Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Lightweight Materials - Carbon Fiber and Polymer Composites, Integrated Computational Materials Engineering (ICME) Predictive Tools Development for Low-Cost Carbon Fiber for Lightweight Vehicles (University of Virginia) (Final Report)

This project aimed to develop low-cost alternative precursors and processing techniques through the implementation of an integrated computational materials engineering (ICME) framework to evaluate precursor conversion kinetics. Once established, this framework was then used to down-select precursors for laboratory- and pilot-scale production to validate resulting carbon fiber (CF) material properties and process cost-savings. The two most promising approaches to reduce the cost of CFs were to (1) use new low-cost precursors and (2) reduce the energy requirements of CF processing. These approaches were investigated over the course of three phases of work, spanning 3.5 years. This report describes the overall project objectives, approach, and the key accomplishments in each phase.

36 MATERIALS SCIENCE↗
DOE OSTI2023

An open-source framework for simulation-based testing of buildings control strategies

Here this paper presents a simulation framework for evaluating building control strategies (BCSs), developed with VOLTTRON, an opensource platform that integrates data, devices, and systems for sensing and control applications, and is based on co-simulation interfaces. It realizes an integrated environment for both testing and deploying BCSs, thereby eliminating the need for having a dedicated implementation of BCS for testing. For the first time, this framework provides critical functionalities, including scalable communication management and time-drive simulation advance, i.e., advancing the simulation based on clock time. We applied this framework to evaluating two BCSs from ASHRAE Guideline 36-2008 and ASHRAE Standard 90.1-2019. The evaluation results show that those BCSs primarily benefit the heating operation by reducing gas usage but yield insignificant savings in electricity consumption. The results also emphasize the importance of tuning the parameters of the BCSs to achieve better performances.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Initial Development of Fusion Magnet Simulation Capabilities for Performance and Safety Evaluation Using the MOOSE Framework

Fusion energy holds the promise of being a transformative technology as a carbon-neutral, sustainable source of energy. Whole device modeling and the development of fusion digital twins will be increasingly important for emerging fusion device concepts at both national laboratories and within the commercial fusion industry. However, meeting the challenge of whole device modeling of fusion energy devices requires robust, multiphysics, multiscale modeling and simulation technologies capable of running on large-scale supercomputers. Detailed analysis of individual systems at-scale is also required to ensure safe and efficient operation as well as provide the safety basis for future device designs and licensing activities. In a tokamak, toroidal and poloidal magnets confine and shape the fusion plasma to promote the fusion reaction. High plasma temperatures and high magnetic field requirements in modern design concepts (leading to high amounts of energy stored within each magnet) impose electrical, thermal, and mechanical loads on the magnet components, which in turn impacts the safety considerations of the magnet and their supporting systems. Idaho National Laboratory (INL) has a history of working in this space, including development and benchmarking of the Magnetic System Circuitry Analysis Program (MSCAP) and Magnet Arcing (MAGARC) codes to study magnet quench events; notably, MAGARC was used to study quenching during the ITER Engineering Design Activity. However, these legacy codes and capabilities are not parallel and scalable, and new tools are required for future advances in this area, which leads to the INL-developed Multiphysics Object-Oriented Simulation Environment (MOOSE) framework. Developed originally for fission reactor systems under United States Department of Energy, Office of Nuclear Energy modeling and simulation programs, the MOOSE framework has been well-suited to multiscale, multiphysics modeling and simulation needs for nuclear systems. The framework is open-source, well-tested, under continuous development and deployment, and developed to a Nuclear Quality Assurance, Level 1 software quality standard. MOOSE has also been used in the fusion space previously in several projects: INL’s Tritium Migration Analysis Program, Version 8 (TMAP8) for tritium migration, UK Atomic Energy Authority’s A Unified Resource for OpenMC (fusion) Reactor Applications (AURORA) code for fusion thermo-mechanical and neutronics analysis, and Argonne National Laboratory’s Cardinal for high-fidelity computational fluid dynamics and neutronics. However, to model superconducting magnets, several MOOSE enhancements are required: additions to the current MOOSE electromagnetic capabilities, new material libraries for superconductors of interest (such as YBCO), as well as fusion-specific models for thermo-mechanics. This talk will discuss initial development activities to build these capabilities in MOOSE, focusing on initial validation and benchmarking activities. Proposed coupling workflows and future work to support the simulation of fusion magnets and magnet structural assemblies for performance and safety evaluation in MOOSE will also be discussed.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

A Power Outage Data Informed Resilience Assessment Framework

Catastrophic impacts to power systems due to disruptive events have increased significantly during the last decade. These events highlight the need to develop approaches to assess the resilience of power systems against extreme events. However, the availability of data that capture power system performance during and after disruptive events is scarce. This paper proposes an assessment framework to evaluate the performance aspects of the grid system during extreme outage events using the Environment for Analysis of Geo-Located Energy Information (EAGLE-I) data. EAGLE-I includes information related to the number of impacted customers, duration, and location of power outages in the United States. Statistical analyses were conducted to extract resilient-based outage data and derive probability distribution functions of their impact and recovery characteristics. A list of extreme events is identified based on few predetermined threshold values. Metrics from other power outage assessments were used to measure the characteristics of each event, including impact rate and duration, recovery rate and duration, and impact level. A probability distribution function is obtained for each metric. The obtained results provide a representation of national grid performance during extreme events, which can be applied as a framework to evaluate various resilience enhancement techniques.

EAGLE-I↗
DOE OSTI2022

Designing Porous Ion Emitters for Thermal Ionization Mass Spectrometry: Evaluating Metal-Organic Frameworks

In this work we describe the first exploration of metal-organic frameworks (MOFs) as ‘next generation’ ion emitters for thermal ionization mass spectrometry (TIMS). MOFs were identified as promising candidates for this application given the synthetic control over their desired structural properties. This tunability results in well-ordered, high surface area, high porosity frameworks with targeted sorption affinities. Here we explored an aluminum-based, bipyridine-containing MOF (MOF-253) with and without incorporating the high work function metal, rhenium (Re). After analysis of a Nd-bearing MOF, we hypothesized that the well-dispersed, sponge-like interconnected network of the degraded structure would enhance Nd ionization more than traditional TIMS loading activators (i.e., phosphoric acid). Compared to filaments loaded with phosphoric acid that require an additional benzene carburization step, the Nd ionization efficiencies (atoms detected relative to atoms loaded) for heated filaments loaded with MOF-253 were similar (~1%). Electron microscopy after TIMS analysis demonstrated that the MOF was retained on the filament and, as hypothesized, preserved sub-micron porosity post analysis. While these results are preliminary, they demonstrate that MOFs have potential to enhance ionization and exceed the performance of traditional loading techniques by forming nano-porous ion emitters (nano-PIEs). Thus, further experimentation is likely to exceed this performance through more specific selection of the base MOF structure and modifications to porosity and composition. This work represents a novel application of MOFs and a next step in the pursuit of advanced thermal ionization with potential to expand across the periodic table.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

An Advanced Machine Learning and Artificial Intelligence System for Demonstrating Radiation Regulatory Compliance in DOE Accelerator Facilities

In this Phase II proposal, Applied Research LLC (ARLLC), Thomas Jefferson National Accelerator Facility (Jefferson Lab), and Old Dominion University (ODU) propose the combination of domain knowledge (beam characteristics, fixed structural shielding, earthen burden (the soil and foliage added to the dome of the experimental halls as additional shielding), etc.), machine learning (ML) and/or artificial intelligence (AI) to correlate a variety of multi-modal onsite signals and the radiation fields seen in accessible areas of the accelerator site and the site boundary. The ML/AI will consider the complex influence of environmental parameters affecting the radon contribution of the measurements, focusing on actual data obtained from Jefferson Lab. In Phase I, the coded beam and location data were fed into a deep learning model to predict doses at several designated locations in Jefferson Lab’s facility. Moreover, a dense radiation map was generated using only a sparse collection of the samples in a facility. In Phase II, we will develop a software prototype containing a radiation prediction algorithm, dense radiation map algorithms, and background noise prediction algorithms, with actual data used to evaluate the prototype. This work will provide a framework for evaluation of radiation measurement results around the site based on learned responses. In addition, the proposed approach allows more granular mapping of radiation levels. Better understanding and communication of these levels is related to the overall approach in keeping doses to personnel ALARA.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Benchmarking machine learning strategies for phase-field problems

Abstract We present a comprehensive benchmarking framework for evaluating machine-learning approaches applied to phase-field problems. This framework focuses on four key analysis areas crucial for assessing the performance of such approaches in a systematic and structured way. Firstly, interpolation tasks are examined to identify trends in prediction accuracy and accumulation of error over simulation time. Secondly, extrapolation tasks are also evaluated according to the same metrics. Thirdly, the relationship between model performance and data requirements is investigated to understand the impact on predictions and robustness of these approaches. Finally, systematic errors are analyzed to identify specific events or inadvertent rare events triggering high errors. Quantitative metrics evaluating the local and global description of the microstructure evolution, along with other scalar metrics representative of phase-field problems, are used across these four analysis areas. This benchmarking framework provides a path to evaluate the effectiveness and limitations of machine-learning strategies applied to phase-field problems, ultimately facilitating their practical application.

36 MATERIALS SCIENCE↗
DOE OSTI2024

A Hybrid Anomaly Detection Approach for Obfuscated Malware

With the rapid evolution of malicious software, cyber threats have become increasingly sophisticated, employing advanced obfuscation techniques to evade traditional detection methods. This study presents a hybrid anomaly detection approach applied to obfuscated malware. Even though there is a large body of research in this field, existing malware detection techniques have some drawbacks, such as requiring large amounts of data, trustworthiness (imprecise results) of algorithms, and advanced obfuscation. To overcome these challenges, there is a need to employ solid and efficient techniques for malware detection. This paper proposes a hybrid approach, combining an autoencoder with traditional machine-learning methods to create an efficient malware detection framework. We used the malware memory dataset (MalMemAnalysis-2022) to evaluate this framework. The results indicate that our proposed approach can detect obfuscated malware when a deep autoencoder used for feature learning is combined with logistic regression, and it is extremely fast with an Accuracy, Detection Rate (DR), Matthew Correlation Coefficient(MCC), and Statistical Parity Difference

malware detection, Hybrid Anomly Detection, Obfusc↗
DOE OSTI2023

Extrapolation Domains for Aggregating Environmental Outcomes from Local to Regional Levels

Billions of dollars are invested every year to run field experiments to quantify the response of crops to new technologies and associated environmental outcomes. Given the diversity of environments where crop production occurs, conducting these research studies without a robust framework for research site selection and upscaling results to larger spatial scales is inefficient. In this project, researchers from the University of Nebraska-Lincoln used their unique Technology Extrapolation Domains framework (TED) as a tool to guide the selection of experimental sites and as basis for aggregating and validating environmental outcomes from local to regional levels. In the present project, we first used the TED framework to evaluate the current distribution and area coverage of the current SMARTFARM sites. The purpose was to showcase how it is possible to use the TED framework to guide site selection and extrapolate results over space. Additionally, the original TED framework was expanded to account for other factors influencing environmental outcomes by inclusion of three additional variables: soil organic matter, soil texture, and topographic wetness index. The resulting expanded framework (TED-E) was validated using nitrogen (N) losses from corn in the United States as a case study. To do so, we used N balance as a proxy to N losses and we evaluated the capacity of the framework to explain variation in N balance across fields and across countries. We found that the TED-E has substantially higher predictive power than the original TED framework to explain spatial variation in N balance. However, improvements in predictive power with the TED-E tool come at the expense of a higher number of TEDs needed to achieve a given crop area coverage compared with the original TED framework. We conclude that the new TED-E framework can help aggregate and extrapolate environmental outcomes from research sites to regional levels and improve the visualization of their spatial patterns across the United States. An online version of the framework is available at: https://www.toolted.org/

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Advances in Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework.

The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Fuel Cycle Technology (FCT) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two high priorities for SFWST disposal R&D are design concept development and disposal system modeling. These priorities are directly addressed in the SFWST ''Geologic Disposal Safety Assessment'' (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, ''GDSA Framework'', for evaluating disposal system performance for nuclear waste in geologic media. ''GDSA Framework'' is supported by SFWST Campaign and its predecessor the Used Fuel Disposition (UFD) campaign. This report fulfills the GDSA Uncertainty and Sensitivity Analysis Methods work package (SF-20SN01030403) level 3 milestone — ''Advances in Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework'' (M3SF-20SN010304032). It presents high level objectives and strategy for development of uncertainty and sensitivity analysis tools, demonstrates uncertainty quantification (UQ) and sensitivity analysis (SA) tools in GDSA Framework in FY20, and describes additional UQ/SA tools whose future implementation would enhance the UQ/SA capability of ''GDSA Framework''. This work was closely coordinated with the other Sandia National Laboratory GDSA work packages: the GDSA Framework Development work package (SF- 2051\101030404), the GDSA Repository Systems Analysis work package (SF-2051\101030405), and the GDSA PFLOTRAN Development work package (SF-20SN01030406). This report builds on developments reported in previous ''GDSA Framework'' milestones, particularly M2SF- 19SNO1030403.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2021)

The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Fuel Cycle Technology (FCT) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two high priorities for SFWST disposal R&D are design concept development and disposal system modeling. These priorities are directly addressed in the SFWST Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media. GDSA Framework is supported by SFWST Campaign and its predecessor the Used Fuel Disposition (UFD) campaign. This report fulfills the GDSA Uncertainty and Sensitivity Analysis Methods work package (SF-21SN01030404) level 3 milestone, Uncertainty and Sensitivity Analysis Methods and Applications in GDSA Framework (FY2021) (M3SF-21SN010304042). It presents high level objectives and strategy for development of uncertainty and sensitivity analysis tools, demonstrates uncertainty quantification (UQ) and sensitivity analysis (SA) tools in GDSA Framework in FY21, and describes additional UQ/SA tools whose future implementation would enhance the UQ/SA capability of GDSA Framework. This work was closely coordinated with the other Sandia National Laboratory GDSA work packages: the GDSA Framework Development work package (SF-21SN01030405), the GDSA Repository Systems Analysis work package (SF-21SN01030406), and the GDSA PFLOTRAN Development work package (SF-21SN01030407). This report builds on developments reported in previous GDSA Framework milestones, particularly M3SF 20SN010304032.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Uncertainty and Sensitivity Analysis Methods and Applications in the GDSA Framework (FY2022)

The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Fuel Cycle Technology (FCT) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). Two high priorities for SFWST disposal R&D are design concept development and disposal system modeling. These priorities are directly addressed in the SFWST Geologic Disposal Safety Assessment (GDSA) control account, which is charged with developing a geologic repository system modeling and analysis capability, and the associated software, GDSA Framework, for evaluating disposal system performance for nuclear waste in geologic media. GDSA Framework is supported by SFWST Campaign and its predecessor the Used Fuel Disposition (UFD) campaign.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗