Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Molten Salt Corrosion Tests of Additively Manufactured Stainless Steel 316H

Molten salt reactors (MSRs) have drawn considerable interest due to their favorable safety features, high thermal efficiency, and compatibility with different fuel cycles. Yet, the success of MSRs hinges critically on the performance of structural materials to be used in these aggressive molten salt environments, where corrosion and material compatibility remain primary challenges to long-term reliability. Additively manufactured (AM) nuclear structural materials prompt the use of novel geometries and compositions to enhance material performance and reduce costs of constructing MSRs. The rapid solidification conditions inherent to AM processing impart distinctive microstructural features, including cellular sub-structures, dislocation densities, residual stress, and oxide inclusions, which can influence material performance in MSR components. While the mechanical properties of AM stainless steels have been widely studied, their corrosion behavior, particularly in molten salt environments, has received far less attention. Addressing these needs, the Advanced Materials and Manufacturing Technologies (AMMT) program provides a framework for systematically evaluating how unique microstructures produced by AM processes influence the performance of these materials in these demanding environments and for developing reproducible testing workflows that can support future code qualification efforts and standards development. Bridging this knowledge gap is essential for assessing the viability of AM alloys in MSRs and informing qualification strategies. A further challenge is the absence of standardized protocols for molten salt corrosion testing. Accordingly, this report provides an account of the corrosion evaluation of AM 316H stainless steel in NaCl 2 -MgCl 2 molten salt at 550 °C, with exposure times of 100 and 500 hours. It documents the experimental procedures implemented under the AMMT program, including salt preparation, exposure protocols, and post-test characterization methods, to establish reproducibility and transparency. Importantly, the study examines AM 316H samples in the as-fabricated condition, directly reflecting the surface state most relevant to engineering applications, and compares their behavior to machine-cut surfaces. Overall, preliminary evaluations have noted that surface conditions (e.g. morphology, contamination, etc.) have a noticeable impact on the corrosion resiliency. The impact of the corrosion is difficult to detect at 100h, unless, in the case of AM 316H, the specimen surface is decontaminated. After 500 h, as-fabricated surfaces of AM and wrought 316H display evidence of general versus preferential corrosion attack, respectively. Both AM and wrought 316H machine-cut surfaces exhibit a continuous Cr depletion zone, evident of general corrosion. While the estimated extent of corrosion appears within the same order of magnitude regardless of the surface condition, it is apparent that more predictable behavior is observed on machine-cut surfaces. Nonetheless, further investigation is necessary to fully elucidate the corrosion mechanism under these conditions.

36 - MATERIALS SCIENCE↗
DOE OSTI2022

Performing Bayesian Analyses With AZURE2 Using BRICK: An Application to the 7 Be System

Phenomenological R-matrix has been a standard framework for the evaluation of resolved resonance cross section data in nuclear physics for many years. It is a powerful method for comparing different types of experimental nuclear data and combining the results of many different experimental measurements in order to gain a better estimation of the true underlying cross sections. Yet a practical challenge has always been the estimation of the uncertainty on both the cross sections at the energies of interest and the fit parameters, which can take the form of standard level parameters. Frequentist (χ 2 -based) estimation has been the norm. In this work, a Markov Chain Monte Carlo sampler, emcee, has been implemented for the R-matrix code AZURE2, creating the Bayesian R-matrix Inference Code Kit (BRICK). Bayesian uncertainty estimation has then been carried out for a simultaneous R-matrix fit of the 3 He (α,γ) 7 Be and 3 He (α,α) 3 He reactions in order to gain further insight into the fitting of capture and scattering data. Both data sets constrain the values of the bound state α-particle asymptotic normalization coefficients in 7 Be. The analysis highlights the need for low-energy scattering data with well-documented uncertainty information and shows how misleading results can be obtained in its absence.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Regulations for Bat Protection in Mexico's Wind Farms

Wind energy development has expanded the fastest globally among all renewable sources during the last 20 years. However, wind farms have documented adverse impacts on bats, including mortality from collisions with turbine blades and disruptions to habitat and behavior. As the world's sixth most attractive economy for renewables, with 70 operating wind farms, Mexico and its bats now face escalating threats from the country's burgeoning wind industry. Despite this rapid growth, few studies have analyzed Mexico's regulatory framework to prevent, evaluate, and mitigate wind farm effects on bats. In this study, we reviewed Mexican laws and treaties that facilitate wind farm permitting, construction, operation, and decommissioning, and searched for guidelines that specifically address bat conservation. We found eight international pacts that promote wind power adoption along with three relevant articles in Mexico's Constitution. The General Law of Ecological Balance and Environmental Protection proved most pertinent for impact management. Supplementary guidelines from the Ministry of Environment and Natural Resources offer general strategies for evaluating wind farm impacts on bats, but adherence remains voluntary. Given expanding wind power investments across Mexico, we highlight the need for more stringent national standards that require preventative and corrective measures to protect bat populations. Tighter legislation and enforcement offer pathways toward environmentally sustainable wind energy development in Mexico.

17 WIND ENERGY↗
DOE OSTI2025

Validation of Pronghorn for Natural-Circulation Molten Salt Loops

This paper presents the development and validation of a high-fidelity thermal-hydraulic model of a molten salt natural circulation flow loop, designed for integration within a digital twin framework. The study evaluates the performance of Idaho National Laboratory’s Pronghorn against experimental data from Texas A&M University Molten Salt Flow Loop (MSFL) four Hitec-salt test benchmark data. Natural circulation of high-Prandtl-number fluids exhibits complex, counter-intuitive flow patterns that make pointwise thermocouple readings unreliable. Experimental work at TAMU’s MSFL provides benchmark data, including flow visualization at a test-section and centerline steady-state temperature measurements along the loop. Validation includes four single-phase natural circulation test cases with Hitec salt. Key metrics include flow profile agreement and steady-state temperature accuracy. Pronghorn results for two-dimensional single-phase agree qualitatively with the experimental flow profile. This paper illustrates the importance of Computational Fluid Dynamics (CFD) in elucidating the behavior of high-Prandtl-number thermal-hydraulics, along with how misleading centerline temperature measurements can be. Pronghorn reproduces the axial and radial stratification that makes single thermocouple readings unreliable. Future research will focus on reduced-order modeling techniques to enable rapid simulation suitable for real-time digital twin applications. The validated cases provide a basis for developing reduced-order surrogates aimed at real-time digital-twin applications.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Phenomenon Identification and Ranking Table Development for Future Application Figure-of-Merit Studies on Thermal Energy Storage Integrations with Light Water Reactors

There are no standard prioritization criteria for evaluating thermal energy storage (TES) options for use in integrated energy systems. A framework for proposing, analyzing, and presenting energy storage integration with power producers and users is presented along with a specific figure-of-merit (FOM) study based in this framework. This basis for evaluating storage technologies can provide a structure for the energy industry to analyze and prioritize energy storage in different applications and environments. The phenomena identification and ranking table (PIRT) presents a series of design questions specific to energy storage applications. The FOM study, built in this PIRT framework based on a nuclear-renewable hybrid energy system using TES to produce power and provide process energy for a secondary user, successfully identified specific technologies to use based on the project requirements. Expanding the library of projects using this framework will expand the deployable options for energy storage and increase its potential for energy security.

25 ENERGY STORAGE↗
DOE OSTI2023

How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system

Both model predictive control (MPC) and deep reinforcement learning control (DRL) have been presented as a way to approximate the true optimality of a dynamic programming problem, and these two have shown significant operational cost saving potentials for building energy systems. Furthermore, there is still a lack of in-depth quantitative studies on their approximation levels to the true optimality, especially in the building energy domain. To fill in the gap, this paper provides a numerical framework that enables the evaluation of the optimality levels of different controllers for building energy systems. This framework is then used to comprehensively compare the optimal control performance of both MPC and DRL controllers with given computation budgets for a single zone fan coil unit system. Note the optimality is estimated based on a user-specific selection of trade-off weights among energy costs, thermal comfort and control slew rates. Compared with the best optimality we can find through expensive optimization simulations, the best DRL agent can maximally approximate the optimality by 96.54%, which outperforms the best MPC whose optimality level is 90.11%. However, due to the stochasticity, the DRL agent is only expected to approximate the optimality by 90.42%, which is almost equivalent to the best MPC. Except for Proximal Policy Optimization (PPO), all DRL agents can have a better approximation to the optimality than the best MPC, and are expected to have better approximation than the MPC with a prediction horizon of 32 steps (15 min per step). In terms of reducing energy cost and thermal discomfort, MPC can outperform the rule-based control (RBC) by 18.47%–25.44%. DRL can be expected to outperform RBC by 18.95%–25.65% ,and the best DRL control policy can outperform RBC by 20.29%–29.72%. Although the comparison of the optimality level is performed in a perfect setting, e.g., MPC assumes perfect models, and DRL assumes a perfect offline training process and online deployment process, this can shed insight on their capabilities of approximating to the original dynamic programming problem.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

pnnl/OpenCGRA

OpenCGRA is an open-source framework for modeling, testing, and evaluating CGRAs. The first open-source integrated framework able to support the full top-to-bottom design flow for specializing and implementing CGRAs: modeling at different abstraction levels (functional level, cycle level, register-transfer level) with compiler support, verification at different granularities (unit testing, integration testing, property-based testing), simulation, generation of synthesizable Verilog, and characterization (area, power, and timing).

Cheng, Tan↗
DOE OSTI2023

Evaluating energy justice metrics in early-stage science and technology research using the JUST-R metrics framework

Embedding principles of energy justice throughout all aspects of clean energy technology research and development (R&D) can facilitate a more just energy transition; yet gaps remain in our understanding of how to best integrate energy justice from the earliest R&D stages. The Justice Underpinning Science and Technology Research (JUST-R) metrics framework has been developed to enable early-stage energy researchers to assess and address justice considerations associated with their research, but the impacts of the framework, and others like it, have yet to be evaluated. This study seeks to evaluate the JUST-R metrics framework in terms of its effectiveness and appeal to researchers engaged in early-stage technical R&D using qualitative analyses of documents and workshop transcripts. We find that the metrics framework helps researchers identify problems and potential solutions surrounding the energy justice implications of their work and spurs a change in perspective for researchers, but, simultaneously, there is no evidence of solution follow-through within the evaluation timeframe. Greater institutional support, specialization to research areas, knowledge of energy justice fundamentals, and earlier incorporation of energy justice considerations in research projects arise as factors needed to aid continued use of the framework and pursuit of identified solutions. This evaluation protocol and these findings can serve as a guide for improving other frameworks with similar goals of encouraging sociotechnical engagement in early-stage energy R&D.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2019

Microstructural Modeling of the α + β Phase in Ti-6Al-4V: A Diffusion-Based Approach

Complex heat treatment operations and advanced manufacturing processes such as laser or electron-beam welding will see the metallic workpiece experience a considerable range of temperatures and heating/cooling rates. These intrinsic conditions will have a significant bearing upon the microstructure of the material, and in turn upon the thermo-mechanical properties. In this work, a diffusion-based approach to model the growth and shrinkage of precipitates in the alpha + beta field of the common titanium alloy Ti-6Al-4V is established. Further, the numerical model is extended using a JMA-type approach to explore the dependency of the beta-transus temperature on extremely high heating rates, whereby dissolution alone is too slow to accurately describe the alpha to beta-phase transformation. Experimental heat treatments at rates of 5, 50, and 500 °C/s were performed, and metallographic analysis of the samples was used to validate the numerical modeling framework predictions for lamellar shrinkage, while data from the literature has been used to evaluate the numerical modeling framework for the growth of equiaxed microstructures. The agreement between measurements and numerical predictions was found to be good.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Diesel Fuel Consumption in Prominent U.S. Open-Pit Mines: Site-Level Estimates

This report presents a comprehensive framework for estimating diesel fuel consumption and prices at open-pit mines in the United States. The framework includes transparent methods for calculating site-level diesel energy use when direct reporting is unavailable, and a structured confidence evaluation for each method. The framework is demonstrated to estimate current diesel consumption at 21 open-pit mines in the United States. Initial findings support ongoing efforts to strengthen the competitiveness and security of the U.S. industrial base by supporting data-driven supply chain analysis and decision-making, improved transparency in mining sector energy use, and targeted deployment of energy innovation and cost-reduction strategies. Future updates to the dataset—coupled with expanded data transparency and method validation—will help ensure that the findings remain relevant as the sector continues to evolve.

02 PETROLEUM↗
DOE OSTI2023

GAHLS: an optimized graph analytics based high level synthesis framework

The urgent need for low latency, high-compute and low power on-board intelligence in autonomous systems, cyber-physical systems, robotics, edge computing, evolvable computing, and complex data science calls for determining the optimal amount and type of specialized hardware together with reconfigurability capabilities. With these goals in mind, we propose a novel comprehensive graph analytics based high level synthesis (GAHLS) framework that efficiently analyzes complex high level programs through a combined compiler-based approach and graph theoretic optimization and synthesizes them into message passing domain-specific accelerators. This GAHLS framework first constructs a compiler-assisted dependency graph (CaDG) from low level virtual machine (LLVM) intermediate representation (IR) of high level programs and converts it into a hardware friendly description representation. Next, the GAHLS framework performs a memory design space exploration while account for the identified computational properties from the CaDG and optimizing the system performance for higher bandwidth. The GAHLS framework also performs a robust optimization to identify the CaDG subgraphs with similar computational structures and aggregate them into intelligent processing clusters in order to optimize the usage of underlying hardware resources. Finally, the GAHLS framework synthesizes this compressed specialized CaDG into processing elements while optimizing the system performance and area metrics. Evaluations of the GAHLS framework on several real-life applications (e.g., deep learning, brain machine interfaces) demonstrate that it provides 14.27× performance improvements compared to state-of-the-art approaches such as LegUp 6.2.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Trusted Simulation: Considering Model Quality in the Context of User Trust

A high‐quality simulation model should help its users to easily and appropriately calibrate their trust in the model. Traditional evaluation metrics such as validation and robustness are necessary but insufficient for this task. Trust calibration depends on factors like the model's transparency, applicability to intended use, usability, reputation, and consideration of potential bias. This article proposes a framework for designing and evaluating system dynamics models by considering factors that contribute to the proper calibration of user trust. This framework takes inspiration from trusted artificial intelligence, broadening our traditional concept of model quality and explicitly focusing on what users need to consider a model trustworthy and to understand the model's relevance to its intended purpose. The trusted simulation framework can improve our integration of model quality activities throughout the modeling process, leading to more impactful and better‐targeted model design, development, and evaluation.

Naugle, Asmeret Bier [Sandia National Laboratories↗
DOE OSTI2023

Multidisciplinary design optimization in Architecture, Engineering, and Construction: a detailed review and call for collaboration

The design of buildings has become a complex and multidisciplinary problem involving multiple conflicting objectives as architects and designers address competing technical, economic, environmental, and societal concerns. This has been driving research in Architecture, Engineering, and Construction (AEC) toward rigorous multidisciplinary decision-making frameworks that generate and evaluate numerous design alternatives using multi-objective optimization in concert with simulation and analysis models of varying fidelity and computational expense. While such frameworks are well known and widely employed in the aerospace and systems engineering domains, efforts by design professionals and researchers in the AEC field are scattered at best. In this paper, we provide a detailed review of recent developments in optimization frameworks in the AEC field and subsequently highlight how such developments are largely compartmentalized into separate domains such as structural, energy, daylighting, and other performance factors. Herein, we further discuss the technical challenges involved in concurrent coupled multidisciplinary design optimization (MDO) in the AEC field such as interoperability issues between Building Information Modeling (BIM) environments, analysis/simulation tools, and optimization frameworks. We conclude by outlining research needed for more unified modeling and simulation-based optimization frameworks to aid in complex and multidisciplinary building design processes. We also highlight the need for the identification and development of multi-fidelity simulation tools for use across multiple design phases. As such, this paper contributes a novel roadmap to leverage aerospace and systems engineering research in MDO into the field of AEC, along with a call for researchers in the MDO community to seek collaborations in AEC field.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Floating Wind Turbine Control Optimization

We present a framework for optimizing the control parameters of floating offshore wind turbines (FOWTs). The framework combines aeroelastic simulations with a systems engineering model and control software. In an example of the optimization framework, we minimize tower damage equivalent loading with generator speed constraints. We also study the effect of thrust-limiting control and quantify the trade off between fatigue loading and energy capture using a set of optimal controller designs. Finally, we optimize the controller of four different FOWT models and compare their dynamic responses. Additional details and other use cases for the framework are presented, which can optimize different control problems and evaluate FOWT designs.

controls↗
DOE OSTI2022

FlameNEST: explicit profile likelihoods with the Noble Element Simulation Technique

We present FlameNEST, a framework providing explicit likelihood evaluations in noble element particle detectors using data-driven models from the Noble Element Simulation Technique. FlameNEST provides a way to perform statistical analyses on real data with no dependence on large, computationally expensive Monte Carlo simulations by evaluating the likelihood on an event-by-event basis using analytic probability elements convolved together in a single TensorFlow multiplication. Furthermore, this robust framework creates opportunities for simple inter-collaboration analyses which will be fundamental for the future of experimental dark matter physics.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Understanding the Physics Representation of Deep Learning Models in Environmental Applications

Deep learning (DL) models have been popular in earth and environmental modeling and analysis, which exhibit huge potential in capturing and reconstructing the non-linearity of relevant environmental processes. They are extensively used as analytical tools or emulators for multiple domains (atmosphere, land surface, ocean, and biogeochemistry). Despite their success, their internal working mechanism remains largely unknown. Such a lack of knowledge hinders the identification of physically consistent models that are fully adaptive to non-stationary climate, as well as the development of physics-informed machine learning such as physics-informed neural network (PINN). To establish preliminary knowledge and framework of such physics representation evaluation, this project focuses on an improved understanding of DL models in the environmental applications. DL models are increasingly applied to environmental modeling and prediction. However, they have been evaluated mostly from a performance perspective, and there is a gap in understanding how they represent the known physics internally. Such knowledge is especially critical when applying DL models under climate change conditions, where new inputs are likely outside the ranges of the training datasets. In this project, we reveal how the known physical processes are represented within DL models from both statistical and mechanistic perspectives. Leveraging the traditional model evaluations that focus more on the accuracies of predictions, we establish a framework that examines both the accuracy and physics representation of DL models. This analysis framework can identify DL models that make the correct predictions based on correct physics, thus enhancing the existing explainable artificial intelligence (explainable-AI) portfolio. It lays a foundation for developing novel metrics to evaluate the emerging DL models in environmental applications. This knowledge also informs the development of physics-informed DL models by revealing the direct connections between the known physical processes and specific model components or structures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Data Requirements for Application of Risk-Based Dynamic Contingency Analysis to Evaluate Hurricane Impact to Electrical Infrastructure in Puerto Rico

This paper presents a risk-based dynamic contingency analysis framework that was used to evaluate the hurricane impact to electrical infrastructure in Puerto Rico. PNNL developed a scalable risk-based framework for identifying high-voltage transmission resilience improvements by classifying and prioritizing high-risk power grid contingencies (system failures) under hurricane impact. The risk-based framework is founded on grid outage definitions with their associated probabilities of occurrence from hurricane events, in combination with an impact assessment derived from detailed dynamic cascading failure analysis. This paper focuses on a discussion around data requirements for transmission resilience planning for hurricane events, derived from the development of the risk-based framework and its application to Puerto Rico. This paper launches an important first step in encouraging the engineering community and power system industry to move towards establishing resilience planning as a routine practice. Since actual results for Puerto Rico contain sensitive information, sample simulation results will be used to illustrate the data requirements and risk-based dynamic cascading framework on the Puerto Rico power grid, as well as demonstrate the potential for such a simulation framework. The paper includes a discussion on the lessons learned, importance and need for improved datasets that are not usually considered in traditional power system planning. The paper will also elaborate on how the scalable simulation framework and datasets might be expanded to larger footprints and leveraged for modelling other types of natural disasters.

DCAT, Puerto Rico, hurricane, Power System Stabili↗