Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Evaluation Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Advancing the Theory of Nuclear Data Evaluations [Abstract]

We present recent advances in the R-matrix formalism as well as the Bayesian evaluation framework for improved nuclear data evaluations. The advances in the R matrix formalism include: 1) direct processes, 2) doorway, as well as multistep, processes, and 3) various forms of the Reich-Moore approximation for eliminated capture channels. Furthermore, to address unreasonably small posterior uncertainties often encountered in nuclear data evaluations of large data sets using the conventional form of the Bayes’ theorem, we introduce imperfections (of the data or the model) as a formal evaluation tool for taming the evaluated uncertainties in harmony with Bayes’ theorem. These theoretical advances were motivated by the nuclear data evaluations of differential resolved resonance cross section data using the code SAMMY, as well as the integral benchmark experiments using the SCALE code system, being performed at Oak Ridge National Laboratory for the Nuclear Criticality Safety Program. Some pedagogical applications of the new formalism, as well as a snapshot of the SAMMY modernization efforts, will be presented.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

A coupled hydrologic-agroeconomic modeling framework to evaluate adaptive irrigation strategies under groundwater withdrawal restrictions

Growing groundwater scarcity requires integrated tools to capture interactions among hydrology, agricultural production, markets, and land use. This study presents an iterative modeling framework that couples hydrologic, crop-yield, and economic models to capture two-way feedback among water availability, agricultural production, and market responses under groundwater constraints. The primary goal of this paper is to describe the methodological development of the coupled framework and demonstrate the significance of iterative model interaction. Applied to the western United States, we evaluated adaptive responses to restricting groundwater use beyond recharge levels, represented through changes in irrigation management and expansion or shrinkage of crop markets through land reallocation. Results demonstrate that the iterative coupling converges to stable equilibrium responses within 10 iterations. At equilibrium, deficit irrigation emerges as the dominant adaptation strategy in California, with irrigation levels stabilizing at approximately 70% of full irrigation demand, while Arizona and New Mexico experience stronger yield sensitivities. Early iterations produce commodity price increases of up to 10% for fruit and vegetable crops; however, these responses moderate as land allocation and production patterns adjust across regions. Deficit irrigation and spatial reallocation of irrigated land partially offset production losses, with variability observed across different states: California maintains yields primarily via deficit irrigation, whereas Arizona and New Mexico will rely mainly on reducing irrigated area to absorb the shock. By capturing feedback between biophysical and economic processes, this approach highlights how irrigation strategies and land-use decisions evolve under water stress and provides a transferable platform for evaluating water management policies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Decision-Making Framework to Evaluate Opportunities for Recovery of Rare Earth Elements and Critical Minerals in Produced Water Networks

Oil and gas development activities require a significant amount of water. Given the environmental impacts associated with high consumption and subsequent disposal of this water, there is a need for strategies to support effective reuse of, treatment of, and/or resource recovery from this produced water. These streams can contain appreciable concentrations of rare earth elements (REE) and critical minerals (CM) (e.g., Lithium), which are critical for many important applications in electronics, technology, manufacturing, energy, and medicine [1]. Along with REE/CM present in produced water, other waste streams such as fly ash from coal-fired power plants and acid mine discharge present other potential sources for recovery of REE/CM [2-4]. And with increases in demand for REE/CM, the need for recovery from wastewater streams is becoming even more important. There is a need to develop effective decision-making tools to evaluate the economic and environmental potential for REE/CM recovery from produced water networks while supporting the needs of drilling and hydraulic fracturing activities. In this work, we present our progress in developing a decision-making framework to efficiently design and operate produced water networks for REE/CM recovery. Our approach considers REE/CM recovery from produced water streams alongside other potential wastewater sources. The models consider the location and capacity of storage and decentralized treatment processes as well as the design and operation of pipeline and transportation networks to connect different sources and effectively schedule inventories, reuse, and recovery opportunities. We focus on the evaluation of opportunities for REE/CM recovery with treatment constraints on composition and flow. We demonstrate this framework with an illustrative case study that features diverse production sites, storage facilities, transportation, and treatment sites. This proposed framework will be deployed in an open-source software package that is compatible with the PARETO framework to deliver analysis and decision-making tools that allow stakeholders to quantitatively evaluate potential opportunities for REE/CM recovery in produced water networks.

Pulsipher, Joshua↗
DOE OSTI2026

From Bricks to Clicks: Mapping the White Space in Building Innovation

It is a critical national imperative to transform the buildings sector, yet innovation is impeded by deployment failures that leave promising technologies stranded. Conventional market reports and techno-economic analysis provide an insufficient understanding of markets and resource allocation for emerging building technologies. They omit crucial commercialization factors such as ecosystem maturity and adoption friction, where the coordinated participation of a network of suppliers, contractors, financiers, regulators, and integrators is required to scale solutions. This study addresses these gaps by introducing an evaluation framework grounded in front-line data from six years of the DOE's IMPEL incubator, comprising experience from 300 building-sector innovators and the adjacent, complex ecosystem. Our methodology synthesizes top-down market analysis with bottom-up, practitioner-level data across five megatrends: (M1) Affordable materials and industrialized construction; (M2) Healthy and efficient mechanical systems; (M3) Intelligent building operations; (M4) Buildings as grid assets; and (M5) High-density power and cooling for data centers and therein identify twelve "white space" technology opportunities. Next, we develop a multi-criteria scoring rubric to rank these opportunities based on parameters, i.e., Affordability, Quality of Life, Reliability, and Security, yielding composite ‘Demand’ and ‘Maturity’ indices. Our results indicate that the most significant white spaces may not be incremental products but a new class of ‘Ecosystem Enablers’, such as logistics platforms, orchestration layers, and automated compliance software that solve structural deployment gaps. This paper summarizes this transparent, evidence-based, practitioner-informed evaluation framework for policymakers and investors to re-evaluate policy and resource allocation and unlock scalable market transformation.

Singh, Reshma↗
DOE OSTI2022

A framework for evaluating power electronic systems for grid integration

As power electronic systems (PESs) grow increasingly complex, integrating and testing these systems in the development stages is becoming more crucial and more challenging. New modes and resource integration strategies are in development and must be tested before pilot demonstrations and mass production. This paper proposes a framework for testing of PES technologies including early validation with integration of simulated resources. The framework is demonstrated to work in two example configurations as proof of principle.

Dean, Ben↗
DOE OSTI2022

Building a better framework for evaluating human well-being impacts in global change analysis: The example of energy security

Human well-being can be greatly impacted by the global environmental and socio-economic change captured in Integrated Models of Global Change (IMGCs). Though most IMGCs address some aspects of well-being, their underlying modeling approach and ‘philosophy’ differ widely, and some key elements – like energy security – are omitted. In this report, we describe a project in which we set out to a create a framework through which the well-being dimensions of the household are connected to key drivers of socio-economic and environmental change – and how the needed metrics, data and modeling methods can be brought to bear. We focus on the well-being dimensions of energy, and lay out the necessary elements to capturing household energy security – using household energy burden as the relevant metric. We begin by showing the conceptual linkage of energy burden to environmental drivers like temperature change, using a simple and straightforward conceptual framework. We then go further to use the example of GCAM-USA to show how some key analytical features of the model can provide insight into how energy security across different groups can change along alternative pathways to sustainability. We compare our preliminary assessment of household energy burden to existing data and suggest further steps to improve and refine this analysis in future research.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

gdess: A framework for evaluating simulated atmospheric CO 2 in Earth System Models

Atmospheric carbon dioxide (CO 2 ) plays a key role in the global carbon cycle and global warming. Climate-carbon feedbacks are often studied and estimated using Earth System Models (ESMs), which couple together multiple model components—including the atmosphere, ocean, terrestrial biosphere, and cryosphere—to jointly simulate mass and energy exchanges within and between these components. Despite tremendous advances, model intercomparisons and benchmarking are aspects of ESMs that warrant further improvement (Fer et al., 2021; Smith et al., 2014). Such benchmarking is critical because comparing the value of state variables in these simulations against observed values provides evidence for appropriately refining model components; moreover, researchers can learn much about Earth system dynamics in the process (Randall et al., 2019). We introduce `gdess` (a.k.a., Greenhouse gas Diagnostics for Earth System Simulations), which parses observational datasets and ESM simulation output, combines them to be in a consistent structure, computes statistical metrics, and generates diagnostic visualizations. In its current incarnation, `gdess` facilitates evaluating a model's ability to reproduce observed temporal and spatial variations of atmospheric CO 2 . The diagnostics implemented modularly in `gdess` support more rapid assessment and improvement of model-simulated global CO 2 sources and sinks associated with land and ocean ecosystem processes. We intend for this set of automated diagnostics to form an extensible, open source framework for future comparisons of simulated and observed concentrations of various greenhouse gases across Earth system models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Dynamic Microgrids in Resilient Distribution Systems With Reconfigurable Cyber-Physical Networks

Modern distribution systems energized by inverter-interfaced distributed generators (DGs) operate as coupled cyber-physical networks (C/P-networks), where the controllable components in the physical network (P-network) are coordinated through the cyber network (C-network). The concept of dynamic microgrids (MGs) operation has been adopted to enable distribution system autonomous operation with varying electric boundaries. To further enhance system operation resiliency and flexibility, dynamic MGs operation with reconfigurable C/P-networks is discussed in this work. An evaluation framework is proposed to assess the operational feasibility of distribution feeders with multiple inverter-based dynamic MGs and come out with possible restoration solutions in the context of cross-layer C/P-network reconfiguration. Furthermore, distributed controllers are developed for components with different operating characteristics to realize seamless system topology variations and provide coordinated secondary regulation in various operation modes. Furthermore, the proposed evaluation framework along with the developed distributed controller has been validated using a Hardware-in-the-Loop (HIL) real-time CPS testbed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

ReSpike: A Co-Design Framework for Evaluating SNNs on ReRAM-Based Neuromorphic Processors

With Moore’s law approaching its end, traditional von Neumann architectures are struggling to keep up with the exceeding performance and memory requirements of artificial intelligence and machine learning algorithms. Unconventional computing approaches such as neuromorphic computing that leverage spiking neural networks (SNNs) to perform computation are gaining traction and seek the paradigm shift necessary to sustain the increasing demands of modern applications. Novel memory technologies, such as resistive RAM (ReRAM), employ a crossbar architecture that possesses the inherent capability of efficiently computing vector-matrix multiplication—a dominant operation in SNNs. The prospect of naturally mapping SNNs to the crossbar structures provides a unique opportunity for achieving a high-performance, power-efficient neuromorphic system. In this work, we present ReSpike, which is a new framework, behavioral simulator, and architectural design based on ReRAM crossbar architectures, enabling modeling and co-design to achieve efficient execution of SNNs. We drive this co-design forward by quantifying the impact that ReRAM cell nonidealities have on the corresponding accuracy of an SNN application.

Asifuzzaman, Kazi [ORNL] (ORCID:0000000240044791)↗
DOE OSTI2025

A cost–benefit framework to evaluate capacity upgrade options in overhead line transmission planning

This paper presents the methodology behind the new Reconductoring Economic and Financial Analysis (REFA) tool, an open-access software, used by transmission utilities to evaluate transmission capacity enhancement options. The proposed methodology is intended to be used in a new planning stage, after the capacity expansion and prior to the individual transmission project engineering, allowing capacity upgrade options (reconductoring, rebuild or voltage upgrade), and respective conductor selection, to be compared under the same economic basis. Furthermore, the REFA tool implements a methodology to rank project options and conductor types based on economic criteria, considering an approximation of the ampacity and sag constraints. Results, using 5 real transmission lines in the US, show that least-cost combinations of project and conductor types can be very diverse, which emphasizes the need for the proposed methodology and tool.

Advanced conductors↗
DOE OSTI2025

A hybrid numerical and machine learning framework for evaluating the performance of a 780 cm 2 aqueous organic redox flow battery

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low capacity degradation in 10 cm2 cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier for commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm 2 DHP-based AORFB by combining physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical quantities and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. These combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks the first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE↗
DOE OSTI2023

A Statistical Framework for Evaluating Rain Microphysics in Model Simulations and Disdrometer Observations

Abstract Statistical analyses of a large disdrometer data set and a diverse set of model simulations for convection using the Regional Atmospheric Modeling System were conducted, with the mutual goal of providing insights into precipitation formation and microphysical processes. We demonstrate that a two‐moment bulk microphysical model successfully captures the dominant observed modes of variability in rainfall related to rainfall intensity and raindrop size distributions. The model reproduced the general distribution of observed precipitation groups (PGs) derived from Principal Component Analysis. The multi‐variable analysis also uncovered some shortcomings in the model as well as limitations of the disdrometer data. The model solutions were constrained in their predicted drop size distributions (DSDs) due to the fixed DSD parameters assumed in a two‐moment microphysics scheme. A case study from the Mid‐latitude Continental Clouds and Convection Experiment field project demonstrated how model results can be used to contextualize the disdrometer observations which are limited in sample size, spatial coherence, and detection of small drops and low drop concentrations. The case study also showed that the spatial patterns of the statistically derived PGs revealed by the model are consistent with the hypothesized microphysical processes that determine surface rain DSDs. This work demonstrates how leveraging the strengths of observations and models together can improve our understanding and representation of rain microphysical processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Author Correction: A framework to evaluate machine learning crystal stability predictions

In the version of this article initially published, Figs. 1–3, Table 1 and the Supplementary Information presented more models than were present in the accepted version of the article, and which were not discussed in the text. The Supplementary Information has been revised and the figures and table are now updated in the HTML and PDF versions of the article.

Riebesell, Janosh↗
DOE OSTI2024

A Novel Framework to Evaluate the Costs and Potential of Bioenergy in Decarbonization of the U.S. Economy

The long-term strategy of the United States targets reaching economy-wide net-zero emissions by 2050 and a carbon-neutral electricity grid by 2035 (U.S. Department of State and U.S. Executive Office of the President, 2021). Meeting these targets would require considerable changes to the energy system. Some key characteristics of illustrative net-zero energy systems include increased penetration of renewable energy and carbon sources, use of CO2 capture and storage (CCS) in hard-to-abate sectors, and a greater role for energy carriers such as electricity and hydrogen (Davis et al, 2018). Another common feature of such energy systems is the need for carbon dioxide removal (CDR) approaches (Horowitz et al, 2022). Across all these characteristics of net-zero energy systems, bioenergy and biomass feedstock is anticipated to play an important role. Biomass feedstock serves as a renewable carbon source. This can enable conversion of such feedstock into fuels and energy carriers for hard-to-abate sectors such as aviation. Indeed, the U.S. Government has a target to meet all jet fuel demand by 2050 from sustainable aviation fuel (SAF), where biofuel pathways are likely to have an important role (EERE, 2020). Bioenergy is also highly versatile with the possibility to convert feedstock into electricity, hydrogen, liquid fuels, heat or high-value products, based on biomass type, demand and technology availability (Clarke et al, 2022). Combination of bioenergy with CCS can also nominally deliver CDR (Fuhrman et al, 2023). As such, the share of bioenergy is expected to grow by at least five time across scenarios studied for the long-term strategy of the U.S. between 2020 and 2050 (Horowitz et al, 2022). Notwithstanding the role of bioenergy in the energy systems, its deployment, costs and scalability are influenced by a number of factors. Some of these factors pertain to policy interventions such as imposition of a binding decarbonization target either at an economy-wide level or the sectoral level. Resource availability and type of biomass feedstock also varies considerably across regions. From a technological perspective, the readiness of bioenergy conversion pathways is subject to high variability. This influences the costs of deployment. Moreover, the sourcing of feedstock, grid carbon intensity, and co-product handling approaches all affect the life cycle efficacy of bioenergy. The latter, in turn, is particularly important in determining the extent to which bioenergy with CCS or BECCS can effectively deliver CDR (Fajardy and Mac Dowell, 2017).

air emission↗
DOE OSTI2021

A Cybersecurity Event Simulation Tool and Platform

Digital Instrumentation and Control Systems (ICSs) have replaced analog control systems in nuclear power plants raising cybersecurity concerns. To study and understand the cybersecurity risks of nuclear power plants both high fidelity models of the plant physics and controllers must be created, and a framework to test and evaluate cyber security events must be established. A testing and evaluation framework of cybersecurity events consists of a method of interfering with control systems, a simulation of the plant network, and a network packet capture and recording tool. Sandia National Labs (SNL) in collaboration with the University of New Mexico’s Institute for Space and Nuclear Power Studies (UNM-ISNPS) is developing such a cybersecurity testing framework.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗