Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

An Evaluation of the Economic and Resilience Benefits of a Microgrid in Northampton, Massachusetts

Recent developments and advances in distributed energy resource (DER) technologies make them valuable assets in microgrids. This paper presents an innovative evaluation framework for microgrid assets to capture economic benefits from various grid and behind-the-meter services in grid-connecting mode and resilience benefits in islanding mode. In particular, a linear programming formulation is used to model different services and DER operational constraints to determine the optimal DER dispatch to maximize economic benefits. For the resiliency analysis, a stochastic evaluation procedure is proposed to explicitly quantify the microgrid survivability against a random outage, considering uncertainties associated with photovoltaic (PV) generation, system load, and distributed generator failures. Optimal coordination strategies are developed to minimize unserved energy and improve system survivability, considering different levels of system connectedness. The proposed framework has been applied to evaluate a proposed microgrid in Northampton, Massachusetts that would link the Northampton Department of Public Works, Cooley Dickenson Hospital, and Smith Vocational Area High School. The findings of this analysis indicate that over a 20-year economic life, a 441 kW/441 kWh battery energy storage system, and 386 kW PV solar array can generate $2.5 million in present value benefits, yielding a 1.16 return on investment ratio. Results of this study also show that forming a microgrid generally improves system survivability, but the resilience performance of individual facilities varies depending on power-sharing strategies.

25 ENERGY STORAGE↗
DOE OSTI2021

Microstructure-Based Estimation of Strength and Ductility Distributions for \(\alpha +\beta \) Titanium Alloys

Titanium alloys are processed to develop a wide range of microstructure configurations and therefore material properties. While these properties are typically measured experimentally, a framework for property prediction could greatly enhance alloy design and manufacturing. In this work, a microstructure-sensitive framework is presented for the prediction of strength and ductility as well as estimates of the bounds in variability for these properties. The framework explicitly considers distributions of microstructure via new approaches for instantiation of structure in synthetic samples. The parametric evaluation strategy, including the finite element simulation package FEpX, is used to create and test virtual polycrystalline samples to evaluate the variability bounds of mechanical properties in Ti-6Al-4V. Critical parameters for the property evaluation framework are provided by measurements of single crystal properties and advanced characterization of microstructure and slip system strengths in 2D and 3D. Property distributions for yield strength and ductility are presented, along with the validation and verification steps undertaken. Comparisons between strain localization and slip activity in virtual samples and in experimental grain-scale strain measurements are also discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Livability Assessment of Urban Communities considering the Preferences of Different Age Groups

Livability is one of the major guiding principles for urban planning and policymaking, of which the definition and evaluation have become the crucial research topic. As the progress in socioeconomic development accelerates, the microscale living conditions require more urgent attention. However, few researchers have addressed the assessment of urban livability at a finer spatial scale such as the community scale. Thus, this article aims to evaluate the urban environmental quality at the community level given the residential community as the basic unit of urban living areas. We select eighteen objective indicators from five dimensions to establish an objective indicator system. Taking the preferences of different age groups into account, a comprehensive evaluation framework for the livability of communities combining both subjective perceptions and objective indicator is constructed. Then, it is applied to evaluate the livability of 1,394 residential communities in Ningbo City. There are three significant results from the study. First, different age groups have diverse preferences of demands to the livability of an urban community. The indicators they valued most concentrated in the following two dimensions: the convenience of transportation and the completeness of supporting facilities. Second, there exists significant heterogeneity in the livability of communities among districts. Third, the livability of communities shows a decreasing spatial pattern from the city center to the surroundings. These empirical results can be advantageous to urban planning departments and other relevant stakeholders.

Liang, Xiaojin↗
DOE OSTI2026

Extension of Clad Damage Propagation Model for Fission Gas Dispersal and Two-Phase Flow Effects in MOOSE SubChannel Module

This report presents an extension of the Clad Damage Propagation (CDAP) model implemented in the MOOSE SubChannel Module (SCM) to capture post-failure fission-gas dispersal and two-phase flow effects in sodium-cooled fast reactor assemblies. The extended model tracks discharged gas axially and radially, computes channel-averaged flow quality and void fraction using a Lockhart–Martinelli framework, evaluates two-phase frictional pressure-drop multipliers, determines inlet mass-flow degradation under fixed core pressures, and applies an intensified-void-based heat-transfer degradation to affected fuel pins. Radial plume expansion is parameterized using mineral-oil jet experiments mapped to sodium conditions via Reynolds–Weber similarity. Implementation details are documented, along with the new methods and user inputs needed to control plume mapping and two-phase behavior. Demonstration simulations for 19- and 37-pin bundles show that breach size and inlet velocity strongly influence propagation potential: small breaches (≤0.5 mm) produce limited degradation while larger breaches (~1 mm) can drive oscillatory temperature spikes and enhanced failure propagation, especially at higher velocities. These results demonstrate that the extended CDAP model provides a more complete framework for quantifying cladding damage propagation and evaluating propagation potential in transient scenarios. The approach remains computationally efficient, consistent with subchannel-level analysis, yet incorporates sufficient physics to bridge localized post-failure effects with bundle- and assembly-scale degradation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Trustworthiness modeling and evaluation for a nearly autonomous management and control system

The Nearly Autonomous Management and Control (NAMAC) system supports the advanced reactor operation by recommending control actions to operators based on real-time measurements and digital twins (DTs) learning from the knowledge base. To enable the safe and reliable use of autonomous technologies, NAMAC and its recommendations should be trustworthy to operators and regulators at both the design and operation stages. This study proposes a NAMAC trustworthiness modeling and evaluation framework supported by trustworthiness ontologies and evidence-based approaches. The development-time and run-time ontologies are separately constructed and then converted to Bayesian networks to quantitatively evaluate the NAMAC trustworthiness. This evaluation is demonstrated by collecting and characterizing evidence from NAMAC practices, such as the development and assessment of the NAMAC system, data coverage assessment, and the training and optimizations of neural-network-based DTs. Our proposed approach can aggregate various trustworthiness attributes of complex artificial-intelligence-supported systems for safety-critical applications. It also considers the interaction between different DTs and extends beyond the trustworthiness evaluation of a single DT. In conclusion, the evidence-based method enhances the transparency of the trustworthiness modeling and evaluation processes and helps identify uncertainties and subjectivity involved in the processes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Long-Duration Energy Storage Grid Integration-Valuation Framework and Incentive Gaps

Given these challenges and current modeling gaps on Long Duration Energy Storage (LDES), enhancing the structure and design of existing planning, operations, and organized wholesale markets can better characterize the value of LDES to the power system. To more thoroughly assess the gaps and barriers to LDES investment and readiness for integration into a future grid, we conducted stakeholder outreach through an online survey, interviews with individual independent system operators/regional transmission organizations, and a literature review. Based on this assessment, we identified a set of opportunities for LDES focused development, including a framework to quantify the contributions of LDES on resource adequacy, reliability, and resiliency. Specifically, we identify the potential demand for and benefits of an open-source, LDES-centric evaluation framework that can guide future planning, operations, market design, and policy reforms.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Design and optimization of processes for recovering rare earth elements from end‐of‐life permanent magnets

Recovery of rare earth elements (REEs) from end-of-life (EOL) products represents a strategic opportunity to strengthen the domestic supply chain for rare earth elements. This work presents a superstructure-based optimization framework for finding the most economical processing pathway for different EOL rare earth permanent magnets (REPMs). The framework evaluates state-of-the-art technologies across four processing stages—disassembly, demagnetization, leaching and extraction, and precipitation and calcination—using net present value (NPV) maximization and cost of recovery (COR) minimization objectives. A novel bottom-up costing framework for hydrogen decrepitation is also introduced. Two feedstocks were considered: REPMs from EOL hard disk drives (HDDs), and electric and hybrid electric vehicles (EVs and HEVs). While HDD recycling proved unprofitable due to limited feedstock availability, EVs/HEVs were profitable across a range of parameters and cost estimates. Therefore, our findings suggest that the proposed EOL EV/HEV recycling process may be economical and is worthy of further investigation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Simplified Approach for Scoping Assessment of Non-LWR Source Terms

This report describes a structure to aid in evaluation of release mitigation strategies across a range of reactor technologies. The assessment performed for example reactor concepts utilizes previous studies of postulated accident sequences for each reactor concept. This simplified approach classifies release mitigation strategies based on a range of barriers, physical attenuation processes, and system performance. It is not, however, intended to develop quantitative estimates of radiological release magnitudes and compositions to the environment. Rather, this approach is intended to identify the characteristics of a reactor design concepts release mitigation strategies that are most important to different classes of accident scenarios. It uses a scoping methodology to provide an approximate, order-of-magnitude, estimate of the radiological release to the environment and associated off-site consequences. This scoping method is applied to different reactor concepts, considering the performance of barriers to fission product release for these concepts under sample accident scenarios. The accident scenarios and sensitivity evaluations are selected in this report to evaluate the role of different fission product barriers in ameliorating the source term to the environment and associated off-site consequences. This report applies this structure to characterize how release mitigation measures are integrated to define overall release mitigation strategies for High Temperature Gas Reactors (HTGRs), Sodium Fast Reactors (SFRs), and liquid fueled Molten Salt Reactors (MSRs). To support this evaluation framework, factors defining a chain of release attenuation stages, and thus an overall mitigation strategy, must be established through mechanistic source term calculations. This has typically required the application of an integral plant analysis code such as MELCOR. At present, there is insufficient evidence to support a priori evaluation of the effectiveness of a release mitigation strategy for advanced reactor concepts across the spectrum of events that could challenge the radiological containment function. While it is clear that these designs have significant margin to radiological release to the environment for the scenarios comprising the design basis, detailed studies have not yet been performed to assess the risk profile for these plants. Such studies would require extensive evaluation across a reasonably complete spectrum of accident scenarios that could lead to radiological release to the environment.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Preventive Power Outage Estimation Based on A Novel Scenario Clustering Strategy: Preprint

The increasing occurrence of extreme weather events is challenging the power grid operation. In front of the extreme weather, the system operator is responsible for estimating the power outage and scheduling the restoration resources. This paper proposes an outage evaluation framework to identify the possible unserved load profiles, vulnerable areas, and mobile energy adequacy. The predicted vulnerable lines of an outage prediction model tool are utilized to generate numerous faulted line scenarios. Next, each scenario's nodal unserved load profile is obtained by solving a three-phase restoration model that considers the schedule of repair crews and mobile energy resources. Then, a novel scenario clustering strategy is developed to cluster the unserved load profiles into multiple representative ones for straightforward analysis. Finally, case studies on a distribution system evaluate the damage level brought by extreme weather and verify the effectiveness of the proposed scenario clustering strategy.

mobile energy resources↗
DOE OSTI2021

RAVEN Theory Manual

RAVEN is a software framework able to perform parametric and stochastic analysis based on the response of complex system codes. The initial development was aimed at providing dynamic risk analysis capabilities to the thermohydraulic code RELAP-7, currently under development at Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose stochastic and uncertainty quantification platform, capable of communicating with any system code. In fact, the provided Application Programming Interfaces (APIs) allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by input files or via python interfaces. RAVEN is capable of investigating system response and explore input space using various sampling schemes such as Monte Carlo, grid, or Latin hypercube. However, RAVEN strength lies in its system feature discovery capabilities such as: constructing limit surfaces, separating regions of the input space leading to system failure, and using dynamic supervised learning techniques. The development of RAVEN started in 2012 when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework arose. RAVEN’s principal assignment is to provide the necessary software and algorithms in order to employ the concepts developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just to identify the frequency of an event potentially leading to a system failure, but the proximity (or lack thereof) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. peak pressure in a pipe) is exceeded under certain conditions. Most of the capabilities, implemented having RELAP-7 as a principal focus, are easily deployable to other system codes. For this reason, several side activates have been employed (e.g. RELAP5-3D, any MOOSE-based App, etc.) or are currently ongoing for coupling RAVEN with several different software. The aim of this document is to provide a set of commented examples that can help the user to become familiar with the RAVEN code usage.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

RAVEN User Manual

RAVEN is a generic software framework to perform parametric and probabilistic analysis based on the response of complex system codes. The initial development was aimed to provide dynamic risk analysis capabilities to the Thermo-Hydraulic code RELAP-7, currently under development at the Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose probabilistic and uncertainty quantification platform, capable to agnostically communicate with any system code. This agnosticism includes providing Application Programming Interfaces (APIs). These APIs are used to allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by inputs files or via python interfaces. RAVEN is capable of investigating the system response, and investigating the input space using Monte Carlo, Grid, or Latin Hyper Cube sampling schemes, but its strength is focused to- ward system feature discovery, such as limit surfaces, separating regions of the input space leading to system failure, using dynamic supervised learning techniques. The development of RAVEN has started in 2012, when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework became stronger. RAVEN principal assignment is to provide the necessary software and algorithms in order to employ the concept developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just the individuation of the frequency of an event potentially leading to a system failure, but the closeness (or not) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. for an important process such as peak pressure in a pipe) is exceeded under certain conditions. The initial development of RAVEN has been focused on providing dynamic risk assessment capability to RELAP-7, currently under development at the INL and, likely, future replacement of the RELAP5-3D code. Most the capabilities that have been implemented having RELAP-7 as principal focus are easily deployable for other system codes. For this reason, several side activates are currently ongoing for coupling RAVEN with soft- ware such as RELAP5-3D, etc. The aim of this document is the explanation of the input requirements, focalizing on the input structure.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Sensor impacts on building and HVAC controls: A critical review for building energy performance

Building operations rely heavily on control systems and sensors. This paper provides a sophisticated literature review on sensor systems in building/HVAC systems, particularly in the context of controls, and their impacts on energy efficiency and thermal comfort. This study aims to understand the previous and current research and identify future research opportunities on this subject. The reviewed sensor systems were used for heuristic rule-based controls, local controls, and advanced optimal controls for existing and emerging technologies. Five major aspects of sensors are reviewed here: control loops for sensors, sensor types, sensor locations, sensor data, and a sensor impact evaluation framework. To augment the literature review, comprehensive standardized interviews were also conducted with relevant industry experts and practitioners. These interviews were designed and performed to (1) identify significant factors for selecting sensor sets and current undergoing issues, (2) identify potential improvements in sensor configuration/deployment, and (3) integrate expert (e.g., researcher, building operation practitioner) knowledge and experiences to develop structured use-case scenarios. Researchers collected and analyzed 31 interview responses for this paper.

Building control↗
DOE OSTI2020

Anode-free, Lean-Electrolyte Lithium-Sulfur Batteries Enabled by Tellurium-Stabilized Lithium Deposition

For realizing practically viable lithium-sulfur (Li-S) batteries, it is imperative to stabilize Li deposition and improve cyclability while reducing excess Li and electrolyte. We have discovered that introducing tellurium (Te) into the Li-S system as a cathode additive significantly improves the reversibility of Li plating and stripping by forming a tellurized and sulfide-rich solid-electrolyte interphase (SEI) layer on the Li surface. A remarkable improvement in cyclability is demonstrated in anode-free full cells with limited Li inventory and large-area Li-S pouch cells under lean electrolyte conditions. Tellurium reacts with polysulfides to generate soluble polytellurosulfides that migrate to the anode side and form stabilizing lithium thiotellurate and lithium telluride in situ as SEI components. A significant reduction in electrolyte decomposition on the Li surface is also engendered. This work demonstrates Te inclusion as a viable strategy for stabilizing Li deposition and establishes a robust evaluation framework for preserving electrochemical performance under limited Li and limited electrolyte conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Uncertainty quantification and reliability assessment for intermodal freight transportation

Intermodal freight optimization models support cost-effective, low-emission, and timely goods movement by coordinating trucks, rail, and barges. These models determine optimal flows, routing, and modal switches while respecting infrastructure and operational constraints. However, their real-world utility is often undermined by pervasive uncertainties-such as fluctuating transportation costs and emissions, variable terminal capacities, and uncertain freight demand-that distort key performance outcomes, including total system cost, carbon footprint, and transit time reliability. This study presents a structured framework for quantifying uncertainty in intermodal freight transportation (IFT) optimization. The framework evaluates how input uncertainty affects system performance and reliability, a critical need for ensuring that model-based decisions remain robust under real-world variability, especially amid volatile fuel prices, shifting demand, and growing disruptions. It integrates three complementary methods: (1) Sobol-based global sensitivity analysis to identify influential parameters affecting cost, emissions, and transit time, (2) Monte Carlo-based capacity perturbation analysis to assess robustness under probabilistic facility disruptions, and (3) Monte Carlo filtering with Bayesian inference to detect threshold-based performance vulnerabilities. The results highlight diesel truck unit cost as the dominant driver of variability. To improve system resilience, planners should prioritize uncertainty in fuel-related parameters when designing intermodal strategies.

Intermodal freight transportation↗
DOE OSTI2023

Resilience assessment and planning in power distribution systems: Past and future considerations

High impact low probability (HILP) events such as hurricanes, heat waves, and floods have instigated widespread power outages and blackouts around the globe in the past decade. With the increasing challenges concerning the threats to the power distribution systems and the growing need to mitigate the impacts of the HILP events, resilience has become a crucial requirement for the power grid infrastructures. Numerous efforts have been made to define, measure, and characterize the resilience of power distribution systems. This study thoroughly reviews the state-of-the-art methods on the existing resilience evaluation framework and metrics. Here, the desirable characteristics of resilience metrics are highlighted, and the challenges associated with formulating, developing, and calculating such metrics are discussed. Next, we detail the state-of-the-art literature on planning solutions to ensure distribution system resilience. This paper aims to extract a deep insight into this challenging and critical research area and envision future opportunities that can guide the power distribution system operators/planners to formulate more effective mitigation strategies to enhance the resilience of power distribution systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Thermomechanical analysis and modeling of a high-temperature light trapping planar cavity solar receiver

The development of durable particle-based high-temperature solar receivers is critical for advancing concentrating solar-thermal (CST) technologies to enable high-efficiency power generation and industrial process heat. Here, this study presents a computational framework to evaluate the thermomechanical performance of a proposed enclosed light-trapping planar cavity receiver designed for particle-based thermal energy systems. The receiver incorporates absorptive cavities and fluidized particle-bed channels to enhance heat capture and reduce thermal losses. Finite element analysis (FEA) is employed to assess stress, strain, and creep-fatigue behavior under concentrated solar flux using realistic thermal boundary conditions derived from coupled system models and experimental assembly parameters. The analysis investigates the influence of particle-to-wall heat transfer coefficients (HTC) ranging from 800 to 1800 W/m 2 .K on the thermomechanical response of six candidate high-temperature alloys: Alloy 740H, Alloy 282, Alloy 617, 316H, Alloy 230, and 800H. Results show that increasing HTC reduces thermal gradients, leading to lower stresses and strains and extended minimum predicted creep life. While all materials satisfy fatigue life requirements under the investigated conditions, significant differences in creep resistance are observed. Alloy 740H consistently exhibits the longest minimum predicted creep life and the most favorable durability margins, followed by Alloy 282, with the remaining materials showing reduced creep resistance under identical loading. The reported creep lives are conservative lower-bound estimates intended for comparative material evaluation. This framework highlights the critical roles of material selection and geometry optimization in improving mechanical durability and reliability of solar-thermal receivers, forming a foundation for future experimental validation and design optimization.

14 SOLAR ENERGY↗