SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Understanding the compound flood risk along the coast of the contiguous United States

Abstract. Compound flooding is a type of flood event caused by multiple flood drivers. The associated risk has usually been assessed using statistics-based analyses or hydrodynamics-based numerical models. This study proposes a compound flood (CF) risk assessment (CFRA) framework for coastal regions in the contiguous United States (CONUS). In this framework, a large-scale river model is coupled with a global ocean reanalysis dataset to (a) evaluate the CF exposure related to the coastal backwater effects on river basins, and (b) generate spatially distributed data for analyzing the CF hazard using a bivariate statistical model of river discharge and storm surge. The two kinds of risk are also combined to achieve a holistic understanding of the continental-scale CF risk. The estimated CF risk shows remarkable inter- and intra-basin variabilities along the CONUS coast with more variabilities in the CF hazard over the US west and Gulf coastal basins. Different risk assessment methods present significantly different patterns in a few key regions such as the San Francisco Bay area, the lower Mississippi River, and Puget Sound. Our results highlight the need to weigh different CF risk measures and avoid using single statistics-based or hydrodynamics-based CFRAs. Uncertainty sources in these CFRAs include the use of gauge observations, which cannot account for the flow physics or resolve the spatial variability of risks, and underestimations of the flood extremes and the dependence of CF drivers in large-scale models, highlighting the importance of understanding the CF risks for developing a more robust CFRA.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Marine ice sheet experiments with the Community Ice Sheet Model

Ice sheet models differ in their numerical treatment of dynamical processes. Simulations of marine-based ice are sensitive to the choice of Stokes flow approximation and basal friction law and to the treatment of stresses and melt rates near the grounding line. We study the effects of these numerical choices on marine ice sheet dynamics in the Community Ice Sheet Model (CISM). In the framework of the Marine Ice Sheet Model Intercomparison Project 3d (MISMIP3d), we show that a depth-integrated, higher-order solver gives results similar to a 3D (Blatter–Pattyn) solver. We confirm that using a grounding line parameterization to approximate stresses in the grounding zone leads to accurate representation of ice sheet flow with a resolution of ~2 km, as opposed to ~0.5 km without the parameterization. In the MISMIP+ experimental framework, we compare different treatments of sub-shelf melting near the grounding line. In contrast to recent studies arguing that melting should not be applied in partly grounded cells, it is usually beneficial in CISM simulations to apply some melting in these cells. This suggests that the optimal treatment of melting near the grounding line can depend on ice sheet geometry, forcing, or model numerics. In both experimental frameworks, ice flow is sensitive to the choice of basal friction law. To study this sensitivity, we evaluate friction laws that vary the connectivity between the basal hydrological system and the ocean near the grounding line. CISM yields accurate results in steady-state and perturbation experiments at a resolution of ~2 km (arguably 4 km) when the connectivity is low or moderate and ~1 km (arguably 2 km) when the connectivity is strong.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Data from "The Influence of Climate Change on Flooding and Social Inequalities from Remnants of Hurricane Ida"

Previous research has demonstrated that tropical cyclone-related precipitation and flooding have been increased by anthropogenic global warming. Our work aims to quantify the contribution of climate change to the deadly flooding from the remnants of Hurricane Ida (2021) and its impact on human society. We developed an analysis framework that combines lessons from climate change attribution science, two-dimensional hydrodynamic modeling, and flood impact evaluation, including a social inequality index, to estimate remnants of Ida flooding and consequences responding to current (locally 1°C warmer) and future (another 1°C warmer) climate change. We find that an additional quarter to a half million people were exposed to flooding due to current and future climate change. The human influence on flood impacts was larger with deeper flood water depth (≥ 1 m) than with shallow depths. Socially vulnerable populations were found to be disproportionately more affected, and climate change exacerbates this inequality

Climate Change↗

DOE OSTI2026

Repowering: The Other Side of the Reliability Coin

Extreme weather, cracked backsheets, severe PID, poorly built modules, and installation flaws - all can compromise a solar plant's health and force repowering long before end of life. With more than 70% of U.S. PV capacity less than seven years old, the fleet is young, but its rapid expansion has introduced new materials and system designs that are still being tested under real-world conditions. As a result, reliability - not economics - is what most often drives repowering decisions. Repowering is frequently assumed to be an economically motivated choice, but our work shows that reliability concerns are the real trigger. Drawing from industry interviews, case studies, and modeling, we highlight the physical, electrical, and policy barriers owners face when deciding whether to repair, repower, or decommission. At the same time, repowering can create opportunities: renewed interconnection periods, improved energy yields, and strategic upgrades to extend system value. We present a quantitative framework using NLR's System Advisor Model (SAM) and PV in Circular Economy (PV ICE) tool to evaluate trade-offs across financial, material, and energy impacts. These findings provide practical guidance for navigating the realities of repowering today and underscore the critical role of reliability in shaping the future performance and sustainability of the PV fleet.

14 SOLAR ENERGY↗

DOE OSTI2025

Immersive Scientific Visualization of Molten-Salt Reactor Waste Characteristics Using Virtual Reality

Immersive visualization is changing how we explore, communicate, and understand complex scientific systems. In nuclear energy, an area in which data are often multidimensional, time-dependent, and difficult to interpret, virtual reality (VR) represents a powerful and intuitive informational medium. This work introduces a VR-based platform that visualizes the post-shutdown behavior and waste management lifecycle of molten-salt reactors (MSRs), a next-generation reactor type with unique operational and safety characteristics. The platform, built in Unity, is streamed on the Meta Quest 3 headset. It transforms high-fidelity simulation data into an interactive, immersive experience. Users can explore time-dependent reactor characteristics such as nuclide decay, which is a key factor for evaluating reactor waste strategies. The datasets were generated using the MOOSE (Multiphysics Object-Oriented Simulation Environment) framework and then processed through ParaView scripting for smooth integration into Unity. From a visualization standpoint, the platform emphasizes spatial storytelling, temporal exploration, and user-centered interaction. Users can navigate 3D reactor geometries, slice through volumetric data, and manipulate time to observe how physical phenomena evolve. Real-scale rendering and embodied interaction make the experience feel tangible. The interface is designed to be accessible, even to those without nuclear or simulation expertise. This lowers the barrier for stakeholders, policymakers, and the general public, while still supporting expert analysis and collaborative decision-making. This work shows how immersive visualization can function as both a scientific tool and a communication interface. By integrating simulation, processing, and visualization into a cohesive workflow, we offer a scalable framework for immersive scientific storytelling. The modular design supports future extensions to other reactor types and lifecycle stages, from shutdown to long-term storage, making the platform adaptable for both research and outreach.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Benders Decomposition Using Graph Modeling and Multi-Parametric Programming

Benders decomposition is a widely used method for solving large and structured optimization problems, but its performance is affected by the repeated solution of subproblems. We propose a flexible and modular algorithmic framework for accelerating Benders decomposition. Specifically, we express the problem structure by using a graph-theoretic modeling abstraction in which nodes represent optimization subproblems and edges represent connectivity between subproblems. A key innovation of our approach is that we embed multiparametric programming (mp) surrogates for node subproblems, which maps the exact analytical map of the subproblem solution space. The use of mp surrogates allows us to replace subproblem solves with fast look-ups and function evaluations for primal and dual variables during the iterative Benders process. We formally show the equivalence between classical Benders cuts and those derived from the mp solution. We implement our framework in the open-source PlasmoBenders.jl software package. To demonstrate the capabilities of the proposed framework, we apply it to a two-stage stochastic programming problem, which aims to make optimal capacity expansion decisions under market uncertainty. We evaluate both single-cut and multicut variants of Benders decomposition and show that the use of mp surrogates achieves substantial speedups in subproblem solve time, while preserving the convergence guarantees of Benders decomposition. We highlight advantages in solution analysis and interpretability that is enabled by mp critical region tracking; specifically, we show that these reveal how decisions evolve geometrically across the Benders search. Our results aim to demonstrate that combining surrogate modeling with graph modeling offers a promising and extensible foundation for structure-exploiting decomposition. In addition, by decomposing the problem into more tractable subproblems, the proposed approach also aims to overcome scalability issues of mp. Finally, the use of mp surrogates provides a unifying and modular optimization framework that enables the representation of heterogeneous node subproblems as modeling objects with a homogeneous structure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

A Mathematical Framework for Representing Cyber-Physical System Interdependencies and Resilience

U.S. critical infrastructure is increasingly composed of integrated cyber-physical systems (CPS) whose components are operationally interdependent. These interdependencies can create additional vulnerabilities beyond those that are typically evaluated through independent physical and cyber risk assessments. These additional vulnerabilities, previously undetected at the sub-system and/or component level, could cause cascading effects across both the physical and cyber domains that could lead to infrastructure disruption or failure. This paper will review an initial mathematical framework developed to help understand the dynamics of these interfacing physical and cyber components at a holistic system level. The resulting framework also provides a method for modeling and assessing the resilience of CPS in complex and adaptive systems. It frames the system in terms of mission performance and the potential effects to performance caused by attacks that are cyber, physical, or blended in nature. The framework utilizes a systems-based, state-space modeling approach to reason about risk, resilience, and interdependencies in CPS. Probabilities are applied to each CPS component regarding a threat (both man-made and natural) and the likelihood of that particular component being impacted, along with indirect impact to other interdependent components. These component-level impacts from threats then translate into mission-level impact and systemic state change.

Brigantic, Robert T.↗

DOE OSTI2026

Improving thermodynamic nudging in the E3SM Atmosphere Model version 2 (EAMv2): strategy and hindcast skills on weather systems

Nudging techniques are commonly employed to constrain atmospheric simulations toward observed states, facilitating model evaluation and sensitivity studies. However, if applied improperly – particularly to thermodynamic variables such as temperature and humidity – nudging can distort physical processes and introduce spurious biases, undermining the credibility of the simulations. This study presents an improved nudging implementation that applies vertically modulated tendencies to reduce adverse impacts on model physics. The framework is tested in version 2 of the Energy Exascale Earth System Model (EAMv2) using a suite of hindcast simulations nudged toward ERA5 reanalysis. We systematically evaluate the individual and combined effects of nudging wind, temperature, and humidity fields on the model's ability to represent large-scale atmospheric states and high-impact weather systems. Results show that the revised strategy – particularly when nudging temperature and humidity at selected levels – enhances hindcast skill by improving agreement with ERA5 without degrading the hydrological cycle or precipitation processes. Additional improvements in surface temperature, outgoing longwave radiation, and precipitation biases are achieved through targeted nudging of land-surface variables. The proposed approach strengthens the representation of large-scale conditions relevant to tropical cyclones, atmospheric rivers, and extratropical cyclones in the low-resolution EAMv2. These findings demonstrate that carefully designed thermodynamic nudging, especially of temperature and humidity, improves the realism of constrained simulations and broadens the utility of nudged EAMv2 for atmospheric modeling, machine learning, and high-impact weather research.

Atmospheric river↗

DOE OSTI2025

Hidden Features: How Subsurface and Landscape Heterogeneity Govern Hydrologic Connectivity and Stream Chemistry in a Montane Watershed

ABSTRACT Hydrologic connectivity is defined as the connection among stores of water within a watershed and controls the flux of water and solutes from the subsurface to the stream. Hydrologic connectivity is difficult to quantify because it is goverened by heterogeniety in subsurface storage and permeability and responds to seasonal changes in precipitation inputs and subsurface moisture conditions. How interannual climate variability impacts hydrologic connectivity, and thus stream flow generation and chemistry, remains unclear. Using a rare, four‐year synoptic stream chemistry dataset, we evaluated shifts in stream chemistry and stream flow source of Coal Creek, a montane, headwater tributary of the Upper Colorado River. We leveraged compositional principal component analysis and end‐member mixing to evaluate how seasonal and interannual variation in subsurface moisture conditions impacts stream chemistry. Overall, three main findings emerged from this work. First, three geochemically distinct end members were identified that constrained stream flow chemistry: reach inflows, and quick and slow flow groundwater contributions. Reach inflows were impacted by historic base and precious metal mine inputs. Bedrock fractures facilitated much of the transport of quick flow groundwater and higher‐storage subsurface features (e.g., alluvial fans) facilitated the transport of slow flow groundwater. Second, the contributions of different end members to the stream changed over the summer. In early summer, stream flow was composed of all three end members, while in late summer, it was composed predominantly of reach inflows and slow flow groundwater. Finally, we observed minimal differences in proportional composition in stream chemistry across all four years, indicating seasonal variability in subsurface moisture and spatial heterogeneity in landscape and geologic features had a greater influence than interannual climate fluctuation on hydrologic connectivity and stream water chemistry. These findings indicate that mechanisms controlling solute transport (e.g., hydrologic connectivity and flow path activation) may be resilient (i.e., able to rebound after perturbations) to predicted increases in climate variability. By establishing a framework for assessing compositional stream chemistry across variable hydrologic and subsurface moisture conditions, our study offers a method to evaluate watershed biogeochemical resilience to variations in hydrometeorological conditions.

Johnson, Keira [College of Earth, Ocean, and Atmos↗

DOE OSTI2026

Energy Infrastructure Futures: A Multiscale Evaluation of Projected Power Plant Siting Across the Western Interconnection

The US Western Interconnection is facing unprecedented challenges in the form of less predictable peak demand, increasingly diverse generating resources, and fast-growing loads due to the onset of artificial intelligence, hyperscale computing, and electrification. Projecting where future generation may be developed is critical to maintaining a robust and resilient electric grid under this mounting uncertainty and variability. Using an integrated multisectoral, multiscale modeling framework that links a human-Earth systems model, an hourly load model, a geospatial power plant siting model, and an hourly grid operations model, we evaluate the power plant landscape evolution under eight alternative futures between 2020 and 2055. These futures represent a wide but plausible range of atmospheric conditions, emissions constraints, and economic, technological, and population growth assumptions. We find that local-level development can vary substantially both by generation type and capacity buildout across these futures. Specific regions of the Western Interconnection are projected to see large amounts of capacity development regardless of the future scenario. We additionally determine that projected power plant locations are more heavily influenced by the cost to interconnect to the electric grid than the locational energy value.

Mongird, Kendall↗

DOE OSTI2026

Learning neural representations for X-ray ptychography reconstruction with unknown probes

X-ray ptychography provides exceptional nanoscale resolution and is widely applied in materials science, biology, and nanotechnology. However, its full potential is constrained by the critical challenge of accurately reconstructing images when the illuminating probe is unknown. Conventional iterative methods and deep learning approaches are often suboptimal, particularly under the low-signal conditions inherent to low-dose and high-speed experiments. These limitations compromise reconstruction fidelity and restrict the broader adoption of the technique. In this work, we introduce the Ptychographic Implicit Neural Representation (PtyINR), a self-supervised framework that simultaneously addresses the object- and probe-recovery problem. By parameterizing both as continuous neural representations, PtyINR performs end-to-end reconstruction directly from raw diffraction patterns without requiring any pre-characterization of the probe. Extensive evaluations demonstrate that PtyINR achieves superior reconstruction quality on both simulated and experimental data, with remarkable robustness under challenging low-signal conditions. Furthermore, PtyINR offers a generalizable, physics-informed framework for addressing probe-dependent inverse problems, making it applicable to a wide range of computational microscopy problems.

36 MATERIALS SCIENCE↗

DOE OSTI2025

A rigorous framework for an improved Messinger/Myers model of ice accretion under conditions of variable property and unsteady aircraft icing

We analyse the Messinger/Myers model by critically evaluating simplifying assumptions through a rigorous formulation of the rime ice accretion process. We explore the effects of both constant and variable ice density and thermal conductivity, along with the effects of sublimation from the ice surface. The effects of key factors such as droplet impact rate, ambient temperature relative to the freezing temperature and the temperature difference between the ambient air and the airfoil surface are examined. Under these varying conditions, the present rigorous formulation is used to assess the significance of unsteady effects, variable ice properties and sublimation. We observe that the Myers model performs remarkably well in certain icing situations and analyse the reasons for this strong performance. We also show that partially relaxing the model’s assumptions can lead to poorer performance. The Myers model can lead to overprediction of ice surface temperature and correspondingly underprediction of transition time under conditions of relatively weak sublimation and surface cooling. A modified Myers model is presented, which can be used to recover near-perfect results under widely varying icing conditions of relevance. This article is part of the theme issue ‘Heat and mass transfer in frost and ice’.

Science & Technology - Other Topics↗

DOE OSTI2021

Evaluating the Lagrangian Evolution of Subtropical Low Clouds in GCMs Using Observations: Mean Evolution, Time Scales, and Responses to Predictors

In this work, a Lagrangian framework is developed to show the daily-scale time evolution of low clouds over the eastern subtropical oceans. An identical framework is applied to two general circulation models (GCMs): the CAM5 and UKMET and a set of satellite observations. This approach follows thousands of parcels as they advect downwind in the subtropical trade winds, comparing cloud evolution in time and space. This study tracks cloud cover, in-cloud liquid water path (CLWP), droplet concentration $N_d$, planetary boundary layer (PBL) depth, and rain rate as clouds transition from regions with predominately stratiform clouds to regions containing mostly trade cumulus. The two models generate fewer clouds with greater $N_d$ relative to observations. Models show stronger Lagrangian cloud cover decline and greater PBL deepening when compared with observations. In comparing frequency distributions of cloud variables over time, it is seen that models generate increasing frequencies of nearly clear conditions at the expense of overcast conditions, whereas observations show transitions from overcast to cloud amounts between 50% and 90%. Lagrangian decorrelation time scales ($\mathcal{e}$-folding time $\tau$) of cloud cover and CLWP are between 11 and 19 h for models and observations, although they are a bit shorter for models. A Lagrangian framework applied here resolves and compares the time evolution of cloud systems as they adjust to environmental perturbations in models and observations. Increasing subsidence in the overlying troposphere leads to declining cloud cover, CLWP, PBL depth, and rain rates in models and observations. Modeled cloud responses to other meteorological variables are less consistent with observations, suggesting a need for continuing mechanical improvements in GCMs.

58 GEOSCIENCES↗

DOE OSTI2021

Combined modeling and experiments to predict corrosion and embrittlement in dual-phase stainless steels within the MARMOT framework

Extending service of Light Water Reactors (LWRs) to beyond 60 years will demand high integrity of materials and components in the reactors. The accurate evaluation and prediction of materials performance under anticipated operating conditions are of particular importance for ensuring the safety of nuclear power plants over their extended lifetime. Stainless steels are extensively used as structural alloys in light water reactor (LWR) systems because of their excellent combination of mechanical properties and corrosion resistance. Austenitic stainless steel welds and cast austenitic stainless steels (CASS) contain significant amounts of ferrite ~5-30% and are ubiquitous in LWR piping (elbows, pump casings, valves) and internal structural components. During their lifetime, these components are subjected to thermal aging at the temperature range of 288-327°C for pressurized water reactors (PWR). A phase transformation within the ferrite phase of these materials leads to embrittlement and degradation in corrosion resistance, which undermines the materials selection criteria.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Leveraging Large Language Models for Real-World Data Evidence: A Framework for Automated Treatment Extraction and Data Harmonization

Background: The ability to comprehensively collect treatment information from cancer patient medical records would enable studies to evaluate real-world benefits and risks tied to specific treatments. Currently, it is difficult to system- atically collect high-quality treatment information because it is often stored in unstructured text. Manually extracting and standardizing drug and regimen data is time-intensive. Recent advances in large language models (LLMs) offer a potential solution for automated extraction of structured treatment information from clinical text. Objective: This study systematically evaluates the utility of four LLMs from the Llama family for automated extraction of oncology treatment information from clinical text. This information can guide researchers using cancer registry data to provide insights into cancer care and outcomes beyond clinical trials. Methods: Four instruction-tuned Llama models with varying parameter counts (1B, 3B, 8B, and 70B) were evaluated for their ability to extract treatment information from clinical documents. A unified oncology knowledge base integrating seven major public data sources was developed to standardize and normalize extracted entities—a critical step for harmonizing data from diverse sources. Extracted treatment data were compared against expert-annotated ground truth. Model performance was assessed using accuracy metrics (Precision, Recall, F1-Score) and opera- tional feasibility metrics, including processing speed and structural compliance of the output. Results: A strong positive correlation was observed between model size and extraction accuracy. F1-score improved from 0.609 for the 1B model to 0.710 (3B), 0.807 (8B), and 0.828 (70B). While larger models demonstrated superior accuracy and compliance, they incurred higher computational costs. The modest performance difference between 8B and 70B suggests diminishing returns with increasing model size. Conclusions: LLMs represent a viable technology for automating oncology treatment extraction. The 8B-parameter model emerged as a highly effective option, balancing high accuracy and computational efficiency. Selecting an appropriate LLM for deployment in cancer registries involves a trade-off between desired accuracy and available operational resources. Harmonizing extracted entities with the oncology knowledge base facilitates standardized integration into common data models, enhancing data quality for real-world evidence analyses.

artificial intelligence↗

DOE OSTI2025

Failure Analysis–Informed Risk Assessment Framework for Geological Carbon Storage Using Numerical Simulation and Machine Learning

Geological carbon storage (GCS) is recognized as a critical technology for achieving large-scale reductions in anthropogenic carbon dioxide (CO 2 ) emissions. Ensuring long-term containment and safety requires robust risk assessment frameworks that account for geological uncertainty and identify potential failure scenarios. Among various indicators, the area of review (AoR) serves as a key metric for evaluating storage performance, regulatory compliance, and monitoring design, as it delineates the spatial extent impacted by pressure buildup and plume migration. However, conventional AoR-based risk assessments typically perturb parameters within narrow uncertainty bounds, potentially overlooking rare but high-impact events arising from extreme geological conditions. In this study, we present a failure analysis–informed risk assessment framework for large-scale GCS projects to improve site prescreening and monitoring design. A suite of 300 numerical simulations was generated using stochastic geological models that vary five key parameters: net-to-gross ratio, anisotropy azimuth, porosity multiplier, permeability multiplier, and vertical-to-horizontal permeability ratio. Among these, 200 realizations represent normal geological uncertainty, while 100 additional cases explore extreme yet plausible conditions for failure-case analysis. The AoR was simulated and computed from pressure and CO 2 saturation fields, where the baseline AoR boundary, representing the extent predicted under typical geological uncertainty, was defined as the union of 200 normal-range simulations, and failure was identified when extreme-range cases exceeded this baseline. Results show that incorporating broader parameter uncertainty produces significantly larger AoR extents, underscoring the potential underestimation of risk under conventional uncertainty ranges. Furthermore, spatial probability maps derived from failure-induced AoR exceedance identify regions requiring enhanced monitoring attention. Various machine learning (ML)–based classifiers were developed to predict failure occurrence from geological parameters, with the random forest model achieving the highest performance (F1-score of 0.986). Consistent findings from correlation coefficient, feature importance, and Sobol sensitivity analyses reveal that low net-to-gross ratios and permeability multipliers are the dominant risk drivers, reflecting reduced reservoir connectivity and limited pressure dissipation. Altogether, these results provide a novel framework for risk-informed site prescreening and monitoring design that explicitly considers rare but high-impact geological scenarios in GCS projects.

25 ENERGY STORAGE↗

DOE OSTI2022

Energy Resilience Reference Guide Chapter One: Developing A Shared Definition of Energy Resilience

The NARUC Resilience Reference Guide is envisioned as a one-stop primer for state public utility commissions (PUCs) to assist in the development of a shared language, valuation framework, and educational tool on the topic of energy resilience. The resilience of the energy system has increasingly become part of commissions’ regulatory scope so informed decisions are made regarding how to best enhance system resiliency. Several states have already established evaluative resilience criteria (via legislative statute or regulatory directive). This guide is intended to summarize many of the critical topic areas within energy resilience and to facilitate adoption of resilience valuation frameworks by which PUCs can weigh investment decisions regarding energy system resiliency.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Energy Resilience Reference Guide Chapter Two: Developing a Shared Framework to Value Resilience Investments

24 POWER TRANSMISSION AND DISTRIBUTION↗