Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Failure Analysis–Informed Risk Assessment Framework for Geological Carbon Storage Using Numerical Simulation and Machine Learning

Geological carbon storage (GCS) is recognized as a critical technology for achieving large-scale reductions in anthropogenic carbon dioxide (CO 2 ) emissions. Ensuring long-term containment and safety requires robust risk assessment frameworks that account for geological uncertainty and identify potential failure scenarios. Among various indicators, the area of review (AoR) serves as a key metric for evaluating storage performance, regulatory compliance, and monitoring design, as it delineates the spatial extent impacted by pressure buildup and plume migration. However, conventional AoR-based risk assessments typically perturb parameters within narrow uncertainty bounds, potentially overlooking rare but high-impact events arising from extreme geological conditions. In this study, we present a failure analysis–informed risk assessment framework for large-scale GCS projects to improve site prescreening and monitoring design. A suite of 300 numerical simulations was generated using stochastic geological models that vary five key parameters: net-to-gross ratio, anisotropy azimuth, porosity multiplier, permeability multiplier, and vertical-to-horizontal permeability ratio. Among these, 200 realizations represent normal geological uncertainty, while 100 additional cases explore extreme yet plausible conditions for failure-case analysis. The AoR was simulated and computed from pressure and CO 2 saturation fields, where the baseline AoR boundary, representing the extent predicted under typical geological uncertainty, was defined as the union of 200 normal-range simulations, and failure was identified when extreme-range cases exceeded this baseline. Results show that incorporating broader parameter uncertainty produces significantly larger AoR extents, underscoring the potential underestimation of risk under conventional uncertainty ranges. Furthermore, spatial probability maps derived from failure-induced AoR exceedance identify regions requiring enhanced monitoring attention. Various machine learning (ML)–based classifiers were developed to predict failure occurrence from geological parameters, with the random forest model achieving the highest performance (F1-score of 0.986). Consistent findings from correlation coefficient, feature importance, and Sobol sensitivity analyses reveal that low net-to-gross ratios and permeability multipliers are the dominant risk drivers, reflecting reduced reservoir connectivity and limited pressure dissipation. Altogether, these results provide a novel framework for risk-informed site prescreening and monitoring design that explicitly considers rare but high-impact geological scenarios in GCS projects.

25 ENERGY STORAGE↗
DOE OSTI2021

TRUST Contact Thermal Conductance (CTC) Report

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) work package is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are critical to the current and future stockpile. Staff development will include cross-discipline training to provide engineers with experience in both numerical simulations and experimental methods. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), and the test information management system (TIMS).

42 ENGINEERING↗
DOE OSTI2021

TRUST End-of-Year Report

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) work package is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are critical to the current and future stockpile. Staff development will include cross-discipline training to provide engineers with experience in both numerical simulations and experimental methods. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), and the test information management system (TIMS). TRUST includes four testbeds and their associated engineering analysis baseline models (EABMs): 1. contact thermal conductivity (CTC); 2. nonlinear dynamics (ND); 3. sensors in environments for accelerometers (SEA); 4. sensors in environments for fiber optic displacement gages (SEFOD).

42 ENGINEERING↗
DOE OSTI2021

TRUST Nonlinear Dynamics (ND) Report

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) work package is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are critical to the current and future stockpile. Staff development will include cross-discipline training to provide engineers with experience in both numerical simulations and experimental methods. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), and the test information management system (TIMS).

42 ENGINEERING↗
DOE OSTI2022

TRUST Nonlinear Dynamics (ND) Report: FY22

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainty in Simulations and Tests (TRUST) work package, is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are relevant to the current and future stockpile. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), and the test information management system (TIMS). Additionally, this work is being used to test a newly available framework in W-13, Weapons Analysis for Verified Engineering Simulation (WAVES).

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2024

Uncertainty Quantification and Sensitivity Analysis of Low-Dimensional Manifold via Co-Kurtosis PCA in Combustion Modeling

For multi-scale multi-physics applications e.g., the turbulent combustion code Pele, robust and accurate dimensionality reduction is crucial to solving problems at exascale and beyond. A recently developed technique, Co-Kurtosis based Principal Component Analysis (CoK-PCA) which leverages principal vectors of co-kurtosis, is a promising alternative to traditional PCA for complex chemical systems. To improve the effectiveness of this approach, we employ Artificial Neural Networks for reconstructing thermo-chemical scalars, species production rates, and overall heat release rates corresponding to the full state space. Our focus is on bolstering confidence in this deep learning based non-linear reconstruction through Uncertainty Quantification (UQ) and Sensitivity Analysis (SA). UQ involves quantifying uncertainties in inputs and outputs, while SA identifies influential inputs. One of the noteworthy challenges is the computational expense inherent in both endeavors. To address this, we employ the Monte Carlo methods to effectively quantify and propagate uncertainties in our reduced spaces while managing computational demands. Our research carries profound implications not only for the realm of combustion modeling but also for a broader audience in UQ. By showcasing the reliability and robustness of CoK-PCA in dimensionality reduction and deep learning predictions, we empower researchers and decision-makers to navigate complex combustion systems with greater confidence.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

A robust approach to Gaussian process implementation

Abstract. Gaussian process (GP) regression is a flexible modeling technique used to predict outputs and to capture uncertainty in the predictions. However, the GP regression process becomes computationally intensive when the training spatial dataset has a large number of observations. To address this challenge, we introduce a scalable GP algorithm, termed MuyGPs, which incorporates nearest-neighbor and leave-one-out cross-validation during training. This approach enables the evaluation of large spatial datasets with state-of-the-art accuracy and speed in certain spatial problems. Despite these advantages, conventional quadratic loss functions used in the MuyGPs optimization, such as root mean squared error (RMSE), are highly influenced by outliers. We explore the behavior of MuyGPs in cases involving outlying observations and, subsequently, develop a robust approach to handle and mitigate their impact. Specifically, we introduce a novel leave-one-out loss function based on the pseudo-Huber function (LOOPH) that effectively accounts for outliers in large spatial datasets within the MuyGPs framework. Our simulation study shows that the LOOPH loss method maintains accuracy despite outlying observations, establishing MuyGPs as a powerful tool for mitigating unusual observation impacts in the large data regime. In the analysis of US ozone data, MuyGPs provides accurate predictions and uncertainty quantification, demonstrating its utility in managing data anomalies. Through these efforts, we advance the understanding of GP regression in spatial contexts.

Mukangango, Juliette↗
DOE OSTI2021

Developing an Automated Uncertainty Quantification Tool to Improve Watershed-Scale Predictions of Water and Nutrient Cycling

Managing the flow of water, nutrients, and contaminants in watersheds is vital to addressing pressing issues related to water scarcity, access to clean drinking water, energy production, resilience to natural and anthropogenic perturbations, and ecological restoration. Decisions about the management of watersheds critically depend on the accuracy with which the flow of water and chemicals through the watershed can be predicted by computer models. Prediction uncertainty can be reduced by matching the model to data, which are collected in the field at great expense. The contribution of watershed characterization data to reducing uncertainty of relevant model predictions can be evaluated in a so-called data-worth analysis, which provides transparent, quantitative metrics about a data set’s value for the support of relevant watershed management objectives. To achieve this goal, we developed a software package that implements the data-worth analysis approach for use with state-of-the-art watershed models. The purpose of the proposed data-worth analysis is to help decision-makers allocate resources for watershed characterization such that the uncertainty in model predictions can be significantly reduced, which leads to better, more effective management decisions. At the same time, watershed characterization costs can be reduced. The specific technical objectives of this SBIR/STTR Phase II project were to develop a framework and associated software toolsets that implement the uncertainty quantification and data-worth analysis approach for use with state-of-the-art watershed models. This goal was achieved by (A) developing a user-friendly, robust software package that is accessible to a wide audience, including watershed managers, policy-makers, and public stakeholders; (B) by demonstrating application of the prototype on several use cases that are representative of complex watershed management challenges spanning a range of scales and that consider different open-source, DOE-based codes and other modeling platforms; and (C) by gathering information about the needs and requirements from potential users to help guide future developments, ensuring that the final product will be commercially viable. The developed software consists of a graphical user interface that guides the user through a sequence of analysis steps, supported by toolsets that leverage state-of-the-art computational simulation-optimization capabilities. A prototype of the software runs on multiple platforms (PC, Mac, multi-processor Linux environment), is linked to diverse watershed simulators (e.g., ECOSYS, TOUGH2, TOUGHREACT, Amanzi-ATS), performs multiple analysis tasks (predictive simulations, sensitivity analysis, uncertainty analysis, automatic parameter estimation, and data-worth analysis, multicomponent geothermometry), and is readily extensible to include external simulators and analysis tools. The software is being commercialized and will be continually updated to address user needs.

58 GEOSCIENCES↗
DOE OSTI2020

Uncertainty Analysis Framework for the Hospital Resource Supply Model for Covid-19

In March and April of 2020 there was widespread concern about availability of medical resources required to treat Covid-19 patients who become seriously ill. A simulation model of supply management was developed to aid understanding of how to best manage available supplies and channel new production. Forecasted demands for critical therapeutic resources have tremendous uncertainty, largely due to uncertainties about the number and timing of patient arrivals. It is therefore essential to evaluate any process for managing supplies in view of this uncertainty. To support such evaluations, we developed a modeling framework that would allow an integrated assessment in the context of uncertainty quantification. At the time of writing there has been no need to execute this framework because adaptations of the medical system have been able to respond effectively to the outbreak. This report documents the framework and its implemented components should need later arise for its application.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

An Integrated Paradigm for the Management of Delivery Risk in Electricity Markets: From Batteries to Insurance and Beyond [Slides]

In wholesale electricity markets today, flexibility from a limited number of distributed energy resources (DERs) is offered daily, and the value of flexibility is not yet recognized for economic hedging of delivery risk. Under a three-year project funded by the ARPA-E PERFORM program, a collaborative team is working towards developing an integrated risk management framework that will leverage flexibility from distributed and bulk resources to cost-effectively and reliably manage delivery risk of intermittent resources. Two concepts are at the core of the proposed integrated risk management framework: (A) flexibility options, which are a novel type of options and enable wholesale electricity market participants to hedge uncertainty by buying flexibility. (B) DER flexibility scores, which provide a way for utilities or aggregators to classify assets in groups with different likelihood of delivering contracted flexibility. This report presentation will focus on the proposed ISO-product "flexibility options," which is complementary to ramp and other products being introduced by ISOs/RTOs to manage net load uncertainties. Participating resources with imbalance risk can buy flexibility options to hedge their production, whereas grid-connected resources that can provide physical flexibility can offer flexibility options. We will present basics of the formulation for a day-ahead ISO market that matches buyers and sellers of this hedge in coordination with existing capabilities to schedule energy and ancillary services, and outline how their settlements mitigate the impact of imbalance risk.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Machine learning surrogate of physics-based building-stock simulator for end-use load forecasting

Building energy models are used to simulate heat and mass transfer and estimate end-use load in buildings. With the proliferation of solar photovoltaics on residential and commercial buildings, increasingly, buildings are expected to provide grid services, for which accurate and computationally efficient building energy simulations and end-use load prediction are imperative. Existing building energy simulation tools, however, have significant computational overhead that make them less practical in real-time deployment for optimization, design, uncertainty quantification and control in building energy management systems. Here this article presents a data-driven machine learning model based on light gradient boosting method (LightGBM) as a surrogate for a physics-based simulator for residential buildings to predict end-use load. The machine learning based surrogate model accounts for time-series related variables, seasonality and trend component of end-use load, and history of end-use load. The accuracy of the surrogate model is assessed on the prediction of the load profiles of 100 different houses in Cook County, Illinois, USA. The LightGBM surrogate model is shown to reduce the root-mean-squared error by 53% relative to a reference decision tree (DT) based model reported previously in the literature. Moreover, the model predicts the load spikes and high-ramp rate events throughout the year which are often the Achilles heel of other models in the literature. The machine learning based surrogate model is demonstrated to be computationally efficient, with a ten-fold reduction in the computational time compared to a physics-based building energy simulation, and suitable for uncertainty analysis and real-time control of building characteristics in response to uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

14 Steps to Creating Value in Cost and Schedule Resources for Nuclear Waste Management - 20188

While Waste Management budgets are shrinking, DOE required cost and schedule controls are becoming increasingly stringent. At the same time, there is a scarcity of adept, qualified, and competent projects controls staff who both understand nuclear waste management and are capable of addressing today's cost and schedule challenges. In response, we have developed a systematic approach to training and mentoring project controls staff. The approach is based on the observations and lessons learned on projects, both successful and unsuccessful, over the past 20 years. During that time, we evaluated staff development and used that experience to design a program that progresses the maturity, knowledge and experience of the individual. The program is based on the unique needs of cost and schedule specialists while incorporating the best leadership and managerial applications. The system is not limited to developing individual software skills, which is a primary focus of many project controls training programs. Instead, our system develops an individual's soft and hard skill sets. The system develops the user's skill, talent, attitude, and drive to do the best job possible. It focuses on all aspects of becoming a more productive technical team while accepting responsibility for individual growth. It also enhances the project controls team by setting up checks and balances that everyone is aware of and participates in. The system is based on 14 steps of increasing complexity in knowledge and application. The system clarifies roles, responsibilities and expectations. It helps eliminate uncertainty and reduces stress on staff and managers. It contains everyday routine actions and is simple to implement. It allows the development of a consistent rhythm to staff growth and development. Mastering the steps will allow the user to achieve excellence in cost and schedule control. The 14 steps are: 1 - Key Performance Objectives, 2 - Check Lists, 3 - Desktop Guides, 4 - System Description, 5 - Procedures, 6 - Software and On the Job Training (OTJ), 7 - Traceability Checks, 8 - Surveillances, 9 - 32 Criteria, 10 - The Contract, 11 - Customer/Government Guidance, 12 - Training and Mentoring Others, 13 - Master your weekly and daily schedules, 14 - Improving your interpersonal skills. Application and mastery of this system will produce better cost and schedule control results. Your project controls staff will write better reports, analyze data better, make better use of their time, and be more valuable to decision makers. If followed rigorously, our system will produce a great project controls team, which is invaluable to the success of each project. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Ensemble‐Based Spatially Distributed CLM5 Hydrological Parameter Estimation for the Continental United States

Abstract One of the major challenges in large‐domain hydrological modeling efforts lies in the estimation of spatially distributed hydrological parameters while simultaneously accounting for their associated uncertainties. Addressing this challenge is particularly difficult in ungauged locations. With growing societal demands for large‐scale streamflow projections to inform water resource management and long‐term planning, evaluating and constraining hydrological parameter uncertainty is increasingly vital. This study introduces a hybrid regionalization approach to enhance hydrological predictions of the Community Land Model version 5 (CLM5) across the Continental United States (CONUS), with a total of 50,629 1/8° grid cells. This hybrid method combines the strengths of two existing techniques: parameter regionalization and streamflow signature regionalization. It identifies ensemble behavioral parameters for each 1/8° grid cell across the CONUS domain, tailored to three distinct streamflow signatures focused on low flows, high flows, and annual water balance. Evaluating this hybrid method for 464 CAMELS (Catchment Attributes and Meteorology for Large‐sample Studies) basins demonstrates a significant improvement in CLM5 hydrological predictions, even in challenging arid regions. In CONUS applications, the derived spatially distributed parameter sets capture both spatial continuity and variation of parameters, highlighting their heterogeneous nature within specific regions. Overall, this hybrid regionalization approach offers a promising solution to the complex task of improving hydrological modeling over large domains for important hydrological applications.

CLM5↗
DOE OSTI2024

Uncertainty characterization in a coupled human-natural system: Modeling agricultural adaptation in the Great Lakes Region

The Great Lakes Region's water quality and ecological health are threatened by the export of nutrients from agricultural lands, which causes eutrophication, hypoxia, and destructive algal blooms. The intensification of hydrologic cycles brought about by climate change is expected to exacerbate nutrient loading in the region, and, at the same time, agricultural adaptation to changing conditions is also expected to affect loading through shifting amounts and timing of fertilization. Quantifying these future effects and their interactions necessitates modeling both the human and natural processes as a coupled system, by pairing land use and agricultural management with hydrologic modeling. At the same time, compounding uncertainties arising from the complex interactions in both systems significantly limit our predictive understanding of the region's impacts. This study utilizes the Soil and Water Assessment Tool (SWAT), developed for simulating the impact of various farmer decisions on watershed functions in Western Lake Erie watersheds, and an under-development agent-based model (ABM) for agricultural management decisions. The aim of this study is to use global sensitivity analysis on the coupled ABM and SWAT models to quantify how uncertainty in both models interactively affects nutrient loading. To do so, we will conduct Sobol sensitivity analysis experiments at different levels of coupling assumptions to quantify how various uncertain factors (e.g., soil moisture and crop choice) and their interactions affect our estimates of nutrient loading. The results of this analysis will allow us to quantify how complex interactions and dependencies between both systems amplify the effect of uncertainties. Insights gained from this study will have broader implications for modeling the adaptive co-evolution of human and natural systems under climate change and can inform effective management of nutrient loading in the Great Lakes Region.

Climate Change↗
DOE OSTI2022

DUNE atmospheric neutrinos: Earth tomography

In this paper we show that the DUNE experiment can measure the Earth’s density profile by analyzing atmospheric neutrino oscillations. The crucial feature that enables such measurement is the detailed event reconstruction capability of liquid argon time projection chambers. This allows for studying the sub-GeV atmospheric neutrino component, which bears a rich oscillation phenomenology, strongly dependent on the matter potential sourced by the Earth. We provide a pedagogical discussion of the MSW and parametric resonances and their role in measuring the core and mantle densities. By performing a detailed simulation, accounting for particle reconstruction at DUNE, nuclear physics effects relevant to neutrino-argon interactions and several uncertainties on the atmospheric neutrino flux, we manage to obtain a robust estimate of DUNE’s sensitivity to the Earth matter profile. We find that DUNE can measure the total mass of the Earth at 9.3% precision with an exposure of 400 kton-year. By accounting for previous measurements of the total mass and moment of inertia of the Earth, the core, lower mantle and upper mantle densities can be determined with 9%, 14% and 22% precision, respectively, for the same exposure. Finally, for a low exposure run of 60 kton-year, which would correspond to two far detectors running for three years, we have found that the core density could be measured by DUNE at ∼ 30% precision.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Compound Continental Risk of Multiple Extreme Floods in the United States

Abstract Understanding spatially correlated floods and modeling joint hazard associated with threshold exceedances across multiple locations is crucial for accurate estimation of continental‐scale portfolio risk. This work uses a non‐parametric copula‐based spatial simulator to analyze peak floods across the United States to derive the first‐of‐its‐kind continental portfolio risk estimates at the 10‐ and 100‐year return levels. We find significant interdependence in floods across the nation, revealing the recurring pattern of extreme events affecting the Northeast, Central, West, and Northwest United States in the same year. The stochastic simulator effectively manages high‐dimensional data and offers reliable uncertainty estimates for both spatially dependent floods and the aggregated flood losses at the continental level. El Niño‐Southern Oscillation and Atlantic Multidecadal Oscillation are identified as statistically significant tele‐connectors of aggregate loss. This research aims to advance the understanding of compound continental flood hazard and the potential large‐scale climate teleconnections that lead to such compound floods.

Geology↗