SEARCH · Engineering Papers

Results for “uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Aggregation bias and its drivers in large‐scale flood loss estimation: A Massachusetts case study

Abstract Large‐scale estimations of flood losses are often based on spatially aggregated inputs. This makes risk assessments vulnerable to aggregation bias, a well‐studied, sometimes substantial outcome in analyses that model fine‐grained spatial phenomena at coarse spatial units. To evaluate this potential in the context of large‐scale flood risk assessments, we use data from a high‐resolution flood hazard model and structure inventory for over 1.3 million properties in Massachusetts and examine how prominent data aggregation approaches affect the magnitude and spatial distribution of flood loss estimates. All considered aggregation approaches rely on aggregate structure inventories but differ in whether flood hazard is also aggregated. We find that aggregating only structure inventories slightly underestimates overall losses (−10% bias), and when flood hazard data is spatially aggregated to even relatively small spatial units (census block), statewide aggregation bias can reach +366%. All aggregation‐based procedures fail to capture the spatial covariation of inputs distributions in the upper tails that disproportionately generate total expected losses. Our findings are robust to several key assumptions, add important context to published risk assessments and highlight opportunities to improve flood loss estimation uncertainty quantification.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

High Temperature Sodium Submersible Flowmeter Design and Analysis

This work details the design and analysis of a permanent magnet flowmeter designed to be submerged in a pool type sodium fast reactor environment. Recently developed Samarium Cobalt rare earth magnets were utilized that have demonstrated resilience to temperature and neutron flux up to 550 °C and 10 18 n/cm 2 , respectively. This paper will discuss the theory, design, calibration and uncertainty quantification of the flowmeter. The flowmeter was calibrated over a flowrate range of 11.4 - 90.9 LPM at temperatures of 220 and 400 °C, yielding an uncertainty in calibration of 2-3.6%. Here, a finite element model was developed and validated experimentally, yielding <; 3.2% error.

47 OTHER INSTRUMENTATION↗

DOE OSTI2025

pnnl/SNAP

In this work, we detail two uncertainty quantification (UQ) methods that provide complementary information. Readout ensembling, by finetuning only the readout layers of an ensemble of foundation models, provides information about model uncertainty. Amending the final readout layer to predict upper and lower quantiles replaces point predictions with distributional predictions, which provide information about uncertainty within the underlying training data. We demonstrate our approach with the MACE-MP-0 model, applying UQ to both the foundation model and a series of finetuned models. The uncertainties produced by the ensemble and quantile methods are demonstrated to be distinct measures by which the quality of the NNP output can be judged.

Pope, Jenna (Bilbrey) [Pacific Northwest National ↗

DOE OSTI2025

Model Calibration with Markov Chain Monte Carlo Tutorial

The purpose of this tutorial is to demonstrate how to use Markov chain Monte Carlo (MCMC) to calibrate a model. By calibration, we mean the selection of model parameters (and, when relevant, structures). A common goal in model development and diagnostics is calibration, or the identification of model structures and parameters which are consistent with data. While models can be calibrated through hand-tuning parameters or minimizing simple error metrics such as root-mean-square-error (RMSE), these approaches can underrepresent the probabilistic nature of the data-generating process, as well as the potential for multiple model configurations to be consistent with the data. Probabilistic uncertainty quantification, which is the topic of this notebook, can address these concerns. This tutorial is presented as an appendix to the e-book: Addressing Uncertainty in MultiSector Dynamics Research.

Markov chain Monte Carlo↗

DOE OSTI2025

Multi-fidelity equations of state and transport coefficient datasets for pulsed-power applications

Reliably simulating experiments relevant to the National Nuclear Security Administration (NNSA) requires a detailed description of material properties across a wide range of conditions. Such properties include the equations of state, charged-particle transport coefficients, and optical properties like the opacity. Together, these properties make up the material models used in radiation-magnetohydrodynamic simulations of nuclear fusion experiments. Many of these models do not incorporate uncertainties in the data used to produce them. It is unknown whether these uncertainties significantly impact the interpretation of simulation results and diagnostics. The purpose of this work is to quantify how such uncertainties impact simulations of pulsed-power experiments. We accomplished this task by first assessing discrepancies between approaches used to generate the data. This included bringing together members of the high-energy-density community spanning the three NNSA laboratories and multiple universities. Then, using these data, we developed a general framework that systematically incorporates physical uncertainties within the material models suitable for uncertainty quantification analyses. The framework utilizes machine learning, Bayesian inference, and incorporates multi-fidelity datasets. We demonstrated the framework by quantifying the impact that material model uncertainties have on simulations of pulsed-power experiments underway on Z at Sandia National Laboratories. As a result of this work, we discovered that modest uncertainties in material models (roughly 20%) correspond to significant uncertainties in the outputs from simulations. Our framework has enabled rapid construction of material models through an automated procedure and allows for the generation of material models of interest to the NNSA.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Conformal Hierarchical Simulation-Based Inference with Local Validity

Trustworthy and interpretable uncertainty quantification is a long-standing challenge in artificial intelligence. Simulation-based inference (SBI) comprises a broad swath of approaches for estimating latent parameters with uncertainties. Although flexible neural density estimators in SBI can be remark- ably expressive capturing highly structured, high-dimensional posteriors their credible regions can be badly mis-calibrated and are often only accompanied by heuristic coverage checks. We present the first SBI framework that delivers finite-sample local valid coverage guarantees that hold in the neighborhood of each observation. Our framework can couple any off-the-shelf hierarchical SBI engine with a confor- mal Bayesian post-processing step that operates on the posterior predictive density. A kernel-weighted conformity score adapts the conformal quantile to the local geometry of the data, yielding prediction sets that are simultaneously (i) marginally calibrated, (ii) locally valid, and (iii) hierarchical, handling global and observation-specific parameters in a single pass. Through experiments on synthetic data and benchmarks from neuroscience and physics, we show that our approach attains 1 − α coverage, where prior SBI methods under- or over-cover. Our approach also maintains a competitive, credible set size with minimal computational overhead. Finally, our approach can be used to make predictions on real data and give valid credible regions modulo weight-initialization-based model mis-specification.

Trivedi, Shubhendu [Fermilab]↗

DOE OSTI2024

Accurate field-level weak lensing inference for precision cosmology

We present miko, a catalog-to-cosmology pipeline for general flat-sky field-level inference, which provides access to cosmological information beyond the two-point statistics. In the context of weak lensing, we identify several new field-level analysis systematics (such as aliasing, Fourier mode-coupling, and density-induced shape noise), quantify their impact on cosmological constraints, and correct the biases to a percent level. Next, we find that model misspecification can lead to both absolute bias and incorrect uncertainty quantification for the inferred cosmological parameters in realistic simulations. The Gaussian map prior infers unbiased cosmological parameters, regardless of the true data distribution, but it yields overconfident uncertainties. The log-normal map prior quantifies the uncertainties accurately, although it requires careful calibration of the shift parameters for unbiased cosmological parameters. Here, we demonstrate systematics control down to the 2% level for both models, making them suitable for ongoing weak lensing surveys.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

fvGP v2.2.0

fvGP is a flexible Gaussian process API that enables gpCAM, a software recently submitted, to do uncertainty quantification and steer data acquisition autonomously. In short, given a bunch of data, fvGP can find the most likely model creating the data and the model's uncertainty.

Noack, Marcus↗

DOE OSTI2025

Identifying high-impact and high-uncertainty parameters in MiniFuel model predictions

The MiniFuel irradiation platform at Oak Ridge National Laboratory's High Flux Isotope Reactor (HFIR) is a flexible, high-throughput separate effects test capability. Finite element thermal models are relied upon to design MiniFuel experiments and to achieve experimental objectives. Recent reports show good agreement in the model prediction of target fuel temperatures, but as the capability of the experiments is extended to higher temperatures, the uncertainty in the model predictions must be quantified. To that end, high-impact, high-uncertainty parameters that contribute the most uncertainty to the model are identified. The uncertainty quantification was accomplished through a series of screening and sensitivity analyses. The first analysis utilizes the method of Morris to perform a computationally efficient preliminary screening that considers uncertainty in a large number of the model inputs. The most important parameters identified in the Morris screening study were then considered in a Sobol sensitivity analysis that more robustly ranks and quantifies the uncertainty associated with each parameter. From these analyses, it was determined that thermal contact conductance between components is the parameter that contributes the highest uncertainty. The estimated uncertainty of the MiniFuel model fuel temperature predictions is ±80 °C in the removable beryllium and ±40 °C in the vertical experiment facilities. In conclusion, the framework established by the series of sensitivity analyses presented herein could easily be adapted to fit the needs of accelerated fuel qualification processes.

Fuel, Irradiation↗

DOE OSTI2025

Implementation of Perturbation Theory and Sensitivity Capabilities in Griffin

Griffin is a Multiphysics Object-Oriented Simulation Environment (MOOSE) based reactor Multiphysics analysis application, jointly developed by Argonne and Idaho National Laboratories under the DOE-NE NEAMS program. This fiscal year, capabilities for reactivity and sensitivity evaluation using perturbation methods were implemented and verified. The First Order Perturbation Method (FOPT) was employed to compute reactivity worth resulting from small perturbations in input parameters, while the Generalized Perturbation Theory (GPT) was used to evaluate sensitivities of a range of response types, including reaction rate ratio, k-eigenvalue, neutron generation time, and effective delayed neutron fraction. These perturbation methods enable users to quantify how response quantities change due to a perturbation in a input parameter without explicitly performing an additional transport simulation for each perturbed state. In particular, the GPT formulation accounts for indirect effects arising from flux changes by solving generalized inhomogeneous equations, for which a Neumann series-based iterative solution method was developed and implemented in Griffin. The implemented reactivity and sensitivity evaluation capabilities were verified using two test problems: an infinite homogeneous system and a two-dimensional hexagonal core. The results showed excellent agreement with reference solutions obtained by a direct method based on finite difference approximation as well as GPT-based results from the PERSENT code, confirming the accuracy of both reactivity and sensitivity evaluations. Additionally, preliminary uncertainty quantification (UQ) results were obtained by combining the sensitivity values computed using GPT and external covariance data, demonstrating that the implemented sensitivity results can be reliably used for uncertainty calculations. To further demonstrate the generality and practical strength of the implementation, the sensitivity evaluation capability was successfully applied to the Empire microreactor with a geometrically complex design that poses significant modeling challenges. The results confirm that Griffin enables sensitivity evaluations even for irregular and highly heterogeneous reactor configurations, thereby establishing a foundation for UQ applications in advanced reactor designs and analyses.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

The Reduction of Random Uncertainty in Differential Temperature Measurements Using Common Leg Thermocouples

The uncertainty quantification of random error is considered for common leg thermocouples (i.e., where one thermoelement is shared along the length of the TC for all other TC junctions present). The uncertainty is presented for both a common leg and individual, separate leg thermocouples. For Type K thermocouples a reduction in uncertainty by up to 3x is capable when differential temperatures, ?T, are within 150°C, and diminishes to little to no improvement above 150°C.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

DOE OSTI2021

Foundations of Rigorous Cyber Experimentation

This report presents the results of the “Foundations of Rigorous Cyber Experimentation” (FORCE) Laboratory Directed Research and Development (LDRD) project. This project is a companion project to the “Science and Engineering of Cyber security through Uncertainty quantification and Rigorous Experimentation” (SECURE) Grand Challenge LDRD project. This project leverages the offline, controlled nature of cyber experimentation technologies in general, and emulation testbeds in particular, to assess how uncertainties in network conditions affect uncertainties in key metrics. We conduct extensive experimentation using a Firewheel emulation-based cyber testbed model of Invisible Internet Project (I2P) networks to understand a de-anonymization attack formerly presented in the literature. Our goals in this analysis are to see if we can leverage emulation testbeds to produce reliably repeatable experimental networks at scale, identify significant parameters influencing experimental results, replicate the previous results, quantify uncertainty associated with the predictions, and apply multi-fidelity techniques to forecast results to real-world network scales. The I2P networks we study are up to three orders of magnitude larger than the networks studied in SECURE and presented additional challenges to identify significant parameters. The key contributions of this project are the application of SECURE techniques such as UQ to a scenario of interest and scaling the SECURE techniques to larger network sizes. This report describes the experimental methods and results of these studies in more detail. In addition, the process of constructing these large-scale experiments tested the limits of the Firewheel emulation-based technologies. Therefore, another contribution of this work is that it informed the Firewheel developers of scaling limitations, which were subsequently corrected.

97 MATHEMATICS AND COMPUTING↗

NASA NTRSDate not supplied

Design Under Uncertainty for Conceptual Aircraft Design Leveraging Analytical Gradients

The purpose of this paper is to extend previously demonstrated methodologies for design under uncertainty, leveraging analytical gradients to higher fidelity analysis for use in conceptual aircraft design. Previous work developed methods to generate analytical derivatives through polynomial chaos expansion, eliminating the need to estimate derivatives via complex step or finite difference. In this research, the authors build upon the methods to include physics-based aircraft design codes for aircraft design under uncertainty. This extends the previous work’s case study, which employed analytical aerodynamics and Breguet range estimations for wing design, to a higher fidelity level. In addition, this work extends previous work on interface development between the Uncertainty Quantification with Polynomial Chaos Expansion (UQPCE) software and Model-Based Systems Analysis and Engineering (MBSA&E) frameworks. This paper will discuss the development work necessary to perform multidisciplinary design under uncertainty as well as demonstrate the mechanics of interfacing UQPCE and conceptual aircraft design tools such as NASA’s Aviary code. In a case study, a conceptual aircraft design under uncertainty was conducted and compared against a traditional deterministic design. When given information about the uncertainty space from UQPCE, the optimizer was able to shape the output distribution and produce a more robust design

UQ↗

NASA NTRSDate not supplied

Design Under Uncertainty for Conceptual Aircraft Design Leveraging Analytical Gradients

UQ↗

DOE OSTI2021

Challenging Practices of Algebraic Battery Life Models through Statistical Validation and Model Identification via Machine-Learning

Various modeling techniques are used to predict the capacity fade of Li-ion batteries. Algebraic reduced-order models, which are inherently interpretable and computationally fast, are ideal for use in battery controllers, technoeconomic models, and multi-objective optimizations. For Li-ion batteries with graphite anodes, solid-electrolyte-interphase (SEI) growth on the graphite surface dominates fade. This fade is often modeled using physically informed equations, such as square-root of time for predicting solvent-diffusion limited SEI growth, and Arrhenius and Tafel-like equations predicting the temperature and state-of-charge rate dependencies. In some cases, completely empirical relationships are proposed. However, statistical validation is rarely conducted to evaluate model optimality, and only a handful of possible models are usually investigated. This article demonstrates a novel procedure for automatically identifying reduced-order degradation models from millions of algorithmically generated equations via bi-level optimization and symbolic regression. Identified models are statistically validated using cross-validation, sensitivity analysis, and uncertainty quantification via bootstrapping. On a LiFePO 4 /Graphite cell calendar aging data set, automatically identified models utilizing square-root, power law, stretched exponential, and sigmoidal functions result in greater accuracy and lower uncertainty than models identified by human experts, and demonstrate that previously known physical relationships can be empirically "rediscovered" using machine learning.

25 ENERGY STORAGE↗

DOE OSTI2023

Predictive Capability Maturity Model Demonstration for Cylindrical Cavity Coupling Using Gemma in the Next Generation Workflow

The predictive capability maturity model (PCMM) uses the expert elicitation process to generate credibility evidence for a particular analysis. To ensure Gemma has the capability to efficiently produce this credibility evidence, next generation workflows (NGW) are created for the solution verification, calibration/validation, and input uncertainty quantification portions of the PCMM assessment. These workflows are then used on the Higgins cylinder problem, which is representative of applications involving external-to-internal electromagnetic field coupling through a slot. The uncertainties calculated using these workflows are then used to calculate the validation comparison error and the validation uncertainty for the model following the American Society of Mechanical Engineers (ASME) verification and validation (V&V) 20 standard. These workflows will enable analysts to iterate each element of PCMM more efficiently than if completed without using a NGW workflow. An example of this iterative process is shown in Section 7.2.

42 ENGINEERING↗

NASA NTRS2019

Operational and Technical Updates to the Object Reentry Survival Analysis Tool

The Object Reentry Survival Analysis Tool (ORSAT) has been used in the NASA Orbital Debris Program Office for over 25 years to estimate risk due to uncontrolled reentry of spacecraft and rocket bodies. Development over the last 3 years has included: a major change to the treatment of carbon fiber- and glass fiber-reinforced plastics (CFRP and GFRP, respectively); an updated atmospheric model; a new model for computing casualty area around an impacting debris object; and a newly-implemented scheme to determine the breakup altitude of a reentry object. Software also was written to automatically perform parameter sweeps in ORSAT to allow for uncertainty quantification and sensitivity analysis for components with borderline demisability. These updates have improved the speed and fidelity of the reentry analysis performed using ORSAT, and have allowed for improved engineering understanding by estimating the uncertainty for each component’s survivability. A statistical model for initial conditions captures the latitude bias in population density, a large improvement over the previous inclination-based latitude-averaged models. A sample spacecraft has been analyzed with standard techniques using ORSAT 6.2.1 and again using all the updated models; we will demonstrate the variation in the total debris casualty area and overall expectation of casualty.

Ostrom, C.↗

DOE OSTI2024

Evidential Deep Learning for Probabilistic Modelling of Extreme Storm Events

Uncertainty quantification (UQ) methods play an important role in reducing errors in weather forecasting. Conventional approaches in UQ for weather forecasting rely on generating an ensemble of forecasts from physics-based simulations to estimate the uncertainty. However, it is computationally expensive to generate many forecasts to predict real-time extreme weather events. Evidential Deep Learning (EDL) is an uncertainty-aware deep learning approach designed to provide confidence about its predictions using only one forecast. It treats learning as an evidence acquisition process where more evidence is interpreted as increased predictive confidence. We apply EDL to storm forecasting using real-world weather datasets and compare its performance with traditional methods. Our findings indicate that EDL not only reduces computational overhead but also enhances predictive uncertainty. This method opens up novel opportunities in research areas such as climate risk assessment, where quantifying the uncertainty about future climate is crucial.

97 MATHEMATICS AND COMPUTING↗