Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Uncertainty quantification for misspecified machine learned interatomic potentials

The use of high-dimensional regression techniques from machine learning has significantly improved the quantitative accuracy of interatomic potentials. Atomic simulations can now plausibly target quantitative predictions in a variety of settings, which has brought renewed interest in robust means to quantify uncertainties. In many practical settings where model complexity is constrained (e.g., due to performance considerations), misspecification — the inability of any one choice of model parameters to exactly match all training data — is a key contributor to errors that is often disregarded. Here, we employ a recent misspecification-aware regression technique to quantify parameter uncertainties, which is then propagated to a broad range of phase and defect properties in tungsten. The propagation is performed through both brute-force resampling and implicit Taylor expansion. The propagated misspecification uncertainties robustly quantify and bound errors on a broad range of material properties. We demonstrate application to recent foundational machine learning interatomic potentials, accurately predicting and bounding errors in MACE-MPA-0 energy predictions across the diverse materials project database.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A framework for quantifying uncertainty in DFT energy corrections

In this work, we demonstrate a method to quantify uncertainty in corrections to density functional theory (DFT) energies based on empirical results. Such corrections are commonly used to improve the accuracy of computational enthalpies of formation, phase stability predictions, and other energy-derived properties, for example. We incorporate this method into a new DFT energy correction scheme comprising a mixture of oxidation-state and composition-dependent corrections and show that many chemical systems contain unstable polymorphs that may actually be predicted stable when uncertainty is taken into account. We then illustrate how these uncertainties can be used to estimate the probability that a compound is stable on a compositional phase diagram, thus enabling better-informed assessments of compound stability.

42 ENGINEERING↗
DOE OSTI2022

Uncertainty quantification for Bayesian active learning in rupture life prediction of ferritic steels

Abstract Three probabilistic methodologies are developed for predicting the long-term creep rupture life of 9–12 wt%Cr ferritic-martensitic steels using their chemical and processing parameters. The framework developed in this research strives to simultaneously make efficient inference along with associated risk, i.e., the uncertainty of estimation. The study highlights the limitations of applying probabilistic machine learning to model creep life and provides suggestions as to how this might be alleviated to make an efficient and accurate model with the evaluation of epistemic uncertainty of each prediction. Based on extensive experimentation, Gaussian Process Regression yielded more accurate inference ( $$Pearson\;correlation\;coefficent> 0.95$$ P e a r s o n c o r r e l a t i o n c o e f f i c e n t > 0.95 for the holdout test set) in addition to meaningful uncertainty estimate (i.e., coverage ranges from 94 to 98% for the test set) as compared to quantile regression and natural gradient boosting algorithm. Furthermore, the possibility of an active learning framework to iteratively explore the material space intelligently was demonstrated by simulating the experimental data collection process. This framework can be subsequently deployed to improve model performance or to explore new alloy domains with minimal experimental effort.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2022

Uncertainty propagation in pore water chemical composition calculation using surrogate models

Performance assessment in deep geological nuclear waste repository systems necessitates an extended knowledge of the pore water chemical conditions prevailing in host-rock formations. In the last two decades, important progress has been made in the experimental characterization and thermodynamic modeling of pore water speciation, but the influence of experimental artifacts and uncertainties of thermodynamic input parameters are seldom evaluated. In this respect, we conducted an uncertainty propagation study in a reference geochemical model describing the pore water chemistry of the Callovian-Oxfordian clay formation. Nineteen model input parameters were perturbed, including those associated to experimental characterization (leached anions, exchanged cations, cation exchange selectivity coefficients) and those associated to generic thermodynamic databases (solubilities). A set of 13 quantities of interest were studied by the use of polynomial chaos expansions built non-intrusively with a least-squares forward stepwise regression approach. Training and validation sets of simulations were carried out using the geochemical speciation code PHREEQC. The statistical results explored the marginal distribution of each quantity of interest, their bivariate correlations as well as their global sensitivity indices. The influence of the assumed distributions for input parameters uncertainties was evaluated by considering two parametric domain sizes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Radiation image reconstruction and uncertainty quantification using a Gaussian process prior

We propose a complete framework for Bayesian image reconstruction and uncertainty quantification based on a Gaussian process prior (GPP) to overcome limitations of maximum likelihood expectation maximization (ML-EM) image reconstruction algorithm. The prior distribution is constructed with a zero-mean Gaussian process (GP) with a choice of a covariance function, and a link function is used to map the Gaussian process to an image. Unlike many other maximum a posteriori approaches, our method offers highly interpretable hyperparamters that are selected automatically with the empirical Bayes method. Furthermore, the GP covariance function can be modified to incorporate a priori structural priors, enabling multi-modality imaging or contextual data fusion. Lastly, we illustrate that our approach lends itself to Bayesian uncertainty quantification techniques, such as the preconditioned Crank–Nicolson method and the Laplace approximation. The proposed framework is general and can be employed in most radiation image reconstruction problems, and we demonstrate it with simulated free-moving single detector radiation source imaging scenarios. We compare the reconstruction results from GPP and ML-EM, and show that the proposed method can significantly improve the image quality over ML-EM, all the while providing greater understanding of the source distribution via the uncertainty quantification capability. Furthermore, significant improvement of the image quality by incorporating a structural prior is illustrated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Understanding drivers and uncertainty in projected African precipitation

We investigate the drivers of projected summer precipitation changes and their uncertainties across Africa in the second half of the 21st century under the SSP2-4.5 and SSP5-8.5 scenarios using CMIP6 models. Our results reveal distinct regional precipitation changes, particularly under SSP5-8.5, with robust increases of 75%, 24%, and 17% over the Sahara, South Eastern Africa, and South Central Africa, respectively, and a decline of up to 5% over West Southern Africa (WSAF). In most regions, precipitation increases are driven by enhanced vertical thermodynamic processes associated with temperature-induced moisture increases and enhanced moisture convergence. In contrast, the WSAF decrease is associated with vertical dynamic processes driven by a weakening of the Hadley circulation’s ascending branch. Model uncertainty accounts for over 85% of total projection uncertainty across all regions and is largely due to subgrid-scale parameterizations. Overall, this study enhances our understanding of climate change impacts on African precipitation.

Taguela, Thierry N↗
DOE OSTI2023

Templates of expected measurement uncertainties for prompt fission neutron spectra

In this paper, we provide templates of uncertainty sources expected to appear for three measurement types of prompt fission neutron spectra (PFNS): (1) shape measurements, (2) clean-ratio shape, that is the monitor PFNS are measured in nearly exactly the same surrounding as the PFNS of interest, and (3) indirect ratios, where the detector efficiency is backed out from PFNS monitor measurements. Information is also listed that is needed to faithfully include PFNS in nuclear data evaluations to guide experimenters on how to best report data and metadata for their measurements. These templates also suggest a typical range of pertinent uncertainty values and their correlations in case realistic uncertainties cannot be estimated from information on the measurement itself. The templates were based on a literature review, information found in EXFOR for 252 Cf, 235, 238 U, and 239 Pu PFNS, and enhanced by expertise from experimenters contributing to these PFNS templates.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Sensitivity of an integrated experiment to uncertainty in the high explosive equations of state

Traditionally, hydrodynamics simulations are performed with a single equation-of-state (EOS) to describe each material. These EOSs typically have a physics-informed functional form with adjustable parameters that are calibrated in order to replicate small-scale data. However, because the calibration data have uncertainty and there are typically inherent degeneracies in fitting the EOS, there are actually multiple EOSs that might be consistent with calibration data. In this work, we perform uncertainty quantification (UQ) for the reactant and product equations of state for the high explosive PBX 9501 to yield an ensemble of EOSs that match the uncertain small-scale calibration data. We then simulate an experiment of an explosively formed penetrator repeatedly with different EOSs to both validate the UQ analysis and determine the effects of EOS uncertainty on the prediction of quantities of interest in the experiment. In general, we find good agreement between the simulation predictions and the experimental measurements, and we identify an EOS variable that contributes most directly to the spread in the predictions as the EOSs are varied.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Selection of a Pair of Experiments to Optimally Reduce Uncertainty in Targeted Nuclear Data

We propose a novel process to select a pair of differential and integral experiments that best reduce uncertainties in targeted 239 ⁢Pu nuclear data while compressing the current nuclear data pipeline from 20 to 3 years. 239⁢ Pu nuclear data are poorly understood for neutrons in the intermediate energy range due to sparsity and uncertainty in historical experiments. New experiments targeting this range will enable better understanding of these nuclear data, but choosing the ideal experiments to conduct is challenging. Beginning with a prior distribution represented by samples of nuclear data generated from theory, generalized least squares adjustments are made to incorporate data from historical experiments. To quantify potential uncertainty reduction obtainable from a pair of candidate experiments, we compute the D-optimality criterion of the posterior covariance of intermediate energy range nuclear data compared to the equivalent covariance after additional adjustment to the pair of candidate experiments. Repeating the process for each of many candidate pairs facilitates the final selection. Results support 63⁢ Cu total cross section measurements for differential experiments and alumina and alumina/graphite configurations for integral experiments. This analysis enables choosing differential and integral experiments to be executed concurrently while shortening decision times relative to the current nuclear data pipeline.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Analytic marginalization of N(z) uncertainties in tomographic galaxy surveys

In this paper, we present a new method to marginalize over uncertainties in redshift distributions, N(z), within tomographic cosmological analyses applicable to current and upcoming photometric galaxy surveys. We allow for arbitrary deviations from the best-guess N(z) governed by a general covariance matrix describing the uncertainty in our knowledge of redshift distributions. In principle, this is marginalization over hundreds or thousands of new parameters describing potential deviations as a function of redshift and tomographic bin. However, by linearly expanding the theory predictions around a fiducial model, this marginalization can be performed analytically, resulting in a modified data covariance matrix that effectively downweights the modes of the data vector that are more sensitive to redshift distribution variations. We showcase this method by applying it to the galaxy clustering measurements from the Hyper Suprime-Cam first data release. We illustrate how to marginalize over sample variance of the calibration sample and a large general systematic uncertainty in photometric estimation methods, and explore the impact of priors imposing smoothness in the redshift distributions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Geant4Reweight: a framework for evaluating and propagating hadronic interaction uncertainties in Geant4

Geant4Reweight is an open-source C++ framework that allows users to weight tracks produced by the Geant4 particle transport Monte Carlo simulation according to hadron interaction cross section variations and estimate uncertainties in Geant4 interaction models by comparing the simulation’s hadron interaction cross section predictions to data. The ability to weight hadron transport as simulated by Geant4 is crucial to the propagation of systematic uncertainties related to secondary hadronic interactions in current and upcoming neutrino oscillation experiments, including MicroBooNE, NOvA, and DUNE, aswell as hadron test beam experiments such as ProtoDUNE. Here, we provide motivation for weighting hadron tracks in Geant4 in the context of systematic uncertainty propagation, a description of Geant4’s transport simulation technique, and a description of our weighting technique and fitting framework in the momentum range 0–10 GeV/c, which is typical for the hadrons produced by neutrino interactions in these experiments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Deep neural network uncertainty quantification for LArTPC reconstruction

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural networks with reliable estimates of prediction uncertainty and robust performance against overconfidence and out-of-distribution (OOD) samples are critical for their full deployment in analyzing experimental data. While numerous UQ methods have been tested on simple datasets, performance evaluations for more complex tasks and datasets are scarce. Here we assess the application of selected deep learning UQ methods on the task of particle classification using the PiLArNet monte carlo 3D LArTPC point cloud dataset. We observe that UQ methods not only allow for better rejection of prediction mistakes and OOD detection, but also generally achieve higher overall accuracy across different task settings. We assess the precision of uncertainty quantification using different evaluation metrics, such as distributional separation of prediction entropy across correctly and incorrectly identified samples, receiver operating characteristic curves (ROCs), and expected calibration error from observed empirical accuracy. We conclude that ensembling methods can obtain well calibrated classification probabilities and generally perform better than other existing methods in deep learning UQ literature.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Clarifying trust of materials property predictions using neural networks with distribution-specific uncertainty quantification

It is critical that machine learning (ML) model predictions be trustworthy for high-throughput catalyst discovery approaches. Uncertainty quantification (UQ) methods allow estimation of the trustworthiness of an ML model, but these methods have not been well explored in the field of heterogeneous catalysis. Herein, we investigate different UQ methods applied to a crystal graph convolutional neural network to predict adsorption energies of molecules on alloys from the Open Catalyst 2020 dataset, the largest existing heterogeneous catalyst dataset. We apply three UQ methods to the adsorption energy predictions, namely k-fold ensembling, Monte Carlo dropout, and evidential regression. The effectiveness of each UQ method is assessed based on accuracy, sharpness, dispersion, calibration, and tightness. Evidential regression is demonstrated to be a powerful approach for rapidly obtaining tunable, competitively trustworthy UQ estimates for heterogeneous catalysis applications when using neural networks. Recalibration of model uncertainties is shown to be essential in practical screening applications of catalysts using uncertainties.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Characterizing Uncertainty in Synthetic Tropical Cyclone Hazard Models for U.S. Energy Infrastructure Resilience

Tropical Cyclones (TCs) are intense storms that pose a persistent and considerable risk to coastal communities and infrastructure in the global tropics and subtropics, including the United States (US). With known limitations associated with observations and high-resolution earth system models, synthetic TC models that capture a wide spectrum of storm possibilities have been developed to robustly quantify TC risk. Here we examine the simulation of various TC features in the North Atlantic relevant for US coastal risk in three synthetic TC models forced with ERA5 reanalysis: MIT, CHAZ and RAFT. While there is a broad agreement among these models in terms of their representation of salient TC characteristics, certain differences do exist. To connect these modeling uncertainties with energy infrastructure resilience, we apply fragility curves that link simulated TC intensities to damage probabilities, demonstrating how uncertainty in storm states may translate into that in coastal impacts. Our study indicates that acknowledging and accounting for inter-model uncertainty leads to more reliable risk assessments, strengthening science-to-action pathways for managing risks associated with TCs.

Baby John, Effy↗
DOE OSTI2020

Towards real-time monitoring: data assimilated time-lapse full waveform inversion for seismic velocity and uncertainty estimation

SUMMARY Rapid development of time-lapse seismic monitoring instrumentations has made it possible to collect dense time-lapse data for tomographically retrieving time-lapse (even continuous) images of subsurface changes. While traditional time-lapse full waveform inversion (TLFWI) algorithms are designed for sparse time-lapse surveys, they lack of effective temporal constraint on time-lapse data, and, more importantly, lack of the uncertainty estimation of the TLFWI results that is critical for further interpretation. Here, we propose a new data assimilation TLFWI method, using hierarchical matrix powered extended Kalman filter (HiEKF) to quantify the image uncertainty. Compared to existing Kalman filter algorithms, HiEKF allows to store and update a data-sparse representation of the cross-covariance matrices and propagate model errors without expensive operations involving covariance matrices. Hence, HiEKF is computationally efficient and applicable to 3-D TLFWI problems. Then, we reformulate TLFWI in the framework of HiEKF (termed hereafter as TLFWI-HiEKF) to predict time-lapse images of subsurface spatiotemporal velocity changes and simultaneously quantify the uncertainty of the inverted velocity changes over time. We demonstrate the validity and applicability of TLFWI–HiEKF with two realistic CO2 monitoring models derived from Frio-II and Cranfield CO2 injection sites, respectively. In both 2-D and 3-D examples, the inverted high-resolution time-lapse velocity results clearly reveal a continuous velocity reduction due to the injection of CO2. Moreover, the accuracy of the model is increasing over time by assimilating more time-lapse data while the standard deviation is decreasing over lapsed time. We expect TLFWI-HiEKF to be equipped with real-time seismic monitoring systems for continuously imaging the distribution of subsurface gas and fluids in the future large-scale CO2 sequestration experiments and reservoir management.

58 GEOSCIENCES↗
DOE OSTI2020

The effects of earth model uncertainty on the inversion of seismic data for seismic source functions

SUMMARY We use Monte Carlo simulations to explore the effects of earth model uncertainty on the estimation of the seismic source time functions that correspond to the six independent components of the point source seismic moment tensor. Specifically, we invert synthetic data using Green’s functions estimated from a suite of earth models that contain stochastic density and seismic wave-speed heterogeneities. We find that the primary effect of earth model uncertainty on the data is that the amplitude of the first-arriving seismic energy is reduced, and that this amplitude reduction is proportional to the magnitude of the stochastic heterogeneities. Also, we find that the amplitude of the estimated seismic source functions can be under- or overestimated, depending on the stochastic earth model used to create the data. This effect is totally unpredictable, meaning that uncertainty in the earth model can lead to unpredictable biases in the amplitude of the estimated seismic source functions.

58 GEOSCIENCES↗
DOE OSTI2022

An efficient method to propagate model uncertainty when inverting seismic data for time domain seismic moment tensors

SUMMARY We present a computationally efficient method to approximately propagate uncertainty when linearly inverting seismic data for point source, time variable moment tensor components. The method is based on the assumption that the data residual, given by the difference between the observed seismic data and the data predicated by a linear inversion, contains the effects of both data and model uncertainty. Our method uses a distribution of data residuals, added directly to the data, in a pseudo-Monte Carlo scheme. Using the assumption that the data residual is a stochastic process, we use the well-known Karhunen–Loève (KL) theorem to construct a distribution of data residuals, where the required basis functions are constructed using Fourier series. The Fourier series are scaled by a product of a random variable and the real-valued spectral amplitudes of the original data residual’s spectrum. Thus, the Fourier series and spectral amplitudes are eigenfunction-eigenvalue pairs used in the KL-based construction of data residual distribution. Using tests with synthetic data, we show that our method compares closely with a Finite Difference Monte Carlo (FDMC) method that we presented previously. More importantly, the method presented here is computationally several orders of magnitude faster than our previous FDMC method, and requires no a priori assumptions of model and/or data uncertainty.

Poppeliers, Christian (ORCID:0000000159526849)↗
DOE OSTI2020

Black hole spin in X-ray binaries: giving uncertainties an $\mathcal{f}$

The two established techniques for measuring black hole spin in X-ray binaries often yield conflicting results, which must be resolved before either method may be deemed robust. In practice, black hole spin measurements based on fitting the accretion disc continuum effectively do not marginalize over the colour-correction factor f col . This factor parametrizes spectral hardening of the disc continuum by the disc atmosphere, whose true properties are poorly constrained. We incorporate reasonable systematic uncertainties in f col into the eight (non-maximal) black hole spin measurements vetted by the disc continuum fitting community. In most cases, an f col uncertainty of ±0.2–0.3 dominates the black hole spin error budget. We go on to demonstrate that plausible departures in f col values from those adopted by the disc continuum fitting practitioners can bring the discrepant black hole spins into agreement with those from iron line modelling. Systematic uncertainties in f col , such as the effects of strong magnetization, should be better understood before dismissing their potentially dominant impact on the black hole spin error budget.

4U 1543–47↗