Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Exploiting SMILEs and the CMIP5 Archive to Understand Arctic Climate Change Seasonality and Uncertainty

Arctic Amplification (AA) exhibits a distinct seasonal dependence; it is weakest in boreal summer and strongest in winter. Here, we analyze simulations from single-model initial-condition large ensembles and Coupled Model Intercomparison Project Phase 5 to decipher the seasonal evolution of Arctic climate change. Models agree that the annual maximum AA shifts from autumn into winter over the 21st century, accompanied by similar shifts in sea-ice loss and surface turbulent heat fluxes, whereas the maximum precipitation shifts only into late autumn. However, the exact seasonal timing and magnitude of these shifts are highly uncertain. Decomposing the uncertainty into model structural differences, emission scenarios, and internal variability reveals that model differences dominate the total uncertainty, which also undergo autumn-to-winter shifts. We also find that the scenario uncertainty is unimportant for projections of AA. These results highlight that understanding model differences is critical to reducing uncertainty in projected Arctic climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

A Framework for Parametric and Predictive Uncertainty Quantification in the E3SM Land Model: Assessing Site and Observable Generalizability

Quantifying parametric uncertainty using observations from individual sites provides a critical foundation for Earth system modeling, serving as a necessary first step before scaling up to regional or global applications. This study introduces a novel computational framework designed to enhance model predictability by reducing parametric uncertainty and assessing site and observable generalizability using various observational constraints. The framework integrates five components: Model Simulation, Statistical Emulation, Global Sensitivity Analysis (GSA), Model Calibration, and Model Prediction. Using the E3SM land model, we simulated site-level land-atmosphere carbon and energy fluxes from 2003 to 2007 across five evergreen needleleaf FLUXNET sites, perturbing 26 vegetation-related model parameters. Gaussian process emulators were employed to expedite GSA and model calibration. Four critical parameters that strongly influence selected land-atmosphere fluxes were identified by GSA. Bayesian approaches were used to infer parameter probability distributions leveraging synthetic data and FLUXNET observations. The results reveal that posterior parameter distributions vary significantly across different sites and observables within the same plant functional type. Probabilistic predictions indicate that parameters calibrated at one site can enhance predictive accuracy at other sites, although site heterogeneity may sometimes outweigh parametric uncertainty. Additionally, the probabilistic predictions demonstrate that calibration for one variable can also improve predictability for other variables, thereby maximizing predictive capabilities with limited observations. This framework provides a powerful approach for reducing parametric uncertainty in Earth system models and deepening our understanding of carbon dynamics and energy cycles. Its adaptability makes it a valuable tool for broader applications in Earth system modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Uncertainty in El Niño-like warming and California precipitation changes linked by the Interdecadal Pacific Oscillation

Abstract Marked uncertainty in California (CA) precipitation projections challenges their use in adaptation planning in the region already experiencing severe water stress. Under global warming, a westerly jet extension in the North Pacific analogous to the El Niño-like teleconnection has been suggested as a key mechanism for CA winter precipitation changes. However, this teleconnection has not been reconciled with the well-known El Niño-like warming response or the controversial role of internal variability in the precipitation uncertainty. Here we find that internal variability contributes > 70% and > 50% of uncertainty in the CA precipitation changes and the El Niño-like warming, respectively, based on analysis of 318 climate simulations from several multi-model and large ensembles. The Interdecadal Pacific Oscillation plays a key role in each contribution and in connecting the two via the westerly jet extension. This unifying understanding of the role of internal variability in CA precipitation provides critical guidance for reducing and communicating uncertainty to inform adaptation planning.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Vegetation biogeography is a main source of uncertainty in modelling the land carbon cycle

The terrestrial biosphere exchanges a large amount of CO 2 with the atmosphere through photosynthesis and respiration, determining the magnitude of land carbon sink and consequently influencing the rate of global warming. The magnitudes of global photosynthesis and respiration, however, vary widely across models (100-200 PgC/year), constituting a key and persistent source of uncertainty in carbon cycle and climate modelling. Here, we argue that the uncertainty in the land carbon cycle modelling is largely attributable to the uncertainty in biogeography – the distribution of plant functional types (PFTs). Using an ensemble of dynamic global vegetation models (DGVMs), we find a strong dependence of total photosynthesis on total area for each PFT. The dependence allows us to reduce the spread of land carbon cycle estimates by ~75% using remote sensing-based PFT maps. We further find that 56 ± 21% of climate-driven changes in global photosynthesis modelled by DGVMs are caused by changes in PFT distribution in the last two decades. Our study identifies vegetation biogeography as a main controlling factor of uncertainty in land carbon cycle modelling and highlights the importance of biogeography-climate interactions in carbon cycle and climate studies.

Zhao, Ruiying [National Univ. of Singapore (Singap↗
DOE OSTI2022

Uncertainty-aware mixed-variable machine learning for materials design

Abstract Data-driven design shows the promise of accelerating materials discovery but is challenging due to the prohibitive cost of searching the vast design space of chemistry, structure, and synthesis methods. Bayesian optimization (BO) employs uncertainty-aware machine learning models to select promising designs to evaluate, hence reducing the cost. However, BO with mixed numerical and categorical variables, which is of particular interest in materials design, has not been well studied. In this work, we survey frequentist and Bayesian approaches to uncertainty quantification of machine learning with mixed variables. We then conduct a systematic comparative study of their performances in BO using a popular representative model from each group, the random forest-based Lolo model (frequentist) and the latent variable Gaussian process model (Bayesian). We examine the efficacy of the two models in the optimization of mathematical functions, as well as properties of structural and functional materials, where we observe performance differences as related to problem dimensionality and complexity. By investigating the machine learning models’ predictive and uncertainty estimation capabilities, we provide interpretations of the observed performance differences. Our results provide practical guidance on choosing between frequentist and Bayesian uncertainty-aware machine learning models for mixed-variable BO in materials design.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Uncertainty-driven dynamics for active learning of interatomic potentials

Machine learning (ML) models, if trained to data sets of high-fidelity quantum simulations, produce accurate and efficient interatomic potentials. Active learning (AL) is a powerful tool to iteratively generate diverse data sets. In this approach, the ML model provides an uncertainty estimate along with its prediction for each new atomic configuration. If the uncertainty estimate passes a certain threshold, then the configuration is included in the data set. Here we develop a strategy to more rapidly discover configurations that meaningfully augment the training data set. The approach, uncertainty-driven dynamics for active learning (UDD-AL), modifies the potential energy surface used in molecular dynamics simulations to favor regions of configuration space for which there is large model uncertainty. The performance of UDD-AL is demonstrated for two AL tasks: sampling the conformational space of glycine and sampling the promotion of proton transfer in acetylacetone. The method is shown to efficiently explore the chemically relevant configuration space, which may be inaccessible using regular dynamical sampling at target temperature conditions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Templates of expected measurement uncertainties for (n, xn) cross sections

A template is provided for evaluating experimental uncertainties for neutron elastic and inelastic scattering cross sections and γ -ray production cross sections from (n, xn) measurements at laboratories with monoenergetic or white neutron sources. A typical range of uncertainties is presented for experiments detecting the scattered neutrons or the resulting de-excitation γ rays based on a survey of available data and input from many experimentalists and theorists with extensive knowledge in the field. Models commonly used to evaluate the resulting cross-sections are also discussed. Suggestions are made regarding what experimental and uncertainty information is needed for data evaluations and should be included when reporting experimental (n, xn) cross sections. Uncertainty values and correlations are recommended if these values cannot be estimated for past data from the literature.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Development of uncertainty-aware equation-of-state models: Application to copper

Sophisticated hydrodynamic codes are commonly used to understand and predict events relevant to natural and applied sciences. The degree to which these simulations reflect reality, however, is dependent on how well we understand the materials and underlying physics involved. These research communities need material models that communicate the uncertainty in the physical properties, which at their basest form comes from the uncertainty in the underlying experimental measurements. Additionally, we have constructed a new framework for using both experimental measurements and the associated experimental uncertainties to build equation-of-state models that reflect not only current best measurements but also the accuracy of those measurements. This method had been used to construct an ensemble of equation-of-state models for copper that communicates the experimental uncertainties in the data through the equation-of-state model, which is available for application in any simulation metric of interest.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Mechanistic Multiscale Uncertainty Propagation in Support of Accelerated Fuel Qualification

Taking a nuclear fuel concept through the research, development, and qualification stages has historically taken on the order of 20 to 25 years because of extensive irradiation tests required for a variety of conditions. The concept of accelerated fuel qualification (AFQ) has been proposed to increase the innovation pace for nuclear fuels. The goal of AFQ is not to replace the traditional qualification approach but rather to reduce the total number of experiments required to ensure approval from the regulatory authority. Of the many AFQ approaches being explored, advanced modeling—and, in particular, mechanistic modeling—is in a uniquely cross-cutting position to reduce the number of required integral tests through the inclusion of separate-effects testing, while helping to extrapolate reactor performance during rare events. We make the case that propagation of uncertainty through various computational length scales helps contextualize mechanistic modeling. We will utilize UO 2 fission gas diffusion predictions from the atomistically informed cluster dynamics code Centipede to inform fuel performance rodlet simulations using the BISON finite element code as the metric for showing how multiscale mechanistic uncertainty quantification can help reduce uncertainty in fuel performance. In conclusion, by quantifying uncertainty and its reduction through multiscale modeling, the qualification process may be accelerated through the reduction of costly irradiation experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Deeply uncertain: comparing methods of uncertainty quantification in deep learning algorithms

We present a comparison of methods for uncertainty quantification (UQ) in deep learning algorithms in the context of a simple physical system. Three of the most common uncertainty quantification methods - Bayesian Neural Networks (BNN), Concrete Dropout (CD), and Deep Ensembles (DE) - are compared to the standard analytic error propagation. We discuss this comparison in terms endemic to both machine learning ("epistemic" and "aleatoric") and the physical sciences ("statistical" and "systematic"). The comparisons are presented in terms of simulated experimental measurements of a single pendulum - a prototypical physical system for studying measurement and analysis techniques. Our results highlight some pitfalls that may occur when using these UQ methods. For example, when the variation of noise in the training set is small, all methods predicted the same relative uncertainty independently of the inputs. This issue is particularly hard to avoid in BNN. On the other hand, when the test set contains samples far from the training distribution, we found that no methods sufficiently increased the uncertainties associated to their predictions. This problem was particularly clear for CD. In light of these results, we make some recommendations for usage and interpretation of UQ methods.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

LTAU-FF: Loss Trajectory Analysis for Uncertainty in atomistic Force Fields

Model ensembles are effective tools for estimating prediction uncertainty in deep learning atomistic force fields. However, their widespread adoption is hindered by high computational costs and overconfident error estimates. In this work, we address these challenges by leveraging distributions of per-sample errors obtained during training and employing a distance-based similarity search in the model latent space. Our method, which we call LTAU (Loss Trajectory Analysis for Uncertainty), efficiently estimates the full probability distribution function of errors for any test point using the logged training errors, achieving speeds that are 2–3 orders of magnitudes faster than typical ensemble methods and allowing it to be used for tasks where training or evaluating multiple models would be infeasible. We apply LTAU towards estimating parametric uncertainty in atomistic force fields (LTAU-FF), demonstrating that it produces well-calibrated confidence intervals and predicts errors that correlate strongly with the true errors for data near the training domain. Furthermore, we show that the errors predicted by LTAU-FF can be used in practical applications for detecting out-of-domain data, tuning model performance, and predicting failure during simulations. We believe that LTAU will be a valuable tool for uncertainty quantification in atomistic force fields and is a promising method that should be further explored in other domains of machine learning.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A New Approach to Evaluate and Reduce Uncertainty of Model-Based Biodiversity Projections for Conservation Policy Formulation

Biodiversity projections with uncertainty estimates under different climate, land-use, and policy scenarios are essential to setting and achieving international targets to mitigate biodiversity loss. Evaluating and improving biodiversity predictions to better inform policy decisions remains a central conservation goal and challenge. A comprehensive strategy to evaluate and reduce uncertainty of model outputs against observed measurements and multiple models would help to produce more robust biodiversity predictions. We propose an approach that integrates biodiversity models and emerging remote sensing and in-situ data streams to evaluate and reduce uncertainty with the goal of improving policy-relevant biodiversity predictions. In this work, we describe a multivariate approach to directly and indirectly evaluate and constrain model uncertainty, demonstrate a proof of concept of this approach, embed the concept within the broader context of model evaluation and scenario analysis for conservation policy, and highlight lessons from other modeling communities.

essential biodiversity variables↗
DOE OSTI2022

Dark Energy Survey Year 3 results: marginalization over redshift distribution uncertainties using ranking of discrete realizations

ABSTRACT Cosmological information from weak lensing surveys is maximized by sorting source galaxies into tomographic redshift subsamples. Any uncertainties on these redshift distributions must be correctly propagated into the cosmological results. We present hyperrank, a new method for marginalizing over redshift distribution uncertainties, using discrete samples from the space of all possible redshift distributions, improving over simple parametrized models. In hyperrank, the set of proposed redshift distributions is ranked according to a small (between one and four) number of summary values, which are then sampled, along with other nuisance parameters and cosmological parameters in the Monte Carlo chain used for inference. This approach can be regarded as a general method for marginalizing over discrete realizations of data vector variation with nuisance parameters, which can consequently be sampled separately from the main parameters of interest, allowing for increased computational efficiency. We focus on the case of weak lensing cosmic shear analyses and demonstrate our method using simulations made for the Dark Energy Survey (DES). We show that the method can correctly and efficiently marginalize over a wide range of models for the redshift distribution uncertainty. Finally, we compare hyperrank to the common mean-shifting method of marginalizing over redshift uncertainty, validating that this simpler model is sufficient for use in the DES Year 3 cosmology results presented in companion papers.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Improving statistical precision in Monte Carlo samples with negative weights via reweighting and uncertainty quantification

High statistical precision is critical for Monte Carlo (MC) samples in high energy physics and is degraded by negatively weighted events. This paper investigates a procedure to learn the relationship between the negative and positive weight distributions of any sample, allowing the reduction of statistical uncertainty by reweighting kinematically equivalent events with the same sign. A robust uncertainty quantification method is required for the practical application of such method. Two methods for the estimation of the reweighting uncertainty are developed: one at the event and another one at the final observable level. The latter method is strongly favored. The gains in statistical precision are then quantified. The method is demonstrated on Sherpa vector boson plus jets samples when using all generated events and when restricted to the signal region of a mock analysis. It is demonstrated to significantly reduce stochastic behavior in sparse MC samples while decreasing the overall uncertainty with a sufficiently well-known reweighting function.

Monte Carlo methods↗
DOE OSTI2021

Statistical uncertainties of the v n { 2 k } harmonics from Q cumulants

Analytic formulas to calculate statistical uncertainties of v n { 2 k } harmonics extracted from the Q cumulants are presented. The Q cumulants are multivariate polynomial functions of the weighted means of 2m-particle azimuthal correlations, $\langle\langle 2 m \rangle\rangle$. Variances and covariances of the $\langle\langle 2 m \rangle\rangle$ are included in the analytic formulas of the uncertainties that can be calculated simultaneously with the calculations of the v n { 2 k } harmonics. The calculations are performed using a simple toy model, which roughly simulates elliptic flow azimuthal anisotropy with magnitudes around 0.05. The results are compared with the results obtained by the many data subsets, and by the bootstrapping method. The first one is a common way of estimation of the statistical uncertainties of the v n { 2 k } harmonics in a real experiment. In order to increase precision in the measurement of the v n { 2 k } harmonics, a large number of 15 000 subsets and the same number of the resampling in the bootstrap method is used. Unlike the other ways of the analytic calculation of the v n { 2 k } statistical uncertainties, our proposal that includes the use of squared weights in the calculation of both the variances and covariances, gives the best agreement with the results obtained from the subsets and bootstrap method. Additionally, a recurrence equation between Q cumulants of any order is also presented.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Uncertainty quantification of mass models using ensemble Bayesian model averaging

Developments in the description of the masses of atomic nuclei have led to various nuclear mass models that provide predictions for masses across the whole chart of nuclides. These mass models play an important role in understanding the synthesis of heavy elements in the rapid neutron capture ( r ) process. However, it is still a challenging task to estimate the size of uncertainty associated with the predictions of each mass model. In this work, a method called ensemble Bayesian model averaging (EBMA) is introduced to quantify the uncertainty of one-neutron separation energies (S 1 n ) which are directly relevant in the calculations of r -process observables. Here, this Bayesian method provides a natural way to perform model averaging, selection, and uncertainty quantification, by combining the mass models as a mixture of normal distributions whose parameters are optimized against the experimental data, employing the Markov chain Monte Carlo method using the no-u-turn sampler. The EBMA model optimized with all the experimental S 1 n from the AME2003 nuclides are shown to provide reliable uncertainty estimates when tested with the new data in the AME2020.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Impact of cross-section uncertainties on supernova neutrino spectral parameter fitting in the Deep Underground Neutrino Experiment

A primary goal of the upcoming Deep Underground Neutrino Experiment (DUNE) is to measure the 𝒪⁡(10) MeV neutrinos produced by a Galactic core-collapse supernova if one should occur during the lifetime of the experiment. The liquid-argon-based detectors planned for DUNE are expected to be uniquely sensitive to the 𝜈 𝑒 component of the supernova flux, enabling a wide variety of physics and astrophysics measurements. A key requirement for a correct interpretation of these measurements is a good understanding of the energy-dependent total cross section 𝜎⁡(𝐸 𝜈 ) for charged-current 𝜈 𝑒 absorption on argon. In the context of a simulated extraction of supernova 𝜈 𝑒 spectral parameters from a toy analysis, we investigate the impact of 𝜎⁡(𝐸 𝜈 ) modeling uncertainties on DUNE’s supernova neutrino physics sensitivity for the first time. We find that the currently large theoretical uncertainties on 𝜎⁡(𝐸 𝜈 ) must be substantially reduced before the 𝜈𝑒 flux parameters can be extracted reliably; in the absence of external constraints, a measurement of the integrated neutrino luminosity with less than 10% bias with DUNE requires 𝜎⁡(𝐸 𝜈 ) to be known to about 5%. The neutrino spectral shape parameters can be known to better than 10% for a 20% uncertainty on the cross-section scale, although they will be sensitive to uncertainties on the shape of 𝜎⁡(𝐸 𝜈 ). A direct measurement of low-energy 𝜈𝑒-argon scattering would be invaluable for improving the theoretical precision to the needed level.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Dark Matter Velocity Distributions for Direct Detection: Astrophysical Uncertainties Are Smaller Than They Appear

The sensitivity of direct detection experiments depends on the phase-space distribution of dark matter near the Sun, which can be modeled theoretically using cosmological hydrodynamical simulations of Milky Way–like galaxies. However, capturing the halo-to-halo variation in the local dark matter speeds—a necessary step for quantifying the astrophysical uncertainties that feed into experimental results—requires a sufficiently large sample of simulated galaxies, which has been a challenge. In this Letter, we quantify this variation with nearly 100 Milky Way–like galaxies from the tng50 simulation, the largest sample to date at this resolution. Moreover, we introduce a novel phase-space scaling procedure that endows every system with a reference frame that accurately reproduces the local standard-of-rest speed of our Galaxy, providing a principled way of extrapolating the simulation results to real-world data. The ensemble of predicted speed distributions is well characterized by the standard halo model, a Maxwell-Boltzmann distribution truncated at the escape speed, though the individual distributions can deviate from it, especially at high speeds. The dark matter–nucleon cross section limits placed by these speed distributions vary by ∼ 60% about the median. This places the 1⁢𝜎 astrophysical uncertainty at or below the level of the systematic uncertainty of current ton-scale detectors, even down to the energy threshold. The predicted uncertainty remains unchanged when subselecting on those TNG 50 galaxies with merger histories similar to the Milky Way. Tabulated speed distributions, as well as Maxwell-Boltzmann fits, are provided for use in computing direct detection bounds or projecting sensitivities.

Milky Way↗