Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Estimating Uncertainty in Simulated ENSO Statistics

Abstract Large ensembles of model simulations are frequently used to reduce the impact of internal variability when evaluating climate models and assessing climate change induced trends. However, the optimal number of ensemble members required to distinguish model biases and climate change signals from internal variability varies across models and metrics. Here we analyze the mean, variance and skewness of precipitation and sea surface temperature in the eastern equatorial Pacific region often used to describe the El Niño–Southern Oscillation (ENSO), obtained from large ensembles of Coupled model intercomparison project phase 6 climate simulations. Leveraging established statistical theory, we develop and assess equations to estimate, a priori, the ensemble size or simulation length required to limit sampling‐based uncertainties in ENSO statistics to within a desired tolerance. Our results confirm that the uncertainty of these statistics decreases with the square root of the time series length and/or ensemble size. Moreover, we demonstrate that uncertainties of these statistics are generally comparable when computed using either pre‐industrial control or historical runs. This suggests that pre‐industrial runs can sometimes be used to estimate the expected uncertainty of statistics computed from an existing historical member or ensemble, and the number of simulation years (run duration and/or ensemble size) required to adequately characterize the statistic. This advance allows us to use existing simulations (e.g., control runs that are performed during model development) to design ensembles that can sufficiently limit diagnostic uncertainties arising from simulated internal variability. These results may well be applicable to variables and regions beyond ENSO.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Uncertainty Quantification for Multiphase Computational Fluid Dynamics Closure Relations with a Physics-Informed Bayesian Approach

Multiphase Computational Fluid Dynamics (MCFD) based on the two-fluid model is considered a promising tool to model complex two-phase flow systems. MCFD simulation can predict local flow features without resolving interfacial information. As a result, the MCFD solver relies on closure relations to describe the interaction between the two phases. Those empirical or semi-mechanistic closure relations constitute a major source of uncertainty for MCFD predictions. In this paper, we leverage a physics-informed uncertainty quantification (UQ) approach to inversely quantify the closure relations’ model form uncertainty in a physically consistent manner. This proposed approach considers the model form uncertainty terms as stochastic fields that are additive to the closure relation outputs. Combining dimensionality reduction and Gaussian processes, the posterior distribution of the stochastic fields can be effectively quantified within the Bayesian framework with the support of experimental measurements. As this UQ approach is fully integrated into the MCFD solving process, the physical constraints of the system can be naturally preserved in the UQ results. Here, in a case study of adiabatic bubbly flow, we demonstrate that this UQ approach can quantify the model form uncertainty of the MCFD interfacial force closure relations, thus effectively improving the simulation results with relatively sparse data support.

42 ENGINEERING↗
DOE OSTI2025

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Calculating Interval Uncertainties for Calibration Standards That Drift with Time

Calibrated values of many devices exhibit predictable drift over time. To provide an uncertainty statement valid over the entire calibration interval, one must account for drift. In this article, a method of accounting for drift is proposed based on guidance in the Guide to Expression of Uncertainty in Measurement. An additional uncertainty term is computed using a linear regression of historical measurement data, which is included along with the time-of-test uncertainty. This method is evaluated by analyzing its average out-of-tolerance (OOT) rate using a Monte Carlo simulation, which results in the desired 5% average OOT rate when the total uncertainty is expanded to a 95% confidence interval.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Recent advances in the quantification of uncertainties in reaction theory

Uncertainty quantification has become increasingly more prominent in nuclear physics over the past several years. In few-body reaction theory, there are four main sources that contribute to the uncertainties in the calculated observables: the effective potentials, approximations made to the few-body problem, structure functions, and degrees of freedom left out of the model space. In this work, we illustrate some of the features that can be obtained when modern statistical tools are applied in the context of nuclear reactions. This work consists of a summary of the progress that has been made in quantifying theoretical uncertainties in this domain, focusing primarily on those uncertainties coming from the effective optical potential as well as their propagation within various reaction theories. We use, as the central example, reactions on the doubly-magic stable nucleus 40 Ca, namely neutron and proton elastic scattering and single-nucleon transfer 40 Ca(d,p) 41 Ca. First, we show different optimization schemes used to constrain the optical potential from differential cross sections and other experimental constraints; we then discuss how these uncertainties propagate to the transfer cross section, comparing two reaction theories. Finally, we finish by laying out our future plans.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Robust two-colour pyrometry uncertainty analysis to acquire spatially-resolved measurements

Two-colour pyrometry (2CP) has been used over several decades to study engine-relevant combustion processes, but results are generally regarded as qualitative or semi-quantitative. In many current 2CP systems, large measurement errors are introduced by parallax because the two measured wavelengths are not from the same line of sight. Here this work presents a spatially-resolved 2CP system with the objective of quantifying and reducing measurement uncertainty. An optical setup that eliminates parallax in 2CP is used together with pixel-by-pixel calibration of the camera sensor to increase measurement accuracy. Primary uncertainty terms are identified, and an error propagation analysis is performed to compute uncertainties in the final results of soot temperature, soot concentration parameter, KL, and soot mass. These methodologies are applied to investigate an auto-igniting fuel spray in a constant pressure flow rig at diesel-like conditions of high ambient pressure and temperature. Results show bias uncertainty of around 200 K (≈10%) for temperature and about 40%–60% for KL. High uncertainty was found to occur on the diffusion flame front where both optical thickness and soot concentrations are small. However, these uncertain measurement zones with relatively low soot concentrations contribute minimally to the total soot mass present in the reacting jet during the temporal evolution of the flame.

42 ENGINEERING↗
DOE OSTI2022

Theoretical uncertainty quantification for heavy-ion fusion

Despite recent advances and focus on rigorous uncertainty quantification for microscopic models of quantum many-body systems, the uncertainty on the dynamics of those systems has been underexplored. To address this, we have used time-dependent Hartree-Fock to examine the model uncertainty for a collection of low-energy, heavy-ion fusion reactions. Fusion reactions at near-barrier energies represent a rich test-bed for the dynamics of quantum many-body systems owing to the complex interplay of collective excitation, transfer, and static effects that determine the fusion probability of a given system. The model uncertainty is sizable for many of the systems studied and the primary contribution arises from static properties that are ill-constrained, such as the neutron radius of neutron-rich nuclei. Furthermore, these large uncertainties motivate the use of information from reactions to better constrain existing models and to infer static properties from reaction data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Complete quantification of parametric uncertainties in ( d , p ) transfer reactions

Deuteron-induced transfer reactions are a popular probe in nuclear structure and nuclear astro physics studies. The interpretation of these transfer measurements relies on reaction theory that takes as input effective interactions between the nucleons and the target nucleus. Previous work quantified the uncertainty associated with the optical potentials between the nucleons and the target. In this study, we extend that work by also including the parameters of the mean field associated with the overlap function of the final bound state, thus obtaining the full parametric uncertainty on transfer observables. We use Bayesian Markov Chain Monte Carlo simulations to obtain parameter posterior distributions. We use elastic-scattering cross sections to constrain the optical potential parameters and use the asymptotic normalization coefficient of the final state to constrain the bound state interaction. We then propagate these posteriors to the transfer angular distributions and obtain confidence intervals for this observable. We study (d,p) reactions on 14 C, 16 O, and 48 Ca at energies in the range $E$ $d$ = 7 - 24 MeV. Our results show a strong reduction in uncertainty by using the asymptotic normalization coefficient as a constraint, particularly for those reactions most sensitive to ambiguities in the mean field. For those reactions, the importance of constraining the bound state interaction is equal to that of constraining the optical potentials. Furthermore, the case of 14 C is an outlier because the cross section is less sensitive to the nuclear interior. When minimal constraints are used on the parameters of the nucleon-target interaction, the 1σ uncertainties on the differential cross sections are large (~ 500-100%). However, if elastic-scattering data and the asymptotic normalization coefficient are used in the analysis, with an error of 10% (5%), this uncertainty reduces to ~ 30% (~ 15%).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Characterizing Interaction Uncertainty in Human-Machine Teams

With the increasing use and adoption of artificial intelligence (AI), the reliability of modern data systems will be driven by a tighter teaming between human experts and intelligent machine teammates. As in the case of human-human teams, the success of human-machine teams will also rely on clear communication about mutual goals and actions. In this paper, we combine related literature from cognitive psychology, human-machine teaming, uncertainty in data analysis, and multi-agent systems to propose a new form of uncertainty: interaction uncertainty for characterizing bidirectional communication in human-machine teams. We map the causes and effects of interaction uncertainty and outline potential ways to mitigate uncertainty for mutual trust in a high-consequence real-world scenario.

uncertainty, data analytics, interaction, trust, h↗
DOE OSTI2025

Navigating Uncertainty: Challenges in Visualizing Ensemble Data and Surrogate Models for Decision Systems

Uncertainty visualization plays a critical role in transforming ensemble simulation data into actionable insights by effectively communicating various dimensions of uncertainty within a system. The emergence of artificial intelligence-driven surrogate models trained on multirun ensemble data offers a transformative opportunity to replace computationally intensive simulations with fast estimates, enabling users to explore data spaces with unprecedented depth and interactivity. However, integrating ensemble data and surrogate models into decision-making workflows and tools introduces novel challenges for uncertainty visualization. These include reconciling and clearly communicating the unique uncertainties associated with ensembles and their surrogate model estimates, and leveraging these approximations to inform actionable decisions. This work explores these challenges in the context of high-dimensional data visualization, bridging discrete datasets with their continuous representations and addressing the complexities of systems that support iterative navigation between input and output spaces. We evaluate the role of uncertainty visualization in fostering intuitive, actionable interactions and identify critical hurdles in advancing this frontier of computational simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models

Uncertainty visualization is a key component in translating important insights from ensemble simulation data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models trained on ensemble data, we can substitute computationally expensive simulations, which allows users to interact with more aspects of data spaces than ever before. However, the use of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble data↗
DOE OSTI2022

Machine-Learning Assisted Identification of Accurate Battery Lifetime Models with Uncertainty

Reduced-order battery lifetime models, which consist of algebraic expressions for various aging modes, are widely utilized for extrapolating degradation trends from accelerated aging tests to real-world aging scenarios. Identifying models with high accuracy and low uncertainty is crucial for ensuring that model extrapolations are believable, however, it is difficult to compose expressions that accurately predict multivariate data trends; a review of cycling degradation models from literature reveals a wide variety of functional relationships. Here, a machine-learning assisted model identification method is utilized to fit degradation in a stand-out LFP-Gr aging data set, with uncertainty quantified by bootstrap resampling. The model identified in this work results in approximately half the mean absolute error of a human expert model. Models are validated by converting to a state-equation form and comparing predictions against cells aging under varying loads. Parameter uncertainty is carried forward into an energy storage system simulation to estimate the impact of aging model uncertainty on system lifetime. The new model identification method used here reduces life-prediction uncertainty by more than a factor of three (86% ± 5% relative capacity at 10 years for human-expert model, 88.5% ± 1.5% for machine-learning assisted model), empowering more confident estimates of energy storage system lifetime.

25 ENERGY STORAGE↗
DOE OSTI2025

Evaluating Probabilistic Deep Learning Methods for Uncertainty Quantification of Precipitation Bias Correction

Climate models often exhibit biases in their precipitation predictions, particularly underestimating high-intensity events and overestimating low precipitation. Deep learning approaches offer promising solutions, but their epistemic uncertainty associated with a deep learning–based bias correction method has not previously been quantified for reliable downstream climate impact studies. While methods for capturing the epistemic uncertainty in deep learning frameworks exist, there is currently no consensus on the best method. In this work, we compare three uncertainty quantification (UQ) methods—Deep Ensembles (DEns), Monte Carlo Dropout (MCD), and Flipout—by assessing the reliability of their uncertainty estimates using standard measures such as sharpness and calibration. These UQ methods are applied to an existing deep learning precipitation bias correction model known as UFNet: a coupled U-Net and fully connected neural network. The methods utilized to assess the models’ uncertainties are 1) calibration, which ensures that the expected probabilities of the model align with reality and 2) sharpness, which is a measure of the precision of the model’s probabilistic predictions. Of the three UQ methods evaluated, the DEns and MCD methods demonstrated the best-calibrated performance (expected calibration error of 0.36 and 0.35, respectively), compared to Flipout (0.58). In contrast, Flipout had the sharpest predictions and the highest metric performance in bias correcting precipitation—especially for higher-order moments such as kurtosis with a spatial correlation of 72% compared to 32% and 55% spatial correlation for DEns and MCD, respectively. Of the three UQ methods, MCD was found to be the most suitable method for UQ purposes based on its calibration, sharpness, and computational requirements.

Bayesian methods↗
DOE OSTI2020

We Know Where We Don't Know: 3D Bayesian CNNs for Credible Geometric Uncertainty

Deep learning has been successfully applied to the segmentation of 3D Computed Tomography (CT) scans. Establishing the credibility of these segmentations requires uncertainty quantification (UQ) to identify untrustworthy predictions. Recent UQ architectures include Monte Carlo dropout networks (MCDNs), which approximate deep Gaussian processes, and Bayesian neural networks (BNNs), which learn the distribution of the weight space. BNNs are advantageous over MCDNs for UQ but are thought to be computationally infeasible in high dimension, and neither architecture has produced interpretable geometric uncertainty maps. We propose a novel 3D Bayesian convolutional neural network (BCNN), the first deep learning method which generates statistically credible geometric uncertainty maps and scales for application to 3D data. We present experimental results on CT scans of graphite electrodes and laser-welded metals and show that our BCNN outperforms an MCDN in recent uncertainty metrics. The geometric uncertainty maps generated by our BCNN capture distributions of sigmoid values that are interpretable as confidence intervals, critical for applications that rely on deep learning for high-consequence decisions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Uncertainties in Local Intense Precipitation Flood Modeling

In the Task 1 report for the U.S. Nuclear Regulatory Commission (NRC) funded Local Intense Precipitation (LIP) Probabilistic Flood Hazard Assessment (PFHA) Pilot Study, the Pacific Northwest National Laboratory (PNNL) reviewed hydrologic and hydraulic modeling approaches for estimation of LIP flooding and their implementation in readily available simulation software packages (Prasad and Yuan 2020). NRC’s interest is in developing guidance for performing LIP PFHA at nuclear power plant (NPP) sites. This report describes the work done under Task 2 of the study that focused on describing uncertainties associated with LIP flood modeling. Two main types of uncertainties exist in LIP flood modeling: (1) aleatory uncertainties that arise from the inherent natural variability of the hydrometeorological system and (2) epistemic uncertainties that arise from the analysts’ incomplete knowledge of the hydrometeorological and site configuration. Principal sources for aleatory variability in LIP flood simulations at NPP sites include precipitation (i.e., magnitude, duration, and temporal distribution of LIP events), initial conditions (e.g., soil moisture content, stormwater drainage discharge, surface storage), boundary conditions (e.g., upstream discharge, downstream water surface elevations), and long-term temporal trends (e.g., climate change). This report describes approaches used for estimating the aleatory variability in precipitation including precipitation-frequency analysis, numerical weather prediction, and stochastic weather generation. Data sources that can be used to estimate aleatory variability in initial and boundary conditions are also described. Approaches to include effects of long-term trends like those from climate change into estimation of aleatory variability are summarized. Sources of epistemic uncertainty in LIP flood simulations at NPP sites include process representation (e.g., multiple approaches to represent runoff generation, stormwater drainage, and hydraulic routing), site configurations (e.g., site layout, flow features, status of temporary flood protection, blockage of drains), model resolution, and long-term temporal trends (e.g., known/planned site alterations, land-use changes at and in the vicinity of the site). The report describes alternative process representations (methods and models), particularly those implemented in the LIP flood simulation software packages reviewed in Task 1 report, and lists the associated model parameters. Approaches for estimating model parameters when surface and subsurface water exchanges occur are also described.

42 ENGINEERING↗
DOE OSTI2023

Gaussian Process Modeling For Experimental Procedure Uncertainty

Many laboratory experiments generate data that are characterized by a form of uncertainty that differs from noise: experimental procedure uncertainty. The origin of this type of uncertainty is the difficulty in controlling a subset of experimental conditions in such a way that the experiment is perfectly reproducible within noise. In this report, we describe a Gaussian Process modeling-based method that accounts for experimental procedure uncertainty. The method accounts for variations in conditions from experiment to experiment that are independent between experiments, but correlated within each experiment, and incorporates the resulting uncertainty into predictions at future experimental settings. The method is discussed in the context of a specific chemistry application in which Raman scattering spectra are measured from three-component mixtures.

42 ENGINEERING↗
DOE OSTI2021

Multi-Fidelity Active Subspaces for Wind Farm Uncertainty Quantification

Wind plants operate in stochastic environments characterized by complex turbulent flow dynamics and high-dimensional random variables. A key step in uncertainty quantification studies is sensitivity analysis and dimension reduction that can facilitate the development of surrogate models to be used for forward and inverse propagation or optimization under uncertainty. Prior work has shown active subspaces are an effective tool for identifying important directions in the space of stochastic inputs; however, they have only been applied to single-fidelity wind plant models. In this study, we investigate the efficacy of a multi-fidelity active subspace method for analyzing the uncertainty in wind plant power output. The multi-fidelity active subspace estimator offers the promise of increased accuracy in identifying active subspaces as compared to a single-fidelity estimator for the same computational cost, or a reduction in cost for the same accuracy. This makes the study of uncertainty in larger wind plants and with higher fidelity physics tractable. The multi-fidelity active subspace method is applied to gridded and existing wind plant layouts with single and multiple inflow conditions and its performance for surrogate modeling and uncertainty propagation is compared against a single-fidelity active subspace method. This multi-fidelity approach yields substantial computational speedups of 2x - 3.4x across the test cases along with acceptable accuracy in surrogate modeling and computing statistical moments.

active subspace↗
DOE OSTI2020

Environmental and Economic Assessments and Uncertainties of Multiple Lignocellulosic Biomass Utilization for Bioenergy Products: Case Studies

Life-cycle assessment (LCA) and techno-economic analysis (TEA) were applied to assess the economic feasibility and environmental benefits of utilizing multiple biomass feedstocks for bioenergy products under three different technological pathways with consideration of uncertainties. Three cases were studied for the production of pellets, biomass-based electricity, and pyrolysis bio-oil. A Monte Carlo simulation was used to examine the uncertainties of fossil energy consumption, bioenergy conversion efficiency, stochastic production rate, etc. The cradle-to-gate LCA results showed that pellet production had the lowest greenhouse gas (GHG) emissions, water and fossil fuels consumption (8.29 kg CO2 eq (equivalent), 0.46 kg, and 105.42 MJ, respectively). The conversion process presented a greater environmental impact for all three bioenergy products. When producing 46,929 Mg of pellets, 223,380 MWh of electricity, and 78,000 barrels of pyrolysis oil, the net present values (NPV) indicated that only pellet and electricity production were profitable with NPVs of $1.20 million for pellets, and $5.59 million for biopower. Uncertainty analysis indicated that pellet production showed the highest uncertainty in GHG emission, and bio-oil production had the least uncertainty in GHG emission but had risks producing greater-than-normal amounts of GHG. Biopower production had the highest probability to be a profitable investment with 85.23%.

09 BIOMASS FUELS↗