Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Sensitivity and uncertainty of the IFR-1 BISON benchmark

The fuel performance code BISON is being used to evaluate metallic fuel for a new fast-spectrum test reactor called the Versatile Test Reactor, which is being considered for adoption by the US Department of Energy. To quantify the accuracy of BISON predictions, researchers at Oak Ridge National Laboratory have been developing a series of benchmarks based on legacy metallic fuel experiments. As part of this effort, the sensitivity of BISON predictions to variations in model inputs and the uncertainties associated with BISON predictions must be established. This paper summarizes efforts to perform a comprehensive sensitivity analysis (SA) and uncertainty quantification (UQ) on a benchmark based on the IFR-1 experiment.For the SA, at least one input was chosen from every BISON model and physics module used in the benchmark. The inputs were varied individually in a series of BISON simulations. Here, the resulting variations in benchmark predictions were normalized to calculate sensitivities. These sensitivities were then used to inform input selections for the UQ.The UQ was performed using the Monte Carlo UQ method. A literature review was conducted to estimate uncertainty distributions for the selected inputs, and values were sampled randomly from each distribution in a series of BISON simulations. Variations in the benchmark predictions were used to estimate uncertainty distributions and confidence intervals. It was found that nearly 100% of the benchmark predictions matched the corresponding legacy values within the confidence intervals. However, this is at least partially because the confidence intervals associated with benchmark predictions were wide. The uncertainty contributions of assumptions in the benchmark, experimental uncertainties, and BISON models were quantified. Some analysis was performed to identify inputs that contributed to the uncertainties. Finally, recommendations are made for future benchmark and future BISON development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Utilizing Environmental Tracers to Reduce Groundwater Flow and Transport Model Parameter Uncertainties

Abstract Non‐uniqueness in groundwater model calibration is a primary source of uncertainty in groundwater flow and transport predictions. In this study, we investigate the ability of environmental tracer information to constrain groundwater model parameters. We utilize a pilot point calibration procedure conditioned to subsets of observed data including: liquid pressures, tritium ( 3 H), chlorofluorocarbon‐12 (CFC‐12), and sulfur hexafluoride (SF 6 ) concentrations; and groundwater apparent ages inferred from these environmental tracers, to quantify uncertainties in the heterogeneous permeability fields and infiltration rates of a steady‐state 2‐D synthetic aquifer and a transient 3‐D model of a field site located near Riverton, Wyoming (USA). To identify the relative data worth of each observation data type, the post‐calibration uncertainties of the optimal parameters for a given observation subset are compared to that from the full observation data set. Our results suggest that the calibration‐constrained permeability field uncertainties are largest when liquid pressures are used as the sole calibration data set. We find significant reduction in permeability uncertainty and increased predictive accuracy when the environmental tracer concentrations, rather than apparent groundwater ages, are used as calibration targets in the synthetic model. Calibration of the Riverton field site model using environmental tracer concentrations directly produces infiltration rate estimates with the lowest uncertainties, however; permeability field uncertainties remain similar between the environmental tracer concentration and apparent groundwater age calibration scenarios. This work provides insight on the data worth of environmental tracer information to calibrate groundwater models and highlights potential benefits of directly assimilating environmental tracer concentrations into model parameter estimation procedures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Characterizing and quantifying uncertainty in projections of climate change impacts on air quality

Climate change can aggravate air pollution, with important public health and environmental consequences. While major sources of uncertainty in climate change projections - greenhouse gas (GHG) emissions scenario, model response, and internal variability - have been investigated extensively, their propagation to estimates of air quality impacts has not been systematically assessed. Here, we compare these uncertainties using a coupled modeling framework that includes a human activity model, an Earth system model of intermediate complexity, and a global atmospheric chemistry model. Uncertainties in projections of U.S. air quality under 21st century climate change are quantified based on a climate-chemistry ensemble that includes multiple initializations, representations of climate sensitivity, and climate policy scenarios, under constant air pollution emissions. We find that climate-related uncertainties are comparable at mid-century, making it difficult to distinguish the impact of variations in GHG emissions on ozone and particulate matter pollution. While GHG emissions scenario eventually becomes the dominant uncertainty based on the scenarios considered, all sources of uncertainty are significant through the end of the century. The results provide insights into intrinsically different uncertainties in projections of air pollution impacts and the potential for large ensembles to better capture them.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Reducing uncertainty of high-latitude ecosystem models through identification of key parameters

Abstract Climate change is having significant impacts on Earth’s ecosystems and carbon budgets, and in the Arctic may drive a shift from an historic carbon sink to a source. Large uncertainties in terrestrial biosphere models (TBMs) used to forecast Arctic changes demonstrate the challenges of determining the timing and extent of this possible switch. This spread in model predictions can limit the ability of TBMs to guide management and policy decisions. One of the most influential sources of model uncertainty is model parameterization. Parameter uncertainty results in part from a mismatch between available data in databases and model needs. We identify that mismatch for three TBMs, DVM-DOS-TEM, SIPNET and ED2, and four databases with information on Arctic and boreal above- and belowground traits that may be applied to model parametrization. However, focusing solely on such data gaps can introduce biases towards simple models and ignores structural model uncertainty, another main source for model uncertainty. Therefore, we develop a causal loop diagram (CLD) of the Arctic and boreal ecosystem that includes unquantified, and thus unmodeled, processes. We map model parameters to processes in the CLD and assess parameter vulnerability via the internal network structure. One important substructure, feed forward loops (FFLs), describe processes that are linked both directly and indirectly. When the model parameters are data-informed, these indirect processes might be implicitly included in the model, but if not, they have the potential to introduce significant model uncertainty. We find that the parameters describing the impact of local temperature on microbial activity are associated with a particularly high number of FFLs but are not constrained well by existing data. By employing ecological models of varying complexity, databases, and network methods, we identify the key parameters responsible for limited model accuracy. They should be prioritized for future data sampling to reduce model uncertainty.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Defining Computational Emissivity Uncertainty Over Large Temperature Scales Due to Surface Evolution

There is a dearth in the literature on how to capture the uncertainty generated by material surface evolution in thermal modeling. This leads to inadequate or highly variable uncertainty representations for material properties, specifically emissivity when minimal information is available. Inaccurate understandings of prediction uncertainties may lead decision makers to incorrect conclusions, so best engineering practices should be developed for this domain. In order to mitigate the aforementioned issues, this study explores different strategies to better capture the thermal uncertainty response of engineered systems exposed to fire environments via defensible emissivity uncertainty characterizations that can be easily adapted to a variety of use cases. Here, two unique formulations (one physics-informed and one mathematically based) are presented. The formulations and methodologies presented herein are not exhaustive but more so are a starting point and give the reader a basis for how to customize their uncertainty definitions for differing fire scenarios and materials. Lastly, the impact of using this approach versus other commonly used strategies and the usefulness of adding rigor to material surface evolution uncertainty is demonstrated.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Uncertainty in Annual Energy Resulting from Uncertain Irradiance Measurements

We report an analysis quantifying the contribution to uncertainty in annual energy projections from uncertainty in ground-measured irradiance. Uncertainty in measured irradiance is quantified for eight instruments by the difference from a well maintained, secondary standard pyranometer which is regarded as truthful. We construct a statistical model of irradiance uncertainty and apply the model to generate a sample of 100 annual time series of irradiance for each instrument. The sample is propagated through a common performance model for a reference photovoltaic system to quantify variation in annual energy. Although the measured irradiance varies from the reference by a few percent (standard deviation of 1-2%) the uncertainty in annual energy is on the order of a fraction of one percent. We propose a model for a factor that represents uncertainty in modeled annual energy that arises from uncertainty in ground-measured irradiance.

14 SOLAR ENERGY↗
DOE OSTI2023

Uncertainties in ab initio nuclear structure calculations with chiral interactions

We present theoretical ground state energies and their uncertainties for p -shell nuclei obtained from chiral effective field theory internucleon interactions as a function of chiral order, fitted to two- and three-body data only. We apply a Similary Renormalization Group transformation to improve the numerical convergence of the many-body calculations, and discuss both the numerical uncertainties arising from basis truncations and those from omitted induced many-body forces, as well as chiral truncation uncertainties. With complete Next-to-Next-to-Leading (N 2 LO) order two- and three-body interactions, we find significant overbinding for the ground states in the upper p -shell, but using higher-order two-body potentials, in combination with N 2 LO three-body forces, our predictions agree with experiment throughout the p -shell to within our combined estimated uncertainties. The uncertainties due to chiral order truncation are noticeably larger than the numerical uncertainties, but they are expected to become comparable to the numerical uncertainties at complete N 3 LO.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Wake steering optimization under uncertainty

Turbines in wind power plants experience significant power losses when wakes from upstream turbines affect the energy production of downstream turbines. A promising plant-level control strategy to reduce these losses is wake steering, where upstream turbines are yawed to direct wakes away from downstream turbines. However, there are significant uncertainties in many aspects of the wake steering problem. For example, infield sensors do not give perfect information, and inflow to the plant is complex and difficult to forecast with available information, even over short time periods. Here, we formulate and solve an optimization under uncertainty (OUU) problem for determining optimal plant-level wake steering strategies in the presence of independent uncertainties in the direction, speed, turbulence intensity, and shear of the incoming wind, as well as in turbine yaw positions. The OUU wake steering strategy is first examined for a two-turbine test case to explore the impacts of different types of inflow uncertainties, and it is then demonstrated for a more realistic 11-turbine wind power plant. Of the sources of uncertainty considered, we find that wake steering strategies are most sensitive to uncertainties in the wind speed and direction. When maximizing expected power production, the OUU strategy also tends to favor smaller yaw angles, which have been shown in previous work to reduce turbine loading. Ultimately, the plant-level wake steering strategy formulated using an OUU approach yields 0.48?% more expected annual energy production for the 11-turbine wind plant than a strategy that neglects uncertainty when considering stochastic inputs. Thus, not only does the present OUU strategy produce more power in realistic conditions, but it also reduces risk by prescribing strategies that call for less extreme yaw angles.

17 WIND ENERGY↗
DOE OSTI2023

Long-term uncertainty quantification in WRF-modeled offshore wind resource off the US Atlantic coast

Uncertainty quantification of long-term modeled wind speed is essential to ensure stakeholders can best leverage wind resource numerical data sets. Offshore, this need is even stronger given the limited availability of observations of wind speed at heights relevant for wind energy purposes and the resulting heavier relative weight of numerical data sets for wind energy planning and operational projects. In this analysis, we consider the National Renewable Energy Laboratory's 21-year updated numerical offshore data set for the US East Coast and provide a methodological framework to leverage both floating lidar and near-surface buoy observations in the region to quantify uncertainty in the modeled hub-height wind resource. We first show how using a numerical ensemble to quantify the uncertainty in modeled wind speed is insufficient to fully capture the model deviation from real-world observations. Next, we train and validate a random forest to vertically extrapolate near-surface wind speed to hub height using the available short-term lidar data sets in the region. We then apply this model to vertically extrapolate the long-term near-surface buoy wind speed observations to hub height so that they can be directly compared to the long-term numerical data set. We find that the mean 21-year uncertainty in 140 m hourly average wind speed is slightly lower than 3 m s -1 (roughly 30m% of the mean observed wind speed) across the considered region. Atmospheric stability is strictly connected to the modeled wind speed uncertainty, with stable conditions associated with an uncertainty which is, on average, about 20 % larger than the overall mean uncertainty.

17 WIND ENERGY↗
DOE OSTI2021

An extended polynomial chaos expansion for PDF characterization and variation with aleatory and epistemic uncertainties

This paper presents an extended polynomial chaos formalism for epistemic uncertainties and a new framework for evaluating sensitivities and variations of output probability density functions (PDF) to uncertainty in probabilistic models of input variables. An ”extended” polynomial chaos expansion (PCE) approach is developed that accounts for both aleatory and epistemic uncertainties, modeled as random variables, thus allowing a unified treatment of both types of uncertainty. We explore in particular epistemic uncertainty associated with the choice of prior probabilistic models for input parameters. A PCE-based Kernel Density (KDE) construction provides a composite map from the PCE coefficients and germ to the PDF of quantities of interest (QoI). Here, the sensitivities of these PDF with respect to the input parameters are then evaluated. Input parameters of the probabilistic models are considered. By sampling over the epistemic random variable, a family of PDFs is generated and the failure probability is itself estimated as a random variable with its own PCE. Integrating epistemic uncertainties within the PCE framework results in a computationally efficient paradigm for propagation and sensitivity evaluation. Two typical illustrative examples are used to demonstrate the proposed approach.

Aleatory uncertainty↗
DOE OSTI2025

LandScan mosaic enables high-resolution gridded population estimates with explicit uncertainty

Gridded population datasets represent high-resolution distributions of human occupancy, enabling informed decision-making across a broad range of fields. These data products are valuable for assessing environmental risk, urban development, disaster preparedness and resource allocation—areas where accurate population estimates directly enhance policy effectiveness and optimize resource distribution. Despite the importance of gridded population datasets, traditional population modeling approaches often overlook inherent uncertainties in the estimation process. This limitation can create a false sense of certainty in population estimates, potentially leading to flawed decisions by those who rely on the data. To address this methodological gap, we introduce a probabilistic machine learning modeling framework, LandScan Mosaic, that explicitly incorporates uncertainty into the population modeling process. Our approach systematically quantifies uncertainty in three key modeling parameters of the LandScan HD gridded population dataset: building use types, floor counts, and occupancy rates. By employing Monte Carlo simulations, we propagate these uncertainties through the modeling process, yielding probability distributions of population counts in place of deterministic point estimates. We demonstrate the practical application of this framework in Iloilo City, Philippines, using structured decision-making techniques and our probabilistic estimates to identify and prioritize areas most affected by projected flooding, supporting targeted interventions that address both economic and social risks. In doing so, we propose a population-specific approach for incorporating confidence into structured decision making processes. Through a comparative analysis with conventional deterministic approaches and point estimate approaches, including LandScan HD and WorldPop, we evaluate how the incorporation of machine learning and uncertainty influences decision rankings. This research advances population distribution modeling by offering a robust, quantitative approach that explicitly accounts for uncertainty in the underlying data, along with guidance for how users can apply uncertainty in their decision-making.

Environmental sciences↗
DOE OSTI2022

Bootstrap estimation of the effect of instrument response function uncertainty on the reconstruction of fusion neutron sources

Neutron imagers are important diagnostics for the inertial confinement fusion implosions at the National Ignition Facility. They provide two- and three-dimensional reconstructions of the neutron source shape that are key indicators of the overall performance. To interpret the shape results properly, it is critical to estimate the uncertainty in those reconstructions. There are two main sources of uncertainties: limited neutron statistics, leading to random errors in the reconstructed images, and incomplete knowledge of the instrument response function (the pinhole-dependent point spread function). While the statistical errors dominate the uncertainty for lower yield deuterium-tritium (DT) shots, errors due to the instrument response function dominate the uncertainty for DT yields on the order of 10 16 neutrons or higher. In this work, a bootstrapping method estimates the uncertainty in a reconstructed image due to the incomplete knowledge of the instrument response function. The main reconstruction is created from the fixed collection of pinhole images that are best aligned with the neutron source. Additional reconstructions are then built using subsets of that collection of images. Variations in the shapes of these additional reconstructions originate solely from uncertainties in the instrument response function, allowing us to use them to provide an additional systematic uncertainty estimate.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Fast uncertainty estimates in deep learning interatomic potentials

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and material properties. A common short-coming shared by current approaches, however, is that neural networks only give point estimates of their predictions and do not come with predictive uncertainties associated with these estimates. Existing uncertainty quantification efforts have primarily leveraged the standard deviation of predictions across an ensemble of independently trained neural networks. This incurs a large computational overhead in both training and prediction, resulting in order-of-magnitude more expensive predictions. Here, we propose a method to estimate the predictive uncertainty based on a single neural network without the need for an ensemble. This allows us to obtain uncertainty estimates with virtually no additional computational overhead over standard training and inference. We demonstrate that the quality of the uncertainty estimates matches those obtained from deep ensembles. We further examine the uncertainty estimates of our methods and deep ensembles across the configuration space of our test system and compare the uncertainties to the potential energy surface. Finally, we study the efficacy of the method in an active learning setting and find the results to match an ensemble-based strategy at order-of-magnitude reduced computational cost.

Chemistry↗
DOE OSTI2023

Quantifying uncertainty in analysis of shockless dynamic compression experiments on platinum. I. Inverse Lagrangian analysis

Absolute measurements of solid-material compressibility by magnetically driven shockless dynamic compression experiments to multi-megabar pressures have the potential to greatly improve the accuracy and precision of pressure calibration standards for use in diamond anvil cell experiments. Here, to this end, we apply characteristics-based inverse Lagrangian analysis (ILA) to 11 sets of ramp-compression data on pure platinum (Pt) metal and then reduce the resulting weighted-mean stress–strain curve to the principal isentrope and room-temperature isotherm using simple models for yield stress and Grüneisen parameter. We introduce several improvements to methods for ILA and quasi-isentrope reduction, the latter including calculation of corrections in wave speed instead of stress and pressure to render results largely independent of initial yield stress while enforcing thermodynamic consistency near zero pressure. More importantly, we quantify in detail the propagation of experimental uncertainty through ILA and model uncertainty through quasi-isentrope reduction, considering all potential sources of error except the electrode and window material models used in ILA. Compared to previous approaches, we find larger uncertainty in longitudinal stress. Monte Carlo analysis demonstrates that uncertainty in the yield-stress model constitutes by far the largest contribution to uncertainty in quasi-isentrope reduction corrections. We present a new room-temperature isotherm for Pt up to 444 GPa, with 1-sigma uncertainty at that pressure of just under ±1.2%; the latter is about a factor of three smaller than uncertainty previously reported for multi-megabar ramp-compression experiments on Pt. The result is well represented by a Vinet-form compression curve with (isothermal) bulk modulus K 0 = 270.3 ± 3.8 GPa, pressure derivative K$^{'}_{0}$= 5.66 ± 0.10, and correlation coefficient $R_{K_{0},K^{'}_{0}}$= –0.843.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Characterization of uncertainties in electron-argon collision cross sections

Abstract The predictive capability of a plasma discharge model depends on accurate representations of electron-impact collision cross sections, which determine the corresponding reaction rates and electron transport properties. The values of cross sections can be known only approximately either through experiments or simulations and are thus subject to uncertainties. Quantifying the uncertainties in plasma simulations allows us to assess the reliability of simulations and to provide a basis for interpreting discrepancies between simulations and experiments. For such uncertainty quantification of plasma simulations, it is essential to quantify the uncertainties of the underlying cross sections. Although much effort has been committed to calibrate the cross section values, their uncertainties are not well investigated. We characterize uncertainties in electron-argon atom collision cross sections using a Bayesian framework. Six collision processes—elastic momentum transfer, ionization, and four excitations—are characterized with semi-empirical models, which effectively capture the features important to the macroscopic properties of the plasma. A probability model for the uncertain parameters of these semi-empirical models is developed. Specifically, a Gaussian-process likelihood model is proposed to capture discrepancies among data sets, as well as the model-form inadequacies of the semi-empirical models. Two other likelihood models are compared with the proposed Gaussian-process model, to illustrate the importance of the choice of the likelihood model. The cross section models are calibrated using the electron-beam experiments and ab-inito quantum simulations. The resulting calibrated uncertainties capture well the scattering among the data sets. The calibrated cross section models are further validated against swarm-parameter experiments and zero-dimensional Boltzmann equation simulations of widely used cross section datasets.

Chung, Seung Whan (ORCID:0000000302501549)↗
DOE OSTI2022

Photometric redshift uncertainties in weak gravitational lensing shear analysis: models and marginalization

ABSTRACT Recovering credible cosmological parameter constraints in a weak lensing shear analysis requires an accurate model that can be used to marginalize over nuisance parameters describing potential sources of systematic uncertainty, such as the uncertainties on the sample redshift distribution n(z). Due to the challenge of running Markov chain Monte Carlo (MCMC) in the high-dimensional parameter spaces in which the n(z) uncertainties may be parametrized, it is common practice to simplify the n(z) parametrization or combine MCMC chains that each have a fixed n(z) resampled from the n(z) uncertainties. In this work, we propose a statistically principled Bayesian resampling approach for marginalizing over the n(z) uncertainty using multiple MCMC chains. We self-consistently compare the new method to existing ones from the literature in the context of a forecasted cosmic shear analysis for the HSC three-year shape catalogue, and find that these methods recover statistically consistent error bars for the cosmological parameter constraints for predicted HSC three-year analysis, implying that using the most computationally efficient of the approaches is appropriate. However, we find that for data sets with the constraining power of the full HSC survey data set (and, by implication, those upcoming surveys with even tighter constraints), the choice of method for marginalizing over n(z) uncertainty among the several methods from the literature may modify the 1σ uncertainties on Ωm–S8 constraints by ∼4 per cent, and a careful model selection is needed to ensure credible parameter intervals.

Zhang, Tianqing (ORCID:000000025596198X)↗
DOE OSTI2020

Uncertainty Analysis of Consequence Management Data Products

An interlaboratory effort has developed a probabilistic framework to characterize uncertainty in data products that are developed by the US Department of Energy Consequence Management Program in support of the Federal Radiological Monitoring and Assessment Center. The purpose of this paper is to provide an overview of the probability distributions of input variables and the statistical methods used to propagate and quantify the overall uncertainty of the derived response levels that are used as contours on data products due to the uncertainty in input parameters. Uncertainty analysis results are also presented for several study scenarios. This paper includes an example data product to illustrate the potential real-world implications of incorporating uncertainty analysis results into data products that inform protective action decisions. Data product contours that indicate areas where public protection actions may be warranted can be customized to an acceptable level of uncertainty. Finally, the investigators seek feedback from decision makers and the radiological emergency response community to determine how uncertainty information can be used to support the protective action decision-making process and how it can be presented on data products.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2025

Toward shell model interactions with credible uncertainties

Background: The nuclear shell model is a powerful framework for predicting nuclear structure observables, but relies on interaction matrix elements fit to experimental data as its inputs. Extending the shell model's applicability, particularly toward dripline nuclei, requires efficient fitting methods and credible uncertainty quantification. Traditional approaches face computational challenges and may underestimate uncertainties. Purpose: We develop and test a framework combining eigenvector continuation and Markov chain Monte Carlo to efficiently fit shell model interaction matrix elements and quantify their uncertainties. Methods: Eigenvector continuation is used to emulate shell model calculations, reducing computational costs. The emulator enables Markov chain Monte Carlo sampling to optimize interaction matrix elements and rigorously assess parametric uncertainties. Here, the framework is benchmarked using the USDB interaction in the 𝑠⁢𝑑 shell. Results: The emulator reproduces the USDB interaction with negligible error, validating its use in shell model fitting applications. However, we find that to obtain credible predictive intervals, the model defect of the shell model itself, rather than experimental or emulator error, must be taken into account in order to obtain credible uncertainties. Conclusions: The proposed framework provides an efficient and rigorous approach for fitting shell model interactions and quantifying uncertainties. Further, the normality assumption used in the past appears sufficient to describe the distribution of interaction matrix elements. However, it is crucial to account for model correlations to avoid underestimating uncertainties.

Nuclear forces↗