SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Machine learning surrogate for charged particle beam dynamics with space charge based on a recurrent neural network with aleatoric uncertainty

In this work, we develop a machine learning (ML) model with aleatoric uncertainty for the low energy beam transport (LEBT) region of the LANSCE linear accelerator in which we model the transport of a space-charge-dominated 750 keV proton beam through a lattice of 22 quadrupole magnets. Our ML model is developed based on data generated by a Kapchinsky–Vladimirsky (KV) envelope model of beam transport. We show that a recurrent neural network can be used as a dynamical surrogate model for fast prediction of the LEBT beam envelope. Furthermore, we endow the model with the prediction of aleatoric uncertainty and compare three different approaches. We demonstrate that the ML-based uncertainty quantification models are well calibrated and produce good estimates of the regions where the model is less certain about its predictions. This ML framework is a necessary step in the development of a real-time virtual diagnostic tool with uncertainty quantification that can be integrated into more complex downstream tasks (e.g., adaptive control or learning flexible control policies via reinforcement learning) for improved efficiency in beam operations. In future work, we plan to expand on this preliminary study by considering more realistic envelope models that include longitudinal momentum spread and dispersive effects in bending magnets, as well as particle tracking codes with 3D space charge (such as and ). Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗

DOE OSTI2025

Complementarity-based complementarity: The choice of mutually unbiased observables shapes quantum uncertainty relations

Quantum uncertainty relations impose fundamental limits on the joint knowledge that can be acquired from complementary observables: Perfect knowledge of a quantum state in one basis implies maximal indetermination in all other mutually unbiased bases (MUBs). Uncertainty relations derived from joint properties of the MUBs are generally assumed to be uniform, irrespective of the specific observables chosen within a set. In this work, we demonstrate instead that the uncertainty relations can depend on the choice of observables. Through both experimental observation and numerical methods, we show that selecting different sets of three MUBs in a five-dimensional quantum system results in distinct uncertainty bounds, i.e., in varying degrees of complementarity, in terms of both entropy and variance.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2020

An Uncertainty Management Framework for Integrated Gas-Electric Energy Systems

In many parts of the world, electric power systems have seen a significant shift toward generation from renewable energy and natural gas. Because of their ability to flexibly adjust power generation in real time, gas-fired power plants are frequently seen as the perfect partner for variable renewable generation. However, this reliance on gas generation increases interdependence and propagates uncertainty between power grids and gas pipelines and brings coordination and uncertainty management challenges. To address these issues, we propose an uncertainty management framework for uncertain, but bounded gas consumption by gas-fired power plants. The admissible ranges are computed based on a joint optimization problem for the combined gas and electricity networks, which involves chance-constrained scheduling for the electric grid and a novel robust optimization formulation for the natural-gas network. This formulation ensures feasibility of the integrated system with a high probability, while providing a tractable numerical formulation. A key advance with respect to existing methods is that our method is based on a physically accurate, validated model for transient gas pipeline flows. Our case study benchmarks our proposed formulation against methods that ignore how reserve activation impacts the fuel use of gas power plants and only consider predetermined gas consumption. Here, the results demonstrate the importance of considering uncertainty to avoid operating constraint violations and curtailment of gas to the generators.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Combining Indoor and Outdoor Measurements to Lower Uncertainty in PV Modules Performance

In this manuscript, we present an overview of our module self-reference (MSR) calibration results of PV electrical performance collected for over three years on a silicon module. Analysis and comparison of the results based on measurement uncertainty analysis enable the quantification of the major sources of uncertainty and an estimate of the total uncertainty of the MSR measurements. The control charts show that the mean values are consistent with uncertainty calculations for P MAX , V OC and I SC .

calibration↗

DOE OSTI2022

Uncertainty Quantification of Bifacial Performance Modeling

Analysis on uncertainty in the annual energy of PV systems that can be attributed to parameters of particular importance to bifacial PV modules is presented. Monte Carlo simulations are used to evaluate the effect of uncertain module bifaciality factors, module transmission fractions, albedo values, and ground clearance. The analyses cover a wide spectrum of potential PV array archetypes through variation of installation parameters. The results of the Monte Carlo analysis reveal that the uncertainty is largely dependent on albedo uncertainty, but more simulations are needed to identify trends across system archetypes. The simulations are aimed at attributing an annual energy uncertainty factor for bifacial considerations that can be applied in post-processing of project probability of exceedance analysis.

energy modeling↗

DOE OSTI2022

Uncertainty reduction in residual stress measurements by an optimised inverse solution using nonconsecutive polynomials

Many destructive methods for measuring residual stresses such as the slitting method require an inverse analysis to solve the problem. The accuracy of the result as well as an uncertainty component (the model uncertainty) depends on the basis functions used in the inverse solution. The use of a series expansion as the basis functions for the inverse solution was analysed in a previous work for the particular case where functions orders grew consecutively. The present work presents a new estimation of the model uncertainty and a new improved methodology to select the final basis functions for the case where the basis is composed of polynomials. Including nonconsecutive polynomial orders in the basis generates a larger space of possible solutions to be evaluated and allows the possibility to include higher-order polynomials. The paper includes a comparison with two other inverse analyses methodologies applied to synthetically generated data. With the new methodology, the final error is reduced and the uncertainty estimation improved.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Quantifying Uncertainty in HPC Job Queue Time Predictions

High Performance Computing (HPC) has developed at an unprecedented pace in recent decades. This growth has demanded corresponding development in the area of HPC Operational Data Analytics (ODA), which encompasses a wide range of data analysis techniques, ML/AI efforts, tools, and visualizations. Published studies in ODA offer a variety of practical ways to inform HPC users, administrators, procurement managers, and other stakeholders. Uncertainty analysis, however, is rare in the related published literature. For instance, we identify only 1 out of 14 existing studies focused on job queue time prediction that investigates the uncertainty aspect of their proposed predictions. We recognize the utmost importance uncertainty quantification can have in such predictive analytics solutions, with consequences in how users interpret information they receive, and attempt to bridge this gap. With the goal of improving access to such insights, we develop a process for determining upper and lower bounds of the predicted queue times of a regression model at a specified confidence level. Our current research is focused on the uncertainty in predicting job queue times, yet our approach may be employed in predicting other metrics.

HPC↗

DOE OSTI2023

Evaluating uncertainty-based active learning for accelerating the generalization of molecular property prediction

Deep learning models have proven to be a powerful tool for the prediction of molecular properties for applications including drug design and the development of energy storage materials. However, in order to learn accurate and robust structure–property mappings, these models require large amounts of data which can be a challenge to collect given the time and resource-intensive nature of experimental material characterization efforts. Additionally, such models fail to generalize to new types of molecular structures that were not included in the model training data. The acceleration of material development through uncertainty-guided experimental design has the promise to significantly reduce the data requirements and enable faster generalization to new types of materials. To evaluate the potential of such approaches for electrolyte design applications, we perform comprehensive evaluation of existing uncertainty quantification methods on the prediction of two relevant molecular properties - aqueous solubility and redox potential. We develop novel evaluation methods to probe the utility of the uncertainty estimates for both in-domain and out-of-domain data sets. Finally, we leverage selected uncertainty estimation methods for active learning to evaluate their capacity to support experimental design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Dataset for "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantification" Willard et al. (2025).

This data release provides all data and code used in the paper " "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantifications" Willard et al. (2025)" to model stream temperature, evaluate, and assess results. The associated manuscript explores the effect of different ensemble construction techniques across different common machine learning (ML) architectures for predictions in unmonitored basins. Modeling was done using long short-term memory (LSTM), gated recurrent unit (GRU), temporal convolution network (TCN), and extreme gradient boosting (XGBoost) models, and stream site coverage spans 1362 locations across the conterminous United States. The ensemble construction techniques investigated include ensemble by random weight initialization, differing hyperparameters, different random subsets of training data, different subselections of input features, different architectures, and Monte Carlo Dropout. The data is organized into these items items:Code repository and data for the paper " "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantifications" Willard et al. (2025).Code: stream_temp_ml_regionalization.zip contains the code repositoryData to run the code:- data_dir.zip -- contains all files that should be moved to the "DATA_DIR" variable defined in the "set_env_vars.sh" script in the code repository- metadata_dir.zip -- contains all files that should be moved to the "METADATA_DIR" variable defined in the "set_env_vars.sh" script in the code repositoryData produced by the code and used in the paper:- outputs_dir.zip - contains model output and results (outputs_dir/results), model weights (outputs_dir/models), and all other outputs used for the paper including feature importances.To cite this code, please use the following BibTeX or MLA entries:bibtex:@misc{willard2025streamensembles,author = {Jared Willard and Charuleka Varadharajan},title = {Dataset for "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantification"},year = {2024},doi = {10.15485/2527393},publisher = {ESS-DIVE Repository},url = {https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2527393}}MLA: Willard, Jared, et al. Dataset for "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantification". 2025. ESS-DIVE Repository, doi:10.15485/2448016.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Lung Cancer in the Mayak Workers Cohort: Risk Estimation and Uncertainty Analysis

The workers at the Mayak nuclear facility near Ozyorsk, Russia are a primary source of information about exposure to radiation at low-dose rates, since they were subject to protracted exposures to external gamma rays and to internal exposures from plutonium inhalation. Here we re-examine lung cancer mortality rates and assess the effects of external gamma and internal plutonium exposures using recently developed Monte Carlo dosimetry systems. Using individual lagged mean annual lung doses computed from the dose realizations, we fit excess relative risk (ERR) models to the lung cancer mortality data for the Mayak Workers Cohort using risk-modeling software. We then used the corrected information matrix (CIM) approach to widen the confidence intervals of ERR by taking into account the uncertainty in doses represented by multiple realizations from the Monte Carlo dosimetry systems. Findings of this work revealed that there were 930 lung cancer deaths during follow-up. Plutonium lung doses (but not gamma doses) were generally higher in the new dosimetry systems than those used in the previous analysis. This led to a reduction in the risk per unit dose compared to prior estimates. The estimated ERR/Gy for external gamma-ray exposure was 0.19 (95% CI: 0.07 to 0.31) for both sexes combined, while the ERR/Gy for internal exposures based on mean plutonium doses were 3.5 (95% CI: 2.3 to 4.6) and 8.9 (95% CI: 3.4 to 14) for males and females at attained age 60. Accounting for uncertainty in dose had little effect on the confidence intervals for the ERR associated with gamma-ray exposure, but had a marked impact on confidence intervals, particularly the upper bounds, for the effect of plutonium exposure [adjusted 95% CIs: 1.5 to 8.9 for males and 2.7 to 28 for females]. In conclusion, lung cancer rates increased significantly with both external gamma-ray and internal plutonium exposures. Accounting for the effects of dose uncertainty markedly increased the width of the confidence intervals for the plutonium dose response but had little impact on the external gamma dose effect estimate. Adjusting risk estimate confidence intervals using CIM provides a solution to the important problem of dose uncertainty. This work demonstrates, for the first time, that it is possible and practical to use our recently developed CIM method to make such adjustments in a large cohort study.

uncertainty, radiation risk estimation, Mayak Prod↗

DOE OSTI2020

Uncertainty Quantification for Capacity Expansion Planning

This report quantifies the uncertainty in output decisions from a Capacity Expansion Planning (CEP) model. The need to understand how uncertainties within CEP models and modeling assumptions affect Quantities of Interest (QoIs) such as expansion and operating costs, as well as expansion decisions remains an ongoing challenge in scientific research and industrial operations. This area of research is particularly important for models which seek to capture how large networks will evolve and operate under increased sources of variable generation, i.e., higher penetration of renewable technologies such as solar and wind generators. Uncertainty quantification (UQ) of CEP models which estimate expansion costs and decisions, and production cost models which estimate operating costs and dispatch decisions, is a key focus of research at NREL. The Regional Energy Deployment System (ReEDS) represents a state-of-the-art CEP model and considers a range of possible grid evolutions in an attempt to identify key drivers, ramifications, and decisions which contribute to better informed investment and policy decisions. However, research to quantify how uncertainties and model assumptions, such as unit commitment (UC), within ReEDS may be affecting its outputs remains challenging due to to size and complexity of the model

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Uncertainty in Experimental Data Analysis [Slides]

The talk was presented virtually to the Institute of Fundamental Technological Research, Polish Academy of Sciences in Warsaw, Poland, December 21, 2020. Astronomical observations, unusual medical cases, physics experiments too costly to repeat, natural events like earthquakes, hurricanes – all of them are impossible to repeat yet produce important scientific information not achievable in other way. This data should not be treated as qualitative, anecdotal evidence only. It should be analyzed in a mathematically rigorous way to produce quantitative experimental data. Analysis method for one-of-a-kind event data differs from analysis of a repeated experiment data. For a repeated experiments the experimental error includes a range of true values generated by repetitions of the experiment, and measurement uncertainty caused by detectors. They are independent. Repetitions of any experiment, as similar as achievable, always have built-in differences resulting in a range of the true values rather than in a single true experimental value. Measurement uncertainty depends on the measurement system only. Modern digital measurements have very small uncertainty, frequently smaller than the range of true experimental values resulting from built-in differences in the experiment repetitions. When data from one-of-a-kind experiment are analyzed, only the measurement uncertainty can be reported.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

Microstructure-Sensitive Uncertainty Quantification for Crystal Plasticity Finite Element Constitutive Models Using Stochastic Collocation Methods

Uncertainty quantification (UQ) plays a major role in verification and validation for computational engineering models and simulations, and establishes trust in the predictive capability of computational models. In the materials science and engineering context, where the process-structure-property-performance linkage is well known to be the only road mapping from manufacturing to engineering performance, numerous integrated computational materials engineering (ICME) models have been developed across a wide spectrum of length-scales and time-scales to relieve the burden of resource-intensive experiments. Within the structure-property linkage, crystal plasticity finite element method (CPFEM) models have been widely used since they are one of a few ICME toolboxes that allows numerical predictions, providing the bridge from microstructure to materials properties and performances. Several constitutive models have been proposed in the last few decades to capture the mechanics and plasticity behavior of materials. While some UQ studies have been performed, the robustness and uncertainty of these constitutive models have not been rigorously established. In this work, we apply a stochastic collocation (SC) method, which is mathematically rigorous and has been widely used in the field of UQ, to quantify the uncertainty of three most commonly used constitutive models in CPFEM, namely phenomenological models (with and without twinning), and dislocation-density-based constitutive models, for three different types of crystal structures, namely face-centered cubic (fcc) copper (Cu), body-centered cubic (bcc) tungsten (W), and hexagonal close packing (hcp) magnesium (Mg). Our numerical results not only quantify the uncertainty of these constitutive models in stress-strain curve, but also analyze the global sensitivity of the underlying constitutive parameters with respect to the initial yield behavior, which may be helpful for robust constitutive model calibration works in the future.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Uncertainty quantification of machine learning models to improve streamflow prediction under changing climate and environmental conditions

Machine learning (ML) models, and Long Short-Term Memory (LSTM) networks in particular, have demonstrated remarkable performance in streamflow prediction and are increasingly being used by the hydrological research community. However, most of these applications do not include uncertainty quantification (UQ). ML models are data driven and can suffer from large extrapolation errors when applied to changing climate/environmental conditions. UQ is required to quantify the influence of data noises on model predictions and avoid overconfident projections in extrapolation. In this work, we integrate a novel UQ method, called PI3NN, with LSTM networks for streamflow prediction. PI3NN calculates Prediction Intervals by training 3 Neural Networks. It can precisely quantify the predictive uncertainty caused by the data noise and identify out-of-distribution (OOD) data in a non-stationary condition to avoid overconfident predictions. We apply the PI3NN-LSTM method in the snow-dominant East River Watershed in the western US and in the rain-driven Walker Branch Watershed in the southeastern US. Results indicate that for the prediction data which have similar features as the training data, PI3NN precisely quantifies the predictive uncertainty with the desired confidence level; and for the OOD data where the LSTM network fails to make accurate predictions, PI3NN produces a reasonably large uncertainty indicating that the results are not trustworthy and should avoid overconfidence. PI3NN is computationally efficient, robust in performance, and generalizable to various network structures and data with no distributional assumptions. It can be broadly applied in ML-based hydrological simulations for credible prediction.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Uncertainty Quantification and Sensitivity Analysis of Nuclear Construction Cost Reduction Pathways

High construction costs have plagued recent nuclear projects and they hamper the widespread deployment of nuclear technology. The Nuclear Cost Reduction Tool is a plant economic framework that quantifies the impact that various plant design and construction attributes have on construction costs and cost overruns and shows the positive effects of learning over a series of deployments. However, a downside of the current model is that all model outputs and capabilities are deterministic. To provide a more comprehensive view, this study evaluated the impact of model parameter uncertainty through a sensitivity analysis applied to 18 model parameters. This approach quantified the impact of model uncertainty on the output variables of Net Overnight Capital Cost (Net OCC), Construction Duration (CD), and Levelized Cost of Electricity (LCOE). Monte Carlo analysis revealed uncertainty distributions for these variables, showing that absolute uncertainty decreases over a series of deployments. A local sensitivity analysis showed that even small parameter perturbations (5%) can have a significant impact on project execution, highlighting areas that could reduce costs by billions across an order book of plants. The results of this study have improved the understanding of the model and identified the most impactful model parameters and construction attributes.

Levelized Cost of Electricity↗

DOE OSTI2023

Assignment of Freight Traffic in a Large-scale Intermodal Network under Uncertainty

This paper presents a methodology for freight traffic assignment in a large-scale road-rail intermodal network under uncertainty. Network uncertainties caused by natural disasters have dramatically increased in recent years. Several of these disasters (e.g., Hurricane Sandy, Mississippi River Flooding, and Hurricane Harvey) severely disrupted the U.S. freight transportation network, and consequently, the supply chain. To account for these network uncertainties, a stochastic freight traffic assignment model is formulated. An algorithmic framework, involving the sample average approximation and gradient projection algorithm, is proposed to solve this challenging problem. The developed methodology is tested on the U.S. intermodal network with freight flow data from the Freight Analysis Framework. The experiments consider three types of natural disasters that have different risks and impacts on transportation networks: earthquakes, hurricanes, and floods. It is found that for all disaster scenarios, freight ton-miles are higher compared to the base case without uncertainty. The increase in freight ton-miles is the highest under the flooding scenario; this is because there are more states in the flood-risk areas, and they are scattered throughout the U.S.

42 ENGINEERING↗

NASA NTRS2011

Climate Change Impact Uncertainties for Maize in Panama: Farm Information, Climate Projections, and Yield Sensitivities

We present results from a pilot project to characterize and bound multi-disciplinary uncertainties around the assessment of maize (Zea mays) production impacts using the CERES-Maize crop model in a climate-sensitive region with a variety of farming systems (Panama). Segunda coa (autumn) maize yield in Panama currently suffers occasionally from high water stress at the end of the growing season, however under future climate conditions warmer temperatures accelerate crop maturation and elevated CO (sub 2) concentrations improve water retention. This combination reduces end-of-season water stresses and eventually leads to small mean yield gains according to median projections, although accelerated maturation reduces yields in seasons with low water stresses. Calibrations of cultivar traits, soil profile, and fertilizer amounts are most important for representing baseline yields, however sensitivity to all management factors is reduced in an assessment of future yield changes (most dramatically for fertilizers), suggesting that yield changes may be more generalizable than absolute yields. Uncertainty around General Circulation Model (GCM)s' projected changes in rainfall gain in importance throughout the century, with yield changes strongly correlated with growing season rainfall totals. Climate changes are expected to be obscured by the large inter-annual variations in Panamanian climate that will continue to be the dominant influence on seasonal maize yield into the coming decades. The relatively high (A2) and low (B1) emissions scenarios show little difference in their impact on future maize yields until the end of the century. Uncertainties related to the sensitivity of CERES-Maize to carbon dioxide concentrations have a substantial influence on projected changes, and remain a significant obstacle to climate change impacts assessment. Finally, an investigation into the potential of simple statistical yield emulators based upon key climate variables characterizes the important uncertainties behind the selection of climate change metrics and their performance against more complex process-based crop model simulations, revealing a danger in relying only on long-term mean quantities for crop impact assessment.

Maize↗

NASA NTRS2015

Estimating Uncertainties in the Multi-Instrument SBUV Profile Ozone Merged Data Set

The MOD data set is uniquely qualified for use in long-term ozone analysis because of its long record, high spatial coverage, and consistent instrument design and algorithm. The estimated MOD uncertainty term significantly increases the uncertainty over the statistical error alone. Trends in the post-2000 period are generally positive in the upper stratosphere, but only significant at 1-1.6 hPa. Remaining uncertainties not yet included in the Monte Carlo model are Smoothing Error ( 1 from 10 to 1 hPa) Relative calibration uncertainty between N11 and N17Seasonal cycle differences between SBUV records.

Uncertainties↗