Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

COVID-19 dynamics across the US: A deep learning study of human mobility and social behavior

This paper presents a deep learning framework for epidemiology system identification from noisy and sparse observations with quantified uncertainty. The proposed approach employs an ensemble of deep neural networks to infer the time-dependent reproduction number of an infectious disease by formulating a tensor-based multi-step loss function that allows us to efficiently calibrate the model on multiple observed trajectories. The method is applied to a mobility and social behavior-based SEIR model of COVID-19 spread. The model is trained on Google and Unacast mobility data spanning a period of 66 days, and is able to yield accurate future forecasts of COVID-19 spread in 203 US counties within a time-window of 15 days. Interestingly, a sensitivity analysis that assesses the importance of different mobility and social behavior parameters reveals that attendance of close places, including workplaces, residential, and retail and recreational locations, has the largest impact on the effective reproduction number. Furthermore, the model enables us to rapidly probe and quantify the effects of government interventions, such as lock-down and re-opening strategies. Taken together, the proposed framework provides a robust workflow for data-driven epidemiology model discovery under uncertainty and produces probabilistic forecasts for the evolution of a pandemic that can judiciously provide information for policy and decision making. All codes and data accompanying this manuscript are available at https://github.com/PredictiveIntelligenceLab/DeepCOVID19.

60 APPLIED LIFE SCIENCES↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗

Uncertainty propagation in pore water chemical composition calculation using surrogate models

Performance assessment in deep geological nuclear waste repository systems necessitates an extended knowledge of the pore water chemical conditions prevailing in host-rock formations. In the last two decades, important progress has been made in the experimental characterization and thermodynamic modeling of pore water speciation, but the influence of experimental artifacts and uncertainties of thermodynamic input parameters are seldom evaluated. In this respect, we conducted an uncertainty propagation study in a reference geochemical model describing the pore water chemistry of the Callovian-Oxfordian clay formation. Nineteen model input parameters were perturbed, including those associated to experimental characterization (leached anions, exchanged cations, cation exchange selectivity coefficients) and those associated to generic thermodynamic databases (solubilities). A set of 13 quantities of interest were studied by the use of polynomial chaos expansions built non-intrusively with a least-squares forward stepwise regression approach. Training and validation sets of simulations were carried out using the geochemical speciation code PHREEQC. The statistical results explored the marginal distribution of each quantity of interest, their bivariate correlations as well as their global sensitivity indices. The influence of the assumed distributions for input parameters uncertainties was evaluated by considering two parametric domain sizes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Technical descriptions of the experimental dynamical downscaling simulations over North America by the CAM–MPAS variable-resolution model

Abstract. Comprehensive assessment of climate datasets is important for communicating model projections and associated uncertainties to stakeholders. Uncertainties can arise not only from assumptions and biases within the model but also from external factors such as computational constraint and data processing. To understand sources of uncertainties in global variable-resolution (VR) dynamical downscaling, we produced a regional climate dataset using the Model for Prediction Across Scales (MPAS; dynamical core version 4.0) coupled to the Community Atmosphere Model (CAM; version 5.4), which we refer to as CAM–MPAS hereafter. This document provides technical details of the model configuration, simulations, computational requirements, post-processing, and data archive of the experimental CAM–MPAS downscaling data. The CAM–MPAS model is configured with VR meshes featuring higher resolutions over North America as well as quasi-uniform-resolution meshes across the globe. The dataset includes multiple uniform- (240 and 120 km) and variable-resolution (50–200, 25–100, and 12–46 km) simulations for both the present-day (1990–2010) and future (2080–2100) periods, closely following the protocol of the North American Coordinated Regional Climate Downscaling Experiment. A deviation from the protocol is the pseudo-warming experiment for the future period, using the ocean boundary conditions produced by adding the sea surface temperature and sea-ice changes from the low-resolution version of the Max Planck Institute Earth System Model (MPI-ESM-LR) in the Coupled Model Intercomparison Project Phase 5 to the present-day ocean state from a reanalysis product. Some unique aspects of global VR models are evaluated to provide background knowledge to data users and to explore good practices for modelers who use VR models for regional downscaling. In the coarse-resolution domain, strong resolution sensitivity of the hydrological cycles exists over the tropics but does not appear to affect the midlatitude circulations in the Northern Hemisphere, including the downscaling target of North America. The pseudo-warming experiment leads to similar responses of large-scale circulations to the imposed radiative and boundary forcings in the CAM–MPAS and MPI-ESM-LR models, but their climatological states in the historical period differ over various regions, including North America. Such differences are carried to the future period, suggesting the importance of the base state climatology. Within the refined domain, precipitation statistics improve with higher resolutions, and such statistical inference is verified to be negligibly influenced by horizontal remapping during post-processing. Limited (≈50 % slower) throughput of the current code is found on a recent many-core/wide-vector high-performance computing system, which limits the lengths of the 12–46 km simulations and indirectly affects sampling uncertainty. Our experience shows that global and technical aspects of the VR downscaling framework require further investigations to reduce uncertainties for regional climate projection.

58 GEOSCIENCES↗

Modeling study of deep direct use geothermal on the West Virginia university campus-morgantown, WV

To reduce the geothermal exploration risk, a feasibility study is performed for a deep direct-use (DDU) system proposed at the West Virginia University (WVU) Morgantown campus. This study applies numerical simulations to investigate reservoir impedance and thermal production. Because of the great depth of the geothermal reservoir, few data are available to characterize reservoir features and properties. Consequently, the study focuses on the following three aspects: 1. model choice for predicting reservoir impedance and thermal breakthrough: after investigating three potential models (one single permeability model and two dual permeability models) for flow through fractured rock, it is decided only the single permeability model is needed; 2. well placement (horizontal vs. vertical) options: horizontal well placement seems to be more robust to heterogeneity and the impedance is more acceptable; 3. Prediction uncertainty: the most influential parameters are identified using a First-Order-Second-Moment uncertainty propagation analysis, and the uncertain range of the model predictions is estimated by performing a Monte Carlo simulation. Heterogeneity has a large impact on the prediction, therefore, heterogeneity is included in the predictive model and uncertainty analysis. The numerical model results and uncertainty analysis will be used for further economic studies.

15 GEOTHERMAL ENERGY↗

Type Ia Supernova Growth-rate Measurement with LSST Simulations: Intrinsic Scatter Systematics

Measurement of the growth rate of structures (fσ 8 ) with Type Ia supernovae (SNe Ia) will improve our understanding of the nature of dark energy and enable tests of general relativity. In this paper, we generate simulations of the 10 yr SN Ia data set of the Rubin-LSST survey, including a correlated velocity field from an N-body simulation and realistic models of SNe Ia properties and their correlations with host-galaxy properties. We find, similar to SN Ia analyses that constrain the dark energy equation-of-state parameters w 0 w a , that constraints on fσ 8 can be biased depending on the intrinsic scatter of SNe Ia. While for the majority of intrinsic scatter models we recover fσ 8 with a precision of ∼13%–14%, for the most realistic dust-based model, we find that the presence of non-Gaussianities in Hubble diagram residuals leads to a bias on fσ 8 of ∼ −20%. When trying to correct for the dust-based intrinsic scatter, we find that the propagation of the uncertainty on the model parameters does not significantly increase the error on fσ 8 . We also find that while the main component of the error budget of fσ 8 is the statistical uncertainty (>75% of the total error budget), the systematic error budget is dominated by the uncertainty on the damping parameter, σ u , that gives an empirical description of the effect of redshift space distortions on the velocity power spectrum. Our results motivate a search for new methods to correct for the non-Gaussian distribution of the Hubble diagram residuals, as well as an improved modeling of the damping parameter.

Carreres, Bastien [Duke Univ., Durham, NC (United ↗

A Comprehensive Analysis of Uncertainties in Warm-Rain Parameterizations in Climate Models Based on In Situ Measurements

Abstract Because of the coarse grid size of Earth system models (ESMs), representing warm-rain processes in ESMs is a challenging task involving multiple sources of uncertainty. Previous studies evaluated warm-rain parameterizations mainly according to their performance in emulating collision–coalescence rates for local droplet populations over a short period of a few seconds. The representativeness of these local process rates comes into question when applied in ESMs for grid sizes on the order of 100 km and time steps on the order of 20–30 min. We evaluate several widely used warm-rain parameterizations in ESM application scenarios. In the comparison of local and instantaneous autoconversion rates, the two parameterization schemes based on numerical fitting to stochastic collection equation (SCE) results perform best. However, because of Jessen’s inequality, their performance deteriorates when grid-mean, instead of locally resolved, cloud properties are used in their simulations. In contrast, the effect of Jessen’s inequality partly cancels the overestimation problem of two semianalytical schemes, leading to an improvement in the ESM-like comparison. In the assessment of uncertainty due to the large time step of ESMs, it is found that the rainwater tendency simulated by the SCE is roughly linear for time steps smaller than 10 min, but the nonlinearity effect becomes significant for larger time steps, leading to errors up to a factor of 4 for a time step of 20 min. After considering all uncertainties, the grid-mean and time-averaged rainwater tendency based on the parameterization schemes is mostly within a factor of 4 of the local benchmark results simulated by SCE.

Meteorology & Atmospheric Sciences↗

Glass formulation and composition optimization with property models: A review

Abstract Glass is a versatile material with a remarkable history and many practical applications. It plays a critical role in our everyday lives, the advancement of science, and the development of many technologies. The Edisonian type trial‐and‐error method was commonly used for conventional design of glass compositions, which was time‐consuming and costly. With the urgent need to develop new glass compositions for technology applications rapidly, it has become necessary to develop precise property models with predictive powers using large databases and efficient formulation approaches. This paper reviews the design of glass compositions using these analytical and numerical models of composition–structure–property relations of glasses, some based on large databases and machine learning approaches. Aspects of data collection, model fitting, feature extraction, model evaluation, and uncertainty quantification will be covered. Furthermore, advances in the glass optimization framework and available tools are summarized with examples. The outlook and perspective for further glass property model development and formulation approaches are discussed.

Lu, Xiaonan↗

Planning Amidst Uncertainty: Identifying Core CCS Infrastructure Robust to Storage Uncertainty

Carbon Capture and Storage (CCS) is a critical technology for reducing anthropogenic CO2 emissions, but its large-scale deployment is complicated by uncertainties in geological storage performance. These uncertainties pose significant financial and operational risks, as underperforming storage sites can lead to costly infrastructure modifications, inefficient pipeline routing, and economic shortfalls. To address this challenge, we propose a novel optimization workflow that is based on mixed-integer linear programming and explicitly integrates probabilistic modeling of storage uncertainty into CCS infrastructure design. This workflow generates multiple infrastructure scenarios by sampling storage capacity distributions, optimally solving each scenario using a mixed-integer linear programming model, and aggregating results into a heatmap to identify core infrastructure components that have a low likelihood of underperforming. A risk index parameter is introduced to balance trade-offs between cost, CO2 processing capacity, and risk of underperformance, allowing stakeholders to quantify and mitigate uncertainty in CCS planning. Applying this workflow to a CCS dataset from the US Department of Energy’s Carbon Utilization and Storage Partnership project reveals key insights into infrastructure resilience. Reducing the risk index from 15% to 0% is observed to lead to an 83.7% reduction in CO2 processing capacity and a 77.1% decrease in project profit, quantifying the trade-off between risk tolerance and project performance. Furthermore, our results highlight critical breakpoints, where small adjustments in the risk index produce disproportionate shifts in infrastructure performance, providing actionable guidance for decision-makers. Unlike prior approaches that aimed to cheaply repair underperforming infrastructure, our workflow constructs robust CCS networks from the ground up, ensuring cost-effective infrastructure under storage uncertainty. These findings demonstrate the practical relevance of incorporating uncertainty-aware optimization into CCS planning, equipping decision-makers with a tool to make informed project planning decisions.

Olson, Daniel↗

Robust calibration of non-perturbative models with history matching

We apply, for the first time, Bayes Linear Emulation and History Matching to the calibration of non-perturbative models in Monte Carlo event generators. In contrast to the usual approach of "Monte Carlo tuning", History Matching does not result in best-fit plus ellipsoidal parameter uncertainty estimates but instead identifies all parameter space regions that are consistent with data. This approach leads to a systematic and robust quantification of parametric uncertainties in the models, especially in those challenging cases where different, possibly disjoint, regions of parameter space deliver similar results, which are usually not properly treated with current methodology. We highlight the power of this method with the hadronisation models available through Sherpa : the built-in cluster fragmentation Ahadic and string fragmentation through an interface to Pythia .

Iskauskas, Andrew [Durham U. (main)] (ORCID:000000↗

A Tutorial on Bayesian analysis of linear shock compression data

Gas gun and other shock compression experiments often produce shock wave velocity measurements that are linearly associated with particle velocity. Traditionally, this empirical relationship is quantified with a single Hugoniot curve that is estimated using least squares regression. However, for downstream modeling and simulation tasks, it is often more useful to have multiple Hugoniot curves in the pressure–volume plane that are consistent with the data. We employ Bayesian uncertainty quantification methods as a framework for propagating measurement uncertainty through to model parameters and predictions. Specifically, this Tutorial shows how to sample multiple Hugoniot curves in the pressure–volume plane that are consistent with the shock wave-particle velocity measurements in a two-step Bayesian approach. First, we obtain an analytical expression for the posterior distribution of the linear model parameters using Bayesian linear regression. Second, we propagate samples from the posterior distribution through the Rankine–Hugoniot equations to yield Hugoniot curves in the pressure–volume plane. The procedure is demonstrated with publicly available data on argon, copper, and nickel, and compared against bootstrapping and linear regression. The Bayesian procedure is shown to be interpretable, computationally inexpensive, and less sensitive than an alternative bootstrapping approach to the removal of the point in the copper dataset that has the largest particle velocity. As a Tutorial on Bayesian methodology for the shock compression community, we provide several derivations and explanations that make this paper self-contained, and make all code and data available at github.com/llnl/BALSCD.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Assessment of Crustal Leg Uncertainties for RSTT Path-dependent Uncertainty

The Regional Seismic Travel Time (RSTT) model and software were recently updated to allow for path-dependent uncertainty (PDU) estimates for travel-time (Begnaud et al. 2021; Begnaud et al. 2020). Begnaud et al. (2021) describes the process of improving the current distance-dependent uncertainty parameterization for RSTT using a random effects model (REM) to estimate slowness (inverse velocity) uncertainty as a mean squared error for each model parameter. The REM separates the error between observed slowness and model predicted slowness into bias and random components. The PDU is calculated by integrating these mean squared errors along a seismic-phase ray path.

58 GEOSCIENCES↗

Probabilistic machine learning for battery health diagnostics and prognostics—review and perspectives

Abstract Diagnosing lithium-ion battery health and predicting future degradation is essential for driving design improvements in the laboratory and ensuring safe and reliable operation over a product’s expected lifetime. However, accurate battery health diagnostics and prognostics is challenging due to the unavoidable influence of cell-to-cell manufacturing variability and time-varying operating circumstances experienced in the field. Machine learning approaches informed by simulation, experiment, and field data show enormous promise to predict the evolution of battery health with use; however, until recently, the research community has focused on deterministic modeling methods, largely ignoring the cell-to-cell performance and aging variability inherent to all batteries. To truly make informed decisions regarding battery design in the lab or control strategies for the field, it is critical to characterize the uncertainty in a model’s predictions. After providing an overview of lithium-ion battery degradation, this paper reviews the current state-of-the-art probabilistic machine learning models for health diagnostics and prognostics. Details of the various methods, their advantages, and limitations are discussed in detail with a primary focus on probabilistic machine learning and uncertainty quantification. Last, future trends and opportunities for research and development are discussed.

25 ENERGY STORAGE↗

Challenges in quantifying unparameterized spatial uncertainties in deep geologic repositories for nuclear waste

Spatially heterogeneous uncertainties are prevalent in geophysical modeling applications, such as probabilistic post-closure performance assessment (PA) of deep geologic repositories for nuclear waste. Such uncertainties are often highly influential to model outputs, so it is desirable to identify the most important mechanisms by which they influence model predictions. However, these uncertainties are often unparameterized in the sense that there is no set of parameters that can be specified to yield a particular realization of the uncertainty. Additionally, the uncertainty is not intrinsically endowed with a parameterization that captures a realization’s mechanistic influence on model outputs. Therefore, in this work we present a novel methodology to develop and assess a set of proxy variables that aim to represent this influence. We show how they can be computed, downselected, and incorporated into the construction of statistical surrogate models mapping model inputs to outputs. We present our methodology in the context of a motivating application problem in deep geologic repository PA and discuss the challenges in capturing the effects of these spatial heterogeneities in uncertainty analyses.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Bayesian learning with Gaussian processes for low-dimensional representations of time-dependent nonlinear systems

This work presents a data-driven method for learning low-dimensional time-dependent physics-based surrogate models whose predictions are endowed with uncertainty estimates. We use the operator inference approach to model reduction that poses the problem of learning low-dimensional model terms as a regression of state space data and corresponding time derivatives by minimizing the residual of reduced system equations. Standard operator inference models perform well with accurate training data that are dense in time, but producing stable and accurate models when the state data are noisy and/or sparse in time remains a challenge. Another challenge is the lack of uncertainty estimation for the predictions from the operator inference models. Our approach addresses these challenges by incorporating Gaussian process surrogates into the operator inference framework to (1) probabilistically describe uncertainties in the state predictions and (2) procure analytical time derivative estimates with quantified uncertainties. The formulation leads to a generalized least-squares regression and, ultimately, reduced-order models that are described probabilistically with a closed-form expression for the posterior distribution of the operators. The resulting probabilistic surrogate model propagates uncertainties from the observed state data to reduced-order predictions. Furthermore, we demonstrate the method is effective for constructing low-dimensional models of two nonlinear partial differential equations representing a compressible flow and a nonlinear diffusion–reaction process, as well as for estimating the parameters of a low-dimensional system of nonlinear ordinary differential equations representing compartmental models in epidemiology.

Data-driven model reduction↗

Probabilistic neural networks for fluid flow surrogate modeling and data recovery

We consider the use of probabilistic neural networks for fluid flow surrogate modeling and data recovery. This framework is constructed by assuming that the target variables are sampled from a Gaussian distribution conditioned on the inputs. Consequently, the overall formulation sets up a procedure to predict the hyperparameters of this distribution which are then used to compute an objective function given training data. We demonstrate that this framework has the ability to provide for prediction confidence intervals based on the assumption of a probabilistic posterior, given an appropriate model architecture and adequate training data. The applicability of the present framework to cases with noisy measurements and limited observations is also assessed. To demonstrate the capabilities of this framework, we consider canonical regression problems of fluid dynamics from the viewpoint of reduced-order modeling and spatial data recovery for four canonical data sets. The examples considered in this study arise from (i) the shallow-water equations, (ii) a two-dimensional cylinder flow, (iii) the wake of a NACA0012 airfoil with a Gurney flap, and (iv) the NOAA sea surface temperature data set. Furthermore, the present results indicate that the probabilistic neural network not only produces a machine-learning-based fluid flow surrogate model but also systematically quantifies the uncertainty therein to assist with model interpretability.

42 ENGINEERING↗

Sensitivity of Thermal Predictions to Uncertain Surface Tension Data in Laser Additive Manufacturing

To understand the process-microstructure relationships in additive manufacturing (AM), it is necessary to predict the solidification characteristics in the melt pool. This study investigates the influence of Marangoni driven fluid flow on the predicted melt pool geometry and solidification conditions using a continuum finite volume model. A calibrated laser absorptivity was determined by comparing the model predictions (neglecting fluid flow) against melt pool dimensions obtained from single laser melt experiments on a nickel super alloy 625 (IN625) plate. Using this calibrated efficiency, predicted melt pool geometries agree well with experiments across a range of process conditions. When fluid mechanics is considered, a surface tension gradient recommended for IN625 tends to overpredict the influence of convective heat transfer, but the use of an intermediate value reported from experimental measurements of a similar nickel super alloy produces excellent experimental agreement. Despite its significant effect on the melt pool geometry predictions, fluid flow was found to have a small effect on the predicted solidification conditions compared to processing conditions. We find that this result suggests that under certain circumstances, a model only considering conductive heat transfer is sufficient for approximating process-microstructure relationships in laser AM. Extending the model to multiple laser passes further showed that fluid flow also has a small effect on the solidification conditions compared to the transient variations in the process. Furthermore, limitations of the current model and areas of improvement, including uncertainties associated with the phenomenological model inputs are discussed.

36 MATERIALS SCIENCE↗