Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Uncertainty reduction in residual stress measurements by an optimised inverse solution using nonconsecutive polynomials

Many destructive methods for measuring residual stresses such as the slitting method require an inverse analysis to solve the problem. The accuracy of the result as well as an uncertainty component (the model uncertainty) depends on the basis functions used in the inverse solution. The use of a series expansion as the basis functions for the inverse solution was analysed in a previous work for the particular case where functions orders grew consecutively. The present work presents a new estimation of the model uncertainty and a new improved methodology to select the final basis functions for the case where the basis is composed of polynomials. Including nonconsecutive polynomial orders in the basis generates a larger space of possible solutions to be evaluated and allows the possibility to include higher-order polynomials. The paper includes a comparison with two other inverse analyses methodologies applied to synthetically generated data. With the new methodology, the final error is reduced and the uncertainty estimation improved.

36 MATERIALS SCIENCE↗

Assessing Uncertainty in Modeling Stress Corrosion Cracking

This report summarizes the collaboration between Sandia National Laboratories (SNL) and the Nuclear Regulatory Commission (NRC) to improve the state of knowledge on chloride induced stress corrosion cracking (CISCC). The foundation of this work relied on using SNL’s CISCC computer code to assess the current state of knowledge for probabilistically modeling CISCC on stainless steel canisters. This work is presented as three tasks. The first task is exploring and independently comparing crack growth rate (CGR) models typically used in CISCC modeling by the research community. The second task is implementing two of the more conservative CGR models from the first task into SNL’s full CISCC code to understand the impact of the different CGR models on a full probabilistic analysis while studying uncertainty from three key input parameters. The combined work of the first two tasks showed that properly measuring salt deposition rates is impactful to reducing uncertainty when modeling CISCC. The work in Task 2 also showed how probabilistic CGR models can be more appropriate at capturing aleatory uncertainty when modeling SCC. Lastly, appropriate and realistic input parameters relevant for CISCC modeling were documented in the last task as a product of the simulations considered in the first two tasks.

36 MATERIALS SCIENCE↗

Prediction of the SYM-H Index Using a Bayesian Deep Learning Method With Uncertainty Quantification

We propose a novel deep learning framework, named SYMHnet, which employs a graph neural network and a bidirectional long short-term memory network to cooperatively learn patterns from solar wind and interplanetary magnetic field parameters for short-term forecasts of the SYM-H index based on 1- and 5-min resolution data. SYMHnet takes, as input, the time series of the parameters' values provided by NASA's Space Science Data Coordinated Archive and predicts, as output, the SYM-H index value at time point t + w hours for a given time point t where w is 1 or 2. By incorporating Bayesian inference into the learning framework, SYMHnet can quantify both aleatoric (data) uncertainty and epistemic (model) uncertainty when predicting future SYM-H indices. Experimental results show that SYMHnet works well at quiet time and storm time, for both 1- and 5-min resolution data. The results also show that SYMHnet generally performs better than related machine learning methods. For example, SYMHnet achieves a forecast skill score (FSS) of 0.343 compared to the FSS of 0.074 of a recent gradient boosting machine (GBM) method when predicting SYM-H indices (1 hr in advance) in a large storm (SYM-H = -393 nT) using 5-min resolution data. When predicting the SYM-H indices (2 hr in advance) in the large storm, SYMHnet achieves an FSS of 0.553 compared to the FSS of 0.087 of the GBM method. In addition, SYMHnet can provide results for both data and model uncertainty quantification, whereas the related methods cannot.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian modeling of traffic-related air pollutants: A case study of urban transportation and air quality dynamics in Columbia, South Carolina

Traffic emissions significantly impact near-road air quality and public health. This research applies a Bayesian modeling framework to investigate these impacts using high-resolution traffic and air pollutant data from an urban corridor in Columbia, South Carolina. Despite a data collection period truncated by the COVID-19 lockdown, the Bayesian approach successfully identified significant predictors and quantified model uncertainty. Employing Bayesian Model Selection and Averaging enhanced prediction accuracy and evaluated model uncertainty. Findings indicate that higher temperatures and increased moisture levels elevate particulate matter (PM 1.0 , PM 2.5 , PM 10 ) concentrations, while traffic speed significantly affects nitrogen dioxide (NO 2 ) levels. Specifically, higher average traffic speeds (indicative of smoother flow) correspond to lower NO 2 concentrations, suggesting that less congested conditions reduce NO 2 emissions. This study highlights the robustness of Bayesian methods for generating reliable air quality insights even under data-constrained conditions. The findings underscore the importance of traffic flow management (e.g., reducing congestion) for mitigating near-road NO 2 exposure and provide a basis for developing targeted public health strategies.

54 ENVIRONMENTAL SCIENCES↗

Stochastic symplectic reduced-order modeling for model-form uncertainty quantification in molecular dynamics simulations in various statistical ensembles

Here, this work focuses on the representation of model-form uncertainties in molecular dynamics simulations in various statistical ensembles. In prior contributions, the modeling of such uncertainties was formalized and applied to quantify the impact of, and the error generated by, pair-potential selection in the microcanonical ensemble (NVE). In this work, we extend this formulation and present a linear-subspace reduced-order model for the canonical (NVT) and isobaric (NPT) ensembles. The symplectic reduced-order basis is randomized on the tangent space of the Stiefel manifold to provide topological relationships and capture model-form uncertainty. Using the Large-scale Atomic/Molecular Massively Parallel Simulator (LAMMPS), we assess the relevance of these stochastic reduced-order atomistic models on canonical problems involving a Lennard-Jones fluid and an argon crystal melt.

42 ENGINEERING↗

Theoretical and methodological challenges in hierarchical Bayesian inference for model-form uncertainty

This report describes challenges associated with the hierarchical Bayesian approach to inform model-form uncertainty (MFU) representations, which are parameterized modifications to a mathematical models’ governing equations to express uncertainty in form of the equations. To inform model-form uncertainties, hierarchical Bayesian inference is often employed. Here, the MFU parameters are distributed parametrically, and the hyperparameters of the parametric distribution are informed through Bayesian inference, with the aim of determining the MFU parameter distribution that best agrees with calibration data. In practice, however, we have found the hierarchical Bayesian approach falls short of this aim. We discuss theoretical and methodological challenges of the approach, and we present several numerical demonstrations of these challenges. To conclude, we suggest promising alternative approaches for future investigation.

97 MATHEMATICS AND COMPUTING↗

Utilizing Environmental Tracers to Reduce Groundwater Flow and Transport Model Parameter Uncertainties

Abstract Non‐uniqueness in groundwater model calibration is a primary source of uncertainty in groundwater flow and transport predictions. In this study, we investigate the ability of environmental tracer information to constrain groundwater model parameters. We utilize a pilot point calibration procedure conditioned to subsets of observed data including: liquid pressures, tritium ( 3 H), chlorofluorocarbon‐12 (CFC‐12), and sulfur hexafluoride (SF 6 ) concentrations; and groundwater apparent ages inferred from these environmental tracers, to quantify uncertainties in the heterogeneous permeability fields and infiltration rates of a steady‐state 2‐D synthetic aquifer and a transient 3‐D model of a field site located near Riverton, Wyoming (USA). To identify the relative data worth of each observation data type, the post‐calibration uncertainties of the optimal parameters for a given observation subset are compared to that from the full observation data set. Our results suggest that the calibration‐constrained permeability field uncertainties are largest when liquid pressures are used as the sole calibration data set. We find significant reduction in permeability uncertainty and increased predictive accuracy when the environmental tracer concentrations, rather than apparent groundwater ages, are used as calibration targets in the synthetic model. Calibration of the Riverton field site model using environmental tracer concentrations directly produces infiltration rate estimates with the lowest uncertainties, however; permeability field uncertainties remain similar between the environmental tracer concentration and apparent groundwater age calibration scenarios. This work provides insight on the data worth of environmental tracer information to calibrate groundwater models and highlights potential benefits of directly assimilating environmental tracer concentrations into model parameter estimation procedures.

54 ENVIRONMENTAL SCIENCES↗

The Observed and Projected Changes of Global Monsoons: Current Status and Future Perspectives

The global monsoon system, encompassing the Asian-Australian, African, and American monsoons, sustains two-thirds of the world’s population by regulating water resources and agriculture. Monsoon anomalies pose severe risks, including floods and droughts. Recent research associated with the implementation of the Global Monsoons Model Intercomparison Project under the umbrella of CMIP6 has advanced our understanding of its historical variability and driving mechanisms. Observational data reveal a 20th-century shift: increased rainfall pre-1950s, followed by aridification and partial recovery post-1980s, driven by both internal variability (e.g., Atlantic Multidecadal Oscillation) and external forcings (greenhouse gases, aerosols), while ENSO drives interannual variability through ocean-atmosphere interactions. Future projections under greenhouse forcing suggest long-term monsoon intensification, though regional disparities and model uncertainties persist. Models indicate robust trends but struggle to quantify extremes, where thermodynamic effects (warming-induced moisture rise) uniformly boost heavy rainfall, while dynamical shifts (circulation changes) create spatial heterogeneity. Volcanic eruptions and proposed solar radiation modification (SRM) further complicate predictions: tropical eruptions suppress monsoons, whereas high-latitude events alter cross-equatorial flows, highlighting unresolved feedbacks. The emergent constraint approach is booming in terms of correcting future projections and reducing uncertainty with respect to the global monsoons. Critical challenges remain. Model biases and sparse 20th-century observational data hinder accurate attribution. The interplay between natural variability and anthropogenic forcings, along with nonlinear extreme precipitation risks under warming, demands deeper mechanistic insights. Additionally, SRM’s regional impacts and hemispheric monsoon interactions require systematic evaluation. Addressing these gaps necessitates enhanced observational networks, refined climate models, and interdisciplinary efforts to disentangle multiscale drivers, ultimately improving resilience strategies for monsoon-dependent regions.

climate extreme events↗

Comparison and multi-model inference of excess risks models for radiation-related solid cancer

In assessments of detrimental health risks from exposures to ionising radiation, many forms of risk to dose–response models are available in the literature. The usual practice is to base risk assessment on one specific model and ignore model uncertainty. The analysis illustrated here considers model uncertainty for the outcome all solid cancer incidence, when modelled as a function of colon organ dose, using the most recent publicly available data from the Life Span Study on atomic bomb survivors of Japan. Seven recent publications reporting all solid cancer risk models currently deemed plausible by the scientific community have been included in a model averaging procedure so that the main conclusions do not depend on just one type of model. The models have been estimated with different baselines and presented for males and females at various attained ages and ages at exposure, to obtain specially computed model-averaged Excess Relative Risks (ERR) and Excess Absolute Risks (EAR). Monte Carlo simulated estimation of uncertainty on excess risks was accounted for by applying realisations including correlations in the risk model parameters. Three models were found to weight the model-averaged risks most strongly depending on the baseline and information criteria used for the weighting. Fitting all excess risk models with the same baseline, one model dominates for both information criteria considered in this study. Based on the analysis presented here, it is generally recommended to take model uncertainty into account in future risk analyses.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

Cosmological inference from an emulator based halo model. II. Joint analysis of galaxy-galaxy weak lensing and galaxy clustering from HSC-Y1 and SDSS

Here, we present high-fidelity cosmology results from a blinded joint analysis of galaxy-galaxy weak lensing (ΔΣ) and projected galaxy clustering (w p ) measured from the Hyper Suprime-Cam Year-1 (HSC-Y1) data and spectroscopic Sloan Digital Sky Survey (SDSS) galaxy catalogs in the redshift range 0.15 < z < 0.7. We define luminosity-limited samples of SDSS galaxies to serve as the tracers of w p in three spectroscopic redshift bins, and as the lens samples for ΔΣ. For the ΔΣ measurements, we select a single sample of 4×10 6 source galaxies over 140 deg 2 from HSC-Y1 with photometric redshifts (photo z) greater than 0.75, enabling a better handle of photo- z errors by comparing the ΔΣ amplitudes for the three lens redshift bins. The deep, high-quality HSC-Y1 data enable significant detections of the ΔΣ signals, with integrated signal-to-noise ratio S/N ~ 15 in the range 3 ≤ R/[h –1 Mpc] ≤ 30 for the three lens samples, despite the small area coverage. For cosmological parameter inference, we use an input galaxy-halo connection model built on the dark emulator package (which uses an ensemble set of high-resolution N-body simulations and enables fast, accurate computation of the clustering observables) with a halo occupation distribution that includes nuisance parameters to marginalize over modeling uncertainties. We model the ΔΣ and wp measurements on scales from R≃3 and 2h –1 Mpc , respectively, up to 30 h –1 Mpc (therefore excluding the baryon acoustic oscillations information) assuming a flat Λ CDM cosmology, marginalizing over about 20 nuisance parameters and demonstrating the robustness of our results to them. With various tests using mock catalogs described in Miyatake et al. [preceding paper, Phys. Rev. D 106, 083519 (2022)], we show that any bias in the clustering amplitude S 8 ≡ σ 8 (Ω m /0.3) 0.5 due to uncertainties in the galaxy-halo connection is less than ~ 50 % of the statistical uncertainty of S 8 , unless the assembly biaseffect is unexpectedly large. Our best-fit models have S 8 = 0.795$_{-0.042}^{+0.049}$ (mode and 68% credible interval) for the flat Λ CDM model; we find tighter constraints on the quantity S 8 (α = 0.17)≡σ 8 (Ω m /0.3) 0.17 = 0.745$_{-0.031}^{+0.039}$.

79 ASTRONOMY AND ASTROPHYSICS↗

Comprehensive Analysis of Model Parameter Uncertainty Influence on Evaluation of HVAC Operation to Mitigate Indoor Virus: A Case Study for an Office Building in a Cold and Dry Climate

Simulation-based studies of HVAC operation to mitigate indoor virus have been conducted to understand tradeoffs between indoor air quality (IAQ) and energy consumption. However, the influence of model parameter uncertainty in these studies has not been systematically quantified, which is critical when providing guidance to building operators. To address this gap, we identify 20 model parameters for a typical medium office building system in a cold and dry climate that can influence IAQ and energy consumption for indoor virus scenarios. Next, the distributions of the parameter values are estimated from literature and a set of simulation samples for three representative days is generated that simultaneously sample all of the parameters from their distributions. Two HVAC virus mitigation strategies are studied: increased filtration using MERV 13 filters and increased ventilation, via supply of 100% outdoor air into buildings. The model parameter uncertainty leads to significant variability in the results, particularly for the IAQ because of the highly uncertain virus generation rate. Use of 100% outdoor air can be beneficial for some uncertain scenarios on the hot day, but shows less IAQ improvement and/or significant energy increases on the other days. The virus removal efficiency and pressure drop of the HVAC filter, fan efficiency, and internal heat gain are the most important parameters to determining the tradeoffs of the two strategies. Our results demonstrate how this model parameter uncertainty analysis methodology can provide practical guidance to building operators.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Polynomial chaos expansions on principal geodesic Grassmannian submanifolds for surrogate modeling and uncertainty quantification

In this work we introduce a manifold learning-based surrogate modeling framework for uncertainty quantification in high-dimensional stochastic systems. Our first goal is to perform data mining on the available simulation data to identify a set of low-dimensional (latent) descriptors that efficiently parameterize the response of the high-dimensional computational model. To this end, we employ Principal Geodesic Analysis on the Grassmann manifold of the response to identify a set of disjoint principal geodesic submanifolds, of possibly different dimension, that captures the variation in the data. Since operations on the Grassmann require the data to be concentrated, we propose an adaptive algorithm based on Riemannian K-means and the minimization of the sample Fréchet variance on the Grassmann manifold to identify “local” principal geodesic submanifolds that represent different system behavior across the parameter space. Polynomial chaos expansion is then used to construct a mapping between the random input parameters and the projection of the response on these local principal geodesic submanifolds. Here, the method is demonstrated on four test cases, a toy-example that involves points on a hypersphere, a Lotka-Volterra dynamical system, a continuous-flow stirred-tank chemical reactor system, and a two-dimensional Rayleigh-Bénard convection problem.

42 ENGINEERING↗

Assessing dynamic vegetation model parameter uncertainty across Alaskan arctic tundra plant communities

Abstract As the Arctic region moves into uncharted territory under a warming climate, it is important to refine the terrestrial biosphere models (TBMs) that help us understand and predict change. One fundamental uncertainty in TBMs relates to model parameters, configuration variables internal to the model whose value can be estimated from data. We incorporate a version of the Terrestrial Ecosystem Model (TEM) developed for arctic ecosystems into the Predictive Ecosystem Analyzer (PEcAn) framework. PEcAn treats model parameters as probability distributions, estimates parameters based on a synthesis of available field data, and then quantifies both model sensitivity and uncertainty to a given parameter or suite of parameters. We examined how variation in 21 parameters in the equation for gross primary production influenced model sensitivity and uncertainty in terms of two carbon fluxes (net primary productivity and heterotrophic respiration) and two carbon (C) pools (vegetation C and soil C). We set up different parameterizations of TEM across a range of tundra types (tussock tundra, heath tundra, wet sedge tundra, and shrub tundra) in northern Alaska, along a latitudinal transect extending from the coastal plain near Utqiaġvik to the southern foothills of the Brooks Range, to the Seward Peninsula. TEM was most sensitive to parameters related to the temperature regulation of photosynthesis. Model uncertainty was mostly due to parameters related to leaf area, temperature regulation of photosynthesis, and the stomatal responses to ambient light conditions. Our analysis also showed that sensitivity and uncertainty to a given parameter varied spatially. At some sites, model sensitivity and uncertainty tended to be connected to a wider range of parameters, underlining the importance of assessing tundra community processes across environmental gradients or geographic locations. Generally, across sites, the flux of net primary productivity (NPP) and pool of vegetation C had about equal uncertainty, while heterotrophic respiration had higher uncertainty than the pool of soil C. Our study illustrates the complexity inherent in evaluating parameter uncertainty across highly heterogeneous arctic tundra plant communities. It also provides a framework for iteratively testing how newly collected field data related to key parameters may result in more effective forecasting of Arctic change.

54 ENVIRONMENTAL SCIENCES↗

Considering the Variability of Soiling in Long-Term PV Performance Forecasting

This study presents the development of a methodology for evaluating the variability associated with soiling on long-term photovoltaic (PV) forecasting. Independent engineering firms typically build forecasts for large PV plants through the use of the PVsyst software, where monthly soiling losses are one of many inputs to the P50 model. Subsequently, long-term performance distributions are constructed through a Monte Carlo analysis that includes various factors, such as satellite irradiance modeling uncertainty, uncertainty in the PVsyst model, and long-term irradiance variability. Often the PVsyst model uncertainty is increased to account for sites with significant soiling concerns but no systematic method has been presented in the literature to specifically include soiling variability within long-term performance uncertainty. In this work soiling information from 16 sites in the U.S. Southwest are combined with 24 years of rainfall data to generate 24 years of energy production with soiling losses and then subsequently generate probability of exceedance values (e.g., P50, P90, P95…). The results show that the size of the 90% confidence interval (P5–P95) can increase from –0.7% to 10.1% when interannual soiling variability and soiling rate uncertainty is included.

14 SOLAR ENERGY↗

Data-assimilated time-lapse visco-acoustic full-waveform inversion: Theory and application for injected CO 2 plume monitoring

Continuous seismic monitoring for quantifying CO 2 plume migration and detection of any potential leakages in the subsurface is essential for the security of long-term anthropogenic carbon dioxide geologic storage. Traditional time-lapse full-waveform inversion (TLFWI) methods aim to map the CO 2 distribution by estimating seismic velocity changes, but recent studies find that CO 2 -induced attenuation is an important complement to seismic velocity for tracking the CO 2 plumes and even quantifying the CO 2 saturation. We have developed a novel data-assimilated TLFWI method to construct high-resolution time-lapse velocity and attenuation changes from dense time-lapse monitoring data. This method consists of two theoretical developments: visco-acoustic full-waveform inversion (QFWI) and multiparameter hierarchical matrix-powered extended Kalman filter (mHiEKF). The method is capable of (1) posing temporal constraints to retrieve time-lapse information from dense monitoring data by using mHiEKF, (2) accurately recovering high-spatial-resolution velocity and attenuation perturbations using first-order equation system-based QFWI, and (3) providing the model uncertainty by estimating their model standard deviation. With numerical examples, we first find the effectiveness of the new QFWI on estimating accurate velocity and attenuation models simultaneously. Then, a CO 2 leakage case and a realistic Frio-II CO 2 monitoring case are presented to find the advantages and applicability of our data-assimilated QFWI method for estimating time-lapse changes using dense time-lapse monitoring surveys. Here, by assimilating time-lapse seismic monitoring data over time, our data-assimilated QFWI method can improve the resolution of velocity and attenuation changes and decrease their model uncertainties.

58 GEOSCIENCES↗

Considering the Variability of Soiling in Long-Term PV Performance Forecasting: Preprint

This study presents the development of a methodology for evaluating the variability associated with soiling on long-term PV forecasting. Independent engineering firms typically build P50 forecasts for large PV plants through the use of the PVsyst software, where monthly soiling losses are one of many inputs to the P50 model. Subsequently, long-term performance distributions, or Pvalues, are constructed through a Monte Carlo analysis that includes various factors such as: satellite irradiance modeling uncertainty, uncertainty in the PVsyst model, and long-term irradiance variability. Often the PVsyst model uncertainty is increased to account for sites with significant soiling concerns but no systematic method has been presented in the literature to specifically include soiling variability within Pvalues. In this work soiling information from 16 sites in the U.S. Southwest are combined with 20 years of rainfall data to generate 20 years of energy production with soiling losses and then subsequently generate Pvalues. The results show that the spread of Pvalues (P1-P99) can increase from 0-13% when interannual soiling variability is included.

interannual variability↗

A framework for strategic discovery of credible neural network surrogate models under uncertainty

The widespread integration of deep neural networks in developing data-driven surrogate models for high-fidelity simulations of complex physical systems highlights the critical necessity for robust uncertainty quantification techniques and credibility assessment methodologies, ensuring the reliable deployment of surrogate models in consequential decision-making. Here, this study presents the Occam Plausibility Algorithm for surrogate models (OPAL-surrogate), providing a systematic framework to uncover predictive neural network-based surrogate models within the large space of potential models, including various neural network classes and choices of architecture and hyperparameters. The framework is grounded in hierarchical Bayesian inferences and employs model validation tests to evaluate the credibility and prediction reliability of the surrogate models under uncertainty. Leveraging these principles, OPAL-surrogate introduces a systematic and efficient strategy for balancing the trade-off between model complexity, accuracy, and prediction uncertainty. The effectiveness of OPAL-surrogate is demonstrated through two modeling problems, including the deformation of porous materials for building insulation and turbulent combustion flow for ablation of solid fuels within hybrid rocket motors.

42 ENGINEERING↗

Vegetation biogeography is a main source of uncertainty in modelling the land carbon cycle

The terrestrial biosphere exchanges a large amount of CO 2 with the atmosphere through photosynthesis and respiration, determining the magnitude of land carbon sink and consequently influencing the rate of global warming. The magnitudes of global photosynthesis and respiration, however, vary widely across models (100-200 PgC/year), constituting a key and persistent source of uncertainty in carbon cycle and climate modelling. Here, we argue that the uncertainty in the land carbon cycle modelling is largely attributable to the uncertainty in biogeography – the distribution of plant functional types (PFTs). Using an ensemble of dynamic global vegetation models (DGVMs), we find a strong dependence of total photosynthesis on total area for each PFT. The dependence allows us to reduce the spread of land carbon cycle estimates by ~75% using remote sensing-based PFT maps. We further find that 56 ± 21% of climate-driven changes in global photosynthesis modelled by DGVMs are caused by changes in PFT distribution in the last two decades. Our study identifies vegetation biogeography as a main controlling factor of uncertainty in land carbon cycle modelling and highlights the importance of biogeography-climate interactions in carbon cycle and climate studies.

Zhao, Ruiying [National Univ. of Singapore (Singap↗