Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Long-Term Evaluation of Remedial Technology Performance in the Laboratory: Multi-year Experimental Test Plan

An understanding of the long-term effectiveness of remediation technologies is central to sustainable environmental cleanup. Long-term experiments are valuable for reducing uncertainty and predicting remediation outcomes at scales required for regulatory compliance. However, these types of tests can be costly and challenging to interpret. Therefore, contaminated sites often rely on short-term laboratory experiments that may not account for the potentially significant effects of gradual, time- dependent processes governing contaminant retention, release, and species transformation. For example, short-term lab experiments (from months to a year) conducted with sediments from the unsaturated and saturated zones at the Hanford Site play an important role in initial evaluations of remediation technologies but cannot capture the full extent of time-dependent reactions, leaving uncertainties in field-scale deployment. Here, long-term testing will be conducted on select technologies based on their performance in short-term testing. The overall objective is to directly address the challenges described above by generating and analyzing data on long-term (2–10 years) efficacy of selected remediation technologies, integrating this understanding into models, and providing critical input for remediation planning, monitoring, and 5-year review cycles for field-implemented remedies. Specific objectives include: 1. Evaluating long-term efficiency of promising remedies under site-specific conditions. 2. Generating robust parameters for modeling, reducing uncertainty in predictive simulations. 3. Advancing integrated monitoring by combining geochemical and geophysical observations. 4. Informing field-scale implementation by incrementally advancing technologies, identifying failure mechanisms early, and prioritizing robust, cost-effective remedies. Through systematic evaluation of technologies in laboratory-scale column experiments, integrated monitoring, and modeling support, this project is designed to bolster confidence in the long-term robustness of selected technologies. The ultimate outcome is the identification and deployment of more reliable, cost-effective remedies that safeguard human health and the environment while reducing the uncertainties that have historically hindered cleanup progress at Hanford Site. An experimental approach was developed and initiated for long-term testing potentially up to 10 years. The table below summarizes the experimental approach developed for testing select technologies and presented in this multi-year experimental test plan.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Interpretable Data-Driven Probabilistic Power System Load Margin Assessment with Uncertain Renewable Energy and Loads

The increasing uncertainties caused by the high-penetration of stochastic renewable generation resources poses a significant threat to the power system voltage stability. To address this issue, this paper proposes a probabilistic deep kernel learning enabled surrogate model to extract the hidden relationship between uncertain sources, i.e., wind power and loads, and load margin for probabilistic load margin assessment (PLMA). Unlike other deep learning approaches, a kernel SHAP provides the sensitivity analysis as well as interpretability of the inputs to outputs influences. This allows identifying the critical factors that affect load margin so that corrective control can be initiated for stability enhancement. Numerical results carried out on the IEEE 118-bus power system demonstrate the accuracy and efficiency of the proposed data-driven PLMA scheme.

deep kernel learning↗
DOE OSTI2024

Active learning of ternary alloy structures and energies

Abstract Machine learning models with uncertainty quantification have recently emerged as attractive tools to accelerate the navigation of catalyst design spaces in a data-efficient manner. Here, we combine active learning with a dropout graph convolutional network (dGCN) as a surrogate model to explore the complex materials space of high-entropy alloys (HEAs). We train the dGCN on the formation energies of disordered binary alloy structures in the Pd-Pt-Sn ternary alloy system and improve predictions on ternary structures by performing reduced optimization of the formation free energy, the target property that determines HEA stability, over ensembles of ternary structures constructed based on two coordinate systems: (a) a physics-informed ternary composition space, and (b) data-driven coordinates discovered by the Diffusion Maps manifold learning scheme. Both reduced optimization techniques improve predictions of the formation free energy in the ternary alloy space with a significantly reduced number of DFT calculations compared to a high-fidelity model. The physics-based scheme converges to the target property in a manner akin to a depth-first strategy, whereas the data-driven scheme appears more akin to a breadth-first approach. Both sampling schemes, coupled with our acquisition function, successfully exploit a database of DFT-calculated binary alloy structures and energies, augmented with a relatively small number of ternary alloy calculations, to identify stable ternary HEA compositions and structures. This generalized framework can be extended to incorporate more complex bulk and surface structural motifs, and the results demonstrate that significant dimensionality reduction is possible in thermodynamic sampling problems when suitable active learning schemes are employed.

Chemistry↗
DOE OSTI2023

BUQEYE guide to projection-based emulators in nuclear physics

The BUQEYE collaboration (Bayesian Uncertainty Quantification: Errors in Your effective field theory) presents a pedagogical introduction to projection-based, reduced-order emulators for applications in low-energy nuclear physics. The term emulator refers here to a fast surrogate model capable of reliably approximating high-fidelity models. As the general tools employed by these emulators are not yet well-known in the nuclear physics community, we discuss variational and Galerkin projection methods, emphasize the benefits of offline-online decompositions, and explore how these concepts lead to emulators for bound and scattering systems that enable fast and accurate calculations using many different model parameter sets. We also point to future extensions and applications of these emulators for nuclear physics, guided by the mature field of model (order) reduction. All examples discussed here and more are available as interactive, open-source Python code so that practitioners can readily adapt projection-based emulators for their own work.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

The potential role of organics in new particle formation and initial growth in the remote tropical upper troposphere

Abstract. Global observations and model studies indicate that new particle formation (NPF) in the upper troposphere (UT) and subsequent particles supply 40 %–60 % of cloud condensation nuclei (CCN) in the lower troposphere, thus affecting the Earth's radiative budget. There are several plausible nucleation mechanisms and precursor species in this atmospheric region, which, in the absence of observational constraints, lead to uncertainties in modeled aerosols. In particular, the type of nucleation mechanism and concentrations of nucleation precursors, in part, determine the spatial distribution of new particles and resulting spatial distribution of CCN from this source. Although substantial advances in understanding NPF have been made in recent years, NPF processes in the UT in pristine marine regions are still poorly understood and are inadequately represented in global models. Here, we evaluate commonly used and state-of-the-art NPF schemes in a Lagrangian box model to assess which schemes and precursor concentrations best reproduce detailed in situ observations. Using measurements of aerosol size distributions (0.003 < Dp < 4.8 µm) in the remote marine troposphere between ∼0.18 and 13 km altitude obtained during the NASA Atmospheric Tomography (ATom) mission, we show that high concentrations of newly formed particles in the tropical UT over both the Atlantic and Pacific oceans are associated with outflow regions of deep convective clouds. We focus analysis on observations over the remote Pacific Ocean, which is a region less perturbed by continental emissions than the Atlantic. Comparing aerosol size distribution measurements over the remote Pacific with box model simulations for 32 cases shows that none of the NPF schemes most commonly used in global models, including binary nucleation of sulfuric acid and water (neutral and ion-assisted) and ternary involving sulfuric acid, water, and ammonia, are consistent with observations, regardless of precursor concentrations. Through sensitivity studies, we find that the nucleation scheme among those tested that is able to explain most consistently (21 of 32 cases) the observed size distributions is that of Riccobono et al. (2014), which involves both organic species and sulfuric acid. The method of Dunne et al. (2016), involving charged sulfuric acid–water–ammonia nucleation, when coupled with organic growth of the nucleated particles, was most consistent with the observations for 5 of 32 cases. Similarly, the neutral sulfuric acid–water–ammonia method of Napari (2002), when scaled with a tuning factor and with organic growth added, was most consistent for 6 of 32 cases. We find that to best reproduce both nucleation and growth rates, the mixing ratios of gas-phase organic precursors generally need to be at least twice that of SO2, a proxy for dimethyl sulfide (DMS). Unfortunately, we have no information on the nature of oxidized organic species that participated in NPF in this region. Global models rarely include organic-driven nucleation and growth pathways in UT conditions where globally significant NPF takes place, which may result in poor estimates of NPF and CCN abundance and contribute to uncertainties in aerosol–cloud–radiation effects. Furthermore, our results indicate that the organic aerosol precursor vapors may be important in the tropical UT above marine regions, a finding that should guide future observational efforts.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Machine Learning Driven Sensitivity Analysis of E3SM Land Model Parameters for Wetland Methane Emissions

Methane (CH 4 ) is globally the second most critical greenhouse gas after carbon dioxide, contributing to 16%–25% of the observed atmospheric warming. Wetlands are the primary natural source of methane emissions globally. However, wetland methane emission estimates from biogeochemistry models contain considerable uncertainty. One of the main sources of this uncertainty arises from the numerous uncertain model parameters within various physical, biological, and chemical processes that influence methane production, oxidation, and transport. Sensitivity Analysis (SA) can help identify critical parameters for methane emission and achieve reduced biases and uncertainties in future projections. This study performs SA for 19 selected parameters responsible for critical biogeochemical processes in the methane module of the Energy Exascale Earth System Model (E3SM) land model (ELM). The impact of these parameters on various CH 4 fluxes is examined at 14 FLUXNET- CH 4 sites with diverse vegetation types. Given the extensive number of model simulations needed for global variance-based SA, we employ a machine learning (ML) algorithm to emulate the complex behavior of ELM methane biogeochemistry. We found that parameters linked to CH 4 production and diffusion generally present the highest sensitivities despite apparent seasonal variation. Comparing simulated emissions from perturbed parameter sets against FLUXNET-CH 4 observations revealed that better performances can be achieved at each site compared to the default parameter values. This presents a scope for further improving simulated emissions using parameter calibration with advanced optimization techniques.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Quantifying uncertainties due to optical potentials in one-neutron knockout reactions

One-neutron knockout reactions have been widely used to extract information about the single-particle structure of nuclei from the valley of stability to the drip lines. The interpretation of knockout data relies on reaction models, where the uncertainties are typically not accounted for. In this work, we quantify uncertainties of optical potentials used in these reaction models and propagate them, for the first time, to knockout observables using a Bayesian analysis. We study two reactions in the present paper, the first of which involves a loosely bound halo projectile, 11 Be, and the second a tightly bound projectile, 12 C. We first quantify the parametric uncertainties associated with phenomenological optical potentials. Complementing this approach, we also quantify the model uncertainties associated with the chiral forces that can be used to construct microscopic optical potentials. For the phenomenological study, we investigate the impact of the imaginary terms of the optical potential on the breakup and stripping components of the knockout cross sections as well as the impact of the angular range. For the 11 Be case, the theoretical uncertainty from the phenomenological method is on the order of the experimental uncertainty of the knockout observables; however, for the 12 C case, the theoretical uncertainty is significantly larger. Additionally, the widths of the uncertainty bands for the knockout observables obtained for the microscopic study and the phenomenological approach are of similar orders of magnitude. Based on this work we conclude that structure information inferred from the ratio of the knockout cross sections will carry a theoretical uncertainty of at least 20% for halo nuclei and at least 40% for tightly bound nuclei.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Bayesian Adaptive Polynomial Chaos Expansions

Polynomial chaos expansions (PCEs) are widely used for uncertainty quantification (UQ) tasks, particularly in the applied mathematics community. However, PCE has received comparatively less attention in the statistics literature, and fully Bayesian formulations remain rare—especially with implementations in R. Motivated by the success of adaptive Bayesian machine learning models such as BART, BASS and BPPR, we develop a new fully Bayesian adaptive PCE method with an efficient and accessible R implementation: khaos. Our approach includes a novel proposal distribution that enables data-driven interaction selection and supports a modified g-prior tailored to PCE structure. Through simulation studies and real-world UQ applications, we demonstrate that the Bayesian adaptive PCE provides competitive performance for surrogate modeling, global sensitivity analysis and ordinal regression tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Sensitivity study of parameters important to Molten Salt Reactor Safety

This paper presents a molten salt reactor (MSR) design parameter sensitivity study using a nodal dynamic modelling methodology with explicitly modified point kinetics equation and Mann’s model for heat transfer. Six parameters that can impact MSR safety are evaluated. A MATLAB-Simulink model inspired by Thorcon’s 550MW th MSR is used for parameter evaluations. A safety envelope was formed to encapsulate power, maximum and minimum temperature, and temperature-induced reactivity feedback. The parameters are perturbed by ±30%. The parameters were then ranked by their subsequent impact on the considered safety envelope, which ranks acceptable parameter uncertainty. The model is openly available on GitHub.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

A Primer on Dose-Response Data Modeling in Radiation Therapy

An overview of common approaches used to assess a dose response for radiation therapy–associated endpoints is presented, using lung toxicity data sets analyzed as a part of the High Dose per Fraction, Hypofractionated Treatment Effects in the Clinic effort as an example. Each component presented (eg, data-driven analysis, dose-response analysis, and calculating uncertainties on model prediction) is addressed using established approaches. Specifically, the maximum likelihood method was used to calculate best parameter values of the commonly used logistic model, the profile-likelihood to calculate confidence intervals on model parameters, and the likelihood ratio to determine whether the observed data fit is statistically significant. The bootstrap method was used to calculate confidence intervals for model predictions. Correlated behavior of model parameters and implication for interpreting dose response are discussed.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

Climate response to off-equatorial stratospheric sulfur injections in three Earth system models – Part 2: Stratospheric and free-tropospheric response

The paper constitutes Part 2 of a study performing a first systematic inter-model comparison of the atmospheric responses to stratospheric aerosol injection (SAI) at various single latitudes in the tropics, as simulated by three state-of-the-art Earth system models – CESM2-WACCM6, UKESM1.0, and GISS-E2.1-G. Building on Part 1 (Visioni et al., 2023) we demonstrate the role of biases in the climatological circulation and specific aspects of the model microphysics in driving the inter-model differences in the simulated sulfate distributions. We then characterize the simulated changes in stratospheric and free-tropospheric temperatures, ozone, water vapor, and large-scale circulation, elucidating the role of the above aspects in the surface SAI responses discussed in Part 1. We show that the differences in the aerosol spatial distribution can be explained by the significantly faster shallow branches of the Brewer–Dobson circulation in CESM2, a relatively isolated tropical pipe and older tropical age of air in UKESM, and smaller aerosol sizes and relatively stronger horizontal mixing (thus very young stratospheric age of air) in the two GISS versions used. We also find a large spread in the magnitudes of the tropical lower-stratospheric warming amongst the models, driven by microphysical, chemical, and dynamical differences. These lead to large differences in stratospheric water vapor responses, with significant increases in stratospheric water vapor under SAI in CESM2 and GISS that were largely not reproduced in UKESM. For ozone, good agreement was found in the tropical stratosphere amongst the models with more complex microphysics, with lower stratospheric ozone changes consistent with the SAI-induced modulation of the large-scale circulation and the resulting changes in transport. In contrast, we find a large inter-model spread in the Antarctic ozone responses that can largely be explained by the differences in the simulated latitudinal distributions of aerosols as well as the degree of implementation of heterogeneous halogen chemistry on sulfate in the models. The use of GISS runs with bulk microphysics demonstrates the importance of more detailed treatment of aerosol processes, with contrastingly different stratospheric SAI responses to the models using the two-moment aerosol treatment; however, some problems in halogen chemistry in GISS are also identified that require further attention. Overall, our results contribute to an increased understanding of the underlying physical mechanisms as well as identifying and narrowing the uncertainty in model projections of climate impacts from SAI.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Assessing the representation of the Australian carbon cycle in global vegetation models

Australia plays an important role in the global terrestrial carbon cycle on inter-annual timescales. While the Australian continent is included in global assessments of the carbon cycle such as the global carbon budget, the performance of dynamic global vegetation models (DGVMs) over Australia has rarely been evaluated. We assessed simulations of net biome production (NBP) and the carbon stored in vegetation between 1901 to 2018 from 13 DGVMs (TRENDY v8 ensemble). We focused our analysis on Australia's short-term (inter-annual) and long-term (decadal to centennial) terrestrial carbon dynamics. The TRENDY models simulated differing magnitudes of NBP on inter-annual timescales, and these differences resulted in significant differences in long-term vegetation carbon accumulation (–4.7 to 9.5 Pg C). We compared the TRENDY ensemble to several satellite-derived datasets and showed that the spread in the models' simulated carbon storage resulted from varying changes in carbon residence time rather than differences in net carbon uptake. Differences in simulated long-term accumulated NBP between models were mostly due to model responses to land-use change. The DGVMs also simulated different sensitivities to atmospheric carbon dioxide (CO 2 ) concentration, although notably, the models with nutrient cycles did not simulate the smallest NBP response to CO 2 . Our results suggest that a change in the climate forcing did not have a large impact on the carbon cycle on long timescales. However, the inter-annual variability in precipitation drives the year-to-year variability in NBP. We analysed the impact of key modes of climate variability, including the El Niño–Southern Oscillation (ENSO) and the Indian Ocean Dipole (IOD), on NBP. While the DGVMs agreed on sign of the response of NBP to El Niño and La Niña and to positive and negative IOD events, the magnitude of inter-annual variability in NBP differed strongly between models. In addition, we find that differences in the timing of simulated phenology and fire dynamics are associated with differences in simulated or prescribed vegetation cover and process representation. We further find model disagreement in simulated vegetation carbon, phenology, and apparent carbon residence time, indicating that the models have different types and coverage of vegetation across Australia (whether prescribed or emergent). Our study highlights the need to evaluate parameter assumptions and the key processes that drive vegetation dynamics, such as phenology, mortality, and fire, in an Australian context to reduce uncertainty across models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Incorporating geological structure into sensitivity analysis of subsurface contaminant transport

Simulating subsurface contaminant transport at the kilometer-scale often entails modeling reactive flow and transport within and through complex geologic structures. These structures are typically meshed by hand and as a result geologic structure is usually represented by one or a few deterministically generated geological models for uncertainty studies of flow and transport in the subsurface. Uncertainty in geologic structure can have a significant impact on contaminant transport. In this study, the impact of geologic structure on contaminant tracer transport in a shale formation is investigated for a simplified generic deep geologic repository for permanent disposal of spent nuclear fuel. An open-source modeling framework is used to perform a sensitivity analysis study on transport of two tracers from a generic spent nuclear fuel repository with uncertain location of the interfaces between the stratum of the geologic structure. The automated workflow uses sampled realizations of the geological structural model in addition to uncertain flow parameters in a nested sensitivity analysis. Concentration of the tracers at observation points within, in line with, and downstream of the repository are used as the quantities of interest for determining model sensitivity to input parameters and geological realization. Finally, the results of the study indicate that the location of strata interfaces in the geological structure has a first-order impact on tracer transport in the example shale formation, and that this impact may be greater than that of the uncertain flow parameters.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Evaluating integrated surface/subsurface permafrost thermal hydrology models in ATS (v0.88) against observations from a polygonal tundra site

Numerical simulations are essential tools for understanding the complex hydrologic response of Arctic regions to a warming climate. However, strong coupling among thermal and hydrological processes on the surface and in the subsurface and the significant role that subtle variations in surface topography have in regulating flow direction and surface storage lead to significant uncertainties. Careful model evaluation against field observations is thus important to build confidence.We evaluate the integrated surface/subsurface permafrost thermal hydrology models in the Advanced Terrestrial Simulator (ATS) against field observations from polygonal tundra at the Barrow Environmental Observatory. ATS couples a multiphase, 3D representation of subsurface thermal hydrology with representations of overland nonisothermal flows, snow processes, and surface energy balance. We simulated thermal hydrology of a 3D ice-wedge polygon with geometry that is abstracted but broadly consistent with the surface microtopography at our study site. The simulations were forced by meteorological data and observed water table elevations in ice-wedge polygon troughs. With limited calibration of parameters appearing in the soil evaporation model, the 3-year simulations agreed reasonably well with snow depth, summer water table elevations in the polygon center, and high-frequency soil temperature measurements at several depths in the trough, rim, and center of the polygon. Upscaled evaporation is in good agreement with flux tower observations. The simulations were found to be sensitive to parameters in the bare soil evaporation model, snowpack, and the lateral saturated hydraulic conductivity.Timing of fall freeze-up was found to be sensitive to initial snow density, illustrating the importance of including snow aging effects. The study provides new support for an emerging class of integrated surface/subsurface permafrost simulators.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Ground Heat Flux Reconstruction Using Bayesian Uncertainty Quantification Machinery and Surrogate Modeling

Ground heat flux (G 0 ) is a key component of the land-surface energy balance of high-latitude regions. Despite its crucial role in controlling permafrost degradation due to global warming, G 0 is sparsely measured and not well represented in the outputs of global scale model simulation. In this study, an analytical heat transfer model is tested to reconstruct G 0 across seasons using soil temperature series from field measurements, Global Climate Model, and climate reanalysis outputs. The probability density functions of ground heat flux and of model parameters are inferred using available G 0 data (measured or modeled) for snow-free period as a reference. When observed G 0 is not available, a numerical model is applied using estimates of surface heat flux (dependent on parameters) as the top boundary condition. These estimates (and thus the corresponding parameters) are verified by comparing the distributions of simulated and measured soil temperature at several depths. Aided by state-of-the-art uncertainty quantification methods, the developed G 0 reconstruction approach provides novel means for assessing the probabilistic structure of the ground heat flux for regional permafrost change studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Black hole spin in X-ray binaries: giving uncertainties an $\mathcal{f}$

The two established techniques for measuring black hole spin in X-ray binaries often yield conflicting results, which must be resolved before either method may be deemed robust. In practice, black hole spin measurements based on fitting the accretion disc continuum effectively do not marginalize over the colour-correction factor f col . This factor parametrizes spectral hardening of the disc continuum by the disc atmosphere, whose true properties are poorly constrained. We incorporate reasonable systematic uncertainties in f col into the eight (non-maximal) black hole spin measurements vetted by the disc continuum fitting community. In most cases, an f col uncertainty of ±0.2–0.3 dominates the black hole spin error budget. We go on to demonstrate that plausible departures in f col values from those adopted by the disc continuum fitting practitioners can bring the discrepant black hole spins into agreement with those from iron line modelling. Systematic uncertainties in f col , such as the effects of strong magnetization, should be better understood before dismissing their potentially dominant impact on the black hole spin error budget.

4U 1543–47↗
DOE OSTI2023

Clarifying trust of materials property predictions using neural networks with distribution-specific uncertainty quantification

It is critical that machine learning (ML) model predictions be trustworthy for high-throughput catalyst discovery approaches. Uncertainty quantification (UQ) methods allow estimation of the trustworthiness of an ML model, but these methods have not been well explored in the field of heterogeneous catalysis. Herein, we investigate different UQ methods applied to a crystal graph convolutional neural network to predict adsorption energies of molecules on alloys from the Open Catalyst 2020 dataset, the largest existing heterogeneous catalyst dataset. We apply three UQ methods to the adsorption energy predictions, namely k-fold ensembling, Monte Carlo dropout, and evidential regression. The effectiveness of each UQ method is assessed based on accuracy, sharpness, dispersion, calibration, and tightness. Evidential regression is demonstrated to be a powerful approach for rapidly obtaining tunable, competitively trustworthy UQ estimates for heterogeneous catalysis applications when using neural networks. Recalibration of model uncertainties is shown to be essential in practical screening applications of catalysts using uncertainties.

36 MATERIALS SCIENCE↗