Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Leveraging Multiple Raman Excitation Wavelength Systems for Process Monitoring of Nuclear Waste Streams

Processing nuclear waste from sites such as Hanford is a significant environmental cleanup need while being a significant logistical challenge. Integration of process monitoring tools, that can provide in situ and real-time feedback about the process, can significantly alleviate needs to collect grab samples for process control and product characterization. Raman spectroscopy paired with chemometric analysis is one process monitoring tool that can provide chemical composition information on a large number of chemical targets in nuclear waste streams. However, methods to improve limits of detection as well as drop uncertainty in quantification are needed. Optimizing instrument specifications can achieve this, here this is demonstrated by comparing limits of detection for key analytes when using Raman systems with 671 nm, 532 nm, and 405 nm excitation wavelengths. Generally, limits of detection decease (allowing the measurement of lower salt concentrations) with decreasing wavelength. Similarly, data collection times and averaging were optimized. Finally, multiple chemometric modeling approaches were leveraged, including multiblock methods that combined data from all three Raman systems to simultaneously quantify targets with improved sensitivity.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Multilevel Monte Carlo Predictions of First Passage Times in Three-Dimensional Discrete Fracture Networks: A Graph-Based Approach

In this paper, we present a method combining multilevel Monte Carlo (MLMC) and a graph-based primary subnetwork identification algorithm to provide estimates of the mean and variance of the distribution of first passage times in fracture media at significantly lower computational cost than standard Monte Carlo (MC) methods. Simulations of solute transport are performed using a discrete fracture network (DFN), and instead of using various grid resolutions for levels in the MLMC, which is standard practice in MLMC, we identify a hierarchy of subnetworks in the DFN based on the shortest topological paths through the network using a graph-based method. While the mean of these ensembles is of critical importance, the variance is also essential in fractured media where uncertainty is an overarching theme, and understanding variability across an ensemble is a requirement for safety assessments. The method provides good estimates of the mean and variance at two orders of magnitude lower computational cost than MC.

54 ENVIRONMENTAL SCIENCES↗

Utilizing Environmental Tracers to Reduce Groundwater Flow and Transport Model Parameter Uncertainties

Abstract Non‐uniqueness in groundwater model calibration is a primary source of uncertainty in groundwater flow and transport predictions. In this study, we investigate the ability of environmental tracer information to constrain groundwater model parameters. We utilize a pilot point calibration procedure conditioned to subsets of observed data including: liquid pressures, tritium ( 3 H), chlorofluorocarbon‐12 (CFC‐12), and sulfur hexafluoride (SF 6 ) concentrations; and groundwater apparent ages inferred from these environmental tracers, to quantify uncertainties in the heterogeneous permeability fields and infiltration rates of a steady‐state 2‐D synthetic aquifer and a transient 3‐D model of a field site located near Riverton, Wyoming (USA). To identify the relative data worth of each observation data type, the post‐calibration uncertainties of the optimal parameters for a given observation subset are compared to that from the full observation data set. Our results suggest that the calibration‐constrained permeability field uncertainties are largest when liquid pressures are used as the sole calibration data set. We find significant reduction in permeability uncertainty and increased predictive accuracy when the environmental tracer concentrations, rather than apparent groundwater ages, are used as calibration targets in the synthetic model. Calibration of the Riverton field site model using environmental tracer concentrations directly produces infiltration rate estimates with the lowest uncertainties, however; permeability field uncertainties remain similar between the environmental tracer concentration and apparent groundwater age calibration scenarios. This work provides insight on the data worth of environmental tracer information to calibrate groundwater models and highlights potential benefits of directly assimilating environmental tracer concentrations into model parameter estimation procedures.

54 ENVIRONMENTAL SCIENCES↗

Global Sensitivity Analysis Using the Ultra‐Low Resolution Energy Exascale Earth System Model

Abstract For decades, Arctic temperatures have increased twice as fast as average global temperatures. As a first step toward quantifying parametric uncertainty in Arctic climate, we performed a variance‐based global sensitivity analysis (GSA) using a fully coupled, ultra‐low resolution (ULR) configuration of version 1 of the U.S. Department of Energy's Energy Exascale Earth System Model (E3SMv1). Specifically, we quantified the sensitivity of six quantities of interests (QOIs), which characterize changes in Arctic climate over a 75 year period, to uncertainties in nine model parameters spanning the sea ice, atmosphere, and ocean components of E3SMv1. Sensitivity indices for each QOI were computed with a Gaussian process emulator using 139 random realizations of the random parameters and fixed preindustrial forcing. Uncertainties in the atmospheric parameters in the Cloud Layers Unified by Binormals (CLUBB) scheme were found to have the most impact on sea ice status and the larger Arctic climate. Our results demonstrate the importance of conducting sensitivity analyses with fully coupled climate models. The ULR configuration makes such studies computationally feasible today due to its low computational cost. When advances in computational power and modeling algorithms enable the tractable use of higher‐resolution models, our results will provide a baseline that can quantify the impact of model resolution on the accuracy of sensitivity indices. Moreover, the confidence intervals provided by our study, which we used to quantify the impact of the number of model evaluations on the accuracy of sensitivity estimates, have the potential to inform the computational resources needed for future sensitivity studies.

54 ENVIRONMENTAL SCIENCES↗

Future Atmospheric Rivers and Impacts on Precipitation: Overview of the ARTMIP Tier 2 High–Resolution Global Warming Experiment

Atmospheric rivers (ARs) are long, narrow synoptic scale weather features important for Earth’s hydrological cycle typically transporting water vapor poleward, delivering precipitation important for local climates. Understanding ARs in a warming climate is problematic because the AR response to climate change is tied to how the feature is defined. The Atmospheric River Tracking Method Intercomparison Project (ARTMIP) provides insights into this problem by comparing 16 atmospheric river detection tools (ARDTs) to a common data set consisting of high resolution climate change simulations from a global atmospheric general circulation model. ARDTs mostly show increases in frequency and intensity, but the scale of the response is largely dependent on algorithmic criteria. Across ARDTs, bulk characteristics suggest intensity and spatial footprint are inversely correlated, and most focus regions experience increases in precipitation volume coming from extreme ARs. The spread of the AR precipitation response under climate change is large and dependent on ARDT selection.

54 ENVIRONMENTAL SCIENCES↗

A Bayesian Deep Learning Approach to Near-Term Climate Prediction

Since model bias and associated initialization shock are serious shortcomings that reduce prediction skills in state-of-the-art decadal climate prediction efforts, we pursue a complementary machine-learning-based approach to climate prediction. The example problem setting we consider consists of predicting natural variability of the North Atlantic sea surface temperature on the interannual timescale in the pre-industrial control simulation of the Community Earth System Model. While previous works have considered the use of recurrent networks such as convolutional LSTMs and reservoir computing networks in this and other similar problem settings, we currently focus on the use of feedforward convolutional networks. In particular, we find that a feedforward convolutional network with a Densenet architecture is able to outperform a convolutional LSTM in terms of predictive skill. Next, we go on to consider a probabilistic formulation of the same network based on Stein variational gradient descent and find that in addition to providing useful measures of predictive uncertainty, the probabilistic (Bayesian) version improves on its deterministic counterpart in terms of predictive skill. Finally, we characterize the reliability of the ensemble of machine learning models obtained in the probabilistic setting by using analysis tools developed in the context of ensemble numerical weather prediction.

54 ENVIRONMENTAL SCIENCES↗

Quantifying Site Effects and Their Influence on Earthquake Source Parameter Estimations Using a Dense Array in Oklahoma

We investigate the effects of site response on source parameter estimates using earthquakes recorded by the LArge-n Seismic Survey in Oklahoma (LASSO). While it is well known that near-surface unconsolidated sediments can cause an apparent breakdown of earthquake self-similarity, the influence of laterally varying site conditions remains unclear. We analyze site conditions across the 1825-station array on a river plain within an area of 40 km by 23 km using vertical ground motions from 14 regional earthquakes. While the source radiation pattern controls P-wave ground motions below 8 Hz, the surface geology correlates with P-wave ground motions above 8 Hz and S-wave ground motions at 2–21 Hz. Stations installed in alluvial sediments have vertical ground motions that can exceed three times the array median. We use the variation of ground motion of regional earthquakes across the array as a proxy for site effects. The corner frequencies and stress drops of local earthquakes ( M L = 0.01–3) estimated using a standard single-spectra approach show negative correlations with the site-effect proxy, while the seismic moments show positive correlations. In contrast, the spectral-ratio approach effectively shows no correlation. The overall bias is small as expected for this relatively homogeneous structure; accurate estimation of site-related biases requires at least 30 stations. Correcting for site-related biases reduces the standard deviations of the source parameters by less than 13% of the total variations. Remaining variations are partially associated with source directivity and model misfits— as small earthquakes can have complex ruptures.

58 GEOSCIENCES↗

Sensitivity Analysis in the Presence of Intrinsic Stochasticity for Discrete Fracture Network Simulations

Abstract Large‐scale discrete fracture network (DFN) simulators are standard fare for studies involving the sub‐surface transport of particles since direct observation of real world underground fracture networks is generally infeasible. While these simulators have successfully been used in several engineering applications, estimates of output quantities of interest (QoI) — such as breakthrough time of particles reaching the edge of the system — suffer from two distinct types of uncertainty. A run of a DFN simulator requires several parameters to be set that dictate the placement and size of fractures, the density of fractures, and the overall permeability of the system; uncertainty on the proper parameters will lead to uncertainty in the QoI, called epistemic uncertainty. Furthermore, since these input settings to DFN simulators control the stochastic processes which place fractures and govern flow, understanding how this randomness affects the QoI requires several runs of the simulator at distinct random seeds. The uncertainty in the QoI attributed to different realizations (i.e., different seeds) of the same random process (i.e., identical input parameters) leads to a second type of uncertainty, called aleatoric uncertainty. In this paper, we perform a Sensitivity Analysis, which directly attributes the uncertainty observed in the QoI to the epistemic uncertainty from each input parameter and to the aleatoric uncertainty. Beyond the specific takeaways on which input variables influence uncertainty in the QoI the most, a major contribution of this paper is the introduction of a statistically rigorous workflow for characterizing the uncertainty in DFN flow simulations that exhibit heteroskedasticity.

58 GEOSCIENCES↗

Machine Learning Driven Sensitivity Analysis of E3SM Land Model Parameters for Wetland Methane Emissions

Methane (CH 4 ) is globally the second most critical greenhouse gas after carbon dioxide, contributing to 16%–25% of the observed atmospheric warming. Wetlands are the primary natural source of methane emissions globally. However, wetland methane emission estimates from biogeochemistry models contain considerable uncertainty. One of the main sources of this uncertainty arises from the numerous uncertain model parameters within various physical, biological, and chemical processes that influence methane production, oxidation, and transport. Sensitivity Analysis (SA) can help identify critical parameters for methane emission and achieve reduced biases and uncertainties in future projections. This study performs SA for 19 selected parameters responsible for critical biogeochemical processes in the methane module of the Energy Exascale Earth System Model (E3SM) land model (ELM). The impact of these parameters on various CH 4 fluxes is examined at 14 FLUXNET- CH 4 sites with diverse vegetation types. Given the extensive number of model simulations needed for global variance-based SA, we employ a machine learning (ML) algorithm to emulate the complex behavior of ELM methane biogeochemistry. We found that parameters linked to CH 4 production and diffusion generally present the highest sensitivities despite apparent seasonal variation. Comparing simulated emissions from perturbed parameter sets against FLUXNET-CH 4 observations revealed that better performances can be achieved at each site compared to the default parameter values. This presents a scope for further improving simulated emissions using parameter calibration with advanced optimization techniques.

54 ENVIRONMENTAL SCIENCES↗

Coupled Lake‐Atmosphere‐Land Physics Uncertainties in a Great Lakes Regional Climate Model

Abstract This study develops a surrogate‐based method to assess the uncertainty within a convective permitting integrated modeling system of the Great Lakes region, arising from interacting physics parameterizations across the lake, atmosphere, and land surface. Perturbed physics ensembles of the model during the 2018 summer are used to train a neural network surrogate model to predict lake surface temperature (LST) and near‐surface air temperature (T2m). Average physics uncertainties are determined to be 1.5C for LST and T2m over land, and 1.9C for T2m over lake, but these have significant spatiotemporal variations. We find that atmospheric physics parameterizations alone are the dominant sources of uncertainty (45%–53%), while lake and land parameterizations account for 33% and 38% of the uncertainty of LST and T2m over land respectively. Interactions of atmosphere physics parameterizations with those of the land and lake contribute to an additional 13%–17% of the total variance. LST and T2m over the lake are more uncertain in the deeper northern lakes, particularly during the rapid warming phase that occurs in late spring/early summer. The LST uncertainty increases with sensitivity to the lake model's surface wind stress scheme. T2m over land is more uncertain over forested areas in the north, where it is most sensitive to the land surface model, than the more agricultural land in the south, where it is most sensitive to the atmospheric planetary boundary and surface layer scheme. Uncertainty also increases in the southwest during multiday temperature declines with higher sensitivity to the land surface model.

54 ENVIRONMENTAL SCIENCES↗

Data-driven modeling of dislocation mobility from atomistics using physics-informed machine learning

Dislocation mobility, which dictates the response of dislocations to an applied stress, is a fundamental property of crystalline materials that governs the evolution of plastic deformation. Traditional approaches for deriving mobility laws rely on phenomenological models of the underlying physics, whose free parameters are in turn fitted to a small number of intuition-driven atomic scale simulations under varying conditions of temperature and stress. This tedious and time-consuming approach becomes particularly cumbersome for materials with complex dependencies on stress, temperature, and local environment, such as body-centered cubic crystals (BCC) metals and alloys. In this paper, we present a novel, uncertainty quantification-driven active learning paradigm for learning dislocation mobility laws from automated high-throughput large-scale molecular dynamics simulations, using Graph Neural Networks (GNN) with a physics-informed architecture. We demonstrate that this Physics-informed Graph Neural Network (PI-GNN) framework captures the underlying physics more accurately compared to existing phenomenological mobility laws in BCC metals.

36 MATERIALS SCIENCE↗

Bayesian calibration of irradiated graphite property models under high temperatures

Graphite under high temperatures and irradiation is central to advanced reactors. We develop a Bayesian calibration framework for graphite property models that explicitly represents model-data mismatch via a Gaussian-process discrepancy. The approach propagates uncertainty from parameters, experimental noise, and model form, with a hierarchical variance structure to capture group and cross-group noise. Using two predictive models across five grades (IG-110, NBG-18, PCEA, NBG-17, 2114) and four properties-irradiation-induced dimension change, creep, Young’s modulus change ratio, and coefficient of thermal expansion change ratio-we obtain average predictive-error reductions of 54%, 65%, 17%, and 17% when discrepancy is included. We illustrate engineering impact with a multiphysics model of a very-high-temperature reactor prismatic reflector brick, analyzing stresses under high fluence and temperature. Accounting for model discrepancy markedly improves predictive accuracy and provides a robust basis for reliable graphite component design in advanced reactors.

36 - MATERIALS SCIENCE↗

Spotlight: efficient automated global optimization in rietveld analysis of diffraction data

Performing reliable Rietveld analysis on tens or hundreds of powder diffraction datasets from parametric or time-resolved experiments often poses a bottleneck in extracting meaningful results from the data. While automated analysis of data has recently been demonstrated, high temperature annealing studies, during which phase transformations occur and lattice parameters may change due to repartitioning of elements, are prime examples where automation by a simple phase identification from a database of room temperature structures or automation by sequential refinements is likely to fail. To enable reliable, efficient, automated Rietveld analysis, we present a Python package named Spotlight , building on established Rietveld packages such as MAUD, GSAS , or GSAS-II , which extends the refinement of best fit parameters to a global optimization using an ensemble of optimizers leveraging hierarchical parallel execution on high-performance computing clusters. Spotlight further enables the efficient design of refinement plans through the iterative automated machine-learning of a surrogate for the refinement on which the global optimizations are performed until results from the surrogate converge to the response surface data. We demonstrate Spotlight with the analysis of uranium molybdenum and Ti–6Al–4V datasets, as well as in two open-source tutorials analyzing aluminium oxide and lead sulphate.

36 MATERIALS SCIENCE↗

Efficient online quantum circuit learning with no upfront training

Optimization is a promising candidate for studying the utility of variational quantum algorithms (VQAs). However, evaluating cost functions using quantum hardware introduces runtime overheads that limit exploration. Surrogate-based methods can reduce calls to a quantum computer, yet existing approaches require hyperparameter pre-training and have been tested only on small problems. Here, we show that surrogate-based methods can enable successful optimization at scale, without pre-training, by using radial basis function interpolation (RBF) to construct an adaptive, hyperparameter-free surrogate. Using the surrogate as an acquisition function drives hardware queries to the vicinity of the true optima. For 16-qubit random 3-regular Max-Cut instances with the Quantum Approximate Optimization Algorithm (QAOA), our method outperforms state-of-the-art approaches, without considering their upfront training costs. Furthermore, we successfully optimize QAOA circuits for 127-qubit random Ising models on an IBM processor using 10 4 −10 5 measurements. Strong empirical performance demonstrates the promise of automated surrogate-based learning for large-scale VQA applications.

97 MATHEMATICS AND COMPUTING↗

Effect of void positioning on the detonation sensitivity of a heterogeneous energetic material

We show although it is well-established that voids profoundly influence the initiation and reaction behaviors of heterogeneous energetic materials such as polymer-bonded explosives (PBX) and propellants, there has been little study of how void location in different constituents in the microstructures of such materials affect the macroscale behavior. Here, we use three-dimensional (3D) mesoscale simulations to study how void placement within the reactive grains versus the polymer binder influences the shock-to-detonation transition (SDT) in a polymer-bonded explosive. The material studied here has a microstructure comprised of 75% PETN (pentaerythritol tetranitrate) grains and 25% HTPB (hydroxyl-terminated polybutadiene) polymer binder by volume. Porosities up to 10% in the form of spherical voids distributed in both the grains and polymer are considered. An Arrhenius reactive burn relation is used to model the chemical kinetics of the PETN grains under shock loading, thereby resolving the heterogeneous detonation behavior of the PBX. The influence of void location on the shock initiation sensitivity of the material is quantitatively ranked by comparing the predicted run distance to detonation (RDD) for each sample. The analysis includes inherent quantification of uncertainties arising from the stochastic variations in the microstructure morphologies and void distributions by using statistically equivalent microstructure sample sets (SEMSS), leading to probabilistic formulations for the RDD as a function of shock pressure. The calculations reveal that the location of voids in the composite microstructure significantly affects the RDD. Specifically, voids exclusively within the grains cause the PBX to be more sensitive (having shorter RDD) than voids in the polymer binder. Unique probabilistic relationships are derived to map the probability of observing RDD for each void location material case, allowing for prediction of initiation behavior anywhere in the shock pressure – RDD space. These findings agree with trends reported in the literature.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Monte Carlo Perturbation Analysis of Fuel Temperature Variations in the MCNP Model of the Annular Core Research Reactor

The Annular Core Research Reactor (ACRR) Monte Carlo N-Particle (MCNP) model is used by ACRR reactor operators and experiment designers at Sandia National Laboratories for a variety of computational calculations ranging from reactor kinetics parameter estimates and safety analyses to experimental planning. To understand the dominant source of uncertainty within the MCNP model, perturbations in temperature were applied to individual ACRR MCNP fuel rods. Fuel rod temperatures were randomly sampled from a uniform distribution from operational temperatures to quantify temperature-related uncertainty effects. Stochastic mixing was used to blend the cross sections of the desired temperatures using the MCNP continuous and Thermal Neutron Scattering Treatment [S(α,β)] libraries in ENDF/B-VII.1. Furthermore, this uncertainty analysis produced a 640 row × 640 column correlation and covariance matrix of the neutron energy spectra. Positive covariance was produced around the 1-MeV region and the 0.2-eV region. Correlation was found in the thermal and fast energy regions, but no correlation was observed in the slowing-down energy region because interactions in this region are not dominated by fuel.

ACRR↗