Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Methodology for Generating Covariance Data of Thermal Neutron Scattering Cross Sections

This paper details and implements a framework for evaluating thermal neutron scattering cross sections that provide S(α,β) data and covariance data for hydrogen in light water. This methodology involves perturbing model parameters of molecular dynamics potentials and fitting the simulation results to experimental data. The framework is general and can be applied to any material or simulation method. The fit is made using the Unified Monte Carlo method to experimentally measure double-differential scattering cross sections of light water at the Spallation Neutron Source at Oak Ridge National Laboratory. Mean values and covariance data were generated for model parameters, phonon density of states, double-differential cross sections, and total scattering cross sections. These posterior parameter values were very similar to their prior values with a maximum relative error of 0.54%. This falls within in the Unified Monte Carlo–calculated uncertainties on the order of 2.7%. Additionally, posterior double-differential cross sections agree favorably with ENDF/B-VIII.0 cross sections. The new thermal scattering law was tested by comparing it against benchmarks from the International Criticality Safety Benchmark Evaluation Project Handbook, which showed a slight improvement over the ENDF/B-VIII.0 library. Additionally, the covariance matrix of the phonon density of states was validated to confirm that the spread of k eff from the density of states used to generate the covariance matrix was similar to the spread of k eff from the density of states of the sampled covariance matrix.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Comparative Analysis of Standard and Advanced USL Methodologies for Nuclear Criticality Safety

The American National Standards Institute/American Nuclear Society national standards 8.1 and 8.24 provide guidance on the requirements and recommendations for establishing confidence in the results of the computerized models used to support operation with fissionable materials. By design, the guidance is not prescriptive, leaving freedom to the analysts to determine how the various sources of uncertainties are to be statistically aggregated. Due to the involved use of statistics entangled with heuristic recipes, the resulting safety margins are often difficult to interpret. Also, these technical margins are augmented by additional administrative margins, which are required to ensure compliance with safety standards or regulations, eliminating the incentive to understand their differences. With the new resurgent wave of advanced nuclear systems, e.g., advanced reactors, fuel cycles, and fuel concepts, focused on economizing operation, there is a strong need to develop a clear understanding of the uncertainties and their consolidation methods to reduce them in manners that can be scientifically defended. In response, the current studies compare the analyses behind four notable methodologies for upper subcriticality limit estimation that have been documented in the nuclear criticality safety literature: the parametric, nonparametric, Whisper, and TSURFER methodologies. Specifically, the work offers a deep dive into the various assumptions of the noted methodologies, their adequacies, and their limitations to provide guidance on developing confidence for the emergent nuclear systems that are expected to be challenged by the scarcity of experimental data. Here, to limit the scope, the current work focuses on the application of these methodologies to criticality safety experiments, where the goal is to calculate a bias, a bias uncertainty, and a tolerance limit for k eff in support of determining an upper subcriticality limit for nuclear criticality safety.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2023

Sequential Bayesian Experimental Design for Calibration of Expensive Simulation Models

Simulation models of critical systems often have parameters that need to be calibrated using observed data. For expensive simulation models, calibration is done using an emulator of the simulation model built on simulation output at different parameter settings. Using intelligent and adaptive selection of parameters to build the emulator can drastically improve the efficiency of the calibration process. The article proposes a sequential framework with a novel criterion for parameter selection that targets learning the posterior density of the parameters. The emergent behavior from this criterion is that exploration happens by selecting parameters in uncertain posterior regions while simultaneously exploitation happens by selecting parameters in regions of high posterior density. Furthermore, the advantages of the proposed method are illustrated using several simulation experiments and a nuclear physics reaction model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Bayesian characterization of uncertainties surrounding fluvial flood hazard estimates

Fluvial floods drive severe risk to riverine communities. There is strong evidence of increasing flood hazards in many regions around the world. The choice of methods and assumptions used in flood hazard estimates can impact the design of risk management strategies. In this study, we characterize the expected flood hazards conditioned on the uncertain model structures, model parameters, and prior distributions of the parameters. We construct a Bayesian framework for river stage return level estimation using a nonstationary statistical model that relies exclusively on the Indian Ocean Dipole Index. We show that ignoring uncertainties can lead to biased estimation of expected flood hazards. We find that the considered model parametric uncertainty is more influential than model structures and model priors. Our results highlight the importance of incorporating uncertainty in extreme flood stage estimates, and are of practical use for informing water infrastructure designs in a changing climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Bounding uncertainty in functional data: A case study

Functional data are fast becoming a preeminent source of information across a wide range of industries. A particularly challenging aspect of functional data is bounding uncertainty. In this unique case study, we present our attempts at creating bounding functions for selected applications at Sandia National Laboratories (SNL). The first attempt involved a simple extension of functional principal component analysis (fPCA) to incorporate covariates. Though this method was straightforward, the extension was plagued by poor coverage accuracy for the bounding curve. This led to a second attempt utilizing elastic methodology which yielded more accurate coverage at the cost of more complexity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Sequential Learning of Active Subspaces

This study shows that in recent years, active subspace methods (ASMs) have become a popular means of performing subspace sensitivity analysis on black-box functions. Naively applied, however, ASMs require gradient evaluations of the target function. In the event of noisy, expensive, or stochastic simulators, evaluating gradients via finite differencing may be infeasible. In such cases, often a surrogate model is employed, on which finite differencing is performed. When the surrogate model is a Gaussian process (GP), we show that the ASM estimator is available in closed form, rendering the finite-difference approximation unnecessary. We use our closed-form solution to develop acquisition functions focused on sequential learning tailored to sensitivity analysis on top of ASMs. We also show that the traditional ASM estimator may be viewed as a method of moments estimator for a certain class of GPs. We demonstrate how uncertainty on GP hyperparameters may be propagated to uncertainty on the sensitivity analysis, allowing model-based confidence intervals on the active subspace. Our methodological developments are illustrated on several examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

An open source analysis framework for large-scale building energy modeling

Full integration of building energy modelling into the design and retrofit process has long been a goal of building scientists and practitioners. However, significant barriers still exist. Among them are the lack of available: (1) configurable technology stacks for performing both small- and large-scale analyses, (2) different classes of algorithms compatible with common design workflows, and (3) analysis tools for effectively visualizing large-scale simulation results. This article discusses the OpenStudio® Analysis Framework: a scalable analysis framework for building energy modelling that was developed to overcome the three barriers listed above. The framework is open-source and scalable to facilitate wider adoption and has a clearly defined application programming interface upon which other applications can be built. It runs on high-performance computing systems, within cloud infrastructure, and on laptops, and uses a common workflow to enable different classes of algorithms. Lessons learned from previous development efforts are also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Data-Consistent Inversion for Stochastic Input-to-Output Maps

Data-consistent inversion is a recently developed measure-theoretic framework for solving a stochastic inverse problem involving models of physical systems. The goal is to construct a probability measure on model inputs (i.e., parameters of interest) whose associated push-forward measure matches (i.e., is consistent with) a probability measure on the observable outputs of the model (i.e., quantities of interest). Previous implementations required the map from parameters of interest to quantities of interest to be deterministic. This work generalizes this framework for maps that are stochastic, i.e., contain uncertainties and variation not explainable by variations in uncertain parameters of interest. Generalizations of previous theorems of existence, uniqueness, and stability of the data-consistent solution are provided while new theoretical results address the stability of marginals on parameters of interest. A notable aspect of the algorithmic generalization is the ability to query the solution to generate independent identically distributed samples of the parameters of interest without requiring knowledge of the so-called stochastic parameters. This work therefore extends the applicability of the data-consistent inversion framework to a much wider class of problems. This includes those based on purely experimental and field data where only a subset of conditions are either controllable or can be documented between experiments while the underlying physics, measurement errors, and any additional covariates are either uncertain or not accounted for by the researcher. Finally, numerical examples demonstrate application of this approach to systems with stochastic sources of uncertainties embedded within the modeling of a system and a numerical diagnostic is summarized that is useful for determining if a key assumption is verified among competing choices of stochastic maps.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

S -factor and scattering-parameter extractions from ${}^{3}\mathrm{He}+{}^{4}\mathrm{He}{ \rightarrow }^{7}\mathrm{Be}+\gamma $

Previous studies of the reaction ${}^{3}\mathrm{He}+{}^{4}\mathrm{He}\to {}^{7}\mathrm{Be}+\gamma $ have mainly focused on providing the best central value and error bar for the S factor at solar energies. Experimental measurements of this capture reaction at higher energies, the ${}^{3}\mathrm{He}$–${}^{4}\mathrm{He}$ scattering phase shifts, as well as properties of ${}^{7}\mathrm{Be}$ and its excited state, have been used to constrain the theoretical models employed for this purpose. Here we show that much more information than was previously appreciated can be extracted from angle-integrated capture data alone. We use the next-to-leading-order (NLO) amplitude in an effective field theory (EFT) for ${}^{3}\mathrm{He}+{}^{4}\mathrm{He}\to {}^{7}\mathrm{Be}+\gamma $ to perform the extrapolation. At this order the EFT describes the capture process using an s-wave scattering length and effective range, the asymptotic properties of ${}^{7}\mathrm{Be}$ and its excited state, and short-distance contributions to the E1 capture amplitude. We extract the multi-dimensional posterior of all these parameters via a Bayesian analysis that uses capture data below 2 MeV. We find that properties of the ${}^{7}\mathrm{Be}$ ground and excited states are well constrained. The total S factor $S(0)\,={0.577}_{-0.016}^{+0.015}$ keV b, while the branching ratio for excited- to ground-state capture at zero energy, ${Br}(0)={0.406}_{-0.011}^{+0.013}$, both at 68% degree of belief. This S(0) is broadly consistent with other recent evaluations, and agrees with the previously recommended value $S(0)=0.56\pm 0.03\,\,\mathrm{keV}$ b, but has a smaller error bar. We also find significant constraints on ${}^{3}\mathrm{He}$–${}^{4}\mathrm{He}$ scattering parameters, and we obtain constraints on the angular distribution of capture gamma rays, which is important for interpreting experiments. The path forward for this reaction seems to lie with better measurements of the scattering phase shifts and S(E)'s angular dependence away from zero energy, together with better understanding of the asymptotic normalization coefficients of the ${}^{7}$Be bound states' wave functions. Lastly, data on these could further reduce the uncertainty on S(0).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Quantifying uncertainties on fission fragment mass yields with mixture density networks

Probabilistic machine learning techniques can learn both complex relations between input features and output quantities of interest as well as take into account stochasticity or uncertainty within a data set. In this initial work, we explore the use of one such probabilistic network, the mixture density network (MDN), to reproduce fission yields and their uncertainties. In this paper, we study mass yields for the spontaneous fission of 252 Cf, exploring the number of training samples needed for converged predictions, how different levels of uncertainty propagate from the training set to the MDN predictions, and how well physical constraints of the yields—such as normalization and symmetry—are upheld by the algorithm. Finally, we test the ability of the MDN to interpolate between and extrapolate beyond samples in the training set using energy-dependent mass yields for the neutron-induced fission on 235 U. The MDN provides a reliable way to include and predict uncertainties and is a promising path forward for supplementing sparse sets of nuclear data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Get on the BAND Wagon: a Bayesian framework for quantifying model uncertainties in nuclear dynamics

In this paper, we describe the Bayesian Analysis of Nuclear Dynamics (BAND) framework, a cyberinfrastructure that we are developing which will unify the treatment of nuclear models, experimental data, and associated uncertainties. We overview the statistical principles and nuclear-physics contexts underlying the BAND toolset, with an emphasis on Bayesian methodology's ability to leverage insight from multiple models. In order to facilitate understanding of these tools we provide a simple and accessible example of the BAND framework's application. Four case studies are presented to highlight how elements of the framework will enable progress on complex, far-ranging problems in nuclear physics. By collecting notation and terminology, providing illustrative examples, and giving an overview of the associated techniques, this paper aims to open paths through which the nuclear physics and statistics communities can contribute to and build upon the BAND framework.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Revisiting proton–proton fusion in chiral effective field theory

We calculate the S-factor for proton–proton fusion using chiral effective field theory interactions and currents. By performing order-by-order calculations with a variety of chiral interactions that are regularized and calibrated in different ways, we assess the uncertainty in the S-factor from the truncation of the effective field theory expansion and from the sensitivity of the S-factor to the short-distance axial current determined from three- and four-nucleon observables. We find that S(0) = (4.100 ± 0.024(syst) ± 0.013(stat) ± 0.008(g$_{A}$)) × 10$^{−23}$ MeV fm$^{2}$, where the three uncertainties arise, respectively, from the truncation of the effective field theory expansion, use of the two-nucleon axial current fit to few-nucleon observables and variation of the axial coupling constant within the recommended range. The increased value of S(0) compared to previous calculations is mainly driven by an increase in the recommended value for the axial coupling constant and is in agreement with a recent analysis based on pionless effective field theory.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Variational inference of effective range parameters for 3 He− 4 He scattering

We use two different methods, Monte Carlo sampling and variational inference (VI), to perform a Bayesian calibration of the effective-range parameters in 3 He– 4 He elastic scattering. The parameters are calibrated to data from a recent set of 3 He– 4 He elastic scattering differential cross section measurements. Analysis of these data for E lab ≤ 4.3 MeV yields a unimodal posterior for which both methods obtain the same structure. However, the effective-range expansion amplitude does not account for the 7/2 − state of 7 Be so, even after calibration, the description of data at the upper end of this energy range is poor. The data up to E lab = 2.6 MeV can be well described, but calibration to this lower-energy subset of the data yields a bimodal posterior. After adapting VI to treat such a multi-modal posterior we find good agreement between the VI results and those obtained with parallel-tempered Monte Carlo sampling.

effective field theory↗
DOE OSTI2026

Connecting ground-state properties of 6 Li to each other and to scattering data

We examine the relationship between the asymptotic normalization coefficient (ANC) of 6 Li and other low-energy observables in the α–deuteron system. Our analysis uses a set of calculations carried out within the ab initio no core shell model with continuum (NCSMC) using a variety of inter-nucleon interactions and basis sizes, and yielding 6 Li deuteron separation energies between 1.3 and 1.8 MeV (Hebborn et al 2022 Phys. Rev. Lett. 129 042503). These NCSMC calculations show that the square of the ANC is strongly correlated with the separation energy over this range. In this work, we investigate the origin of this correlation using the phenomenological R-matrix, a single-channel potential and a perturbative approach. We show that this correlation occurs because the depth of the α–deuteron central potential changes by only a small relative amount as the separation energy varies. We then investigate if the ANC can be accurately extracted from α–deuteron phase shifts in an ideal case in which low-energy data are available and there are no experimental errors. We find that both R-matrix and Coulomb-modified effective-range theory (CM-ERE) yield extracted ANCs close to, although not exactly equal to, the NCSMC value, provided the extrapolation is constrained by the known position of the bound-state pole and at least three terms are included in the fit function. The R-matrix approach converges faster than the CM-ERE as the number of parameters increases and is also more robust against the inclusion of low-energy and high-energy phase shift data. Finally, our study also shows that a naive quantification of uncertainties by comparing different truncations used in both theories is not accurate, and suggests the accuracy of ANCs extracted from phase shift data needs further investigation.

R-matrix↗
DOE OSTI2024

Using intrusive approaches as a step towards accounting for stochasticity in wind turbine design

Current wind turbine design methods require tens of thousands of time-domain simulations and use different random seeds to account for the stochasticity of the environmental conditions. The account of stochasticity is nonintrusive because the sampling method calls a deterministic model multiple times without changing its underlying equations. In this work, we investigate and demonstrate using simple proof of concepts how intrusive approaches can be used to directly account for stochasticity in the equations representing a mechanical system. Our long term goal is to apply such methodology to the design of wind turbines without requiring an excessive number of simulations. Intrusive methods manipulate stochastic variables directly to provide the probability density functions (PDFs) of the states and outputs at any time as functions of the PDFs of the inputs. We illustrate how different methods can be used with a reduced-order model of a wind turbine with one degree of freedom and for linear and nonlinear models. We discuss how the methods can be extended and what it will take to apply them to a level of fidelity similar to current state-of-the-art wind turbine design tools.

17 WIND ENERGY↗
DOE OSTI2024

Distance preserving machine learning for uncertainty aware accelerator capacitance predictions

Abstract Accurate uncertainty estimations are essential for producing reliable machine learning models, especially in safety-critical applications such as accelerator systems. Gaussian process models are generally regarded as the gold standard for this task; however, they can struggle with large, high-dimensional datasets. Combining deep neural networks with Gaussian process approximation techniques has shown promising results, but dimensionality reduction through standard deep neural network layers is not guaranteed to maintain the distance information necessary for Gaussian process models. We build on previous work by comparing the use of the singular value decomposition against a spectral-normalized dense layer as a feature extractor for a deep neural Gaussian process approximation model and apply it to a capacitance prediction problem for the High Voltage Converter Modulators in the Oak Ridge Spallation Neutron Source. Our model shows improved distance preservation and predicts in-distribution capacitance values with less than 1% error.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Discriminative versus generative approaches to simulation-based inference

Most of the fundamental, emergent, and phenomenological parameters of particle and nuclear physics are determined through parametric template fits. Simulations are used to populate histograms which are then matched to data. This approach is inherently lossy, since histograms are binned and low-dimensional. Deep learning has enabled unbinned and high-dimensional parameter estimation through neural likelihood(-ratio) estimation. We compare two approaches for neural simulation-based inference (NSBI): one based on discriminative learning (classification) and one based on generative modeling. These two approaches are directly evaluated on the same datasets, with a similar level of hyperparameter optimization in both cases. In addition to a Gaussian dataset, we study NSBI using a Higgs boson dataset from the FAIR Universe Challenge. We find that both the direct likelihood and likelihood ratio estimation are able to effectively extract parameters with reasonable uncertainties. For the numerical examples and within the set of hyperparameters studied, we found that the likelihood ratio method is more accurate and/or precise. Both methods have a significant spread from the network training and would require ensembling or other mitigation strategies in practice.

high energy physics↗