Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Quantifying uncertainty in Pareto estimates of global lake area

This software contains the code for Bayesian uncertainty analysis of global lake area. Computed uncertainties are compared against more conventional estimation using lake size-abundance distributions. Routines are included to explore sensitivity to observational errors and ad-hoc "censoring" strategies.

Stachelek, Jemma↗
DOE OSTI2021

Particle image velocimetry analysis with simultaneous uncertainty quantification using Bayesian neural networks

Particle image velocimetry (PIV) is an effective tool in experimental fluid mechanics for extracting flow fields from images. Recently, convolutional neural networks (CNNs) have been used to perform PIV analysis with accuracy on par with classical methods. Here we extend the use of CNNs to analyze PIV data while providing simultaneous uncertainty quantification on the inferred flow field. The method we apply in this paper is a Bayesian convolutional neural network (BCNN) which learns distributions of the CNN weights through variational Bayes. In order to demonstrate the utility of BCNNs for the PIV task, we compare the performance of three distinct BCNN models with simple architectures. The first network estimates flow velocity from image interrogation regions only. Our second model learns to infer velocity from both the image interrogation regions and interrogation region cross-correlation maps. Finally, our best performing network infers velocities from interrogation region cross-correlation maps only. We find that BCNNs using interrogation region cross-correlation maps as inputs perform better than those using interrogation windows only as inputs and discuss reasons why this may be the case. Additionally, we test the best performing BCNN on a full synthetic test image pair and a real image pair from the 1st International PIV Challenge. We show that ~98% of true particle displacements from the full synthetic image pair can be captured within the BCNN's 95% confidence intervals, and that the BCNN's performance on the real image pair is quantitatively similar to that of algorithms tested in the 1st International PIV Challenge. Finally, we show that BCNNs can be generalized to be used with multi-pass PIV algorithms with a moderate loss in accuracy, which may be overcome by future work on finetuning and training schemes. So to our knowledge, this is the first use of Bayesian neural networks to perform PIV.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

PyApprox: A software package for sensitivity analysis, Bayesian inference, optimal experimental design, and multi-fidelity uncertainty quantification and surrogate modeling

PyApprox is a Python-based one-stop-shop for probabilistic analysis of numerical models such as those used in the earth, environmental and engineering sciences. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent a wide range of methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of new or existing algorithms for a wide range of model analyses. Here, this paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in groundwater.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Magnetostriction of α-RuCl 3 Flakes in the Zigzag Phase

Motivated by the possibility of enhanced magnetic fluctuations in exfoliated α-RuCl 3 flakes, we study magneto-Raman spectra of exfoliated multilayer α-RuCl 3 in out-of-plane magnetic fields of -6 to 6 T at temperatures of 670 mK to 4 K. While the literature currently suggests that bulk α-RuCl 3 is in an antiferromagnetic zigzag phase with R$\bar3$ symmetry at low temperatures, we do not observe R$\bar3$ symmetry in exfoliated α-RuCl 3 at low temperatures. While we saw no magnetic field-driven transitions, the Raman modes exhibit unexpected stochastic shifts in response to the applied magnetic field that are above the uncertainties inferred from Bayesian analysis. Finally, these stochastic shifts are consistent with the emergence of magnetostrictive interactions in exfoliated α-RuCl 3 .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

16 O Electroweak Response Functions from First Principles

We present calculations of various electroweak response functions for the 16 O nucleus obtained using coupled-cluster theory in conjunction with the Lorentz integral transform method. We employ nuclear forces derived at next-to-leading order and next-to-next-to-leading order in chiral effective field theory and perform a Bayesian analysis to assess uncertainties. Our results are in good agreement with available electron-scattering data at |𝐪|≈326 MeV/c. Additionally, we provide several predictions for the weak response functions in the quasielastic peak region at |𝐪| =300 and 400 MeV/c, which are critical for long-baseline neutrino experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

State of Stress Uncertainty Quantification and Geomechanical Risk Analysis for Subsurface Engineering

All subsurface stress measurement methods available for deep subsurface applications are indirect and involve a significant amount of uncertainty. Quantifying these uncertainties is critical for applications where the state of stress is a component of a risk analysis with significant safety, environmental, and economic considerations. A publicly available and open source tool called the State of Stress Analysis Tool (SOSAT) has been developed to aid in performing a Bayesian uncertainty quantification and geomechanical risk analysis using many types of commonly available data. A new feature of this tool is using data from the FutureGen 2.0 site. The new feature of the tool was uses information about the absence or presence of borehole breakouts to constrain the state of stress. This new feature allows the user to specify probability distributions for the relevant parameters such as the drilling mud pressure, temperature, and the formation strength properties. The tool computes the posterior joint probability distribution of the horizontal principal stresses. Using random samples from this posterior distribution the tool then computes the probability of activating a critically oriented fault at a range of pore pressures. This latter feature can be used to aid in the assessment of the risk of induced seismicity and leakage in geologic carbon sequestration and enhanced geothermal systems.

Burghardt, Jeffrey A.↗
DOE OSTI2023

Quantifying uncertainty in analysis of shockless dynamic compression experiments on platinum. II. Bayesian model calibration

Dynamic shockless compression experiments provide the ability to explore material behavior at extreme pressures but relatively low temperatures. Typically, the data from these types of experiments are interpreted through an analytic method called Lagrangian analysis. Here, in this work, alternative analysis methods are explored using modern statistical methods. Specifically, Bayesian model calibration is applied to a new set of platinum data shocklessly compressed to 570 GPa. Several platinum equation-of-state models are evaluated, including traditional parametric forms as well as a novel non-parametric model concept. The results are compared to those in Paper I obtained by inverse Lagrangian analysis. The comparisons suggest that Bayesian calibration is not only a viable framework for precise quantification of the compression path, but also reveals insights pertaining to trade-offs surrounding model form selection, sensitivities of the relevant experimental uncertainties, and assumptions and limitations within Lagrangian analysis. The non-parametric model method, in particular, is found to give precise unbiased results and is expected to be useful over a wide range of applications. The calibration results in estimates of the platinum principal isentrope over the full range of experimental pressures to a standard error of 1.6%, which extends the results from Paper I while maintaining the high precision required for the platinum pressure standard.

Brown, Justin Lee↗
DOE OSTI2024

Bayesian calibration and uncertainty quantification of a rate-dependent cohesive zone model for polymer interfaces

In this work we present a rate-dependent cohesive zone model for the fracture of polymeric interfaces and performs a Bayesian calibration, an uncertainty quantification, and a sensitivity analysis for the model. The proposed cohesive zone model accounts for both reversible elastic and irreversible rate-dependent separation sliding deformation at the interface. The viscous dissipation due to the irreversible opening at the interface is modeled using elastic-viscoplastic kinematics that incorporates the effects of strain rate. Inverse calibration of parameters for such complex models through trial and error is challenging due to the large number of parameters of the model. Moreover, the calibrated parameter values are often non-unique and uncertain when the available experimental data is limited. To tackle this challenge, we employ a Bayesian calibration approach to identify parameters from experimental data, the resulting parameters significantly enhance the accuracy of the model. To quantify the uncertainty associated with the inverse parameter estimation, a modular Bayesian approach is employed to calibrate the unknown model parameters, accounting for the parameter uncertainty of the cohesive zone model. The advantages of the Bayesian calibration over a deterministic parameter fit are demonstrated. Further, to quantify the model uncertainties, such as incorrect assumptions or missing physics, a discrepancy function is introduced, which significantly improves the model’s prediction. Finally, the total uncertainty of the model is quantified in a predictive setting. A sensitivity analysis is performed to assess how changes in the input variables of the model affect the peak load, facilitating the identification of a concise set of highly influential parameters. The present approach can be used for calibration and uncertainty quantification for other complex computational mechanics models. It should also facilitate the designing of interface materials under uncertainty.

42 ENGINEERING↗
DOE OSTI2025

A compact x-ray spectrometer for measurements of electron temperature distributions in inertial confinement fusion implosions at OMEGA

The Wedge Range Filter (WRF), commonly used for proton spectroscopy at the OMEGA Laser Facility and National Ignition Facility, is adapted to measure the x-ray continuum spectrum through transmission measurement using a continuous-gradient filter. Continuum x rays emitted from the hotspot of an implosion contain information about the plasma composition and electron temperature. The WRF data are leveraged to probe this distribution, specifically the electron temperature distribution. In this work, the data recorded with the WRF are forward modeled using a temperature distribution model folded with the WRF response function. An uncertainty analysis is conducted through a Bayesian regression algorithm using a Hamiltonian Monte Carlo sampler. This analysis enables the uncertainties in the instrument response to be folded into the uncertainty estimation of the electron temperature and absolute x-ray emission. Data analysis for a series of OMEGA implosions is presented and compared with radiation hydrodynamic simulations.

Lasers↗
DOE OSTI2022

PyApprox: Enabling efficient model analysis

PyApprox is a Python-based one-stop-shop for probabilistic analysis of scientific numerical models. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent the most popular methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. Simple interfaces are provided for the most commonly-used algorithms to limit a user’s need to tune the various hyper-parameters of each algorithm. However, more advanced work flows that require customization of hyper-parameters is also supported. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of different algorithms for a wide range of model analyses. This paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in ground water.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Quantifying heavy quark transport coefficients with an improved transport model

We report that the heavy-flavor transport coefficients contain important information on the strong interaction at finite temperatures. The extraction of these numbers from experimental data requires dynamical modeling of heavy-flavor transport that is coupled to realistic medium evolution. Furthermore, meaningful extractions necessitate both a faithful implementation of the physical inputs to be tested and the quantification of model uncertainty. For these purposes, we have developed a partonic transport model LIDO. It has an improved treatment of in-medium parton bremsstrahlung, which has been calibrated to theoretical calculations in a simple medium to reduce modeling uncertainty. Regarding the interaction between heavy quark and the medium, few-body perturbative scatterings are applied to large-momentum transfer (q) processes, while a diffusion equation models the dynamics of small-q processes. Such a separation restricts the explicit use of medium quasi-particles to large-q processes only. Another advantage is that deviations from the leading-order probe-medium coupling can be parametrized as an additional contribution to the diffusion constant. The heavy quark transport coefficients are then extracted with uncertainty estimation from a Bayesian analysis including both the RHIC and the LHC data. The results are found to be consistent with earlier extraction of the light-quark transport coefficients at high momentum and be comparable with lattice calculations of the heavy-flavor diffusion constant in the static limit at low momentum.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Performing Bayesian Analyses With AZURE2 Using BRICK: An Application to the 7 Be System

Phenomenological R-matrix has been a standard framework for the evaluation of resolved resonance cross section data in nuclear physics for many years. It is a powerful method for comparing different types of experimental nuclear data and combining the results of many different experimental measurements in order to gain a better estimation of the true underlying cross sections. Yet a practical challenge has always been the estimation of the uncertainty on both the cross sections at the energies of interest and the fit parameters, which can take the form of standard level parameters. Frequentist (χ 2 -based) estimation has been the norm. In this work, a Markov Chain Monte Carlo sampler, emcee, has been implemented for the R-matrix code AZURE2, creating the Bayesian R-matrix Inference Code Kit (BRICK). Bayesian uncertainty estimation has then been carried out for a simultaneous R-matrix fit of the 3 He (α,γ) 7 Be and 3 He (α,α) 3 He reactions in order to gain further insight into the fitting of capture and scattering data. Both data sets constrain the values of the bound state α-particle asymptotic normalization coefficients in 7 Be. The analysis highlights the need for low-energy scattering data with well-documented uncertainty information and shows how misleading results can be obtained in its absence.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Reliability Prediction using FMEA, FTA, and Related Techniques [Slides]

Summary: We presented a reliability analysis framework. We made point estimates of reliability using reliability block diagrams, fault trees, success trees and estimates with uncertainty using expert elicitation, Monte Carlo simulation, Bayesian analysis. Expert elicitation of failure modes and probabilities is labor-intensive, but critical. Bayesian analysis updates information from expert elicitation with data from reliability and aging tests (aging/compatibility data are needed to estimate lower-bound reliabilities at end of life). Estimation by more than one method helps insure consistency and accuracy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

16 O ⁡(𝑒,𝑒′⁢𝛼)⁢ 12 C measurements and the 12 C ⁡(𝛼,𝛾)⁢ 16 O astrophysical reaction rate

The 12 C ⁡(𝛼,𝛾)⁢ 16 O reaction, an important component of stellar helium burning, has a key role in nuclear astrophysics. It has significant impact on the evolution and final state of heavy to low mass stars, maximum mass of stellar formed black holes and also shapes the elemental abundances resulting from nucleosynthesis in such stars. Providing a reliable estimate for the energy dependence of this reaction at stellar helium burning temperatures has been a longstanding and important goal. In this work, we study the role of potential new 𝐸⁢1 and 𝐸⁢2 measurements of the 16 O ⁡(𝑒,𝑒′⁢𝛼)⁢ 12 C reaction in reducing the overall uncertainty in the astrophysical 𝑆 factor for the 12 C ⁡(𝛼,𝛾)⁢ 16 O 𝐸⁢1 and 𝐸⁢2 ground state capture extrapolated to a stellar energy of 300 keV. A multilevel 𝑅-matrix analysis is used to make extrapolations of the 𝑆 𝐸⁢1 (300 keV) and 𝑆 𝐸⁢2 (300 keV) factors for the 12 C ⁡(𝛼,𝛾)⁢ 16 O reaction from existing ground state capture data. Bayesian analysis is used to quantify the uncertainties in the extrapolations for both the existing data alone and also when possible new experimental data are included. In particular, we consider a new experiment that would make use of a high-intensity low-energy electron beam that impinges on a windowless oxygen gas target as a means to determine the total 𝐸⁢1 and 𝐸⁢2 ground state cross sections for this reaction. Here we find that the new data could significantly reduce the 𝑆⁡(300) uncertainties. Splitting the new data into high and low energy regions shows that both low and high energy data are effective in reducing the uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗