Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “bayesian inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Differentiable Hydrology Approach for Modeling With Time-Varying Parameters

In the analysis of observational data with mathematical models, it is often desirable to let one or more model parameters vary with time to account for changing environmental conditions or to offer more flexibility. A standard approach for dynamic models is to allow for the number of parameters to grow as a function of time, leading to a high-dimensional inference problem for long data records. We propose using Hamiltonian Monte Carlo, a gradient-based Markov chain Monte Carlo (MCMC) method, to perform Bayesian inference for time-varying parameters (TVP) in hydrology models. As derivatives of model error functions with regard to parameters are not available in closed form, we implemented the GR4J rainfall-runoff models in Theano/PyMC3, and Jax/NumPyro, allowing for the application of automatic differentiation techniques. A simulation experiment assessing the viability of these methods for recovering underlying temporal variation in parameters indicates that a discrete Gaussian random walk-based prior appears to be best suited across a range of scenarios while the continuous-time Gaussian process compares relatively poorly. In an analysis of 20 years of daily real-world streamflow records from the Model Parameter Estimation Experiment (MOPEX) hydrology data set with increasing data sparsity and at multiple temporal resolutions, we find that TVP inference with gradient-based MCMC is a flexible and reliable approach for analyzing hydrology models with dynamic parameter sets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Calibration verification for stochastic agent-based disease spread models

Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Scalable Algorithms for Inverse Problems With High-Dimensional Parameter Spaces

Inverse problems, which involve inferring unknown parameters from observed data, present significant computational challenges, especially in large-scale settings with high-dimensional unknown parameters and nonlinear relationships between the unknowns and observations. Bayesian inference provides an approach for addressing these problems, often relying on sequential sampling methods like Markov chain Monte Carlo (MCMC) to approximate the posterior distribution of the parameters. However, MCMC methods become computationally demanding as the dimensionality of the problem increases, particularly in large-scale systems where likelihood evaluations rely on solving partial differential equations (PDEs) on large spatial domains with finely resolved meshes. To overcome these limitations, recent advancements have focused on designing scalable computa tional techniques – for both PDE simulations and sampling strategies – to make Bayesian methods feasible for high-dimensional problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Wolf-Rayet Galaxies in SDSS-IV MaNGA. II. Metallicity Dependence of the High-mass Slope of the Stellar Initial Mass Function

As hosts of living high-mass stars, Wolf-Rayet (WR) regions or WR galaxies are ideal objects for constraining the high-mass end of the stellar initial mass function (IMF). We construct a large sample of 910 WR galaxies/regions that cover a wide range of stellar metallicity (from Z ~ 0.001 to 0.03) by combining three catalogs of WR galaxies/regions previously selected from the SDSS and SDSS-IV/MaNGA surveys. We measure the equivalent widths of the WR blue bump at ~4650 Å for each spectrum. They are compared with predictions from stellar evolutionary models Starburst99 and BPASS, with different IMF assumptions (high-mass slope α of the IMF ranging from 1.0 to 3.3). Both singular evolution and binary evolution are considered. We also use a Bayesian inference code to perform full spectral fitting to WR spectra with stellar population spectra from BPASS as fitting templates. We then make a model selection among different α assumptions based on Bayesian evidence. These analyses have consistently led to a positive correlation of the IMF high-mass slope α with stellar metallicity Z, i.e., with a steeper IMF (more bottom-heavy) at higher metallicities. Specifically, an IMF with α = 1.00 is preferred at the lowest metallicity (Z ~ 0.001), and an Salpeter or even steeper IMF is preferred at the highest metallicity (Z ~ 0.03). These conclusions hold even when binary population models are adopted.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

A deep learning approach to fast analysis of collective Thomson scattering spectra

Fast analysis of collective Thomson scattering ion acoustic wave features using a deep convolutional neural network model is presented. The network was trained from spectra to predict the plasma parameters, including ion velocities, population fractions, and ion and electron temperatures. A fully kinetic particle-in-cell simulation was used to model a laboratory astrophysics experiment and simulate a diagnostic image of the ion acoustic wave feature. Network predictions were compared with Bayesian inference of the plasma model parameters for both the simulated and experimentally measured images. Both approaches were fairly accurate predicting the simulated image and the network predictions matched a good portion of the Bayesian results for the experimentally measured image. The Bayesian approach is more robust to noise and motivates future work to train deep learning models with realistic noise. The advantage of the deep learning model is making thousands of predictions in a few hundred milliseconds, compared to a few seconds to minutes per prediction for the optimization and Bayesian approaches presented here. The results demonstrate promising capabilities of deep learning models to analyze Thomson data orders of magnitude faster than conventional methods when using the neural network for standalone analysis. If more rigorous analysis is needed, neural network predictions can be used to quickly initialize other optimization methods and increase chances of success. This is especially useful when the dataset becomes very large or highly dimensional and manually refining initial conditions for the entire dataset are no longer tractable.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Leveraging differentiable programming in the inverse problem of neutron stars

Neutron stars (NSs) probe the high-density regime of the nuclear equation of state (EOS). However, inferring the EOS from observations of NSs is a computationally challenging task. Here, in this work, we efficiently solve this inverse problem by leveraging differential programming in two ways. First, we enable full Bayesian inference in under one hour of wall time on a GPU by using gradient-based samplers, without requiring pretrained machine learning emulators. Moreover, we demonstrate efficient scaling to high-dimensional parameter spaces. Second, we introduce a novel gradient-based optimization scheme that recovers the EOS of a given NS mass-radius curve. We demonstrate how our framework can reveal consistencies or tensions between nuclear physics and astrophysics. First, we show how the breakdown density of a metamodel description of the EOS can be determined from NS observations. Second, we demonstrate how degeneracies in EOS modeling using nuclear empirical parameters can influence the inverse problem during gradient-based optimization. Looking ahead, our approach opens up new theoretical studies of the relation between NS properties and the EOS, while effectively tackling the data analysis challenges brought by future detectors.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Robust Statistical Approach for Determination of Graphite Nitridation Using Bayesian Model Comparison

A better estimation of surface reaction efficiency of semiconductor-grade graphite with atomic nitrogen, as well as the calibration error are calculated using Bayesian updating based on experimental data. Compared with a conventional deterministic model, the stochastic model approach is a powerful tool in the sense that the model is capable of taking into account underlying error correlations among the data quantities. In this paper, we investigate four different stochastic models (called “stochastic system model classes” herein) corresponding to different descriptions of modeling and measurement error structures, given one deterministic physical model. These stochastic system model classes differ in the covariance matrix structure that is used in the uncertainty model to represent uncertainties associated with the physical model and experimental measurements. For each model class, Bayesian inference is used to estimate the posterior probabilities of the physical model parameters as well as of the stochastic model parameters. Model comparison and selection are then applied based on two measures including Bayesian evidence and Bayesian information criterion, as well as the deviance information criterion. Both measures suggest the stochastic model class, which considers that a correlation between errors in two data quantities among different data points is the most plausible. With the stochastic model class, the range of uncertainty in surface reaction efficiency is estimated to be about two orders of magnitude at [Formula: see text].

Engineering↗
DOE OSTI2023

Understanding capacity fade in organic redox-flow batteries by combining spectroscopy with statistical inference techniques

Organic redox-active molecules are attractive as redox-flow battery (RFB) reactants because of their low anticipated costs and widely tunable properties. Unfortunately, many lab-scale flow cells experience rapid material degradation (from chemical and electrochemical decay mechanisms) and capacity fade during cycling (>0.1%/day) hindering their commercial deployment. In this work, we combine ultraviolet-visible spectrophotometry and statistical inference techniques to elucidate the Michael attack decay mechanism for 4,5-dihydroxy-1,3-benzenedisulfonic acid (BQDS), a once-promising positive electrolyte reactant for aqueous organic redox-flow batteries. We use Bayesian inference and multivariate curve resolution on the spectroscopic data to derive uncertainty-quantified reaction orders and rates for Michael attack, estimate the spectra of intermediate species and establish a quantitative connection between molecular decay and capacity fade. Our work illustrates the promise of using statistical inference to elucidate chemical and electrochemical mechanisms of capacity fade in organic redox-flow battery together with uncertainty quantification, in flow cell-based electrochemical systems.

25 ENERGY STORAGE↗
DOE OSTI2020

Exploring physics of ferroelectric domain walls via Bayesian analysis of atomically resolved STEM data

The physics of ferroelectric domain walls is explored using the Bayesian inference analysis of atomically resolved STEM data. We demonstrate that domain wall profile shapes are ultimately sensitive to the nature of the order parameter in the material, including the functional form of Ginzburg-Landau-Devonshire expansion, and numerical value of the corresponding parameters. The preexisting materials knowledge naturally folds in the Bayesian framework in the form of prior distributions, with the different order parameters forming competing (or hierarchical) models. Here, we explore the physics of the ferroelectric domain walls in BiFeO 3 using this method, and derive the posterior estimates of relevant parameters. More generally, this inference approach both allows learning materials physics from experimental data with associated uncertainty quantification, and establishing guidelines for instrumental development answering questions on what resolution and information limits are necessary for reliable observation of specific physical mechanisms of interest.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Atikokan Digital Twin: Machine learning in a biomass energy system

The Atikokan Generating Station, operated by Ontario Power Generation, has a 200 MW, biomass-fired tower boiler that operates on a dispatch schedule with a five-minute cycle. The boiler is generally operated in the range of 40–100 MW using two of five burner levels. In order to optimize boiler performance, we propose the implementation of a unique digital twin. Our digital twin abstraction couples Bayesian inference from science-based models and from observations (machine learning) with decision theory to predict operating-variable set points that optimize the physical asset (the boiler) in the presence of uncertainty (artificial intelligence). We focus this paper on the continuous Bayesian machine learning part of the Atikokan Digital Twin; we discuss decision theory in a companion paper. We identify and learn about 12 operational, model, and measured-output parameters and their uncertainties from high-fidelity, science-based simulations of the Atikokan boiler and from the observed measurements at the power plant. Since the goal of the Atikokan Digital Twin is to implement it online in real time, we require fast function evaluations for the quantities of interest extracted from the simulations in the Bayesian analysis. We use Gaussian process regression/interpolation to create accurate, robust surrogate models. We define the Bayesian priors and likelihood function and solve for the posterior distributions of the 12 parameters. Here we then propagate these distributions (i.e., parameters with uncertainty) into the predicted distributions of 790 quantities of interest to learn about the relative importance of various sources of error including experimental, model, and operating-parameter errors.

09 BIOMASS FUELS↗
DOE OSTI2021

An initial framework for the rapid qualification of long-term creep rupture strength via microstructural modeling

This report describes the development and testing of a new method for extrapolating short-term creep rupture test data to predict long-term rupture strength. The goal of this work is to reduce the time required to qualify new materials for nuclear service by reducing the lead time required for dedicated, long-term material testing to establish key long-term material properties. The new approach described here uses a physics-based model to predict the long-term creep rupture strength of 316H stainless steel using only short-term test data. The key idea is to use Bayesian inference to find the statistical distribution of the model parameters that best explain the short-term rupture data. Because the model is physics-based these parameters are all microstructural quantities that can be measured through detailed material characterization experiments. The Bayesian prior distributions provide a means for incorporating this characterization data into the final model to improve the accuracy of the long-term model predictions. However, where such data is not available the process still produces an accurate model based on an uniformed prior. Our hypothesis is that this approach more accurately extrapolates the short-term test data when compared to current, empirical methods. The report proves this hypothesis using actual long-term rupture data available for 316H, including tests with rupture times greater than 200,000 hours. The general approach developed here could be applied to other materials and other time-dependent material properties. Applying this new technique to develop long-term qualified material properties, potentially in conjunction with other accelerated qualification approaches like staggered qualification test programs, could greatly reduce the time required to qualify new materials for nuclear service.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Inferring the spread of COVID-19: the role of time-varying reporting rate in epidemiological modelling

The role of epidemiological models is crucial for informing public health officials during a public health emergency, such as the COVID-19 pandemic. However, traditional epidemiological models fail to capture the time-varying effects of mitigation strategies and do not account for under-reporting of active cases, thus introducing bias in the estimation of model parameters. To infer more accurate parameter estimates and to reduce the uncertainty of these estimates, we extend the SIR and SEIR epidemiological models with two time-varying parameters that capture the transmission rate and the rate at which active cases are reported to health officials. Using two real data sets of COVID-19 cases, we perform Bayesian inference via our SIR and SEIR models with time-varying transmission and reporting rates and via their standard counterparts with constant rates; our approach provides parameter estimates with more realistic interpretation, and 1-week ahead predictions with reduced uncertainty. Furthermore, we find consistent under-reporting in the number of active cases in the data that we consider, suggesting that the initial phase of the pandemic was more widespread than previously reported.

42 ENGINEERING↗
DOE OSTI2024

Pedestal main ion particle transport inference through gas puff modulation with experimental source measurements

Abstract Transport in the DIII-D high confinement mode (H-mode) pedestal is investigated through a periodic edge gas puff modulation (GPM) which perturbs the deuterium density and source profiles. By using absolutely calibrated experimental edge ionization profile measurements, radial profiles of diffusion ( D ) and convection ( v ) are calculated into the pedestal region without depending on modeling the edge ionization source. An analytic approach with closed-form expressions for the D and v profiles and a more advanced Bayesian approach show evidence of an inward particle convection on the order of 1 m s −1 extending to normalized poloidal flux ( Ψ N ) of 0.98. Meanwhile, diffusion reaches a minimum value of ( 0.03 ± 0.02 ) m 2 s −1 in the pedestal region. Notably, the Bayesian approach, which utilizes the Aurora 1.5 D forward model inside the IMPRAD OMFIT module, provides radially resolved transport profiles with associated uncertainty without requiring an explicit form for the perturbation to the density profile or source. The combination of experimental ionization measurements and Bayesian inference provides an enhanced robust framework for investigating edge particle transport coefficients to experimentally test transport physics in order to improve predictive capabilities in the tokamak edge.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

A differentiable simulation package for performing inference of synchrotron-radiation-based diagnostics

The direction of particle accelerator development is ever-increasing beam quality, currents and repetition rates. This poses a challenge to traditional diagnostics that directly intercept the beam due to the mutual destruction of both the beam and the diagnostic. An alternative approach is to infer beam parameters non-invasively from the synchrotron radiation emitted in bending magnets. However, inferring the beam distribution from a measured radiation pattern is a complex and computationally expensive task. To address this challenge we present SYRIPY ( SYnchrotron Radiation In PYthon ), a software package intended as a tool for performing inference of synchrotron-radiation-based diagnostics. SYRIPY has been developed using PyTorch , which makes it both differentiable and able to leverage the high performance of GPUs, two vital characteristics for performing statistical inference. The package consists of three modules: a particle tracker, Lienard–Wiechert solver and Fourier optics propagator, allowing start-to-end simulation of synchrotron radiation detection to be carried out. SYRIPY has been benchmarked against SRW , the prevalent numerical package in the field, showing good agreement and up to a 50× speed improvement. Finally, we have demonstrated how SYRIPY can be used to perform Bayesian inference of beam parameters using stochastic variational inference.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Advancements in Constitutive Model Calibration: Leveraging the Power of Full‐Field DIC Measurements and In Situ Load Path Selection for Reliable Parameter Inference

Accurate material characterization and model calibration are essential for computationally supported high-consequence engineering decisions. Historically, characterization and calibration methods (1) use simplified test specimen geometries and global data, (2) cannot guarantee that sufficient characterization data are collected for a specific model of interest, (3) use deterministic methods that provide best-fit parameter values with no uncertainty quantification, and (4) are sequential, inflexible, and time-consuming. This work brings together several recent advancements into an improved workflow called interlaced characterization and calibration (ICC) that advances the state-of-the-art in constitutive model calibration. The ICC paradigm (1) employs tools to efficiently use full-field data to calibrate high-fidelity material models, (2) aligns the data needed with the data collected by adopting an optimal experimental design protocol, (3) quantifies parameter uncertainty through Bayesian inference and (4) incorporates these advancements into a quasi real-time feedback loop. The ICC framework is demonstrated here on the calibration of a material model using simulated full-field data for an aluminium cruciform specimen being deformed biaxially. The cruciform is actively driven through the myopically preferred load path using Bayesian optimal experimental design, which selects load steps that yield the maximum expected information gain (EIG). Principal component analysis (PCA) is performed on the model predictions of full-field displacements, and fast surrogate models are built to approximate the input-output relationships of the expensive finite element model. Furthermore, the tools developed and demonstrated here show that high-fidelity constitutive models can be efficiently and reliably calibrated with quantified uncertainty, thus supporting credible decision-making and potentially increasing the agility of solid mechanics modelling by enabling utilization of computational simulations at earlier stages of the design cycle.

Bayesian optimal experimental design↗
DOE OSTI2022

A non-commutative Bayes' theorem

Using a diagrammatic reformulation of Bayes' theorem, we provide a necessary and sufficient condition for the existence of Bayesian inference in the setting of finite-dimensional C* -algebras. In other words, we prove an analogue of Bayes' theorem in the joint classical and quantum context. Our analogue is justified by recent advances in categorical probability theory, which have provided an abstract formulation of the classical Bayes' theorem. In the process, we further develop non-commutative almost everywhere equivalence and illustrate its important role in non-commutative Bayesian inversion. The construction of such Bayesian inverses, when they exist, involves solving a positive semidefinite matrix completion problem for the Choi matrix. This gives a solution to the open problem of constructing Bayesian inversion for completely positive unital maps acting on density matrices that do not have full support. In conclusion, we illustrate how the procedure works for several examples relevant to quantum information theory.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Bayesian analysis of (3 +1)⁢D relativistic nuclear dynamics with the RHIC beam energy scan data

This work presents a Bayesian inference study for relativistic heavy-ion collisions in the beam energy scan program at the BNL Relativistic Heavy-Ion Collider. The theoretical model simulates event-by-event (3+1)-dimensional [(3+1)⁢D] collision dynamics using hydrodynamics and hadronic transport theory. We analyze the model's 20-dimensional posterior distributions obtained using three model emulators with different accuracy and demonstrate the essential role of training an accurate model emulator in the Bayesian analysis. Our analysis provides robust constraints on the quark-gluon plasma's transport properties and various aspects of (3+1)⁢D relativistic nuclear dynamics. By running full model simulations with 100 parameter sets sampled from the posterior distribution, we make predictions for p T -differential observables and estimate their systematic theory uncertainty. Here, a sensitivity analysis is performed to elucidate how individual experimental observables respond to different model parameters, providing useful physics insights into the phenomenological model for heavy-ion collisions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

BISON Fuel Fragmentation Relocation and Dispersal (FFRD) Assessment Database for Eventual Use in Bayesian Calibration

Existing light-water reactor (LWR) fuel vendors have been interested in seeking increased discharge burnups of nuclear fuel rods for improved economics for quite a few years. With increased burnups come additional challenges that must be addressed. It has been experimentally observed that average burnups higher than the current regulatory limit of 62 MWd/kgU may undergo fuel fragmentation, relocation, and dispersal (FFRD) during a loss-of-coolant accident (LOCA). Industry must demonstrate approaches to mitigate FFRD. In an effort to support industry, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program within the U.S. Department of Energy (DOE) has for several years invested in developing multiscale models and creating a validation/assessment database for these models to study the mechanisms driving FFRD. This report provides an update on changes made to the assessment database and new models added to BISON to support the study of fuel rod behavior during FFRD. An effort has been initiated this year to begin adding dedicated inputs to the publicly available Virtual Test Bed (VTB) repository for industry use. A section of this report details the efforts made in this area. NEAMS has recently developed new capabilities in the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework’s stochastic tools module for calibration using Bayesian inference. The goal in the future is to use these capabilities to calibrate and identify weaknesses in the existing BISON models for FFRD. The report concludes with a discussion on the models most likely to benefit the most from such calibration.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗