Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “bayesian inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

The Effect of Embedded Nanoparticles on the Phonon Spectrum of Ice: An Inelastic X-ray Scattering Study

As a contribution to the ongoing effort toward high-frequency sound manipulation in composite materials, we use Inelastic X-ray Scattering to probe the phonon spectrum of ice, either in a pure form or with a sparse amount of nanoparticles embedded in it. The study aims at elucidating the ability of nanocolloids to condition the collective atomic vibrations of the surrounding environment. We observe that a nanoparticle concentration of about 1 % in volume is sufficient to visibly affect the phonon spectrum of the icy substrate, mainly canceling its optical modes and adding nanoparticle phonon excitations to it. We highlight this phenomenon thanks to the lineshape modeling based on a Bayesian inference, which enables us to capture the finest detail of the scattering signal. The results of this study can empower new routes toward the shaping of sound propagation in materials through the control of their structural heterogeneity.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2021

A Bayesian Approach to the Eagar–Tsai Model for Melt Pool Geometry Prediction with Implications in Additive Manufacturing of Metals

Here, this paper focuses on improving the melt pool geometry predictions and quantifying uncertainties using an adapted version of the Eagar–Tsai (E–T) model that incorporates temperature-dependent properties of the material as well as powder conditions. Additionally, Bayesian inference is employed to predict distributions for the E–T model input parameters of laser absorptivity and powder bed porosity by incorporating experimental results into the analysis. Monte Carlo uncertainty propagation is then used with these parameter distributions to estimate the melt pool depth and associated uncertainty. Our results for the 316L stainless steel suggest that both the absorptivity and powder bed porosity are strongly influenced by the laser power. In contrast, the scanning speed has only a marginal effect on both the absorptivity and powder bed porosity. We constructed a printability map using the Bayesian E–T model based on power-dependent input parameter values to demonstrate the merit of the approach. The Bayesian approach improved the accuracy in predicting the keyhole regions in the laser power-scan speed parameter space for the 316L stainless steel. Although applied to a specific adaptation of the E–T model, the method put forth can be extended to quantify uncertainties in other numerical models as well as in the estimation of unknown parameters.

316L Stainless Steel (SS).↗
DOE OSTI2024

Ensemble variational Fokker-Planck methods for data assimilation

Particle flow filters solve Bayesian inference problems by smoothly transforming a set of particles into samples from the posterior distribution. Particles move in state space under the flow of an McKean-Vlasov-Itˆo process. This work introduces the Variational Fokker-Planck (VFP) framework for data assimilation, a general approach that includes previously known particle flow filters as special cases. The McKean-Vlasov-Itˆo process that transforms particles is defined via an optimal drift that depends on the selected diffusion term. It is established that the underlying probability density - sampled by the ensemble of particles - converges to the Bayesian posterior probability density. For a finite number of particles the optimal drift contains a regularization term that nudges particles toward becoming independent random variables. Based on this analysis, we derive computationally-feasible approximate regularization approaches that penalize the mutual information between pairs of particles, and avoid particle collapse. Moreover, the diffusion plays a role akin to a particle rejuvenation approach that aims to alleviate particle collapse. The VFP framework is very flexible. Different assumptions on prior and intermediate probability distributions can be used to implement the optimal drift, and localization and covariance shrinkage can be applied to alleviate the curse of dimensionality. A robust implicit-explicit method is discussed for the efficient integration of stiff McKean- Vlasov-Itˆo processes. Here, the effectiveness of the VFP framework is demonstrated on three progressively more challenging test problems, namely the Lorenz ’63, Lorenz ’96 and the quasi-geostrophic equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Bayesian-based response expansion and uncertainty quantification using sparse measurement sets

Systems subjected to dynamic loads often require monitoring of their vibrational response, but limitations on the total number and placement of the measurement sensors can hinder the data-collection process. Here, we present an indirect approach to estimate a system’s full-field dynamic response, including all uninstrumented locations, using response measurements from sensors sparsely located on the system. This approach relies on Bayesian inference that utilizes a system model to estimate the full-field response and quantify the uncertainty in these estimates. By casting the estimation problem in the frequency domain, this approach utilizes the modal frequency response functions as a natural, frequency-dependent weighting scheme for the system mode shapes to perform the expansion. This frequency-dependent weighting scheme enables an accurate expansion, even with highly correlated mode shapes that may arise from spatial aliasing due to the limited number of sensors, provided these correlated modes do not have natural frequencies that are closely spaced. Furthermore, the inherent regularization mechanism that arises in this Bayesian-based procedure enables the utilization of the full set of system mode shapes for the expansion, rather than any reduced subset. This approach can produce estimates when considering a single realization of the measured responses, and with some modification, it can also produce estimates for power spectral density matrices measured from many realizations of the responses from statistically stationary random processes. A simply supported beam provides an initial numerical validation, and a cylindrical test article excited by acoustic loads in a reverberation chamber provides experimental validation.

42 ENGINEERING↗
DOE OSTI2025

Accelerating multilevel Markov Chain Monte Carlo using machine learning models

Here, this work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian inference often substitute computationally expensive high-fidelity models with machine learning models, thereby introducing approximation errors, our approach offers a computationally efficient alternative by augmenting high-fidelity models with low-fidelity ones within a hierarchical framework. The multilevel approach utilizes the low-fidelity machine learning model (MLM) for inexpensive evaluation of proposed samples thereby improving the acceptance of samples by the high-fidelity model. The hierarchy in our multilevel algorithm is derived from geometric multigrid hierarchy. We utilize an MLM to accelerate the coarse level sampling. Training machine learning model for the coarsest level significantly reduces the computational cost associated with generating training data and training the model. We present an MCMC algorithm to accelerate the coarsest level sampling using MLM and account for the approximation error introduced. We provide theoretical proofs of detailed balance and demonstrate that our multilevel approach constitutes a consistent MCMC algorithm. Additionally, we derive the expression for cost reduction due to machine learning model to facilitate cost analysis of the hierarchical sampling algorithm. Our technique is demonstrated on a standard benchmark inference problem in groundwater flow, where we estimate the probability density of a quantity of interest using a four-level MCMC algorithm. Our proposed algorithm accelerates multilevel sampling by a factor of two while achieving similar accuracy compared to sampling using the standard multilevel algorithm.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Multi-head physics-informed neural networks for learning functional priors and uncertainty quantification

In numerous applications, the integration of prior knowledge and historical information is essential, particularly for tasks requiring the solution of ordinary or partial differential equations (ODEs/PDEs) in data-sparse or noisy environments. For instance, achieving accurate solutions to time-dependent PDEs with limited initial condition measurements necessitates an effective strategy for embedding prior knowledge. Hard-parameter sharing architectures in neural networks (NNs) have demonstrated success in both traditional and scientific machine learning domains, facilitating the learning of informative representations. Here, in this study, we introduce a novel, yet efficient, method to enhance physics-informed neural networks (PINNs) by incorporating a multi-head structure that enables the learning of functional priors from both empirical data and governing physical laws. This prior information can then be used to address data sparsity and high-level noise in solving ODE/PDE problems with uncertainty quantification (UQ). The approach, termed Multi-Head PINN (MH-PINN), consists of a shared body NN and multiple head NNs, each corresponding to an individual PINN instance. Our framework for functional prior learning is carried out in two stages: (1) training the MH-PINNs to develop a shared body NN alongside multiple head NNs, and (2) employing these trained head NNs to estimate a prior distribution through a normalizing flow-based density estimator. The learned functional prior can then be applied as a regularization mechanism in deterministic contexts or as an informative prior within a Bayesian inference framework, aiding in the resolution of subsequent ODE/PDE tasks. We evaluate the efficacy of MH-PINNs across five benchmark problems, including a high-dimensional parametric PDE, all characterized by data sparsity or substantial noise levels. Our findings reveal that MH-PINNs deliver accurate solutions and robust UQ, demonstrating adaptability across a range of complex and challenging scenarios.

Bayesian inference↗
DOE OSTI2022

Sparsifying priors for Bayesian uncertainty quantification in model discovery

We propose a probabilistic model discovery method for identifying ordinary differential equations governing the dynamics of observed multivariate data. Our method is based on the sparse identification of nonlinear dynamics (SINDy) framework, where models are expressed as sparse linear combinations of pre-specified candidate functions. Promoting parsimony through sparsity leads to interpretable models that generalize to unknown data. Instead of targeting point estimates of the SINDy coefficients, we estimate these coefficients via sparse Bayesian inference. The resulting method, uncertainty quantification SINDy (UQ-SINDy), quantifies not only the uncertainty in the values of the SINDy coefficients due to observation errors and limited data, but also the probability of inclusion of each candidate function in the linear combination. UQ-SINDy promotes robustness against observation noise and limited data, interpretability (in terms of model selection and inclusion probabilities) and generalization capacity for out-of-sample forecast. Sparse inference for UQ-SINDy employs Markov chain Monte Carlo, and we explore two sparsifying priors: the spike and slab prior, and the regularized horseshoe prior. UQ-SINDy is shown to discover accurate models in the presence of noise and with orders-of-magnitude less data than current model discovery methods, thus providing a transformative method for real-world applications which have limited data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

A score-based diffusion model approach for adaptive learning of stochastic partial differential equation solutions

In this paper, we propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central role in modeling complex physical systems under uncertainty, but their numerical solutions often suffer from model errors and reduced accuracy due to incomplete physical knowledge and environmental variability. To address these challenges, we encode the governing physics into the score function of a diffusion model using simulation data and incorporate observational information via a likelihood-based correction in a reverse-time stochastic differential equation. This enables adaptive learning through iterative refinement of the solution as new data becomes available. To improve computational efficiency in high-dimensional settings, we introduce the ensemble score filter, a training-free approximation of the score function designed for real-time inference. Numerical experiments on benchmark SPDEs demonstrate the accuracy and robustness of the proposed method under sparse and noisy observations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

The Terahertz Dynamics of an Aqueous Nanoparticle Suspension: An Inelastic X-ray Scattering Study

We used the high-resolution Inelastic X-ray Scattering beamline of the Advanced Photon Source at Argonne National Laboratory to measure the terahertz spectrum of pure water and a dilute aqueous suspension of 15 nm diameter spherical Au nanoparticles (Au-NPs). We observe that, despite their sparse volume concentration of about 0.5%, the immersed NPs strongly influence the collective molecular dynamics of the hosting liquid. We investigate this effect through a Bayesian inference analysis of the spectral lineshape, which elucidates how terahertz transport properties of water change upon Au-NP immersion. In particular, we observe a nearly complete disappearance of the longitudinal acoustic mode and a mildly decreased ability to support shear wave propagation.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2019

Approximate Bayesian Model Inversion for PDEs with Heterogeneous and State-Dependent Coefficients

We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and cost-effective alternatives to Markov Chain Monte Carlo simulation. We assume a parameterized Gaussian prior on the unknown functions, and approximate the posterior density by a parameterized multivariate Gaussian density. The parameters of the prior and posterior are estimated from sparse observations of the PDE model's states and the unknown functions themselves by maximizing the evidence lower bound (ELBO), a lower bound on the log marginal likelihood of the observations. The first method, Laplace-EM, employs the expectation maximization algorithm to maximize the ELBO, with a Laplace approximation of the posterior on the E-step, and minimization of a Kullback-Leibler divergence on the M-step. The second method, DSVI-EB, employs the doubly stochastic variational inference (DSVI) algorithm, in which the ELBO is maximized via gradient-based stochastic optimization, with nosiy gradients computed via simple Monte Carlo sampling and Gaussian backpropagation. We apply these methods to identifying diffusion coefficients in linear and nonlinear diffusion equations, and we find that both methods provide accurate estimates of posterior densities and the hyperparameters of Gaussian priors. While the Laplace-EM method is more accurate, it requires computing Hessians of the physics model. The DSVI-EB method is found to be less accurate but only requires gradients of the physics model.

approximate Bayesian inference, model inversion, v↗
DOE OSTI2023

Differential contagiousness of respiratory disease across the United States

The initial contagiousness of a communicable disease within a given population is quantified by the basic reproduction number, $R_0$. This number depends on both pathogen and population properties. On the basis of compartmental models that reproduce Coronavirus Disease 2019 (COVID-19) surveillance data, we used Bayesian inference and the next-generation matrix approach to estimate region-specific $R_0$ values for 280 of 384 metropolitan statistical areas (MSAs) in the United States (US), which account for 95% of the US population living in urban areas and 82% of the total population. We focused on MSA populations after finding that these populations were more uniformly impacted by COVID-19 than state populations. Our maximum a posteriori (MAP) estimates for $R_0$ range from 1.9 to 7.7 and quantify the relative susceptibilities of regional populations to spread of respiratory diseases.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

High-resolution x-ray spectrometer for x-ray absorption fine structure spectroscopy

Two extended x-ray absorption fine structure flat crystal x-ray spectrometers (EFX’s) were designed and built for high-resolution x-ray spectroscopy over a large energy range with flexible, on-shot energy dispersion calibration capabilities. The EFX uses a flat silicon [111] crystal in the reflection geometry as the energy dispersive optic covering the energy range of 6.3–11.4 keV and achieving a spectral resolution of 4.5 eV with a source size of 50 μm at 7.2 keV. A shot-to-shot configurable calibration filter pack and Bayesian inference routine were used to constrain the energy dispersion relation to within ±3 eV. The EFX was primarily designed for x-ray absorption fine structure (XAFS) spectroscopy and provides significant improvement to the Laboratory for Laser Energetics’ OMEGA-60 XAFS experimental platform. The EFX is capable of performing extended XAFS measurements of multiple absorption edges simultaneously on metal alloys and x-ray absorption near-edge spectroscopy to measure the electron structure of compressed 3d transition metals.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Analytic Neural Network Gaussian Process Enabled Chance-Constrained Voltage Regulation for Active Distribution Systems with PVs, Batteries and EVs

This paper proposes an analytic neural network Gaussian process (NNGP)-based chance-constrained real-time voltage regulation method for active distribution systems with photovoltaics (PVs), batteries, and electric vehicles (EVs). NNGP can utilize historical measurement data to achieve real-time probabilistic node voltage estimation through Bayesian inference. Then, NNGP is fully analytically embedded into the optimal power flow model to perform voltage regulation and adapt to various topological changes. The uncertainties of voltage estimations are easily considered via the chance constraint, and it has been shown that the adoption of this chance constraint can significantly improve the reliability of voltage regulation under various scenarios. The comparison results with other methods, carried out on a real 759-node distribution system located in western Colorado, U.S., show that the proposed method can achieve accurate voltage estimation across different topologies and reliably perform voltage regulation considering PVs, batteries, and EVs.

active distribution systems↗
DOE OSTI2025

Joint state-parameter estimation for the reduced fracture model via the united filter

Here, in this paper, we introduce an effective United Filter method for jointly estimating the solution state and physical parameters in flow and transport problems within fractured porous media. Fluid flow and transport in fractured porous media are critical in subsurface hydrology, geophysics, and reservoir geomechanics. Reduced fracture models, which represent fractures as lower-dimensional interfaces, enable efficient multi-scale simulations. However, reduced fracture models also face accuracy challenges due to modeling errors and uncertainties in physical parameters such as permeability and fracture geometry. To address these challenges, we propose a United Filter method, which integrates the Ensemble Score Filter (EnSF) for state estimation with the Direct Filter for parameter estimation. EnSF, based on a score-based diffusion model framework, produces ensemble representations of the state distribution without deep learning. Meanwhile, the Direct Filter, a recursive Bayesian inference method, estimates parameters directly from state observations. The United Filter combines these methods iteratively: EnSF estimates are used to refine parameter values, which are then fed back to improve state estimation. Numerical experiments demonstrate that the United Filter method surpasses the state-of-the-art Augmented Ensemble Kalman Filter, delivering more accurate state and parameter estimation for reduced fracture models. This framework also provides a robust and efficient solution for PDE-constrained inverse problems with uncertainties and sparse observations.

Bayesian inference↗
DOE OSTI2022

Reinforcement learning for adaptive maintenance policy optimization under imperfect knowledge of the system degradation model and partial observability of system states

Maintenance policy optimization usually is faced with challenges that arise from an imperfect knowledge of system degradation models and from the partial observability of system degradation states. Here, this paper proposes a reinforcement learning method to address these two challenges for a class of maintenance problems with Markov degradation processes. The reinforcement learning approach consists of a learning component and a planning component. Using sequentially collected observations, at each step of decision-making the learning component improves the knowledge of system degradation in terms of the probability distributions of the transition rates based on sequential Bayesian inference. Using the updated transition rates, at each step of decision-making the maintenance policy optimization problem is then formulated as a partially observable Markov decision problem, and the planning component computes the optimal maintenance policy that maximizes the expected cumulative reward. The proposed method is illustrated using a numerical example with repair and inspection maintenance actions. The result shows that as more observations are collected, the learning component progressively learns the true system degradation process, and the planning component adjusts the optimal maintenance policy accordingly as well, which leads to increased reward.

42 ENGINEERING↗
DOE OSTI2025

Uncertainty Quantification for Neutron Shield Using Convolutional Neural Networks

Uncertainty quantification from radiation transport calculations was conducted using a Bayesian inference approach. A surrogate model, using a convolutional neural network, was employed to emulate the neutron fluence, which was simulated with a Monte Carlo radiation transport model. This allowed for a computationally cheap approach to evaluate input parameters and to sample their corresponding posterior probability distributions. Experimental data from the literature were employed to perform uncertainty quantification studies for concrete shields. As a result, the method is a nonintrusive approach that enables studies with multiple input parameters and can be applied to any radiation transport model.

Bayesian inference↗
DOE OSTI2023

Bayesian merging of numerical modeling and remote sensing for saltwater intrusion quantification in the Vietnamese Mekong Delta

Saltwater intrusion has become one of the most concerning issues in the Vietnamese Mekong Delta (VMD) due to its increasing impacts on agriculture and food security of Vietnam. Reliable estimation of salinity plays a crucial role to mitigate the impacts of saltwater intrusion. Here, this study developed a hybrid technique that merges satellite imagery with numerical simulations to improve the estimation of salinity in the VMD. The salinity derived from Landsat images and by numerical simulations was fused using the Bayesian inference technique. The results indicate that our technique significantly reduces the uncertainties and improves the accuracy of salinity estimates. The Nash–Sutcliffe coefficient is 0.74, which is much higher than that of numerical simulation (0.63) and Landsat estimation (0.6). The correlation coefficient between the ensemble and measured salinity is relatively high (0.88). The variance of the ensemble salinity errors (5.0 ppt 2 ) is lower than that of Landsat estimation (10.4 ppt 2 ) and numerical simulations (9.6 ppt 2 ). The proposed approach shows a great potential to combine multiple data sources of a variable of interest to improve its accuracy and reliability wherever these data are available.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Radiation Source Localization Using Surrogate Models Constructed from 3-D Monte Carlo Transport Physics Simulations

Recent research has focused on the development of surrogate models for radiation source localization in a simulated urban domain. We employ the Monte Carlo N-Particle (MCNP) code to provide high- delity simulations of radiation transport within an urban domain. The model is constructed to employ a source location (x, y, z) as input and return the estimated count rate for a set of speci ed detector locations. Because MCNP simulations are computationally expensive, we develop e cient and accurate surrogate models of the detector responses. We construct surrogate models using Gaussian processes (GP) and neural networks (NN) that we train and verify using the MCNP simulations. The trained surrogate models provide an e cient framework for Bayesian inference and experimental design. We employ Delayed Rejection Adaptive Metropolis (DRAM), a Markov Chain Monte Carlo (MCMC) algorithm, to infer the location and intensity of an unknown source. The DRAM results yield a posterior probability distribution for the source's location conditioned on the observed detector count rates. The posterior distribution exhibits regions of high and low probability within the simulated environment identifying potential source locations. In this manner, we can quantify the source location to within at least one of these regions of high probability in the considered cases. Employing these methods, we are able to reduce the space of potential source locations by at least 60%.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗