Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Bayesian prior construction for uncertainty quantification in first-principles statistical mechanics

First-principles statistical mechanics enables the prediction of thermodynamic and kinetic properties of materials, but is computationally expensive. Many approaches require surrogate models to calculate energies within Monte Carlo or molecular dynamics simulations. Inexpensive surrogates such as cluster expansions enable otherwise intractable calculations by interpolating data from higher accuracy methods, such as Density Functional Theory (DFT). Surrogate models introduce uncertainty into downstream calculations, in addition to any uncertainty inherent to DFT calculations. Bayesian frameworks address this by quantifying uncertainty and incorporating expert knowledge through priors. However, constructing effective priors remains challenging. This work introduces and describes practical strategies for building Bayesian cluster expansions, focusing on basis truncation, hyperparameter selection, and ground state replication. We analyze multiple basis truncation schemes, compare cross-validation to the evidence-approximation for hyperparameter optimization, and provide methods to find and enforce ground-state-preserving models through priors. Additionally, we compare the uncertainties between different approximations to DFT (LDA, PBE, SCAN) against the uncertainty introduced with the use of cluster expansion surrogate models. These approaches are demonstrated on the BCC Li x Mg 1-x and Li x Al 1-x alloys, which are both of interest for solid-state Li batteries. Our results provide guidelines for constructing and utilizing Bayesian cluster expansions, thereby improving the transparency of materials modeling. Furthermore, the approaches and insights developed in this work can be transferred to a wide range of cluster expansion surrogate models, including the atomic cluster expansion and related machine-learned interatomic potential architectures.

Alloy theory↗

Absolute cross section of the C 12 ( p , γ ) N 13 reaction

Solar neutrino measurements have recently reached a level of sensitivity such that CNO fluxes can now be experimentally determined. While these first measurements are still only sensitive to the higher energy neutrinos resulting from the β + decays of 15 Ο produced by the 14 Ν ⁡( p ,$\gamma$)⁢ 15 O reaction, future measurements will work towards detection of neutrinos from the β + decay of 13 N from the 12 C ⁡( p ,$\gamma$)⁢ 13 N reaction. Here, this paper reports on a recent measurement of the 12 C ⁡( p ,$\gamma$)⁢ 13 N reaction covering a broad laboratory energy range between 1.0 and 2.5 MeV. The measurement was made to better determine the overall normalization of the absolute cross section and to explore the interference effects between the two broad, overlapping resonances at proton energies of 0.460 and 1.689 MeV and the direct capture to the ground state of 13 N in the framework of a multichannel R -matrix analysis. This work takes into account previous radiative capture as well as elastic 12 C ( p , p ) 12 C scattering data, making uncertainty estimations using a Bayesian framework, to determine a reliable extrapolation of the low energy S factor towards the stellar energy range of CNO hydrogen burning. These new experimental results, and a detailed investigation of the past literature data, suggest that the resonant component of the cross section should be 30% lower than previously accepted.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Posterior Covariance Matrix Approximations

Here, the Davis equation of state (EOS) is commonly used to model thermodynamic relationships for high explosive (HE) reactants. Typically, the parameters in the EOS are calibrated, with uncertainty, using a Bayesian framework and Markov Chain Monte Carlo (MCMC) methods. However, MCMC methods are computationally expensive, especially for complex models with many parameters. This paper provides a comparison between MCMC and less computationally expensive Variational methods (Variational Bayesian and Hessian Variational Bayesian) for computing the posterior distribution and approximating the posterior covariance matrix based on heterogeneous experimental data. All three methods recover similar posterior distributions and posterior covariance matrices. This study demonstrates that for this EOS parameter calibration application, the assumptions made in the two Variational methods significantly reduce the computational cost but do not substantially change the results compared to MCMC.

97 MATHEMATICS AND COMPUTING↗

Optimal Estimation Framework for Ocean Color Atmospheric Correction and Pixel-level Uncertainty Quantification

Ocean color remote sensing requires compensation for atmospheric scattering and absorption (aerosol, Rayleigh, and trace gases), referred to as atmospheric correction (AC). AC allows inference of parameters such as spectrally resolved remote sensing reflectance ( R rs )(λ) ; sr 1 ) at the ocean surface from the top-of-atmosphere reflectance. Often, the uncertainty of this process is not fully explored. Bayesian inference techniques provide a simultaneous AC and uncertainty assessment via a full posterior distribution of the relevant variables, given the prior distribution of those variables and the radiative transfer (RT) likelihood function. Given uncertainties in the algorithm inputs, the Bayesian framework enables better constraints on the AC process by using the complete spectral information compared to traditional approaches that use only a subset of bands for AC. This paper investigates a Bayesian inference research method (Optimal Estimation, OE) for ocean color AC by simultaneously retrieving atmospheric and ocean properties using all visible and near-infrared spectral bands. The OE algorithm analytically approximates the posterior distribution of parameters based on normality assumptions and provides a potentially viable operational algorithm with a reduced computational expense. We developed a Neural Network (NN) RT forward model look-up-table-based emulator to increase algorithm efficiency further and thus speed up the likelihood computations. We then applied the OE algorithm to synthetic data and observations from the MODerate resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua spacecraft. We compared the R rs )(λ) retrieval and its uncertainty estimates from the OE method with in-situ validation data from the SeaWiFS Bio-optical Archive and Storage System (SeaBASS) and Aerosol Robotic Network Ocean Color (AERONET-OC) datasets. The OE algorithm improved R rs )(λ) estimates relative to the NASA standard operational algorithm by improving all statistical metrics at 443, 555, and 667 nm. Unphysical negative R rs )(λ) , which often appear in complex water conditions, was reduced by a factor of 3. The OE-derived pixel-level R rs )(λ) uncertainty estimates were also assessed relative to in-situ data and were shown to have skill.

Atmospheric correction↗

Probabilistic Mixture Model-Based Spectral Unmixing

Spectral unmixing attempts to decompose a spectral ensemble into the constituent pure spectral signatures (called endmembers) along with the proportion of each endmember. This is essential for techniques like hyperspectral imaging (HSI) used in environment monitoring, geological exploration, etc. Several spectral unmixing approaches have been proposed, many of which are connected to hyperspectral imaging. However, most extant approaches assume highly diverse collections of mixtures and extremely low-loss spectroscopic measurements. Additionally, current non-Bayesian frameworks do not incorporate the uncertainty inherent in unmixing. We propose a probabilistic inference algorithm that explicitly incorporates noise and uncertainty, enabling us to unmix endmembers in collections of mixtures with limited diversity. We use a Bayesian mixture model to jointly extract endmember spectra and mixing parameters while explicitly modeling observation noise and the resulting inference uncertainties. We obtain approximate distributions over endmember coordinates for each set of observed spectra while remaining robust to inference biases from the lack of pure observations and the presence of non-isotropic Gaussian noise. As a direct impact of our methodology, access to reliable uncertainties on the unmixing solutions would enable robust solutions to noise, as well as informed decision-making for HSI applications and other unmixing problems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Sensitive Detection of Structural Differences using a Statistical Framework for Comparative Crystallography

Chemical and conformational changes underlie the functional cycles of proteins. Comparative crystallography can reveal these changes over time, over ligands, and over chemical and physical perturbations in atomic detail. A key difficulty, however, is that the resulting observations must be placed on the same scale by correcting for experimental factors. We recently introduced a Bayesian framework for correcting (scaling) X-ray diffraction data by combining deep learning with statistical priors informed by crystallographic theory. To scale comparative crystallography data, we here combine this framework with a multivariate statistical theory of comparative crystallography. By doing so, we find strong improvements in the detection of protein dynamics, element-specific anomalous signal, and the binding of drug fragments.

Hekstra, Doeke R. [Harvard Univ., Cambridge, MA (U↗

Sensitivity of the CUPID experiment to $0\nu \beta \beta$ decay of 100 Mo

CUPID is a next-generation bolometric experiment to search for neutrinoless double-beta decay ($0\nu \beta \beta$ ) of 100 Mo using Li 2 MoO 4 scintillating crystals. It will operate 1596 crystals at ~10 mK in the CUORE cryostat at the Laboratori Nazionali del Gran Sasso in Italy. Each crystal will be facing two Ge-based bolometric light detectors for α rejection. We compute the discovery and the exclusion sensitivity of CUPID to $0\nu \beta \beta$ in a Frequentist and a Bayesian framework. This computation is done numerically based on pseudo-experiments. For the CUPID baseline scenario, with a background and an energy resolution of 1.0 x 10 –4 counts/keV/kg/yr and 5 keV FWHM at the Q-value, respectively, this results in a Bayesian exclusion sensitivity (90% c.i.) of $\hat{T}_{1/2} > 1.6 \times 10^{27} \ \textrm{yr}$, corresponding to the effective Majorana neutrino mass of $\hat{m}_{\beta \beta } < \ 9.6$ – 28 meV. The Frequentist discovery sensitivity (3σ ) is $\hat{T}_{1/2}= 1.0 \times 10^{27} \ \textrm{yr}$, corresponding to $\hat{m}_{\beta \beta }= \ 12$ – 36 meV.

Alfonso, K. [Virginia Polytechnic Institute and St↗

Bayesian mixture model approach to quantifying the empirical nuclear saturation point

The equation of state (EOS) in the limit of infinite symmetric nuclear matter exhibits an equilibrium density, $n_0 \approx 0.16 \, \mathrm{fm}^{-3}$, at which the pressure vanishes and the energy per particle attains its minimum, $E_0 \approx -16 \, \mathrm{MeV}$. Although not directly measurable, the nuclear saturation point $(n_0,E_0)$ can be extrapolated by density functional theory (DFT), providing tight constraints for microscopic interactions derived from chiral effective field theory (EFT). However, when considering several DFT predictions for $(n_0,E_0)$ from Skyrme and Relativistic Mean Field (RMF) models together, a discrepancy between these model classes emerges at high confidence levels that each model prediction's uncertainty cannot explain. How can we leverage these DFT constraints to rigorously benchmark nuclear saturation properties of chiral interactions? To address this question, we present a Bayesian mixture model that combines multiple DFT predictions for $(n_0,E_0)$ using an efficient conjugate prior approach. The inferred posterior distribution for the saturation point's mean and covariance matrix follows a Normal-inverse-Wishart class, resulting in posterior predictives in the form of correlated, bivariate $t$-distributions. The DFT uncertainty reports are then used to mix these posteriors using an ordinary Monte Carlo approach. At the 95\% credibility level, we estimate $n_0 \approx 0.157 \pm 0.010 \, \mathrm{fm}^{-3}$ and $E_0 \approx -15.97 \pm 0.40 \, \mathrm{MeV}$ for the marginal (univariate) $t$-distributions. Combined with chiral EFT calculations of the pure neutron matter EOS, we obtain bivariate normal distributions for the nuclear symmetry energy and its slope parameter evaluated at $n_0$: $S_v \approx 32.0 \pm 1.1 \, \mathrm{MeV}$ and $L\approx 52.6\pm 8.1 \, \mathrm{MeV}$ (95\%), respectively. Furthermore, our Bayesian framework is publicly available, so practitioners can readily use and extend our results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Assessing the design of integrated methane sensing networks

Abstract While methane is the second largest contributor to global warming after carbon dioxide, it has a larger warming effect over a much shorter lifetime. Despite accelerated technological efforts to radically reduce global carbon dioxide emissions, rapid reductions in methane emissions are needed to limit near-term warming. Being primarily emitted as a byproduct from agricultural activities and energy extraction, methane is currently monitored via bottom–up (i.e. activity level) or top–down (via airborne or satellite retrievals) approaches. However, significant methane leaks remain undetected and emission rates are challenging to characterize with current monitoring frameworks. In this paper, we study the design of a layered monitoring approach that combines bottom–up and top–down approaches as an integrated sensing network. By recognizing that varying meteorological conditions and emission rates impact the efficacy of bottom–up monitoring, we develop a probabilistic approach to optimal sensor placement in its bottom–up network. Subsequently, we derive an inverse Bayesian framework to quantify the improvement that a design-optimized integrated framework has on emission-rate quantifications and their uncertainties. We find that under realistic meteorological conditions, the overall error in estimating the true emission rates is approximately 1.3 times higher, with their uncertainties being approximately 2.4 times higher, when using a randomized network over an optimized network, highlighting the importance of optimizing the design of integrated methane sensing networks. Further, we find that optimized networks can improve scenario coverage fractions by more than a factor of 2 over experimentally-studied networks, and identify a budget threshold beyond which the rate of optimized-network coverage improvement exhibits diminishing returns, suggesting that strategic sensor placement is also crucial for maximizing network efficiency.

54 ENVIRONMENTAL SCIENCES↗

EFIT‐AI: Machine Learning and Artificial Intelligence Assisted Equilibrium Reconstruction for Tokamak Experiments and Burning Plasmas (Final Report)

The EFIT-AI project is creating a modern advanced equilibrium reconstruction code suitable for tokamak experiments of burning plasmas. EFIT [1,2] was the first and is the most extensively used equilibrium reconstruction code in the world. This project builds on the production-level experience and adds key elements as follows. 1. A Model Order Reduction (MOR) version of the two-dimensional (2D) Grad-Shafranov equation solver (EFIT-MORNN) using physics-informed neural networks. 2. Improved optimization and data analysis capabilities using a Bayesian framework enhanced with machine learning. 3. A MOR version of the three-dimensional (3D) perturbed equilibrium reconstruction tool.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Uncertainty Quantification for a Multi-phase Carbon Equation of State Model

Many physics models have tunable parameters that are calibrated by matching the model output to experimental or calculated data. However, given that calibration data often contain uncertainty and that different model parameter sets might result in a very similar simulated output for a finite calibration data set, it is advantageous to provide an ensemble of parameter sets that are consistent with the calibration data. Uncertainty quantification (UQ) provides a means to generate such an ensemble in a statistically rigorous fashion. In this work, we perform UQ for a multi-phase equation of state (EOS) model for carbon containing the diamond, graphite, and liquid phases. We use a Bayesian framework for the UQ and introduce a novel strategy for including phase diagram information in the calibration. The method is highly general and accurately reproduces the calibration data without any material-specific prior knowledge of the EOS model parameters.

36 MATERIALS SCIENCE↗

A NICER view of PSR J0030+0451: Implications for the Dense Matter Equation of State

Both the mass and radius of the millisecond pulsar PSRJ0030+0451 have been inferred via pulse-profile modeling of X-ray data obtained by NASA’s Neutron Star Interior Composition Explorer (NICER) mission. In this Letter we study the implications of the mass–radius inference reported for this source by Riley et al. for the dense matter equation of state (EoS), in the context of prior information from nuclear physics at low densities. Using a Bayesian framework we infer central densities and EoS properties for two choices of high-density extensions: a piecewise-polytropic model and a model based on assumptions of the speed of sound in dense matter. Around nuclear saturation density these extensions are matched to an EoS uncertainty band obtained from calculations based on chiral effective field theory interactions, which provide a realistic description of atomic nuclei as well as empirical nuclear matter properties within uncertainties. We further constrain EoS expectations with input from the current highest measured pulsar mass; together, these constraints offer a narrow Bayesian prior informed by theory as well as laboratory and astrophysical measurements. The NICER mass–radius likelihood function derived by Riley et al. using pulse-profile modeling is consistent with the highest-density region of this prior. The present relatively large uncertainties on mass and radius for PSR J0030+0451 offer, however, only a weak posterior information gain over the prior. We explore the sensitivity to the inferred geometry of the heated regions that give rise to the pulsed emission, and find a small increase in posterior gain for an alternative (but less preferred) model. Lastly, we investigate the hypothetical scenario of increasing the NICER exposure time for PSRJ0030+0451.

G Raaijmakers↗

Bayesian operator inference for data-driven reduced-order modeling

This work proposes a Bayesian inference method for the reduced-order modeling of time-dependent systems. Informed by the structure of the governing equations, the task of learning a reduced-order model from data is posed as a Bayesian inverse problem with Gaussian prior and likelihood. The resulting posterior distribution characterizes the operators defining the reduced-order model, hence the predictions subsequently issued by the reduced-order model are endowed with uncertainty. The statistical moments of these predictions are estimated via a Monte Carlo sampling of the posterior distribution. Since the reduced models are fast to solve, this sampling is computationally efficient. Furthermore, the proposed Bayesian framework provides a statistical interpretation of the regularization term that is present in the deterministic operator inference problem, and the empirical Bayes approach of maximum marginal likelihood suggests a selection algorithm for the regularization hyperparameters. The proposed method is demonstrated on two examples: the compressible Euler equations with noise-corrupted observations, and a single-injector combustion process.

97 MATHEMATICS AND COMPUTING↗

Statistical Estimation of Strain Using Spatial Correlation Functions

Ex-situ estimation of strains from deformed micrographs is not possible as there are no persistent features which can be tracked. Two point spatial statistics enable the rigorous quantification of spatial patterns in heterogeneous media. In this paper, we propose a novel method for estimating strains directly from dissimilar micrographs using a continuum mechanics approach. Rather than operating directly on images from sequential frames, as is done in digital image correlation, we operate on different microstructure realizations. This is made possible by comparing the spatial autocorrelation maps of deformed and undeformed micrographs rather than direct comparison of images. Additionally, a Bayesian framework is proposed for quantifying uncertainty. We first illustrate the efficacy of this method on speckle pattern images from digital image correlation experiments. Then, we demonstrate that the method is capable of operating on dissimilar micrographs using deformed synthetic binary microstructures. Finally, we present a case study on polycrystalline additively manufactured 316L deformed via tension. The proposed method works well and we discuss implications and limitations of the presented work.

36 MATERIALS SCIENCE↗

GIGA-Lens: Fast Bayesian Inference for Strong Gravitational Lens Modeling

We present GIGA-Lens: a gradient-informed, GPU-accelerated Bayesian framework for modeling strong gravitational lensing systems, implemented in TensorFlow and JAX. The three components, optimization using multistart gradient descent, posterior covariance estimation with variational inference, and sampling via Hamiltonian Monte Carlo, all take advantage of gradient information through automatic differentiation and massive parallelization on graphics processing units (GPUs). We test our pipeline on a large set of simulated systems and demonstrate in detail its high level of performance. The average time to model a single system on four Nvidia A100 GPUs is 105 s. The robustness, speed, and scalability offered by this framework make it possible to model the large number of strong lenses found in current surveys and present a very promising prospect for the modeling of ${ \mathcal O }({10}^{5})$ lensing systems expected to be discovered in the era of the Vera C. Rubin Observatory, Euclid, and the Nancy Grace Roman Space Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian refinement of covariant energy density functionals

The last five years have seen remarkable progress in our quest to determine the equation of state of neutron rich matter. Here, recent advances across the theoretical, experimental, and observational landscape have been incorporated in a Bayesian framework to refine existing covariant energy density functionals previously calibrated by the properties of finite nuclei. In particular, constraints on the maximum neutron star mass from pulsar timing, on stellar radii from the NICER mission, on tidal deformabilities from the LIGO-Virgo collaboration, and on the dynamics of pure neutron matter as predicted from chiral effective field theories have resulted in significant refinements to the models, particularly to those predicting a stiff symmetry energy. Still, even after these improvements, we find it challenging to reproduce simultaneously the neutron skin thickness of both 208 Pb and 48 Ca recently reported by the PREX/CREX collaboration.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

On the impact of tidal generation and energy storage integration in PV-rich electric distribution systems

Deep decarbonization of power system operations requires the maximal utilization of available renewable resources. At distribution-level operations, however, grid operators can face numerous challenges in integrating renewables at scale owing to the inherent intermittence of renewable energy resources. These include phenomena such as voltage fluctuations, which are typically mitigated through control actuators such as on-load tap changers (OLTC) as well as energy storage devices, such as battery energy storage systems (BESS). On the one hand, high intermittence of the available renewable portfolio may require increasingly aggressive control of actuators, thereby accelerating the probability of equipment failure. On the other hand, integrating BESS operations and having a diverse renewable generation portfolio can typically help stagger power/energy flow to mitigate the aforementioned adverse impacts. In this paper, we employ a Bayesian framework for equipment lifetime estimation to understand the impact of including tidal energy resources and BESS in distribution system operations for feeders having substantial distribution photovoltaic generation. Our results indicate that while tidal energy alone may slightly decrease equipment reliability, the adverse impact on reliability is significantly magnified by a generation portfolio consisting of tidal generation and photovoltaic generation. Here, we also study the tidal and photovoltaic hosting capacity problem with and without energy storage systems using equipment reliability as an added constraint. We conclude that energy storage increases the reliability-constrained hosting capacity of the distribution system.

14 SOLAR ENERGY↗

Bayesian model-data comparison incorporating theoretical uncertainties

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of properly accounting for theoretical uncertainties. In this Letter, we present a Bayesian framework that explicitly quantifies these uncertainties by statistically modeling theory errors, guided by qualitative knowledge of a theory’s varying reliability across the input domain. We demonstrate the effectiveness of this approach using two systems: a simple ball drop experiment and multi-stage heavy-ion simulations. In both cases incorporating model discrepancy leads to improved parameter estimates, with systematic improvements observed as additional experimental observables are integrated.

Bayesian methods↗