Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “posterior inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Bayesian operator inference for data-driven reduced-order modeling

This work proposes a Bayesian inference method for the reduced-order modeling of time-dependent systems. Informed by the structure of the governing equations, the task of learning a reduced-order model from data is posed as a Bayesian inverse problem with Gaussian prior and likelihood. The resulting posterior distribution characterizes the operators defining the reduced-order model, hence the predictions subsequently issued by the reduced-order model are endowed with uncertainty. The statistical moments of these predictions are estimated via a Monte Carlo sampling of the posterior distribution. Since the reduced models are fast to solve, this sampling is computationally efficient. Furthermore, the proposed Bayesian framework provides a statistical interpretation of the regularization term that is present in the deterministic operator inference problem, and the empirical Bayes approach of maximum marginal likelihood suggests a selection algorithm for the regularization hyperparameters. The proposed method is demonstrated on two examples: the compressible Euler equations with noise-corrupted observations, and a single-injector combustion process.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Accelerating cosmological inference with Gaussian processes and neural networks – an application to LSST Y1 weak lensing and galaxy clustering

ABSTRACT Studying the impact of systematic effects, optimizing survey strategies, assessing tensions between different probes and exploring synergies of different data sets require a large number of simulated likelihood analyses, each of which cost thousands of CPU hours. In this paper, we present a method to accelerate cosmological inference using emulators based on Gaussian process regression and neural networks. We iteratively acquire training samples in regions of high posterior probability which enables accurate emulation of data vectors even in high dimensional parameter spaces. We showcase the performance of our emulator with a simulated 3×2 point analysis of LSST-Y1 with realistic theoretical and systematics modelling. We show that our emulator leads to high-fidelity posterior contours, with an order of magnitude speed-up. Most importantly, the trained emulator can be re-used for extremely fast impact and optimization studies. We demonstrate this feature by studying baryonic physics effects in LSST-Y1 3×2 point analyses where each one of our MCMC runs takes approximately 5 min. This technique enables future cosmological analyses to map out the science return as a function of analysis choices and survey strategy.

Astronomy & Astrophysics↗
DOE OSTI2025

Can Neutron Star Tidal Effects Obscure Deviations from General Relativity?

Abstract One of the main goals of gravitational-wave astrophysics is to study gravity in the strong-field regime and constrain deviations from general relativity (GR). Any such deviation affects not only binary dynamics and gravitational-wave emission but also the structure and tidal properties of compact objects. In the case of neutron stars, masses, radii, and tidal deformabilities can all differ significantly between different theories of gravity. Currently, the measurement uncertainties in neutron star radii and tidal deformabilities are quite large. However, much less is known about how the large uncertainty in the nuclear equation of state (EOS) might affect tests of GR using binary neutron star mergers. Conversely, using the wrong theory of gravity might lead to incorrect constraints on the nuclear EOS. Here, we study this problem within scalar–tensor (ST) theory. We apply the recently derived ℓ = 2 tidal Love numbers in this theory to parameter estimation of GW170817. Correspondingly, we test if physics beyond GR could bias measurements of the nuclear EOS and neutron star radii. We find that parameter inference for both the GR and ST cases returns consistent component masses and tidal deformabilities. The radius and the EOS posteriors, however, differ between the two theories, but neither is excluded by current observational limits. This indicates that measurements of the nuclear EOS may be biased and that deviations from GR could go undetected when analyzing current binary neutron star mergers.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Value-of-Information Analysis of a Fracture Prediction Method

A core-based fracture prediction method is used to illustrate a Value of Information (VOI) decision-analysis protocol to inform completion decisions in tight-gas sandstones. The ratio of late host-rock cement to available pore volume or degradation index uses petrographic observations of cement distributions in core (including sidewall cores) to predict whether nearby but unsampled fractures (widths > 0.5 to 1 mm) are sealed (non-conductive) or open (conductive). Measurements from four sandstone plays suggest that the index correctly predicts open vs. sealed fractures with an accuracy in excess of 80%. The value added is calculated using Bayesian inference in which accuracy of the index serves as the likelihood of the prior distribution of open fractures to assess the posterior probability that data represent a useful predictor of producibility. VOI of the prediction method is more than three times the cost to acquire the data. VOI is most sensitive to play-specific geologic and cost parameters including cost to drill, expected revenue from a successful well, cost of completion, cost of acquiring data for the index, and fracture probability distributions. The approach provides a way to value acquiring fracture data and points to a need for zone-specific production data in tight-gas sandstones.

02 PETROLEUM↗
DOE OSTI2021

Dark Matter Constraints from a Unified Analysis of Strong Gravitational Lenses and Milky Way Satellite Galaxies

Joint analyses of small-scale cosmological structure probes have been relatively unexplored yet promise to advance measurements of microphysical dark matter properties using heterogeneous data. Here, we present a multidimensional analysis of dark matter substructure using strong gravitational lenses and the Milky Way (MW) satellite galaxy population, accounting for degeneracies in model predictions and using covariances in the constraining power of these individual probes for the first time. We simultaneously infer the projected subhalo number density and the half-mode mass describing the suppression of the subhalo mass function in thermal relic warm dark matter (WDM), $M_{\mathrm{hm}}$, using the semianalytic model \texttt{Galacticus} to connect the subhalo population inferred from MW satellite observations to the strong lensing host halo mass and redshift regime. Combining MW satellite and strong lensing posteriors in this parameter space yields $M_{\mathrm{hm}}<10^{7.0}\ M_{\mathrm{\odot}}$ (WDM particle mass $m_{\mathrm{WDM}}>9.7\ \mathrm{keV}$) at $95\%$ confidence and disfavors $M_{\mathrm{hm}}=10^{7.4}\ M_{\mathrm{\odot}}$ ($m_{\mathrm{WDM}}=7.4\ \mathrm{keV}$) with a 20:1 marginal likelihood ratio, improving limits on $m_{\mathrm{WDM}}$ set by the two methods independently by $\sim 30\%$. These results are marginalized over the line-of-sight contribution to the strong lensing signal, the mass of the MW host halo, and the efficiency of subhalo disruption due to baryons and are robust to differences in the disruption efficiency between the MW and strong lensing regimes at the $\sim 10\%$ level. This work paves the way for unified analyses of next-generation small-scale structure measurements covering a wide range of scales and redshifts.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Bayesian quantification of observability and equation of state of twin stars

The possibility of discovering twin stars, two neutron stars (NSs) with the same mass but different radii, is usually studied in forward modelings by using a restricted number of NS matter equations of state (EOSs) encapsulating a first-order phase transition from hadronic to quark matter (QM). Informing our likelihood function with the NS radius data from GW170817 and using a metamodel with nine parameters capable of mimicking most NS EOSs available in the literature, we conduct a Bayesian quantification of the observability and underlying EOSs of twin stars. Of the accepted EOSs, between 12 and 18% yield twin stars, depending on the restrictions we place on the second branch. The possibility of twin stars remains robust even under recent observational constraints. Here, we show that many of these twin star scenarios are observable with currently available levels of accuracy in measuring NS radii. We also present the marginalized posterior probability density functions (PDFs) of every EOS parameter for each of four mass-radius correlation topologies. We find that the inferred EOS depends sensitively on not only whether twin stars are present, but also the category of twin stars, indicating that the observation of twin stars would provide a strong constraint on the underlying EOS. In particular, for two coexisting hybrid stars having QM cores at different densities, the PDF for QM speed of sound squared 𝑐$^2_{qm}$ has two peaks, one below and another above the conformal limit 𝑐$^2_{qm}$ = 1/3 predicted by perturbative QCD.

QCD in nuclear reactions↗
DOE OSTI2026

py-boomer v0.1.0

Py-BOOMER (Python Bayesian OWL Ontology MErgER in Python) is a probabilistic reasoning system for knowledge representation and ontological reasoning with uncertainty. Itnables reasoning over probabilistic facts and taxonomic relationships, finding the most likely consistent interpretation of potentially conflicting assertions. It uses a combination of graph-based reasoning and Bayesian probabilistic inference. Key features: Represent probabilistic ontological statements Reason over class subsumption hierarchies Evaluate class equivalence relationships Detect and resolve logical inconsistencies Calculate posterior probabilities for each assertion

Mungall, Chris [Lawrence Berkeley National Laborat↗
DOE OSTI2024

popclass

popclass is a lightweight python package that allows fast, probabilistic classification of the lens of a microlensing event given the event's posterior distribution and a model of the Galaxy. popclass provides the bridge between Galactic simulation and lens classification, an interface to common Bayesian inference libraries, and the ability for users to flexibly specify their own Galactic model and classification parameters.

Mcgill, Peter↗
DOE OSTI2021

Bayesian Optimal Sensor Augmentation Via Estimated Mutual Information

We consider the problem of designing a sensor network to most efficiently locate the source of a seismic event. The left panel of Figure 1 shows 982 possible sensor locations in a region of interest. The objective is to infer the unknown location of an earthquake, indicated by the gold dot for illustration purposes. Assume that three sensors have already been placed for data collection. Travel times of the P-wave from the source to the three sensors are observed and used to infer the unknown source location via a Bayesian statistical model described subsequently. The right panel of Figure 1 shows samples from the resulting posterior distribution for source location along with a posterior estimate of this location.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Scalable Algorithms for Inverse Problems With High-Dimensional Parameter Spaces

Inverse problems, which involve inferring unknown parameters from observed data, present significant computational challenges, especially in large-scale settings with high-dimensional unknown parameters and nonlinear relationships between the unknowns and observations. Bayesian inference provides an approach for addressing these problems, often relying on sequential sampling methods like Markov chain Monte Carlo (MCMC) to approximate the posterior distribution of the parameters. However, MCMC methods become computationally demanding as the dimensionality of the problem increases, particularly in large-scale systems where likelihood evaluations rely on solving partial differential equations (PDEs) on large spatial domains with finely resolved meshes. To overcome these limitations, recent advancements have focused on designing scalable computa tional techniques – for both PDE simulations and sampling strategies – to make Bayesian methods feasible for high-dimensional problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Robust scalable initialization for Bayesian variational inference with multi-modal Laplace approximations

Predictive modeling typically relies on Bayesian model calibration to provide uncertainty quantification. Variational inference utilizing fully independent (“mean-field”) Gaussian distributions are often used as approximate probability density functions. This simplification is attractive since the number of variational parameters grows only linearly with the number of unknown model parameters. However, the resulting diagonal covariance structure and unimodal behavior can be too restrictive to provide useful approximations of intractable Bayesian posteriors that exhibit highly non-Gaussian behavior, including multimodality. High-fidelity surrogate posteriors for these problems can be obtained by considering the family of Gaussian mixtures. Gaussian mixtures are capable of capturing multiple modes and approximating any distribution to an arbitrary degree of accuracy, while maintaining some analytical tractability. Unfortunately, variational inference using Gaussian mixtures with full-covariance structures suffers from a quadratic growth in variational parameters with the number of model parameters. The existence of multiple local minima due to strong nonconvex trends in the loss functions often associated with variational inference present additional complications, These challenges motivate the need for robust initialization procedures to improve the performance and computational scalability of variational inference with mixture models. In this work, we propose a method for constructing an initial Gaussian mixture model approximation that can be used to warm-start the iterative solvers for variational inference. The procedure begins with a global optimization stage in model parameter space. In this step, local gradient-based optimization, globalized through multistart, is used to determine a set of local maxima, which we take to approximate the mixture component centers. Around each mode, a local Gaussian approximation is constructed via the Laplace approximation. Finally, the mixture weights are determined through constrained least squares regression. The robustness and scalability of the proposed methodology is demonstrated through application to an ensemble of synthetic tests using high-dimensional, multimodal probability density functions. Here, the practical aspects of the approach are demonstrated with inversion problems in structural dynamics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A Conditional Autoencoder for Galaxy Photometric Parameter Estimation

Astronomical photometric surveys routinely image billions of galaxies, and traditionally infer the parameters of a parametric model for each galaxy. This approach has served us well, but the computational expense of deriving a full posterior probability distribution function is a challenge for increasingly ambitious surveys. In this paper, we use deep learning methods to characterize galaxy images, training a conditional autoencoder on mock data. The autoencoder can reconstruct and denoise galaxy images via a latent space engineered to include semantically meaningful parameters, such as brightness, location, size, and shape. Our model recovers galaxy fluxes and shapes on mock data with a lower variance than the Hyper Suprime-Cam photometry pipeline, and returns reasonable answers even for inputs outside the range of its training data. When applied to data in the training range, the regression errors on all extracted parameters are nearly unbiased with a variance near the Cramr-Rao bound.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Dimensional Reduction for Sampled Priors and Application to Photometric Redshift Distributions

A typical Bayesian inference on the values of some parameters of interest q from some data D involves running a Markov Chain (MC) to sample from the posterior $p$($q$,$n$|$D$) $\propto$ $\mathcal{L}$($D$|$q$,$n$)$p$(q)$p$($n$), where n are some nuisance parameters with a separable prior. In some cases, the nuisance parameters are high-dimensional, and their prior p(n) is itself defined only by a set of samples that have been drawn from some other MC. The MC for the posterior will typically require evaluation of p(n) at arbitrary values of n, i.e., one needs to provide a density estimator over the full n space from the provided samples. But the high dimensionality of n hinders both the density estimation and the efficiency of the MC for the posterior. We describe a solution to this problem: a linear compression of the n space into a much lower-dimensional space u, which projects away directions in n space that cannot appreciably alter $\mathcal{L}$. The algorithm for doing so is a slight modification to principal components analysis, and is less restrictive on p(n) than other proposed solutions to this issue. We demonstrate this “mode projection” technique using the analysis of 2-point correlation functions of weak lensing fields and galaxy density in the Dark Energy Survey, where n is a binned representation of the redshift distribution n(z) of the galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Probabilistic Nanomagnetic Memories for Uncertain and Robust Machine Learning

This project evaluated the use of emerging spintronic memory devices for robust and efficient variational inference schemes. Variational inference (VI) schemes, which constrain the distribution for each weight to be a Gaussian distribution with a mean and standard deviation, are a tractable method for calculating posterior distributions of weights in a Bayesian neural network such that this neural network can also be trained using the powerful backpropagation algorithm. Our project focuses on domain-wall magnetic tunnel junctions (DW-MTJs), a powerful multi-functional spintronic synapse design that can achieve low power switching while also opening the pathway towards repeatable, analog operation using fabricated notches. Our initial efforts to employ DW-MTJs as an all-in-one stochastic synapse with both a mean and standard deviation didn’t end up meeting the quality metrics for hardware-friendly VI. In the future, new device stacks and methods for expressive anisotropy modification may make this idea still possible. However, as a fall back that immediately satisfies our requirements, we invented and detailed how the combination of a DW-MTJ synapse encoding the mean and a probabilistic Bayes-MTJ device, programmed via a ferroelectric or ionically modifiable layer, can robustly and expressively implement VI. This design includes a physics-informed small circuit model, that was scaled up to perform and demonstrate rigorous uncertainty quantification applications, up to and including small convolutional networks on a grayscale image classification task, and larger (Residual) networks implementing multi-channel image classification. Lastly, as these results and ideas all depend upon the idea of an inference application where weights (spintronic memory states) remain non-volatile, the retention of these synapses for the notched case was further interrogated. These investigations revealed and emphasized the importance of both notch geometry and anisotropy modification in order to further enhance the endurance of written spintronic states. In the near future, these results will be mapped to effective predictions for room temperature and elevated operation DW-MTJ memory retention, and experimentally verified when devices become available.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2024

Differentiable stochastic halo occupation distribution

ABSTRACT In this work, we demonstrate how differentiable stochastic sampling techniques developed in the context of deep reinforcement learning can be used to perform efficient parameter inference over stochastic, simulation-based, forward models. As a particular example, we focus on the problem of estimating parameters of halo occupation distribution (HOD) models that are used to connect galaxies with their dark matter haloes. Using a combination of continuous relaxation and gradient re-parametrization techniques, we can obtain well-defined gradients with respect to HOD parameters through discrete galaxy catalogue realizations. Having access to these gradients allows us to leverage efficient sampling schemes, such as Hamiltonian Monte Carlo, and greatly speed up parameter inference. We demonstrate our technique on a mock galaxy catalogue generated from the Bolshoi simulation using a standard HOD model and find near-identical posteriors as standard Markov chain Monte Carlo techniques with an increase of ∼8× in convergence efficiency. Our differentiable HOD model also has broad applications in full forward model approaches to cosmic structure and cosmological analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Constraining Cosmology with Simulation-based inference and Optical Galaxy Cluster Abundance

We test the robustness of simulation-based inference (SBI) in the context of cosmological parameter estimation from galaxy cluster counts and masses in simulated optical datasets. We construct ``simulations'' using analytical models for the galaxy cluster halo mass function (HMF) and for the observed richness (number of observed member galaxies) to train and test the SBI method. We compare the SBI parameter posterior samples to those from an MCMC analysis that uses the same analytical models to construct predictions of the observed data vector. The two methods exhibit comparable performance, with reliable constraints derived for the primary cosmological parameters, ($\Omega_m$ and $\sigma_8$), and richness-mass relation parameters. We also perform out-of-domain tests with observables constructed from galaxy cluster-sized halos in the Quijote simulations. Again, the SBI and MCMC results have comparable posteriors, with similar uncertainties and biases. Unsurprisingly, upon evaluating the SBI method on thousands of simulated data vectors that span the parameter space, SBI exhibits worsened posterior calibration metrics in the out-of-domain application. We note that such calibration tests with MCMC is less computationally feasible and highlight the potential use of SBI to stress-test limitations of analytical models, such as in the use for constructing models for inference with MCMC.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Thermal Experiments for Fractured Rock Characterization: Theoretical Analysis and Inverse Modeling

Abstract Field‐scale properties of fractured rocks play a crucial role in many subsurface applications, yet methodologies for identification of the statistical parameters of a discrete fracture network (DFN) are scarce. We present an inversion technique to infer two such parameters, fracture density and fractal dimension, from cross‐borehole thermal experiments data. It is based on a particle‐based heat‐transfer model, whose evaluation is accelerated with a deep neural network (DNN) surrogate that is integrated into a grid search. The DNN is trained on a small number of the heat‐transfer model runs and predicts the cumulative density function of the thermal field. The latter is used to compute fine posterior distributions of the (to be estimated) parameters. Our synthetic experiments reveal that fracture density is well constrained by data, while fractal dimension is harder to determine. Adding nonuniform prior information related to the DFN connectivity improves the inference of this parameter.

Zhou, Zitong↗
DOE OSTI2026

A Bayesian inferencing framework for ultrasound wave speed measurements in metal additive manufacturing

Process-related changes during metal additive manufacturing introduce microstructural variability in the material properties of printed parts, directly affecting component reliability. Accurate estimation of these property variations with part performance are essential for quality assurance. Ultrasound testing offers a non-destructive means to estimate mechanical properties and detect defects; however, conventional analysis methods often neglect the influence of microstructural variability, limiting their effectiveness. Here, this research presents a Bayesian inference technique for quantifying wave speed uncertainty from ultrasound measurements of metal additive manufactured parts. By integrating prior ultrasound data with a Bayesian model, the proposed approach generates posterior density estimates of wave speed that systematically account for manufacturing-induced variability and uncertainty. The novelty of this research lies in applying a Bayesian framework to analyze experimental ultrasound measurements within the context of metal additive manufacturing variability. The method enhances the accuracy of wave speed estimation by 64%, defect position by 50% and increases confidence associated with wave speed variance by 30% across different porosity levels, thereby providing a robust foundation for improved decision-making and increased reliability in additively manufactured components.

Additive manufacturing↗