Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

Multi-Modal Bayesian Neural Network Surrogates with Conjugate Last-Layer Estimation

As data collection and simulation capabilities advance, multi-modal learning, the task of learning from multiple modalities and sources of data, is becoming an increasingly important area of research. Surrogate models that learn from data of multiple auxiliary modalities to support the modeling of a highly expensive quantity of interest have the potential to aid outer loop applications such as optimization, inverse problems, or sensitivity analyses when multi-modal data are available. We develop two multi-modal Bayesian neural network surrogate models and leverage conditionally conjugate distributions in the last layer to estimate model parameters using stochastic variational inference (SVI). We provide a method to perform this conjugate SVI estimation in the presence of partially missing observations. Here, we demonstrate improved prediction accuracy and uncertainty quantification compared to unimodal surrogate models for both scalar and time series data.

97 MATHEMATICS AND COMPUTING↗

Bayesian analysis of a future β decay experiment's sensitivity to neutrino mass scale and ordering

Bayesian modeling techniques enable sensitivity analyses that incorporate detailed expectations regarding future experiments. A model-based approach also allows one to evaluate inferences and predicted outcomes, by calibrating (or measuring) the consequences incurred when certain results are reported. In this work, we present procedures for calibrating predictions of an experiment's sensitivity to both continuous and discrete parameters. Using these procedures and a new Bayesian model of the β-decay spectrum, we assess a high-precision β-decay experiment's sensitivity to the neutrino mass scale and ordering for one assumed design scenario. We find that such an experiment could measure the electron-weighted neutrino mass within ~40 meV after 1 year (90% credibility). Neutrino masses > 500 meV could be measured within ≈5 meV. Using only β decay and external reactor neutrino data, we find that next-generation β-decay experiments could potentially constrain the mass ordering using a two-neutrino spectral model analysis. By calibrating mass ordering results, we identify reporting criteria that can be tuned to suppress false ordering claims. In some cases, a two-neutrino analysis can reveal that the mass ordering is inverted, an unobtainable result for the traditional one-neutrino analysis approach.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Dwarf spheroidal J-factor likelihoods for generalized NFW profiles

ABSTRACT Indirect detection strategies of particle dark matter (DM) in Dwarf spheroidal satellite galaxies (dSphs) typically entail searching for annihilation signals above the astrophysical background. To robustly compare model predictions with the observed fluxes of product particles, most analyses of astrophysical data – which are generally frequentist – rely on estimating the abundance of DM by calculating the so-called J factor. This quantity is usually inferred from the kinematic properties of the stellar population of a dSph using the Jeans equation, commonly by means of Bayesian techniques that entail the presence (and additional systematic uncertainty) of prior choice. Here, extending earlier work, we develop a scheme to derive the profile likelihood for J factors of dwarf spheroidals for models with five or more free parameters. We validate our method on a publicly available simulation suite, released by the Gaia Challenge, finding satisfactory statistical properties for bias and probability coverage. We present the profile likelihood function and maximum likelihood estimates for the J-factor of 10 dSphs. As an illustration, we apply these profile likelihoods to recently published analyses of γ-ray data with the Fermi Large Area Telescope to derive new, consistent upper limits on the DM annihilation cross-section. We do this for a subset of systems, generally referred to as classical dwarfs. The implications of these findings for DM searches are discussed, together with future improvements and extensions of this technique.

79 ASTRONOMY AND ASTROPHYSICS↗

Overview of Algorithms for Using Particle Morphology in Pre-Detonation Nuclear Forensics

A major goal in pre-detonation nuclear forensics is to infer the processing conditions and/or facility type that produced radiological material. This review paper focuses on analyses of particle size, shape, texture (“morphology”) signatures that could provide information on the provenance of interdicted materials. For example, uranium ore concentrates (UOC or yellowcake) include ammonium diuranate (ADU), ammonium uranyl carbonate (AUC), sodium diuranate (SDU), magnesium diuranate (MDU), and others, each prepared using different salts to precipitate U from solution. Once precipitated, UOCs are often dried and calcined to remove adsorbed water. The products can be allowed to react further, forming uranium oxides UO3, U3O8, or UO2 powders, whose surface morphology can be indicative of precipitation and/or calcination conditions used in their production. This review paper describes statistical issues and approaches in using quantitative analyses of measurements such as particle size and shape to infer production conditions. Statistical topics include multivariate t tests (Hotelling’s T 2 ), design of experiments, and several machine learning (ML) options including decision trees, learning vector quantization neural networks, mixture discriminant analysis, and approximate Bayesian computation (ABC). ABC is emphasized as an attractive option to include the effects of model uncertainty in the selected and fitted forward model used for inferring processing conditions.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Expectation propagation for nonlinear inverse problems – with an application to electrical impedance tomography

In this paper, we study a fast approximate inference method based on expectation propagation for exploring the posterior probability distribution arising from the Bayesian formulation of nonlinear inverse problems. It is capable of efficiently delivering reliable estimates of the posterior mean and covariance, thereby providing an inverse solution together with quantified uncertainties. Some theoretical properties of the iterative algorithm are discussed, and the efficient implementation for an important class of problems of projection type is described. The method is illustrated with one typical nonlinear inverse problem, electrical impedance tomography with complete electrode model, under sparsity constraints. Numerical results for real experimental data are presented, and compared with that by Markov chain Monte Carlo. The results indicate that the method is accurate and computationally very efficient.

97 MATHEMATICS AND COMPUTING↗

A Bayesian approach for parameter estimation and prediction using a computationally intensive model

Bayesian methods have been successful in quantifying uncertainty in physics-based problems in parameter estimation and prediction. In these cases, physical measurements y are modeled as the best fit of a physics-based model eta(theta), where theta denotes the uncertain, best input setting. Hence the statistical model is of the form y = eta(theta) + c, where epsilon accounts for measurement, and possibly other, error sources. When nonlinearity is present in eta(center dot), the resulting posterior distribution for the unknown parameters in the Bayesian formulation is typically complex and nonstandard, requiring computationally demanding computational approaches such as Markov chain Monte Carlo (MCMC) to produce multivariate draws from the posterior. Although generally applicable, MCMC requires thousands (or even millions) of evaluations of the physics model eta(center dot). This requirement is problematic if the model takes hours or days to evaluate. To overcome this computational bottleneck, we present an approach adapted from Bayesian model calibration. This approach combines output from an ensemble of computational model runs with physical measurements, within a statistical formulation, to carry out inference. A key component of this approach is a statistical response surface, or emulator, estimated from the ensemble of model runs. We demonstrate this approach with a case study in estimating parameters for a density functional theory model, using experimental mass/binding energy measurements from a collection of atomic nuclei. We also demonstrate how this approach produces uncertainties in predictions for recent mass measurements obtained at Argonne National Laboratory.

Higdon, Dave↗

Prime VI

SAND2025-03757O Prime VI is a distribution-of-disease outbreak model calibration code based on variational inference. It accompanies a publication for submission to Statistics in Medicine journal, and the code will be maintained for open-source use on Sandia's GitLab. The software provides methods for calibrating an epidemiological model to measured case-count data for a multitude of correlated spatial regions. The code solves a Bayesian inverse problem for model calibration where the posterior over-model parameters are approximated through a custom implementation of variational inference. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Safta, Cosmin↗

Bayesian Optimization of Catalysis with In-Context Learning

Large language models (LLMs) can perform accurate classification with zero or few examples through in-context learning (ICL), allowing the model to observe query-relevant examples at inference time and eliminating the need for additional weight updates to generalize beyond its original training data. We extend this capability to regression with uncertainty estimation using frozen LLMs (e.g., GPT-4o, Gemini), enabling Bayesian optimization (BO) in natural language without explicit model training or feature engineering. We apply this to materials discovery by representing materials as synthesis and testing procedures for use in natural language prompts. This Bayesian, design-first approach prioritizes optimization toward target material properties before detailed characterization, in contrast to conventional experimental workflows that often emphasize characterization of suboptimal materials. On benchmarks like aqueous solubility and oxidative coupling of methane (OCM), BO-ICL matches or outperforms Gaussian processes. In live experiments on the reverse water–gas shift (RWGS) reaction, BO-ICL identifies multimetallic catalysts that approach equilibrium CO yield within 6 and 10 iterations from a pool of 3,700 and 360,000 candidates, respectively. Our method redefines materials representation and accelerates discovery, with broad applications across catalysis, materials science, and AI.

Calibration↗

Bayesian-based Hyperparameter Optimization for Spiking Neuromorphic Systems

Designing a neuromorphic computing system involves selection of several hyperparameters that not only affect the accuracy of the framework, but also the energy efficiency and speed of inference and training. These hyperparameters might be inherent to the training of the spiking neural network (SNN), the input/output encoding of the real-world data to spikes, or the underlying neuromorphic hardware. In this work, we present a Bayesian-based hyperparameter optimization approach for spiking neuromorphic systems, and we show how this optimization framework can lead to significant improvement in designing accurate neuromorphic computing systems. In particular, we show that this hyperparameter optimization approach can discover the same optimal hyperparameter set for input encoding as a grid search, but with far fewer evaluations and far less time. We also show the impact of hardware-specific hyperparameters on the performance of the system, and we demonstrate that by optimizing these hyperparameters, we can achieve significantly better application performance.

Parsa, Maryam↗

Machine-learning-based inversion of nuclear responses

A microscopic description of the interaction of atomic nuclei with external electroweak probes is required for elucidating aspects of short-range nuclear dynamics and for the correct interpretation of neutrino oscillation experiments. Nuclear quantum Monte Carlo methods infer the nuclear electroweak response functions from their Laplace transforms. Inverting the Laplace transform is a notoriously ill-posed problem; and Bayesian techniques, such as maximum entropy, are typically used to reconstruct the original response functions in the quasielastic region. In this work, we present a physics-informed artificial neural network architecture suitable for approximating the inverse of the Laplace transform. Utilizing simulated, albeit realistic, electromagnetic response functions, we show that this physics-informed artificial neural network outperforms maximum entropy in both the low-energy transfer and the quasielastic regions, thereby allowing for robust calculations of electron scattering and neutrino scattering on nuclei and inclusive muon capture rates.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Posterior Covariance Matrix Approximations

Here, the Davis equation of state (EOS) is commonly used to model thermodynamic relationships for high explosive (HE) reactants. Typically, the parameters in the EOS are calibrated, with uncertainty, using a Bayesian framework and Markov Chain Monte Carlo (MCMC) methods. However, MCMC methods are computationally expensive, especially for complex models with many parameters. This paper provides a comparison between MCMC and less computationally expensive Variational methods (Variational Bayesian and Hessian Variational Bayesian) for computing the posterior distribution and approximating the posterior covariance matrix based on heterogeneous experimental data. All three methods recover similar posterior distributions and posterior covariance matrices. This study demonstrates that for this EOS parameter calibration application, the assumptions made in the two Variational methods significantly reduce the computational cost but do not substantially change the results compared to MCMC.

97 MATHEMATICS AND COMPUTING↗

A novel framework for increasing research transparency: Exploring the connection between diversity and innovation

A split sample/dual method research protocol is demonstrated to increase transparency while reducing the probability of false discovery. We apply the protocol to examine whether diversity in ownership teams increases or decreases the likelihood of a firm reporting a novel innovation using data from the 2018 United States Census Bureau’s Annual Business Survey. Transparency is increased in three ways: 1) all specification testing and identifying potentially productive models is done in an exploratory subsample that 2) preserves the validity of hypothesis test statistics fromde novoestimation in the holdout confirmatory sample with 3) all findings publicly documented in an earlier registered report and in this journal publication. Bayesian estimation procedures that leverage information from the exploratory stage included in the confirmatory stage estimation replace traditional frequentist null hypothesis significance testing. In addition to increasing statistical power by using information from the full sample, Bayesian methods directly estimate a probability distribution for the magnitude of an effect, allowing much richer inference. Estimated magnitudes of diversity along academic discipline, race, ethnicity, and foreign-born status dimensions are positively associated with innovation. A maximally diverse ownership team on these dimensions would be roughly six times more likely to report new-to-market innovation than a homophilic team.

Science & Technology - Other Topics↗

Hierarchical Bayesian Modeling for Cosmology: Can NPE reliably replace MCMC?

Hierarchical neural posterior estimation has its place Hierarchical Bayesian Modeling (HBM) combined with MCMC algorithms has been shown to provide more robust and accurate inference for real-world phenomena in which nature takes a nested form. However, MCMC-based inference can be computationally expensive, and its performance often suffers for complex posterior geometries. These costs are especially pertinent for HBM. Studies have recently demonstrated the potential for a flexible, expressive, and amortized hierarchical neural posterior estimator (HNPE) built on Normalizing Flows. These studies have mostly been performed on simple datasets, or they focus on a single parameter from each level of the hierarchy. A systematic study analyzing how both hierarchical methods compare for more complex and realistic datasets is necessary before applying HNPE for scientific measurements. Here, we re-explore the theory behind HNPE and conduct comparative numerical experiments of HNPE and MCMC-based HBM methods on real and synthetic data, including strong gravitational lensing simulations. In particular, we use a suite of diagnostics to show trade-offs in terms of accuracy, precision, time to train or sample, reproducibility, and the need for expert domain knowledge. Especially for higher dimensional and complex posteriors, HNPE is expected to drastically improve on time for inference, accuracy, and precision with an upfront training time cost.

Hur, Rachel [Chicago U.] (ORCID:000900089890445X)↗

The dense matter equation of state from neutron star radius and mass measurements

We present a comprehensive study of spectroscopic radius measurements of twelve neutron stars obtained during thermonuclear bursts or in quiescence. We incorporate, for the first time, a large number of systematic uncertainties in the measurement of the apparent angular sizes, Eddington fluxes, and distances, in the composition of the interstellar medium, and in the flux calibration of X-ray detectors. We also take into account the results of recent theoretical calculations of rotational effects on neutron star radii, of atmospheric effects on surface spectra, and of relativistic corrections to the Eddington critical flux. We employ Bayesian statistical frameworks to obtain neutron star radii from the spectroscopic measurements as well as to infer the equation of state from the radius measurements. Combining these with the results of experiments in the vicinity of nuclear saturation density and the observations of ∼2 M{sub ⊙} neutron stars, we place strong and quantitative constraints on the properties of the equation of state between ≈2--8 times the nuclear saturation density. We find that around M=1.5M{sub ⊙}, the preferred equation of state predicts radii between 10.1 and 11.1 km. When interpreting the pressure constraints in the context of high density equations of state based on interacting nucleons, our results suggest a relatively weak contribution of the three-body interaction potential.

79 ASTRONOMY AND ASTROPHYSICS↗

BAYESIAN ANALYSIS OF MULTIPLE HARMONIC OSCILLATIONS IN THE SOLAR CORONA

The detection of multiple mode harmonic kink oscillations in coronal loops enables us to obtain information on coronal density stratification and magnetic field expansion using seismology inversion techniques. The inference is based on the measurement of the period ratio between the fundamental mode and the first overtone and theoretical results for the period ratio under the hypotheses of coronal density stratification and magnetic field expansion of the wave guide. We present a Bayesian analysis of multiple mode harmonic oscillations for the inversion of the density scale height and magnetic flux tube expansion under each of the hypotheses. The two models are then compared using a Bayesian model comparison scheme to assess how plausible each one is given our current state of knowledge.

79 ASTRONOMY AND ASTROPHYSICS↗

BANYAN. V. A SYSTEMATIC ALL-SKY SURVEY FOR NEW VERY LATE-TYPE LOW-MASS STARS AND BROWN DWARFS IN NEARBY YOUNG MOVING GROUPS

We present the BANYAN All-Sky Survey (BASS) catalog, consisting of 228 new late-type (M4-L6) candidate members of nearby young moving groups (YMGs) with an expected false-positive rate of ∼13%. This sample includes 79 new candidate young brown dwarfs and 22 planetary-mass objects. These candidates were identified through the first systematic all-sky survey for late-type low-mass stars and brown dwarfs in YMGs. We cross-matched the Two Micron All Sky Survey and AllWISE catalogs outside of the galactic plane to build a sample of 98,970 potential ≥M5 dwarfs in the solar neighborhood and calculated their proper motions with typical precisions of 5-15 mas yr{sup –1}. We selected highly probable candidate members of several YMGs from this sample using the Bayesian Analysis for Nearby Young AssociatioNs II tool (BANYAN II). We used the most probable statistical distances inferred from BANYAN II to estimate the spectral type and mass of these candidate YMG members. We used this unique sample to show tentative signs of mass segregation in the AB Doradus moving group and the Tucana-Horologium and Columba associations. The BASS sample has already been successful in identifying several new young brown dwarfs in earlier publications, and will be of great interest in studying the initial mass function of YMGs and for the search of exoplanets by direct imaging; the input sample of potential close-by ≥M5 dwarfs will be useful to study the kinematics of low-mass stars and brown dwarfs and search for new proper motion pairs.

79 ASTRONOMY AND ASTROPHYSICS↗

A Bayesian view of the current status of dark matter direct searches

Bayesian statistical methods offer a simple and consistent framework for incorporating uncertainties into a multi-parameter inference problem. In this work we apply these methods to a selection of current direct dark matter searches. We consider the simplest scenario of spin-independent elastic WIMP scattering, and infer the WIMP mass and cross-section from the experimental data with the essential systematic uncertainties folded into the analysis. We find that when uncertainties in the scintillation efficiency of XENON100 have been accounted for, the resulting exclusion limit is not sufficiently constraining to rule out the CoGeNT preferred parameter region, contrary to previous claims. In the same vein, we also investigate the impact of astrophysical uncertainties on the preferred WIMP parameters. We find that within the class of smooth and isotropic WIMP velocity distributions, it is difficult to reconcile the DAMA and the CoGeNT preferred regions by tweaking the astrophysics parameters alone. If we demand compatibility between these experiments, then the inference process naturally concludes that a high value for the sodium quenching factor for DAMA is preferred.

79 ASTRONOMY AND ASTROPHYSICS↗

Evidence for Cosmic Acceleration Is Robust to Observed Correlations between Type Ia Supernova Luminosity and Stellar Age

Type Ia supernovae (SNe Ia) are powerful standardizable candles for constraining cosmological models and provided the first evidence of the accelerated expansion of the universe. Their precision derives from empirical correlations, now measured from >1000 SNe Ia, between their luminosities, light-curve shapes, colors, and most recently with the stellar mass of their host galaxy. As mass correlates with other galaxy properties, alternative parameters have been investigated to improve SN Ia standardization though none have been shown to significantly alter the determination of cosmological parameters. We re-examine a recent claim, based on 34 SN Ia in nearby passive host galaxies, of a 0.05 mag Gyr -1 dependence of standardized SN Ia luminosity on host age, which, if extrapolated to higher redshifts, would be a bias up to 0.25 mag, challenging the inference of dark energy. We reanalyze this sample of hosts using both the original method and a Bayesian hierarchical model and find after a fuller accounting of the uncertainties the significance of a dependence on age to be ≤2σ and ~1σ after the removal of a single poorly sampled SN Ia. Here, to test the claim that a trend seen in old stellar populations can be applied to younger ages, we extend our analysis to a larger sample that includes young hosts. We find the residual dependence of host age (after all standardization typically employed for cosmological measurements) to be consistent with zero for 254 SNe Ia from the Pantheon sample, ruling out the large but low significance trend seen in passive hosts.

79 ASTRONOMY AND ASTROPHYSICS↗