Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Fitting the phenomenological MSSM

We perform a global Bayesian fit of the phenomenological minimal supersymmetric standard model (pMSSM) to current indirect collider and dark matter data. The pMSSM contains the most relevant 25 weak-scale MSSM parameters, which are simultaneously fit using 'nested sampling' Monte Carlo techniques in more than 15 years of CPU time. We calculate the Bayesian evidence for the pMSSM and constrain its parameters and observables in the context of two widely different, but reasonable, priors to determine which inferences are robust. We make inferences about sparticle masses, the sign of the {mu} parameter, the amount of fine-tuning, dark matter properties, and the prospects for direct dark matter detection without assuming a restrictive high-scale supersymmetry breaking model. We find the inferred lightest CP-even Higgs boson mass as an example of an approximately prior-independent observable. This analysis constitutes the first statistically convergent pMSSM global fit to all current data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Strong Lensing Parameter Estimation on Ground-Based Imaging Data Using Simulation-Based Inference

Current ground-based cosmological surveys, such as the Dark Energy Survey (DES), are predicted to discover thousands of galaxy-scale strong lenses, while future surveys, such as the Vera Rubin Observatory Legacy Survey of Space and Time (LSST) will increase that number by 1-2 orders of magnitude. The large number of strong lenses discoverable in future surveys will make strong lensing a highly competitive and complementary cosmic probe. To leverage the increased statistical power of the lenses that will be discovered through upcoming surveys, automated lens analysis techniques are necessary. We present two Simulation-Based Inference (SBI) approaches for lens parameter estimation of galaxy-galaxy lenses. We demonstrate the successful application of Neural Posterior Estimation (NPE) to automate the inference of a 12-parameter lens mass model for DES-like ground-based imaging data. We compare our NPE constraints to a Bayesian Neural Network (BNN) and find that it outperforms the BNN, producing posterior distributions that are for the most part both more accurate and more precise; in particular, several source-light model parameters are systematically biased in the BNN implementation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Bayesian Analysis of Congruence of Core Genes in Prochlorococcus and Synechococcus and Implications on Horizontal Gene Transfer

It is often suggested that horizontal gene transfer is so ubiquitous in microbes that the concept of a phylogenetic tree representing the pattern of vertical inheritance is oversimplified or even positively misleading. “Universal proteins” have been used to infer the organismal phylogeny, but have been criticized as being only the “tree of one percent.” Currently, few options exist for those wishing to rigorously assess how well a universal protein phylogeny, based on a relative handful of well-conserved genes, represents the phylogenetic histories of hundreds of genes. Here, we address this problem by proposing a visualization method and a statistical test within a Bayesian framework. We use the genomes of marine cyanobacteria, a group thought to exhibit substantial amounts of HGT, as a test case. We take 379 orthologous gene families from 28 cyanobacteria genomes and estimate the Bayesian posterior distributions of trees – a “treecloud” – for each, as well as for a concatenated dataset based on putative “universal proteins.” We then calculate the average distance between trees within and between all treeclouds on various metrics and visualize this high-dimensional space with non-metric multidimensional scaling (NMMDS). We show that the tree space is strongly clustered and that the universal protein treecloud is statistically significantly closer to the center of this tree space than any individual gene treecloud. We apply several commonly-used tests for incongruence/HGT and show that they agree HGT is rare in this dataset, but make different choices about which genes were subject to HGT. Our results show that the question of the representativeness of the “tree of one percent” is a quantitative empirical question, and that the phylogenetic central tendency is a meaningful observation even if many individual genes disagree due to the various sources of incongruence.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian uncertainty quantification for nuclear matter incompressibility

Within a Bayesian statistical framework using the standard Skyrme-Hartree-Fock model, the maximum a posteriori (MAP) values and uncertainties of nuclear matter incompressibility and isovector interaction parameters are inferred from the experimental data of giant resonances and neutron-skin thicknesses of typical heavy nuclei. Furthermore, with the uncertainties of the isovector interaction parameters constrained by the data of the isovector giant dipole resonance and the neutron-skin thickness, we have obtained K 0 = 223$^{+7}_{–8}$ MeV at 68% confidence level using the data of the isoscalar giant monopole resonance in 208 Pb measured at the Research Center for Nuclear Physics (RCNP), Japan, and at the Texas A&M University, USA. Although the corresponding 120 Sn data gives a MAP value for K 0 about 5 MeV smaller than the 208 Pb data, there are significant overlaps in their posterior probability distribution functions.

190 ≤ A ≤ 219↗

Summer Intern Report: Multiple-Event Seismic Location Using Bayesian Inversion: Case Study Using Newberry Enhanced Geothermal System Data

The central idea of the method used in the work is representing all the information we have using probability densities and then using inversion method to infer the A posteriori probability density of the model parameters we would like to know from all these information we have. This information includes forward model (the assumption we made on the problem and the theory we use for arrival time calculation), observations (arrival time), and A prior information on the model parameters (all other information we have on model parameters before the inversion).

58 GEOSCIENCES↗

NASA’s Pandora SmallSat Mission: Simulating the Impact of Stellar Photospheric Heterogeneity and Its Correction

Stellar photospheric heterogeneity is a dominant astrophysical systematic impacting exoplanet transmission spectroscopy. NASA’s Pandora SmallSat Mission is designed to address this challenge through contemporaneous visible-band photometry and near-infrared spectroscopy of exoplanet host stars. Here, we present an end-to-end simulation study quantifying Pandora’s ability to infer stellar photospheric properties and correct stellar contamination using out-of-transit observations. We construct eight representative stellar activity scenarios and generate 160 simulated Pandora datasets, incorporating time-dependent stellar spectra, instrument response, and noise. Given accurate models, Bayesian retrievals of joint visible photometry (0.4–0.7 μm) and near-infrared spectroscopy (0.9–1.6 μm, R ≈ 120) recover photospheric temperatures with typical uncertainties of ≈30 K, with no significant bias. Models with two spectral components (i.e., a quiescent photosphere and spots) are strongly favored in 95% of cases; one-component models are preferred when true spot filling factors fall below a detection threshold of ≈0.3%. We propagate the true and inferred stellar parameters to compute true, inferred, and residual contamination signals under physically motivated spot geometries. For simple spot distributions, contamination signals of 10 2 –10 3 ppm are reduced to ≲10 ppm—well below Pandora’s expected transmission spectroscopy precision (30–100 ppm). For more complex spot distributions, geometric degeneracies limit deterministic corrections, leaving residual contamination at the 10 3 ppm level that must be mitigated using additional constraints, such as spot-crossing events and joint stellar–planetary retrievals of transmission spectra. These results define regimes in which stellar contamination can be corrected from stellar observations alone and show how Pandora stellar observations can identify cases where additional information is required.

Astronomy and AstroPhysics↗

Understanding the formation and evolution of interstellar ices: a Bayesian approach

Understanding the physical conditions of dark molecular clouds and star-forming regions is an inverse problem subject to complicated chemistry that varies nonlinearly with both time and the physical environment. In this paper, we apply a Bayesian approach based on a Markov chain Monte Carlo (MCMC) method for solving the nonlinear inverse problems encountered in astrochemical modeling. We use observations for ice and gas species in dark molecular clouds and a time-dependent, gas-grain chemical model to infer the values of the physical and chemical parameters that characterize quiescent regions of molecular clouds. We show evidence that in high-dimensional problems, MCMC algorithms provide a more efficient and complete solution than more classical strategies. The results of our MCMC method enable us to derive statistical estimates and uncertainties for the physical parameters of interest as a result of the Bayesian treatment.

79 ASTRONOMY AND ASTROPHYSICS↗

Robust sampling for weak lensing and clustering analyses with the Dark Energy Survey

Recent cosmological analyses rely on the ability to accurately sample from high-dimensional posterior distributions. A variety of algorithms have been applied in the field, but justification of the particular sampler choice and settings is often lacking. Here, we investigate three such samplers to motivate and validate the algorithm and settings used for the Dark Energy Survey (DES) analyses of the first 3 yr (Y3) of data from combined measurements of weak lensing and galaxy clustering. We employ the full DES Year 1 likelihood alongside a much faster approximate likelihood, which enables us to assess the outcomes from each sampler choice and demonstrate the robustness of our full results. We find that the ellipsoidal nested sampling algorithm multinest reports inconsistent estimates of the Bayesian evidence and somewhat narrower parameter credible intervals than the sliced nested sampling implemented in polychord. We compare the findings from multinest and polychord with parameter inference from the Metropolis–Hastings algorithm, finding good agreement. We determine that polychord provides a good balance of speed and robustness for posterior and evidence estimation, and recommend different settings for testing purposes and final chains for analyses with DES Y3 data. Our methodology can readily be reproduced to obtain suitable sampler settings for future surveys.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Selecting a model of supersymmetry breaking mediation

We study the problem of selecting between different mechanisms of supersymmetry breaking in the minimal supersymmetric standard model using current data. We evaluate the Bayesian evidence of four supersymmetry breaking scenarios: mSUGRA, mGMSB, mAMSB, and moduli mediation. The results show a strong dependence on the dark matter assumption. Using the inferred cosmological relic density as an upper bound, minimal anomaly mediation is at least moderately favored over the CMSSM. Our fits also indicate that evidence for a positive sign of the {mu} parameter is moderate at best. We present constraints on the anomaly and gauge mediated parameter spaces and some previously unexplored aspects of the dark matter phenomenology of the moduli mediation scenario. We use sparticle searches, indirect observables and dark matter observables in the global fit and quantify robustness with respect to prior choice. We quantify how much information is contained within each constraint.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Multiclass Classification Using Bayesian Multivariate Adaptive Regression Splines

We present a new Bayesian model for the problem of multiclass classification. In this model, the probabilities of class membership of a given observation are determined by the mean of a latent Gaussian distribution. The mean functions of this latent distribution consist of combinations of highly flexible basis functions of the inputs: multivariate adaptive regression splines (MARS), first developed for multiple regression. We use reversible jump Markov chain Monte Carlo to make inference on the classification model, including the number of basis functions. We compare the probabilistic classification performance of our proposed approach to existing methods on simulated and benchmark data, and compare uncertainty estimates on simulated data. Our proposed method compares favorably with existing Bayesian and frequentist multiclass classification methods in out-of-sample probabilistic classification, and uncertainty estimation of these probabilistic classifications. We examine the fit of the proposed method to a data set of hurricane storm surge levels near Delaware Bay, US, and conclude that sea level rise is a key contributor to damage delivered by storm surge.

97 MATHEMATICS AND COMPUTING↗

Anthropogenic Impacts on Atmospheric Carbonyl Sulfide Since the 19th Century Inferred From Polar Firn Air and Ice Core Measurements

Carbonyl sulfide (COS) was measured in firn air collected during seven different field campaigns carried out at four different sites in Greenland and Antarctica between 2001 and 2015. A Bayesian probabilistic statistical model is used to conduct multisite inversions and to reconstruct separate atmospheric histories for Greenland and Antarctica. The firn air inversions cover most of the 20th century over Greenland and extend back to the 19th century over Antarctica. The derived atmospheric histories are consistent with independent surface air time series data from the corresponding sites and the Antarctic ice core COS records during periods of overlap. Atmospheric COS levels began to increase over preindustrial levels starting in the 19th century, and the increase continued for much of the 20th century. Atmospheric COS peaked at higher than present-day levels around 1975 CE over Greenland and around 1987 CE over Antarctica. An atmosphere/surface ocean box model is used to investigate the possible causes of observed variability. The results suggest that changes in the magnitude and location of anthropogenic sources have had a strong influence on the observed atmospheric COS variability.

54 ENVIRONMENTAL SCIENCES↗

Efficient uncertainty quantification methodologies for high-dimensional climate land models

In this report, we proposed, examined and implemented approaches for performing efficient uncertainty quantification (UQ) in climate land models. Specifically, we applied Bayesian compressive sensing framework to a polynomial chaos spectral expansions, enhanced it with an iterative algorithm of basis reduction, and investigated the results on test models as well as on the community land model (CLM). Furthermore, we discussed construction of efficient quadrature rules for forward propagation of uncertainties from high-dimensional, constrained input space to output quantities of interest. The work lays grounds for efficient forward UQ for high-dimensional, strongly non-linear and computationally costly climate models. Moreover, to investigate parameter inference approaches, we have applied two variants of the Markov chain Monte Carlo (MCMC) method to a soil moisture dynamics submodel of the CLM. The evaluation of these algorithms gave us a good foundation for further building out the Bayesian calibration framework towards the goal of robust component-wise calibration.

54 ENVIRONMENTAL SCIENCES↗

Sequential Monte Carlo for Cut-Bayesian Posterior Computation

We propose a sequential Monte Carlo (SMC) method to efficiently and accurately compute cut-Bayesian posterior quantities of interest, variations of standard Bayesian approaches constructed primarily to account for model misspecification. We prove finite sample concentration bounds for estimators derived from the proposed method along with a linear tempering extension and apply these results to a realistic setting where a computer model is misspecified. We then illustrate the SMC method for inference in a modular chemical reactor example that includes submodels for reaction kinetics, turbulence, mass transfer, and diffusion. The samples obtained are commensurate with a direct-sampling approach that consists of running multiple Markov chains, with computational efficiency gains using the SMC method. Overall, the SMC method presented yields a novel, rigorous approach to computing with cut-Bayesian posterior distributions.

97 MATHEMATICS AND COMPUTING↗

LISA extreme-mass-ratio inspiral events as probes of the black hole mass function

One of the sources of gravitational waves for the proposed space-based gravitational wave detector, the Laser Interferometer Space Antenna (LISA), are the inspirals of compact objects into supermassive black holes in the centers of galaxies--extreme-mass-ratio inspirals (EMRIs). Using LISA observations, we will be able to measure the parameters of each EMRI system detected to very high precision. However, the statistics of the set of EMRI events observed by LISA will be more important in constraining astrophysical models than extremely precise measurements for individual systems. The black holes to which LISA is most sensitive are in a mass range that is difficult to probe using other techniques, so LISA provides an almost unique window onto these objects. In this paper we explore, using Bayesian techniques, the constraints that LISA EMRI observations can place on the mass function of black holes at low redshift. We describe a general framework for approaching inference of this type--using multiple observations in combination to constrain a parametrized source population. Assuming that the scaling of the EMRI rate with the black-hole mass is known and taking a black-hole distribution given by a simple power law, dn/dlnM=A{sub 0}(M/M{sub *}){sup {alpha}}{sub 0}, we find that LISA could measure the parameters to a precision of {Delta}(lnA{sub 0}){approx}0.08, and {Delta}({alpha}{sub 0}){approx}0.03 for a reference model that predicts {approx}1000 events. Even with as few as 10 events, LISA should constrain the slope to a precision {approx}0.3, which is the current level of observational uncertainty in the low-mass slope of the black-hole mass function. We also consider a model in which A{sub 0} and {alpha}{sub 0} evolve with redshift, but find that EMRI observations alone do not have much power to probe such an evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

Estimating Material Properties Under Extreme Conditions by Using Bayesian Model Calibration with Functional Outputs

Summary Dynamic material properties experiments provide access to the most extreme temperatures and pressures attainable in a laboratory setting; the data from these experiments are often used to improve our understanding of material models at these extreme conditions. We apply Bayesian model calibration to dynamic material property applications where the experimental output is a function: velocity over time. This framework can accommodate more uncertainties and facilitate analysis of new types of experiments relative to techniques traditionally used to analyse dynamic material experiments. However, implementation of Bayesian model calibration requires more sophisticated statistical techniques, because of the functional nature of the output as well as parameter and model discrepancy identifiability. We propose a novel Bayesian model calibration process to simplify and improve the estimation of the material property calibration parameters. Specifically, we propose scaling the likelihood function by an effective sample size rather than modelling the auto-correlation function to accommodate the functional output. Additionally, we propose sensitivity analyses by using the notion of 'modularization' to assess the effect of experiment-specific nuisance input parameters on estimates of the physical parameters. The Bayesian model calibration framework proposed is applied to dynamic compression of tantalum to extreme pressures, and we conclude that the procedure results in simple, fast and valid inferences on the material properties for tantalum.

36 MATERIALS SCIENCE↗

Uncertainty quantification in multivariable regression for material property prediction with Bayesian neural networks

With the increased use of data-driven approaches and machine learning-based methods in material science, the importance of reliable uncertainty quantification (UQ) of the predicted variables for informed decision-making cannot be overstated. UQ in material property prediction poses unique challenges, including multi-scale and multi-physics nature of materials, intricate interactions between numerous factors, limited availability of large curated datasets, etc. In this work, we introduce a physics-informed Bayesian Neural Networks (BNNs) approach for UQ, which integrates knowledge from governing laws in materials to guide the models toward physically consistent predictions. To evaluate the approach, we present case studies for predicting the creep rupture life of steel alloys. Experimental validation with three datasets of creep tests demonstrates that this method produces point predictions and uncertainty estimations that are competitive or exceed the performance of conventional UQ methods such as Gaussian Process Regression. Additionally, we evaluate the suitability of employing UQ in an active learning scenario and report competitive performance. The most promising framework for creep life prediction is BNNs based on Markov Chain Monte Carlo approximation of the posterior distribution of network parameters, as it provided more reliable results in comparison to BNNs based on variational inference approximation or related NNs with probabilistic outputs.

36 MATERIALS SCIENCE↗

Posterior Regularized Bayesian Neural Network incorporating soft and hard knowledge constraints

Neural Networks (NNs) have been widely used in supervised learning due to their ability to model complex nonlinear patterns, often presented in high-dimensional data such as images and text. However, traditional NNs often lack the ability for uncertainty quantification. Bayesian NNs (BNNS) could help measure the uncertainty by considering the distributions of the NN model parameters. Besides, domain knowledge is commonly available and could improve the performance of BNNs if it can be appropriately incorporated. In this work, we propose a novel Posterior-Regularized Bayesian Neural Network (PR-BNN) model by incorporating different types of knowledge constraints, such as the soft and hard constraints, as a posterior regularization term. Furthermore, we propose to combine the augmented Lagrangian method and the existing BNN solvers for efficient inference. Furthermore, the experiments in simulation and two case studies about aviation landing prediction and solar energy output prediction have shown the knowledge constraints and the performance improvement of the proposed model over traditional BNNs without the constraints.

14 SOLAR ENERGY↗

Descriptor Aided Bayesian Optimization for Many-Level Qualitative Variables With Materials Design Applications

Abstract Engineering design often involves qualitative and quantitative design variables, which requires systematic methods for the exploration of these mixed-variable design spaces. Expensive simulation techniques, such as those required to evaluate optimization objectives in materials design applications, constitute the main portion of the cost of the design process and underline the need for efficient search strategies—Bayesian optimization (BO) being one of the most widely adopted. Although recent developments in mixed-variable Bayesian optimization have shown promise, the effects of dimensionality of qualitative variables have not been well studied. High-dimensional qualitative variables, i.e., with many levels, impose a large design cost as they typically require a larger dataset to quantify the effect of each level on the optimization objective. We address this challenge by leveraging domain knowledge about underlying physical descriptors, which embody the physics of the underlying physical phenomena, to infer the effect of unobserved levels that have not been sampled yet. We show that physical descriptors can be intuitively embedded into the latent variable Gaussian process approach—a mixed-variable GP modeling technique—and used to selectively explore levels of qualitative variables in the Bayesian optimization framework. This physics-informed approach is particularly useful when one or more qualitative variables are high dimensional (many-level) and the modeling dataset is small, containing observations for only a subset of levels. Through a combination of mathematical test functions and materials design applications, our method is shown to be robust to certain types of incomplete domain knowledge and significantly reduces the design cost for problems with high-dimensional qualitative variables.

Engineering↗