Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Making Steppingstones out of Stumbling Blocks: A Bayesian Model Evidence Estimator with Application to Groundwater Transport Model Selection

Bayesian model evidence (BME) is a measure of the average fit of a model to observation data given all the parameter values that the model can assume. By accounting for the trade-off between goodness-of-fit and model complexity, BME is used for model selection and model averaging purposes. For strict Bayesian computation, the theoretically unbiased Monte Carlo based numerical estimators are preferred over semi-analytical solutions. This study examines five BME numerical estimators and asks how accurate estimation of the BME is important for penalizing model complexity. The limiting cases for numerical BME estimators are the prior sampling arithmetic mean estimator (AM) and the posterior sampling harmonic mean (HM) estimator, which are straightforward to implement, yet they result in underestimation and overestimation, respectively. We also consider the path sampling methods of thermodynamic integration (TI) and steppingstone sampling (SS) that sample multiple intermediate distributions that link the prior and the posterior. Although TI and SS are theoretically unbiased estimators, they could have a bias in practice arising from numerical implementation. For example, sampling errors of some intermediate distributions can introduce bias. We propose a variant of SS, namely the multiple one-steppingstone sampling (MOSS) that is less sensitive to sampling errors. We evaluate these five estimators using a groundwater transport model selection problem. SS and MOSS give the least biased BME estimation at an efficient computational cost. If the estimated BME has a bias that covariates with the true BME, this would not be a problem because we are interested in BME ratios and not their absolute values. On the contrary, the results show that BME estimation bias can be a function of model complexity. Thus, biased BME estimation results in inaccurate penalization of more complex models, which changes the model ranking. This was less observed with SS and MOSS as with the three other methods.

54 ENVIRONMENTAL SCIENCES↗

Bayesian Model Selection as a Continuous-Variable Helmholtz Machine

We show that Bayesian model selection is equivalent to optimization of a suitably defined free energy. The entropy term in the free energy is defined over the space of possible model selections and model parameters for a given model. Bayesian model selection thus follows a minimum description length principle.

97 MATHEMATICS AND COMPUTING↗

Constraints on primordial isocurvature perturbations and spatial curvature by Bayesian model selection

We present posterior likelihoods and Bayesian model selection analysis for generalized cosmological models where the primordial perturbations include correlated adiabatic and cold dark matter isocurvature components. We perform nested sampling with flat and, for the first time, curved spatial geometries of the Universe, using data from the CMB anisotropies, the Union supernovae (SN) sample, and a combined measurement of the integrated Sachs-Wolfe effect. The CMB alone favors a 3% (positively correlated) isocurvature contribution in both the flat and curved cases. The nonadiabatic contribution to the observed CMB temperature variance is 0<{alpha}{sub T}<7% at 98% C.L. in the curved case. In the flat case, combining the CMB with SN data artificially biases the result towards the pure adiabatic {lambda}CDM concordance model, whereas in the curved case the favored level of nonadiabaticity stays at the 3% level with all combinations of data. However, the ratio of Bayes factors, or {delta}ln (evidence), is more than 5 points in favor of the flat adiabatic {lambda}CDM model, which suggests that the inclusion of the 5 extra parameters of the curved isocurvature model is not supported by the current data. The results are very sensitive to the second and third acoustic peak regions in the CMB temperature angular power: therefore a careful calibration of these data will be required before drawing decisive conclusions on the nature of primordial perturbations. Finally, we point out that the odds for the flat nonadiabatic model are 1:3 compared to the curved adiabatic model. This may suggest that it is not much less motivated to extend the concordance model with 4 isocurvature degrees of freedom than it is to study the spatially curved adiabatic model, though at the moment the model selection disfavors both of these models.

99 GENERAL AND MISCELLANEOUS↗

Multiverse: Bayesian model selection for neural networks

Multiverse is a code repository for a set of tools for Bayesian model selection for neural networks. The goal of the tools is to provide capabilities for selecting among prior and model specifications for Bayesian neural networks. Multiverse will include tools for creating Bayesian neural networks, evaluating the Bayesian model evidence, and performing inference in Bayesian neural networks. These components are written in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning and signal processing.

Klein, Natalie↗

Hybrid nested sampling algorithm for Bayesian model selection applied to inverse subsurface flow problems

A Hybrid Nested Sampling (HNS) algorithm is proposed for efficient Bayesian model calibration and prior model selection. The proposed algorithm combines, Nested Sampling (NS) algorithm, Hybrid Monte Carlo (HMC) sampling and gradient estimation using Stochastic Ensemble Method (SEM). NS is an efficient sampling algorithm that can be used for Bayesian calibration and estimating the Bayesian evidence for prior model selection. Nested sampling has the advantage of computational feasibility. Within the nested sampling algorithm, a constrained sampling step is performed. For this step, we utilize HMC to reduce the correlation between successive sampled states. HMC relies on the gradient of the logarithm of the posterior distribution, which we estimate using a stochastic ensemble method based on an ensemble of directional derivatives. SEM only requires forward model runs and the simulator is then used as a black box and no adjoint code is needed. The developed HNS algorithm is successfully applied for Bayesian calibration and prior model selection of several nonlinear subsurface flow problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Application of Bayesian Model Selection for Metal Yield Models using ALEGRA and Dakota

This report introduces the concepts of Bayesian model selection, which provides a systematic means of calibrating and selecting an optimal model to represent a phenomenon. This has many potential applications, including for comparing constitutive models. The ideas described herein are applied to a model selection problem between different yield models for hardened steel under extreme loading conditions.

97 MATHEMATICS AND COMPUTING↗

EXONEST: Bayesian model selection applied to the detection and characterization of exoplanets via photometric variations

EXONEST is an algorithm dedicated to detecting and characterizing the photometric signatures of exoplanets, which include reflection and thermal emission, Doppler boosting, and ellipsoidal variations. Using Bayesian inference, we can test between competing models that describe the data as well as estimate model parameters. We demonstrate this approach by testing circular versus eccentric planetary orbital models, as well as testing for the presence or absence of four photometric effects. In addition to using Bayesian model selection, a unique aspect of EXONEST is the potential capability to distinguish between reflective and thermal contributions to the light curve. A case study is presented using Kepler data recorded from the transiting planet KOI-13b. By considering only the nontransiting portions of the light curve, we demonstrate that it is possible to estimate the photometrically relevant model parameters of KOI-13b. Furthermore, Bayesian model testing confirms that the orbit of KOI-13b has a detectable eccentricity.

79 ASTRONOMY AND ASTROPHYSICS↗

Testing general relativity using Bayesian model selection: Applications to observations of gravitational waves from compact binary systems

Second-generation interferometric gravitational-wave detectors, such as Advanced LIGO and Advanced Virgo, are expected to begin operation by 2015. Such instruments plan to reach sensitivities that will offer the unique possibility to test general relativity in the dynamical, strong-field regime and investigate departures from its predictions, in particular, using the signal from coalescing binary systems. We introduce a statistical framework based on Bayesian model selection in which the Bayes factor between two competing hypotheses measures which theory is favored by the data. Probability density functions of the model parameters are then used to quantify the inference on individual parameters. We also develop a method to combine the information coming from multiple independent observations of gravitational waves, and show how much stronger inference could be. As an introduction and illustration of this framework-and a practical numerical implementation through the Monte Carlo integration technique of nested sampling-we apply it to gravitational waves from the inspiral phase of coalescing binary systems as predicted by general relativity and a very simple alternative theory in which the graviton has a nonzero mass. This method can (and should) be extended to more realistic and physically motivated theories.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Bayesian model selection for GRB 211211A through multiwavelength analyses

ABSTRACT Although GRB 211211A is one of the closest gamma-ray bursts (GRBs), its classification is challenging because of its partially inconclusive electromagnetic signatures. In this paper, we investigate four astrophysical scenarios as possible progenitors for GRB 211211A: a binary neutron star merger, a black hole–neutron star merger, a core-collapse supernova, and an r-process enriched core collapse of a rapidly rotating massive star (a collapsar). We perform a large set of Bayesian multiwavelength analyses based on different models describing these scenarios and priors to investigate which astrophysical scenarios and processes might be related to GRB 211211A. Our analysis supports previous studies in which the presence of an additional component, likely related to r-process nucleosynthesis, is required to explain the observed light curves of GRB 211211A, as it cannot be explained solely as a GRB afterglow. Fixing the distance to about $350~\rm Mpc$, namely the distance of the possible host galaxy SDSS J140910.47+275320.8, we find a statistical preference for a binary neutron star merger scenario.

(transients:) gamma-ray bursts↗