Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Comparing Methods for Assessing Reliability Uncertainty Based on Pass/Fail Data Collected Over Time

In this paper, we compare statistical methods for analyzing pass/fail data collected over time; some methods are traditional and one (the RADAR or Rationale for Assessing Degradation Arriving at Random) was recently developed. These methods are used to provide uncertainty bounds on reliability. We make observations about the methods' assumptions and properties. Finally, we illustrate the differences between two traditional methods, logistic regression and Weibull failure time analysis, and the RADAR method using a numerical example.

97 MATHEMATICS AND COMPUTING↗

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global fit of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalising flows. A code implementation can be found at https://github.com/NickHunt-Smith/MCMC-diffusion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Statistical surrogate models for prediction of high-consequence climate change.

In safety engineering, performance metrics are defined using probabilistic risk assessments focused on the low-probability, high-consequence tail of the distribution of possible events, as opposed to best estimates based on central tendencies. We frame the climate change problem and its associated risks in a similar manner. To properly explore the tails of the distribution requires extensive sampling, which is not possible with existing coupled atmospheric models due to the high computational cost of each simulation. We therefore propose the use of specialized statistical surrogate models (SSMs) for the purpose of exploring the probability law of various climate variables of interest. A SSM is different than a deterministic surrogate model in that it represents each climate variable of interest as a space/time random field. The SSM can be calibrated to available spatial and temporal data from existing climate databases, e.g., the Program for Climate Model Diagnosis and Intercomparison (PCMDI), or to a collection of outputs from a General Circulation Model (GCM), e.g., the Community Earth System Model (CESM) and its predecessors. Because of its reduced size and complexity, the realization of a large number of independent model outputs from a SSM becomes computationally straightforward, so that quantifying the risk associated with low-probability, high-consequence climate events becomes feasible. A Bayesian framework is developed to provide quantitative measures of confidence, via Bayesian credible intervals, in the use of the proposed approach to assess these risks.

54 ENVIRONMENTAL SCIENCES↗

DISSECTING THE GRAVITATIONAL LENS B1608+656. II. PRECISION MEASUREMENTS OF THE HUBBLE CONSTANT, SPATIAL CURVATURE, AND THE DARK ENERGY EQUATION OF STATE

Strong gravitational lens systems with measured time delays between the multiple images provide a method for measuring the 'time-delay distance' to the lens, and thus the Hubble constant. We present a Bayesian analysis of the strong gravitational lens system B1608+656, incorporating (1) new, deep Hubble Space Telescope (HST) observations, (2) a new velocity-dispersion measurement of 260 +- 15 km s{sup -1} for the primary lens galaxy, and (3) an updated study of the lens' environment. Our analysis of the HST images takes into account the extended source surface brightness, and the dust extinction and optical emission by the interacting lens galaxies. When modeling the stellar dynamics of the primary lens galaxy, the lensing effect, and the environment of the lens, we explicitly include the total mass distribution profile logarithmic slope gamma' and the external convergence kappa{sub ext}; we marginalize over these parameters, assigning well-motivated priors for them, and so turn the major systematic errors into statistical ones. The HST images provide one such prior, constraining the lens mass density profile logarithmic slope to be gamma' = 2.08 +- 0.03; a combination of numerical simulations and photometric observations of the B1608+656 field provides an estimate of the prior for kappa{sub ext}: 0.10{sup +0.08}{sub -0.05}. This latter distribution dominates the final uncertainty on H{sub 0}. Fixing the cosmological parameters at OMEGA{sub m} = 0.3, OMEGA{sub L}AMBDA = 0.7, and w = -1 in order to compare with previous work on this system, we find H{sub 0} = 70.6{sup +3.1}{sub -3.1} km s{sup -1} Mpc{sup -1}. The new data provide an increase in precision of more than a factor of 2, even including the marginalization over kappa{sub ext}. Relaxing the prior probability density function for the cosmological parameters to that derived from the Wilkinson Microwave Anisotropy Probe (WMAP) five-year data set, we find that the B1608+656 data set breaks the degeneracy between OMEGA{sub m} and OMEGA{sub L}AMBDA at w = -1 and constrains the curvature parameter to be -0.031 < OMEGA{sub k} < 0.009 (95% CL), a level of precision comparable to that afforded by the current Type Ia SNe sample. Asserting a flat spatial geometry, we find that, in combination with WMAP, H{sub 0} = 69.7{sup +4.9}{sub -5.0} km s{sup -1} Mpc{sup -1} and w = -0.94{sup +0.17}{sub -0.19} (68% CL), suggesting that the observations of B1608+656 constrain w as tightly as the current Baryon Acoustic Oscillation data do.

79 ASTRONOMY AND ASTROPHYSICS↗

Parameter estimation for X-ray scattering analysis with Hamiltonian Markov Chain Monte Carlo

Bayesian-inference-based approaches, in particular the random-walk Markov Chain Monte Carlo (MCMC) method, have received much attention recently for X-ray scattering analysis. Hamiltonian MCMC, a state-of-the-art development in the field of MCMC, has become popular in recent years. It utilizes Hamiltonian dynamics for indirect but much more efficient drawings of the model parameters. We described the principle of the Hamiltonian MCMC for inversion problems in X-ray scattering analysis by estimating high-dimensional models for several motivating scenarios in small-angle X-ray scattering, reflectivity, and X-ray fluorescence holography. Hamiltonian MCMC with appropriate preconditioning can deliver superior performance over the random-walk MCMC, and thus can be used as an efficient tool for the statistical analysis of the parameter distributions, as well as model predictions and confidence analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Dissecting the Gravitational Lens B1608 656. II. Precision Measurements of the Hubble Constant, Spatial Curvature, and the Dark Energy Equation of State

Strong gravitational lens systems with measured time delays between the multiple images provide a method for measuring the 'time-delay distance' to the lens, and thus the Hubble constant. We present a Bayesian analysis of the strong gravitational lens system B1608+656, incorporating (1) new, deep Hubble Space Telescope (HST) observations, (2) a new velocity dispersion measurement of 260 {+-} 15 km s{sup -1} for the primary lens galaxy, and (3) an updated study of the lens environment. Our analysis of the HST images takes into account the extended source surface brightness, and the dust extinction and optical emission by the interacting lens galaxies. When modeling the stellar dynamics of the primary lens galaxy, the lensing effect, and the environment of the lens, we explicitly include the total mass distribution profile logarithmic slope {gamma}{prime} and the external convergence {kappa}{sub ext}; we marginalize over these parameters, assigning well-motivated priors for them, and so turn the major systematic errors into statistical ones. The HST images provide one such prior, constraining the lens mass density profile logarithmic slope to be {gamma}{prime} = 2.08 {+-} 0.03; a combination of numerical simulations and photometric observations of the B1608+656 field provides an estimate of the prior for {kappa}{sub ext}: 0.10{sub -0.05}{sup +0.08}. This latter distribution dominates the final uncertainty on H{sub 0}. Fixing the cosmological parameters at {Omega}{sub m} = 0.3, {Omega}{sub {Lambda}} = 0.7, and w = -1 in order to compare with previous work on this system, we find H{sub 0} = 70.6{sub -3.1}{sup +3.1} km s{sup -1} Mpc{sup -1}. The new data provide an increase in precision of more than a factor of two, even including the marginalization over {kappa}{sub ext}. Relaxing the prior probability density function for the cosmological parameters to that derived from the WMAP 5-year data set, we find that the B1608+656 data set breaks the degeneracy between {Omega}{sub m} and {Omega}{sub {Lambda}} at w = -1 and constrains the curvature parameter to be -0.031 < {Omega}{sub k} < 0.009 (95% CL), a level of precision comparable to that afforded by the current Type Ia SNe sample. Asserting a flat spatial geometry, we find that, in combination with WMAP, H{sub 0} = 69.7{sub 5.0}{sup +4.9} km s{sup -1} Mpc{sup -1} and w = -0.94{sub -0.19}{sup +0.17} (68% CL), suggesting that the observations of B1608+656 constrain w as tightly as do the current Baryon Acoustic Oscillation data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Bayesian framework for adaptive selection, calibration, and validation of coarse-grained models of atomistic systems

A general adaptive modeling algorithm for selection and validation of coarse-grained models of atomistic systems is presented. A Bayesian framework is developed to address uncertainties in parameters, data, and model selection. Algorithms for computing output sensitivities to parameter variances, model evidence and posterior model plausibilities for given data, and for computing what are referred to as Occam Categories in reference to a rough measure of model simplicity, make up components of the overall approach. Computational results are provided for representative applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Bayesian investigation of isochrone consistency using the old open cluster NGC 188

This paper provides a detailed comparison of the differences in parameters derived for a star cluster from its color–magnitude diagrams (CMDs) depending on the filters and models used. We examine the consistency and reliability of fitting three widely used stellar evolution models to 15 combinations of optical and near-IR photometry for the old open cluster NGC 188. The optical filter response curves match those of theoretical systems and are thus not the source of fit inconsistencies. NGC 188 is ideally suited to this study thanks to a wide variety of high-quality photometry and available proper motions and radial velocities that enable us to remove non-cluster members and many binaries. Our Bayesian fitting technique yields inferred values of age, metallicity, distance modulus, and absorption as a function of the photometric band combinations and stellar models. We show that the historically favored three-band combinations of UBV and VRI can be meaningfully inconsistent with each other and with longer baseline data sets such as UBVRIJHK{sub S}. Differences among model sets can also be substantial. For instance, fitting Yi et al. (2001) and Dotter et al. (2008) models to UBVRIJHK{sub S} photometry for NGC 188 yields the following cluster parameters: age = (5.78 ± 0.03, 6.45 ± 0.04) Gyr, [Fe/H] = (+0.125 ± 0.003, −0.077 ± 0.003) dex, (m−M){sub V} = (11.441 ± 0.007, 11.525 ± 0.005) mag, and A{sub V} = (0.162 ± 0.003, 0.236 ± 0.003) mag, respectively. Within the formal fitting errors, these two fits are substantially and statistically different. Such differences among fits using different filters and models are a cautionary tale regarding our current ability to fit star cluster CMDs. Additional modeling of this kind, with more models and star clusters, and future Gaia parallaxes are critical for isolating and quantifying the most relevant uncertainties in stellar evolutionary models.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark matter voids in the SDSS galaxy survey

What do we know about voids in the dark matter distribution given the Sloan Digital Sky Survey (SDSS) and assuming the ΛCDM model? Recent application of the Bayesian inference algorithm BORG to the SDSS Data Release 7 main galaxy sample has generated detailed Eulerian and Lagrangian representations of the large-scale structure as well as the possibility to accurately quantify corresponding uncertainties. Building upon these results, we present constrained catalogs of voids in the Sloan volume, aiming at a physical representation of dark matter underdensities and at the alleviation of the problems due to sparsity and biasing on galaxy void catalogs. To do so, we generate data-constrained reconstructions of the presently observed large-scale structure using a fully non-linear gravitational model. We then find and analyze void candidates using the VIDE toolkit. Our methodology therefore predicts the properties of voids based on fusing prior information from simulations and data constraints. For usual void statistics (number function, ellipticity distribution and radial density profile), all the results obtained are in agreement with dark matter simulations. Our dark matter void candidates probe a deeper void hierarchy than voids directly based on the observed galaxies alone. The use of our catalogs therefore opens the way to high-precision void cosmology at the level of the dark matter field. We will make the void catalogs used in this work available at http://www.cosmicvoids.net.

79 ASTRONOMY AND ASTROPHYSICS↗

Assay-based background projection for the Majorana Demonstrator using Monte Carlo uncertainty propagation

The background index (BI) is an important quantity to project and calculate the half-life sensitivity of neutrinoless double-𝛽 decay (0⁢𝜈⁢𝛽⁢𝛽) experiments. An analysis framework is presented to calculate the BI using the specific activities, masses, and simulated efficiencies of an experiments components as distributions. This Bayesian framework includes a unified approach to combine specific activities from assay. Monte Carlo uncertainty propagation is used to build a BI distribution from the specific activity, mass, and efficiency distributions. This method is applied to the M AJORANA D EMONSTRATOR , which deployed arrays of high-purity Ge detectors enriched in 76 Ge to search for 0⁢𝜈⁢𝛽⁢𝛽. The original assay-based projection is requantified in the new framework, using the as-built geometry of the Demonstrator and additional assay information. While 47% higher than the original projection, the resulting BI of [8.95±0.36]×10 −4 cts/(keVkgyr) from the 232 Th and 238 U decay chains does not account for the higher-than-expected BI observed by the D EMONSTRATOR . Finally, this method enables us to demonstrate the statistical incompatibility between the D EMONSTRATOR 's observed background and the assay results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Topics in inference and decision-making with partial knowledge

Two essential elements needed in the process of inference and decision-making are prior probabilities and likelihood functions. When both of these components are known accurately and precisely, the Bayesian approach provides a consistent and coherent solution to the problems of inference and decision-making. In many situations, however, either one or both of the above components may not be known, or at least may not be known precisely. This problem of partial knowledge about prior probabilities and likelihood functions is addressed. There are at least two ways to cope with this lack of precise knowledge: robust methods, and interval-valued methods. First, ways of modeling imprecision and indeterminacies in prior probabilities and likelihood functions are examined; then how imprecision in the above components carries over to the posterior probabilities is examined. Finally, the problem of decision making with imprecise posterior probabilities and the consequences of such actions are addressed. Application areas where the above problems may occur are in statistical pattern recognition problems, for example, the problem of classification of high-dimensional multispectral remote sensing image data.

Safavian, S. Rasoul↗

Stochastic Gradient-Based Distributed Bayesian Estimation in Cooperative Sensor Networks

Distributed Bayesian inference provides a full quantification of uncertainty offering numerous advantages over point estimates that autonomous sensor networks are able to exploit. However, fully-decentralized Bayesian inference often requires large communication overheads and low network latency, resources that are not typically available in practical applications. In this paper, we propose a decentralized Bayesian inference approach based on stochastic gradient Langevin dynamics, which produces full posterior distributions at each of the nodes with significantly lower communication overhead. We provide analytical results on convergence of the proposed distributed algorithm to the centralized posterior, under typical network constraints. Finally, we also provide extensive simulation results to demonstrate the validity of the proposed approach.

42 ENGINEERING↗

Statistical sensitivity on right-handed currents in presence of eV scale sterile neutrinos with KATRIN

The KATRIN experiment aims to determine the absolute neutrino mass by measuring the endpoint region of the tritium β-spectrum. As a large-scale experiment with a sharp energy resolution, high source luminosity and low background it may also be capable of testing certain theories of neutrino interactions beyond the standard model (SM). An example of a non-SM interaction are right-handed currents mediated by right-handed W bosons in the left-right symmetric model (LRSM). In this extension of the SM, an additional SU(2){sub R} symmetry in the high-energy limit is introduced, which naturally includes sterile neutrinos and predicts the seesaw mechanism. In tritium β decay, this leads to an additional term from interference between left- and right-handed interactions, which enhances or suppresses certain regions near the endpoint of the beta spectrum. In this work, the sensitivity of KATRIN to right-handed currents is estimated for the scenario of a light sterile neutrino with a mass of some eV. This analysis has been performed with a Bayesian analysis using Markov Chain Monte Carlo (MCMC). The simulations show that, in principle, KATRIN will be able to set sterile neutrino mass-dependent limits on the interference strength. The sensitivity is significantly increased if the Q value of the β decay can be sufficiently constrained. However, the sensitivity is not high enough to improve current upper limits from right-handed W boson searches at the LHC.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

PyCBC Inference: A Python-based Parameter Estimation Toolkit for Compact Binary Coalescence Signals

We introduce new modules in the open-source PyCBC gravitational-wave astronomy toolkit that implement Bayesian inference for compact-object binary mergers. We review the Bayesian inference methods implemented and describe the structure of the modules. Here, we demonstrate that the PyCBC Inference modules produce unbiased estimates of the parameters of a simulated population of binary black hole mergers. We show that the parameters' posterior distributions obtained using our new code agree well with the published estimates for binary black holes in the first Advanced LIGO–Virgo observing run.

79 ASTRONOMY AND ASTROPHYSICS↗

Probing cosmology and gravity with redshift-space distortions around voids

Cosmic voids in the large-scale structure of the Universe affect the peculiar motions of objects in their vicinity. Although these motions are difficult to observe directly, the clustering pattern of their surrounding tracers in redshift space is influenced in a unique way. This allows to investigate the interplay between densities and velocities around voids, which is solely dictated by the laws of gravity. With the help of N-body simulations and derived mock-galaxy catalogs we calculate the average density fluctuations around voids identified with a watershed algorithm in redshift space and compare the results with the expectation from general relativity and the ΛCDM model. We find linear theory to work remarkably well in describing the dynamics of voids. Adopting a Bayesian inference framework, we explore the full posterior of our model parameters and forecast the achievable accuracy on measurements of the growth rate of structure and the geometric distortion through the Alcock-Paczyński effect. Systematic errors in the latter are reduced from ∼15% to ∼5% when peculiar velocities are taken into account. The relative parameter uncertainties in galaxy surveys with number densities comparable to the SDSS MAIN (CMASS) sample probing a volume of 1h{sup −3}Gpc{sup 3} yield σ{sub f/b}/(f/b).∼2% (20%) and σ{sub D{sub A{sub H}}}/D{sub AH∼0}.2% (2%), respectively. At this level of precision the linear-theory model becomes systematics dominated, with parameter biases that fall beyond these values. Nevertheless, the presented method is highly model independent; its viability lies in the underlying assumption of statistical isotropy of the Universe.

79 ASTRONOMY AND ASTROPHYSICS↗

Chaconne: A Statistical Approach to Nonlocal Compression for Supervised Learning, Semi-Supervised Learning, and Anomaly Detection

This project developed a novel statistical understanding of compression analytics (CA), which has challenged and clarified some core assumptions about CA, and enabled the development of novel techniques that address vital challenges of national security. Specifically, this project has yielded the development of novel capabilities including 1. Principled metrics for model selection in CA, 2. Techniques for deriving/applying optimal classification rules and decision theory to supervised CA, including how to properly handle class imbalance and differing costs of misclassification, 3. Two techniques for handling nonlocal information in CA, 4. A novel technique for unsupervised CA that is agnostic with regard to the underlying compression algorithm, 5. A framework for semisupervised CA when a small number of labels are known in an otherwise large unlabeled dataset. 6. The academic alliance component of this project has focused on the development of a novel exemplar-based Bayesian technique for estimating variable length Markov models (closely related to PPM [prediction by partial matching] compression techniques). We have developed examples illustrating the application of our work to text, video, genetic sequences, and unstructured cybersecurity log files.

99 GENERAL AND MISCELLANEOUS↗

Modeling Increased Complexity and the Reliance on Automation: FLightdeck Automation Problems (FLAP) Model

This paper highlights the development of a model that is focused on the safety issue of increasing complexity and reliance on automation systems in transport category aircraft. Recent statistics show an increase in mishaps related to manual handling and automation errors due to pilot complacency and over-reliance on automation, loss of situational awareness, automation system failures and/or pilot deficiencies. Consequently, the aircraft can enter a state outside the flight envelope and/or air traffic safety margins which potentially can lead to loss-of-control (LOC), controlled-flight-into-terrain (CFIT), or runway excursion/confusion accidents, etc. The goal of this modeling effort is to provide NASA's Aviation Safety Program (AvSP) with a platform capable of assessing the impacts of AvSP technologies and products towards reducing the relative risk of automation related accidents and incidents. In order to do so, a generic framework, capable of mapping both latent and active causal factors leading to automation errors, is developed. Next, the framework is converted into a Bayesian Belief Network model and populated with data gathered from Subject Matter Experts (SMEs). With the insertion of technologies and products, the model provides individual and collective risk reduction acquired by technologies and methodologies developed within AvSP.

Ancel, Ersin↗