Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

A tale of two modes: neutrino free-streaming in the early universe

We present updated constraints on the free-streaming nature of cosmological neutrinos from cosmic microwave background (CMB) temperature and polarization power spectra, baryonic acoustic oscillation data, and distance ladder measurements of the Hubble constant. Specifically, we consider a Fermi-like four-fermion interaction between massless neutrinos, characterized by an effective coupling constant G {sub eff}, and resulting in a neutrino opacity τ-dot {sub ν∝} G {sub eff}{sup 2} T {sub ν}{sup 5}. Using a conservative flat prior on the parameter log{sub 10}( G {sub eff} MeV{sup 2}), we find a bimodal posterior distribution with two clearly separated regions of high probability. The first of these modes is consistent with the standard ΛCDM cosmology and corresponds to neutrinos decoupling at redshift z {sub ν,dec} > 1.3×10{sup 5}, that is before the Fourier modes probed by the CMB damping tail enter the causal horizon. The other mode of the posterior, dubbed the 'interacting neutrino mode', corresponds to neutrino decoupling occurring within a narrow redshift window centered around z {sub ν,dec}∼8300. This mode is characterized by a high value of the effective neutrino coupling constant, log{sub 10}( G {sub eff} MeV{sup 2}) = −1.72 ± 0.10 (68% C.L.), together with a lower value of the scalar spectral index and amplitude of fluctuations, and a higher value of the Hubble parameter. Using both a maximum likelihood analysis and the ratio of the two mode's Bayesian evidence, we find the interacting neutrino mode to be statistically disfavored compared to the standard ΛCDM cosmology, and determine this result to be largely driven by the low- l CMB temperature data. Interestingly, the addition of CMB polarization and direct Hubble constant measurements significantly raises the statistical significance of this secondary mode, indicating that new physics in the neutrino sector could help explain the difference between local measurements of H {sub 0}, and those inferred from CMB data. A robust consequence of our results is that neutrinos must be free streaming long before the epoch of matter-radiation equality in order to fit current cosmological data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Hierarchical Inference with Bayesian Neural Networks: An Application to Strong Gravitational Lensing

In the past few years, approximate Bayesian Neural Networks (BNNs) have demonstrated the ability to produce statistically consistent posteriors on a wide range of inference problems at unprecedented speed and scale. However, any disconnect between training sets and the distribution of real-world objects can introduce bias when BNNs are applied to data. This is a common challenge in astrophysics and cosmology, where the unknown distribution of objects in our universe is often the science goal. In this work, we incorporate BNNs with flexible posterior parameterizations into a hierarchical inference framework that allows for the reconstruction of population hyperparameters and removes the bias introduced by the training distribution. We focus on the challenge of producing posterior PDFs for strong gravitational lens mass model parameters given Hubble Space Telescope–quality single-filter, lens-subtracted, synthetic imaging data. We show that the posterior PDFs are sufficiently accurate (statistically consistent with the truth) across a wide variety of power-law elliptical lens mass distributions. We then apply our approach to test data sets whose lens parameters are drawn from distributions that are drastically different from the training set. We show that our hierarchical inference framework mitigates the bias introduced by an unrepresentative training set's interim prior. Simultaneously, we can precisely reconstruct the population hyperparameters governing our test distributions. Our full pipeline, from training to hierarchical inference on thousands of lenses, can be run in a day. The framework presented here will allow us to efficiently exploit the full constraining power of future ground- and space-based surveys (https://github.com/swagnercarena/ovejero).

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian mass estimates of the milky way: including measurement uncertainties with hierarchical bayes

We present a hierarchical Bayesian method for estimating the total mass and mass profile of the Milky Way Galaxy. The new hierarchical Bayesian approach further improves the framework presented by Eadie et al. and Eadie and Harris and builds upon the preliminary reports by Eadie et al. The method uses a distribution function f(E,L) to model the Galaxy and kinematic data from satellite objects, such as globular clusters (GCs), to trace the Galaxy’s gravitational potential. A major advantage of the method is that it not only includes complete and incomplete data simultaneously in the analysis, but also incorporates measurement uncertainties in a coherent and meaningful way. We first test the hierarchical Bayesian framework, which includes measurement uncertainties, using the same data and power-law model assumed in Eadie and Harris and find the results are similar but more strongly constrained. Next, we take advantage of the new statistical framework and incorporate all possible GC data, finding a cumulative mass profile with Bayesian credible regions. This profile implies a mass within 125 kpc of 4.8×10{sup 11}M{sub ⊙} with a 95% Bayesian credible region of (4.0--5.8)×10{sup 11}M{sub ⊙}. Our results also provide estimates of the true specific energies of all the GCs. By comparing these estimated energies to the measured energies of GCs with complete velocity measurements, we observe that (the few) remote tracers with complete measurements may play a large role in determining a total mass estimate of the Galaxy. Thus, our study stresses the need for more remote tracers with complete velocity measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Data-driven prediction of scaling and ignition of inertial confinement fusion experiments

Recent advances in inertial confinement fusion (ICF) at the National Ignition Facility (NIF), including ignition and energy gain, are enabled by a close coupling between experiments and high-fidelity simulations. Neither simulations nor experiments can fully constrain the behavior of ICF implosions on their own, meaning pre- and postshot simulation studies must incorporate experimental data to be reliable. Linking past data with simulations to make predictions for upcoming designs and quantifying the uncertainty in those predictions has been an ongoing challenge in ICF research. We have developed a data-driven approach to prediction and uncertainty quantification that combines large ensembles of simulations with Bayesian inference and deep learning. The approach builds a predictive model for the statistical distribution of key performance parameters, which is jointly informed by past experiments and physics simulations. The prediction distribution captures the impact of experimental uncertainty, expert priors, design changes, and shot-to-shot variations. We have used this new capability to predict a 10× increase in ignition probability between Hybrid-E shots driven with 2.05 MJ compared to 1.9 MJ, and validated our predictions against subsequent experiments. We describe our new Bayesian postshot and prediction capabilities, discuss their application to NIF ignition and validate the results, and finally investigate the impact of data sparsity on our prediction results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Evaluating the Benefits of Bayesian Hierarchical Methods for Analyzing Heterogeneous Environmental Datasets: A Case Study of Marine Organic Carbon Fluxes

Large compilations of heterogeneous environmental observations are increasingly available as public databases, allowing researchers to test hypotheses across datasets. Statistical complexities arise when analyzing compiled data due to unbalanced spatial sampling, variable environmental context, mixed measurement techniques, and other reasons. Hierarchical Bayesian modeling is increasingly used in environmental science to describe these complexities, however few studies explicitly compare the utility of hierarchical Bayesian models to simpler and more commonly applied methods. Here we demonstrate the utility of the hierarchical Bayesian approach with application to a large compiled environmental dataset consisting of 5,741 marine vertical organic carbon flux observations from 407 sampling locations spanning eight biomes across the global ocean. We fit a global scale Bayesian hierarchical model that describes the vertical profile of organic carbon flux with depth. Profile parameters within a particular biome are assumed to share a common deviation from the global mean profile. Individual station-level parameters are then modeled as deviations from the common biome-level profile. The hierarchical approach is shown to have several benefits over simpler and more common data aggregation methods. First, the hierarchical approach avoids statistical complexities introduced due to unbalanced sampling and allows for flexible incorporation of spatial heterogeneitites in model parameters. Second, the hierarchical approach uses the whole dataset simultaneously to fit the model parameters which shares information across datasets and reduces the uncertainty up to 95% in individual profiles. Third, the Bayesian approach incorporates prior scientific information about model parameters; for example, the non-negativity of chemical concentrations or mass-balance, which we apply here. We explicitly quantify each of these properties in turn. We emphasize the generality of the hierarchical Bayesian approach for diverse environmental applications and its increasing feasibility for large datasets due to recent developments in Markov Chain Monte Carlo algorithms and easy-to-use high-level software implementations.

54 ENVIRONMENTAL SCIENCES↗

Comparison of Bayesian network and support vector machine models for two-year survival prediction in lung cancer patients treated with radiotherapy

Purpose: Classic statistical and machine learning models such as support vector machines (SVMs) can be used to predict cancer outcome, but often only perform well if all the input variables are known, which is unlikely in the medical domain. Bayesian network (BN) models have a natural ability to reason under uncertainty and might handle missing data better. In this study, the authors hypothesize that a BN model can predict two-year survival in non-small cell lung cancer (NSCLC) patients as accurately as SVM, but will predict survival more accurately when data are missing. Methods: A BN and SVM model were trained on 322 inoperable NSCLC patients treated with radiotherapy from Maastricht and validated in three independent data sets of 35, 47, and 33 patients from Ghent, Leuven, and Toronto. Missing variables occurred in the data set with only 37, 28, and 24 patients having a complete data set. Results: The BN model structure and parameter learning identified gross tumor volume size, performance status, and number of positive lymph nodes on a PET as prognostic factors for two-year survival. When validated in the full validation set of Ghent, Leuven, and Toronto, the BN model had an AUC of 0.77, 0.72, and 0.70, respectively. A SVM model based on the same variables had an overall worse performance (AUC 0.71, 0.68, and 0.69) especially in the Ghent set, which had the highest percentage of missing the important GTV size data. When only patients with complete data sets were considered, the BN and SVM model performed more alike. Conclusions: Within the limitations of this study, the hypothesis is supported that BN models are better at handling missing data than SVM models and are therefore more suitable for the medical domain. Future works have to focus on improving the BN performance by including more patients, more variables, and more diversity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Proteomic Profiling of the Substantia Nigra to Identify Determinants of Lewy Body Pathology and Dopaminergic Neuronal Loss

Proteinaceous aggregates containing ?-synuclein protein called Lewy bodies in the substantia nigra is a hallmark of Parkinson’s disease. The molecular mechanisms of Lewy body formation and associated neuronal loss remain largely unknown. To gain insights on proteins and pathways associated with Lewy body pathology, we performed quantitative profiling of the proteome. We analyzed substantia nigra tissue from 51 subjects arranged into three groups: cases with Lewy body pathology, Lewy body-negative controls with matching neuronal loss and controls with no neuronal loss. Using label-free LC-MS/MS approach we quantified the 2,963 most abundant proteins. Statistical testing for differential protein abundance, followed by pathway enrichment and Bayesian learning of the causal network structure were performed to identify likely drivers of Lewy body formation and dopaminergic neuronal loss. The identified pathways include (1) Arp2/3 complex-mediated actin nucleation; (2) synaptic function; (3) poly(A) RNA binding; (4) basement membrane and endothelium; and (5) hydrogen peroxide metabolic process. According to the data, the endothelial/basement membrane pathway is tightly connected with both pathologies and likely to be one of the drivers of the neuronal loss. The poly(A) RNA-binding proteins, including the ones relevant to other neurodegenerative disorders (e.g. TDP-43 and FUS) have strong inverse correlation with Lewy bodies and may reflect alternative mechanism of nigral neurodegeneration.

Petyuk, Vladislav A.↗

Bayesian characterization of uncertainties surrounding fluvial flood hazard estimates

Fluvial floods drive severe risk to riverine communities. There is strong evidence of increasing flood hazards in many regions around the world. The choice of methods and assumptions used in flood hazard estimates can impact the design of risk management strategies. In this study, we characterize the expected flood hazards conditioned on the uncertain model structures, model parameters, and prior distributions of the parameters. We construct a Bayesian framework for river stage return level estimation using a nonstationary statistical model that relies exclusively on the Indian Ocean Dipole Index. We show that ignoring uncertainties can lead to biased estimation of expected flood hazards. We find that the considered model parametric uncertainty is more influential than model structures and model priors. Our results highlight the importance of incorporating uncertainty in extreme flood stage estimates, and are of practical use for informing water infrastructure designs in a changing climate.

54 ENVIRONMENTAL SCIENCES↗

Separating gravitational wave signals from instrument artifacts

Central to the gravitational wave detection problem is the challenge of separating features in the data produced by astrophysical sources from features produced by the detector. Matched filtering provides an optimal solution for Gaussian noise, but in practice, transient noise excursions or ''glitches'' complicate the analysis. Detector diagnostics and coincidence tests can be used to veto many glitches which may otherwise be misinterpreted as gravitational wave signals. The glitches that remain can lead to long tails in the matched filter search statistics and drive up the detection threshold. Here we describe a Bayesian approach that incorporates a more realistic model for the instrument noise allowing for fluctuating noise levels that vary independently across frequency bands, and deterministic glitch fitting using wavelets as glitch templates, the number of which is determined by a transdimensional Markov chain Monte Carlo algorithm. We demonstrate the method's effectiveness on simulated data containing low amplitude gravitational wave signals from inspiraling binary black-hole systems, and simulated nonstationary and non-Gaussian noise comprised of a Gaussian component with the standard LIGO/Virgo spectrum, and injected glitches of various amplitude, prevalence, and variety. Glitch fitting allows us to detect significantly weaker signals than standard techniques.

79 ASTRONOMY AND ASTROPHYSICS↗

Probabalistic Modeling of Minibangs and Megabands (Final Report)

This project was original proposed as a fundamental advance in the treatment of probabilistic modeling as it applies to nuclear fission calculations of nuclear database inputs and produced particle distributions in heavy-ion collisions. However, funding decisions made within LLNL and the DOE Office of Science led to the project proceeding through three distinct stages. The first two, probabilistic calculations of the fission and jet energy loss relate follow directly from the proposed research. The fission task led to the development of a proof-of-principle Gaussian Process Emulator for time-dependent generator coordinate method (TDGCM) calculation for the fission of Pu-240. To study energy loss in heavy-ion collisions with a probabilistic model, we generated a training data set using the Pythia event generator superimposed on a heavy-ion background with a single quench-factor parameter. We then used kernel density estimation (KDE) to recover the distribution of quench-factors for a calibration data set. In the third stage, we proceeded to work through collaborations, collecting new data within the ATLAS experiment at the Large Hadron Collider (LHC), and further developing bayesian methodology within the Jet Energy-loss Tomography with a Statistically and Computationally Advanced Program Envelope (JETSCAPE) Collaboration.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Characterizing and Mitigating Intraday Variability: Reconstructing Source Structure in Accreting Black Holes with mm-VLBI

The extraordinary physical resolution afforded by the Event Horizon Telescope has opened a window onto the astrophysical phenomena unfolding on horizon scales in two known black holes, M87* and Sgr A*. However, with this leap in resolution has come a new set of practical complications. Sgr A* exhibits intraday variability that violates the assumptions underlying Earth aperture synthesis, limiting traditional image reconstruction methods to short timescales and data sets with very sparse (u, v) coverage. We present a new set of tools to detect and mitigate this variability. We develop a data-driven, model-agnostic procedure to detect and characterize the spatial structure of intraday variability. This method is calibrated against a large set of mock data sets, producing an empirical estimator of the spatial power spectrum of the brightness fluctuations. We present a novel Bayesian noise modeling algorithm that simultaneously reconstructs an average image and statistical measure of the fluctuations about it using a parameterized form for the excess variance in the complex visibilities not otherwise explained by the statistical errors. These methods are validated using a variety of simulated data, including general relativistic magnetohydrodynamic simulations appropriate for Sgr A* and M87*. We find that the reconstructed source structure and variability are robust to changes in the underlying image model. We apply these methods to the 2017 EHT observations of M87*, finding evidence for variability across the EHT observing campaign. The variability mitigation strategies presented are widely applicable to very long baseline interferometry observations of variable sources generally, for which they provide a data-informed averaging procedure and natural characterization of inter-epoch image consistency.

79 ASTRONOMY AND ASTROPHYSICS↗

Separating Gravitational Wave Signals from Instrument Artifacts

Central to the gravitational wave detection problem is the challenge of separating features in the data produced by astrophysical sources from features produced by the detector. Matched filtering provides an optimal solution for Gaussian noise, but in practice, transient noise excursions or "glitches" complicate the analysis. Detector diagnostics and coincidence tests can be used to veto many glitches which may otherwise be misinterpreted as gravitational wave signals. The glitches that remain can lead to long tails in the matched filter search statistics and drive up the detection threshold. Here we describe a Bayesian approach that incorporates a more realistic model for the instrument noise allowing for fluctuating noise levels that vary independently across frequency bands, and deterministic "glitch fitting" using wavelets as "glitch templates", the number of which is determined by a trans-dimensional Markov chain Monte Carlo algorithm. We demonstrate the method's effectiveness on simulated data containing low amplitude gravitational wave signals from inspiraling binary black hole systems, and simulated non-stationary and non-Gaussian noise comprised of a Gaussian component with the standard LIGO/Virgo spectrum, and injected glitches of various amplitude, prevalence, and variety. Glitch fitting allows us to detect significantly weaker signals than standard techniques.

Littenberg, Tyson B.↗

A Survey of Eight Hot Jupiters in Secondary Eclipse Using WIRCam at CFHT

We present near-infrared high-precision photometry for eight transiting hot Jupiters observed during their predicted secondary eclipses. Our observations were carried out using the staring mode of the WIRCam instrument on the Canada-France-Hawaii Telescope (CFHT).We present the observing strategies and data reduction methods which delivered time series photometry with statistical photometric precision as low as 0.11 percent. We performed a Bayesian analysis to model the eclipse parameters and systematics simultaneously. The measured planet-to-star flux ratios allowed us to constrain the thermal emission from the day side of these hot Jupiters, as we derived the planet brightness temperatures. Our results combined with previously observed eclipses reveal an excess in the brightness temperatures relative to the blackbody prediction for the equilibrium temperatures of the planets for a wide range of heat redistribution factors. We find a trend that this excess appears to be larger for planets with lower equilibrium temperatures. This may imply some additional sources of radiation, such as reflected light from the host star and/or thermal emission from residual internal heat from the formation of the planet.

Bayesian Analysis↗

Update on a short-distance $D^0$-meson mixing calculation with $N_f=2+1$ flavors

We present an update on our calculation of the short-distance $D^0$-meson mixing hadronic matrix elements. The analysis is performed on the MILC collaboration's $N_f=2+1$ asqtad configurations. We use asqtad light valence quarks and the Sheikoleslami-Wohlert action with the Fermilab interpretation for the valence charm quark. SU(3), partially quenched, rooted, staggered heavy-meson chiral perturbation theory is used to extrapolate to the chiral-continuum limit. Systematic errors arising from the chiral-continuum extrapolation, heavy-quark discretization, and quark-mass uncertainties are folded into the statistical errors from the chiral-continuum fits with methods of Bayesian inference. A preliminary error budget for all five operators is presented.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Sensitive Detection of Structural Differences using a Statistical Framework for Comparative Crystallography

Chemical and conformational changes underlie the functional cycles of proteins. Comparative crystallography can reveal these changes over time, over ligands, and over chemical and physical perturbations in atomic detail. A key difficulty, however, is that the resulting observations must be placed on the same scale by correcting for experimental factors. We recently introduced a Bayesian framework for correcting (scaling) X-ray diffraction data by combining deep learning with statistical priors informed by crystallographic theory. To scale comparative crystallography data, we here combine this framework with a multivariate statistical theory of comparative crystallography. By doing so, we find strong improvements in the detection of protein dynamics, element-specific anomalous signal, and the binding of drug fragments.

Hekstra, Doeke R. [Harvard Univ., Cambridge, MA (U↗

Bayesian estimation of Karhunen–Loève expansions; A random subspace approach

One of the most widely-used statistical procedures for dimensionality reduction of high dimensional random fields is Principal Component Analysis (PCA), which is based on the Karhunen-Lo eve expansion (KLE) of a stochastic process with finite variance. The KLE is analogous to a Fourier series expansion for a random process, where the goal is to find an orthogonal transformation for the data such that the projection of the data onto this orthogonal subspace is optimal in the L 2 sense, i.e, which minimizes the mean square error. In practice, this orthogonal transformation is determined by performing an SVD (Singular Value Decomposition) on the sample covariance matrix or on the data matrix itself. Sampling error is typically ignored when quantifying the principal components, or, equivalently, basis functions of the KLE. Furthermore, it is exacerbated when the sample size is much smaller than the dimension of the random field. In this paper, we introduce a Bayesian KLE procedure, allowing one to obtain a probabilistic model on the principal components, which can account for inaccuracies due to limited sample size. The probabilistic model is built via Bayesian inference, from which the posterior becomes the matrix Bingham density over the space of orthonormal matrices. We use a modified Gibbs sampling procedure to sample on this space and then build a probabilistic Karhunen-Lo eve expansions over random subspaces to obtain a set of low-dimensional surrogates of the stochastic process. We illustrate this probabilistic procedure with a finite dimensional stochastic process inspired by Brownian motion.

97 MATHEMATICS AND COMPUTING↗

sitoolbox: A package for Bayesian estimation of the isotropy violation in the CMB sky

ABSTRACT The standard model of cosmology predicts a statistically isotropic (SI) cosmic microwave background (CMB) sky. However, the SI violation signals are always present in an observed sky-map. Different cosmological artefacts, measurement effects, and unavoidable effects during data analysis, etc. may lead to isotropy violation in an otherwise SI sky. Therefore, a proper data analysis technique should calculate all these SI violation signals, so that they can be matched with SI violation signals from the known sources, and then conclude if there is any intrinsic SI violation in the CMB sky. In one of our recent works, we presented a general Bayesian formalism for measuring the isotropy violation signals in the CMB sky in the presence of an idealized isotropic noise. In this paper, we have extended the mechanism and develop a software package, sitoolbox, for measuring SI violation in presence of anisotropic noise and masking.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

CHARACTERIZING THE CONTAMINATING DISTANCE DISTRIBUTION FOR BAYESIAN SUPERNOVA COSMOLOGY

Measurements of the equation of state of dark energy from surveys of thousands of Type Ia Supernovae will be limited by spectroscopic follow-up and must therefore rely on photometric identification, increasing the chance that the sample is contaminated by core collapse supernovae (CC SNe). Bayesian methods for SN cosmology can remove contamination bias while maintaining high statistical precision but are sensitive to the choice of parameterization of the contaminating distance distribution. We use simulations to investigate the form of the contaminating distribution and its dependence on the absolute magnitudes, light curve shapes, colors, extinction, and redshifts of CC SNe. We find that the CC luminosity function (LF) dominates the distance distribution function, but its shape is increasingly distorted as the redshift increases and more CC SNe fall below the survey magnitude limit. The shapes and colors of the CC light curves generally shift the distance distribution, and their effect on the CC distances is correlated. We compare the simulated distances to the first year results of the SDSS-II SN survey and find that the SDSS distance distributions can be reproduced with simulated CC SNe that are {approx}1 mag fainter than the standard Richardson et al. LFs, which do not produce a good fit. To exploit the full power of the Bayesian parameter estimation method, parameterization of the contaminating distribution should be guided by the current knowledge of the CC LFs, coupled with the effects of the survey selection and magnitude limit, and allow for systematic shifts caused by the parameters of the distance fit.

79 ASTRONOMY AND ASTROPHYSICS↗