Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BAYESIAN STATISTICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Validation Metrics for Fixed Effects and Mixed-Effects Calibration

The modern scientific process often involves the development of a predictive computational model. To improve its accuracy, a computational model can be calibrated to a set of experimental data. A variety of validation metrics can be used to quantify this process. Some of these metrics have direct physical interpretations and a history of use, while others, especially those for probabilistic data, are more difficult to interpret. In this work, a variety of validation metrics are used to quantify the accuracy of different calibration methods. Frequentist and Bayesian perspectives are used with both fixed effects and mixed-effects statistical models. Through a quantitative comparison of the resulting distributions, the most accurate calibration method can be selected. Two examples are included which compare the results of various validation metrics for different calibration methods. It is quantitatively shown that, in the presence of significant laboratory biases, a fixed effects calibration is significantly less accurate than a mixed-effects calibration. This is because the mixed-effects statistical model better characterizes the underlying parameter distributions than the fixed effects model. The results suggest that validation metrics can be used to select the most accurate calibration model for a particular empirical model with corresponding experimental data.

97 MATHEMATICS AND COMPUTING↗

Gamma-Ray Raster Imaging with Robotic Data Collection (FY19 Annual Report)

This project has developed an alternative imaging capability for imaging and quantifying radioactive materials in situ. This approach uses a robotic-mounted gamma-ray detector which can move around an area of interest, sampling the space at a high frequency. By rastering across the area, an image can be created with no collimation and a high efficiency. An open-source robotic platform was programed to search an open area, collecting gamma-ray spectra every second. Informative path planning was used to direct the robot to areas of higher dose. Finally, a Bayesian particle filter was used to locate the source with minimal counting statistics. The use of a robotic mount allows data collection for long periods of time unattended, and it will also eliminate uncertainties in positioning typically introduced by personnel. This approach will be particularly relevant for gloveboxes, shielded cells, or process piping which may have complex, non-uniform distributions of material.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

We Know Where We Don't Know: 3D Bayesian CNNs for Credible Geometric Uncertainty

Deep learning has been successfully applied to the segmentation of 3D Computed Tomography (CT) scans. Establishing the credibility of these segmentations requires uncertainty quantification (UQ) to identify untrustworthy predictions. Recent UQ architectures include Monte Carlo dropout networks (MCDNs), which approximate deep Gaussian processes, and Bayesian neural networks (BNNs), which learn the distribution of the weight space. BNNs are advantageous over MCDNs for UQ but are thought to be computationally infeasible in high dimension, and neither architecture has produced interpretable geometric uncertainty maps. We propose a novel 3D Bayesian convolutional neural network (BCNN), the first deep learning method which generates statistically credible geometric uncertainty maps and scales for application to 3D data. We present experimental results on CT scans of graphite electrodes and laser-welded metals and show that our BCNN outperforms an MCDN in recent uncertainty metrics. The geometric uncertainty maps generated by our BCNN capture distributions of sigmoid values that are interpretable as confidence intervals, critical for applications that rely on deep learning for high-consequence decisions.

97 MATHEMATICS AND COMPUTING↗

Software For Multivariate Bayesian Classification

PHD general-purpose classifier computer program. Uses Bayesian methods to classify vectors of real numbers, based on combination of statistical techniques that include multivariate density estimation, Parzen density kernels, and EM (Expectation Maximization) algorithm. By means of simple graphical interface, user trains classifier to recognize two or more classes of data and then use it to identify new data. Written in ANSI C for Unix systems and optimized for online classification applications. Embedded in another program, or runs by itself using simple graphical-user-interface. Online help files makes program easy to use.

Saul, Ronald↗

Bayesian Analysis of the Power Spectrum of the Cosmic Microwave Background

There is a wealth of cosmological information encoded in the spatial power spectrum of temperature anisotropies of the cosmic microwave background. The sky, when viewed in the microwave, is very uniform, with a nearly perfect blackbody spectrum at 2.7 degrees. Very small amplitude brightness fluctuations (to one part in a million!!) trace small density perturbations in the early universe (roughly 300,000 years after the Big Bang), which later grow through gravitational instability to the large-scale structure seen in redshift surveys... In this talk, I will discuss a Bayesian formulation of this problem; discuss a Gibbs sampling approach to numerically sampling from the Bayesian posterior, and the application of this approach to the first-year data from the Wilkinson Microwave Anisotropy Probe. I will also comment on recent algorithmic developments for this approach to be tractable for the even more massive data set to be returned from the Planck satellite.

Bayesian inference↗

Deep Data Analysis of Conductive Phenomena on Complex Oxide Interfaces: Physics from Data Mining

Spatial variability of electronic transport in BiFeO3-CoFe2O4 (BFO-CFO) self-assembled heterostructures is explored using spatially resolved first order reversal curve (FORC) current voltage (IV) mapping. Multivariate statistical analysis of FORC-IV data classifies statistically significant behaviors and maps characteristic responses spatially. In particular, regions of grain, matrix, and grain boundary responses are clearly identified. K-means and Bayesian demixing analysis suggests the characteristic response be separated into four components, with hysteretic type behavior localized at the BFO-CFO tubular interfaces. The conditions under which Bayesian components allow direct physical interpretation are explored, and transport mechanisms at the grain boundaries and individual phases are analyzed. This approach conjoins multivariate statistical analysis with physics-based interpretation, actualizing a robust, universal, data driven approach to problem solving, which can be applied to exploration of local transport and other functional phenomena in other spatially inhomogeneous systems.

big data↗

Bayesian Spatial Models for Projecting Corn Yields

Climate change is predicted to impact corn yields. Previous studies analyzing these impacts differ in data and modeling approaches and, consequently, corn yield projections. We analyze the impacts of climate change on corn yields using two statistical models with different approaches for dealing with county-level effects. The first model, which is novel to modeling corn yields, uses a computationally efficient spatial basis function approach. We use a Bayesian framework to incorporate both parametric and climate model structural uncertainty. We find that the statistical models have similar predictive abilities, but the spatial basis function model is faster and hence potentially a useful tool for crop yield projections. We also explore how different gridded temperature datasets affect the statistical model fit and performance. Compared to the dataset with only weather station data, we find that the dataset composed of satellite and weather station data results in a model with a magnified relationship between temperature and corn yields. For all statistical models, we observe a relationship between temperature and corn yields that is broadly similar to previous studies. We use downscaled and bias-corrected CMIP5 climate model projections to obtain detrended corn yield projections for 2020–2049 and 2069–2098. In both periods, we project a decrease in the mean corn yield production, reinforcing the findings of other studies. However, the magnitude of the decrease and the associated uncertainties we obtain differ from previous studies.

54 ENVIRONMENTAL SCIENCES↗

STUDIES IN ASTRONOMICAL TIME SERIES ANALYSIS. VI. BAYESIAN BLOCK REPRESENTATIONS

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time suppressing the inevitable corrupting observational errors. We present a simple nonparametric modeling technique and an algorithm implementing it-an improved and generalized version of Bayesian Blocks-that finds the optimal segmentation of the data in the observation interval. The structure of the algorithm allows it to be used in either a real-time trigger mode, or a retrospective mode. Maximum likelihood or marginal posterior functions to measure model fitness are presented for events, binned counts, and measurements at arbitrary times with known error distributions. Problems addressed include those connected with data gaps, variable exposure, extension to piecewise linear and piecewise exponential representations, multivariate time series data, analysis of variance, data on the circle, other data modes, and dispersed data. Simulations provide evidence that the detection efficiency for weak signals is close to a theoretical asymptotic limit derived by Arias-Castro et al. In the spirit of Reproducible Research all of the code and data necessary to reproduce all of the figures in this paper are included as supplementary material.

79 ASTRONOMY AND ASTROPHYSICS↗

Studies in Astronomical Time Series Analysis. VI. Bayesian Block Representations

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time suppressing the inevitable corrupting observational errors. We present a simple nonparametric modeling technique and an algorithm implementing it-an improved and generalized version of Bayesian Blocks [Scargle 1998]-that finds the optimal segmentation of the data in the observation interval. The structure of the algorithm allows it to be used in either a real-time trigger mode, or a retrospective mode. Maximum likelihood or marginal posterior functions to measure model fitness are presented for events, binned counts, and measurements at arbitrary times with known error distributions. Problems addressed include those connected with data gaps, variable exposure, extension to piece- wise linear and piecewise exponential representations, multivariate time series data, analysis of variance, data on the circle, other data modes, and dispersed data. Simulations provide evidence that the detection efficiency for weak signals is close to a theoretical asymptotic limit derived by [Arias-Castro, Donoho and Huo 2003]. In the spirit of Reproducible Research [Donoho et al. (2008)] all of the code and data necessary to reproduce all of the figures in this paper are included as auxiliary material.

signal detection↗

Anomaly Detection in Partially Observed Traffic Networks

This paper addresses the problem of detecting anomalous activity in traffic networks where the network is not directly observed. Given knowledge of what the node-tonode traffic in a network should be, any activity that differs significantly from this baseline would be considered anomalous. We propose a Bayesian hierarchical model for estimating the traffic rates and detecting anomalous changes in the network. The probabilistic nature of the model allows us to perform statistical goodness-of-fit tests to detect significant deviations from a baseline network. We show that due to the more defined structure of the hierarchical Bayesian model, such tests perform well even when the empirical models estimated by the EM algorithm are misspecified. Finally, we apply our model to both simulated and real datasets to demonstrate its superior performance over existing alternatives.

97 MATHEMATICS AND COMPUTING↗

Order priors for Bayesian network discovery with an application to malware phylogeny

Here, Bayesian networks have been used extensively to model and discover dependency relationships among sets of random variables. We learn Bayesian network structure with a combination of human knowledge about the partial ordering of variables and statistical inference of conditional dependencies from observed data. Our approach leverages complementary information from human knowledge and inference from observed data to produce networks that reflect human beliefs about the system as well as to fit the observed data. Applying prior beliefs about partial orderings of variables is an approach distinctly different from existing methods that incorporate prior beliefs about direct dependencies (or edges) in a Bayesian network. We provide an efficient implementation of the partial-order prior in a Bayesian structure discovery learning algorithm, as well as an edge prior, showing that both priors meet the local modularity requirement necessary for an efficient Bayesian discovery algorithm. In benchmark studies, the partial-order prior improves the accuracy of Bayesian network structure learning as well as the edge prior, even though order priors are more general. Our primary motivation is in characterizing the evolution of families of malware to aid cyber security analysts. For the problem of malware phylogeny discovery, we find that our algorithm, compared to existing malware phylogeny algorithms, more accurately discovers true dependencies that are missed by other algorithms.

97 MATHEMATICS AND COMPUTING↗

Understanding the formation and evolution of interstellar ices: a Bayesian approach

Understanding the physical conditions of dark molecular clouds and star-forming regions is an inverse problem subject to complicated chemistry that varies nonlinearly with both time and the physical environment. In this paper, we apply a Bayesian approach based on a Markov chain Monte Carlo (MCMC) method for solving the nonlinear inverse problems encountered in astrochemical modeling. We use observations for ice and gas species in dark molecular clouds and a time-dependent, gas-grain chemical model to infer the values of the physical and chemical parameters that characterize quiescent regions of molecular clouds. We show evidence that in high-dimensional problems, MCMC algorithms provide a more efficient and complete solution than more classical strategies. The results of our MCMC method enable us to derive statistical estimates and uncertainties for the physical parameters of interest as a result of the Bayesian treatment.

79 ASTRONOMY AND ASTROPHYSICS↗

Estimated {sup 55}Mn and {sup 90}Zr Cross Section Covariances in the Fast Neutron Energy Region

We completed estimates of neutron cross section covariances for {sup 55}Mn and {sup 90}Zr, from the keV energy range to 25 MeV, considering the most important reaction channels, total, elastic, inelastic, capture, and (n,2n). The nuclear reaction model code EMPIRE was used to calculate sensitivity to model parameters by a perturbation of parameters that define the optical model potential, nuclear level densities and strength of the pre-equilibrium emission. The sensitivity analysis was performed with the set of parameters which reproduces the ENDF/B-VII.0 cross sections. The experimental data were analyzed and both statistical and systematic uncertainties were extracted from almost 30 selected experiments. Then, the Bayesian code KALMAN was used to combine the sensitivity analysis and the experiments to obtain the evaluated covariance matrices.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

PARALLAXES AND PROPER MOTIONS OF ULTRACOOL BROWN DWARFS OF SPECTRAL TYPES Y AND LATE T

We present astrometric measurements of 11 nearby ultracool brown dwarfs of spectral types Y and late-T, based on imaging observations from a variety of space-based and ground-based telescopes. These measurements have been used to estimate relative parallaxes and proper motions via maximum likelihood fitting of geometric model curves. To compensate for the modest statistical significance ({approx}< 7) of our parallax measurements we have employed a novel Bayesian procedure for distance estimation which makes use of an a priori distribution of tangential velocities, V {sub tan}, assumed similar to that implied by previous observations of T dwarfs. Our estimated distances are therefore somewhat dependent on that assumption. Nevertheless, the results have yielded distances for five of our eight Y dwarfs and all three T dwarfs. Estimated distances in all cases are {approx}> 3 pc. In addition, we have obtained significant estimates of V {sub tan} for two of the Y dwarfs; both are <100 km s{sup -1}, consistent with membership in the thin disk population. Comparison of absolute magnitudes with model predictions as a function of color shows that the Y dwarfs are significantly redder in J - H than predicted by a cloud-free model.

79 ASTRONOMY AND ASTROPHYSICS↗

Gamma-ray burst flares: X-ray flaring. II

We present a catalog of 498 flaring periods found in gamma-ray burst (GRB) light curves taken from the online Swift X-Ray Telescope GRB Catalogue. We analyzed 680 individual light curves using a flare detection method developed and used on our UV/optical GRB Flare Catalog. This method makes use of the Bayesian Information Criterion to analyze the residuals of fitted GRB light curves and statistically determines the optimal fit to the light curve residuals in an attempt to identify any additional features. These features, which we classify as flares, are identified by iteratively adding additional 'breaks' to the light curve. We find evidence of flaring in 326 of the analyzed light curves. For those light curves with flares, we find an average number of ∼1.5 flares per GRB. As with the UV/optical, flaring in our sample is generally confined to the first 1000 s of the afterglow, but can be detected to beyond 10{sup 5} s. Only ∼50% of the detected flares follow the 'classical' definition of Δt/t ≤ 0.5, with many of the largest flares exceeding this value.

79 ASTRONOMY AND ASTROPHYSICS↗

Antiproton bounds on dark matter annihilation from a combined analysis using the DRAGON2 code

Abstract Early studies of the AMS-02 antiproton ratio identified a possible excess over the expected astrophysical background that could be fit by the annihilation of a weakly interacting massive particle (WIMP). However, recent efforts have shown that uncertainties in cosmic-ray propagation, the antiproton production cross-section, and correlated systematic uncertainties in the AMS-02 data, may combine to decrease or eliminate the significance of this feature. We produce an advanced analysis using the DRAGON2 code which, for the first time, simultaneously fits the antiproton ratio along with multiple secondary cosmic-ray flux measurements to constrain astrophysical and nuclear uncertainties. Compared to previous work, our analysis benefits from a combination of: (1) recently released AMS-02 antiproton data, (2) updated nuclear fragmentation cross-section fits, (3) a rigorous Bayesian parameter space scan that constrains cosmic-ray propagation parameters.We find no statistically significant preference for a dark matter signal and set strong constraints on WIMP annihilation tobb̅, ruling out annihilation at the thermal cross-section for dark matter masses below ∼ 200 GeV. We do find a positive residual that is consistent with previous work, and can be explained by a ∼ 70 GeV WIMP annihilating below the thermal cross-section. However, our default analysis finds this excess to have a local significance of only 2.8σ, which is decreased to 1.8σwhen the look-elsewhere effect is taken into account.

Astronomy & Astrophysics↗

Exclusion limits from data of directional dark matter detectors

Directional detection is a promising search strategy to discover Galactic dark matter. Taking advantage on the rotation of the Solar System around the Galactic center through the dark matter halo, it allows us to show a direction dependence of weakly interacting massive particle (WIMP) events. Even though the goal of directional search is to identify a WIMP positive detection, exclusion limits are still needed for very low exposure with a rather large background contamination, such as the one obtained with prototype experiments. Data of directional detectors are composed of energy and a 3D track for all recoiling nuclei. However, to set robust exclusion limits, we focus on the angular part of the event distribution, arguing that the energy part of the background distribution is unknown. As the angular distributions of both background and WIMP events are known, a Bayesian approach to set exclusion limits is possible. In this paper, a new statistical method based on an extended likelihood is proposed, compared to existing ones, and is shown to be optimal. Eventually, a comprehensive study of the effect of a detector configuration on exclusion limits is presented. It includes the effect of having or not sense recognition, a finite angular resolution, taking into account energy threshold as well as some astrophysical uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Quantifying Uncertainties of Microscopic Nuclear Theories

The goal of this project was to produce modernized nuclear data libraries of light ion fusion reactions and actinide fission product yields. Such libraries are essential input in both stockpile science but also fundamental science (nucleosynthesis, superheavy nuclei). When such libraries are used to model complex processes involving exotic, very short-lived nuclei that have not been measured experimentally, the underlying nuclear data come from theoretical models, the predictive power of which needs to be quantified, together with its uncertainties. By teaming up nuclear theorists and statisticians, we built comprehensive theoretical frameworks based on the most fundamental theories of fusion and fission that we coupled for the first time with a Bayesian framework with machine learning techniques for uncertainty quantification. Our results include: (1) statistical emulators for neutron-alpha scattering, and the fission product mass yields of neutron-induced fission of 239 Pu, which will enable developers to generate random realizations of the corresponding data for uncertainty quantification (UQ) in applications; (2) the first complete and most accurate ab initio prediction of the S-factor for proton capture on 7 Be, which – combined with UQ – may become the recommended value at solar energies in the next review of solar fusion cross sections; (3) statistical emulators for fission mass yields in the neutron-induced fission of 239 Pu; (4) the first quantification of how uncertainties in nuclear forces impact fission properties that are relevant in nucleosynthesis simulations to explain how heavy elements are formed in the Cosmos.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗