Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BAYESIAN STATISTICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

TESTING THE DARK ENERGY WITH GRAVITATIONAL LENSING STATISTICS

We study the redshift distribution of two samples of early-type gravitational lenses, extracted from a larger collection of 122 systems, to constrain the cosmological constant in the {Lambda}CDM model and the parameters of a set of alternative dark energy models (XCDM, Dvali-Gabadadze-Porrati, and Ricci dark energy models), in a spatially flat universe. The likelihood is maximized for {Omega}{sub {Lambda}} = 0.70 {+-} 0.09 when considering the sample excluding the Sloan Lens ACS systems (known to be biased toward large image-separation lenses) and no-evolution, and {Omega}{sub {Lambda}} = 0.81 {+-} 0.05 when limiting to gravitational lenses with image separation {Delta}{theta} > 2'' and no-evolution. In both cases, results accounting for galaxy evolution are consistent within 1{sigma}. The present test supports the accelerated expansion, by excluding the null hypothesis (i.e., {Omega}{sub {Lambda}} = 0) at more than 4{sigma}, regardless of the chosen sample and assumptions on the galaxy evolution. A comparison between competitive world models is performed by means of the Bayesian information criterion. This shows that the simplest cosmological constant model-that has only one free parameter-is still preferred by the available data on the redshift distribution of gravitational lenses. We perform an analysis of the possible systematic effects, finding that the systematic errors due to sample incompleteness, galaxy evolution, and model uncertainties approximately equal the statistical errors, with present-day data. We find that the largest sources of systemic errors are the dynamical normalization and the high-velocity cutoff factor, followed by the faint-end slope of the velocity dispersion function.

79 ASTRONOMY AND ASTROPHYSICS↗

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative datasets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student-t process regression. We apply Student-t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via coloring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics, and classic machine learning clustering algorithms.

97 MATHEMATICS AND COMPUTING↗

Active learning for accelerated design of layered materials

Hetero-structures made from vertically stacked monolayers of transition metal dichalcogenides hold great potential for optoelectronic and thermoelectric devices. Discovery of the optimal layered material for specific applications necessitates the estimation of key material properties, such as electronic band structure and thermal transport coefficients. However, screening of material properties via brute force ab initio calculations of the entire material structure space exceeds the limits of current computing resources. Moreover, the functional dependence of material properties on the structures is often complicated, making simplistic statistical procedures for prediction difficult to employ without large amounts of data collection. Here, we present a Gaussian process regression model, which predicts material properties of an input hetero-structure, as well as an active learning model based on Bayesian optimization, which can efficiently discover the optimal hetero-structure using a minimal number of ab initio calculations. The electronic band gap, conduction/valence band dispersions, and thermoelectric performance are used as representative material properties for prediction and optimization. The Materials Project platform is used for electronic structure computation, while the BoltzTraP code is used to compute thermoelectric properties. Bayesian optimization is shown to significantly reduce the computational cost of discovering the optimal structure when compared with finding an optimal structure by building a regression model to predict material properties. The models can be used for predictions with respect to any material property and our software, including data preparation code based on the Python Materials Genomics (PyMatGen) library as well as python-based machine learning code, is available open source.

36 MATERIALS SCIENCE↗

Emulator Generation Gadget

This software automates the production of standalone emulators for complex computer models. The end result of running the software is a piece of code called an emulator, a statistical approximation which predicts the output of complex computer simulation, but at a much faster speed. The emulator is built using a training set of inputs and outputs from the simulations. The input-output pairs are used in a Bayesian scheme to estimate the parameters of a Gaussian process based regression model that learns the input-output relationship. The estimated parameters are combined with a generic C skeleton to produce a compile-able instantiation of the emulator.

Sweeney, Christine↗

The orbit and transit prospects for β pictoris b constrained with one milliarcsecond astrometry

A principal scientific goal of the Gemini Planet Imager (GPI) is obtaining milliarcsecond astrometry to constrain exoplanet orbits. However, astrometry of directly imaged exoplanets is subject to biases, systematic errors, and speckle noise. Here, we describe an analytical procedure to forward model the signal of an exoplanet that accounts for both the observing strategy (angular and spectral differential imaging) and the data reduction method (Karhunen–Loève Image Projection algorithm). We use this forward model to measure the position of an exoplanet in a Bayesian framework employing Gaussian processes and Markov-chain Monte Carlo to account for correlated noise. In the case of GPI data on β Pic b, this technique, which we call Bayesian KLIP-FM Astrometry (BKA), outperforms previous techniques and yields 1σ errors at or below the one milliarcsecond level. We validate BKA by fitting a Keplerian orbit to 12 GPI observations along with previous astrometry from other instruments. The statistical properties of the residuals confirm that BKA is accurate and correctly estimates astrometric errors. Our constraints on the orbit of β Pic b firmly rule out the possibility of a transit of the planet at 10-σ significance. However, we confirm that the Hill sphere of β Pic b will transit, giving us a rare chance to probe the circumplanetary environment of a young, evolving exoplanet. As a result, we provide an ephemeris for photometric monitoring of the Hill sphere transit event, which will begin at the start of April in 2017 and finish at the end of January in 2018.

79 ASTRONOMY AND ASTROPHYSICS↗

WASP-117 b: An Eccentric Hot Saturn as a Future Complex Chemistry Laboratory

We present spectral analysis of the transiting Saturn-mass planet WASP-117 b, observed with the G141 grism of the Hubble Space Telescope's (HST) Wide Field Camera 3. We reduce and fit the extracted spectrum from the raw transmission data using the open-source software Iraclis before performing a fully Bayesian retrieval using the publicly available analysis suite TauREx 3.0. We detect water vapor alongside a layer of fully opaque cloud, retrieving a terminator temperature of T{sub term}=833{sub -156}{sup +260} K. In order to quantify the statistical significance of this detection, we employ the atmospheric detectability index (ADI), deriving a value of ADI = 2.30, which provides positive but not strong evidence against the flat-line model. Due to the eccentric orbit of WASP-117 b, it is likely that chemical and mixing timescales oscillate throughout orbit due to the changing temperature, possibly allowing warmer chemistry to remain visible as the planet begins transit, despite the proximity of its point of ingress to apastron. We present simulated spectra of the planet as would be observed by the future space missions such as the Atmospheric Remote-sensing Infrared Exoplanet Large-survey and the James Webb Space Telescope and show that, despite not being able to probe such chemistry with current HST data, these observatories should make it possible in the not too distant future.

79 ASTRONOMY AND ASTROPHYSICS↗

A Bayesian nonparametric analysis for zero-inflated multivariate count data with application to microbiome study

High-throughput sequencing technology has enabled researchers to profile microbial communities from a variety of environments, but analysis of multivariate taxon count data remains challenging. Here, we develop a Bayesian nonparametric (BNP) regression model with zero inflation to analyse multivariate count data from microbiome studies. A BNP approach flexibly models microbial associations with covariates, such as environmental factors and clinical characteristics. The model produces estimates for probability distributions which relate microbial diversity and differential abundance to covariates, and facilitates community comparisons beyond those provided by simple statistical tests. We compare the model to simpler models and popular alternatives in simulation studies, showing, in addition to these additional community-level insights, it yields superior parameter estimates and model fit in various settings. The model's utility is demonstrated by applying it to a chronic wound microbiome data set and a Human Microbiome Project data set, where it is used to compare microbial communities present in different environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quantifying uncertainties and correlations in the nuclear-matter equation of state

We perform statistically rigorous uncertainty quantification (UQ) for chiral effective field theory (χ EFT) applied to infinite nuclear matter up to twice nuclear saturation density. The equation of state (EOS) is based on high-order many-body perturbation theory calculations with nucleon-nucleon and three-nucleon interactions up to fourth order in the χ EFT expansion. From these calculations our newly developed Bayesian machine-learning approach extracts the size and smoothness properties of the correlated EFT truncation error. Furthermore, we then propose a novel extension that uses multitask machine learning to reveal correlations between the EOS at different proton fractions. The inferred in-medium χ EFT breakdown scale in pure neutron matter and symmetric nuclear matter is consistent with that from free-space nucleon-nucleon scattering. These significant advances allow us to provide posterior distributions for the nuclear saturation point and propagate theoretical uncertainties to derived quantities: the pressure and incompressibility of symmetric nuclear matter, the nuclear symmetry energy, and its derivative. Our results, which are validated by statistical diagnostics, demonstrate that an understanding of truncation-error correlations between different densities and different observables is crucial for reliable UQ. The methods developed here are publicly available as annotated Jupyter notebooks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Pushing the limits of detectability: mixed dark matter from strong gravitational lenses

One of the frontiers for advancing what is known about dark matter lies in using strong gravitational lenses to characterize the population of the smallest dark matter haloes. There is a large volume of information in strong gravitational lens images – the question we seek to answer is to what extent we can refine this information. To this end, we forecast the detectability of a mixed warm and cold dark matter scenario using the anomalous flux ratio method from strong gravitational lensed images. The halo mass function of the mixed dark matter scenario is suppressed relative to cold dark matter but still predicts numerous low-mass dark matter haloes relative to warm dark matter. Since the strong lensing signal receives a contribution from a range of dark matter halo masses and since the signal is sensitive to the specific configuration of dark matter haloes, not just the halo mass function, degeneracies between different forms of suppression in the halo mass function, relative to cold dark matter, can arise. Here, we find that, with a set of lenses with different configurations of the main deflector and hence different sensitivities to different mass ranges of the halo mass function, the different forms of suppression of the halo mass function between the warm dark matter model and the mixed dark matter model can be distinguished with 40 lenses with Bayesian odds of 30:1.

79 ASTRONOMY AND ASTROPHYSICS↗

Genome-Wide Association of Lipid-Lowering Response to Statins in Combined Study Populations

Statins effectively lower total and plasma LDL-cholesterol, but the magnitude of decrease varies among individuals. To identify single nucleotide polymorphisms (SNPs) contributing to this variation, we performed a combined analysis of genome-wide association (GWA) results from three trials of statin efficacy. Bayesian and standard frequentist association analyses were performed on untreated and statin-mediated changes in LDL-cholesterol, total cholesterol, HDL-cholesterol, and triglyceride on a total of 3932 subjects using data from three studies: Cholesterol and Pharmacogenetics (40 mg/day simvastatin, 6 weeks), Pravastatin/ Inflammation CRP Evaluation (40 mg/day pravastatin, 24 weeks), and Treating to New Targets (10 mg/day atorvastatin, 8 weeks). Genotype imputation was used to maximize genomic coverage and to combine information across studies. Phenotypes were normalized within each study to account for systematic differences among studies, and fixed-effects combined analysis of the combined sample were performed to detect consistent effects across studies. Two SNP associations were assessed as having posterior probability greater than 50%, indicating that they were more likely than not to be genuinely associated with statin-mediated lipid response. SNP rs8014194, located within the CLMN gene on chromosome 14, was strongly associated with statin-mediated change in total cholesterol with an 84% probability by Bayesian analysis, and a p-value exceeding conventional levels of genome-wide significance by frequentist analysis (P = 1.8 x 10 -8 ). This SNP was less significantly associated with change in LDL-cholesterol (posterior probability = 0.16, P = 4.0 x 10 -6 ). Bayesian analysis also assigned a 51% probability that rs4420638, located in APOC1 and near APOE, was associated with change in LDL-cholesterol. Using combined GWA analysis from three clinical trials involving nearly 4,000 individuals treated with simvastatin, pravastatin, or atorvastatin, we have identified SNPs that may be associated with variation in the magnitude of statin-mediated reduction in total and LDL-cholesterol, including one in the CLMN gene for which statistical evidence for association exceeds conventional levels of genome-wide significance.

59 BASIC BIOLOGICAL SCIENCES↗

Integrated analysis and consistency measurement of bremsstrahlung and charge exchange spectroscopy data for the determination of the ion effective charge

In the context of Bayesian probability theory, we discuss a model for estimating the plasma ion effective charge Z{sub eff}, integrating data from both bremsstrahlung spectroscopy and individual impurity concentrations obtained via charge exchange spectroscopy (CXS). The validity of the model, taking into account statistical as well as systematic uncertainties, is shown via the deviance information criterion. The consistency of the continuum and CXS data regarding Z{sub eff} is improved, as measured by the symmetrized Kullback-Leibler divergence and the geodesic distance between the respective Z{sub eff} marginal posterior densities.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

ACCOUNTING FOR CALIBRATION UNCERTAINTIES IN X-RAY ANALYSIS: EFFECTIVE AREAS IN SPECTRAL FITTING

While considerable advance has been made to account for statistical uncertainties in astronomical analyses, systematic instrumental uncertainties have been generally ignored. This can be crucial to a proper interpretation of analysis results because instrumental calibration uncertainty is a form of systematic uncertainty. Ignoring it can underestimate error bars and introduce bias into the fitted values of model parameters. Accounting for such uncertainties currently requires extensive case-specific simulations if using existing analysis packages. Here, we present general statistical methods that incorporate calibration uncertainties into spectral analysis of high-energy data. We first present a method based on multiple imputation that can be applied with any fitting method, but is necessarily approximate. We then describe a more exact Bayesian approach that works in conjunction with a Markov chain Monte Carlo based fitting. We explore methods for improving computational efficiency, and in particular detail a method of summarizing calibration uncertainties with a principal component analysis of samples of plausible calibration files. This method is implemented using recently codified Chandra effective area uncertainties for low-resolution spectral analysis and is verified using both simulated and actual Chandra data. Our procedure for incorporating effective area uncertainty is easily generalized to other types of calibration uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Cosmic acceleration from modified gravity with Palatini formalism

We study new FRW type cosmological models of modified gravity treated on the background of Palatini approach. These models are generalization of Einstein gravity by the presence of a scalar field non-minimally coupled to the curvature. The models employ Starobinsky's term in the Lagrangian and dust matter. Therefore, as a by-product, an exhausted cosmological analysis of general relativity amended by quadratic term is presented. We investigate dynamics of our models, confront them with the currently available astrophysical data as well as against ΛCDM model. We have used the dynamical system methods in order to investigate dynamics of the models. It reveals the presence of a final sudden singularity. Fitting free parameters we have demonstrated by statistical analysis that this class of models is in a very good agreement with the data (including CMB measurements) as well as with the standard ΛCDM model predictions. One has to use statefinder diagnostic in order to discriminate among them. Therefore Bayesian methods of model selection have been employed in order to indicate preferred model. Only in the light of CMB data the concordance model remains invincible.

79 ASTRONOMY AND ASTROPHYSICS↗

In Situ Inference for Earth System Predictability

An understanding of future evolution in precipitation extremes is critical to numerous DOE mission questions. Extreme events are by nature short time-scale events that are difficult to diagnose in available model data. Accurate modeling of extreme events necessarily requires high spatial resolution at the storm scale locally. However, the environment in which storms grow is dependent on global, remote, processes. These complex spatiotemporal relationships are impossible to diagnose at resolutions required to accurately model storms responsible for extreme precipitation. At exascale, climate simulations will produce results at fine enough resolution to investigate these relationships. However, the resulting data from these simulations will be far too large to save for post-simulation analysis. We advocate for fitting statistical models inside the simulations as they run, a context known as in situ, which will facilitate scientific investigations using the full fine-scale data stream. Figure 1 shows an example of the type of model we could consider, a Bayesian hierarchical spatial regression model. Precipitation extremes at each grid cell are modeled using extreme value distributions. Since extremes are rare, fitting models to individual grid cells can result in high variance and poor estimates. Instead, the model can be made more robust by smoothing the parameters of the extreme value model across space. Additionally, the parameters themselves can be functionally linked to other variables elsewhere in the simulation. Thus, we can use the fine-scale data to build more robust models for extremes that link extreme behavior to other climate patterns.

54 ENVIRONMENTAL SCIENCES↗

In Situ Inference for Earth System Predictability

Focal Area: Focal Area 3: Insight gleaned from complex simulated data using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI. Science Challenge: An understanding of future evolution in precipitation extremes is critical to numerous DOE mission questions. Extreme events are by nature short time-scale events that are difficult to diagnose in available model data. Accurate modeling of extreme events necessarily requires high spatial resolution at the storm scale locally. However, the environment in which storms grow is dependent on global, remote, processes. These complex spatiotemporal relationships are impossible to diagnose at resolutions required to accurately model storms responsible for extreme precipitation. At exascale, climate simulations will produce results at fine enough resolution to investigate these relationships. However, the resulting data from these simulations will be far too large to save for post-simulation analysis. We advocate for fitting statistical models inside the simulations as they run, a context known as in situ, which will facilitate scientific investigations using the full fine-scale data stream. Figure 1 shows an example of the type of model we could consider, a Bayesian hierarchical spatial regression model. Precipitation extremes at each grid cell are modeled using extreme value distributions. Since extremes are rare, fitting models to individual grid cells can result in high variance and poor estimates. Instead, the model can be made more robust by smoothing the parameters of the extreme value model across space. Additionally, the parameters themselves can be functionally linked to other variables elsewhere in the simulation. Thus, we can use the fine-scale data to build more robust models for extremes that link extreme behavior to other climate patterns.

54 ENVIRONMENTAL SCIENCES↗

GIS-Based Modeling of Contaminated Soil Volumes at Multiple Sites in the Formerly Utilized Sites Remedial Action Program - 20149

The remediation of hazardous, toxic, and radioactive waste (HTRW) sites produces cost-related risks associated with the estimation of contaminated soil or debris volumes. Historical risk-management techniques include cost contingencies to cover volume uncertainties that affect project budgeting and decision-making. The Buffalo District teamed with project partners to lessen volume uncertainty and reduce project risks at multiple HTRW sites managed under the Formerly Utilized Sites Remedial Action Program (FUSRAP). Historical remedial investigations under FUSRAP commonly identified the presence of radiological material in site media, the associated human health risk, and then areas of remediation. To manage remedial execution and reduce risk, pre-design or remediation-phase sampling essentially 'chased' contamination, which was not conducive to efficient predictive budgeting derived from Feasibility Study (FS) cost analyses. The Buffalo District first optimized their approach to better understand volume uncertainty by utilizing the Argonne National Laboratory's Bayesian Approaches for Adaptive Spatial Sampling (BAASS) software [1]. BAASS processed soft data (e.g., gamma walk-over data) and spatial sampling data to estimate the lateral extent of contaminated soil irrespective of depth (i.e., gross contamination extent) and define areas of contaminant uncertainty. The software performed a binary transformation of contaminant concentrations at all sampling points based upon remedial action goals or a sum of ratios approach (i.e., clean, impacted, or range of impacts in soil). The model produced two-dimensional (horizontal) contaminant probability contours and statistical uncertainty in the sampling coverage and resulting contaminant extents. This method was translated vertically by partitioning the sampling data into depth brackets that produced a stacked representation of contaminant extents and uncertainty in the subsurface (i.e., similar to construction lifts). The results commonly led to a better understanding of project uncertainty and the need for sampling strategies that produce high-confidence soil volumes, which control costs. The BAASS-based delineations were eventually replaced by Empirical Bayesian Kriging (EBK) methods available in ArcGIS Spatial or 3D Analysts [2]. The EBK method calculates contaminant probability zones derived from user-controlled semivariograms of the spatial datasets. The resulting probability zones (e.g., 50% or 80% of contaminant probability) represent the two-dimensional surface delineation of the overall horizontal remedial area, similarly to BAASS. However, unlike BAASS, the vertical sampling data within these probability zones became vertical control points to contour a subterranean surface that connects subsurface points to the land-surface delineations of contamination. The resulting representation of horizontal and vertical impacts within an enclosed envelop (volume) of soil included uncertainty distributions that are used to plan uncertainty-reduction sampling. These data-driven and math-based models of three-dimensional sampling results produced well-bounded remedial volumes for project planning and better uncertainty predictions during project budgeting. The EBK method was applied to several FUSRAP sites managed by the Buffalo District and compared to less rigorously modeled sites previously remediated by the District. The comparison of modeled to actual remediated volumes provide a basis for validating the volume-estimation method. This comparison is important to ensure modeled volumes match physical boundaries of site remediation. FUSRAP sites with denser investigative sampling and lesser volume uncertainty proved useful in remedial planning and contracting. The Buffalo District noted that historical sites with sparser sampling arrays had greater disparity between estimated volumes and final remedial volumes. The benefit achieved over the cost of detailed soil sampling appears positive for FUSRAP projects, especially where impacts vary widely and appear unbounded by investigation-phase sampling. The subsequent Empirical Bayesian Kriging of contamination coupled with vertical contouring for soil estimations reduces uncertainty in soil volumes or indicates where sampling is required to reduce uncertainty, which together optimize remedial planning and budgeting. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Quantifying and Reducing Curve-Fitting Uncertainty in Isc: Preprint

Current-voltage (I-V) curve measurements of photovoltaic (PV) devices are used to determine performance parameters and to establish traceable calibration chains. Measurement standards specify localized curve fitting methods, e.g., straight-line interpolation/extrapolation of the I-V curve points near short-circuit current, Isc. By considering such fits as statistical linear regressions, uncertainties in the performance parameters are readily quantified. However, the legitimacy of such a computed uncertainty requires that the model be a valid (local) representation of the I-V curve and that the noise be sufficiently well characterized. Using more data points often has the advantage of lowering the uncertainty. However, more data points can make the uncertainty in the fit arbitrarily small, and this fit uncertainty misses the dominant residual uncertainty due to so-called model discrepancy. Using objective Bayesian linear regression for straight-line fits for Isc, we investigate an evidence-based method to automatically choose data windows of I-V points with reduced model discrepancy. We also investigate noise effects. Uncertainties, aligned with the Guide to the Expression of Uncertainty in Measurement (GUM), are quantified throughout.

14 SOLAR ENERGY↗