Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

The best inflationary models after Planck

We compute the Bayesian evidence and complexity of 193 slow-roll single-field models of inflation using the Planck 2013 Cosmic Microwave Background data, with the aim of establishing which models are favoured from a Bayesian perspective. Our calculations employ a new numerical pipeline interfacing an inflationary effective likelihood with the slow-roll library ASPIC and the nested sampling algorithm MultiNest. The models considered represent a complete and systematic scan of the entire landscape of inflationary scenarios proposed so far. Our analysis singles out the most probable models (from an Occam's razor point of view) that are compatible with Planck data, while ruling out with very strong evidence 34% of the models considered. We identify 26% of the models that are favoured by the Bayesian evidence, corresponding to 15 different potential shapes. If the Bayesian complexity is included in the analysis, only 9% of the models are preferred, corresponding to only 9 different potential shapes. These shapes are all of the plateau type.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Quantitative Uncertainty Analysis for Diffraction

Current software uses a least squares statistical method. For each model parameter, current software yields a point estimate and estimated standard error for each point estimate. In contrast, we have employed a Bayesian approach with sampling algorithm to provide a full posterior probability density function on each model parameter. This yields a different type of solution (probabilistic) with better fidelity. The Quantitative Uncertainty Analysis for Diffraction (QUAD) package returns a matrix of affect model parameters as a function of iteration through the MCMC analysis. QUAD is a Python code that allows for analysis of X-ray and neutron diffraction data to infer the structure of materials with quantifiable certainty. The code uses Bayesian statistics and Markov chain sampling algorithms to create posterior probability distributions on all material structure parameters that are modeled by a researcher. The statistical packages use the open source GSASII project as a library to calculate model diffraction patterns.

Fancher, ChristopherM↗

Limitations of polynomial chaos expansions in the Bayesian solution of inverse problems

Polynomial chaos expansions are used to reduce the computational cost in the Bayesian solutions of inverse problems by creating a surrogate posterior that can be evaluated inexpensively. We show, by analysis and example, that when the data contain significant information beyond what is assumed in the prior, the surrogate posterior can be very different from the posterior, and the resulting estimates become inaccurate. One can improve the accuracy by adaptively increasing the order of the polynomial chaos, but the cost may increase too fast for this to be cost effective compared to Monte Carlo sampling without a surrogate posterior.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Exploring the physics of cesium lead halide perovskite quantum dots via Bayesian inference of the photoluminescence spectra in automated experiment

The unique optoelectronic properties of metal halide perovskite quantum dots (QDs) make them promising candidates for applications in light-emitting diodes (LEDs), scintillators, and other photonic devices. The automated micropipetting synthesis platform equipped with an optical reader enables the opportunity for high throughput synthesis and photoluminescent (PL) characterization of metal halide perovskite QDs for the first time. Here, we explore the compositional dependence of the PL behavior and stability of the combinatorial library of cesium lead halide (CsPbX 3 ) perovskites QDs via the automated platform. To study the stability of synthesized QDs in the binary and ternary configurations, we study the time-dependent PL properties using previously developed machine learning analysis. Additionally, to systematically explore the PL behavior in the ternary CsPbX 3 QDs system, we introduce the Bayesian inference framework that allows the probabilistic fit of multiple models to the PL data and establishes both optimal model and model parameter robustly. Furthermore, these behaviors can be used as a control parameter for the navigation of the multidimensional compositional spaces in automated synthesis. Furthermore, this analysis shows the nonuniformity of the PL peak behavior in the ternary CsPbX 3 QDs system. Further, the analysis confirms narrow size distribution and good quality of CsPbBr 3 QDs alloyed with low concentrations of iodide and chloride. We note that Bayesian Inference fit parameters can be further used as a control signal for navigation of the chemical spaces in automated synthesis.

36 MATERIALS SCIENCE↗

Multimodal Bayesian registration of noisy functions using Hamiltonian Monte Carlo

Functional data registration is a necessary processing step for many applications. The observed data can be inherently noisy, often due to measurement error or natural process uncertainty; which most functional alignment methods cannot handle. A pair of functions can also have multiple optimal alignment solutions, which is not addressed in current literature. In this paper, a flexible Bayesian approach to functional alignment is presented, which appropriately accounts for noise in the data without any pre-smoothing required. Additionally, by running parallel MCMC chains, the method can account for multiple optimal alignments via the multi-modal posterior distribution of the warping functions. To most efficiently sample the warping functions, the approach relies on a modification of the standard Hamiltonian Monte Carlo to be well-defined on the infinite-dimensional Hilbert space. In this work, this flexible Bayesian alignment method is applied to both simulated data and real data sets to show its efficiency in handling noisy functions and successfully accounting for multiple optimal alignments in the posterior; characterizing the uncertainty surrounding the warping functions.

97 MATHEMATICS AND COMPUTING↗

Proxy-based Bayesian inversion of strain tensor data measured during well tests

Recent instrument developments have made it possible to measure the strain tensor caused by injecting or pumping fluid from aquifers or reservoirs, but the full value of these data is limited because the long runtimes of poroelastic forward models makes it impractical to use many inversion schemes. This limits the interpretation of strain data for managing the recovery of resources or storage of wastes in the subsurface. This paper describes a method of inverting deformation data using a poroelastic numerical simulator so the results can be used to manage reservoirs or aquifers. We developed a workflow designed to reduce the number of simulations sufficiently to make it feasible to use DREAMzs, an advanced Bayesian inversion method that translates the uncertainties from different sources into unbiased posterior parameter distributions and uncertainty envelopes around the field data. Using a KNN proxy model for the poroelastic simulator is key to reducing the overall computations, and the workflow includes a strategy for ensuring the proxy model results converge on the results from the simulator. The workflow is tested using an idealized example that verifies the ability to correctly identify parameters and characterize noise used to perturb the data. Field data from an injection test at an oil reservoir near Tulsa, Oklahoma, are also used to evaluate the efficacy of the workflow with a real dataset. The workflow identified 265 history matching solutions out of 1240 total simulation runs (21% acceptance ratio), where the results were used to characterize posterior parameter distribution and evaluate the prediction uncertainty. Furthermore, this workflow is significant because it enables strain tensor, or other geomechanical measurements to be interpreted to guide decision-making during energy and environmental processes in the subsurface.

42 ENGINEERING↗

Optimization of Thermal Conductance at Interfaces Using Machine Learning Algorithms

We report optimization of thermal transport across the interface of two different materials is critical to micro-/nanoscale electronic, photonic, and phononic devices. Although several examples of compositional intermixing at the interfaces having a positive effect on interfacial thermal conductance (ITC) have been reported, an optimum arrangement has not yet been determined because of the large number of potential atomic configurations and the significant computational cost of evaluation. On the other hand, computation-driven materials design efforts are rising in popularity and importance. Yet, the scalability and transferability of machine learning models remain as challenges in creating a complete pipeline for the simulation and analysis of large molecular systems. In this work we present a scalable Bayesian optimization framework, which leverages dynamic spawning of jobs through the Message Passing Interface (MPI) to run multiple parallel molecular dynamics simulations within a parent MPI job to optimize heat transfer at the silicon and aluminum (Si/Al) interface. We found a maximum of 50% increase in the ITC when introducing a two-layer intermixed region that consists of a higher percentage of Si. Because of the random nature of the intermixing, the magnitude of increase in the ITC varies. We observed that both homogeneity/heterogeneity of the intermixing and the intrinsic stochastic nature of molecular dynamics simulations account for the variance in ITC.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The phase-space structure of nearby dark matter as constrained by the SDSS

Previous studies using numerical simulations have demonstrated that the shape of the cosmic web can be described by studying the Lagrangian displacement field. We extend these analyses, showing that it is now possible to perform a Lagrangian description of cosmic structure in the nearby Universe based on large-scale structure observations. Building upon recent Bayesian large-scale inference of initial conditions, we present a cosmographic analysis of the dark matter distribution and its evolution, referred to as the dark matter phase-space sheet, in the nearby universe as probed by the Sloan Digital Sky Survey main galaxy sample. We consider its stretchings and foldings using a tetrahedral tessellation of the Lagrangian lattice. The method provides extremely accurate estimates of nearby density and velocity fields, even in regions of low galaxy density. It also measures the number of matter streams, and the deformation and parity reversals of fluid elements, which were previously thought inaccessible using observations. We illustrate the approach by showing the phase-space structure of known objects of the nearby Universe such as the Sloan Great Wall, the Coma cluster and the Boötes void. We dissect cosmic structures into four distinct components (voids, sheets, filaments, and clusters), using the Lagrangian classifiers DIVA, ORIGAMI, and a new scheme which we introduce and call LICH. Because these classifiers use information other than the sheer local density, identified structures explicitly carry physical information about their formation history. Accessing the phase-space structure of dark matter in galaxy surveys opens the way for new confrontations of observational data and theoretical models. We have made our data products publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗

Assessing the Quality of Bioforensic Signatures

We present a mathematical framework for assessing the quality of signature systems in terms of fidelity, cost, risk, and utility—a method we refer to as Signature Quality Metrics (SQM). We demonstrate the SQM approach by assessing the quality of a signature system designed to predict the culture medium used to grow a microorganism. The system consists of four chemical assays designed to identify various ingredients that could be used to produce the culture medium. The analytical measurements resulting from any combination of these four assays can be used in a Bayesian network to predict the probabilities that the microorganism was grown using one of eleven culture media. We evaluated fifteen combinations of the signature system by removing one or more of the assays from the Bayes network. We demonstrated that SQM can be used to distinguish between the various combinations in terms of attributes of interest. The approach assisted in clearly identifying assays that were least informative, largely in part because they only could discriminate between very few culture media, and in particular, culture media that are rarely used. There are limitations associated with the data that were used to train and test the signature system. Consequently, our intent is not to draw formal conclusions regarding this particular bioforensic system, but rather to illustrate an analytical approach that could be useful in comparing one signature system to another.

Bayesian networks↗

pnnl/MCRASTA

McRasta (Markov Chain Rate and State Analysis) was developed to estimate parameter uncertainty in constitutive friction models via Bayesian inverse and Markov Chain Monte Carlo (MCMC) methods.

Fichera, Marissa [Pacific Northwest National Labor↗

Experimental Studies of Elementary Particle Interactions at High Energies

This is the final report of a program of research on "Experimental Studies of Elementary Particle Interactions at High Energies'' of the High Energy Physics (HEP) group of The Rockefeller University. The research was carried out using the Collider Detector at Fermilab (CDF) and the Compact Muon Solenoid (CMS) detector at the Large Hadron Collider (LHC) at CERN. Three faculty members, two research associates, and two postdoctoral associates participated in this project. At CDF, we studied proton-antiproton collisions at an energy of 1.96 TeV. We focused on diffractive interactions, in which the colliding antiproton loses a small fraction of its momentum, typically less than 1%, while the proton is excited into a high mass state retaining its quantum numbers. The study of such collisions provides insight into the nature of the diffractive exchange, conventionally referred to as Pomeron exchange. In studies of W and Z production, we found results that point to a QCD-based interpretation of the diffractive exchange, as predicted in a data-driven phenomenology developed within the Rockefeller HEP group. At CMS, we worked on diffraction, supersymmetry (SUSY), dark matter, large extra dimensions, and statistical applications to data analysis projects. In diffraction, we extended our CDF studies to higher energies working on two fronts: measurement of the single/double diffraction and of the rapidity gap cross sections at 7 TeV, and development of a simulation of diffractive processes along the lines of our successful model used at CDF. Working with the PYTHIA8 Monte Carlo simulation authors, we implemented our model as a PYTHIA8-MBR option in PYTHIA8 and used it in our data analysis. Preliminary results indicate good agreement. We searched for SUSY by measuring parameters in the Constrained Minimal Supersymmetric extension of the Standard Model (CMSSM) and found results which, combined with other experimental constraints and theoretical considerations, indicate that the CMSSM is not a viable model. Expressing our results in terms of simple topologies, we exclude squark masses below 0.75 TeV and gluino masses below 1.1 TeV. Astrophysical measurements suggest that about 80% of the matter density of the Universe is non-luminous. One of the theories on dark matter attributes it to Weakly Interacting Massive Particles (WIMPs). We searched for WIMPs in 7 TeV and 8 TeV collisions at CMS and set limits on WIMP production rates, which are competitive and complementary to those of direct detection experiments. Searching for monojets (events with only one jet), which in a popular model could be produced by a jet paired by a gravitino that escapes into extra dimensions, we significantly improved the previously set limit. Our results have been used to set limits on Higgs decay to invisible particles and on production of top squarks in compressed SUSY scenarios. Statistics. We computed Bayesian reference priors for several types of measurement and used them in the analysis of CMS data; investigated the applicability of bootstrap methods to HEP measurements; studied several issues associated with simple-versus-simple hypothesis testing and applied the resulting methods to the measurement of some properties of the top quark and Higgs boson.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Detection of atmospheric rivers with inline uncertainty quantification: TECA-BARD v1.0.1

It has become increasingly common for researchers to utilize methods that identify weather features in climate models. There is an increasing recognition that the uncertainty associated with choice of detection method may affect our scientific understanding. For example, results from the Atmospheric River Tracking Method Intercomparison Project (ARTMIP) indicate that there are a broad range of plausible atmospheric river (AR) detectors and that scientific results can depend on the algorithm used. There are similar examples from the literature on extratropical cyclones and tropical cyclones. It is therefore imperative to develop detection techniques that explicitly quantify the uncertainty associated with the detection of events. We seek to answer the following question: given a “plausible” AR detector, how does uncertainty in the detector quantitatively impact scientific results? We develop a large dataset of global AR counts, manually identified by a set of eight researchers with expertise in atmospheric science, which we use to constrain parameters in a novel AR detection method. We use a Bayesian framework to sample from the set of AR detector parameters that yield AR counts similar to the expert database of AR counts; this yields a set of “plausible” AR detectors from which we can assess quantitative uncertainty. This probabilistic AR detector has been implemented in the Toolkit for Extreme Climate Analysis (TECA), which allows for efficient processing of petabyte-scale datasets. We apply the TECA Bayesian AR Detector, TECA-BARD v1.0.1, to the MERRA-2 reanalysis and show that the sign of the correlation between global AR count and El Niño–Southern Oscillation depends on the set of parameters used.

54 ENVIRONMENTAL SCIENCES↗

SU-E-J-248: Contributions of Tumor and Stroma Phenotyping in Computer-Aided Diagnosis

Purpose: To gain insight into the role of parenchyma stroma in the characterization of breast tumors by incorporating computerized mammographic parenchyma assessment into breast CADx in the task of distinguishing between malignant and benign lesions. Methods: This study was performed on 182 biopsy-proven breast mass lesions, including 76 benign and 106 malignant lesions. For each full-field digital mammogram (FFDM) case, our quantitative imaging analysis was performed on both the tumor and a region-of-interest (ROI) from the normal contralateral breast. The lesion characterization includes automatic lesion segmentation and feature extraction. Radiographic texture analysis (RTA) was applied on the normal ROIs to assess the mammographic parenchymal patterns of these contralateral normal breasts. Classification performance of both individual computer extracted features and the output from a Bayesian artificial neural network (BANN) were evaluated with a leave-one-lesion-out method using receiver operating characteristic (ROC) analysis with area under the curve (AUC) as the figure of merit. Results: Lesion characterization included computer-extracted phenotypes of spiculation, size, shape, and margin. For parenchymal pattern characterization, five texture features were selected, including power law beta, contrast, and edge gradient. Merging of these computer-selected features using BANN classifiers yielded AUC values of 0.79 (SE=0.03) and 0.67 (SE=0.04) in the task of distinguishing between malignant and benign lesions using only tumor phenotypes and texture features from the contralateral breasts, respectively. Incorporation of tumor phenotypes with parenchyma texture features into the BANN yielded improved classification performance with an AUC value of 0.83 (SE=0.03) in the task of differentiating malignant from benign lesions. Conclusion: Combining computerized tumor and parenchyma phenotyping was found to significantly improve breast cancer diagnostic accuracy highlighting the need to consider both tumor and stroma in decision making. Funding: University of Chicago Dean Bridge Fund, NCI U24-CA143848-05, P50-CA58223 Breast SPORE program, and Breast Cancer Research Foundation. COI: MLG is a stockholder in R2 technology/Hologic and receives royalties from Hologic, GE Medical Systems, MEDIAN Technologies, Riverain Medical, Mitsubishi, and Toshiba. MLG is a cofounder and stockholder in Quantitative Insights.

60 APPLIED LIFE SCIENCES↗

A Bayesian inferencing framework for ultrasound wave speed measurements in metal additive manufacturing

Process-related changes during metal additive manufacturing introduce microstructural variability in the material properties of printed parts, directly affecting component reliability. Accurate estimation of these property variations with part performance are essential for quality assurance. Ultrasound testing offers a non-destructive means to estimate mechanical properties and detect defects; however, conventional analysis methods often neglect the influence of microstructural variability, limiting their effectiveness. Here, this research presents a Bayesian inference technique for quantifying wave speed uncertainty from ultrasound measurements of metal additive manufactured parts. By integrating prior ultrasound data with a Bayesian model, the proposed approach generates posterior density estimates of wave speed that systematically account for manufacturing-induced variability and uncertainty. The novelty of this research lies in applying a Bayesian framework to analyze experimental ultrasound measurements within the context of metal additive manufacturing variability. The method enhances the accuracy of wave speed estimation by 64%, defect position by 50% and increases confidence associated with wave speed variance by 30% across different porosity levels, thereby providing a robust foundation for improved decision-making and increased reliability in additively manufactured components.

Additive manufacturing↗

Bayesian Tensor Decompositions for Scalable Supervised Learning of Scientific Data (Final Report)

In this document we highlight the detailed accomplishments and progress that we have made in this period. This progress seeks to address the three main objectives to provide new algorithms for quantifying uncertainty in low-multilinear-rank models and to leverage them for data analysis. These include: (1) develop probabilistic models for low-multilinear-rank functions; (2) develop a suite of Bayesian learning approaches to learn the probabilistic models from data; (3) apply the techniques on challenging problems arising in DOE-relevant applications.

97 MATHEMATICS AND COMPUTING↗

Boosting efficiency and reducing graph reliance: Basis adaptation integration in Bayesian multi-fidelity networks

The computational cost of high-fidelity numerical models makes outer-loop analysis, which requires repeated interrogation of the model such as uncertainty quantification, computationally demanding. Multi-fidelity methods, which construct a surrogate model using data from an ensemble of models of varying cost and accuracy, can substantially reduce the cost of outer-loop analysis. However, these methods can be difficult to apply when the model ensemble does not admit a clear hierarchy a priori and the correlations between models are low. Consequently, in this paper, we present a multi-fidelity method that leverages dimension reduction to enhance the correlation between models, thereby reducing the amount of data needed to train a surrogate from an unordered ensemble of models. Our method utilizes basis adaptation to build low-dimensional polynomial chaos expansions of each model and employs Multi-fidelity Networks to encode the relationships among models. We show that the resulting method exhibit two notable advantages over its counterpart: (1) enhanced accuracy (both reduced bias and variance); and (2) reduced dependency on the graph structure encoding relationships among models. We demonstrate the approach on an analytical test problem and a challenging finite element model for a spent nuclear fuel. Our method produces a surrogate model that is significantly more accurate than either a single-fidelity surrogate or a multi-fidelity surrogate constructed without basis adaptation.

42 ENGINEERING↗

On the detection of molecules in the atmosphere of HD 189733b using HST NICMOS transmission spectroscopy

The Hubble Space Telescope/NICMOS transmission spectrum measurements of HD 189733b that suggest the detection of methane (CH{sub 4}) in an exoplanet atmosphere have been a source of significant controversy. With what is probably the best analyzed exoplanet spectroscopy data set to date, different teams, using different methods, have claimed evidence both contradicting and supporting the original findings. Here, we report results from a uniform spectral retrieval analysis of the three independent published spectra together with null hypothesis testing. Based on Bayesian model comparison, we find that two of the three spectra show strong evidence (≥3.6σ) for the detection of molecular features mainly due to water and methane while the third is consistent with a weak molecular detection at the 2.2σ level. We interpret the agreement in the spectral modulation established by previous authors and the atmospheric retrieval results presented here, as a confirmation of the original detection of molecular absorbers in the atmosphere of HD 189733b.

79 ASTRONOMY AND ASTROPHYSICS↗

Compactly‐Supported Nonstationary Kernels for Computing Exact Gaussian Processes on Big Data

The Gaussian process (GP) is a widely used method for analyzing large-scale data sets, including spatio-temporal measurements of nonlinear processes that are now commonplace in the environmental sciences. Traditional implementations of GPs involve stationary kernels (also termed covariance functions) that limit their flexibility, and exact methods for inference that prevent application to data sets with more than about 10,000 points. Modern approaches to address stationarity assumptions generally fail to accommodate large data sets, while all attempts to address scalability focus on approximating the Gaussian likelihood, which can involve subjectivity and lead to inaccuracies. In this work, we explicitly derive an alternative kernel that can discover and encode both sparsity and nonstationarity. We embed the kernel within a fully Bayesian GP model and leverage high-performance computing resources to enable the analysis of massive data sets. We demonstrate the favorable performance of our novel kernel relative to existing exact and approximate GP methods across a variety of synthetic data examples. Furthermore, we conduct space–time prediction based on more than 1 million measurements of daily maximum temperature and verify that our results outperform state-of-the-art methods in the Earth sciences. More broadly, having access to exact GPs that use ultra-scalable, sparsity-discovering, nonstationary kernels allows GP methods to truly compete with a wide variety of machine learning methods.

Gaussian processes↗