Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian Robustness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A deep, multi-epoch Chandra HETG study of the ionized outflow from NGC 4051

Actively accreting supermassive black holes significantly impact the evolution of their host galaxies, truncating further star formation by expelling large fractions of gas with wide-angle outflows. The X-ray band is key to understanding how these black hole winds affect their environment, as the outflows have high temperatures ~10 5–8 K). We have developed a Bayesian framework for characterizing active galactic nucleus outflows with an improved ability to explore parameter space and perform robust model selection. We applied this framework to a new 700 ks and an archival 315 ks Chandra High Energy Transmission Gratings observation of the Seyfert galaxy NGC 4051. We have detected six absorbers intrinsic to NGC 4051. These wind components span velocities from 400 to 30000 km s -1 . We have determined that the most statistically significant wind component is purely collisionally ionized, which is the first detection of such an absorber. This wind has T ≈ 10 7 K and v ≈ 880 km s -1 and remains remarkably stable between the two epochs. Other slow components also remain stable across time. Fast outflow components change their properties between 2008 and 2016, suggesting either physical changes or clouds moving in and out of the line of sight. For one of the fast components, we obtain one of the tightest wind density measurements to date, log n/(cm -3 ) = 13.0$^{+0.01}_{-0.02}$, and determine that it is located at ~240 gravitational radii. The estimated total outflow power surpasses 5 percent of the bolometric luminosity (albeit with large uncertainties) making it important in the context of galaxy–black hole interactions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Improving Predictions Under Uncertainty of Material Plasma Device Operations

Understanding the properties of materials when exposed to various plasma temperatures and fluxes is essential to the building and operating of fusion reactors. The Material Plasma Exposure eXperiment (MPEX) is an instrument currently being developed by the Department of Energy (DOE) for this purpose. MPEX is expected to come online in stages over the next five years. Proto-MPEX, the predecessor to MPEX, operated from 2014 to 2021, and was designed to understand the generation of plasma temperatures and fluxes at orders of magnitude below what will be obtained by MPEX. This work uses the recently developed stochastic neural network (SNN), a machine learning technique capable of operating under uncertainty to provide a surrogate model for the Proto-MPEX device. We demonstrate that SNN outperforms Bayesian neural network (BNN), a standard in the field of machine learning with uncertainty. The development of a robust surrogate of the Proto-MPEX will aid in the commissioning and operation of the MPEX device.

Archibald, Rick↗
DOE OSTI2023

Harnessing Uncertainty through Functional Data Analysis in Gas Breakthrough Data

Detecting subsurface explosions from radionuclide gas migration through rock fractures is an effective way to identify nuclear activity. Los Alamos National Laboratory (LANL) has developed simulation methods, based on data from the 1962 Hardhat underground nuclear test, to predict gas breakthrough times at the surface. However, these methods rely on an imperfect understanding of the relationship between rock damage and fracture permeability. Our clinic project studies methods for predicting breakthrough curves that characterize total mass produced as a function of time, as well as quantifying the uncertainty associated with these predictions. The model that is currently employed to relate damage to permeability uses an empirically motivated power-law expression, with a range of parameter values that are compatible with the experimental Hardhat data. We develop emulators, built from functional data analysis techniques and trained on simulation data, that rapidly predict the gas breakthrough curve given a damage field and given the parameter values of the power-law equation. Using Bayesian regression, we address the problem of uncertainty quantification in our emulators. Finally, in order to test the robustness of the model, we further validate it on a damage field representing different physical conditions.

58 GEOSCIENCES↗
DOE OSTI2022

Single Gaussian process method for arbitrary tokamak regimes with a statistical analysis

Abstract Gaussian process regression is a Bayesian method for inferring profiles based on input data. The technique is increasing in popularity in the fusion community due to its many advantages over traditional fitting techniques including intrinsic uncertainty quantification and robustness to over-fitting. This work investigates the use of a new method, the change-point method, for handling the varying length scales found in different tokamak regimes. The use of the Student’s t-distribution for the Bayesian likelihood probability is also investigated and shown to be advantageous in providing good fits in profiles with many outliers. To compare different methods, synthetic data generated from analytic profiles is used to create a database enabling a quantitative statistical comparison of which methods perform the best. Using a full Bayesian approach with the change-point method, Matérn kernel for the prior probability, and Student’s t-distribution for the likelihood is shown to give the best results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2018

Spatially Dependent Multiple Testing Under Model Misspecification, With Application to Detection of Anthropogenic Influence on Extreme Climate Events

The Weather Risk Attribution Forecast (WRAF) is a forecasting tool that uses output from global climate models to make simultaneous attribution statements about whether and how greenhouse gas emissions have contributed to extreme weather across the globe. However, in conducting a large number of simultaneous hypothesis tests, the WRAF is prone to identifying false “discoveries.” A common technique for addressing this multiple testing problem is to adjust the procedure in a way that controls the proportion of true null hypotheses that are incorrectly rejected, or the false discovery rate (FDR). Unfortunately, generic FDR procedures suffer from low power when the hypotheses are dependent, and techniques designed to account for dependence are sensitive to misspecification of the underlying statistical model. In this paper, we develop a Bayesian decision-theoretical approach for dependent multiple testing and a nonparametric hierarchical statistical model that flexibly controls false discovery and is robust to model misspecification. We illustrate the robustness of our procedure to model error with a simulation study, using a framework that accounts for generic spatial dependence and allows the practitioner to flexibly specify the decision criteria. Finally, we apply our procedure to several seasonal forecasts and discuss implementation for the WRAF workflow. Lastly, supplementary materials for this article, including a standardized description of the materials available for reproducing the work, are available as an online supplement.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Using Bayesian Inference Framework towards Identifying Gas Species and Concentration from High Temperature Resistive Sensor Array Data

High temperature gas sensors have been highly demanded for combustion process optimization and toxic emissions control, which usually suffer from poor selectivity. In order to solve this selectivity issue and identify unknown reducing gas species (CO, CH 4 , and CH 8 ) and concentrations, a high temperature resistive sensor array data set was built in this study based on 5 reported sensors. As each sensor showed specific responses towards different types of reducing gas with certain concentrations, based on which calibration curves were fitted, providing benchmark sensor array response database, then Bayesian inference framework was utilized to process the sensor array data and build a sample selection program to simultaneously identify gas species and concentration, by formulating proper likelihood between input measured sensor array response pattern of an unknown gas and each sampled sensor array response pattern in benchmark database. This algorithm shows good robustness which can accurately identify gas species and predict gas concentration with a small error of less than 10% based on limited amount of experiment data. These features indicate that Bayesian probabilistic approach is a simple and efficient way to process sensor array data, which can significantly reduce the required computational overhead and training data.

Liu, Yixin↗
DOE OSTI2020

Does the leaf economic spectrum hold within plant functional types? A Bayesian multivariate trait meta-analysis

The leaf economic spectrum is a widely-studied axis of plant trait variability that defines a trade-off between leaf longevity and productivity. While this has been investigated at the global scale, where it is robust, and at local scales, where deviations from it are common, it has received less attention at the intermediate scale of PFTs. We investigated whether global leaf economic relationships are also present within the scale of plant functional types (PFTs) commonly used by Earth System models, and the extent to which this global-PFT hierarchy can be used to constrain trait estimates. We developed a hierarchical multivariate Bayesian model that assumes separate means and covariance structures within and across PFTs and fit this model to seven leaf traits from the TRY database related to leaf longevity, morphology, biochemistry, and photosynthetic metabolism. Although patterns of trait covariation were generally consistent with the leaf economic spectrum, we found three approximate tiers to this consistency. Relationships among morphological and biochemical traits (SLA, N, P) were the most robust within and across PFTs, suggesting that covariation in these traits is driven by universal leaf construction trade-offs and stoichiometry. Relationships among metabolic traits (R_d, V_{c,max}, J_max) were slightly less consistent, reflecting in part their much sparser sampling (especially for high-latitude PFTs), but also pointing to more flexible plasticity in plant metabolistm. Finally, relationships involving leaf lifespan were the least consistent, indicating that leaf economic relationships related to leaf lifespan are dominated by across-PFT differences and that within-PFT variation in leaf lifespan is more complex and idiosyncratic. Across all traits, these covariance were an important source of information, as evidenced by the improved imputation accuracy and reduced predictive uncertainty in multivariate models compared to univariate models. Ultimately, our study reaffirms the value of studying not just individual traits but the multivariate trait space and the utility of hierarchical modeling for studying the scale dependence of trait relationships.

biodiversity, ecological modeling, ecology, leaf b↗
DOE OSTI2019

Retrieving Temperatures and Abundances of Exoplanet Atmospheres with High-resolution Cross-correlation Spectroscopy

High-resolution spectroscopy (R ≥ 25,000) has recently emerged as one of the leading methods for detecting atomic and molecular species in the atmospheres of exoplanets. However, it has so far been lacking a robust method for extracting quantitative constraints on the temperature structure and molecular/atomic abundances. In this work, we present a novel Bayesian atmospheric retrieval framework applicable to high-resolution cross-correlation spectroscopy (HRCCS) that relies on the cross-correlation between data and models to extract the planetary spectral signal. We successfully test the framework on simulated data and show that it can correctly determine Bayesian credibility intervals on atmospheric temperatures and abundances, allowing for a quantitative exploration of the inherent degeneracies. Furthermore, our new framework permits us to trivially combine and explore the synergies between HRCCS and low-resolution spectroscopy to maximally leverage the information contained within each. This framework also allows us to quantitatively assess the impact of molecular line opacities at high resolution. We apply the framework to VLT CRIRES K-band spectra of HD 209458 b and HD 189733 b and retrieve abundant carbon monoxide but subsolar abundances for water, which are largely invariant under different model assumptions. This confirms previous analysis of these data sets, but is possibly at odds with detections of H{sub 2}O at different wavelengths and spectral resolutions. The framework presented here is the first step toward a true synergy between space observatories and ground-based high-resolution observations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Enhancing Power Grid Resilience with Causal Loops Diagram and Bayesian Networks

Enhancing power grid resilience through improved analysis and planning of Distributed Energy Resources is a key for power system planner. This paper explores the integration of Causal Loop Diagrams (CLDs) and Bayesian Networks (BNs) for enhancing resilience in power systems, focusing on Distributed Energy Resources (DER) planning. By automating CLD analysis in Python's matplotlib, we present a tool for rapid model validation and structural accuracy, crucial for power system planners. This hybrid approach utilizes BNs for inferential depth and CLDs for dynamic system modeling, offering a comprehensive framework for policy formulation and collaborative strategy development against disruptions. Here, we highlight the tool's capability to identify and analyze interconnected feedback loops, facilitating a deeper understanding of DER integration's impact on network resilience. This work aims to bridge quantitative analysis and qualitative insights, addressing the limitations of each method while providing a robust model for power system resilience assessment.

14 SOLAR ENERGY↗
DOE OSTI2016

A multiscale Bayesian data integration approach for mapping air dose rates around the Fukushima Daiichi Nuclear Power Plant

This paper presents a multiscale data integration method to estimate the spatial distribution of air dose rates in the regional scale around the Fukushima Daiichi Nuclear Power Plant. We integrate various types of datasets, such as ground-based walk and car surveys, and airborne surveys, all of which have different scales, resolutions, spatial coverage, and accuracy. This method is based on geostatistics to represent spatial heterogeneous structures, and also on Bayesian hierarchical models to integrate multiscale, multi-type datasets in a consistent manner. The Bayesian method allows us to quantify the uncertainty in the estimates, and to provide the confidence intervals that are critical for robust decision-making. Although this approach is primarily data-driven, it has great flexibility to include mechanistic models for representing radiation transport or other complex correlations. Here, we demonstrate our approach using three types of datasets collected at the same time over Fukushima City in Japan: (1) coarse-resolution airborne surveys covering the entire area, (2) car surveys along major roads, and (3) walk surveys in multiple neighborhoods. Results show that the method can successfully integrate three types of datasets and create an integrated map (including the confidence intervals) of air dose rates over the domain in high resolution. Moreover, this study provides us with various insights into the characteristics of each dataset, as well as radiocaesium distribution. In particular, the urban areas show high heterogeneity in the contaminant distribution due to human activities as well as large discrepancy among different surveys due to such heterogeneity.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Probabilistic Physics-Informed Graph Convolutional Network for Active Distribution System Voltage Prediction

Here this letter proposes a novel data-driven probabilistic physics-informed graph convolutional network (GCN) for active distribution system voltage prediction with PVs and EVs. It leverages both measurements and network topology to accurately and efficiently predict node voltages without the need for an accurate distribution system power flow model. The dropout-enabled Bayesian inference is developed to achieve uncertainty quantification of the voltage prediction. Thanks to the network model embedding, it also has robustness against topology changes, a key difference with existing machine learning-based approaches. Comparison results with other state-of-the-art machine learning methods on a realistic 759-node distribution system demonstrate that the proposed method can achieve better accuracy and robustness under different scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2017

A Multiscale Bayesian Data Integration Approach for Mapping Air Dose Rates around the Fukushima Daiichi Nuclear Power Plant - 17166

This paper presents a multiscale data integration method to estimate the spatial distribution of air dose rates in the regional scale around the Fukushima Daiichi Nuclear Power Plant. We integrate various types of datasets, such as ground-based walk and car surveys, and airborne surveys, all of which have different scales, resolutions, spatial coverage, and accuracy. This method is based on geo-statistics to represent spatial heterogeneous structures, and also on Bayesian hierarchical models to integrate multiscale, multi-type datasets in a consistent manner. The Bayesian method allows us to quantify the uncertainty in the estimates, and to provide the confidence intervals that are critical for robust decision-making. Although this approach is primarily data-driven, it has great flexibility to include mechanistic models for representing radiation transport or other complex correlations. We demonstrate our approach using three types of datasets collected at the same time over Fukushima City, Japan: (1) coarse-resolution airborne surveys covering the entire area, (2) car surveys along major roads, and (3) walk surveys in multiple neighborhoods. Results show that the method can successfully integrate three types of datasets in a consistent manner, and create an integrated map (including the confidence intervals) of air dose rates over the domain in high resolution. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Angular Distribution of Dimuons from Drell-Yan Production in p+Fe Interactions at 120 GeV Beam Energy

In the E906/SeaQuest Fermilab experiment, we report a measurement of the angular distributions by measuring the angular parameters $\lambda$, $\mu$, and $\nu$ of Drell-Yan dimuons produced using a 120 GeV proton beam incident on an iron target. The angular distribution in the naive Drell-Yan model does not show any $\cos2\phi$ dependency, where $\phi$ denotes the azimuthal angle of dimuons in the Collins-Soper frame. However, pion-induced Drell-Yan experiments, such as NA10 and E615, have observed a significant dependence on $\cos2\phi$. The Boer–Mulders function, a transverse momentum-dependent distribution function, represents the correlation between the transverse spin and the transverse momentum of the quark. A non-zero Boer-Mulders function or an improved higher-order Drell-Yan model considering QCD effects can produce a $\cos 2\phi$ modulation in the Drell-Yan angular distribution. To measure the angular distributions, we have used an event mixing method to construct the combin atorial background, which was then subtracted from the data to isolate the Drell-Yan signal. Following this, we corrected the detector, trigger, and reconstruction efficiencies using a doubly-iterative Bayesian Unfolding method. This iterative unfolding technique improves the response matrix based on the results of the previous unfolding step, ensuring robust convergence without exaggeration of uncertainties. The angular distributions of the dimuons were measured over the invariant mass range $5.0 < M_{\mu^+ \mu^-} < 8.0$ $GeV/c^2$, with dimuon transverse momentum $P_T < 2$ GeV/c and Feynman-x $-0.18 < x_F < 0.9$. The measured angular distributions are then compared with the QCD calculations for $p + \text{Fe}$ interactions, and proton-induced angular distribution measurements from other experiments. We have observed weak $\cos 2\phi$ modulations as a function of $P_T$. For $P_T > 1.0 \, \text{GeV}/c$, the predicted NNLO perturbative QCD value of $\nu$ is larger than what we have me asured at E906/SeaQuest. Moreover, we have not observed a strong dependence of $\nu$ on the kinematic variables, such as dimuon mass $M_{\mu^+ \mu^-}$ and Bjorken-$x$. The spin alignment of the virtual photon, $\lambda$, measured from the SeaQuest Drell-Yan $p+\text{Fe}$ data, is found to be strongly dependent on $P_T$, decreasing as $P_T$ increases. $\lambda$ also holds to the upper bound condition $\lambda < 1.0$ within the statistical uncertainty, showing a trend similar to that predicted by NNLO perturbative QCD. However, for $1.0 < P_T < 2.0 \, \text{GeV}/c$, the extracted $\lambda$ value from SeaQuest is smaller than that predicted by perturbative QCD at NNLO.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2008

Using Bayesian Networks for Candidate Generation in Consistency-based Diagnosis

Consistency-based diagnosis relies heavily on the assumption that discrepancies between model predictions and sensor observations can be detected accurately. When sources of uncertainty like sensor noise and model abstraction exist robust schemes have to be designed to make a binary decision on whether predictions are consistent with observations. This risks the occurrence of false alarms and missed alarms when an erroneous decision is made. Moreover when multiple sensors (with differing sensing properties) are available the degree of match between predictions and observations can be used to guide the search for fault candidates. In this paper we propose a novel approach to handle this problem using Bayesian networks. In the consistency- based diagnosis formulation, automatically generated Bayesian networks are used to encode a probabilistic measure of fit between predictions and observations. A Bayesian network inference algorithm is used to compute most probable fault candidates.

Narasimhan, Sriram↗
DOE OSTI2016

AGNfitter: a Bayesian MCMC approach to fitting spectral energy distributions of AGNs

We present AGNfitter, a publicly available open-source algorithm implementing a fully Bayesian Markov Chain Monte Carlo method to fit the spectral energy distributions (SEDs) of active galactic nuclei (AGNs) from the sub-millimeter to the UV, allowing one to robustly disentangle the physical processes responsible for their emission. AGNfitter makes use of a large library of theoretical, empirical, and semi-empirical models to characterize both the nuclear and host galaxy emission simultaneously. The model consists of four physical emission components: an accretion disk, a torus of AGN heated dust, stellar populations, and cold dust in star-forming regions. AGNfitter determines the posterior distributions of numerous parameters that govern the physics of AGNs with a fully Bayesian treatment of errors and parameter degeneracies, allowing one to infer integrated luminosities, dust attenuation parameters, stellar masses, and star-formation rates. We tested AGNfitter’s performance on real data by fitting the SEDs of a sample of 714 X-ray selected AGNs from the XMM-COSMOS survey, spectroscopically classified as Type1 (unobscured) and Type2 (obscured) AGNs by their optical–UV emission lines. We find that two independent model parameters, namely the reddening of the accretion disk and the column density of the dusty torus, are good proxies for AGN obscuration, allowing us to develop a strategy for classifying AGNs as Type1 or Type2, based solely on an SED-fitting analysis. Our classification scheme is in excellent agreement with the spectroscopic classification, giving a completeness fraction of ∼86% and ∼70%, and an efficiency of ∼80% and ∼77%, for Type1 and Type2 AGNs, respectively.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Bayesian Entropy Neural Networks for physics-aware prediction

This article addresses the need for deep learning models to integrate well-defined constraints into their outputs, driven by their application in surrogate models, learning with limited data and partial information, and scenarios requiring flexible model behavior to incorporate non-data sample information. We introduce Bayesian Entropy Neural Networks (BENN), a framework grounded in Maximum Entropy (MaxEnt) principles, designed to impose constraints on Bayesian Neural Network (BNN) predictions. BENN is capable of constraining not only the predicted values but also their derivatives and variances, ensuring a more robust and reliable model output. To achieve simultaneous uncertainty quantification and constraint satisfaction, we employ the method of multipliers approach. This allows for the concurrent estimation of neural network parameters and the Lagrangian multipliers associated with the constraints. Our experiments, spanning diverse applications such as beam deflection modeling and microstructure generation, demonstrate the effectiveness of BENN. The results highlight significant improvements over traditional BNNs and showcase competitive performance relative to contemporary constrained deep learning methods.

14 SOLAR ENERGY↗
DOE OSTI2018

Bayesian approach to model-based extrapolation of nuclear observables

Here, we considered 10 global models based on nuclear density functional theory with realistic energy density functionals as well as two more phenomenological mass models. The emulators of two-neutron separation energy residuals and Bayesian confidence intervals defining theoretical error bars were constructed using Bayesian Gaussian processes and Bayesian neural networks. By establishing statistical methodology and parameters, we carried out extrapolations toward the two-neutron dripline. While both Gaussian processes (GP) and Bayesian neural networks reduce the root-mean-square (rms) deviation from experiment significantly, GP offers a better and much more stable performance. The increase in the predictive power of microscopic models aided by the statistical treatment is quite astonishing: The resulting rms deviations from experiment on the testing dataset are similar to those of more phenomenological models. The estimated credibility intervals on predictions make it possible to evaluate predictive power of individual models and also make quantified predictions using groups of models. The proposed robust statistical approach to extrapolation of nuclear model results can be useful for assessing the impact of current and future experiments in the context of model developments. The new Bayesian capability to evaluate residuals is also expected to impact research in the domains where experiments are currently impossible, for instance, in simulations of the astrophysical r process.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2019

Bayesian strategies for uncertainty quantification of the thermodynamic properties of materials

Reliable models of the thermodynamic properties of materials are critical for industrially relevant applications that require a good understanding of equilibrium phase diagrams, thermal and chemical transport, and microstructure evolution. The goal of thermodynamic models is to capture data from both experimental and computational studies and then make reliable predictions when extrapolating to new regions of parameter space. These predictions will be impacted by artifacts present in real data sets such as outliers, systematic errors, and unreliable or missing uncertainty bounds. Such issues increase the probability of the thermodynamic model producing erroneous predictions. We present a Bayesian framework for the selection, calibration, and quantification of uncertainty of thermodynamic property models. The modular framework addresses numerous concerns regarding thermodynamic models including thermodynamic consistency, robustness to outliers, and systematic errors by the use of hyperparameter weightings and robust Likelihood and Prior distribution choices. Furthermore, the framework’s inherent transparency (e.g. our choice of probability functions and associated parameters) enables insights into the complex process of thermodynamic assessment. We introduce these concepts through examples where the true property model is known. Additionally, we demonstrate the utility of the framework through the creation of a property model from a large set of experimental specific heat and enthalpy measurements of Hafnium metal from 0 to 4900K.

36 MATERIALS SCIENCE↗