Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “bayesian”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Synthesis of observed and simulated rain microphysics to inform a new Bayesian statistical framework for microphysical parameterization in climate models (Final Scientific Report)

This project aimed to investigate a new approach to bulk microphysics schemes. We identified the need to move beyond the fixed structural assumptions and approximation of existing schemes. For example, most schemes assume some functional form for the rain drop size distribution (e.g. a gamma or exponential distribution). Most schemes then evolve some number of statistical moments of that distribution via various processes, such as evaporation, sedimentation, collision-coalescence, and collisional breakup. These microphysical processes, in turn, are typically some fixed functional form derived from either some other (more detailed) model, or using some single-particle rates that are then integrated over the size distribution. While these process rate functions may have some free parameters to adjust, in other cases doing so is impossible (e.g. when the process rates are analytical or piecewise solutions to some target function). Our goal was to build and test a scheme that assumed no size distribution form, and used a series of power laws as the basis for the process rates. Moments of the size distribution would be predicted, but no underlying size distribution would be specified. Any number or choice of size distribution moments could be used, and any number of power laws could be employed to model the process rates. Thus, our approach is flexible, and can seamlessly scale across levels of complexity, as demanded by the data. Bayesian inference then would provide the formalism to estimate the model parameters and structure, allowing for robust uncertainty quantification. We proposed testing this framework in idealized simulations using bin microphysical schemes as a data source. We also proposed using real data to inform our microphysics scheme, and also that we would integrate our scheme into WRF.

58 GEOSCIENCES↗

Posterior Regularized Bayesian Neural Network

Traditional NNs often lack the ability for uncertainty quantification. Bayesian NNs(BNNs) could help measure the confidence level by using distributions in NNs modeling. Besides, knowledge is commonly available and could improve the performance of BNNs if it can be properly incorporated. In this work, we propose a novel Posterior-Regularized BNN(PR-BNN) model by incorporating soft and hard constraints as a posterior regularization term. We also propose an augmented Lagrangian method and stochastic optimization algorithm for efficient updating via Monte Carlo sampling. The simulations and case studies for solar PV plants have shown the performance improvement of the proposed model over traditional BNNs.

97 MATHEMATICS AND COMPUTING↗

Generalized Bayesian Monte Carlo Evaluation [Slides]

Bayesian Monte Carlo is a tool to address imperfect data & models, non-linear models, non-normal PDFs, and integration of differential and integral data. Simple propagation to criticality shows effects of new $\mathcal{L}$($β|z,γ$).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Bayesian Monte-Carlo Evaluation Framework of Differential and Integral Data [Slides]

This presentation discusses the Bayesian Monte Carlo evaluation framework of differential and integral data, specifically in relation to two methods that are based on Bayes theorem, which assumes that all PDFs are normal (Gaussian) and that they use a linear approximation for IBEs. The presentation states that basic components of the MC evaluation framework include the computation of random MC ensemble from ENDF File 32, the simulation of IBEs and R-matrix cross section compared to experimental data, and the computation of weighted averages. It also states that the application to U-233 indicates deviation from the conventional linear approximation. In conclusion, evaluation framework will require MCMC method e.g., Metropolis-Hastings (M.-H.).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Bayesian Cloud Property Retrievals from ARM Active and Passive Measurements

The optimum use of the continuous measurements of thermodynamics, radiation, aerosols, clouds and precipitation from the DOE Atmospheric Radiation Measurement (ARM) program is key to achieve the DOE Atmospheric System Research (ASR)’s objectives. One of the key mission requirements is to retrieve cloud and precipitation properties, as well as vertical motion parameters, along the vertical cross- section defined by the profiling active sensors. Such retrievals are challenging to perform continuously in the entire spectrum of cloud and precipitation conditions due to the large natural microphysical and dynamical variability, the often-limited information content in the measurements, and the lack of proper characterization of measurement quality and uncertainty. Today, the acquisition of new remote and in-situ sensors by the ARM program creates opportunities to address the microphysical retrieval problem by exploiting new, more robust retrieval techniques and integrating various scattered advancements in both sensor techniques and retrieval algorithms. During this project, we constructed a robust Bayesian Markov chain Monte Carlo (MCMC) cloud property retrieval algorithm that includes a state of the art radar forward model. Our MCMC-based retrieval produces both the best estimate of height-resolved cloud and precipitation properties in the radar profile, as well as an estimate of the in-cloud vertical motion and turbulence. In addition, the MCMC algorithm automatically produces robust and flexible estimates of retrieval uncertainty. We tested the algorithm on several synthetic cloud profiles obtained from large eddy simulation (LES) models with bin-resolved microphysics.

54 ENVIRONMENTAL SCIENCES↗

Bayesian inference for the seismic moment tensor using regional waveforms and a data-derived distribution of velocity models

The largest source of uncertainty in any source inversion is the velocity model used to construct the transfer function employed in the forward model that relates observed ground motion to the seismic moment tensor. However, standard inverse procedures often does not quantify uncertainty in the seismic moment tensor due to error in the Green’s functions from uncertain event location and Earth structure. We attempt to incorporate this uncertainty into an estimation of the seismic moment tensor using a distribution of velocity models calculated in a prior effort based on different and complementary data sets. The posterior distribution of velocity models is then used to construct Green’s functions for use in Bayesian inference of an unknown seismic moment tensor using regional waveform data. The combined likelihood is estimated using data-specific error models and the posterior of the seismic moment tensor is estimated and can be interpreted in terms of most-probable source-type.

58 GEOSCIENCES↗

Sequential Bayesian Methods for Analyzing Computer Models

Efficient analysis of computer models is essential for the validation and uncertainty quantification of those models. Surrogate models, and Gaussian processes in particular, are a common and powerful approach to analyzing computer models that treat computer models as a black-box function. Gaussian processes form a Bayesian model over a space of functions that gives a measure of uncertainty about the computer model output at unobserved locations and a framework for sequential sampling. This tutorial will show how to fit Gaussian processes on a series of test functions and apply sequential design techniques to estimate extrema, level sets, and reliabilities of those test functions.

97 MATHEMATICS AND COMPUTING↗

Proxy-Based Bayesian Inversion Of Poroelastic Simulations To Interpret Strain Tensor Data Measured During Well Testing

The long runtimes of 3D poroelastic numerical simulators makes it impractical to interpret deformation datasets using many inversion schemes. Recent advances in instrumentation have made it possible to measure the strain tensor during well testing, but the lack of robust inversion methods is limiting the ability to interpret these data. We have developed an inversion workflow that reduces the number of computations required to complete a Bayesian inversion using DREAMzs. The workflow trains a KNN model using output from the poroelastic simulator, and then uses the KNN model as a proxy for the simulator during inversion. The workflow also includes a strategy for ensuring the results from the proxy model converge to the results from the simulator, ensuring the accuracy of the final results. An idealized example configured to represent a well test in a deep aquifer is used to verify that the workflow correctly identifies parameters and characterizes noise. Field data measured using strainmeters during an injection test at an oil reservoir in Oklahoma are used to evaluate performance with a real dataset. The workflow identified 265 history matching solutions out of 1240 total simulation runs (21% acceptance ratio), and the results are used to characterize posterior parameter distribution and evaluate the prediction uncertainty. This approach makes it feasible to invert strain data measured during well testing and this has the potential to improve the characterization of aquifers and reservoirs.

Roudini, Soheil↗

Bayesian Optimization Scheme for the Design of a Nanofibrous High Power Target

High Power Targetry (HPT) R\&D is critical in the context of increasing beam intensity and energy for next generation accelerators. Many target concepts and novel materials are being developed and tested for their ability to withstand extreme beam environments; the HPT R\&D Group at Fermilab is developing an electrospun nanofiber material for this purpose. The performance of these nanofiber targets is sensitive to their construction parameters, such as the packing density of the fibers. Lowering the density improves the survival of the target, but reduces the secondary particle yield. Optimizing the lifetime and production efficiency of the target poses an interesting design problem, and in this paper we study the applicability of Bayesian optimization to its solution. We first describe how to encode the nanofiber target design problem as the optimization of an objective function, and how to evaluate that function with computer simulations. We then explain the optimization loop setup. Thereafter, we present the optimal design parameters suggested by the algorithm, and close with discussions of limitations and future refinements.

43 PARTICLE ACCELERATORS↗

Assessing the Value of Seismic Amplitude Versus Offset (AVO) Attributes for CO2 Storage Project Using a Bayesian Network Model for Decision Support

Attributes versus offset (AVO) are a set of measurements to analyze how the characteristics of reflected seismic waves change as a function of the offset. It can be useful for monitoring CO2 storage sites because the presence of leaked CO2 into the overlying aquifer can change the properties of the rocks and pore fluids composition that can alter the way seismic waves reflect and their amplitudes. The time-lapse changes in AVO attributes derived from repeat seismic surveys can help identify anomalies or shifts in the subsurface that could potentially be used as an indicator for CO2 leak detection. Our study leverages multiple seismic attributes derived from synthetic seismic data and Bayesian network model to quantify the probability of leak detection in the overlying aquifer above the storage reservoir. It helps to quantify the value of individual seismic attributes at multiple monitoring periods based upon their sensitivities.

Kumar, Abhash↗

Bayesian Inference applied to the Solubility of Phase-3 and Phase-5

This Section covers an introduction to the objectives and techniques used in this analysis. The objectives of the report are given in Subsection 1.1. An introduction to aqueous thermodynamics and how variance might propagate through the relevant thermodynamic equations is given in Subsection 1.2. An introduction to Bayesian inference and its application to thermodynamic modeling is given in Subsection 1.3.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Practical and Optimal Sequential Bayesian Experimental Design for Complex Systems Incorporating Human Experimenter Preferences (Final Scientific/Technical Report)

Experiments are indispensable for developing models of complex systems. Carefully designed experiments can provide substantial savings for these expensive data-acquisition opportunities. However, designs based on heuristics are often suboptimal for systems with multiphysics, nonlinear dynamics, and uncertain and noisy environments. Optimal experimental design, while leveraging predictive models, seeks to systematically quantify and maximize the value of experiments. In this project, we focused on the design of multiple experiments, where current approaches are largely suboptimal: batch-design does not adapt to new data acquired during the experiment campaign (no feedback), and greedy/myopic design ignores future dynamics and consequences (no lookahead). We developed the mathematical framework and computational methods for sequential optimal experimental design (sOED) for complex systems. We enabled tractable model-based sOED in a rigorous manner through novel algorithms based on reinforcement learning, and investigated the effects of human experimenters on the design process. Our methods are fully Bayesian, able to quantify and update uncertainty in a principled manner. The traits aimed by our approach—mathematical rigor and optimality, human effects and uncertainty quantification, computational practicality—are crucial for elevating the standards of artificial intelligence (AI) to support decision-making in scientific domains, and contribute toward trust and realistic adoption of AI in experimental design practice.

97 MATHEMATICS AND COMPUTING↗

PRIME - A Software Toolkit for the Characterization of Partially Observed Epidemics in a Bayesian Framework

PRIME is a modeling framework designed for the “real-time’” characterization and forecasting of partially observed epidemics. Characterization is the estimation of infection spread parameters using daily counts of symptomatic patients. The method is designed to help guide medical resource allocation in the early epoch of the outbreak. The estimation problem is posed as one of Bayesian inference and solved using a Markov Chain Monte Carlo technique. The framework can accommodate multiple epidemic waves and can help identify different disease dynamics at the regional, state, and country levels. We include examples using publicly available COVID-19 data.

97 MATHEMATICS AND COMPUTING↗

Bayesian Attack Model (BAM) User Story

This document presents a user story for the Bayesian Attack Model (BAM) tool designed to aggregate and analyze cyber-attack observables for operational technology (OT) systems. BAM aims to empower cybersecurity analysts by providing a streamlined interface for collecting observable data from various sources, enabling real-time analysis of potential adversary activity. By enhancing the response capabilities of security teams, BAM facilitates risk-informed decision-making and improves organizational security posture. This user story outlines the key functionalities, user interactions, and requirements necessary to successfully integrate BAM with other security information and event management (SIEM) technology and cybersecurity operations centers (CSOCs).

97 MATHEMATICS AND COMPUTING↗