Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “bayesian”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Systematic validation of non-equilibrium thermochemical models using Bayesian inference

The validation process proposed by Babuška et al. [1] is applied to thermochemical models describing post-shock flow conditions. In this validation approach, experimental data is involved only in the calibration of the models, and the decision process is based on quantities of interest (QoIs) predicted on scenarios that are not necessarily amenable experimentally. Moreover, uncertainties present in the experimental data, as well as those resulting from an incomplete physical model description, are propagated to the QoIs. We investigate four commonly used thermochemical models: a one-temperature model (which assumes thermal equilibrium among all inner modes), and two-temperature models developed by Macheret et al. [2], Marrone and Treanor [3], and Park [4]. Up to 16 uncertain parameters are estimated using Bayesian updating based on the latest absolute volumetric radiance data collected at the Electric Arc Shock Tube (EAST) installed inside the NASA Ames Research Center. Following the solution of the inverse problems, the forward problems are solved in order to predict the radiative heat flux, QoI, and examine the validity of these models. Our results show that all four models are invalid, but for different reasons: the one-temperature model simply fails to reproduce the data while the two-temperature models exhibit unacceptably large uncertainties in the QoI predictions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Variational Bayesian strategies for high-dimensional, stochastic design problems

This paper is concerned with a lesser-studied problem in the context of model-based, uncertainty quantification (UQ), that of optimization/design/control under uncertainty. The solution of such problems is hindered not only by the usual difficulties encountered in UQ tasks (e.g. the high computational cost of each forward simulation, the large number of random variables) but also by the need to solve a nonlinear optimization problem involving large numbers of design variables and potentially constraints. We propose a framework that is suitable for a class of such problems and is based on the idea of recasting them as probabilistic inference tasks. To that end, we propose a Variational Bayesian (VB) formulation and an iterative VB–Expectation-Maximization scheme that is capable of identifying a local maximum as well as a low-dimensional set of directions in the design space, along which, the objective exhibits the largest sensitivity. We demonstrate the validity of the proposed approach in the context of two numerical examples involving thousands of random and design variables. In all cases considered the cost of the computations in terms of calls to the forward model was of the order of 100 or less. The accuracy of the approximations provided is assessed by information-theoretic metrics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problems

We explore using neural operators, or neural network representations of nonlinear maps between function spaces, to accelerate infinite-dimensional Bayesian inverse problems (BIPs) with models governed by nonlinear parametric partial differential equations (PDEs). Neural operators have gained significant attention in recent years for their ability to approximate the parameter-to-solution maps defined by PDEs using as training data solutions of PDEs at a limited number of parameter samples. The computational cost of BIPs can be drastically reduced if the large number of PDE solves required for posterior characterization are replaced with evaluations of trained neural operators. However, reducing error in the resulting BIP solutions via reducing the approximation error of the neural operators in training can be challenging and unreliable. We provide an a priori error bound result that implies certain BIPs can be ill-conditioned to the approximation error of neural operators, thus leading to inaccessible accuracy requirements in training. To reliably deploy neural operators in BIPs, we consider a strategy for enhancing the performance of neural operators: correcting the prediction of a trained neural operator by solving a linear variational problem based on the PDE residual. We show that a trained neural operator with error correction can achieve a quadratic reduction of its approximation error, all while retaining substantial computational speedups of posterior sampling when models are governed by highly nonlinear PDEs. The strategy is applied to two numerical examples of BIPs based on a nonlinear reaction–diffusion problem and deformation of hyperelastic materials. We demonstrate that posterior representations of the two BIPs produced using trained neural operators are greatly and consistently enhanced by error correction.

97 MATHEMATICS AND COMPUTING↗

Explicitly integrating parameter, input, and structure uncertainties into Bayesian Neural Networks for probabilistic hydrologic forecasting

Estimating uncertainty of hydrologic forecasting is valuable to water resources and other relevant decision making processes. Recently, Bayesian Neural Networks (BNNs) have been proved powerful tools for quantifying uncertainty of streamflow forecasting. In this study, we propose a Markov Chain Monte Carlo (MCMC) framework to incorporate the uncertainties associated with input, model structure, and parameter into BNNs. This framework allows the structure of the neural networks to change by removing or adding connections between neurons and enables scaling of input data by using rainfall multipliers. The results show that the new BNNs outperform the BNNs that only consider uncertainties associated with parameter and model structure. Critical evaluation of posterior distribution of neural network weights, number of effective connections, rainfall multipliers, and hyper-parameters show that the assumptions held in our BNNs are not well supported. Further understanding of characteristics of different uncertainty sources and including output error into the MCMC framework are expected to enhance the application of neural networks for uncertainty analysis of hydrologic forecasting.

58 GEOSCIENCES↗

Physics-informed Bayesian machine learning case study: Integral blade rotors

This paper provides a physics-informed Bayesian machine learning (PIBML) description and case study. The PIBML approach applies three physics-based models to establish the initial beliefs before testing to determine the probability of milling stability (or prior). These include: receptance coupling substructure analysis (RCSA) prediction for the tool tip frequency response functions; finite element software prediction of the mechanistic force model coefficients; and a spindle speed-dependent power law model for process damping. Testing was then performed to identify optimal stable machining conditions using an expected improvement in material removal rate criterion. The prior probability of stability was updated using the test results to determine the posterior probability of stability. The test results were compared to the parameter recommendations provided by the endmill manufacturer. A demonstration integral blade rotor was machined at the optimal stable machining conditions for 304 stainless steel and 6061-T6 aluminum. Finally, the disagreement between manufacturer recommendations and milling performance in both materials tested emphasizes the need for broad implementation of PIBML approaches to increase machining productivity and efficiency.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Predicting the 3D fatigue crack growth rate of small cracks using multimodal data via Bayesian networks: In-situ experiments and crystal plasticity simulations

Small crack propagation accounts for most of the fatigue life of engineering structures subject to high cycle fatigue loading conditions. Determining the fatigue crack growth rate of small cracks propagating into polycrystalline engineering alloys is critical to improving fatigue life predictions, thus lowering cost and increasing safety. In this work, cycle-by-cycle data of a small crack propagating in a beta metastable titanium alloy is available via phase and diffraction contrast tomography. Crystal plasticity simulations are used to supplement experimental data regarding the micromechanical fields ahead of the crack tip. Experimental and numerical results are combined into a multimodal dataset and sampled utilizing a non-local data mining procedure. Furthermore, to capture the propensity of body-centered cubic metals to deform according to the pencil-glide model, a non-local driving force is postulated. The proposed driving force serves as the basis to construct a data-driven probabilistic crack propagation framework using Bayesian networks as building blocks. The spatial correlation between the postulated driving force and experimental observations is obtained by analyzing the results of the proposed framework. Results show that the above correlation increases proportionally to the distance from the crack front until the edge of the plastic zone. Moreover, the predictions of the propagation framework show good agreement with experimental observations. Finally, we studied the interaction of a small crack with grain boundaries (GBs) utilizing various slip transmission criteria, revealing the tendency of a crack to cross a GB by propagating along the slip directions minimizing the residual Burgers vector within the GB.

36 MATERIALS SCIENCE↗

A Bayesian statistical approach to inferring particle dynamics from in-situ pump POC and chloropigment data from the Mediterranean Sea

Concentrations of chloropigments and particulate organic carbon (POC) in large-volume in-situ pump samples from the Mediterranean Sea were used to estimate rate constants of processes that control the fate of particles, and specifically chloropigments, in the water column. In this paper we introduce a Bayesian statistical inversion method that combines the data with a new box model and has the capacity to infer rate constants for POC respiration/dissolution, chlorophyll and pheopigment degradation, and particle aggregation and disaggregation. We use first-order kinetics to model disaggregation, and use both first-order and second-order kinetics to model aggregation. Using these methods, the estimated small-particle (1–70 μm) POC respiration rate constant was 2.44 -1.00 +1.69 yr -1 (0.41 yr). The estimated disaggregation and second-order aggregation rate constants were 85.6 -36.4 +63.4 yr -1 (1.17×10 -2 yr) and 2.78 -1.17 +2.01 μM -1 yr -1 , respectively. Using the optimal rate constants and the corresponding particle concentrations, disaggregation is ~4.2 times faster than the small-size POC dissolution rate, which indicates that disaggregation is a dominant processes at the time of sampling. More importantly, by comparing our results with those of previous studies, we conclude that sampling methods have less influence than tracers themselves on inferring particle dynamic rate constants. We previously introduced a somewhat similar approach to modeling SV sediment trap data, but large volume pumps are a much more common sample collection method in oceanographic surveys than SV sediment traps, and thus our new model should have a wider applicability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Estimation of process steady state with autoregressive models and Bayesian inference

To improve efficiency, separations engineers will typically design process circuits containing recirculating streams, which mix one or more of the process outputs with the feed material. Doing so can improve efficiency, but will cause a delay in the system reaching steady state conditions until the recirculating load mass flows stabilize. In testing separation circuits, engineers will often test a variety of factors and complete an analysis from sample results. Knowledge of if a process is at steady state, as well as the steady state conditions of a process, is essential for a valid techno-economic analysis. However, the definition of process steady state is often poorly defined, or does not include uncertainty quantification. If the performance of a process operating under two different sets of conditions are compared, an engineer who does not test for steady state or quantify steady state conditions risks producing a faulty analysis. In this work, a Bayesian statistical method for testing if all streams are at steady state is further motivated and then derived. Then after testing for steady state, the same model is used with a prior distribution that enforces a steady state assumption to estimate steady state conditions. Further, these methods were validated in a solvent extraction pilot plant where steady state conditions for all outflows were inferred with uncertainty quantification. Analysis is completed with functions available to the reader as part of the BayesMassBal (V 1.1.0) software package written in R.

01 COAL, LIGNITE, AND PEAT↗

Bayesian Evaluation Including Covariance Matrices of Neutron-induced Reaction Cross Sections of {sup 181}Ta

A new evaluation of neutron-induced reactions on {sup 181}Ta using a consistent procedure based on Bayesian statistics is presented. Starting point of the evaluation is the description of nuclear reactions via nuclear models implemented in TALYS 1.4. A retrieval of experimental data was performed and covariance matrices of the experiments were generated from an extensive study of the corresponding literature. All reaction channels required for a transport file up to 200 MeV have been considered and the covariance matrices of cross section uncertainties for the most important channels are determined. The evaluation has been performed in one step including all available experimental data. A comparison of the evaluated cross sections and spectra with experimental data and available evaluations is performed. In general the evaluated cross section reflect our best knowledge and give a fair description of the observables. However, there are few deviations from expectation which clearly indicate the impact of the prior and the need to account for model defects. Using the results of the evaluation a complete ENDF-file similarly to those of the TENDL library is generated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A New Module for Large Scale Bayesian Evaluation in the Fast Neutron Energy Region

We present an improved update scheme for the Linearized Bayesian Update procedure (LBUP). The revised procedure extends the application of the LBUP to a large number of observables. The consistent update of dozens of millions of observables becomes manageable by circumventing the costly calculation of the prior covariance matrix. Nuclear data evaluations based on the revised scheme may exhaustively enclose all differential and angle-integrated channels, treating all correlations between them exactly in the update procedure.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Bayesian Monte Carlo Method for Nuclear Data Evaluation

A Bayesian Monte Carlo method is outlined which allows a systematic evaluation of nuclear reactions using TALYS. The result will be either an EXFOR-weighted covariance matrix or a collection of random files, each accompanied by an experiment based weight.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Bayesian technique for improving the sensitivity of the atmospheric neutrino L/E analysis

This paper outlines a method for improving the precision of atmospheric neutrino oscillation measurements. One experimental signature for these oscillations is an observed deficit in the rate of ν μ charged-current interactions with an oscillatory dependence on L ν / E ν , where L ν is the neutrino propagation distance and E mrow is="true"> ν is the neutrino energy. For contained-vertex atmospheric neutrino interactions, the L ν / E ν resolution varies significantly from event to event. The precision of the oscillation measurement can be improved by incorporating information on L ν / E ν resolution into the oscillation analysis. In the analysis presented here, a Bayesian technique is used to estimate the L ν / E ν resolution of observed atmospheric neutrinos on an event-by-event basis. By separating the events into bins of L ν / E ν resolution in the oscillation analysis, a significant improvement in oscillation sensitivity can be achieved.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Revealing the collision energy dependence of η/s in RHIC-BES Au+Au collisions using Bayesian statistics

Here, we investigate the collision energy dependence of η/s in a transport + viscous hydrodynamics hybrid model. A Bayesian analysis is performed on RHIC beam energy scan data for Au + Au collisions at √ s NN = 19.6, 39, and 62.4 GeV. The resulting posterior probability distributions for the model parameters show a preference for a larger value of η/s at 19.6 GeV compared to 62.4 GeV, indicating dependence on baryon chemical potential μ B .

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Modeling inclusive electron-nucleus scattering with Bayesian artificial neural networks

We introduce a Bayesian protocol based on artificial neural networks that is suitable for modeling inclusive electron-nucleus scattering on a variety of nuclear targets with quantified uncertainties. Unlike previous applications in the field, which directly parameterize the cross sections, our approach employs artificial neural networks to represent the longitudinal and transverse response functions. In contrast to cross sections, which depend on the incoming energy, scattering angle, and energy transfer, the response functions are determined solely by the energy and momentum transfer to the system, allowing the angular component to be treated analytically. We assess the accuracy and predictive power of our framework against the extensive data in the quasielastic inclusive electron-scattering database. Additionally, we present novel extractions of the longitudinal and transverse response functions and compare them with previous experimental analysis and nuclear ab-initio calculations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A robust Bayesian approach to modeling epistemic uncertainty in common-cause failure models

In a standard Bayesian approach to the alpha-factor model for common-cause failure, a precise Dirichlet prior distribution models epistemic uncertainty in the alpha-factors. This Dirichlet prior is then updated with observed data to obtain a posterior distribution, which forms the basis for further inferences. In this paper, we adapt the imprecise Dirichlet model of Walley to represent epistemic uncertainty in the alpha-factors. In this approach, epistemic uncertainty is expressed more cautiously via lower and upper expectations for each alpha-factor, along with a learning parameter which determines how quickly the model learns from observed data. For this application, we focus on elicitation of the learning parameter, and find that values in the range of 1 to 10 seem reasonable. The approach is compared with Kelly and Atwood's minimally informative Dirichlet prior for the alpha-factor model, which incorporated precise mean values for the alpha-factors, but which was otherwise quite diffuse. Next, we explore the use of a set of Gamma priors to model epistemic uncertainty in the marginal failure rate, expressed via a lower and upper expectation for this rate, again along with a learning parameter. As zero counts are generally less of an issue here, we find that the choice of this learning parameter is less crucial. Finally, we demonstrate how both epistemic uncertainty models can be combined to arrive at lower and upper expectations for all common-cause failure rates. Thereby, we effectively provide a full sensitivity analysis of common-cause failure rates, properly reflecting epistemic uncertainty of the analyst on all levels of the common-cause failure model.

99 GENERAL AND MISCELLANEOUS↗

Hyperspectral remote sensing of plant biochemistry using Bayesian model averaging with variable and band selection

Model specification remains challenging in spectroscopy of plant biochemistry, as exemplified by the availability of various spectral indices or band combinations for estimating the same biochemical. This lack of consensus in model choice across applications argues for a paradigm shift in hyperspectral methods to address model uncertainty and misspecification. We demonstrated one such method using Bayesian model averaging (BMA), which performs variable/band selection and quantifies the relative merits of many candidate models to synthesize a weighted average model with improved predictive performances. The utility of BMA was examined using a portfolio of 27 foliage spectral–chemical datasets representing over 80 species across the globe to estimate multiple biochemical properties, including nitrogen, hydrogen, carbon, cellulose, lignin, chlorophyll (a or b), carotenoid, polar and nonpolar extractives, leaf mass per area, and equivalent water thickness. We also compared BMA with partial least squares (PLS) and stepwise multiple regression (SMR). Results showed that all the biochemicals except carotenoid were accurately estimated from hyerspectral data with R2 values > 0.80.

Zhao, Kaiguang↗

Bayesian population analysis of a washin-washout physiologically based pharmacokinetic model for acetone

The aim of this study was to derive improved estimates of population variability and uncertainty of physiologically based pharmacokinetic (PBPK) model parameters, especially of those related to the washin-washout behavior of polar volatile substances. This was done by optimizing a previously published washin-washout PBPK model for acetone in a Bayesian framework using Markov chain Monte Carlo simulation. The sensitivity of the model parameters was investigated by creating four different prior sets, where the uncertainty surrounding the population variability of the physiological model parameters was given values corresponding to coefficients of variation of 1%, 25%, 50%, and 100%, respectively. The PBPK model was calibrated to toxicokinetic data from 2 previous studies where 18 volunteers were exposed to 250-550 ppm of acetone at various levels of workload. The updated PBPK model provided a good description of the concentrations in arterial, venous, and exhaled air. The precision of most of the model parameter estimates was improved. New information was particularly gained on the population distribution of the parameters governing the washin-washout effect. The results presented herein provide a good starting point to estimate the target dose of acetone in the working and general populations for risk assessment purposes.

60 APPLIED LIFE SCIENCES↗