Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Assessing the performance of MagLIF with 3D MHD simulations

The Magnetized Liner Inertial Fusion (MagLIF) experimental platform at Sandia National Laboratories has realized a number of recent improvements in electrical current and laser preheat coupling but fusion yields are below expectations, based on modeling with clean (that is, simulations with no interfacial instabilities and no mix) two-dimensional (2D) magneto-hydrodynamics (MHD) simulations, by a factor of 5 or more. However, magnetized liner implosions are known to produce helical magneto-Rayleigh–Taylor (MRT) modes and complex stagnation structures that cannot be directly modeled in 2D. This paper presents the results of 3D HYDRA MHD simulations, including helical MRT, showing that degradation from these instabilities can readily reproduce experimental yields, but it is difficult to simultaneously match the yield along with inferred fuel temperature, pressure, and burn history (assessed with x-rays), which are larger in the experiments considered here. Additional analysis methods and future experiments are proposed to help address the discrepancies. The 3D simulations also show, without substantive improvements to stability, changing the applied Bz or preheat is unlikely to increase performance of MagLIF to the same degree as clean 2D simulations. Finally, the first 3D HYDRA simulations with the Hall term show the ab initio production of helical MRT and produce a clear change in stagnation morphology compared to pre-seeded simulations without Hall. In spite of the differences, the simulations still produce comparable fusion performance but with longer, lower power, neutron yield history.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The modeling of risk perception in the use of structural health monitoring information for optimal maintenance decisions

This paper proposes an approach to select a maintenance strategy from a predefined set of choices considering the decision maker’s behavioral risk profile. It is assumed that the damage state is characterized by a continuous state parameter probabilistically inferred from observable sensor data. This work applies an engineering application of consequence-based decision-making incorporating the acceptable risk intensity of the decision-maker, i.e., the decision-maker’s (individual or an organization) valuation of the outcome of a decision, using a risk profile model. The utility of a decision-maker is subjective, and this paper considers the fact that different decision-makers mentally assign a different importance factor (the utility) to the seriousness or urgency to take necessary actions with the increasing intensity of structural damage. The approach herein incorporates a layer of human psychology on selecting appropriate maintenance strategies that not only depend on the posterior distribution of unmeasurable damage state but also consider the behavioral risk profile of the decision-maker. Further, the collective decision-making of an organization consisting of many individuals is also investigated. The approach is exemplified in a case study involving life cycle monitoring of a miter gate, part of a lock system enabling navigation of inland waterways.

42 ENGINEERING↗

Improving the stability and performance of MagLIF implosions by applying dielectric coatings and increasing applied B z , fuel preheat, and load current

We report two magnetized liner inertial fusion (MagLIF) experiments that produced record thermonuclear D–D neutron yields of 2.11×10 13 and 2.33×10 13 . These yields are about a factor of two higher than previous MagLIF results. The experiments achieved ion temperatures of 3.0 and 3.3 keV and stagnation pressures of 1.6 and 1.3 Gbar. The inferred Lawson parameters were χ=0.2 and 0.1, which are the largest reported for MagLIF. The performance increase used a high-aspect-ratio beryllium liner with a dielectric coating and modest increases in preheat energy (∼2.2 kJ), peak current (18.5 MA), and axial magnetic field (15 T). Three-dimensional HYDRA simulations are consistent with the measured liner dynamics and fusion outputs. These results indicate a pathway to higher-yield MagLIF designs using coated, high-aspect-ratio liners and improved input parameters. Simulations further suggest that adding an ice fuel layer could increase yield by up to a factor of 2.5 by reducing liner convergence, instability feedthrough, and mix.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

CheKiPEUQ Intro 2: Harnessing Uncertainties from Data Sets, Bayesian Design of Experiments in Chemical Kinetics**

When choosing experimental conditions, Bayesian statistical tools can predict the experimental choices which will yield the highest information gain. Experimental choices could be temperature, pressure, reaction time, number of measurements, reactor volume, etc.. Three example analyses are presented here, each using the software Chemical Kinetics Parameter Estimation and Uncertainty Quantification (CheKiPEUQ). Information gain is a measure of reduction of uncertainty in a model's parameters. The three chemical system examples presented each illustrate Bayesian Design of Experiments using information gain. In the first chemical example, temperature selection impacts the information gain for the free energy of reaction in a two-component equilibrium reaction. In the second example, temperature and pressure are explored for a competitive adsorption Langmuir replacement reaction system. Finally, the third example is a catalytic membrane reactor which is a culmination of the previous examples. The catalytic membrane reactor has a complex and nonlinear response in the observables which is solved by numerical evaluation. In the three examples, the experimental conditions are treated as design variables for maximizing information gain.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Estimating posterior quantity of interest expectations in a multilevel scalable framework

Scalable approaches for uncertainty quantification are necessary for characterizing prediction confidence in large-scale subsurface flow simulations with uncertain permeability. To this end we explore a multilevel Monte Carlo approach for estimating posterior moments of a particular quantity of interest, where we employ an element-agglomerated algebraic multigrid (AMG) technique to generate the hierarchy of coarse spaces with guaranteed approximation properties for both the generation of spatially correlated random fields and the forward simulation of Darcy's law to model subsurface flow. In both these components (sampling and forward solves), we exploit solvers that rely on state-of-the-art scalable AMG. To illustrate the applicability of this approach, numerical tests are performed on two 3D examples-a unit cube and an egg-shaped domain with an irregular boundary-where the scalability of each simulation as well as the scalability of the overall algorithm are demonstrated.

97 MATHEMATICS AND COMPUTING↗

An application of a zero-inflated lifetime distribution with multiple and incomplete data sources

In this study, we analyze data sampled from a population of parts in which an associated anomaly can occur at assembly or after assembly. Using a zero-inflated lifetime distribution to fit left-censored and right-censored data as well data from a supplementary sample, we make predictions about the proportion of the population with anomalies today and in the future. Goodness-of-fit is also addressed.

97 MATHEMATICS AND COMPUTING↗

Sequential optimal positioning of mobile sensors using mutual information

Source localization, such as detecting a nuclear source in an urban area or ascertaining the origin of a chemical plume, is generally regarded as a well-documented inverse problem; however, optimally placing sensors to collect data for such problems is a more challenging task. In particular, optimal sensor placement—that is, measurement locations resulting in the least uncertainty in the estimated source parameters—depends on the location of the source, which is typically unknown a priori. Mobile sensors are advantageous because they have the flexibility to adapt to any given source position. While most mobile sensor strategies designate a trajectory for sensor movement, we instead employ mutual information, based on Shannon entropy, to choose the next measurement location from a discrete set of design conditions.

97 MATHEMATICS AND COMPUTING↗

A continuation multilevel Monte Carlo algorithm

Here, we propose a novel Continuation Multi Level Monte Carlo (CMLMC) algorithm for weak approximation of stochastic models. The CMLMC algorithm solves the given approximation problem for a sequence of decreasing tolerances, ending when the required error tolerance is satisfied. CMLMC assumes discretization hierarchies that are defined a priori for each level and are geometrically refined across levels. Moreover, the actual choice of computational work across levels is based on parametric models for the average cost per sample and the corresponding variance and weak error. These parameters are calibrated using Bayesian estimation, taking particular notice of the deepest levels of the discretization hierarchy, where only few realizations are available to produce the estimates. The resulting CMLMC estimator exhibits a non-trivial splitting between bias and statistical contributions. We also show the asymptotic normality of the statistical error in the MLMC estimator and justify in this way our error estimate that allows prescribing both required accuracy and confidence in the final result. Our numerical results substantiate the above results and illustrate the corresponding computational savings in examples that are described in terms of differential equations either driven by random measures or with random coefficients.

97 MATHEMATICS AND COMPUTING↗

Preserving nonlinear constraints in variational flow filtering data assimilation

Data assimilation aims to estimate the states of a dynamical system by optimally combining sparse and noisy observations of the physical system with uncertain forecasts produced by a computational model. The states of many dynamical systems of interest obey nonlinear physical constraints, and the corresponding dynamics is confined to a certain sub-manifold of the state space. Standard data assimilation techniques applied to such systems yield posterior states lying outside the manifold, violating the physical constraints. This work focuses on particle flow filters which use stochastic differential equations to evolve state samples from a prior distribution to samples from an observation-informed posterior distribution. The variational Fokker-Planck (VFP)—a generic particle flow filtering framework—is extended to incorporate non-linear, equality state constraints in the analysis. To this end, two algorithmic approaches that modify the VFP stochastic differential equation are discussed: (i) VFPSTAB, to inexactly preserve constraints with the addition of a stabilizing drift term, and (ii) VFPDAE, to exactly preserve constraints by treating the VFP dynamics as a stochastic differential-algebraic equation (SDAE). Additionally, an implicit-explicit time integrator is developed to evolve the VFPDAE dynamics. The strength of the proposed approach for constraint preservation in data assimilation is demonstrated on three test problems: the double pendulum, Korteweg-de-Vries, and the incompressible Navier-Stokes equations.

97 MATHEMATICS AND COMPUTING↗

Recommended nuclear data for medical radioisotope production: diagnostic positron emitters

An IAEA coordinated research project that began in 2012 and ended in 2016 was primarily dedicated to the compilation, evaluation and recommendation of cross-section data for the production of medical radionuclides. One significant part of this work focused on diagnostic positron emitters. These particular studies consist of 69 reactions for direct and indirect or generator production of 44 Sc( 44 Ti), 52 mMn( 52 Fe), 52 gMn, 55 Co, 61 Cu, 62 Cu( 62 Zn), 66 Ga, 68 Ga( 68 Ge), 72 As( 72 Se), 73 Se, 76 Br, 82 Rb( 82 Sr), 82 mRb, 86 Y, 89 Zr, 90 Nb, 94 mTc, 110 mIn( 110 Sn), 118 Sb( 118 Te), 120 I, 122 I( 122 Xe), 128 Cs( 128 Ba), and 140 Pr( 140 Nd) medical radionuclides. The resulting reference cross-section data were obtained from Padé fits to selected and corrected experimental data, and integral thick target yields were subsequently deduced. Uncertainties in the fitted results were estimated via a Padé least-squares method with the addition of a 4% assessed systematic uncertainty. Experimental data were also compared with theoretical predictions available from the TENDL-2015 and TENDL-2017 libraries.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Impacts of Vaccination and Severe Acute Respiratory Syndrome Coronavirus 2 Variants Alpha and Delta on Coronavirus Disease 2019 Transmission Dynamics in Four Metropolitan Areas of the United States

To characterize Coronavirus Disease 2019 (COVID-19) transmission dynamics in each of the metropolitan statistical areas (MSAs) surrounding Dallas, Houston, New York City, and Phoenix in 2020 and 2021, we extended a previously reported compartmental model accounting for effects of multiple distinct periods of non-pharmaceutical interventions by adding consideration of vaccination and Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) variants Alpha (lineage B.1.1.7) and Delta (lineage B.1.617.2). For each MSA, we found region-specific parameterizations of the model using daily reports of new COVID-19 cases available from January 21, 2020 to October 31, 2021. In the process, we obtained estimates of the relative infectiousness of Alpha and Delta as well as their takeoff times in each MSA (the times at which sustained transmission began). The estimated infectiousness of Alpha ranged from 1.1x to 1.4x that of viral strains circulating in 2020 and early 2021. The estimated relative infectiousness of Delta was higher in all cases, ranging from 1.6x to 2.1x. The estimated Alpha takeoff times ranged from February 1 to February 28, 2021. The estimated Delta takeoff times ranged from June 2 to June 26, 2021. In conclusion, estimated takeoff times are consistent with genomic surveillance data.

60 APPLIED LIFE SCIENCES↗

Karhunen–Loève deep learning method for surrogate modeling and approximate Bayesian parameter estimation

We evaluate the performance of the Karhunen-Loève Deep Neural Network (KL-DNN) framework for surrogate modeling and approximate Bayesian parameter estimation in partial differential equation models. In the surrogate model, the Karhunen-Loève (KL) expansions are used for the dimensionality reduction of the number of unknown parameters and variables, and a deep neural network is employed to relate the reduced space of parameters to that of the state variables. The KL-DNN surrogate model is used to formulate a maximum-a-posteriori-like least-squares problem, which is randomized to draw samples of the posterior distribution of the parameters. We test the proposed framework for a hypothetical unconfined aquifer via comparison with the forward MODFLOW and inverse PEST++ iterative ensemble smoother (IES) solutions as well as the state-of-the-art Fourier neural operator (FNO) and deep operator networks (DeepONets) operator learning surrogate models. Our results show that the KL-DNN surrogate model outperforms FNO and DeepONet for forward predictions. For solving inverse problems, the randomized algorithm provides the same or more accurate Bayesian predictions of the parameters than IES as evidenced by the higher log-predictive probability of both the estimated parameter field and the forecast hydraulic head. The posterior mean obtained from the randomized algorithm is closer to the reference parameter field than that obtained with FNO as the maximum a posteriori estimate.

Approximate Bayesian inference↗

On the impact of tidal generation and energy storage integration in PV-rich electric distribution systems

Deep decarbonization of power system operations requires the maximal utilization of available renewable resources. At distribution-level operations, however, grid operators can face numerous challenges in integrating renewables at scale owing to the inherent intermittence of renewable energy resources. These include phenomena such as voltage fluctuations, which are typically mitigated through control actuators such as on-load tap changers (OLTC) as well as energy storage devices, such as battery energy storage systems (BESS). On the one hand, high intermittence of the available renewable portfolio may require increasingly aggressive control of actuators, thereby accelerating the probability of equipment failure. On the other hand, integrating BESS operations and having a diverse renewable generation portfolio can typically help stagger power/energy flow to mitigate the aforementioned adverse impacts. In this paper, we employ a Bayesian framework for equipment lifetime estimation to understand the impact of including tidal energy resources and BESS in distribution system operations for feeders having substantial distribution photovoltaic generation. Our results indicate that while tidal energy alone may slightly decrease equipment reliability, the adverse impact on reliability is significantly magnified by a generation portfolio consisting of tidal generation and photovoltaic generation. Here, we also study the tidal and photovoltaic hosting capacity problem with and without energy storage systems using equipment reliability as an added constraint. We conclude that energy storage increases the reliability-constrained hosting capacity of the distribution system.

14 SOLAR ENERGY↗

Virtual Model Validation of Complex Multiscale Systems: Applications to Nonlinear Elastostatics

We propose a virtual statistical validation process as an aid to the design of experiments for the validation of phenomenological models of the behavior of material bodies, with focus on those cases in which knowledge of the fabrication process used to manufacture the body can provide information on the micro-molecular-scale properties underlying macroscale behavior. One example is given by models of elastomeric solids fabricated using polymerization processes. We describe a framework for model validation that involves Bayesian updates of parameters in statistical calibration and validation phases. The process enables the quanti cation of uncertainty in quantities of interest (QoIs) and the determination of model consistency using tools of statistical information theory. We assert that microscale information drawn from molecular models of the fabrication of the body provides a valuable source of prior information on parameters as well as a means for estimating model bias and designing virtual validation experiments to provide information gain over calibration posteriors.

97 MATHEMATICS AND COMPUTING↗

Generation and application of multivariate polynomial quadrature rules

The search for multivariate quadrature rules of minimal size with a specified polynomial accuracy has been the topic of many years of research. Finding such a rule allows accurate integration of moments, which play a central role in many aspects of scientific computing with complex models. The contribution of this paper is twofold. First, we provide novel mathematical analysis of the polynomial quadrature problem that provides a lower bound for the minimal possible number of nodes in a polynomial rule with specified accuracy. We give concrete but simplistic multivariate examples where a minimal quadrature rule can be designed that achieves this lower bound, along with situations that showcase when it is not possible to achieve this lower bound. Our second contribution is the formulation of an algorithm that is able to efficiently generate multivariate quadrature rules with positive weights on non-tensorial domains. Our tests show success of this procedure in up to 20 dimensions. We test our method on applications to dimension reduction and chemical kinetics problems, including comparisons against popular alternatives such as sparse grids, Monte Carlo and quasi Monte Carlo sequences, and Stroud rules. The quadrature rules computed in this paper outperform these alternatives in almost all scenarios.

97 MATHEMATICS AND COMPUTING↗

Multi-fidelity classification using Gaussian processes: Accelerating the prediction of large-scale computational models

We report that machine learning techniques typically rely on large datasets to create accurate classifiers. However, there are situations when data is scarce and expensive to acquire. This is the case of studies that rely on state-of-the-art computational models which typically take days to run, thus hindering the potential of machine learning tools. In this work, we present a novel classifier that takes advantage of lower fidelity models and inexpensive approximations to predict the binary output of expensive computer simulations. We postulate an autoregressive model between the different levels of fidelity with Gaussian process priors. We adopt a fully Bayesian treatment for the hyper-parameters and use Markov Chain Monte Carlo samplers. We take advantage of the probabilistic nature of the classifier to implement active learning strategies. We also introduce a sparse approximation to enhance the ability of the multi-fidelity classifier to handle a large amount of low fidelity samples. We test these multi-fidelity classifiers against their single-fidelity counterpart with synthetic data, showing a median computational cost reduction of 23% for a target accuracy of 90%. In an application to cardiac electrophysiology, the multi-fidelity classifier achieves an F1 score, the harmonic mean of precision and recall, of 99.6% compared to 74.1% of a single-fidelity classifier when both are trained with 50 samples. In general, our results show that the multi-fidelity classifiers outperform their single-fidelity counterpart in terms of accuracy in all cases. Finally, we envision that this new tool will enable researchers to study classification problems that would otherwise be prohibitively expensive. Source code is available at https://github.com/fsahli/MFclass.

97 MATHEMATICS AND COMPUTING↗

Stochastic modeling and statistical calibration with model error and scarce data

This paper introduces a procedure to assess the predictive accuracy of stochastic models subject to model error and sparse data. Model error is introduced as uncertainty on the coefficients of appropriate polynomial chaos expansions (PCE). The error associated with finite sample size allows us to conceive of these coefficients as statistics of the data that we describe as random variables whose influence on output quantities of interest is evaluated through the extended polynomial chaos expansion (EPCE). A Bayesian data assimilation scheme is introduced to update these expansions by considering the resulting nested chaos expansion as a hierarchical probabilistic model. Stochastic models of quantities of interest (QoI) are thus constructed and efficiently evaluated. Here, the Metropolis–Hastings Markov chain Monte Carlo procedure is used to sample the posterior. Two illustrative analytical and numerical problems are used to demonstrate the proposed approach.

Bayesian inference↗

Towards robust autonomous impedance spectroscopy analysis: A calibrated hierarchical Bayesian approach for electrochemical impedance spectroscopy (EIS) inversion

Distribution-based analyses, such as the distribution of relaxation times (DRT) and the distribution of diffusion times (DDT), present model-free alternatives to equivalent circuit modeling for analysis of electrochemical impedance spectroscopy (EIS) data. However, reconstructing such distributions from noisy impedance data is an ill-posed problem that must be solved with specialized inversion algorithms, requiring careful control and tuning. Furthermore, most inversion algorithms developed to date can only solve problems of limited complexity. Herein, we present a new hierarchical Bayesian method for EIS inversion, leveraging efficient algorithms for optimization and Hamiltonian Monte Carlo (HMC) sampling to solve models of arbitrary complexity. We overcome the challenge of ad-hoc parameter tuning by encoding intrinsic characteristics of the DRT and DDT into flexible prior distributions and “pre-calibrating” the model to simulated data. This approach is versatile, highly robust to noise, and provides quantitative estimates of both the error structure of the data and the uncertainty in the recovered distributions. The model is validated with simulated data to demonstrate accurate recovery of the DRT and the DDT. The method also shows promise for simultaneous recovery of multiple distributions, raising the intriguing possibility of semi-autonomous EIS analysis and ad-hoc model construction. Finally, the practical utility of the method is illustrated with experimental data. Throughout, we draw comparisons to several recently published EIS inversion methodologies.

36 MATERIALS SCIENCE↗