Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Solving Stochastic Inverse Problems for Property–Structure Linkages Using Data-Consistent Inversion and Machine Learning

Determining process–structure–property linkages is one of the key objectives in material science, and uncertainty quantification plays a critical role in understanding both process–structure and structure–property linkages. In this work, we seek to learn a distribution of microstructure parameters that are consistent in the sense that the forward propagation of this distribution through a crystal plasticity finite element model matches a target distribution on materials properties. This stochastic inversion formulation infers a distribution of acceptable/consistent microstructures, as opposed to a deterministic solution, which expands the range of feasible designs in a probabilistic manner. Furthermore, to solve this stochastic inverse problem, we employ a recently developed uncertainty quantification framework based on push-forward probability measures, which combines techniques from measure theory and Bayes’ rule to define a unique and numerically stable solution. This approach requires making an initial prediction using an initial guess for the distribution on model inputs and solving a stochastic forward problem. To reduce the computational burden in solving both stochastic forward and stochastic inverse problems, we combine this approach with a machine learning Bayesian regression model based on Gaussian processes and demonstrate the proposed methodology on two representative case studies in structure–property linkages.

36 MATERIALS SCIENCE↗

Uncertainty estimates for the Bayes Inference Engine, (BIE)

In the fall 2007 meeting of the BIB users group, two approaches to making uncertainty estimates were presented. Ken Hanson asserted that if the BFGS optimizer was used, the inverse Hessian matrix was the same as the covariance matrix representing parameter uncertainties. John Pang presented preliminary results of a Monte Carlo method called Randomized Maximum Likelihood (RML). The BFGS/Hessian matrix approach may be applied to the region of the 'ideal model' Approximately 250 parameters describing the object density patches that are varied to match an image of 1,000,000 pixels. I cast this in terms of least squares analysis, as it is much better understood. This not as large a conceptual jump as some suppose because many of the functional blocks in the BIB are taken directly from existing least squares programs. If a Gaussian (normal) probability density function is assumed for both the observation and parameter errors, the Bayesian and least squares result should be identical.

97 MATHEMATICS AND COMPUTING↗

Improving Weak Lensing Mass Map Reconstructions using Gaussian and Sparsity Priors: Application to DES SV

Mapping the underlying density field, including non-visible dark matter, using weak gravitational lensing measurements is now a standard tool in cosmology. Due to its importance to the science results of current and upcoming surveys, the quality of the convergence reconstruction methods should be well understood. We compare three methods: Kaiser–Squires (KS), Wiener filter, and Glimpse. Kaiser–Squires is a direct inversion, not accounting for survey masks or noise. The Wiener filter is well-motivated for Gaussian density fields in a Bayesian framework. Glimpse uses sparsity, aiming to reconstruct non-linearities in the density field. We compare these methods with several tests using public Dark Energy Survey (DES) Science Verification (SV) data and realistic DES simulations. The Wiener filter and Glimpse offer substantial improvements over smoothed Kaiser–Squires with a range of metrics. Both the Wiener filter and Glimpse convergence reconstructions show a 12 per cent improvement in Pearson correlation with the underlying truth from simulations. To compare the mapping methods’ abilities to find mass peaks, we measure the difference between peak counts from simulated ΛCDM shear catalogues and catalogues with no mass fluctuations (a standard data vector when inferring cosmology from peak statistics); the maximum signal-to-noise of these peak statistics is increased by a factor of 3.5 for the Wiener filter and 9 for Glimpse. With simulations, we measure the reconstruction of the harmonic phases; the phase residuals’ concentration is improved 17 per cent by Glimpse and 18 per cent by the Wiener filter. The correlationbetween reconstructions from data and foreground redMaPPer clusters is increased 18 per cent by the Wiener filter and 32 per cent by Glimpse.

79 ASTRONOMY AND ASTROPHYSICS↗

Anomaly Detection in Dynamic Networks

Anomaly detection in dynamic communication networks has many important security applications. These networks can be extremely large and so detecting any changes in their structure can be computationally challenging; hence, computationally fast, parallelisable methods for monitoring the network are paramount. For this reason the methods presented here use independent node and edge based models to detect locally anomalous substructures within communication networks. As a first stage, the aim is to detect changes in the data streams arising from node or edge communications. Throughout the thesis simple, conjugate Bayesian models for counting processes are used to model these data streams. A second stage of analysis can then be performed on a much reduced subset of the network comprising nodes and edges which have been identified as potentially anomalous in the first stage. The first method assumes communications in a network arise from an inhomogeneous Poisson process with piecewise constant intensity. Anomaly detection is then treated as a changepoint problem on the intensities. The changepoint model is extended to incorporate seasonal behavior inherent in communication networks. This seasonal behavior is also viewed as a changepoint problem acting on a piecewise constant Poisson process. In a static time frame, inference is made on this extended model via a Gibbs sampling strategy. In a sequential time frame, where the data arrive as a stream, a novel, fast Sequential Monte Carlo (SMC) algorithm is introduced to sample from the sequence of posterior distributions of the change points over time. A second method is considered for monitoring communications in a large scale computer network. The usage patterns in these types of networks are very bursty in nature and don’t fit a Poisson process model. For tractable inference, discrete time models are considered, where the data are aggregated into discrete time periods and probability models are fitted to the communication counts. In a sequential analysis, anomalous behavior is then identified from outlying behavior with respect to the fitted predictive probability models. Seasonality is again incorporated into the model and is treated as a changepoint model on the transition probabilities of a discrete time Markov process. Second stage analytics are then developed which combine anomalous edges to identify anomalous substructures in the network.

97 MATHEMATICS AND COMPUTING↗

Ogle-2018-BLG-0799lb: A Q ∼ 2.7 × 10(−3) Planet With Spitzer Parallax

We report the discovery and analysis of a planet in the microlensing event OGLE-2018-BLG-0799. The planetary signal was observed by several ground-based telescopes, and the planet-host mass ratio is q = (2.65 ± 0.16) × 10(−3). The ground-based observations yield a constraint on the angular Einstein radius θE, and the microlensing parallax vector πE, is strongly constrained by the Spitzer data. However, the 2019 Spitzer baseline data reveal systematics in the Spitzer photometry, so there is ambiguity in the magnitude of the parallax. In our preferred interpretation, a full Bayesian analysis using a Galactic model indicates that the planetary system is composed of an Mplanet = 0.26+0.22 −0.11M(J) planet orbiting an Mhost = 0.093+0.082 −0.038 Mʘ , at a distance of DL = 3.71+3.24 −1.70 kpc. An alternate interpretation of the data shifts the localization of the minima along the arc-shaped microlens parallax constraints. This, in turn, yields a more massive host with median mass of 0.13 Mʘ at a distance of 6.3 kpc. This analysis demonstrates the robustness of the osculating circles formalism, but shows that further investigation is needed to assess how systematics affect the specific localization of the microlens parallax vector and, consequently, the inferred physical parameters.

gravitational lensing↗

THE DYNAMICS OF MERGING CLUSTERS: A MONTE CARLO SOLUTION APPLIED TO THE BULLET AND MUSKET BALL CLUSTERS

Merging galaxy clusters have become one of the most important probes of dark matter, providing evidence for dark matter over modified gravity and even constraints on the dark matter self-interaction cross-section. To properly constrain the dark matter cross-section it is necessary to understand the dynamics of the merger, as the inferred cross-section is a function of both the velocity of the collision and the observed time since collision. While the best understanding of merging system dynamics comes from N-body simulations, these are computationally intensive and often explore only a limited volume of the merger phase space allowed by observed parameter uncertainty. Simple analytic models exist but the assumptions of these methods invalidate their results near the collision time, plus error propagation of the highly correlated merger parameters is unfeasible. To address these weaknesses I develop a Monte Carlo method to discern the properties of dissociative mergers and propagate the uncertainty of the measured cluster parameters in an accurate and Bayesian manner. I introduce this method, verify it against an existing hydrodynamic N-body simulation, and apply it to two known dissociative mergers: 1ES 0657-558 (Bullet Cluster) and DLSCL J0916.2+2951 (Musket Ball Cluster). I find that this method surpasses existing analytic models-providing accurate (10% level) dynamic parameter and uncertainty estimates throughout the merger history. This, coupled with minimal required a priori information (subcluster mass, redshift, and projected separation) and relatively fast computation ({approx}6 CPU hours), makes this method ideal for large samples of dissociative merging clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Exploration and Surrogate Emulation of Nonlinear Beam-Response Geometry in the LBNF Beamline

Next-generation long-baseline neutrino experiments aim to achieve multi-MW proton beam power while reducing accelerator-induced systematic uncertainties. At Fermilab, the LBNF beamline is designed for 1.2 MW operation with PIP-II and is upgradeable to 2.4 MW. DUNE will probe the three-flavor neutrino paradigm and search for CP violation, requiring precise neutrino-flux normalization and improved control of accelerator-related uncertainties. Within the LBNF beamline, the System for On-Axis Neutrino Detection (SAND) will constrain flux uncertainties using precision near-detector measurements, while the Muon Monitor System (MuMS) will provide beamline diagnostics sensitive to the proton beam, target, and horn configuration. However, the pion phase space relevant for DUNE depends simultaneously on many correlated parameters, including beam centroid, beam width, horn current and alignment, target position, optics shifts, and radiation-induced changes. Consequently, MuMS observables exhibit nonlinear and coupled responses that are difficult to characterize using traditional one-parameter scans. To address this challenge, we are developing a Bayesian Exploration framework coupled to physics-informed surrogate emulators trained on Geant4 beamline simulations. Gaussian-process emulators provide both fast predictions and uncertainty estimates, enabling adaptive selection of new simulation points in beam-parameter space. As an initial demonstration, we construct surrogate emulators for MuMS response observables using a verified simulation campaign spanning proton-beam steering conditions. The emulators reproduce the simulated dependence of MuMS centroid and gradient observables while providing predictive uncertainties, and serve as the foundation for future multidimensional exploration including beam width, horn current, and additional beamline parameters. This work establishes a framework for uncertainty-aware beam monitoring, adaptive simulation campaigns, and rapid beam-response inference for future DUNE operations.

Ganguly, Sudeshna [Fermilab] (ORCID:00000003163482↗

In Situ Inference for Earth System Predictability

An understanding of future evolution in precipitation extremes is critical to numerous DOE mission questions. Extreme events are by nature short time-scale events that are difficult to diagnose in available model data. Accurate modeling of extreme events necessarily requires high spatial resolution at the storm scale locally. However, the environment in which storms grow is dependent on global, remote, processes. These complex spatiotemporal relationships are impossible to diagnose at resolutions required to accurately model storms responsible for extreme precipitation. At exascale, climate simulations will produce results at fine enough resolution to investigate these relationships. However, the resulting data from these simulations will be far too large to save for post-simulation analysis. We advocate for fitting statistical models inside the simulations as they run, a context known as in situ, which will facilitate scientific investigations using the full fine-scale data stream. Figure 1 shows an example of the type of model we could consider, a Bayesian hierarchical spatial regression model. Precipitation extremes at each grid cell are modeled using extreme value distributions. Since extremes are rare, fitting models to individual grid cells can result in high variance and poor estimates. Instead, the model can be made more robust by smoothing the parameters of the extreme value model across space. Additionally, the parameters themselves can be functionally linked to other variables elsewhere in the simulation. Thus, we can use the fine-scale data to build more robust models for extremes that link extreme behavior to other climate patterns.

54 ENVIRONMENTAL SCIENCES↗

Predictive coarse-graining

We propose a data-driven, coarse-graining formulation in the context of equilibrium statistical mechanics. In contrast to existing techniques which are based on a fine-to-coarse map, we adopt the opposite strategy by prescribing a probabilistic coarse-to-fine map. This corresponds to a directed probabilistic model where the coarse variables play the role of latent generators of the fine scale (all-atom) data. From an information-theoretic perspective, the framework proposed provides an improvement upon the relative entropy method and is capable of quantifying the uncertainty due to the information loss that unavoidably takes place during the coarse-graining process. Furthermore, it can be readily extended to a fully Bayesian model where various sources of uncertainties are reflected in the posterior of the model parameters. The latter can be used to produce not only point estimates of fine-scale reconstructions or macroscopic observables, but more importantly, predictive posterior distributions on these quantities. Predictive posterior distributions reflect the confidence of the model as a function of the amount of data and the level of coarse-graining. The issues of model complexity and model selection are seamlessly addressed by employing a hierarchical prior that favors the discovery of sparse solutions, revealing the most prominent features in the coarse-grained model. A flexible and parallelizable Monte Carlo – Expectation–Maximization (MC-EM) scheme is proposed for carrying out inference and learning tasks. A comparative assessment of the proposed methodology is presented for a lattice spin system and the SPC/E water model.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Effects of error covariance structure on estimation of model averaging weights and predictive performance

When conducting model averaging for assessing groundwater conceptual model uncertainty, the averaging weights are often evaluated using model selection criteria such as AIC, AICc, BIC, and KIC (Akaike Information Criterion, Corrected Akaike Information Criterion, Bayesian Information Criterion, and Kashyap Information Criterion, respectively). However, this method often leads to an unrealistic situation in which the best model receives overwhelmingly large averaging weight (close to 100%), which cannot be justified by available data and knowledge. It was found in this study that this problem was caused by using the covariance matrix, CE, of measurement errors for estimating the negative log likelihood function common to all the model selection criteria. This problem can be resolved by using the covariance matrix, Cek, of total errors (including model errors and measurement errors) to account for the correlation between the total errors. An iterative two-stage method was developed in the context of maximum likelihood inverse modeling to iteratively infer the unknown Cek from the residuals during model calibration. The inferred Cek was then used in the evaluation of model selection criteria and model averaging weights. While this method was limited to serial data using time series techniques in this study, it can be extended to spatial data using geostatistical techniques. The method was first evaluated in a synthetic study and then applied to an experimental study, in which alternative surface complexation models were developed to simulate column experiments of uranium reactive transport. It was found that the total errors of the alternative models were temporally correlated due to the model errors. The iterative two-stage method using Cek resolved the problem that the best model receives 100% model averaging weight, and the resulting model averaging weights were supported by the calibration results and physical understanding of the alternative models. Using Cek obtained from the iterative two-stage method also improved predictive performance of the individual models and model averaging in both synthetic and experimental studies.

error correlation↗

Correcting the z ∼ 8 galaxy luminosity function for gravitational lensing magnification bias

We present a Bayesian framework to account for the magnification bias from both strong and weak gravitational lensing in estimates of high-redshift galaxy luminosity functions (LFs). We illustrate our method by estimating the z ∼ 8 UV LF using a sample of 97 Y-band dropouts (Lyman break galaxies) found in the Brightest of Reionizing Galaxies (BoRG) survey and from the literature. We find the LF is well described by a Schechter function with characteristic magnitude of M{sup ⋆}=−19.85{sub −0.35}{sup +0.30}, faint-end slope of α=−1.72{sub −0.29}{sup +0.30}, and number density of log{sub 10}Ψ{sup ⋆}(Mpc{sup −3})=−3.00{sub −0.31}{sup +0.23}. These parameters are consistent within the uncertainties with those inferred from the same sample without accounting for the magnification bias, demonstrating that the effect is small for current surveys at z ∼ 8, and cannot account for the apparent overdensity of bright galaxies compared to a Schechter function found recently by Bowler et al. and Finkelstein et al. We estimate that the probability of finding a strongly lensed z ∼ 8 source in our sample is in the range ∼3–15% depending on limiting magnitude. We identify one strongly lensed candidate and three cases of intermediate lensing in BoRG (estimated magnification μ > 1.4) in addition to the previously known candidate group-scale strong lens. Using a range of theoretical LFs we conclude that magnification bias will dominate wide field surveys—such as those planned for the Euclid and WFIRST missions—especially at z > 10. Magnification bias will need to be accounted for in order to derive accurate estimates of high-redshift LFs in these surveys and to distinguish between galaxy formation models.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Vision for Shape Recovery

We present a new Bayesian vision technique that aims at recovering a shape from two or more noisy observations taken under similar lighting conditions. The shape is parametrized by a piecewise linear height field, textured by a piecewise linear irradiance field, and we assume Gaussian Markovian priors for both shape vertices and irradiance variables. The observation process. also known as rendering, is modeled by a non-affine projection (e.g. perspective projection) followed by a convolution with a piecewise linear point spread function. and contamination by additive Gaussian noise. We assume that the observation parameters are calibrated beforehand. The major novelty of the proposed method consists of marginalizing out the irradiances considered as nuisance parameters, which is achieved by Laplace approximations. This reduces the inference to minimizing an energy that only depends on the shape vertices, and therefore allows an efficient Iterated Conditional Mode (ICM) optimization scheme to be implemented. A Gaussian approximation of the posterior shape density is computed, thus providing estimates both the geometry and its uncertainty. We illustrate the effectiveness of the new method by shape reconstruction results in a 2D case. A 3D version is currently under development and aims at recovering a surface from multiple images, reconstructing the topography by marginalizing out both albedo and shading.

Jalobeanu, Andre↗

OGLE-2017-BLG-1186: First Application of Asteroseismology and Gaussian Processes to microlensing

We present the analysis of the event OGLE-2017-BLG-1186 from the 2017 Spitzer microlensing campaign. This is a remarkable microlensing event because its source is photometrically bright and variable, which makes it possible to perform an asteroseismic analysis using ground-based data. We find that the source star is an oscillating red giant with average timescale of ∼9 d. The asteroseismic analysis also provides us source properties including the source angular size (∼27 μas) and distance (∼11.5 kpc), which are essential for inferring the properties of the lens. When fitting the light curve, we test the feasibility of Gaussian processes (GPs) in handling the correlated noise caused by the variable source. We find that the parameters from the GP model are generally more loosely constrained than those from the traditional χ(exp 2) minimization method. We note that this event is the first microlensing system for which asteroseismology and GPs have been used to account for the variable source. With both finite-source effect and microlens parallax measured, we find that the lens is likely a ∼0.045 Mʘ brown dwarf at distance ∼9.0 kpc, or a ∼0.073 Mʘ ultracool dwarf at distance ∼9.8 kpc. Combining the estimated lens properties with a Bayesian analysis using a Galactic model, we find a ∼ 35 per cent probability for the lens to be a bulge object and ∼ 65 per cent to be a background disc object.

S.-S. Li↗

Bayesian tomography and integrated data analysis in fusion diagnostics

In this article, a Bayesian tomography method using non-stationary Gaussian process for a prior has been introduced. The Bayesian formalism allows quantities which bear uncertainty to be expressed in the probabilistic form so that the uncertainty of a final solution can be fully resolved from the confidence interval of a posterior probability. Moreover, a consistency check of that solution can be performed by checking whether the misfits between predicted and measured data are reasonably within an assumed data error. In particular, the accuracy of reconstructions is significantly improved by using the non-stationary Gaussian process that can adapt to the varying smoothness of emission distribution. The implementation of this method to a soft X-ray diagnostics on HL-2A has been used to explore relevant physics in equilibrium and MHD instability modes. This project is carried out within a large size inference framework, aiming at an integrated analysis of heterogeneous diagnostics.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Does Spatial Dependence Affect the Intention to Make Land Available for Bioenergy Crops?

Abstract We find spatial dependence in landowners’ stated intentions to make land available for bioenergy crops. Our data are generated from a contingent valuation survey of 599 owners of marginal land in southern Michigan. Employing a Bayesian framework and using these spatially explicit data, we estimate and compare non‐spatial probit and spatial Durbin probit models to examine the presence of spatial dependence in land rental intentions. Results show that intentions to rent land for bioenergy crop production are spatially dependent. This spatial dependence arises both from the land supply intentions of nearby landowners and from spatial spillover effects of landowner characteristics and attitudes towards environmental amenities and the disamenities of land rental. We show that ignoring spatial dependence in the intentions of neighbouring landowners to participate in land rental markets for bioenergy feedstocks can lead to distortions that underestimate total effects. Our finding implies that studies of land use and crop supply should test for spatial interactions in order to make accurate inferences.

Skevas, Theodoros↗

Order-by-order uncertainties of nucleon-nucleon Wolfenstein amplitudes in chiral effective field theory

Quantum mechanical invariance principles dictate the most general operator structure that can be present in the nucleon-nucleon (NN) interaction. Five independent operators appear in the on-shell NN amplitude together with five corresponding coefficient functions. The usual choice for these coefficient functions is known as the NN Wolfenstein amplitudes. We analyze the order-by-order convergence of each of the five NN Wolfenstein amplitudes predicted by a semilocal coordinate space potential implementation of chiral effective field theory (𝜒⁢EFT). We do this at laboratory kinetic energies between 25 and 200 MeV for both neutron-proton and proton-proton scattering. Our analysis uses the Gaussian-process methods developed by the BUQEYE Collaboration to describe the contributions of each 𝜒⁢EFT order, and so yields truncation uncertainties for each Wolfenstein amplitude that are correlated across scattering angles. We combine information on the size of different orders in the EFT to infer the 𝜒⁢EFT breakdown scale for each amplitude, finding, on average, Λ 𝑏 between 750 and 800 MeV. Furthermore, with this choice of Λ 𝑏 , the EFT truncation uncertainties cover both higher-order results and empirical Wolfenstein amplitudes well for all orders other than the leading order.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Inter-Domain Fusion for Enhanced Intrusion Detection in Power Systems: An Evidence Theoretic and Meta-Heuristic Approach

False alerts due to misconfigured or compromised intrusion detection systems (IDS) in industrial control system (ICS) networks can lead to severe economic and operational damage. However, research using deep learning to reduce false alerts often requires the physical and cyber sensor data to be trustworthy. Implicit trust is a major problem for artificial intelligence or machine learning (AI/ML) in cyber-physical system (CPS) security, because when these solutions are most urgently needed is also when they are most at risk (e.g., during an attack). To address this, the Inter-Domain Evidence theoretic Approach for Inference (IDEA-I) is proposed that reframes the detection problem as how to make good decisions given uncertainty. Specifically, an evidence theoretic approach leveraging Dempster–Shafer (DS) combination rules and their variants is proposed for reducing false alerts. A multi-hypothesis mass function model is designed that leverages probability scores obtained from supervised-learning classifiers. Using this model, a location-cum-domain-based fusion framework is proposed to evaluate the detector’s performance using disjunctive, conjunctive, and cautious conjunctive rules. The approach is demonstrated in a cyber-physical power system testbed, and the classifiers are trained with datasets from Man-In-The-Middle attack emulation in a large-scale synthetic electric grid. For evaluating the performance, we consider plausibility, belief, pignistic, and general Bayesian theorem-based metrics as decision functions. To improve the performance, a multi-objective-based genetic algorithm is proposed for feature selection considering the decision metrics as the fitness function. Finally, we present a software application to evaluate the DS fusion approaches with different parameters and architectures.

42 ENGINEERING↗

Deducing neutron star equation of state from telescope spectra with machine-learning-derived likelihoods

The interiors of neutron stars reach densities and temperatures beyond the limits of terrestrial experiments, providing vital laboratories for probing nuclear physics. While the star's interior is not directly observable, its pressure and density determine the star's macroscopic structure which affects the spectra observed in telescopes. The relationship between the observations and the internal state is complex and partially intractable, presenting difficulties for inference. Previous work has focused on the regression from stellar spectra of parameters describing the internal state. We demonstrate a calculation of the full likelihood of the internal state parameters given observations, accomplished by replacing intractable elements with machine learning models trained on samples of simulated stars. Our machine-learning-derived likelihood allows us to perform maximum a posteriori estimation of the parameters of interest, as well as full scans. We demonstrate the technique by inferring stellar mass and radius from an individual stellar spectrum, as well as equation of state parameters from a set of spectra. Our results are more precise than pure regression models, reducing the width of the parameter residuals by 11.8% in the most realistic scenario. The neural networks will be released as a tool for fast simulation of neutron star properties and observed spectra.

79 ASTRONOMY AND ASTROPHYSICS↗