Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Conin

SAND2025-07645O Conin is a Python library that supports constrained analysis of probabilistic graphical models (PGMs). It enables constrained inference and learning for hidden Markov models, Bayesian networks, dynamic Bayesian networks, and Markov networks. Conin interfaces with the pgmpy library to specify general probabilistic graphical models with a variety of optimization solvers to support learning and inference. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Hart, William [Sandia National Lab. (SNL-CA), Live↗

Anomaly Detection in Dynamic Networks

Anomaly detection in dynamic communication networks has many important security applications. These networks can be extremely large and so detecting any changes in their structure can be computationally challenging; hence, computationally fast, parallelisable methods for monitoring the network are paramount. For this reason the methods presented here use independent node and edge based models to detect locally anomalous substructures within communication networks. As a first stage, the aim is to detect changes in the data streams arising from node or edge communications. Throughout the thesis simple, conjugate Bayesian models for counting processes are used to model these data streams. A second stage of analysis can then be performed on a much reduced subset of the network comprising nodes and edges which have been identified as potentially anomalous in the first stage. The first method assumes communications in a network arise from an inhomogeneous Poisson process with piecewise constant intensity. Anomaly detection is then treated as a changepoint problem on the intensities. The changepoint model is extended to incorporate seasonal behavior inherent in communication networks. This seasonal behavior is also viewed as a changepoint problem acting on a piecewise constant Poisson process. In a static time frame, inference is made on this extended model via a Gibbs sampling strategy. In a sequential time frame, where the data arrive as a stream, a novel, fast Sequential Monte Carlo (SMC) algorithm is introduced to sample from the sequence of posterior distributions of the change points over time. A second method is considered for monitoring communications in a large scale computer network. The usage patterns in these types of networks are very bursty in nature and don’t fit a Poisson process model. For tractable inference, discrete time models are considered, where the data are aggregated into discrete time periods and probability models are fitted to the communication counts. In a sequential analysis, anomalous behavior is then identified from outlying behavior with respect to the fitted predictive probability models. Seasonality is again incorporated into the model and is treated as a changepoint model on the transition probabilities of a discrete time Markov process. Second stage analytics are then developed which combine anomalous edges to identify anomalous substructures in the network.

97 MATHEMATICS AND COMPUTING↗

Structure–Property Linkage in Alloys Using Graph Neural Network and Explainable Artificial Intelligence

Deep learning tools have recently shown significant potential for accelerating the prediction of microstructure–property linkage in materials. While deep neural networks like convolution neural networks (CNNs) can extract physics information from 3D microstructure images, they often require a large network architecture and substantial training time. In this research, we trained a graph neural network (GNN) using phase field generated microstructures of Ni-Al alloys to predict the evolution of mechanical properties. We found that a single GNN is capable of accurately predicting the strengthening of Ni-Al alloys with microstructures of varying sizes and dimensions, which cannot otherwise be done with a CNN. Additionally, GNN requires significantly less GPU utilization than CNN and offers more interpretable explanation of predictions using saliency analysis as features are manually defined in the graph. We also utilize explainable artificial intelligence tool Bayesian Inference to determine the coefficients in the power law equation that governs coarsening of precipitates. Overall, our work demonstrates the ability of the GNN to accurately and efficiently extract relevant information from material microstructures without having restrictions on microstructure size or dimension and offers an interpretable explanation.

Chemistry↗

Limitations of traditional tools for beyond design basis external hazard PRA

Probabilistic risk assessment (PRA) is being used increasingly by the nuclear industry for safety during normal operations as well as for the protection against external hazards. Computation of total risk in an external hazard PRA is dependent on hazard assessment, fragility assessment, and systems analysis. A systems analysis for propagation of component fragilities is conducted using event and fault trees. The event and fault trees for an actual power plant can be fairly large in size, which imposes computational challenges. Hence, certain assumptions are employed for computational efficiency. These assumptions typically represent the conditions imposed during the design basis (DB) scenario. The traditional PRA tools based on these assumptions are also widely applied to perform risk assessment in the context of beyond design basis (BDB) scenarios. However, some of these assumptions may not be valid for certain BDB scenarios. In addition, the probability of dependent failures also increases in BDB scenarios due to common cause failures (CCF) which usually results from design modifications, human errors, etc. In this manuscript, a simple and a relatively more complex illustrative examples are used to show the limitation of these assumptions in the numerical quantification of risk for the case of BDB conditions. Case studies with CCF events across multiple fault trees are also presented to illustrate the effect of these assumptions when traditional approach is used in BDB risk assessment. It is shown that the assumptions are valid for the case of DB conditions but may lead to excessively conservative risk estimates in the case of BDB conditions. Finally, a Bayesian network based top-down algorithm is proposed as an alternative tool for accurate numerical quantification of total risk in systems analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Integrated analysis and consistency measurement of bremsstrahlung and charge exchange spectroscopy data for the determination of the ion effective charge

In the context of Bayesian probability theory, we discuss a model for estimating the plasma ion effective charge Z{sub eff}, integrating data from both bremsstrahlung spectroscopy and individual impurity concentrations obtained via charge exchange spectroscopy (CXS). The validity of the model, taking into account statistical as well as systematic uncertainties, is shown via the deviance information criterion. The consistency of the continuum and CXS data regarding Z{sub eff} is improved, as measured by the symmetrized Kullback-Leibler divergence and the geodesic distance between the respective Z{sub eff} marginal posterior densities.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Summary report of the 4th IAEA Technical Meeting on Fusion Data Processing, Validation and Analysis (FDPVA)

The objective of the Fourth Technical Meeting on Fusion Data Processing, Validation and Analysis was to provide a platform during which a set of topics relevant to fusion data processing, validation and analysis are discussed with the view of extrapolating needs to next step fusion devices such as ITER. The validation and analysis of experimental data obtained from diagnostics used to characterize fusion plasmas are crucial for a knowledge-based understanding of the physical processes governing the dynamics of these plasmas. This paper presents the recent progress and achievements in the domain of plasma diagnostics and synthetic diagnostics data analysis (including image processing, regression analysis, inverse problems, deep learning, machine learning, big data and physics-based models for control) reported at the meeting. The progress in these areas highlight trends observed in current major fusion confinement devices. A special focus is dedicated on data analysis requirements for ITER and DEMO with a particular attention paid to artificial intelligence for automatization and improving reliability of control processes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Coupled Location/Depth/Yield Problem for North Korea’s Declared Nuclear Tests

On 3 September 2017, the Democratic People's Republic of Korea (DPRK) conducted its sixth and largest declared nuclear test at the Pung'gye Ri test site. Recently, we have been using regional waveform envelopes to estimate the explosive yield and overburden of chemical and nuclear explosions by coupling explosion source models to propagation parameters. Like most yield determination methods, there can be tradeoffs between yield and depth, leading to uncertainties in both parameters. The relative locations are well-constrained by small timing differences in seismic-phase arrivals at stations that recorded multiple events, but there are potential uncertainties on the absolute locations. Depths are poorly constrained by the relative arrival times. In this study, we have performed a coupled location and yield analysis of the DPRK nuclear tests. We use correlation methods to get highly accurate travel times and relative locations using a Bayesian location method. Then, while keeping the relative locations of the six tests constant, we consider the consequences of shifts to the absolute locations on the resulting overburden for each event. Given that overburden, we determine the yield that minimizes the waveform misfit. We also test and compare a number of explosion source models. By considering the coupled location/depth/yield problem, we reduce uncertainties in the absolute locations, and yield and depth estimates of the events. Based on statistical analysis, we estimate that the 2017 test has a yield of 125 kilotons (equivalent TNT) with a 1 sigma uncertainty range of 103-150 ktons at about 600 m of overburden.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Accelerated Gibbs Sampling for Infinite Sparse Factor Analysis

The Indian Buffet Process (IBP) gives a probabilistic model of sparse binary matrices with an unbounded number of columns. This construct can be used, for example, to model a fixed numer of observed data points (rows) associated with an unknown number of latent features (columns). Markov Chain Monte Carlo (MCMC) methods are often used for IBP inference, and in this technical note, we provide a detailed review of the derivations of collapsed and accelerated Gibbs samplers for the linear-Gaussian infinite latent feature model. We also discuss and explain update equations for hyperparameter resampling in a 'full Bayesian' treatment and present a novel slice sampler capable of extending the accelerated Gibbs sampler to the case of infinite sparse factor analysis by allowing the use of real-valued latent features.

97 MATHEMATICS AND COMPUTING↗

Improving Subsurface Stress Characterization for Carbon Dioxide Storage Projects by Incorporating Machine Learning Techniques

The overall objective of this project is to develop a framework for reliable characterization and prediction of the state of stress in the overburden and underburden (including the basement) in CO 2 storage reservoirs using machine learning and integrated geomechanics and geophysical methods. Specifically, we propose to develop workflow encompassing of technologies and/or methods to predict stress and pressure changes due to CO 2 injection in an active tertiary recovery site and their impacts on subtle fault activation, fractures and occurrence of microseismic events and compare responses to field observations. In this project, we anticipate using dataset from the Farnsworth field Unit (FWU) which is operated by Purdure Petroleum. A novel elastic-waveform VSP inversion technique will be used to estimate high-resolution spatial and temporal changes of elastic moduli in CO 2 storage reservoirs, which will be combined with velocity-stress relationship derived from laboratory tests to obtain subsurface pressure and stress. Clustered microseismic data will be jointly inverted for improved focal mechanisms. Least-squares reverse-time migration of microseismic waveform data will be performed to directly image fracture/fault zones. Additionally, a deep neural network machine learning technique with convolutional and recurrent layers will be used for learning the spectro-temporal structures in microseismic waveforms. The results of this geotechnical data analysis will be integrated to develop a high-resolution 3D mechanical earth model extending from the overburden sealing formations to the underburden including the basement. Mechanical properties will be derived through integration of mechanical logs, tests, available results from chemo-mechanical laboratory tests, and elastic inversion of seismic data using a combination of Bayesian and stochastic methods as well as machine learning technique. Failure features (faults/fractures) will be represented and/or modeled based on seismic and core data analysis. A transient hydrodynamic-geomechanical model will be developed through coupling with the calibrated FWU reservoir simulation model. The full physics coupled model will be used to train a reduced order proxy model using machine learning algorithm for estimating stress which will then be used with appropriate constitutive relationships and forward seismological models to simulate pressure changes and induced microseismicity. An advanced optimization framework will be developed to perform a history match to minimize error between field observations and simulated. The history matched proxy model will be verified against the full-physics equivalent. The field observations that will be used in the coupled model calibration process include pressure/stress inverted from VSP, moment magnitude from microseismic analysis, real time downhole pressure measurements, production and injection data. Parameter sensitivity and uncertainty analysis will be performed to characterize the impact of model parameter uncertainty on stress estimates. The proposed project will have significant impact on future field implementation of the proposed technology. Because the project field site is an ongoing CO 2 EOR development, the value of the new technology will be demonstrated in an operational context and evaluated as a viable risk mitigation strategy. Cost/benefit will be evaluated together with the various commercial incentives for CO 2 sequestration available to oil and gas operators. The extensive available dataset and ongoing data acquisition under the SWP Phase III work plan provides flexibility for investigation of multiple approaches and reduces technical risk.

58 GEOSCIENCES↗

Analysis of streaked images of x-ray self-emission in laser-driven spherical implosions

Imaging of x-ray self-emission provides a powerful in situ measurement of the spatial and temporal evolution of high-energy-density plasmas. However, interpretation of these measurements requires detailed understanding of the data-generating process. This work presents a case study in the interpretation of x-ray self-emission data for the specific application of streaked one-dimensional slit imaging of spherical laser-driven implosions. A comprehensive generative model of the streaked slit-imaging diagnostic is developed including detailed treatments of the radiation transfer, photometrics, and photostatistics associated with the measurement. The model is used to generate realistic synthetic streaked images and to analyze experimental streaked images to extract important physical quantities of interest. An example analysis of streaked images from implosion experiments on the OMEGA laser is presented, where the model developed in this work is used to constrain the trajectory and peak velocity of the implosion using Bayesian inference.

Bayesian inference↗

Sensitivity of an integrated experiment to uncertainty in the high explosive equations of state

Traditionally, hydrodynamics simulations are performed with a single equation-of-state (EOS) to describe each material. These EOSs typically have a physics-informed functional form with adjustable parameters that are calibrated in order to replicate small-scale data. However, because the calibration data have uncertainty and there are typically inherent degeneracies in fitting the EOS, there are actually multiple EOSs that might be consistent with calibration data. In this work, we perform uncertainty quantification (UQ) for the reactant and product equations of state for the high explosive PBX 9501 to yield an ensemble of EOSs that match the uncertain small-scale calibration data. We then simulate an experiment of an explosively formed penetrator repeatedly with different EOSs to both validate the UQ analysis and determine the effects of EOS uncertainty on the prediction of quantities of interest in the experiment. In general, we find good agreement between the simulation predictions and the experimental measurements, and we identify an EOS variable that contributes most directly to the spread in the predictions as the EOSs are varied.

36 MATERIALS SCIENCE↗

Differentially Private Synthesis and Sharing of Network Data Via Bayesian Exponential Random Graph Models

Abstract Network data often contain sensitive relational information. One approach to protecting sensitive information while offering flexibility for network analysis is to share synthesized networks based on the information in originally observed networks. We employ differential privacy (DP) and exponential random graph models (ERGMs) and propose the DP-ERGM method to synthesize network data. We apply DP-ERGM to two real-world networks. We then compare the utility of synthesized networks generated by DP-ERGM, the DyadWise Randomized Response (DWRR) approach, and the Synthesis through Conditional distribution of Edge given nodal Attribute (SCEA) approach. In general, the results suggest that DP-ERGM preserves the original information significantly better than two other approaches in network structural statistics and inference for ERGMs and latent space models. Furthermore, DP-ERGM satisfies node DP through modeling the global network structure with ERGM, a stronger notion of privacy than the edge DP under which DWRR and SCEA operate.

graph synthesis↗

Implementation of Dynamic Extensible Adaptive Locally Exchangeable Measures (IDEALEM) v 0.1

Handling large streaming data is essential for various applications such as network traffic analysis, social networks, energy cost trends, and environment modeling. However, it is in general intractable to store, compute, search, and retrieve large streaming data. This software addresses a fundamental issue, which is to reduce the size of large streaming data and still obtain accurate statistical analysis. As an example, when a high-speed network such as 100 Gbps network is monitored, the collected measurement data rapidly grows so that polynomial time algorithms (e.g., Gaussian processes) become intractable. One possible solution to reduce the storage of vast amounts of measured data is to store a random sample, such as one out of 1000 network packets. However, such static sampling methods (linear sampling) have drawbacks: (1) it is not scalable for high-rate streaming data, and (2) there is no guarantee of reflecting the underlying distribution. In this software, we implemented a dynamic sampling algorithm, based on the recent technology from the relational dynamic bayesian online locally exchangeable measures, that reduces the storage of data records in a large scale, and still provides accurate analysis of large streaming data. The software can be used for both online and offline data records.

Sim, Alex↗

ACCOUNTING FOR CALIBRATION UNCERTAINTIES IN X-RAY ANALYSIS: EFFECTIVE AREAS IN SPECTRAL FITTING

While considerable advance has been made to account for statistical uncertainties in astronomical analyses, systematic instrumental uncertainties have been generally ignored. This can be crucial to a proper interpretation of analysis results because instrumental calibration uncertainty is a form of systematic uncertainty. Ignoring it can underestimate error bars and introduce bias into the fitted values of model parameters. Accounting for such uncertainties currently requires extensive case-specific simulations if using existing analysis packages. Here, we present general statistical methods that incorporate calibration uncertainties into spectral analysis of high-energy data. We first present a method based on multiple imputation that can be applied with any fitting method, but is necessarily approximate. We then describe a more exact Bayesian approach that works in conjunction with a Markov chain Monte Carlo based fitting. We explore methods for improving computational efficiency, and in particular detail a method of summarizing calibration uncertainties with a principal component analysis of samples of plausible calibration files. This method is implemented using recently codified Chandra effective area uncertainties for low-resolution spectral analysis and is verified using both simulated and actual Chandra data. Our procedure for incorporating effective area uncertainty is easily generalized to other types of calibration uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Geomechanical risk assessment for subsurface fluid disposal operations

Numerical models are commonly used to estimate the state of stress in the subsurface for various engineering applications. These estimates are subject to considerable uncertainty, and yet, the estimates are almost always deterministic, yielding no information about the certainty of the prediction. For some applications, unquantified uncertainties in stress are often acceptable, because the risks related to geomechanics may be of low relative importance compared to other risks (e.g. recoverable resource volume), for which uncertainties are often quantified. Furthermore, many geomechanics-related risks in the petroleum industry are relatively short lived (e.g. well bore stability), and decrease in importance with time. In contrast, for waste water injection or geologic carbon sequestration (GCS), geomechanics-related risks (e.g. seal integrity, induced seismicity) are on par with resource-related risks and are of long-term concern, with the risk generally increasing in importance for a significant period of time. For these reasons, the deterministic stress estimation and risk analysis approaches generally applied in the petroleum industry are insufficient for GCS applications. This paper describes a Bayesian approach to geomechanical uncertainty quantification and risk assessment. The method is demonstrated using data from an active enhanced oil recover/geologic carbon sequestration field as a case study

Burghardt, Jeffrey A.↗

Scaling cosmology with variable dark-energy equation of state

Interactions between dark matter and dark energy which result in a power-law behavior (with respect to the cosmic scale factor) of the ratio between the energy densities of the dark components (thus generalizing the ΛCDM model) have been considered as an attempt to alleviate the cosmic coincidence problem phenomenologically. We generalize this approach by allowing for a variable equation of state for the dark energy within the CPL-parametrization. Based on analytic solutions for the Hubble rate and using the Constitution and Union2 SNIa sets, we present a statistical analysis and classify different interacting and non-interacting models according to the Akaike (AIC) and the Bayesian (BIC) information criteria. We do not find noticeable evidence for an alleviation of the coincidence problem with the mentioned type of interaction.

79 ASTRONOMY AND ASTROPHYSICS↗

Searching for systematics in SNIa and galaxy cluster data using the cosmic duality relation

We compare two different probes of the expansion history of the universe, namely, luminosity distances from type Ia supernovae and angular diameter distances from galaxy clusters, using the Bayesian interpretation of Crossing statistic [1,2] in conjunction with the assumption of cosmic duality relation. Our analysis is conducted independently of any a-priori assumptions about the nature of dark energy. The model independent method which we invoke searches for inconsistencies between SNIa and galaxy cluster data sets. If detected such an inconsistency would imply the presence of systematics in either of the two data sets. Simulating observations based on expected WFIRST supernovae data and X-ray eROSITA + SZ Planck cluster data, we show that our method allows one to detect systematics with high precision and without advancing any hypothesis about the nature of dark energy.

79 ASTRONOMY AND ASTROPHYSICS↗

The evolution of the Milky Way’s thin disc radial metallicity gradient with K2 asteroseismic ages

ABSTRACT The radial metallicity distribution of the Milky Way’s disc is an important observational constraint for models of the formation and evolution of our Galaxy. It informs our understanding of the chemical enrichment of the Galactic disc and the dynamical processes therein, particularly radial migration. We investigate how the metallicity changes with guiding radius in the thin disc using a sample of red giant stars with robust astrometric, spectroscopic, and asteroseismic parameters. Our sample contains 668 stars with guiding radii 4 < Rg < 11 kpc and asteroseismic ages covering the whole history of the thin disc with precision ${\approx} 25 {{\, \rm per\ cent}}$. We use MCMC analysis to measure the gradient and its intrinsic spread in bins of age and construct a hierarchical Bayesian model to investigate the evolution of these parameters independently of the bins. We find a smooth evolution of the gradient from ≈−0.07 dex kpc−1 in the youngest stars to ≈−0.04 dex kpc−1 in stars older than 10 Gyr, with no break at intermediate ages. Our results are consistent with those based on asteroseismic ages from CoRoT, with that found in Cepheid variables for stars younger than 1 Gyr, and with open clusters for stars younger than 6 Gyr. For older stars we find a significantly lower metallicity in our sample than in the clusters, suggesting a survival bias favouring more metal-rich clusters. We also find that the chemical evolution model of Chiappini '09 is too metal poor in the early stages of disc formation. Our results provide strong new constraints for the growth and enrichment of the thin disc and radial migration, which will facilitate new tests of model conditions and physics.

79 ASTRONOMY AND ASTROPHYSICS↗