Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Manifold learning for coarse-graining atomistic simulations: Application to amorphous solids

In this work, we introduce a generalized machine learning framework to probabilistically parameterize upper-scale models in the form of nonlinear PDEs consistent with a continuum theory, based on coarse-grained atomistic simulation data of mechanical deformation and flow processes. The proposed framework utilizes a hypothesized coarse-graining methodology with manifold learning and surrogate-based optimization techniques. Coarse-grained high-dimensional data describing quantities of interest of the multiscale models are projected onto a nonlinear manifold whose geometric and topological structure is exploited for measuring behavioral discrepancies in the form of manifold distances. A surrogate model is constructed using Gaussian process regression to identify a mapping between stochastic parameters and distances. Derivative-free optimization is employed to adaptively identify a unique set of parameters of the upper-scale model capable of rapidly reproducing the system's behavior while maintaining consistency with coarse-grained atomic-level simulations. The proposed method is applied to learn the parameters of the shear transformation zone (STZ) theory of plasticity that describes plastic deformation in amorphous solids as well as coarse-graining parameters needed to translate between atomistic and continuum representations. We show that the methodology is able to successfully link coarse-grained microscale simulations to macroscale observables and achieve a high-level of parity between the models across scales.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Bayesian Estimation of the D(p,γ) 3 He Thermonuclear Reaction Rate

Big bang nucleosynthesis (BBN) is the standard model theory for the production of the light nuclides during the early stages of the universe, taking place for a period of about 20 minutes after the big bang. Deuterium production, in particular, is highly sensitive to the primordial baryon density and the number of neutrino species, and its abundance serves as a sensitive test for the conditions in the early universe. The comparison of observed deuterium abundances with predicted ones requires reliable knowledge of the relevant thermonuclear reaction rates, and their corresponding uncertainties. Recent observations reported the primordial deuterium abundance with percent accuracy, but some theoretical predictions based on BBN are at tension with the measured values because of uncertainties in the cross section of the deuterium-burning reactions. In this work, we analyze the S-factor of the D(p,γ) 3 He reaction using a hierarchical Bayesian model. We take into account the results of eleven experiments, spanning the period of 1955--2021; more than any other study. We also present results for two different fitting functions, a two-parameter function based on microscopic nuclear theory and a four-parameter polynomial. Furthermore, our recommended reaction rates have a 2.2\% uncertainty at 0.8~GK, which is the temperature most important for deuterium BBN. Differences between our rates and previous results are discussed.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Multi-Trait Regressor Stacking Increased Genomic Prediction Accuracy of Sorghum Grain Composition

Genomic prediction has enabled plant breeders to estimate breeding values of unobserved genotypes and environments. The use of genomic prediction will be extremely valuable for compositional traits for which phenotyping is labor-intensive and destructive for most accurate results. We studied the potential of Bayesian multi-output regressor stacking (BMORS) model in improving prediction performance over single trait single environment (STSE) models using a grain sorghum diversity panel (GSDP) and a biparental recombinant inbred lines (RILs) population. A total of five highly correlated grain composition traits—amylose, fat, gross energy, protein and starch, with genomic heritability ranging from 0.24 to 0.59 in the GSDP and 0.69 to 0.83 in the RILs were studied. Average prediction accuracies from the STSE model were within a range of 0.4 to 0.6 for all traits across both populations except amylose (0.25) in the GSDP. Prediction accuracy for BMORS increased by 41% and 32% on average over STSE in the GSDP and RILs, respectively. Prediction of whole environments by training with remaining environments in BMORS resulted in moderate to high prediction accuracy. Our results show regression stacking methods such as BMORS have potential to accurately predict unobserved individuals and environments, and implementation of such models can accelerate genetic gain.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A compact x-ray spectrometer for measurements of electron temperature distributions in inertial confinement fusion implosions at OMEGA

The Wedge Range Filter (WRF), commonly used for proton spectroscopy at the OMEGA Laser Facility and National Ignition Facility, is adapted to measure the x-ray continuum spectrum through transmission measurement using a continuous-gradient filter. Continuum x rays emitted from the hotspot of an implosion contain information about the plasma composition and electron temperature. The WRF data are leveraged to probe this distribution, specifically the electron temperature distribution. In this work, the data recorded with the WRF are forward modeled using a temperature distribution model folded with the WRF response function. An uncertainty analysis is conducted through a Bayesian regression algorithm using a Hamiltonian Monte Carlo sampler. This analysis enables the uncertainties in the instrument response to be folded into the uncertainty estimation of the electron temperature and absolute x-ray emission. Data analysis for a series of OMEGA implosions is presented and compared with radiation hydrodynamic simulations.

Lasers↗
NASA NTRS2021

KMT-2021-BLG-0322: Severe Degeneracy Between Triple-lens and Higher-order Binary-lens Interpretations

We investigate the microlensing event KMT-2021-BLG-0322, for which the light curve exhibits three distinctive sets of caustic-crossing features. It is found that the overall features of the light curve are approximately described by a binary-lens (2L1S) model, but the model leaves substantial residuals. We test various interpretations with the aim of explaining the residuals. Methods. We find that the residuals can be explained either by considering a nonrectilinear lens-source motion caused by the microlens-parallax and lens-orbital effects or by adding a low-mass companion to the binary lens (3L1S model). The degeneracy between the higher-order 2L1S model and the 3L1S model is very severe, making it difficult to single out a correct solution based on the photometric data. This degeneracy was known before for two previous events (MACHO-97-BLG-41 and OGLE-2013-BLG-0723),which led to the false detections of planets in binary systems, and thus the identification of the degeneracy for KMT-2021-BLG-0322illustrates that the degeneracy can be not only common but also very severe, emphasizing the need to check both interpretations of deviations from 2L1S models. Results. From the Bayesian analysis conducted with the measured lensing observables of the event timescale, angular Einstein radius, and microlens parallax, it was estimated that the binary lens components have masses(M1,M2)=(0.62+0.25−0.26M,0.07+0.03−0.03M), for both2L1S and 3L1S solutions, and the mass of the tertiary lens component according to the 3L1S solution isM3=6.40+2.64−2.78MJ.

Gravitational lensing: micro↗
NASA NTRS2014

Statistical Symbolic Execution with Informed Sampling

Symbolic execution techniques have been proposed recently for the probabilistic analysis of programs. These techniques seek to quantify the likelihood of reaching program events of interest, e.g., assert violations. They have many promising applications but have scalability issues due to high computational demand. To address this challenge, we propose a statistical symbolic execution technique that performs Monte Carlo sampling of the symbolic program paths and uses the obtained information for Bayesian estimation and hypothesis testing with respect to the probability of reaching the target events. To speed up the convergence of the statistical analysis, we propose Informed Sampling, an iterative symbolic execution that first explores the paths that have high statistical significance, prunes them from the state space and guides the execution towards less likely paths. The technique combines Bayesian estimation with a partial exact analysis for the pruned paths leading to provably improved convergence of the statistical analysis. We have implemented statistical symbolic execution with in- formed sampling in the Symbolic PathFinder tool. We show experimentally that the informed sampling obtains more precise results and converges faster than a purely statistical analysis and may also be more efficient than an exact symbolic analysis. When the latter does not terminate symbolic execution with informed sampling can give meaningful results under the same time and memory limits.

Reliability↗
DOE OSTI2020

Modeling Stochastic Variability in Multiband Time-series Data

In preparation for the era of time-domain astronomy with upcoming large-scale surveys, we propose a state-space representation of a multivariate damped random walk process as a tool to analyze irregularly-spaced multifilter light curves with heteroscedastic measurement errors. We adopt a computationally efficient and scalable Kalman filtering approach to evaluate the likelihood function, leading to maximum O(k 3 n) complexity, where k is the number of available bands and n is the number of unique observation times across the k bands. This is a significant computational advantage over a commonly used univariate Gaussian process that can stack up all multiband light curves in one vector with maximum O(k 3 n 3 ) complexity. Using such efficient likelihood computation, we provide both maximum likelihood estimates and Bayesian posterior samples of the model parameters. Three numerical illustrations are presented: (i) analyzing simulated five-band light curves for a comparison with independent single-band fits; (ii) analyzing five-band light curves of a quasar obtained from the Sloan Digital Sky Survey Stripe 82 to estimate short-term variability and timescale; (iii) analyzing gravitationally lensed g- and r-band light curves of Q0957+561 to infer the time delay. Two R packages, Rdrw and timedelay, are publicly available to fit the proposed models.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2012

Safety Risk Knowledge Elicitation in Support of Aeronautical R and D Portfolio Management: A Case Study

Aviation is a problem domain characterized by a high level of system complexity and uncertainty. Safety risk analysis in such a domain is especially challenging given the multitude of operations and diverse stakeholders. The Federal Aviation Administration (FAA) projects that by 2025 air traffic will increase by more than 50 percent with 1.1 billion passengers a year and more than 85,000 flights every 24 hours contributing to further delays and congestion in the sky (Circelli, 2011). This increased system complexity necessitates the application of structured safety risk analysis methods to understand and eliminate where possible, reduce, and/or mitigate risk factors. The use of expert judgments for probabilistic safety analysis in such a complex domain is necessary especially when evaluating the projected impact of future technologies, capabilities, and procedures for which current operational data may be scarce. Management of an R&D product portfolio in such a dynamic domain needs a systematic process to elicit these expert judgments, process modeling results, perform sensitivity analyses, and efficiently communicate the modeling results to decision makers. In this paper a case study focusing on the application of an R&D portfolio of aeronautical products intended to mitigate aircraft Loss of Control (LOC) accidents is presented. In particular, the knowledge elicitation process with three subject matter experts who contributed to the safety risk model is emphasized. The application and refinement of a verbal-numerical scale for conditional probability elicitation in a Bayesian Belief Network (BBN) is discussed. The preliminary findings from this initial step of a three-part elicitation are important to project management practitioners as they illustrate the vital contribution of systematic knowledge elicitation in complex domains.

Shih, Ann T.↗
DOE OSTI2020

Mesoscopic structure of mixed type domain walls in multiaxial ferroelectrics

The structure of a 180° uncharged rotational domain wall in a multiaxial ferroelectric film is studied in the framework of an analytical Landau-Ginzburg-Devonshire (LGD) approach. Finite element modeling (FEM) is used to solve numerically the system of the coupled nonlinear Euler-Lagrange (EL) second-order differential equations for two components of polarization. We show that the structure of the domain wall and corresponding metastable or stable phase of the film are controlled by a single parameter—the dimensionless ferroelectric anisotropy factor μ. We fitted the static profile of a solitary domain wall, calculated by FEM, with kinklike functions for polarization components, and extracted the five μ-dependent parameters from the fitting to FEM curves. The surprisingly high accuracy of the fitting results for two polarization components in the entire μ range allows us to conclude that the analytical functions, which are trial functions in the direct variational method, can be treated as a high-accuracy variational solution of the static EL equations. We further derive exact two-component analytical solutions of the static EL equations for a polydomain 180° domain structure in a multiaxial ferroelectric film. Using these, we derive analytical expressions for the system free energy and analyze its dependence on the film thickness and boundary conditions at the film surfaces. The single-domain state is ground for zero polarization derivative at the surfaces, while the polydomain states minimize the system energy for zero polarization at the surfaces. Counterintuitively, the energy of the polydomain states split into two levels, “0” and “1,” for zero polarization at the surfaces, and each of the levels contains a large number of close-energy sublevels, whose structure is characterized by a different number and type of domain walls. The analytical solutions can become a useful tool for Bayesian analysis of high-resolution scanning transmission electron microscopy images in ferroelectric films.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Multi-head physics-informed neural networks for learning functional priors and uncertainty quantification

In numerous applications, the integration of prior knowledge and historical information is essential, particularly for tasks requiring the solution of ordinary or partial differential equations (ODEs/PDEs) in data-sparse or noisy environments. For instance, achieving accurate solutions to time-dependent PDEs with limited initial condition measurements necessitates an effective strategy for embedding prior knowledge. Hard-parameter sharing architectures in neural networks (NNs) have demonstrated success in both traditional and scientific machine learning domains, facilitating the learning of informative representations. Here, in this study, we introduce a novel, yet efficient, method to enhance physics-informed neural networks (PINNs) by incorporating a multi-head structure that enables the learning of functional priors from both empirical data and governing physical laws. This prior information can then be used to address data sparsity and high-level noise in solving ODE/PDE problems with uncertainty quantification (UQ). The approach, termed Multi-Head PINN (MH-PINN), consists of a shared body NN and multiple head NNs, each corresponding to an individual PINN instance. Our framework for functional prior learning is carried out in two stages: (1) training the MH-PINNs to develop a shared body NN alongside multiple head NNs, and (2) employing these trained head NNs to estimate a prior distribution through a normalizing flow-based density estimator. The learned functional prior can then be applied as a regularization mechanism in deterministic contexts or as an informative prior within a Bayesian inference framework, aiding in the resolution of subsequent ODE/PDE tasks. We evaluate the efficacy of MH-PINNs across five benchmark problems, including a high-dimensional parametric PDE, all characterized by data sparsity or substantial noise levels. Our findings reveal that MH-PINNs deliver accurate solutions and robust UQ, demonstrating adaptability across a range of complex and challenging scenarios.

Bayesian inference↗
DOE OSTI2023

Hawai‘i Play Fairway (Final Report)

Most of Hawai'i's geothermal resources are blind—their manifestations, such as hot springs and steam vents, do not appear on the ground surface because the heated water flows far below. With the exception of $K\bar{i}lauea East Rift Zone$, in most areas of Hawai'i, high lateral permeability in the first kilometer below ground surface prevents surface thermal features from developing. As a methodology for discovering these blind resources, Play Fairway Analysis (PFA) involves finding potential locations of blind hydrothermal systems and describing potential geothermal sources in rift-zone settings. Using the PFA to find Hawai'i's geothermal resources, the University of Hawai'i (UH) conducted the Hawai‘i Play Fairway Project, Hawai'i's first statewide geothermal resource assessment since 1985. Sponsored by the U.S. Department of Energy, the Hawai'i Play Fairway Project provided an updated resource assessment, a roadmap for additional exploration activities, and the identification of areas for further exploration. Benefitting from UH's core competency in earth sciences and experienced geothermal researchers, the project comprised three phases. During the first phase, the team identified, compiled, and ranked existing geologic, groundwater, and geophysical datasets relevant to subsurface heat, fluid and permeability. Using a Bayesian statistical approach, the team developed a statistical methodology to integrate these data into a resource probability map. The team evaluated the confidence in the probability value and considered development viability of areas with geothermal resources. With these analyses, the team identified 10 locations in the Hawaiian Islands for exploration activities. For the second phase, the team collected new groundwater data in 10 locations across the state and new geophysical data on $L\bar{a}na‘i, Maui$, and central Hawai'i Island and modeled topographically induced stress to better characterize subsurface permeability. Analyzing the subsurface stresses, the team evaluated the potential for fracture-induced permeability. The team inverted the MT and gravity data to produce 3D models of resistivity and density, respectively, on $L\bar{a}na‘i$, across $Haleakal\bar{a}'s$ SW rift (Maui), and surrounding Mauna Kea (Hawai‘i Island). The team developed and applied a new method for incorporating depth information about resistivity, density, and potential for fracture-induced permeability into the statistical method for computing resource probability in these three focus areas. The team incorporated the new groundwater results with the new geophysical results and the calculations of potential for fracture-induced permeability to produce updated maps of resource probability and confidence. Through combining data from the first and second phases, the team determined locations for further exploration during the third phase. For MT and gravity surveys, the team recommended $Kaua'i's$ $L\bar{i}hu'e$ $Basin$, the east rift of $Maui's$ $Haleakal\bar{a}$ volcano, and the southwest rift of Hawai'i Island's Mauna Loa volcano. The MT and gravity surveys aimed to enable improved confidence in the resource potential in these locations. For drilling deep groundwater well(s), the team recommended Southeast Mauna Kea and $L\bar{a}na's$ $P\bar{a}l\bar{a}wai$ $Basin$. During the third phase, further exploration involved drilling a groundwater well in $L\bar{a}na's$ $P\bar{a}l\bar{a}wai$ $Basin$ and performing more geophysical surveys. We deepened an existing water well proximal to our target area on $L\bar{a}na'i$ due to funding constraints that precluded us from spudding a new well that would exceed 1km depth. Drilling was preceded by a number of substantial elements including: writing an Environmental Assessment and the subsequent legal process, performance of deviation logging, lowering a camera down the well, coordinating site preparation with $P\bar{u}lama$ $L\bar{a}na'i$, shipping the UH-owned rig interisland, procuring supplies, and leading 3 community meetings on $L\bar{a}na'i$. Drilling occurred 24/7 the entire month of June 2019 over which time $L\bar{a}na'i$ $Well$ 10 was deepened from 427 m to 1057 m, with continuous core collected. We measured a roughly linear temperature gradient averaging 42°C/km and a maximum bottom hole temperature of 66°C. This gradient is more than twice the background for Hawai'i and within a range of gradients measured in this depth range for some exploration wells within KERZ. We consider these results encouraging for $L\bar{a}na'i's$ resource potential and recommend following with a slim hole within $L\bar{a}na'i's$ caldera (our target zone) to ~ 2 km. Further, the positive implications such results have for the island of O‘ahu are substantial - the shield stage of O'ahu's volcanoes ended 1-2 My earlier. However, O'ahu uses more electricity than the rest of the islands combined, and the utility recently called for 500-700MW of firm, dispatchable renewable electricity on O'ahu by 2033. In Phase 3, we also collected limited new encouraging groundwater data, and updated our thoughts on the probabilities of fluid and permeability at resource depths (Pr F = 1; Pr P = mostly unconstrained). Ultimately, we advocate for using our final probability of heat, and confidence in this probability, to drive the next phase of exploration. We contend further development of geothermal in Hawai‘i will enable the state to achieve its 100% renewable policy objective and Hawai'i to transition off of fossil fuels through geothermal discovery and development. The project not only produced a large amount of data and expanded the existing knowledge of Hawai'i's geothermal resources, but also produced publications, theses, presentations, core photos, datasets, media reports, television interviews, community events, and a blog. Students and new professionals benefitted from the project's hands-on research experiences and educational opportunities and earned awards and recognition.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Deep kernel methods learn better: from cards to process optimization

Abstract The ability of deep learning methods to perform classification and regression tasks relies heavily on their capacity to uncover manifolds in high-dimensional data spaces and project them into low-dimensional representation spaces. In this study, we investigate the structure and character of the manifolds generated by classical variational autoencoder (VAE) approaches and deep kernel learning (DKL). In the former case, the structure of the latent space is determined by the properties of the input data alone, while in the latter, the latent manifold forms as a result of an active learning process that balances the data distribution and target functionalities. We show that DKL with active learning can produce a more compact and smooth latent space which is more conducive to optimization compared to previously reported methods, such as the VAE. We demonstrate this behavior using a simple cards dataset and extend it to the optimization of domain-generated trajectories in physical systems. Our findings suggest that latent manifolds constructed through active learning have a more beneficial structure for optimization problems, especially in feature-rich target-poor scenarios that are common in domain sciences, such as materials synthesis, energy storage, and molecular discovery. The Jupyter Notebooks that encapsulate the complete analysis accompany the article.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Bayesian model averaging for analysis of lattice field theory results

Statistical modeling is a key component in the extraction of physical results from lattice field theory calculations. Although the general models used are often strongly motivated by physics, many model variations can frequently be considered for the same lattice data. Model averaging, which amounts to a probability-weighted average over all model variations, can incorporate systematic errors associated with model choice without being overly conservative. We discuss the framework of model averaging from the perspective of Bayesian statistics, and give useful formulae and approximations for the particular case of least-squares fitting, commonly used in modeling lattice results. In addition, we frame the common problem of data subset selection (e.g. choice of minimum and maximum time separation for fitting a two-point correlation function) as a model selection problem and study model averaging as a straightforward alternative to manual selection of fit ranges. Numerical examples involving both mock and real lattice data are given.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2019

Using Gaia Data 2 to Constrain Local Dark Matter Density and Thin Dark Disk

We use stellar kinematics from the latest Gaia data release (DR2) to measure the local dark matter (DM) density ρDM in a heliocentric cylinder of radius R = 150 pc and half-height z = 200 pc. We also explore the prospect of using our analysis to estimate the DM density in local substructure by setting constraints on the surface density and scale height of a thin dark disk aligned with the baryonic disk and formed due to dissipative dark matter self-interactions. Performing the statistical analysis within a Bayesian framework for three types of tracers, we obtain ρDM = 0.016 ± 0.010 Mꙩ/p c 3 for A stars; early G stars give a similar result, while F stars yield a significantly higher value. For a thin dark disk, A stars set the strongest constraint: excluding surface densities (5–12) Mꙩ/pc 2 for scale heights below 100 pc with 95% confidence. The upper bound of this constraint implies . 1% of the Milky Way DM mass is present in a dissipative dark sector. Comparing our results with those derived using Tycho-Gaia Astrometric Solution (TGAS) data, we find that the uncertainty in our measurements of the local DM content is dominated by systematic errors that arise from assumptions of our dynamical analysis in the low z region. Furthermore, there will only be a marginal reduction in these uncertainties with more data in the Gaia era. We comment on the robustness of our method and discuss potential improvements for future work.

dark matter theory↗
DOE OSTI2025

Robustness of Deep Learning Classification to Adversarial Input on GPUs: Asynchronous Parallel Accumulation Is a Source of Vulnerability

The ability of machine learning (ML) classification models to resist small, targeted input perturbations—known as adversarial attacks—is a key measure of their safety and reliability. We show that floating-point non associativity (FPNA) coupled with asynchronous parallel programming on GPUs is sufficient to result in misclassification, without any perturbation to the input. Additionally, we show that this misclassification is particularly significant for inputs close to the decision boundary and that standard adversarial robustness results may be overestimated up to 4.6 when not considering machine-level details. We first study a linear classifier, before focusing on standard Graph Neural Network (GNN) architectures and datasets used in robustness assessments. We develop a novel black-box attack using Bayesian optimization to discover external workloads that can change the instruction scheduling which bias the output of reductions on GPUs and reliably lead to misclassification. Motivated by these results, we present a new learnable permutation (LP) gradient-based approach to learning floating-point operation orderings that lead to misclassifications. The LP approach provides a worst-case estimate in a computationally efficient manner, avoiding the need to run identical experiments tens of thousands of times over a potentially large set of possible GPU states or architectures. Finally, using instrumentation-based testing, we investigate parallel reduction ordering across different GPU architectures under external background workloads, when utilizing multi-GPU virtualization, and when applying power capping. Our results demonstrate that parallel reduction ordering varies significantly across architectures under the first two conditions, substantially increasing the search space required to fully test the effects of this parallel scheduler-based vulnerability. These results and the methods developed here can help to include machine-level considerations into adversarial robustness assessments, which can make a difference in safety and mission critical applications.

Shanmugavelu, Sanjif [Maxeler Technologies, a Groq↗
DOE OSTI2021

Probabilistic Evaluation of Geoscientific Hypotheses with Geophysical Data: Application to Electrical Resistivity Imaging of a Fractured Bedrock Zone

As climate changes and populations grow, groundwater sustainability is becoming increasingly important. Groundwater models, based on a conceptual understanding of the subsurface structure, are crucial tools for making sustainable management decisions. Conceptual models of the subsurface are based on knowledge of geological processes, and, frequently, observations from geophysical data. A frequent problem in groundwater model development occurs when multiple geological phenomena could explain a single subsurface observation. Uncertainty in geophysical data makes it even more difficult to discern which explanations are consistent with the geophysics. Here, we present a framework for testing geological when a geological feature is observed in geophysical data, but its physical characteristics are uncertain. The framework builds on Popper-Bayes methods developed in previous work, and is applied to study a fractured bedrock zone in a mountainous watershed in southwest Colorado. First, we outline six hypotheses based on the geological history of the watershed. Then, using the proposed Popper-Bayes approach, we demonstrate that three of the six hypotheses are inconsistent with measured electrical resistivity data, even after accounting for uncertainty. Finally, we discuss the importance of the prior model, and how this framework for handling geophysical uncertainty can be applied in other settings.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Efficient Subset Simulation using Hamiltonian Neural Network enhanced Markov Chain Monte Carlo Methods

The Monte Carlo method delivers an unbiased estimate of the probability of failure. However, the variance of the estimate depends on the number of evaluated samples. This number must be very large for estimations of a low probability of failure. If the evaluation of each sample is computationally expensive, the crude Monte Carlo simulation strategy is impracticable. Therefore, subset simulations are used to reduce the required number of evaluations. Subset simulations require a Markov Chain Monte Carlo sampler, such as the random walk Metropolis-Hastings algorithm. The algorithm, however, struggles with sampling in low-probability regions, especially if they are narrow. As a consequence, advanced Markov Chain Monte Carlo simulations have been developed. In particular, the Hamiltonian Monte Carlo method explores the target distribution rapidly. Driven by the idea of Hamiltonian dynamics, this sampler provides a non-random walk through the target distribution. The incorporation of subset simulation and Hamiltonian Monte Carlo methods has shown promising results for reliability analysis. One downside of the Hamiltonian Monte Carlo method is that gradient evaluations are computationally expensive, especially when dealing with high-dimensional problems and evaluating long trajectories. We show that integrating Hamiltonian neural networks in Hamiltonian Monte Carlo simulations significantly speeds up the sampling task. Furthermore, the enhancement of adaptive trajectory length within the Hamiltonian Monte Carlo results in the efficient proposal of the following states. Based on this recent enhancement, we provide a fast sampling strategy for subset simulations using Hamiltonian neural networks to replace the evaluation of the gradient and significantly speed up the Hamiltonian Monte Carlo simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

CONCURRENT, CONDENSED STEIN VARIATIONAL GRADIENT DESCENT FOR UNCERTAINTY QUANTIFICATION OF NEURAL NETWORKS

In this work, we propose a Stein variational gradient descent (SVGD) method to concurrently sparsify, train, and provide uncertainty quantification (UQ) of a complexly parameterized model, such as a neural network (NN). It employs a graph reconciliation and condensation process to reduce complexity and increase similarity in the Stein ensemble of parameterizations. Therefore, the proposed concurrent, condensed SVGD (ccSVGD) method can provide UQ on parameters, not just outputs. Furthermore, the parameter reduction speeds up the convergence of the Stein gradient descent as it reduces the combinatorial complexity by aligning and differentiating the sensitivity to parameters. These properties are demonstrated with an illustrative example and an application to a mechanical response representation problem in solid mechanics.

42 ENGINEERING↗