Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Application of Sequential Design of Experiments (SDoE) to Large Pilot-Scale Solvent-Based CO2 Capture Process at Technology Centre Mongstad (TCM)

The United States Department of Energy’s Carbon Capture Simulation for Industry Impact (CCSI2) program has developed a framework for sequential design of experiments (SDoE) that aims to maximize knowledge gained from budget- and schedule-limited pilot scale testing. SDoE was applied to the planning and execution of campaigns for testing CO2 capture systems at pilot-scale in order to optimally allocate resources available for the testing. In this methodology, a stochastic process model is developed by quantifying the parametric uncertainty in submodels of interest; for a solvent-based CO2 capture system, these may include physical properties and equipment performance submodels (e.g., mass transfer, interfacial area). This uncertainty is propagated through the full process model, over variable operating conditions, for estimating the resulting uncertainty in key model outputs (e.g., percentage of CO2 capture, solvent regeneration energy requirement). In developing a data collection plan, the predicted output uncertainty is incorporated into an algorithm that seeks simultaneously to select process operating conditions for which the predicted uncertainty is relatively high and to ensure that the entire space of operation is well represented. This test plan is then used to guide operation of the pilot plant at varying steady-state conditions, with resulting process data incorporated into the existing model using Bayesian inference to refine parameter distributions. The updated stochastic model, with reduced parametric uncertainty from data collected, is then used to guide additional data collection, thus the sequential nature of the experimental design. The SDoE process was implemented at the pilot test unit (12 MWe in scale) at Norway’s Technology Centre Mongstad (TCM) in a summer 2018 test campaign with aqueous monoethanolamine (MEA). During the test campaign, the varied operating conditions included the flowrates of circulated solvent, flue gas, and reboiler steam and the CO2 concentration in the flue gas. The process data were used to update probability distributions of mass transfer and interfacial area parameters of a stochastic process model developed by the CCSI2 team. Two iterations of the SDoE process were executed, resulting in the uncertainty in model predicted CO2 capture percentage decreasing by an average of 58.0 ± 4.7% over the full input space of interest. This work demonstrates the potential of the SDoE process for model refinement through reduction in process model parametric uncertainty, and ultimately risk in scale-up, in CO2 capture technology performance.

carbon capture↗
DOE OSTI2023

Adaptive mitigation of time-varying quantum noise

Current quantum computers suffer from non-stationary noise channels with high error rates, which undermines their reliability and reproducibility. We propose a Bayesian inference based adaptive algorithm that can learn and mitigate quantum noise in response to changing channel conditions. Our study emphasizes the need for dynamic inference of critical channel parameters to improve program accuracy. We use the Dirichlet distribution to model the stochasticity of the Pauli channel. This allows us to perform Bayesian inference, which can improve the performance of probabilistic error cancellation (PEC) under time-varying noise. Our work demonstrates the importance of characterizing and mitigating temporal variations in quantum noise, which is crucial for developing more accurate and reliable quantum technologies. Our results demonstrate that Bayesian PEC can outperform non-adaptive approaches by a factor of 4.5x when measured using Hellinger distance from the ideal distribution.

Dasgupta, Samudra↗
DOE OSTI2023

BISON Fuel Fragmentation Relocation and Dispersal (FFRD) Assessment Database for Eventual Use in Bayesian Calibration

Existing light-water reactor (LWR) fuel vendors have been interested in seeking increased discharge burnups of nuclear fuel rods for improved economics for quite a few years. With increased burnups come additional challenges that must be addressed. It has been experimentally observed that average burnups higher than the current regulatory limit of 62 MWd/kgU may undergo fuel fragmentation, relocation, and dispersal (FFRD) during a loss-of-coolant accident (LOCA). Industry must demonstrate approaches to mitigate FFRD. In an effort to support industry, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program within the U.S. Department of Energy (DOE) has for several years invested in developing multiscale models and creating a validation/assessment database for these models to study the mechanisms driving FFRD. This report provides an update on changes made to the assessment database and new models added to BISON to support the study of fuel rod behavior during FFRD. An effort has been initiated this year to begin adding dedicated inputs to the publicly available Virtual Test Bed (VTB) repository for industry use. A section of this report details the efforts made in this area. NEAMS has recently developed new capabilities in the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework’s stochastic tools module for calibration using Bayesian inference. The goal in the future is to use these capabilities to calibrate and identify weaknesses in the existing BISON models for FFRD. The report concludes with a discussion on the models most likely to benefit the most from such calibration.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Optimal experimental design for prediction based on push-forward probability measures

Incorporating experimental data is essential for increasing the credibility of simulation-aided decision making and design. This paper presents a method which uses a computational model to guide the optimal acquisition of experimental data to produce data-informed predictions of quantities of interest (QoI). Many strategies for optimal experimental design (OED) select data that maximize some utility that measures the reduction in uncertainty of uncertain model parameters, for example the expected information gain between prior and posterior distributions of these parameters. In this paper, we seek to maximize the expected information gained from the pushforward of an initial (prior) density to the push-forward of the updated (posterior) density through the parameter-to-prediction map. The formulation presented is based upon the solution of a specific class of stochastic inverse problems which seeks a probability density that is consistent with the model and the data in the sense that the push-forward of this density through the parameter-to-observable map matches a target density on the observable data. While this stochastic inverse problem forms the mathematical basis for our approach, we develop a one-step algorithm, focused on push-forward probability measures, that leverages inference-for-prediction to bypass constructing the solution to the stochastic inverse problem. A number of numerical results are presented to demonstrate the utility of this optimal experimental design for prediction and facilitate comparison of our approach with traditional OED.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Decomposing causality into its synergistic, unique, and redundant components

Causality lies at the heart of scientific inquiry, serving as the fundamental basis for understanding interactions among variables in physical systems. Despite its central role, current methods for causal inference face significant challenges due to nonlinear dependencies, stochastic interactions, self-causation, collider effects, and influences from exogenous factors, among others. While existing methods can effectively address some of these challenges, no single approach has successfully integrated all these aspects. Here, we address these challenges with SURD: Synergistic-Unique-Redundant Decomposition of causality. SURD quantifies causality as the increments of redundant, unique, and synergistic information gained about future events from past observations. The formulation is non-intrusive and applicable to both computational and experimental investigations, even when samples are scarce. We benchmark SURD in scenarios that pose significant challenges for causal inference and demonstrate that it offers a more reliable quantification of causality compared to previous methods.

applied mathematics↗
DOE OSTI2025

Selecting samples of galaxies with fewer Fingers-of-God

The radial positions of galaxies inferred from their measured redshift appear distorted due to their peculiar velocities. We argue that the contribution from stochastic velocities — which gives rise to `Fingers-of-God' (FoG) anisotropy in the inferred maps — does not lend itself to perturbative modelling already on scales targeted by current experiments. To get around this limitation, we propose to remove FoG using data-driven indicators of their abundance that are local in nature and thus avoid selection biases. In particular, we show that the scale where the measured power spectrum quadrupole changes sign is tightly anti-correlated with both the satellite fraction and the velocity dispersion, and can thus be used to select galaxy samples with fewer FoG. In addition, we show that excluding galaxies in haloes more massive than a given mass threshold can help to discard many of the most problematic galaxies. Such selection could be achieved in practice using maps of the thermal Sunyaev-Zel'dovich distortion of the cosmic microwave background frequency spectrum. These techniques could potentially improve reconstructions of the large-scale velocity and displacement fields from the redshift-space positions of galaxies. They may also extend the reach of perturbative models for galaxy clustering, though in practice we find only marginal gains when fitting one-loop EFTofLSS models to simulations with mitigated FoG due to the relevance of other effects entering at two-loop order.

cosmological parameters from LSS↗
DOE OSTI2026

Hierarchical Gaussian Random Field Sampling for Multilevel Markov Chain Monte Carlo: Coupling Stochastic Partial Differential Equation and the Karhunen–Loève Decomposition

This work introduces structure preserving hierarchical decompositions for sampling Gaussian random fields (GRFs) within the context of multilevel Bayesian inference in high-dimensional space. Existing scalable hierarchical sampling methods, such as those based on stochastic partial differential equations (SPDEs), often reduce the dimensionality of the sample space at the cost of accuracy of inference. Other approaches, such that those based on Karhunen-Loève (KL) expansions, offer sample space dimensionality reduction but sacrifice GRF representation accuracy and ergodicity of the Markov chain Monte Carlo (MCMC) sampler and are computationally expensive for high-dimensional problems. The proposed method integrates the dimensionality reduction capabilities of KL expansions with the scalability of SPDE-based sampling, thereby providing a robust, unified framework for high-dimensional uncertainty quantification (UQ) that is scalable and accurate, preserves ergodicity, and offers dimensionality reduction of the sample space. The hierarchy in our multilevel algorithm is derived from the geometric multigrid hierarchy. By constructing a hierarchical decomposition that maintains the covariance structure across the levels in the hierarchy, the approach enables efficient coarse-to-fine sampling while ensuring that all samples are drawn from the desired distribution. The effectiveness of the proposed method is demonstrated on a benchmark subsurface flow problem, demonstrating its effectiveness in improving computational efficiency and statistical accuracy. Furthermore, our proposed technique is more efficient and accurate and displays better convergence properties than existing methods for high-dimensional Bayesian inference problems.

Gaussian random fields↗
DOE OSTI2023

Bayesian inferences of electrical current delivered to shocked transmission lines

Small radius Bdot measurements of electrical current delivered by pulsed power devices are routinely compromised by electrode/convolute plasmas endemic to multiterawatt transmission lines. Inferences of delivered current unaffected by these issues have recently been obtained by numerically optimizing consistency between model predictions and local experimental velocimetry data, but these are only unique for shockless velocity profiles. In the paper we describe a more general Bayesian method capable of inferring current despite the presence of shocks. Additionally, we describe uncertainty estimates and use of the technique on experimental data. This technique is the first to provide uncertainty estimates on the full current trace delivered to an inertial confinement fusion target.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1975

Mathematical formulation of scatter-free propagation of solar cosmic rays

The observations of strong persistent velocity anisotropies in solar flare events demand a mathematical theory closer to the extreme of scatter-free (deterministic) propagation rather than diffusive (stochastic) transport, since the latter breaks down as inferred mean-free-paths exceed 0.1 AU. Equations are derived for the time-dependent phase-space density, and Laplace transform techniques are used to obtain solutions under rather general conditions. The case of an Archimedean spiral field has been solved numerically, and the results compared with observations from Mariner and Explorer spacecraft of nearly 0.4 MeV proton intensity and anisotropy histories. These can both be replicated if the inner boundary of the modulation region is placed beyond 2 AU.

Nolte, J. T.↗
DOE OSTI2025

Jensen–Shannon divergence based novel loss functions for Bayesian neural networks

Bayesian neural networks (BNNs) are state-of-the-art machine learning methods that can naturally regularize and systematically quantify uncertainties using their stochastic parameters. Kullback–Leibler (KL) divergence-based variational inference used in BNNs suffer from unstable optimization and challenges in approximating light-tailed posteriors due to the unbounded nature of the KL divergence. To resolve these issues, we formulate a novel loss function for BNNs based on a new modification to the generalized Jensen–Shannon (JS) divergence, which is bounded. In addition, we propose a Geometric JS divergence-based loss, which is computationally efficient since it can be evaluated analytically. We found that the JS divergence-based variational inference is intractable, and hence employed a constrained optimization framework to formulate these losses. Our theoretical analysis and empirical experiments on multiple regression and classification data sets suggest that the proposed losses perform better than the KL divergence-based loss, especially when the data sets are noisy or biased. Specifically, there are approximately 5% and 8% improvements in accuracy for a noise-added CIFAR-10 dataset and a regression dataset, respectively. There is about 13% reduction in false negative predictions of a biased histopathology dataset. Additionally, we quantify and compare the uncertainty metrics for the regression and classification tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Impacts of floating-point non-associativity on reproducibility for HPC and deep learning applications

Run to run variability in parallel programs caused by floating-point non-associativity has been known to significantly affect reproducibility in iterative algorithms, due to accumulating errors. Non-reproducibility can critically affect the efficiency and effectiveness of correctness testing for stochastic programs. Recently, the sensitivity of deep learning training and inference pipelines to floating-point non-associativity has been found to sometimes be extreme. It can prevent certification for commercial applications, accurate assessment of robustness and sensitivity, and bug detection. New approaches in scientific computing applications have coupled deep learning models with high-performance computing, leading to an aggravation of debugging and testing challenges. Here we perform an investigation of the statistical properties of floating-point non-associativity within modern parallel programming models, and analyze performance and productivity impacts of replacing atomic operations with deterministic alternatives on GPUs. We examine the recently-added deterministic options in PyTorch within the context of GPU deployment for deep learning, uncovering and quantifying the impacts of input parameters triggering run to run variability and reporting on the reliability and completeness of the documentation. Finally, we evaluate the strategy of exploiting automatic determinism that could be provided by deterministic hardware, using the Groq LPUTM accelerator for inference portions of the deep learning pipeline. We demonstrate the benefits that a hardware-based strategy can provide within reproducibility and correctness efforts.

Shanmugavelu, Sanjif↗
DOE OSTI2026

A score-based diffusion model approach for adaptive learning of stochastic partial differential equation solutions

In this paper, we propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central role in modeling complex physical systems under uncertainty, but their numerical solutions often suffer from model errors and reduced accuracy due to incomplete physical knowledge and environmental variability. To address these challenges, we encode the governing physics into the score function of a diffusion model using simulation data and incorporate observational information via a likelihood-based correction in a reverse-time stochastic differential equation. This enables adaptive learning through iterative refinement of the solution as new data becomes available. To improve computational efficiency in high-dimensional settings, we introduce the ensemble score filter, a training-free approximation of the score function designed for real-time inference. Numerical experiments on benchmark SPDEs demonstrate the accuracy and robustness of the proposed method under sparse and noisy observations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

AlphaBeta: computational inference of epimutation rates and spectra from high-throughput DNA methylation data in plants

Stochastic changes in DNA methylation (i.e., spontaneous epimutations) contribute to methylome diversity in plants. Here, we describe AlphaBeta, a computational method for estimating the precise rate of such stochastic events using pedigree-based DNA methylation data as input. We demonstrate how AlphaBeta can be employed to study transgenerationally heritable epimutations in clonal or sexually derived mutation accumulation lines, as well as somatic epimutations in long-lived perennials. Application of our method to published and new data reveals that spontaneous epimutations accumulate neutrally at the genome-wide scale, originate mainly during somatic development and that they can be used as a molecular clock for age-dating trees.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Bayesian inference of heterogeneous epidemic models: Application to COVID-19 spread accounting for long-term care facilities

Here we propose a high dimensional Bayesian inference framework for learning heterogeneous dynamics of a COVID-19 model, with a specific application to the dynamics and severity of COVID-19 inside and outside long-term care (LTC) facilities. We develop a heterogeneous compartmental model that accounts for the heterogeneity of the time-varying spread and severity of COVID-19 inside and outside LTC facilities, which is characterized by time-dependent stochastic processes and time-independent parameters in ~ 1500 dimensions after discretization. To infer these parameters, we use reported data on the number of confirmed, hospitalized, and deceased cases with suitable post-processing in both a deterministic inversion approach with appropriate regularization as a first step, followed by Bayesian inversion with proper prior distributions. To address the curse of dimensionality and the ill-posedness of the high-dimensional inference problem, we propose use of a dimension-independent projected Stein variational gradient descent method, and demonstrate the intrinsic low-dimensionality of the inverse problem. We present inference results with quantified uncertainties for both New Jersey and Texas, which experienced different epidemic phases and patterns. Moreover, we also present forecasting and validation results based on the empirical posterior samples of our inference for the future trajectory of COVID-19.

42 ENGINEERING↗
DOE OSTI2022

EdgeAI: Machine learning via direct attached accelerator for streaming data processing at high shot rate x-ray free-electron lasers

We present a case for low batch-size inference with the potential for adaptive training of a lean encoder model. We do so in the context of a paradigmatic example of machine learning as applied in data acquisition at high data velocity scientific user facilities such as the Linac Coherent Light Source-II x-ray Free-Electron Laser. We discuss how a low-latency inference model operating at the data acquisition edge can capitalize on the naturally stochastic nature of such sources. We simulate the method of attosecond angular streaking to produce representative results whereby simulated input data reproduce high-resolution ground truth probability distributions. By minimizing the mean-squared error between the decoded output of the latent representation and the ground truth distributions, we ensure that the encoding layers and resulting latent representation maintains full fidelity for any downstream task, be it classification or regression. We present throughput results for data-parallel inference of various batch sizes, some with throughput exceeding 100 k images per second. We also show in situ training below 10 s per epoch for the full encoder–decoder model as would be relevant for streaming and adaptive real-time data production at our nation’s scientific light sources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Robust Statistical Approach for Determination of Graphite Nitridation Using Bayesian Model Comparison

A better estimation of surface reaction efficiency of semiconductor-grade graphite with atomic nitrogen, as well as the calibration error are calculated using Bayesian updating based on experimental data. Compared with a conventional deterministic model, the stochastic model approach is a powerful tool in the sense that the model is capable of taking into account underlying error correlations among the data quantities. In this paper, we investigate four different stochastic models (called “stochastic system model classes” herein) corresponding to different descriptions of modeling and measurement error structures, given one deterministic physical model. These stochastic system model classes differ in the covariance matrix structure that is used in the uncertainty model to represent uncertainties associated with the physical model and experimental measurements. For each model class, Bayesian inference is used to estimate the posterior probabilities of the physical model parameters as well as of the stochastic model parameters. Model comparison and selection are then applied based on two measures including Bayesian evidence and Bayesian information criterion, as well as the deviance information criterion. Both measures suggest the stochastic model class, which considers that a correlation between errors in two data quantities among different data points is the most plausible. With the stochastic model class, the range of uncertainty in surface reaction efficiency is estimated to be about two orders of magnitude at [Formula: see text].

Engineering↗
DOE OSTI2021

On the Stochastic Stability of Deep Markov Models

Deep Markov models (DMM) are generative models which are scalable and expressive generalization of Markov models for representation, learning, and inference problems. DMMs using deep neural networks to parametrize the transition of Markov probability distributions have recently been shown to provide more expressiveness in modeling sequential data and dynamical system responses. However, the fundamental stochastic stability guarantees of such models have not been thoroughly investigated. In this paper, we present a rigorous analytical method to prove the necessary and sufficient conditions of DMM's stochastic stability. This task is achieved by spectral analysis of the efficiently computed Jacobians of probabilistic maps modeled by deep neural networks. We make theoretical connections between the eigenvalues of neural network's weights and the different activation function types used on the stability and overall dynamic behavior of DMMs with Gaussian distributions. We empirically substantiate our theoretical results on stochastic stability and eigenvalue spectra via several numerical experiments. Formal stability guarantees of DMMs can substantially improve their robustness and trustworthiness, necessary for reliable use in safety-critical real-world applications.

Drgona, Jan↗
NASA NTRS1993

On the generation of sound by turbulent convection. I - A numerical experiment

Motivated by the problem of the origin of the solar p-modes, we study the generation of acoustic waves by turbulent convection. Our approach uses the results of high-resolution 3D simulations as the experimental basis for our investigation. The numerical experiment describes the evolution of a horizontally periodic layer of vigorously convecting fluid. The sound is measured by a procedure, based on a suitable linearization of the equations of compressible convection that allows the amplitude of the acoustic field to be determined. Through this procedure we identify unambiguously some 400 acoustic modes. The total energy of the acoustic field is found to be a fraction of a percent of the kinetic energy of the convection. The amplitudes of the observed modes depend weakly on (horizontal) wavenumber but strongly on frequency. The line widths of the observed modes typically exceed the natural linewidths of the modes as inferred from linear theory. This broadening appears to be related to the (stochastic) interaction between the modes and the underlying turbulence which causes abrupt, episodic events during which the phase coherence of the modes is lost.

Bogdan, Thomas J.↗