Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

On-the-fly autonomous control of neutron diffraction via physics-informed Bayesian active learning

We demonstrate the first live, autonomous control over neutron diffraction experiments by developing and deploying ANDiE: the autonomous neutron diffraction explorer. Neutron scattering is a unique and versatile characterization technique for probing the magnetic structure and behavior of materials. However, instruments at neutron scattering facilities in the world is limited, and instruments at such facilities are perennially oversubscribed. We demonstrate a significant reduction in experimental time required for neutron diffraction experiments by implementation of autonomous navigation of measurement parameter space through machine learning. Prior scientific knowledge and Bayesian active learning are used to dynamically steer the sequence of measurements. We show that ANDiE can experimentally determine the magnetic ordering transition of both MnO and Fe 1.09 Te all while providing a fivefold enhancement in measurement efficiency. Furthermore, in a hypothesis testing post-processing step, ANDiE can determine transition behavior from a set of possible physical models. ANDiE's active learning approach is broadly applicable to a variety of neutron-based experiments and can open the door for neutron scattering as a tool of accelerated materials discovery.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Bayesian Calibration of Inertial Confinement Fusion Models with Very Expensive Data

Calibrating computer simulations against experimental data is a ubiquitous problem in science and is particularly difficult when experimental data are expensive or diffi- cult to collect. In inertial confinement fusion experiments, where a single data point can cost 10 5 –10 6 USD, calibration of large-scale design calculations is particularly challenging. We present a framework that aims to provide calibrated predictions far from the available data that can be trained using a small number of data points. The approach aims to retain as much of the physics (summarized by the simulation code) as possible and is based on a truncated polynomial chaos expansion in the space of simulation inputs, augmented with a non-parametric correction for higher distribution modes. Due to the difficulty of the problem, understanding the sources of uncertainty in the model is essential; we demonstrate this through an application of our approach to a series of 6 experimental laser shots. As a result, we validate our approach, show that the uncertainties in our predictions of experimental performance are dominated by shot-shot fluctuations and regression uncertainties, and discuss paths towards an improved prediction model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

A Machine Learning based Approach of Estimating Equivalent Circuit Model Parameters at Different SoCs of Li-ion Batteries from Voltage Relaxation

Abstract: In this study, an approach of estimating the equivalent circuit model (ECM) parameters for Li-ion batteries (LIBs) is proposed based on the voltage value at different intervals while relaxing the LIB after discharge. The typical approach for estimating ECM parameters of a LIB is to conduct electrochemical impedance spectroscopy (EIS) measurements at different frequencies and fit them to a predefined circuit model, which requires additional measuring arrangements and specialized devices. The proposed methodology utilizes four different voltages at 0s, 60s, 360s, and 1800s alongside the specific state of charge (SoC) value for a specific constant discharge current value of ~1C until the relaxation stage to train and evaluate three regression-based machine learning models— Support Vector Regression (SVR), Extreme Gradient Boosting (XGBoost), and Gaussian Process Regression (GPR)—for estimating the ECM parameters of the selected model. Bayesian optimization is employed for hyperparameter tuning to achieve optimal performance for all the regressor models, among which, the GPR provided the best performance with the root-mean-squared error (RMSE) of less than 4x10-4 on average for the resistive components and less than 0.27 for capacitive components with excellent R2 scores. The simplicity of the approach enables it to eliminate the need for sophisticated measuring equipment and computation power.

Sagar, Md. Samiul [The University of Alabama (UA)]↗
DOE OSTI2020

Limitations of traditional tools for beyond design basis external hazard PRA

Probabilistic risk assessment (PRA) is being used increasingly by the nuclear industry for safety during normal operations as well as for the protection against external hazards. Computation of total risk in an external hazard PRA is dependent on hazard assessment, fragility assessment, and systems analysis. A systems analysis for propagation of component fragilities is conducted using event and fault trees. The event and fault trees for an actual power plant can be fairly large in size, which imposes computational challenges. Hence, certain assumptions are employed for computational efficiency. These assumptions typically represent the conditions imposed during the design basis (DB) scenario. The traditional PRA tools based on these assumptions are also widely applied to perform risk assessment in the context of beyond design basis (BDB) scenarios. However, some of these assumptions may not be valid for certain BDB scenarios. In addition, the probability of dependent failures also increases in BDB scenarios due to common cause failures (CCF) which usually results from design modifications, human errors, etc. In this manuscript, a simple and a relatively more complex illustrative examples are used to show the limitation of these assumptions in the numerical quantification of risk for the case of BDB conditions. Case studies with CCF events across multiple fault trees are also presented to illustrate the effect of these assumptions when traditional approach is used in BDB risk assessment. It is shown that the assumptions are valid for the case of DB conditions but may lead to excessively conservative risk estimates in the case of BDB conditions. Finally, a Bayesian network based top-down algorithm is proposed as an alternative tool for accurate numerical quantification of total risk in systems analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Confronting the Challenge of Modeling Cloud and Precipitation Microphysics

In the atmosphere, microphysics refers to the microscale processes that affect cloud and precipitation particles and is a key linkage among the various components of Earth’s atmospheric water and energy cycles. The representation of microphysical processes in models continues to pose a major challenge leading to uncertainty in numerical weather forecasts and climate simulations. In this paper, the problem of treating microphysics in models is divided into two parts: i) how to represent the population of cloud and precipitation particles, given the impossibility of simulating all particles individually within a cloud, and ii) uncertainties in the microphysical process rates owing to fundamental gaps in knowledge of cloud physics. The recently-developed Lagrangian particle-based method is advocated as a way to address several conceptual and practical challenges of representing particle populations using traditional bulk and bin microphysics parameterization schemes. For addressing critical gaps in cloud physics knowledge, sustained investment for observational advances from laboratory experiments, new probe development, and next-generation instruments in space is needed. Greater emphasis on laboratory work, which has apparently declined over the past several decades relative to other areas of cloud physics research, is argued to be an essential ingredient for improving process-level understanding. More systematic use of natural cloud and precipitation observations to constrain microphysics schemes is also advocated. Because it is generally difficult to quantify individual microphysical process rates from these observations directly, this presents an inverse problem that can be viewed from the standpoint of Bayesian statistics. Following this idea, a probabilistic framework is proposed that combines elements from statistical and physical modeling. Besides providing rigorous constraint of schemes, there is an added benefit of quantifying uncertainty systematically. Finally, a broader hierarchical approach is proposed to accelerate improvements in microphysics schemes, leveraging the advances described in this paper related to process modeling (using Lagrangian particle-based schemes), laboratory experimentation, cloud and precipitation observations, and statistical methods.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

BEYONDPLANCK II. CMB mapmaking through Gibbs sampling

We present a Gibbs sampling solution to the mapmaking problem for cosmic microwave background (CMB) measurements that builds on existing destriping methodology. Gibbs sampling breaks the computationally heavy destriping problem into two separate steps: noise filtering and map binning. Considered as two separate steps, both are computationally much cheaper than solving the combined problem. This provides a huge performance benefit as compared to traditional methods and it allows us, for the first time, to bring the destriping baseline length to a single sample. Here, we applied the Gibbs procedure to simulated Planck 30 GHz data. We find that gaps in the time-ordered data are handled efficiently by filling them in with simulated noise as part of the Gibbs process. The Gibbs procedure yields a chain of map samples, from which we are able to compute the posterior mean as a best-estimate map. The variation in the chain provides information on the correlated residual noise, without the need to construct a full noise covariance matrix. However, if only a single maximum-likelihood frequency map estimate is required, we find that traditional conjugate gradient solvers converge much faster than a Gibbs sampler in terms of the total number of iterations. The conceptual advantages of the Gibbs sampling approach lies in statistically well-defined error propagation and systematic error correction. This methodology thus forms the conceptual basis for the mapmaking algorithm employed in the BEYONDPLANCK framework, which implements the first end-to-end Bayesian analysis pipeline for CMB observations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Greedy emulators for nuclear two-body scattering

Applications of reduced basis method emulators are increasing in low-energy nuclear physics because they enable fast and accurate sampling of high-fidelity calculations, enabling robust uncertainty quantification. Here, in this paper, we develop, implement, and test two model-driven emulators based on the (Petrov-)Galerkin projection using the prototypical test case of two-body scattering with the Minnesota potential and a more realistic local chiral potential. The high-fidelity scattering equations are solved with the matrix Numerov method, a reformulation of the popular Numerov recurrence relation for solving special second-order differential equations as a linear system of coupled equations. A novel error estimator based on reduced-space residuals is applied to an active learning approach (a greedy algorithm) to choosing training samples (“snapshots”) for the emulator and contrasted with a proper orthogonal decomposition (POD) approach. Both approaches allow for computationally efficient offline-online decompositions, but the greedy approach requires many fewer snapshot calculations. These developments set the groundwork for emulating scattering observables based on chiral nucleon-nucleon and three-nucleon interactions and optical models, where computational speed-ups are necessary for Bayesian uncertainty quantification. Our emulators and error estimators are widely applicable to linear systems.

Bayesian methods↗
DOE OSTI2018

Data-Driver Interpretation of Ultradeep Azimuthal Propagation

We report the interpretation of geological features around the borehole stresses on the search of true earth model parameters. Different from the conventional logging-while-drilling (LWD) technologies, such as wireline induction and propagation resistivity tools, the azimuthal resistivity measurement acquires the ability of directional sensitivity. Within this decade, this type of tools has been greatly enhanced with over hundred feet depth-of-detection (DoD). To resolve the interpretation of geological features within 100 feet from the borehole, the multiple-layer structure must be considered. However, the traditional methods can never handle the highly nonlinear inverse problems especially facing on the complicated earth structure. Meanwhile, no justifiable uncertainty of inverse parameters can be provided. The statistical methods have been adopted to search for the global statistical distribution and uncertainties of earth model parameters. However, the most attempts are still stuck in non-uniqueness of the solutions since the structure of earth model has been predefined, where the number of layers is assumed, which introduces another ambiguity into the model interpretation. This paper develops a general trans-dimensional Bayesian methodology to solve non-linear inverse problem of earth layer resistivity and depth to the layer boundaries, from the interpretation of ultra-deep azimuthal resistivity measurements. The presented work is a data-driven approach to search out the multi-dimensional parameter spaces. Finally, the simulations tell that the algorithm can efficiently solve the earth model interpretation within a hundred feet from borehole, and examine the uncertainty of earth model parameters.

58 GEOSCIENCES↗
DOE OSTI2021

A Comparison of Three Ways to Measure Time-Dependent Densities With Quantum Simulators

Quantum algorithms are touted as a way around some classically intractable problems such as the simulation of quantum mechanics. At the end of all quantum algorithms is a quantum measurement whereby classical data is extracted and utilized. In fact, many of the modern hybrid-classical approaches are essentially quantum measurements of states with short quantum circuit descriptions. Here, we compare and examine three methods of extracting the time-dependent one-particle probability density from a quantum simulation: direct Z -measurement, Bayesian phase estimation, and harmonic inversion. We have tested these methods in the context of the potential inversion problem of time-dependent density functional theory. Our test results suggest that direct measurement is the preferable method. We also highlight areas where the other two methods may be useful and report on tests using Rigetti's quantum virtual device. This study provides a starting point for imminent applications of quantum computing.

Yang, Jun↗
DOE OSTI2023

Proactive Frequency Stability Scheme: A Distributed Framework Based on Particle Filters and Synchrophasors

The reactive nature of traditional under-frequency load shedding schemes can lead to delayed response and unnecessary loss of load. This work presents a proactive framework for power system frequency stability. Bayesian filters and synchrophasors are leveraged to produce predictions after disturbances are detected. By being able to estimate the future state of frequency corrective actions can be taken before the system reaches a critical condition. This proactive approach makes it possible to optimize the response to a disturbance, which results in a decrease in the amount of compensation utilized. The framework is tested via Matlab simulations based on Kundur’s Two-Area System, and the IEEE 14-Bus System. Performance metrics are provided and evaluated against other contemporary solutions found in literature. During testing this framework outperformed other solutions by drastically reducing the amount of load dropped during compensation.

42 ENGINEERING↗
DOE OSTI2023

Extending Parsimonious Bayesian Inference

Parsimonious Bayesian inference is a theoretical framework for efficient data assimilation that seeks to balance increased consistency between predictions and training data against corresponding increases in model complexity. Within this framework, over-training is understood as optimization that encodes excessive information within model parameters while only achieving small improvements between predictions and training data. This project aims to develop practical methods of limiting excess model information during optimization. One key observation is that practical heuristics for parsimonious learning in high-dimensions must balance expressivity, i.e. the ability of the model to capture diverse predictions with only a few non-zero parameters, against discoverability, i.e. the ability to train the model with gradient-based optimization and drive parameters to low information states. As such, we developed logical activation functions that are able to adaptively approximate arbitrary truth tables that define Boolean logic operations within a probabilistic framework. These functions have demonstrated the ability to learn exclusive disjunction (XOR) and conditioned disjunction (if [condition] then [result_if_true] else [result_if_false]) within a single layer of a neural network. To efficiently exploit these activation functions to drive parsimonious learning required several other advances within the domain of variational inference. The most efficient form of complexity suppression is structured sparsification, driving most model parameters to zero while achieving the structural coherence among nonzeros needed for bandwidth reduction. Such models are not only far more efficient at suppressing information-theoretic complexity, they also reduce the other forms of complexity (computations, communication, storage, and the number of dependencies needed to evaluate predictions). Aiming to support enhanced sparsification, this project examined new approaches to high-dimensional variational inference that allow us to calibrate and control parameter uncertainty during optimization. By identifying which parameters can sustain sparsifying perturbations with little impact on prediction quality, we can develop better pruning strategies by framing them as approximate Bayesian inference. These advances also open paths to mitigate concerns with deploying advanced learning methods in resource-constrained environments, such as running models on power-limited or communication-limited devices.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Interpretation of Urinary Excretion Data From Plutonium Wound Cases Treated With DTPA: Application of Different Models and Approaches

After a chelation treatment, assessment of intake and doses is the primary concern of an internal dosimetrist. Using the urinary excretion data from two actual wound cases encountered at Los Alamos National Laboratory (LANL), this study discusses several methods that can be used to interpret intakes from the urinary data collected after one or multiple chelation treatments. One of the methods uses only the data assumed to be unaffected by chelation (data collected beyond 100 d after the last treatment). This method, used by many facilities for official dose records, was implemented by employing maximum likelihood analysis and Bayesian analysis methods. The impacts of an improper assumption about the physicochemical behavior of a radioactive material and the importance of the use of a facility-specific biokinetic model when available have also been demonstrated. Another method analyzed both the affected and unaffected urinary data using an empirical urinary excretion model. This method, although case-specific, was useful in determining the actual intakes and the doses averted or the reduction in body burdens due to chelation treatments. Finally, this approach was important in determining the enhancement factors, the behavior of the chelate, and other observations that may be pertinent to several DTPA compartmental modeling approaches being conducted by the health physics community.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2022

Estimation of pollen productivity and dispersal: How pollen assemblages in small lakes represent vegetation

Abstract Quantitative understanding of vegetation dynamics over timespans beyond a century remains limited. In this regard, the pollen‐based reconstruction of past vegetation enables unique research opportunities by quantifying changes in plant community compositions during hundreds to thousands of years. Critically, the methodological basis for most reconstruction approaches rests upon estimates of pollen productivity and dispersal. Previous studies, however, have reached contrasting conclusions concerning these estimates, which may be perceived to challenge the applicability and reliability of pollen‐based reconstruction. Here we show that conflicting estimates of pollen production and dispersal are, at least in part, artifacts of fixed assumptions of pollen dispersal and insufficient spatial resolution of vegetation data surrounding the pollen‐collecting lake. We implemented a Bayesian statistical model that related pollen assemblages in surface sediments of 33 small lakes (<2 ha) in the northeastern United States, with surrounding vegetation ranging from 10 1 to >10 5 m from the lake margin. Our analysis revealed three key insights. First, pollen productivity is largely conserved within taxa and across forest types. Second, when local (within a 1‐km radius) vegetation abundances are not considered, pollen‐source areas may be overestimated for some common taxa (Cupressaceae, Pinus , Quercus , and Tsuga ). Third, pollen dispersal mechanisms may differ between local and regional scales; this is missed by pollen‐dispersal models used in previous studies. These findings highlight the complex interactions between vegetation heterogeneity on the landscape and pollen dispersal. We suggest that, when estimating pollen productivity and dispersal, both detailed local and extended regional vegetation must be taken into account. Also, both deductive (mechanistic models) and inductive (statistical models) approaches are needed to better understand the emergent properties of pollen dispersal in heterogeneous landscapes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Large Methane Emissions From the Pantanal During Rising Water‐Levels Revealed by Regularly Measured Lower Troposphere CH 4 Profiles

Abstract The Pantanal region of Brazil is the largest seasonally flooded tropical grassland and, according to local chamber measurements, a substantial CH 4 source. CH 4 emissions from wetlands have recently become of heightened interest because global atmospheric 13 CH 4 data indicate they may contribute to the resumption of atmospheric CH 4 growth since 2007. We have regularly measured vertical atmospheric profiles for 2 years in the center of the Pantanal with the objectives to obtain an estimate of CH 4 emissions using an atmospheric approach, and provide information about flux seasonality and its relation to controlling factors. Boundary layer‐free troposphere differences observed in the Pantanal are large compared to other wetlands. Total emissions based on a planetary boundary layer budgeting technique are 2.0–2.8 TgCH 4 yr −1 (maximum flux ∼0.4 gCH 4 m −2 d −1 ) while those based on a Bayesian inversion using an atmospheric transport model are ∼3.3 TgCH 4 yr −1 . Compared to recent estimates for Amazonia (∼41 ± 3 TgCH 4 yr −1 , maximum flux ∼0.3 gCH 4 m −2 d −1 ) these emissions are not that large. Our Pantanal data suggest a clear flux seasonality with CH 4 being released in large amounts just after water levels begin to rise again after minimum levels have been reached. CH 4 emissions decline substantially once the maximum water level has been reached. While predictions with prognostic wetland CH 4 emission models agree well with the magnitude of the fluxes, they disagree with the phasing. Our approach shows promise for detecting and understanding longer‐term trends in CH 4 emissions and the potential for future wetlands CH 4 emissions climate feedbacks.

Gloor, M.↗
DOE OSTI2025

Conformal Hierarchical Simulation-Based Inference with Local Validity

Trustworthy and interpretable uncertainty quantification is a long-standing challenge in artificial intelligence. Simulation-based inference (SBI) comprises a broad swath of approaches for estimating latent parameters with uncertainties. Although flexible neural density estimators in SBI can be remark- ably expressive capturing highly structured, high-dimensional posteriors their credible regions can be badly mis-calibrated and are often only accompanied by heuristic coverage checks. We present the first SBI framework that delivers finite-sample local valid coverage guarantees that hold in the neighborhood of each observation. Our framework can couple any off-the-shelf hierarchical SBI engine with a confor- mal Bayesian post-processing step that operates on the posterior predictive density. A kernel-weighted conformity score adapts the conformal quantile to the local geometry of the data, yielding prediction sets that are simultaneously (i) marginally calibrated, (ii) locally valid, and (iii) hierarchical, handling global and observation-specific parameters in a single pass. Through experiments on synthetic data and benchmarks from neuroscience and physics, we show that our approach attains 1 − α coverage, where prior SBI methods under- or over-cover. Our approach also maintains a competitive, credible set size with minimal computational overhead. Finally, our approach can be used to make predictions on real data and give valid credible regions modulo weight-initialization-based model mis-specification.

Trivedi, Shubhendu [Fermilab]↗
DOE OSTI2015

Bayesian inference on the sphere beyond statistical isotropy

We present a general method for Bayesian inference of the underlying covariance structure of random fields on a sphere. We employ the Bipolar Spherical Harmonic (BipoSH) representation of general covariance structure on the sphere. We illustrate the efficacy of the method as a principled approach to assess violation of statistical isotropy (SI) in the sky maps of Cosmic Microwave Background (CMB) fluctuations. SI violation in observed CMB maps arise due to known physical effects such as Doppler boost and weak lensing; yet unknown theoretical possibilities like cosmic topology and subtle violations of the cosmological principle, as well as, expected observational artefacts of scanning the sky with a non-circular beam, masking, foreground residuals, anisotropic noise, etc. We explicitly demonstrate the recovery of the input SI violation signals with their full statistics in simulated CMB maps. Our formalism easily adapts to exploring parametric physical models with non-SI covariance, as we illustrate for the inference of the parameters of a Doppler boosted sky map. Our approach promises to provide a robust quantitative evaluation of the evidence for SI violation related anomalies in the CMB sky by estimating the BipoSH spectra along with their complete posterior.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

BISON Fuel Fragmentation Relocation and Dispersal (FFRD) Assessment Database for Eventual Use in Bayesian Calibration

Existing light-water reactor (LWR) fuel vendors have been interested in seeking increased discharge burnups of nuclear fuel rods for improved economics for quite a few years. With increased burnups come additional challenges that must be addressed. It has been experimentally observed that average burnups higher than the current regulatory limit of 62 MWd/kgU may undergo fuel fragmentation, relocation, and dispersal (FFRD) during a loss-of-coolant accident (LOCA). Industry must demonstrate approaches to mitigate FFRD. In an effort to support industry, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program within the U.S. Department of Energy (DOE) has for several years invested in developing multiscale models and creating a validation/assessment database for these models to study the mechanisms driving FFRD. This report provides an update on changes made to the assessment database and new models added to BISON to support the study of fuel rod behavior during FFRD. An effort has been initiated this year to begin adding dedicated inputs to the publicly available Virtual Test Bed (VTB) repository for industry use. A section of this report details the efforts made in this area. NEAMS has recently developed new capabilities in the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework’s stochastic tools module for calibration using Bayesian inference. The goal in the future is to use these capabilities to calibrate and identify weaknesses in the existing BISON models for FFRD. The report concludes with a discussion on the models most likely to benefit the most from such calibration.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗