Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Goal-oriented a-posteriori estimation of model error as an aid to parameter estimation

In this work, a Bayesian model calibration framework is presented that utilizes goal-oriented a-posterior error estimates in quantities of interest (QoIs) for classes of high-fidelity models characterized by PDEs. It is shown that for a large class of computational models, it is possible to develop a computationally inexpensive procedure for calibrating parameters of high-fidelity models of physical events when the parameters of low-fidelity (surrogate) models are known with acceptable accuracy. The main ingredients in the proposed model calibration scheme are goal-oriented a-posteriori estimates of error in QoIs computed using a so-called lower fidelity model compared to those of an uncalibrated higher fidelity model. The estimates of error in QoIs are used to define likelihood functions in Bayesian inversion analysis. A standard Bayesian approach is employed to compute the posterior distribution of model parameters of high-fidelity models. As applications, parameters in a quasi-linear second-order elliptic boundary-value problem (BVP) are calibrated using a second-order linear elliptic BVP. In a second application, parameters of a tumor growth model involving nonlinear time-dependent PDEs are calibrated using a lower fidelity linear tumor growth model with known parameter values.

A-posterior estimates↗
DOE OSTI2022

Can we use antipredator behavior theory to predict wildlife responses to high-speed vehicles?

Animals seem to rely on antipredator behavior to avoid vehicle collisions. There is an extensive body of antipredator behavior theory that have been used to predict the distance/time animals should escape from predators. These models have also been used to guide empirical research on escape behavior from vehicles. However, little is known as to whether antipredator behavior models are appropriate to apply to an approaching high-speed vehicle scenario. We addressed this gap by (a) providing an overview of the main hypotheses and predictions of different antipredator behavior models via a literature review, (b) exploring whether these models can generate quantitative predictions on escape distance when parameterized with empirical data from the literature, and (c) evaluating their sensitivity to vehicle approach speed using a simulation approach wherein we assessed model performance based on changes in effect size with variations in the slope of the flight initiation distance (FID) vs. approach speed relationship. The slope of the FID vs. approach speed relationship was then related back to three different behavioral rules animals may rely on to avoid approaching threats: the spatial, temporal, or delayed margin of safety. We used literature on birds for goals (b) and (c). Our review considered the following eight models: the economic escape model, Blumstein’s economic escape model, the optimal escape model, the perceptual limit hypothesis, the visual cue model, the flush early and avoid the rush (FEAR) hypothesis, the looming stimulus hypothesis, and the Bayesian model of escape behavior. We were able to generate quantitative predictions about escape distance with the last five models. However, we were only able to assess sensitivity to vehicle approach speed for the last three models. The FEAR hypothesis is most sensitive to high-speed vehicles when the species follows the spatial (FID remains constant as speed increases) and the temporal margin of safety (FID increases with an increase in speed) rules of escape. The looming stimulus effect hypothesis reached small to intermediate levels of sensitivity to high-speed vehicles when a species follows the delayed margin of safety (FID decreases with an increase in speed). The Bayesian optimal escape model reached intermediate levels of sensitivity to approach speed across all escape rules (spatial, temporal, delayed margins of safety) but only for larger (> 1 kg) species, but was not sensitive to speed for smaller species. Overall, no single antipredator behavior model could characterize all different types of escape responses relative to vehicle approach speed but some models showed some levels of sensitivity for certain rules of escape behavior. We derive some applied applications of our findings by suggesting the estimation of critical vehicle approach speeds for managing populations that are especially susceptible to road mortality. Overall, we recommend that new escape behavior models specifically tailored to high-speeds vehicles should be developed to better predict quantitatively the responses of animals to an increase in the frequency of cars, airplanes, drones, etc. they will face in the next decade.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Holocene paleoclimate change in the western US: The importance of chronology in discerning patterns and drivers

We report sediment in lakes and meadows forms a powerful archive that can be used to reconstruct environmental change through time. Reconstructions of lake level, of chemical, biological, and hydrological conditions, and of surrounding vegetation provide detailed information about past climate conditions, both locally and regionally. Indeed, most of our current knowledge of centennial- to millennial-scale climate variability in the arid western United States, where information about past hydroclimate is particularly important, comes from such sediment-based reconstructions. The pressing need for robust, precise predictions of future conditions is a significant motivation for paleoclimate science, and current research questions frequently require Holocene reconstructions to be resolved at sub-centennial timescales. Increasingly, regional syntheses seek to identify synoptic-scale patterns similar to those defined from modern observations (seasonal, interannual, multi-decadal, etc.) or to compare with the output of climate model simulations. However, the age control on existing records, especially those more than about 20 years old, is often sufficient only for millennial-scale interpretation. Here we assess the age control for 84 published and unpublished records from lakes and meadows in the Great Basin, California, and desert southwest, and use Bayesian modeling to evaluate the 95% uncertainty ranges for the 42 best-dated records. In the Late Holocene, about half of the 42 records have <400-year mean uncertainty ranges; however, high-precision age control is especially critical for young records, used to develop an accurate understanding of a proxy’s response to known climate variations. In the Middle Holocene, records vary from 400 to >800-year mean uncertainty and records of the Early Holocene have 600- to >1400-year mean uncertainty ranges. We find that the largest control on modeled uncertainties is dating density, with at least 2 dates/kyr being optimal and suggest obtaining “range-finder” dates at the onset of a study to better predict the total number of dates needed for an adequate age model. Such a density avoids a commonly observed phenomenon of significant peaks in uncertainty arising in gaps between age control points. Analysis of the uncertainties associated with proxy shifts reveal that more than half are >400 years. Although such large uncertainties currently prevent sub-centennial interpretations in most cases, increased dating density, strategic use of limited funds (including budgeting for a 2 date/kyr minimum at the proposal stage), construction of age-depth models with Bayesian methods, and critical evaluation of chronological uncertainty will shed light on past climate variability at finer timescales, enhancing our understanding of global and regional drivers of western U.S. climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Calibration and validation of the foundation for a multiphase strength model for tin

In this work, the Common Model of Multi-phase Strength and Equation of State (CMMP) model was applied to tin. Specifically, calibrations of the strength-specific elements of the CMMP foundation were developed with a combination of experiments and theory, and then the model was validated experimentally. The first element of the foundation is a multi-phase analytic treatment of the melt temperature and the shear modulus for the solid phases. These models were parameterized for each phase based on ab initio calculations using the software VASP (Vienna Ab initio Simulations Package) based on density functional theory. The shear modulus model for the ambient phase was validated with ultrasonic sound speed measurements as a function of pressure and temperature. The second element of the foundation is a viscoplastic strength model for the phase, upon which strength for inaccessible higher-pressure phases can be scaled as necessary. The stress–strain response of tin was measured at strain rates of 10 -3 to 3 x 10 3 s -1 and temperatures ranging from 87 to 373 K. The Preston–Tonks–Wallace (PTW) strength model was fit to that data using Bayesian model calibration. For validation, six forward and two reverse Taylor impact experiments were performed at different velocities to measure large plastic deformation of tin at strain rates up to ⁠10 5 s -1 . The PTW model accurately predicted the deformed shapes of the cylinders, with modest discrepancies attributed to the inability of PTW to capture the effects of twinning and dynamic recrystallization. Some material in the simulations of higher velocity Taylor cylinders reached the melting temperature, thus testing the multiphase model because of the presence of a second phase, the liquid. In simulations using a traditional modeling approach, the abrupt reduction of strength upon melt resulted in poor predictions of the deformed shape and non-physical temperatures. With CMMP, the most deformed material points evolved gradually to a mixed solid–liquid but never a fully liquid state, never fully lost strength, stayed at the melt temperature as the latent heat of fusion was absorbed, and predicted the deformed shape well.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Calibration and validation of the foundation for a multiphase strength model for tin

In this work, the Common Model of Multi-phase Strength and Equation of State (CMMP) model was applied to tin. Specifically, calibrations of the strength-specific elements of the CMMP foundation were developed with a combination of experiments and theory, and then the model was validated experimentally. The first element of the foundation is a 10 multi-phase analytic treatment of the melt temperature and the shear modulus for the solid phases. These models were parameterized for each phase based on ab initio calculations using the software VASP (Vienna Ab initio Simulations Package) based on density functional theory (DFT). The shear modulus model for the ambient β phase was validated with ultrasonic sound speed measurements as a function of pressure and temperature. The second element of the foundation is a viscoplastic strength model for the β phase, upon which strength for inaccessible higher-pressure phases can be scaled as necessary. The stress-strain response of tin was measured at strain rates of 10 -3 to 3 x 10 3 s -1 and temperatures ranging from 87 to 373 K. The Preston-Tonks-Wallace (PTW) strength model was fit to that data using Bayesian model calibration. For validation, six forward and two reverse Taylor impact experiments were performed at different velocities to measure large plastic deformation of tin at strain rates up to 10 5 s -1 . The PTW model accurately predicted the deformed shapes of the cylinders, with modest discrepancies attributed to the inability 20 of PTW to capture the effects of twinning and dynamic recrystallization. Some material in the simulations of higher velocity Taylor cylinders reached the melting temperature, thus testing the multiphase model because of the presence of a second phase, the liquid. In simulations using a traditional modeling approach, the abrupt reduction of strength upon melt resulted in poor predictions of the deformed shape and non-physical temperatures. With CMMP, the most deformed material points evolved gradually to a mixed solid-liquid but never fully liquid state, never fully lost strength, 25 stayed at the melt temperature as the latent heat of fusion was absorbed, and predicted the deformed shape well.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Evaluation of Deep Learning Model Architectures for Point-of-Care Ultrasound Diagnostics

Point-of-care ultrasound imaging is a critical tool for patient triage during trauma for diagnosing injuries and prioritizing limited medical evacuation resources. Specifically, an eFAST exam evaluates if there are free fluids in the chest or abdomen but this is only possible if ultrasound scans can be accurately interpreted, a challenge in the pre-hospital setting. In this effort, we evaluated the use of artificial intelligent eFAST image interpretation models. Widely used deep learning model architectures were evaluated as well as Bayesian models optimized for six different diagnostic models: pneumothorax (i) B- or (ii) M-mode, hemothorax (iii) B- or (iv) M-mode, (v) pelvic or bladder abdominal hemorrhage and (vi) right upper quadrant abdominal hemorrhage. Models were trained using images captured in 27 swine. Using a leave-one-subject-out training approach, the MobileNetV2 and DarkNet53 models surpassed 85% accuracy for each M-mode scan site. The different B-mode models performed worse with accuracies between 68% and 74% except for the pelvic hemorrhage model, which only reached 62% accuracy for all model architectures. These results highlight which eFAST scan sites can be easily automated with image interpretation models, while other scan sites, such as the bladder hemorrhage model, will require more robust model development or data augmentation to improve performance. With these additional improvements, the skill threshold for ultrasound-based triage can be reduced, thus expanding its utility in the pre-hospital setting.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Model orthogonalization and Bayesian forecast mixing via principal component analysis

One can improve predictability in the unknown domain by combining forecasts of imperfect complex computational models using a Bayesian statistical machine learning framework. In many cases, however, the models used in the mixing process are similar. In addition to contaminating the model space, the existence of such similar, or even redundant, models during the multimodeling process can result in misinterpretation of results and deterioration of predictive performance. In this paper we describe a method based on the principal component analysis that eliminates model redundancy. We show that by adding model orthogonalization to the proposed Bayesian model combination framework, one can arrive at better prediction accuracy and reach excellent uncertainty quantification performance.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Precision mass measurement of lightweight self-conjugate nucleus 80 Zr

Protons and neutrons in the atomic nucleus move in shells analogous to the electronic shell structures of atoms. The nuclear shell structure varies due to changes of the nuclear mean field with the number of neutrons N and protons Z, and these variations can be probed by measuring mass differences between nuclei. The N=Z=40 self-conjugate nucleus 80 Zr is of particular interest as its proton and neutron shell structures are expected to be very similar, and its ground state is highly deformed. Here, we provide evidence for the existence of a deformed double shell closure in 80Zr through high precision Penning trap mass measurements of 80-83 Zr. Our mass values show that 80Zr is significantly lighter, and thus more strongly bound than predicted. This can be attributed to the deformed shell closure at N=Z=40 and the large Wigner energy. A statistical Bayesian model mixing analysis employing several global nuclear mass models demonstrates difficulties with reproducing the observed mass anomaly using current theory.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

The Global LAnd Surface Satellite (GLASS) evapotranspiration product Version 5.0: Algorithm development and preliminary validation

An accurate estimation of spatially and temporally continuous global terrestrial evapotranspiration (ET) is essential in the assessment of surface energy, water and carbon cycles. The Global LAnd Surface Satellite (GLASS) ET product Version 4.0 (v4.0) based on the Bayesian model averaging (BMA) method was generated to estimate global terrestrial ET. However, certain uncertainty for the GLASS ET product v4.0 limits its application. In this study, we introduced the deep neural networks (DNN) merging framework to improve terrestrial ET estimation for GLASS ET product Version 5.0 (v5.0) generation by integrating five satellite-derived ET products [Moderate Resolution Imaging Spectroradiometer (MODIS) ET product (MOD16), Shuttleworth–Wallace dual-source ET product (SW), Priestley–Taylor-based ET product (PT-JPL), modified satellite-based Priestley–Taylor ET product (MS-PT) and simple hybrid ET product (SIM)]. We compared the performance of DNN method against other merging methods, including GLASS ET algorithm v4.0 (BMA), the gradient boosting regression tree (GBRT) method and the random forest (RF) method, based on 195 global eddy covariance (EC) flux towers covering observations from 2000 through 2015. Validations indicated that the DNN had the highest accuracy among four merging methods across different land cover types, yielding the highest average determination coefficients (R 2 , 0.62), root-mean-squared-error (RMSE, 24.1 W/m 2 ) and Kling–Gupta efficiency (KGE, 0.77) with a of 99% confidence interval. Compared with GLASS ET algorithm v4.0, the DNN improved on the R 2 by approximately 7% (p < 0.01) and the KGE by 10%. Based on the DNN, we then generated 8-day GLASS ET product v5.0 globally with a 1 km spatial resolution from 2001 to 2015 driven by GLASS vegetation and surface net radiation (R n ) datasets and Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA2) datasets. Finally, this global terrestrial ET product provides a valuable dataset for monitoring regional and global water resources and environmental changes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

FlowPM: Distributed TensorFlow implementation of the FastPM cosmological N-body solver

Here, we present FlowPM, a Particle-Mesh (PM) cosmological N-body code implemented in Mesh-TensorFlow for GPU-accelerated, distributed, and differentiable simulations. We implement and validate the accuracy of a novel multi-grid scheme based on multiresolution pyramids to compute large-scale forces efficiently on distributed platforms. We explore the scaling of the simulation on large-scale supercomputers and compare it with corresponding Python based PM code, finding on an average 10x speed-up in terms of wallclock time. We also demonstrate how this novel tool can be used for efficiently solving large scale cosmological inference problems, in particular reconstruction of cosmological fields in a forward model Bayesian framework with hybrid PM and neural network forward model. We provide skeleton code for these examples and the entire code is publicly available at https://github.com/modichirag/flowpm[Formula presented].

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

The Attraction Indian Buffet Distribution

We propose the attraction Indian buffet distribution (AIBD), a distribution for binary feature matrices influenced by pairwise similarity information. Binary feature matrices are used in Bayesian models to uncover latent variables (i.e., features) that explain observed data. The Indian buffet process (IBP) is a popular exchangeable prior distribution for latent feature matrices. In the presence of additional information, however, the exchangeability assumption is not reasonable or desirable. The AIBD can incorporate pairwise similarity information, yet it preserves many properties of the IBP, including the distribution of the total number of features. Thus, much of the interpretation and intuition that one has for the IBP directly carries over to the AIBD. A temperature parameter controls the degree to which the similarity information affects feature-sharing between observations. Unlike other nonexchangeable distributions for feature allocations, the probability mass function of the AIBD has a tractable normalizing constant, making posterior inference on hyperparameters straight-forward using standard MCMC methods. A novel posterior sampling algorithm is proposed for the IBP and the AIBD. We demonstrate the feasibility of the AIBD as a prior distribution in feature allocation models and compare the performance of competing methods in simulations and an application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Probabilistic Programming for Transportable Source Characterization and Uncertainty Quantification of the North Korean Nuclear Tests 2006–2017

Here, we introduce a transportable technique to determine the yield and depth of burial (DOB) from seismic source spectra of underground nuclear explosions. We demonstrate this technique on the six declared North Korean nuclear tests. This approach derives source spectra in absolute units from regional phase (Pg) amplitudes by correcting the observations for geometric spreading, attenuation, and site amplification. We couple the source spectra and explosion source models with a probabilistic programming framework that integrates deep learning techniques and Bayesian modeling. This approach permits the exchange of information across various data categories to quantify both the data and model uncertainty. This technique stands out as an innovative use of broad‐area propagation models, making it transportable across various geologic settings. This method proves to be effective in scenarios with diverse and/or limited observational data, even when the source depth is unknown. We present new independent estimates of absolute yield and DOB that are consistent with the prior assessments, underscoring the potential of this method in enhancing transportable nuclear explosion monitoring capabilities.

58 GEOSCIENCES↗
DOE OSTI2020

Fast strength model characterization using Bayesian statistics

A variety of flow stress models exist with new models constantly being developed. These models aim to approximate the strength of materials in a variety of regimes from quasistatic loading through shock scenarios. All models contain an array of parameters which need to be tuned to the material under study. Some models perform well under limited conditions, requiring adjustment of the parameters when venturing outside of those predefined ranges. Other models perform well over a wide range of conditions with a set of parameters, but may be outperformed by other models optimized on a tighter range of conditions. Recent research by Los Alamos demonstrated the ability to optimize the Johnson Cook (JC) model using a set of 3 plate-impact experiments on Aluminum. They utilized Bayesian statistics and emulation to determine optimal parameters for the model with a quantification of parameter uncertainty. We present an extension of this capability to incorporate velocimetry from plate-impact tests, stress-strain data from split Hopkinson pressure bar and quasistatic compression tests, plus profiles from Taylor cylinders in a unified fashion. Statistically robust comparisons of the performance and uncertainty of different realizations of the JC flow stress model were carried out based on calibration to several possible combinations of these three different experiment types.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Singling out modified gravity parameters and data sets reveals a dichotomy between Planck and lensing

ABSTRACT An important route to testing general relativity (GR) at cosmological scales is usually done by constraining modified gravity (MG) parameters added to the Einstein perturbed equations. Most studies have analysed so far constraints on pairs of MG parameters, but here, we explore constraints on one parameter at a time while fixing the other at its GR value. This allows us to analyse various models while benefiting from a stronger constraining power from the data. We also explore which specific data sets are in tension with GR. We find that models with (μ = 1, η) and (μ, η = 1) exhibit a 3.9σ and 3.8σ departure from GR when using Planck18 + Supernovae type Ia (SNe) + Baryon acoustic oscillation (BAO), while (μ, η) shows a tension of 3.4σ. We find no tension with GR for models with the MG parameter Σ fixed to its GR value. Using a Bayesian model selection analysis, we find that some one-parameter MG models are moderately favoured over ΛCDM when using all data set combinations except Planck cosmic microwave background lensing and dark energy survey data. Namely, Planck18 shows a moderate tension with GR that only increases when adding any combination of redshift space distortion, SNe, or BAO. However, adding lensing diminishes or removes these tensions, which can be attributed to the ability of lensing in constraining the MG parameter Σ. The two overall groups of data sets are found to have a dichotomy when performing consistency tests with GR, which may be due to systematic effects, lack of constraining power, or modelling. These findings warrant further investigation using more precise data from ongoing and future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Code Release for “Unlocking Extreme Space Weather through Advanced Modeling of Legacy Vela Spacecraft” ER

The software being developed for this project has two mains aims. First, a Bayesian Model Calibration (BMC) procedure is being developed to calibrate a spallation model that simulates protons hitting a spacecraft orbiting earth to real data. The procedure will be developed for general data (there is no data release requested as part of this code release). Second, an inverse physics modeling task is being undertaken to map the number of resulting neutrons observed from this process to the expected number of protons that hit the model. This second task is of statistical interest; to publish on it, the code will need to be open source.

Murph, Alexander↗
DOE OSTI2022

Gaussian processes meet NeuralODEs: a Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data

We present a machine learning framework (GP-NODE) for Bayesian model discovery from partial, noisy and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of differentiable programming to propagate gradient information through ordinary differential equation solvers and perform Bayesian inference with respect to unknown model parameters using Hamiltonian Monte Carlo sampling and Gaussian Process priors over the observed system states. This allows us to exploit temporal correlations in the observed data, and efficiently infer posterior distributions over plausible models with quantified uncertainty. The use of the Finnish Horseshoe as a sparsity-promoting prior for free model parameters also enables the discovery of parsimonious representations for the latent dynamics. A series of numerical studies is presented to demonstrate the effectiveness of the proposed GP-NODE method including predator–prey systems, systems biology and a 50-dimensional human motion dynamical system. This article is part of the theme issue ‘Data-driven prediction in dynamical systems’.

Science & Technology - Other Topics↗
DOE OSTI2026

A Machine Learning based Approach of Estimating Equivalent Circuit Model Parameters at Different SoCs of Li-ion Batteries from Voltage Relaxation

Abstract: In this study, an approach of estimating the equivalent circuit model (ECM) parameters for Li-ion batteries (LIBs) is proposed based on the voltage value at different intervals while relaxing the LIB after discharge. The typical approach for estimating ECM parameters of a LIB is to conduct electrochemical impedance spectroscopy (EIS) measurements at different frequencies and fit them to a predefined circuit model, which requires additional measuring arrangements and specialized devices. The proposed methodology utilizes four different voltages at 0s, 60s, 360s, and 1800s alongside the specific state of charge (SoC) value for a specific constant discharge current value of ~1C until the relaxation stage to train and evaluate three regression-based machine learning models— Support Vector Regression (SVR), Extreme Gradient Boosting (XGBoost), and Gaussian Process Regression (GPR)—for estimating the ECM parameters of the selected model. Bayesian optimization is employed for hyperparameter tuning to achieve optimal performance for all the regressor models, among which, the GPR provided the best performance with the root-mean-squared error (RMSE) of less than 4x10-4 on average for the resistive components and less than 0.27 for capacitive components with excellent R2 scores. The simplicity of the approach enables it to eliminate the need for sophisticated measuring equipment and computation power.

Sagar, Md. Samiul [The University of Alabama (UA)]↗
DOE OSTI2025

Conin

SAND2025-07645O Conin is a Python library that supports constrained analysis of probabilistic graphical models (PGMs). It enables constrained inference and learning for hidden Markov models, Bayesian networks, dynamic Bayesian networks, and Markov networks. Conin interfaces with the pgmpy library to specify general probabilistic graphical models with a variety of optimization solvers to support learning and inference. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Hart, William [Sandia National Lab. (SNL-CA), Live↗