Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian Inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Nonlinear sparse Bayesian learning for physics-based models

This paper addresses the issue of overfitting while calibrating unknown parameters of over-parameterized physics-based models with noisy and incomplete observations. Here, a semi-analytical Bayesian framework of nonlinear sparse Bayesian learning (NSBL) is proposed to identify sparsity among model parameters during Bayesian inversion. NSBL offers significant advantages over machine learning algorithm of sparse Bayesian learning (SBL) for physics-based models, such as 1) the likelihood function or the posterior parameter distribution is not required to be Gaussian, and 2) prior parameter knowledge is incorporated into sparse learning (i.e. not all parameters are treated as questionable). NSBL employs the concept of automatic relevance determination (ARD) to facilitate sparsity among questionable parameters through parameterized prior distributions. The analytical tractability of NSBL is enabled by employing Gaussian ARD priors and by building a Gaussian mixture-model approximation of the posterior parameter distribution that excludes the contribution of ARD priors. Subsequently, type-II maximum likelihood is executed using Newton's method whereby the evidence and its gradient and Hessian information are computed in a semi-analytical fashion. We show numerically and analytically that SBL is a special case of NSBL for linear regression models. Subsequently, a linear regression example involving multimodality in both parameter posterior pdf and model evidence is considered to demonstrate the performance of NSBL in cases where SBL is inapplicable. Next, NSBL is applied to identify sparsity among the damping coefficients of a mass-spring-damper model of a shear building frame. These numerical studies demonstrate the robustness and efficiency of NSBL in alleviating overfitting during Bayesian inversion of nonlinear physics-based models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Kernel learning backward SDE filter for data assimilation

In this paper, we develop a kernel learning backward SDE filter method to estimate the state of a stochastic dynamical system based on its partial noisy observations. A system of forward backward stochastic differential equations is used to propagate the state of the target dynamical model, and Bayesian inference is applied to incorporate the observational information. Further, to characterize the dynamical model in the entire state space, we introduce a kernel learning method to learn a continuous global approximation for the conditional probability density function of the target state by using discrete approximated density values as training data. Numerical experiments demonstrate that the kernel learning backward SDE is highly effective.

97 MATHEMATICS AND COMPUTING↗

Plasma-parameter dependence of ro-vibrational temperatures for H 2 in LHD divertor

We analyzed a thousand visible spectra of Fulcher-α band measured for divertor plasmas in Large Helical Device. With a coronal model and Bayesian inference, the population distribution of hydrogen molecule in the electronic ground state was estimated. The non-thermal population distribution was recovered with a two-temperature model, which has two sets of rotational and vibrational temperatures, as well as their mixture coefficient. The lower rotational temperature significantly changes according to the plasma parameters. Its nearly linear dependence on the electron density was found, which is consistent with previous works. The lower vibrational temperature also shows a small density dependence, as reported by a previous work. On the other hand, the higher rotational and vibrational temperatures as well as the mixture coefficient only show slight changes over the broad range of plasma parameters. These population parameters show a significant correlation; with higher electron density, all the temperatures and the fraction of the higher-temperature component increase simultaneously. In conclusion, this suggests that the electron impact plays an important role to determine the population distribution.

42 ENGINEERING↗

TENDL: Complete Nuclear Data Library for Innovative Nuclear Science and Technology

The TENDL library is now established as one of the major nuclear data libraries in the world, striving for completeness and quality of nuclear data files for all isotopes, evaluation methods, processing and applied performance. To reach this status, some basic principles have been applied which sets it apart from other libraries: reproducible dedicated evaluations when differential data are available, through determination of nuclear models implemented in TALYS and their parameters, completeness (with or without experimental data), format and processing standardization, automation of production and reproducibility. In this paper, we will outline how such an approach has become a reality, and recall some of the past successes since the first TENDL release in 2008. Next, we will demonstrate the performance of the latest TENDL releases for different application fields, as well as new approaches for uncertainty quantification based on Bayesian inference methods and possible differential and integral adjustments. Also, current limitations of the library performances due to modelling and needs for new and more precise experimental data will be outlined.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Numerical convergence and validation of the DIMP inverse particle transport model

The data integration with modeled predictions (DIMP) model is a promising inverse radiation transport method for solving the special nuclear material (SNM) holdup problem. Unlike previous methods, DIMP is a completely passive nondestructive assay technique that requires no initial assumptions regarding the source distribution or active measurement time. DIMP predicts the most probable source location and distribution through Bayesian inference and quasi-Newtonian optimization of predicted detector re-sponses (using the adjoint transport solution) with measured responses. DIMP performs well with for-ward hemispherical collimation and unshielded measurements, but several considerations are required when using narrow-view collimated detectors. DIMP converged well to the correct source distribution as the number of synthetic responses increased. DIMP also performed well for the first experimental validation exercise after applying a collimation factor, and sufficiently reducing the source search vol-ume's extent to prevent the optimizer from getting stuck in local minima. DIMP's simple point detector response function (DRF) is being improved to address coplanar false positive/negative responses, and an angular DRF is being considered for integration with the next version of DIMP to account for highly collimated responses. Overall, DIMP shows promise for solving the SNM holdup inverse problem, especially once an improved optimization algorithm is implemented.

42 ENGINEERING↗

Uncertainty quantification for Multiphase-CFD simulations of bubbly flows: a machine learning-based Bayesian approach supported by high-resolution experiments

In this paper, we developed a machine learning-based Bayesian approach to inversely quantify and reduce the uncertainties of multiphase computational fluid dynamics (MCFD) simulations for bubbly flows. The proposed approach is supported by high-resolution two-phase flow measurements, including those by double-sensor conductivity probes, high-speed imaging, and particle image velocimetry. Local distributions of key physical quantities of interest (QoIs), including the void fraction and phasic velocities, are obtained to support the Bayesian inference. In the process, the epistemic uncertainties of the closure relations are inversely quantified while the aleatory uncertainties from stochastic fluctuations of the system are evaluated based on experimental uncertainty analysis. The combined uncertainties are then propagated through the MCFD solver to obtain uncertainties of the QoIs, based on which probability-boxes are constructed for validation. The proposed approach relies on three machine learning methods: feedforward neural networks and principal component analysis for surrogate modeling, and Gaussian processes for model form uncertainty modeling. The whole process is implemented within the framework of an open-source deep learning library PyTorch with graphics processing unit (GPU) acceleration, thus ensuring the efficiency of the computation. The results demonstrate that with the support of high-resolution data, the uncertainties of MCFD simulations can be significantly reduced. The proposed approach has the potential for other applications that involve numerical models with empirical parameters.

42 ENGINEERING↗

Uncertainty quantification and reliability assessment for intermodal freight transportation

Intermodal freight optimization models support cost-effective, low-emission, and timely goods movement by coordinating trucks, rail, and barges. These models determine optimal flows, routing, and modal switches while respecting infrastructure and operational constraints. However, their real-world utility is often undermined by pervasive uncertainties-such as fluctuating transportation costs and emissions, variable terminal capacities, and uncertain freight demand-that distort key performance outcomes, including total system cost, carbon footprint, and transit time reliability. This study presents a structured framework for quantifying uncertainty in intermodal freight transportation (IFT) optimization. The framework evaluates how input uncertainty affects system performance and reliability, a critical need for ensuring that model-based decisions remain robust under real-world variability, especially amid volatile fuel prices, shifting demand, and growing disruptions. It integrates three complementary methods: (1) Sobol-based global sensitivity analysis to identify influential parameters affecting cost, emissions, and transit time, (2) Monte Carlo-based capacity perturbation analysis to assess robustness under probabilistic facility disruptions, and (3) Monte Carlo filtering with Bayesian inference to detect threshold-based performance vulnerabilities. The results highlight diesel truck unit cost as the dominant driver of variability. To improve system resilience, planners should prioritize uncertainty in fuel-related parameters when designing intermodal strategies.

Intermodal freight transportation↗

Emulator-based Bayesian calibration of a subglacial drainage model

Subglacial drainage models, often motivated by the relationship between hydrology and ice flow, sensitively depend on numerous unconstrained parameters. We explore using borehole water-pressure time series to calibrate the uncertain parameters of a popular subglacial drainage model, taking a Bayesian perspective to quantify the uncertainty in parameter estimates and in the calibrated model predictions. To reduce the computation time associated with Markov Chain Monte Carlo sampling, we construct a fast Gaussian process emulator to stand in for the subglacial drainage model. We first carry out a calibration experiment using synthetic observations consisting of model simulations with hidden parameter values as a demonstration of the method. Using real borehole water pressures measured in western Greenland, we find meaningful constraints on four of the eight model parameters and a factor-of-three reduction in uncertainty of the calibrated model predictions. These experiments illustrate Gaussian process-based Bayesian inference as a useful tool for calibration and uncertainty quantification of complex glaciological models using field data. However, significant differences between the calibrated model and the borehole data suggest that structural limitations of the model, rather than poorly constrained parameters or computational cost, remain the most important constraint on subglacial drainage modelling.

58 GEOSCIENCES↗

Energetic and dynamic analysis of transport of Na + and K + through a cyclic peptide nanotube in water and in lipid bilayers

Potential of mean force (PMF) profiles and position-dependent diffusion coefficients of Na + and K + are calculated to elucidate the translocation of ions through a cyclic peptide nanotube, composed of 8 × cyclo[-(D-Leu-Trp) 4- ] rings, in water and in hydrated DMPC bilayers. The PMF profiles and PMF decomposition analysis for the monovalent cations show that favorable interactions of the cations with the CPN as well as the lipid bilayer and dehydration free energy penalties are two major competing factors which determine the free energy surface for ion transport through CPNs both in water and lipid bilayers, and that the selectivity of CPNs to cations mainly arises from favorable interaction energies of cations with CPNs and lipid bilayers that are more dominant than the dehydration penalties. Calculations of the position-dependent diffusion coefficients and dynamic friction kernels of the cations indicate that the dehydration process along with the molecular rearrangements occurring outside the channel and the coupling of the ion motions with the chain-structured water movements inside the channel lead to decrease of the diffusion coefficients far away from the channel entrance and also reduced coefficients inside the channel. Here the PMF and diffusivity profiles for Na + and K + reveal that the energetics of ion transport through the CPN are governed by global interactions of ions with all the components in the system while the diffusivity of ions through the channel is mostly determined by local interactions of ions with the confined water molecules inside the channel. Comparison of Na + and K + ion distributions based on overdamped Brownian dynamics simulations based on the PMF and diffusivity profiles with the corresponding results from molecular dynamics shows good agreement, indicating accuracy of the Bayesian inference method for determining diffusion coefficients in this application. In addition this work shows that position-dependent diffusion coefficients of ions are required to explain the dynamics and conductance of ions through the CPN properly.

36 MATERIALS SCIENCE↗

Constraining Bedrock Groundwater Residence Times in a Mountain System With Environmental Tracer Observations and Bayesian Uncertainty Quantification

Groundwater residence time distributions provide fundamental insights on the hydrological processes within watersheds. Yet, observations that can constrain groundwater residence times over broad timescales remain scarce in mountain catchment studies. We use environmental tracers (CFC-12, SF 6 , 3 H, and 4 He) to investigate groundwater residence times along a hillslope in the East River Watershed, Colorado, USA. We develop a Bayesian inference framework that applies a Markov-chain Monte Carlo (MCMC) approach to estimate noble gas recharge temperature, elevation, and excess-air parameters and the resulting environmental tracer concentrations. MCMC is then used to propagate the environmental tracer uncertainties to estimates of groundwater mean residence times inferred with lumped parameter models. All samples contain 3 H, CFC-12, and SF 6 in addition to terrigenic 4 He, suggesting a mixture of water characterized by modern and premodern residence times. 4He exponential mean residence times range from hundreds of years at the upslope well to thousands of years at the toe-slope well assuming average crustal production rates. We find that binary mixing residence time distributions with separate young and old mixing fractions are needed to predict the 4 He, CFC-12, SF 6 , and 3 H observations, supporting the importance of flow path mixing in this bedrock system. Our findings that the fractured bedrock hosts groundwater with a mixture of residence times ranging from decades to millennia suggest variable recharge dynamics and flow path mixing along the hillslope and highlight the importance of characterizing groundwater systems with observations that are sensitive to transport over a broad range of residence times.

54 ENVIRONMENTAL SCIENCES↗

Prediction of the SYM-H Index Using a Bayesian Deep Learning Method With Uncertainty Quantification

We propose a novel deep learning framework, named SYMHnet, which employs a graph neural network and a bidirectional long short-term memory network to cooperatively learn patterns from solar wind and interplanetary magnetic field parameters for short-term forecasts of the SYM-H index based on 1- and 5-min resolution data. SYMHnet takes, as input, the time series of the parameters' values provided by NASA's Space Science Data Coordinated Archive and predicts, as output, the SYM-H index value at time point t + w hours for a given time point t where w is 1 or 2. By incorporating Bayesian inference into the learning framework, SYMHnet can quantify both aleatoric (data) uncertainty and epistemic (model) uncertainty when predicting future SYM-H indices. Experimental results show that SYMHnet works well at quiet time and storm time, for both 1- and 5-min resolution data. The results also show that SYMHnet generally performs better than related machine learning methods. For example, SYMHnet achieves a forecast skill score (FSS) of 0.343 compared to the FSS of 0.074 of a recent gradient boosting machine (GBM) method when predicting SYM-H indices (1 hr in advance) in a large storm (SYM-H = -393 nT) using 5-min resolution data. When predicting the SYM-H indices (2 hr in advance) in the large storm, SYMHnet achieves an FSS of 0.553 compared to the FSS of 0.087 of the GBM method. In addition, SYMHnet can provide results for both data and model uncertainty quantification, whereas the related methods cannot.

79 ASTRONOMY AND ASTROPHYSICS↗

Deducing subnanometer cluster size and shape distributions of heterogeneous supported catalysts

Abstract Infrared (IR) spectra of adsorbate vibrational modes are sensitive to adsorbate/metal interactions, accurate, and easily obtainable in-situ or operando. While they are the gold standards for characterizing single-crystals and large nanoparticles, analogous spectra for highly dispersed heterogeneous catalysts consisting of single-atoms and ultra-small clusters are lacking. Here, we combine data-based approaches with physics-driven surrogate models to generate synthetic IR spectra from first-principles. We bypass the vast combinatorial space of clusters by determining viable, low-energy structures using machine-learned Hamiltonians, genetic algorithm optimization, and grand canonical Monte Carlo calculations. We obtain first-principles vibrations on this tractable ensemble and generate single-cluster primary spectra analogous to pure component gas-phase IR spectra. With such spectra as standards, we predict cluster size distributions from computational and experimental data, demonstrated in the case of CO adsorption on Pd/CeO 2 (111) catalysts, and quantify uncertainty using Bayesian Inference. We discuss extensions for characterizing complex materials towards closing the materials gap.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Embedding physics domain knowledge into a Bayesian network enables layer-by-layer process innovation for photovoltaics

Process optimization of photovoltaic devices is a time-intensive, trial-and-error endeavor, which lacks full transparency of the underlying physics and relies on user-imposed constraints that may or may not lead to a global optimum. Herein, we demonstrate that embedding physics domain knowledge into a Bayesian network enables an optimization approach for gallium arsenide (GaAs) solar cells that identifies the root cause(s) of underperformance with layer-by-layer resolution and reveals alternative optimal process windows beyond traditional black-box optimization. Our Bayesian network approach links a key GaAs process variable (growth temperature) to material descriptors (bulk and interface properties, e.g., bulk lifetime, doping, and surface recombination) and device performance parameters (e.g., cell efficiency). For this purpose, we combine a Bayesian inference framework with a neural network surrogate device-physics model that is 100× faster than numerical solvers. With the trained surrogate model and only a small number of experimental samples, our approach reduces significantly the time-consuming intervention and characterization required by the experimentalist. As a demonstration of our method, in only five metal organic chemical vapor depositions, we identify a superior growth temperature profile for the window, bulk, and back surface field layer of a GaAs solar cell, without any secondary measurements, and demonstrate a 6.5% relative AM1.5G efficiency improvement above traditional grid search methods.

14 SOLAR ENERGY↗

On-the-fly active learning of interpretable Bayesian force fields for atomistic rare events

Abstract Machine learned force fields typically require manual construction of training sets consisting of thousands of first principles calculations, which can result in low training efficiency and unpredictable errors when applied to structures not represented in the training set of the model. This severely limits the practical application of these models in systems with dynamics governed by important rare events, such as chemical reactions and diffusion. We present an adaptive Bayesian inference method for automating the training of interpretable, low-dimensional, and multi-element interatomic force fields using structures drawn on the fly from molecular dynamics simulations. Within an active learning framework, the internal uncertainty of a Gaussian process regression model is used to decide whether to accept the model prediction or to perform a first principles calculation to augment the training set of the model. The method is applied to a range of single- and multi-element systems and shown to achieve a favorable balance of accuracy and computational efficiency, while requiring a minimal amount of ab initio training data. We provide a fully open-source implementation of our method, as well as a procedure to map trained models to computationally efficient tabulated force fields.

36 MATERIALS SCIENCE↗

Constraining neutron-star matter with microscopic and macroscopic collisions

Interpreting high-energy, astrophysical phenomena, such as supernova explosions or neutron-star collisions, requires a robust understanding of matter at supranuclear densities. However, our knowledge about dense matter explored in the cores of neutron stars remains limited. Fortunately, dense matter is not probed only in astrophysical observations, but also in terrestrial heavy-ion collision experiments. Here we use Bayesian inference to combine data from astrophysical multi-messenger observations of neutron stars and from heavy-ion collisions of gold nuclei at relativistic energies with microscopic nuclear theory calculations to improve our understanding of dense matter. We find that the inclusion of heavy-ion collision data indicates an increase in the pressure in dense matter relative to previous analyses, shifting neutron-star radii towards larger values, consistent with recent observations by the Neutron Star Interior Composition Explorer mission. Our findings show that constraints from heavy-ion collision experiments show a remarkable consistency with multi-messenger observations and provide complementary information on nuclear matter at intermediate densities. This work combines nuclear theory, nuclear experiment and astrophysical observations, and shows how joint analyses can shed light on the properties of neutron-rich supranuclear matter over the density range probed in neutron stars.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Explaining the trends and variability in the United States tornado records using climate teleconnections and shifts in observational practices

The annual frequency of tornadoes during 1950–2018 across the major tornado-impacted states were examined and modeled using anthropogenic and large-scale climate covariates in a hierarchical Bayesian inference framework. Anthropogenic factors include increases in population density and better detection systems since the mid-1990s. Large-scale climate variables include El Niño Southern Oscillation (ENSO), Southern Oscillation Index (SOI), North Atlantic Oscillation (NAO), Pacific Decadal Oscillation (PDO), Arctic Oscillation (AO), and Atlantic Multi-decadal Oscillation (AMO). The model provides a robust way of estimating the response coefficients by considering pooling of information across groups of states that belong to Tornado Alley, Dixie Alley, and Other States, thereby reducing their uncertainty. The influence of the anthropogenic factors and the large-scale climate variables are modeled in a nested framework to unravel secular trend from cyclical variability. Population density explains the long-term trend in Dixie Alley. The step-increase induced due to the installation of the Doppler Radar systems explains the long-term trend in Tornado Alley. NAO and the interplay between NAO and ENSO explained the interannual to multi-decadal variability in Tornado Alley. PDO and AMO are also contributing to this multi-time scale variability. SOI and AO explain the cyclical variability in Dixie Alley. This improved understanding of the variability and trends in tornadoes should be of immense value to public planners, businesses, and insurance-based risk management agencies.

54 ENVIRONMENTAL SCIENCES↗

Mapping brucellosis risk in Kenya and its implications for control strategies in sub-Saharan Africa

In Sub-Saharan Africa (SSA), effective brucellosis control is limited, in part, by the lack of long-term commitments by governments to control the disease and the absence of reliable national human and livestock population-based data to inform policies. Therefore, we conducted a study to establish the national prevalence and develop a risk map for Brucella spp. in cattle to contribute to plans to eliminate the disease in Kenya by the year 2040. We randomly generated 268 geolocations and distributed them across Kenya, proportionate to the area of each of the five agroecological zones and the associated cattle population. Cattle herds closest to each selected geolocation were identified for sampling. Up to 25 cattle were sampled per geolocation and a semi-structured questionnaire was administered to their owners. We tested 6,593 cattle samples for Brucella immunoglobulin G (IgG) antibodies using an Enzyme-linked immunosorbent assay (ELISA). We assessed potential risk factors and performed spatial analyses and prevalence mapping using approximate Bayesian inference implemented via the integrated nested Laplace approximation (INLA) method. The national Brucella spp. prevalence was 6.8% (95% CI: 6.2–7.4%). Exposure levels varied significantly between agro-ecological zones, with a high of 8.5% in the very arid zone with the lowest agricultural potential relative to a low of 0.0% in the agro-alpine zone with the highest agricultural potential. Additionally, seroprevalence increased with herd size, and the odds of seropositivity were significantly higher for females and adult animals than for males or calves. Similarly, animals with a history of abortion, or with multiple reproductive syndromes had higher seropositivity than those without. At the herd level, the risk of Brucella spp. transmission was higher in larger herds, and herds with a history of reproductive problems such as abortion, giving birth to weak calves, or having swollen testes. Geographic localities with high Brucella seroprevalence occurred in northern, eastern, and southern regions of Kenya all primarily characterized by semi-arid or arid agro-ecological zones dominated by livestock pastoralism interspersed with vast areas with mixed livestock-wildlife systems. The large spatial extent of our survey provides compelling evidence for the widespread geographical distribution of brucellosis risk across Kenya in a manner easily understandable for policymakers. Our findings can provide a basis for risk-stratified pilot studies aiming to investigate the cost-effectiveness and efficacy of singular and combined preventive intervention strategies that seek to inform Kenya’s Brucellosis Control Policy.

60 APPLIED LIFE SCIENCES↗