SEARCH · Engineering Papers

Results for “Bayesian methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Accurate and Accelerated Neuromorphic Network Design Leveraging A Bayesian Hyperparameter Pareto Optimization Approach

Neuromorphic systems allow for extremely efficient hardware implementations for neural networks (NNs). In recent years, several algorithms have been presented to train spiking NNs (SNNs) for neuromorphic hardware. However, SNNs often provide lower accuracy than their artificial NNs (ANNs) counterparts or require computationally expensive and slow training/inference methods. To close this gap, designers typically rely on reconfiguring SNNs through adjustments in the neuron/synapse model or training algorithm itself. Nevertheless, these steps incur significant design time, while still lacking the desired improvement in terms of training/inference times (latency). Designing SNNs that can mimic the accuracy of ANNs with reasonable training times is an exigent challenge in neuromorphic computing. In this work, we present an alternative approach that looks at such designs as an optimization problem rather than algorithm or architecture redesign. We develop a versatile multiobjective hyperparameter optimization (HPO) for automatically tuning HPs of two state-of-the-art SNN training algorithms, SLAYER and HYBRID. We emphasize that, to the best of our knowledge, this is the first work trying to improve SNNs’ computational efficiency, accuracy, and training time using an efficient HPO. We demonstrate significant performance improvements for SNNs on several datasets without the need to redesign or invent new training algorithms/architectures. Our approach results in more accurate networks with lower latency and, in turn, higher energy efficiency than previous implementations. In particular, we demonstrate improvement in accuracy and more than 5× reduction in the training/inference time for the SLAYER algorithm on the DVS Gesture dataset. In the case of HYBRID, we demonstrate 30% reduction in timesteps while surpassing the accuracy of the state-of-the-art networks on CIFAR10. Further, our analysis suggests that even a seemingly minor change in HPs could change the accuracy by 5 - 6×.

Parsa, Maryam↗

DOE OSTI2020

General Bayesian Inference over the Stiefel Manifold via the Givens Transform

We introduce here an approach based on the Givens representation for posterior inference in statistical models with orthogonal matrix parameters, such as factor models and probabilistic principal component analysis (PPCA). We show how the Givens representation can be used to develop practical methods for transforming densities over the Stiefel manifold into densities over subsets of Euclidean space. We demonstrate how to deal with issues arising from the topology of the Stiefel manifold and how to inexpensively compute the change-of-measure terms. We introduce an auxiliary parameter approach that limits the impact of topological issues. We provide both analysis of our methods and numerical examples demonstrating the effectiveness of the approach. We also discuss how our Givens representation can be used to define general classes of distributions over the space of orthogonal matrices. We then give demonstrations on several examples showing how the Givens approach performs in practice in comparison with other methods.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Monte Carlo Global QCD Analyses of the Pion Parton Distribution Functions

As the lightest hadron, the pion presents itself as a dichotomy. While being the pseudo Goldstone boson associated with chiral symmetry breaking, it is simultaneously regarded as the lightest pseudoscalar meson typically composed of constituent quark and antiquark. As the chiral symmetry shares the same global symmetry as QCD, studying the pion and its internal structure is key in understanding one of the four fundamental forces of nature, namely the quantum chromodynamic strong interaction. We study the pion's parton distribution functions (PDFs), which are universal quantities that describe the structure of the pion in terms of its constituent quarks, antiquarks, and gluons. Our goal is to discover what the available data reveal for these universal quantities, namely the PDFs. Through the use of factorization theorems and perturbative QCD, we use Monte Carlo (MC) methods to extract the PDFs from the available Drell-Yan (DY) and leading neutron (LN) data. While the DY process involves two hadrons colliding, the LN electroproduction involves an electron beam incident on a target nucleon. We can constrain well the pion PDFs at large momentum fraction using DY data, and at low momentum fraction using LN data. We also use threshold resummation in the DY process to gather predictable higher order terms associated with the soft gluon radiation because their contributions to the cross section are nontrivial. In this dissertation, we parametrize the pion PDFs and fit those parameters to the available data. We make use of Bayesian inference and use MC techniques to sample the parameter space. Three sets of results are presented. We first extract the pion PDFs by fitting the DY and LN data. Then, we include transverse momentum dependent DY data in conjunction with the DY and LN data to extract the pion PDFs. Finally, we apply various methods of threshold resummation to the DY cross section and extract pion PDFs. The pion PDFs presented here are the first global QCD analyses performed as well as the first MC extracted pion PDFs, which are at the forefront of the pion PDF community.

Barry, Patrick↗

DOE OSTI2022

Evaluation of automated stability testing in machining through closed-loop control and Bayesian machine learning

Here, this paper describes a system for automated identification of the optimal stable cutting parameters in milling through Bayesian machine learning and closed-loop control. The closed-loop control system consists of a process monitoring architecture, an analysis framework, and a feedback mechanism. The analysis framework consists of a Bayesian machine learning algorithm that learns a stability map given test results. The learned stability map is used to select parameters for stability testing using an expected improvement in the material removal rate criterion. The test parameters are communicated to the machine controller to complete the test cut through a feedback mechanism. The test cuts were monitored using an audio signal; the stability of the test cut was determined by analyzing the frequency content of the audio signal. The test result was fed back to the Bayesian learning algorithm to complete the loop. Experimental results demonstrate that the system can identify the optimal stable parameters without information about the cutting force model or the structural dynamics. The system provides a low-cost method for optimal stable parameter identification in an industrial environment.

Chatter↗

DOE OSTI2022

Variational encoder geostatistical analysis (VEGAS) with an application to large scale riverine bathymetry

Estimation of riverbed profiles, also known as bathymetry, plays a vital role in many applications, such as safe and efficient inland navigation, prediction of bank erosion, land subsidence, and flood risk management. The high cost and complex logistics of direct bathymetry surveys, i.e, depth imaging, have encouraged the use of indirect measurements such as surface flow velocities. However, estimating high-resolution bathymetry from indirect measurements is an inverse problem that can be computationally challenging. Here, we propose a reduced-order model (ROM) based approach that utilizes a variational autoencoder (VAE), a type of deep neural network with a narrow layer in the middle, to compress bathymetry and flow velocity information and accelerate bathymetry inverse problems from flow velocity measurements. In our application, the shallow-water equations (SWE) with appropriate boundary conditions (BCs), e.g., the discharge and/or the free surface elevation, constitute the forward problem, to predict flow velocity. Then, ROMs of the SWEs are constructed on a nonlinear manifold of low dimensionality through a variational encoder and the bathymetry inversion problem is derived on the low-dimensional latent space in a Hierarchical Bayesian setting. Further, the reformulation allows variational inference with a small number (e.g., $\mathscr{O}$ (100) of ROM runs and efficient uncertainty quantification. We have tested our inversion approach on a one-mile reach of the Savannah River, GA, USA. Once the neural network is trained (offline stage), the proposed technique can perform the inversion operation orders of magnitude faster than traditional inversion methods that are commonly based on linear projections, such as principal component analysis (PCA), or the principal component geostatistical approach (PCGA). Furthermore, tests show that the algorithm can estimate the bathymetry with good accuracy even with sparse flow velocity measurements.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

PRIME

SAND2021-0565 O PRIME is a modeling framework designed for the real-time characterization and forecasting of partially observed epidemics. The method is designed to help guide medical resource allocation in the early epoch of the outbreak. Characterization is the estimation of infection spread parameters using daily counts of symptomatic patients. The estimation problem is posed as one of Bayesian inference and solved using a Markov Chain Monte Carlo technique. The framework can accommodate multiple epidemic waves and can help identify different disease dynamics at the regional, state, and country levels. Examples are provided using publicly available COVID-19 data. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Safta, Cosmin↗

DOE OSTI2026

Iterative HOMER with uncertainties

We present iHOMER, an iterative version of the HOMER method to extract Lund fragmentation functions from experimental data. Through iterations, we address the information gap between latent and observable phase spaces and systematically remove bias. To quantify uncertainties on the inferred weights, we use a combination of Bayesian neural networks and uncertainty-aware regression. We find that the combination of iterations and uncertainty quantification produces well-calibrated weights that accurately reproduce the data distribution. A parametric closure test shows that the iteratively learned fragmentation function is compatible with the true fragmentation function.

Butter, Anja [Heidelberg Univ. (Germany); Sorbonne↗

DOE OSTI2021

An initial framework for the rapid qualification of long-term creep rupture strength via microstructural modeling

This report describes the development and testing of a new method for extrapolating short-term creep rupture test data to predict long-term rupture strength. The goal of this work is to reduce the time required to qualify new materials for nuclear service by reducing the lead time required for dedicated, long-term material testing to establish key long-term material properties. The new approach described here uses a physics-based model to predict the long-term creep rupture strength of 316H stainless steel using only short-term test data. The key idea is to use Bayesian inference to find the statistical distribution of the model parameters that best explain the short-term rupture data. Because the model is physics-based these parameters are all microstructural quantities that can be measured through detailed material characterization experiments. The Bayesian prior distributions provide a means for incorporating this characterization data into the final model to improve the accuracy of the long-term model predictions. However, where such data is not available the process still produces an accurate model based on an uniformed prior. Our hypothesis is that this approach more accurately extrapolates the short-term test data when compared to current, empirical methods. The report proves this hypothesis using actual long-term rupture data available for 316H, including tests with rupture times greater than 200,000 hours. The general approach developed here could be applied to other materials and other time-dependent material properties. Applying this new technique to develop long-term qualified material properties, potentially in conjunction with other accelerated qualification approaches like staggered qualification test programs, could greatly reduce the time required to qualify new materials for nuclear service.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

Differentially Private Synthesis and Sharing of Network Data Via Bayesian Exponential Random Graph Models

Abstract Network data often contain sensitive relational information. One approach to protecting sensitive information while offering flexibility for network analysis is to share synthesized networks based on the information in originally observed networks. We employ differential privacy (DP) and exponential random graph models (ERGMs) and propose the DP-ERGM method to synthesize network data. We apply DP-ERGM to two real-world networks. We then compare the utility of synthesized networks generated by DP-ERGM, the DyadWise Randomized Response (DWRR) approach, and the Synthesis through Conditional distribution of Edge given nodal Attribute (SCEA) approach. In general, the results suggest that DP-ERGM preserves the original information significantly better than two other approaches in network structural statistics and inference for ERGMs and latent space models. Furthermore, DP-ERGM satisfies node DP through modeling the global network structure with ERGM, a stronger notion of privacy than the edge DP under which DWRR and SCEA operate.

graph synthesis↗

DOE OSTI2024

Machine learning enhanced characterization and optimization of photonic cured MAPbI 3 for efficient perovskite solar cells

Photonic curing (PC) can facilitate high-speed perovskite solar cell (PSC) manufacturing because it uses high-intensity light pulses to crystallize perovskite films in milliseconds. However, optimizing PC conditions is challenging due to its many variables, and using power conversion efficiency (PCE) as the optimization metric is both time-consuming and labor-intensive. This work presents a machine learning (ML) approach to optimize PC conditions for fabricating methylammonium lead iodide (MAPbI 3 ) films by quantitatively comparing their ultraviolet-visible (UV-vis) absorbance spectra to thermal annealed (TA) films using four similarity metrics. We perform Bayesian optimization coupled with Gaussian process regression (BO-GP) to minimize the similarity metrics. Refining PC conditions using active learning based on BO-GP models, we achieve a PC MAPbI3 film with an absorbance spectrum closely matching a TA reference film, which is further verified by its crystalline and morphological properties. Thus, we demonstrate that the UV-vis absorption spectrum can accurately proxy film quality. Additionally, we use an AI-based segmentation model for a more efficient grain size analysis. However, when we use the optimized PC condition to fabricate PSCs, we find that interaction between MAPbI 3 and the hole transport layer (HTL) during PC critically degrades the PSC performance. By adding a buffer layer between the HTL and MAPbI 3 , the optimized PC PSCs produce a champion PCE of 11.8%, comparable to the TA reference of 11.7%. Using UV-vis similarity metrics instead of device PCE as the objective in our BO-GP method accelerates the optimization of PC processing conditions for MAPbI 3 films.

14 SOLAR ENERGY↗

DOE OSTI2026

Uncertainty quantification and reliability assessment for intermodal freight transportation

Intermodal freight optimization models support cost-effective, low-emission, and timely goods movement by coordinating trucks, rail, and barges. These models determine optimal flows, routing, and modal switches while respecting infrastructure and operational constraints. However, their real-world utility is often undermined by pervasive uncertainties-such as fluctuating transportation costs and emissions, variable terminal capacities, and uncertain freight demand-that distort key performance outcomes, including total system cost, carbon footprint, and transit time reliability. This study presents a structured framework for quantifying uncertainty in intermodal freight transportation (IFT) optimization. The framework evaluates how input uncertainty affects system performance and reliability, a critical need for ensuring that model-based decisions remain robust under real-world variability, especially amid volatile fuel prices, shifting demand, and growing disruptions. It integrates three complementary methods: (1) Sobol-based global sensitivity analysis to identify influential parameters affecting cost, emissions, and transit time, (2) Monte Carlo-based capacity perturbation analysis to assess robustness under probabilistic facility disruptions, and (3) Monte Carlo filtering with Bayesian inference to detect threshold-based performance vulnerabilities. The results highlight diesel truck unit cost as the dominant driver of variability. To improve system resilience, planners should prioritize uncertainty in fuel-related parameters when designing intermodal strategies.

Intermodal freight transportation↗

DOE OSTI2025

From Existing and New Nuclear and Astrophysical Constraints to Stringent Limits on the Equation of State of Neutron-Rich Dense Matter

Through continuous progress in nuclear theory and experiment and an increasing number of neutron-star (NS) observations, a multitude of information about the equation of state (EOS) for matter at extreme densities is available. To constrain the EOS across its entire density range, this information needs to be combined consistently. However, the impact and model dependency of individual observations vary. Given their growing number, assessing the various methods is crucial to compare the respective effects on the EOS and discover potential biases. For this purpose, we present a broad compendium of different constraints and apply them individually to a large set of EOS candidates within a Bayesian framework. Specifically, we explore different ways of how chiral effective field theory and perturbative quantum chromodynamics can be used to place a likelihood on EOS candidates. We also investigate the impact of nuclear experimental constraints, as well as different radio and x-ray observations of NS masses and radii. This is augmented by reanalyses of the existing data from binary neutron star coalescences, in particular of GW170817, with improved models for the tidal waveform and kilonova light curves, which we also utilize to construct a tight upper limit of 2.39 M ⊙ on the TOV mass based on GW170817’s remnant. Our diverse set of constraints is eventually combined to obtain stringent limits on NS properties. We organize the combination in a way to distinguish between constraints where the systematic uncertainties are deemed small and those that rely on less conservative assumptions. For the former, we find the radius of the canonical 1.4 M ⊙ neutron star to be R 1.4 = 12.2 6 − 0.91 + 0.80 km and the TOV mass at M TOV = 2.2 5 − 0.22 + 0.42 M ⊙ (95% credibility). Including all the presented constraints yields R 1.4 = 12.2 0 − 0.48 + 0.50 km and M TOV = 2.3 0 − 0.20 + 0.07 M ⊙ . When comparing these limits to individual data points, we find that the quoted radius of HESS J1731-347 displays noticeable tension with other constraints. Constraining microphysical properties of the EOS proves more challenging. For instance, the symmetry energy slope is restricted to L sym = 48 − 25 + 21 MeV , where this constraint is mainly dominated by our reanalysis of the PREX-II and CREX experiment. Published by the American Physical Society 2025

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

KMT-2019-BLG-1715: Planetary Microlensing Event with Three Lens Masses and Two Source Stars

We investigate the gravitational microlensing event KMT-2019-BLG-1715, the light curve of which shows two short-term anomalies from a caustic-crossing binary-lensing light curve: one with a large deviation and the other with a small deviation. We identify five pairs of solutions, in which the anomalies are explained by adding an extra lens or source component in addition to the base binary-lens model. We resolve the degeneracies by applying a method in which the measured flux ratio between the first and second source stars is compared with the flux ratio deduced from the ratio of the source radii. Applying this method leaves a single pair of viable solutions, in both of which the major anomaly is generated by a planetary-mass third body of the lens, and the minor anomaly is generated by a faint second source. A Bayesian analysis indicates that the lens comprises three masses: a planet-mass object with ∼2.6 M {sub J} and binary stars of K and M dwarfs lying in the galactic disk. We point out the possibility that the lens is the blend, and this can be verified by conducting high-resolution follow-up imaging for the resolution of the lens from the source.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

A Bayesian Approach for Estimating Uncertainty in Stochastic Economic Dispatch considering Wind Power Penetration

The increasing penetration of renewable energy resources in power systems, represented as random processes, converts the traditional deterministic economic dispatch problem into a stochastic one. To estimate the uncertainty in this stochastic economic dispatch problem for forecasting purposes, the conventional Monte-Carlo method is prohibitively time-consuming for practical applications. To overcome this problem, here we propose a novel Gaussian-process-emulator-based approach to quantify the uncertainty in the stochastic economic dispatch considering wind power penetration. Facing high-dimensional real-world data representing the correlated uncertainties from wind generation, a manifold-learning-based Isomap algorithm is proposed to efficiently represent the low-dimensional hidden probabilistic structure of the data. In this low-dimensional latent space, with Latin hypercube sampling as the computer experimental design, a Gaussian-process emulator is used, for the first time, to serve as a nonparametric, surrogate model for the original complicated stochastic economic dispatch model. This reduced-order representative allows us to evaluate the economic dispatch solver at sampled values with a negligible computational cost while maintaining a desirable accuracy. Simulation results conducted on the IEEE 118-bus test system reveal the impressive performance of the proposed method.

17 WIND ENERGY↗

DOE OSTI2025

Uncertainty Quantification for Neutron Shield Using Convolutional Neural Networks

Uncertainty quantification from radiation transport calculations was conducted using a Bayesian inference approach. A surrogate model, using a convolutional neural network, was employed to emulate the neutron fluence, which was simulated with a Monte Carlo radiation transport model. This allowed for a computationally cheap approach to evaluate input parameters and to sample their corresponding posterior probability distributions. Experimental data from the literature were employed to perform uncertainty quantification studies for concrete shields. As a result, the method is a nonintrusive approach that enables studies with multiple input parameters and can be applied to any radiation transport model.

Bayesian inference↗

DOE OSTI2024

Tokamak divertor plasma emulation with machine learning

Abstract Future tokamak devices that aim to create conditions relevant to power plant operations must consider strategies for mitigating damage to plasma facing components in the divertor. One of the goals of MAST-U tokamak operations is to inform these considerations by researching advanced divertor configurations that aid stable plasma detachment. Machine design, scenario planning and detachment control would all greatly benefit from tools that enable rapid calculation of scenario-relevant quantities given some input parameters. This paper presents a method for generating large, simulated scrape-off layer data sets, which was applied to generate a data set of steady-state Hermes-3 simulations of the MAST-U tokamak. A machine learning model was constructed using a Bayesian approach to hyperparameter optimisation to predict diagnosable output quantities given control-relevant input features. The resulting best-performing model, which is based on a feedforward neural network, achieves high accuracy when predicting electron temperature at the divertor target and carbon impurity radiation front position and runs in around 1 ms in inference mode. Techniques for interpreting the predictions made by the model were applied, and a high-resolution parameter scan of upstream conditions was performed to demonstrate the utility of rapidly generating accurate predictions using the emulator. This work represents a step forward in the design of machine learning-driven emulators of tokamak exhaust simulation codes in operational modes relevant to divertor detachment control and plasma scenario design.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

Voltage Violation Prediction in Unobservable Distribution Systems

Recently, distributed energy resources (DERs) such as photovoltaic (PV) systems have garnered significant attention due to their economic and environmental benefits. However, DERs can also pose new technical challenges to distribution system operation including under/over voltage issues. In this regard, voltage violation prediction (VVP) becomes an essential component of system operation as it enables proactive control strategies. Unfortunately, classical voltage monitoring techniques assume full availability of state measurements across all nodes in the system. In real-world scenarios, distribution systems are limited with few measurement devices, rendering the system unobservable. Therefore, this paper proposes a new Bayesian matrix completion (BMC) based VVP technique that accurately predicts the probability of nodal voltage violations in unobservable (and unbalanced) distribution systems. The proposed approach is tested via simulations on the IEEE 37 test system. Results show that the proposed method offers over 90% violation prediction accuracy with as low as 50% fraction of available data.

Abujubbeh, Mohammad↗

DOE OSTI2020

Host phylogeny matters: Examining sources of variation in infection risk by blood parasites across a tropical montane bird community in India

Abstract Background Identifying patterns and drivers of infection risk among host communities is crucial to elucidate disease dynamics and predict infectious disease risk in wildlife populations. Blood parasites of the genera Plasmodium and Haemoproteus are a diverse group of vector-borne protozoan parasites that affect bird populations globally. Despite their widespread distribution and exceptional diversity, factors underlying haemosporidian infection risk in wild bird communities remain poorly understood. While some studies have examined variation in avian haemosporidian risk, researchers have primarily focused on host ecological traits without considering host phylogenetic relationships. In this study, we employ a phylogenetically informed approach to examine the association between host ecological traits and haemosporidian infection risk in endemic bird communities in the Western Ghats Sky Islands. Methods We used parasite sequence data based on partial mitochondrial cytochrome b gene, that was amplified from genomic DNA extracted from 1177 birds (28 species) across the Western Ghats to assess infection of birds with haemosporidian parasites. We employed a Bayesian phylogenetic mixed effect modelling approach to test whether haemosporidian infection risk was affected by seven species-specific and four individual-level ecological predictors. We also examined the effect of host phylogenetic relationships on the observed patterns of variation in haemosporidian infection risk by estimating phylogenetic signal. Results Our study shows that host ecological traits and host phylogeny differentially influence infection risk by Plasmodium (generalist parasite) and Haemoproteus (specialist parasite). For Plasmodium , we found that sociality, sexual dimorphism and foraging strata were important ecological predictors. For Haemoproteus , patterns of infection risk among host species were associated with sociality, species elevation and individual body condition. Interestingly, variance in infection risk explained by host phylogeny was higher for Haemoproteus parasites compared to Plasmodium . Conclusions Our study highlights that while host ecological traits promoting parasite exposure and host susceptibility are important determinants of infection risk, host phylogeny also contributes substantially to predicting patterns of haemosporidian infection risk in multi-host communities. Importantly, infection risk is driven by joint contributions of host ecology and host phylogeny and studying these effects together could increase our ability to better understand the drivers of infection risk and predict future disease threats. Graphical abstract

59 BASIC BIOLOGICAL SCIENCES↗