SEARCH · Engineering Papers

Results for “Bayesian approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

DOE OSTI2015

Principles of Bayesian Ensemble Creation: Theoretical and Empirical Observations

Bayesian methods are theoretically optimal given their underlying assumptions. Bayesian model averaging (BMA) is generally considered the standard model for creating ensembles of learners using Bayesian methods, but this technique is often out-performed by more ad hoc methods in empirical studies. It has been proposed that Bayesian model averaging struggles in practice because it accounts for uncertainty about which model is the data-generating model but still operates under the assumption that only one of them is. Thus, BMA is unable to enrich the hypothesis space as effectively as other ensemble creation methods, serving as a form of optimal model selection, not optimal model combination. This work provides empirical verification for this hypothesis using both synthetic and real-world data. We propose several different approaches for Bayesian model combination, and demonstrate that they overcome this problem with BMA. We empirically show that even the most simplistic of Bayesian model combination strategies can compete with the traditional ad hoc techniques of bagging, boosting and stacking, as well as significantly outperforming BMA over a wide variety of cases. We also explore the implications of this observation as it relates to the effectiveness of ensemble learning.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Uncertainty Quantification for Neutron Shield Using Convolutional Neural Networks

Uncertainty quantification from radiation transport calculations was conducted using a Bayesian inference approach. A surrogate model, using a convolutional neural network, was employed to emulate the neutron fluence, which was simulated with a Monte Carlo radiation transport model. This allowed for a computationally cheap approach to evaluate input parameters and to sample their corresponding posterior probability distributions. Experimental data from the literature were employed to perform uncertainty quantification studies for concrete shields. As a result, the method is a nonintrusive approach that enables studies with multiple input parameters and can be applied to any radiation transport model.

Bayesian inference↗

DOE OSTI2021

Application of an automated machine learning-genetic algorithm (AutoML-GA) coupled with computational fluid dynamics simulations for rapid engine design optimization

In recent years, the use of machine learning-based surrogate models for computational fluid dynamics (CFD) simulations has emerged as a promising technique for reducing the computational cost associated with engine design optimization. However, such methods still suffer from drawbacks. One main disadvantage is that the default machine learning (ML) hyperparameters are often severely suboptimal for a given problem. This has often been addressed by manually trying out different hyperparameter settings, but this solution is ineffective in case of a high-dimensional hyperparameter space. Besides this problem, the amount of data needed for training is also not known a priori. In response to these issues that need to be addressed, the present work describes and validates an automated active learning approach, AutoML-GA, for surrogate-based optimization of internal combustion engines. In this approach, a Bayesian optimization technique is used to find the best machine learning hyperparameters based on an initial dataset obtained from a small number of CFD simulations. Subsequently, a genetic algorithm is employed to locate the design optimum on the ML surrogate surface. In the vicinity of the design optimum, the solution is refined by repeatedly running CFD simulations at the projected optima and adding the newly obtained data to the training dataset. It is demonstrated that AutoML-GA leads to a better optimum with a lower number of CFD simulations, compared to the use of default hyperparameters. The proposed framework offers the advantage of being a more hands-off approach that can be readily utilized by researchers and engineers in industry who do not have extensive machine learning expertise.

Owoyele, Opeoluwa↗

DOE OSTI2017

Hierarchical calibration and validation for modeling bench-scale solvent-based carbon capture. Part 1: Non-reactive physical mass transfer across the wetted wall column

A hierarchical model calibration and validation are proposed here for quantifying the confidence level of mass transfer prediction using a computational fluid dynamics (CFD) model, where the solvent-based carbon dioxide (CO 2 ) capture is simulated and the predicted results are compared to the corresponding bench-scale experimental data. Two unit problems with an increasing level of complexity are proposed to break down the complex physical/chemical processes of solvent-based CO 2 capture into relatively simpler problems to separate the effects of physical transport and chemical reaction. This paper focuses on the calibration and validation of the first unit problem, i.e., the CO 2 mass transfer across a falling ethanolamine (MEA) film in the absence of chemical reaction. This problem is investigated both experimentally and numerically using non-reactive nitrous oxide (N 2 O) as a surrogate for CO 2 . To capture motion of the gas-liquid interface, a volume of fluid method is employed with a one-fluid formulation to compute the mass transfer between the two phases. Parallel bench-scale experiments are designed and conducted to validate and calibrate the CFD models using a general Bayesian calibration approach. Two important transport parameters, Henry's constant and gas diffusivity, are calibrated to produce the posterior distributions, which will be used as input for the second unit problem to address the chemical absorption of CO 2 across the MEA falling film, where both mass transfer and chemical reaction are involved. Finally, mass transfer coefficients predicted by CFD are also compared with those predicted by the traditional/empirical correlations under both steady and wavy falling film conditions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Improvement of two-phase closure models in CTF using Bayesian inference

Under the Consortium for Advanced Simulation of Light Water Reactors (CASL) program, extensive capabilities have been developed in CTF to analyze light-water reactors (LWRs) for normal operating conditions, departure from nucleate boiling (DNB), and system transients. However, further improvements are required in the modeling and simulation of boiling water reactors (BWRs), which is a focus of the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. In this work, CTF validation results were used to optimize selected modeling coefficients by calibrating to experimental data using a Bayesian inference approach. Here, calibration studies were conducted to improve (vapor) void fraction prediction without worsening the two-phase pressure drop prediction, as well as to improve the two-phase pressure drop prediction. Calibration was performed for interfacial drag and wall shear models. Surrogates were developed to alleviate the computational expense required for sampling the parameter space using Markov chain Monte Carlo (MCMC). An assessment performed with calibrated models demonstrated an improvement of CTF in its prediction of key parameters such as void fraction and two-phase pressure drop.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2016

A Demonstration of Concrete Structural Health Monitoring Framework for Degradation due to Alkali-Silica Reaction

Assessment and management of aging concrete structures in nuclear power plants require a more systematic approach than simple reliance on existing code margins of safety. Structural health monitoring of concrete structures aims to understand the current health condition of a structure based on heterogeneous measurements to produce high-confidence actionable information regarding structural integrity that supports operational and maintenance decisions. This ongoing research project is seeking to develop a probabilistic framework for health diagnosis and prognosis of aging concrete structures in a nuclear power plant that is subjected to physical, chemical, environment, and mechanical degradation. The proposed framework consists of four elements: monitoring, data analytics, uncertainty quantification and prognosis. This report focuses on degradation caused by ASR (alkali-silica reaction). Controlled specimens were prepared to develop accelerated ASR degradation. Different monitoring techniques – thermography, digital image correlation (DIC), mechanical deformation measurements, nonlinear impact resonance acoustic spectroscopy (NIRAS), and vibro-acoustic modulation (VAM) -- were used to detect the damage caused by ASR. Heterogeneous data from the multiple techniques was used for damage diagnosis and prognosis, and quantification of the associated uncertainty using a Bayesian network approach. Additionally, MapReduce technique has been demonstrated with synthetic data. This technique can be used in future to handle large amounts of observation data obtained from the online monitoring of realistic structures.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Demonstration of an AI-driven workflow for dynamic x-ray spectroscopy

X-ray absorption near edge structure (XANES) spectroscopy is a powerful technique for characterizing the chemical state and symmetry of individual elements within materials, but requires collecting data at many energy points which can be time-consuming. While adaptive sampling methods exist for efficiently collecting spectroscopic data, they often lack domain-specific knowledge about the structure of XANES spectra. Here we demonstrate a knowledge-injected Bayesian optimization approach for adaptive XANES data collection that incorporates understanding of spectral features like absorption edges and pre-edge peaks. We show this method accurately reconstructs the absorption edge of XANES spectra using only 15–20% of the measurement points typically needed for conventional sampling, while maintaining the ability to determine the x-ray energy of the sharp peak after the absorption edge with errors less than 0.03 eV, the absorption edge with errors less than 0.1 eV; and overall root-mean-square errors less than 0.005 compared to traditionally sampled spectra. Our experiments on battery materials and catalysts demonstrate the method’s effectiveness for both static and dynamic XANES measurements, improving data collection efficiency and enabling better time resolution for tracking chemical changes. This approach advances the degree of automation in XANES experiments, reducing the common errors of under- or over-sampling points near the absorption edge and enabling dynamic experiments that require high temporal resolution or limited measurement time.

Bayesian optimization↗

NASA NTRS2015

An Inversion Analysis of Recent Variability in Natural CO2 Fluxes Using GOSAT and In Situ Observations

About one-half of the global CO2 emissions from fossil fuel combustion and deforestation accumulates in the atmosphere, where it contributes to global warming. The rest is taken up by vegetation and the ocean. The precise contribution of the two sinks, and their location and year-to-year variability are, however, not well understood. We use two different approaches, batch Bayesian synthesis inversion and variational data assimilation, to deduce the global spatiotemporal distributions of CO2 fluxes during 2009-2010. One of our objectives is to assess different sources of uncertainties in inferred fluxes, including uncertainties in prior flux estimates and observations, and differences in inversion techniques. For prior constraints, we utilize fluxes and uncertainties from the CASA-GFED model of the terrestrial biosphere and biomass burning driven by satellite observations and interannually varying meteorology. We also use measurement-based ocean flux estimates and two sets of fixed fossil CO2 emissions. Here, our inversions incorporate column CO2 measurements from the GOSAT satellite (ACOS retrieval, filtered and bias-corrected) and in situ observations (individual flask and afternoon-average continuous observations) to estimate fluxes in 108 regions over 8-day intervals for the batch inversion and at 3 x 3.75 weekly for the variational system. Relationships between fluxes and atmospheric concentrations are derived consistently for the two inversion systems using the PCTM atmospheric transport model driven by meteorology from the MERRA reanalysis. We compare the posterior fluxes and uncertainties derived using different data sets and the two inversion approaches, and evaluate the posterior atmospheric concentrations against independent data including aircraft measurements. The optimized fluxes generally resemble those from other studies. For example, the results indicate that the terrestrial biosphere is a net CO2 sink, and a GOSAT-only inversion suggests a shift in the global sink from the tropics south to the north relative to the prior and to an in-situ-only inversion. We also find a smaller terrestrial sink in higher-latitude northern regions in boreal summer of 2010 relative to 2009.

Carbon dioxide↗

DOE OSTI2020

Multi-Mechanism Flood Hazard Assessment: Critical Review of Current Practice and Approaches

This report documents the initial findings from the Nuclear Regulatory commission (NRC)-sponsored research project Methods for Estimating Joint Probabilities of Coincident and Correlated Flooding Mechanisms for Nuclear Power Plant Flood Hazard Assessments.1 This research project is a part of NRC’s Probabilistic Flood Hazard Assessment (PFHA) Research Program and will aid the development of guidance on the use of PFHA methods to evaluate infrastructure safety for existing and proposed US nuclear power plants (NPPs). More specifically, this project intends to provide technical background for the development of flood hazard curves for multi-mechanism floods (MMFs). MMFs are flood events caused by more than one flooding mechanism (e.g., flood events due to the simultaneous occurrence of precipitation-induced river flooding and storm surge). Project activities include three main tasks: Task 1—Survey of current concepts and methods in assessing MMF hazards; Task 2—Critical assessment of selected methods and approaches for quantifying probabilistic MMF hazard risk; Task 3—Development of example case studies to illustrate best practices for quantifying probabilistic MMF hazard risk The initial findings from Tasks 1 and 2 are documented in this report. Task 1 comprised a survey of approaches and methods that have been applied to understand and assess flood hazards due to MMFs. Task 2 involved a critical review of the selected approaches and methods. To that end, the scope of this report includes documentation of (1) a reconnaissance-level survey of the current state of concepts and practice for MMF hazard assessment; (2) a generalized MMF assessment framework to address the distinctions among various types of flood-forcing phenomena, flood mechanisms (grouped into three mechanism types), and flood severity metrics; (3) a wide-ranging survey of approaches and methods that have been applied to various flooding phenomena and settings; and (4) a critical assessment of MMF hazard assessment methods. Studies were identified involving MMFs related to coastal flooding mechanisms, fluvial (rivers/streams) flooding mechanisms, and associated combinations of coastal and fluvial flooding mechanisms. Studies were also identified that address MMFs involving coastal and fluvial flooding mechanisms as well as coastal flooding mechanisms along with extreme precipitation (without specific attribution to fluvial or pluvial mechanisms). The studies identified for review in this report included assessments at varying spatial scales (from local to global) with differing geographic regions of focus using both observed and synthetic data. The majority of studies identified and reviewed were site-specific assessments focusing on relatively short return periods. Studies considered a range of flood severity metrics, made differing assumptions regarding the occurrence of extrema, and used multiple statistical techniques; the use of copulas for the development of joint distributions was a particularly popular analysis technique. The literature review highlighted the differences among existing studies relative to terminology used, means of presenting results, framework and techniques employed, and level of sophistication regarding the number and types of variables considered. Despite the significant diversity in existing studies, the review identified several promising techniques that will be considered in future work under this project, including the development of joint distributions for MMFs using copula and Bayesian-motivated approaches.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

DOE OSTI2024

ytopt: Autotuning Scientific Applications for Energy Efficiency at Large Scales

As we enter the exascale computing era, efficiently utilizing power and optimizing the performance of scientific applications under power and energy constraints has become critical and challenging. We propose a low-overhead autotuning framework to autotune performance and energy for various hybrid MPI/OpenMP scientific applications at large scales and to explore the tradeoffs between application runtime and power/energy for energy efficient application execution, then use this framework to autotune four ECP proxy applications—XSBench, AMG, SWFFT, and SW4lite. Our approach uses Bayesian optimization with a Random Forest surrogate model to effectively search parameter spaces with up to 6 million different configurations on two large-scale HPC production systems, Theta at Argonne National Laboratory and Summit at Oak Ridge National Laboratory. The experimental results show that our autotuning framework at large scales has low overhead and achieves good scalability. Using the proposed autotuning framework to identify the best configurations, we achieve up to 91.59% performance improvement, up to 21.2% energy savings, and up to 37.84% EDP (energy delay product) improvement on up to 4096 nodes.

Autotuning↗

DOE OSTI2016

Multi-Detection Events, Probability Density Functions, and Reduced Location Area

Abstract Several efforts have been made in the Comprehensive Nuclear-Test-Ban Treaty (CTBT) community to assess the benefits of combining detections of radionuclides to improve the location estimates available from atmospheric transport modeling (ATM) backtrack calculations. We present a Bayesian estimation approach rather than a simple dilution field of regard approach to allow xenon detections and non-detections to be combined mathematically. This system represents one possible probabilistic approach to radionuclide event formation. Application of this method to a recent interesting radionuclide event shows a substantial reduction in the location uncertainty of that event.

atmospheric modeling↗

DOE OSTI2022

Development of Aluminum Scandium Nitride Molecular Dynamics Force Fields with Scalable Multi-Objective Bayesian Optimization

Scandium (Sc)-doped aluminum nitride (AlN) exhibits improved piezoelectric properties, which is favorable for sensor applications. Although many experimental studies exist to fine tune the material properties for design purposes, an atomistic level understanding of the structure-property (S-P) relationships is needed, which is the aim of this work. Molecular dynamics can be used to understand the S-P relationships. However, the limited availability of suitable force fields has been a major challenge for accurate property predictions. In this article, a robust force field calibration method using a scalable multi-objective Bayesian optimization approach is presented. Optimizations with three, six, and eight objectives are applied to calibrate aluminum scandium nitride force fields based on the piezoelectric characteristics, modulus of elasticity, and lattice parameters at different Sc-doped levels. Furthermore, the performances of the different force fields are compared, and the performance of the higher dimensional objective problems is discussed. The highly scalable molecular dynamics force field development method is successfully implemented, resulting in the creation of several aluminum scandium nitride molecular dynamics force fields for piezoelectric applications at varying Sc dope levels.

36 MATERIALS SCIENCE↗

DOE OSTI2019

Impacts of Observational Constraints Related to Sea Level on Estimates of Climate Sensitivity

Reduced complexity climate models are necessary tools for quantifying decision-relevant uncertainties, given their flexibility, computational efficiency, and suitability for large-ensemble frameworks necessary for statistical estimation using resampling techniques (e.g. Markov chain Monte Carlo—MCMC). Here we document a new version of the simple, open-source, global climate model Hector, coupled with a one-dimensional diffusive heat and energy balance model (Diffusion Ocean Energy balance CLIMate model; DOECLIM) and a sea-level change module (Building blocks for Relevant Ice and Climate Knowledge; BRICK) that also represents contributions from thermal expansion, glaciers and ice caps, and polar ice sheets. We apply a Bayesian calibration approach to quantify model uncertainties surrounding 39 model parameters with prescribed radiative forcing, using observational information from global surface temperature, ocean heat uptake, and sea-level change. Furthermore, we find sea-level change as an observational constraint sharpens inference for the upper tail of posterior climate sensitivity estimates (the 97.5 percentile is tightened from 6.5 K to 5.3 K). The addition of sea-level change as an observational constraint also has implications for probabilistic projections of global surface temperature (the 97.5 percentile for RCP8.5 2100 temperature decreases 0.3 K) and sea-level rise (the 97.5 percentile for RCP8.5 2100 sea level decreases 0.5 m).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Bayesian blacksmithing: discovering thermomechanical properties and deformation mechanisms in high-entropy refractory alloys

Finding alloys with specific design properties is challenging due to the large number of possible compositions and the complex interactions between elements. This study introduces a multi-objective Bayesian optimization approach guiding molecular dynamics simulations for discovering high-performance refractory alloys with both targeted intrinsic static thermomechanical properties and also deformation mechanisms occurring during dynamic loading. The objective functions are aiming for excellent thermomechanical stability via a high bulk modulus, a low thermal expansion, a high heat capacity, and for a resilient deformation mechanism maximizing the retention of the BCC phase after shock loading. Contrasting two optimization procedures, we show that the Pareto-optimal solutions are confined to a small performance space when the property objectives display a cooperative relationship. Conversely, the Pareto front is much broader in the performance space when these properties have antagonistic relationships. Density functional theory simulations validate these findings and unveil underlying atomic-bond changes driving property improvements.

36 MATERIALS SCIENCE↗

DOE OSTI2019

Quantitative impacts of incubation phase transmission of foot-and-mouth disease virus

The current investigation applied a Bayesian modeling approach to a unique experimental transmission study to estimate the occurrence of transmission of foot-and-mouth disease (FMD) during the incubation phase amongst group-housed pigs. The primary outcome was that transmission occurred approximately one day prior to development of visible signs of disease (posterior median 21hours, 95% CI: 1.1–45.0). Updated disease state durations were incorporated into a simulation model to examine the importance of addressing preclinical transmission in the face of robust response measures. Simulation of FMD outbreaks in the US pig production sector demonstrated that including a preclinical infectious period of one day would result in a 40% increase in the median number of farms afected (166 additional farms and 664,912 pigs euthanized) compared to the scenario of no preclinical transmission, assuming suboptimal outbreak response. These fndings emphasize the importance of considering transmission of FMD during the incubation phase in modeling and response planning.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2019

Coupled flow accumulation and atmospheric blocking govern flood duration

Abstract We present a physically based Bayesian network model for inference and prediction of flood duration that allows for a deeper understanding of the nexus of antecedent flow regime, atmospheric blocking, and moisture transport/release mechanisms. Distinct scaling factors at the land surface and regional atmospheric levels are unraveled using this Bayesian network model. Land surface scaling explains the variability in flood duration as a function of cumulative exceedance index, a new measure that represents the evolution of the flood in the basin. Dynamic atmospheric scaling explains the cumulative exceedance index using the interaction between atmospheric blocking system and the synergistic model of wind divergence and atmospheric water vapor. Our findings underline that the synergy between a large persistent low-pressure blocking system and a higher rate of divergent wind often triggers a long-duration flood, even in the presence of moderate moisture supply in the atmosphere. This condition in turn causes an extremely long-duration flood if the basin-wide cumulative flow prior to the flood event was already high. Thus, this new land-atmospheric interaction framework integrates regional flood duration scaling and dynamic atmospheric scaling to enable the coupling of ‘horizontal’ (for example, streamflow accumulation inside the basin) and ‘vertical’ flow of information (for example, interrelated land and ocean-atmosphere interactions), providing an improved understanding of the critical forcing of regional hydroclimatic systems. This Bayesian model approach is applied to the Missouri River Basin, which has the largest system of reservoirs in the United States. Our predictive model can aid in decision support systems for the protection of national infrastructure against long-duration flood events.

Najibi, Nasser (ORCID:0000000205157192)↗

DOE OSTI2022

The dark matter halo masses of elliptical galaxies as a function of observationally robust quantities

Context. The assembly history of the stellar component of a massive elliptical galaxy is closely related to that of its dark matter halo. Measuring how the properties of galaxies correlate with their halo mass can therefore help to understand their evolution. Aims. We investigate how the dark matter halo mass of elliptical galaxies varies as a function of their properties, using weak gravitational lensing observations. To minimise the chances of biases, we focus on the following galaxy properties that can be determined robustly: the surface brightness profile and the colour. Methods. We selected 2409 central massive elliptical galaxies (log M*/M ⊙ ≳ 11.4) from the Sloan Digital Sky Survey spectroscopic sample. We first measured their surface brightness profile and colours by fitting Sérsic models to photometric data from the Kilo-Degree Survey (KiDS). We fitted their halo mass distribution as a function of redshift, rest-frame r-band luminosity, half-light radius, and rest-frame u - g colour, using KiDS weak lensing measurements and a Bayesian hierarchical approach. For the sake of robustness with respect to assumptions on the large-radii behaviour of the surface brightness, we repeated the analysis replacing the total luminosity and half-light radius with the luminosity within a 10 kpc aperture, L r, 10 , and the light-weighted surface brightness slope, Γ 10 . Results. We did not detect any correlation between the halo mass and either the half-light radius or colour at fixed redshift and luminosity. Using the robust surface brightness parameterisation, we found that the halo mass correlates weakly with L r,10 and anti-correlates with Γ 10 . At fixed redshift, L r, 10 and Γ 10 , the difference in the average halo mass between galaxies at the 84th percentile and 16th percentile of the colour distribution is 0.00 ± 0.11 dex. Conclusion. Our results indicate that the average star formation efficiency of massive elliptical galaxies has little dependence on their final size or colour. This suggests that the origin of the diversity in the size and colour distribution of these objects lies with properties other than the halo mass.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2018

Bayesian calibration of strength parameters using hydrocode simulations of symmetric impact shock experiments of Al-5083

We report that predictive modeling of materials requires accurately parameterized constitutive models. Parameterizing models that describe dynamic strength and plasticity require experimentally probing materials in a variety of strain rate regimes. Some experimental protocols (e.g., plate impact) probe the constitutive response of a material using indirect measures such as free surface velocimetry. Manual efforts to parameterize constitutive models using indirect experimental measures often lead to non-unique optimizations without quantification of parameter uncertainty. This study uses a Bayesian statistical approach to find model parameters and to quantify the uncertainty of the resulting parameters. The technique is demonstrated by parameterizing the Johnson-Cook strength model for aluminum alloy 5083 by coupling hydrocode simulations and velocimetry measurements of a series of plate impact experiments. Simulation inputs and outputs are used to calibrate an emulator that mimics the outputs of the computationally intensive simulations. Varying the amount of experimental data available for emulator calibration showed clear differences in the degree of uncertainty and uniqueness of the resulting optimized Johnson-Cook parameters for Al-5083. The results of the optimization provided a numerical evaluation of the degree of confidence in model parameters and model performance. Lastly, given an understanding of the physical effects of certain model parameters, individual parameter uncertainty can be leveraged to quickly identify gaps in the physical domains covered by completed experiments.

36 MATERIALS SCIENCE↗