Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bayesian methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Hadronic structure in high-energy collisions

Here, Parton distribution functions (PDFs) describe the structure of hadrons as composed of quarks and gluons. They are needed to make predictions for short-distance processes in high-energy collisions and are determined by fitting to cross-section data. Definitions of the PDFs and their relations to high-energy cross sections are reviewed. The focus is on the PDFs in protons, but PDFs in nuclei are also discussed. The standard statistical treatment needed to fit the PDFs to data using the Hessian method is reviewed in some detail. Tests are discussed that critically examine whether the needed assumptions are indeed valid. Also presented are some ideas of what one can do in case tests indicate that the assumptions fail.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Spatiotemporal Prediction Model for Regional Scheduling of Shared Bicycles Based on the INLA Method

Dock-less bicycle-sharing programs have been widely accepted as an efficient mode to benefit health and reduce congestions. And modeling and prediction has always been a core proposition in the field of transportation. Most of the existing demand prediction models for shared bikes take regions as research objects; therefore, a POI-based method can be a beneficial complement to existing research, including zone-level, OD-level, and station-level techniques. Point of interest (POI) is the location description of spatial entities, which can reflect the cycling route characteristics for both commuting and noncommuting trips to a certain extent, and is also the main generating point and attraction point of shared-bike travel flow. In this study, we make an effort to model a POI-level cycling demand with a Bayesian hierarchical method. The proposed model combines the integrated nested Laplace approximation (INLA) and random partial differential equation (SPDE) to cope with the huge computation in the modeling process. In particular, we have adopted the dock-less bicycle-sharing rental records of Mobike as a case study to validate our method; the study area was one of the fastest growing urban districts in Shanghai in August 2016. The operation results show that the method can help better understand, measure, and characterize spatiotemporal patterns of bike-share ridership at the POI level and quantify the impact of the spatiotemporal effect on bicycle-sharing use.

Yu, Zhuoran↗

Fusion of Multiple Models for Improving Gross Primary Production Estimation With Eddy Covariance Data Based on Machine Learning

Abstract Terrestrial gross primary production (GPP) represents the magnitude of CO 2 uptake through vegetation photosynthesis, and is a key variable for carbon cycles between the biosphere and atmosphere. Light use efficiency (LUE) models have been widely used to estimate GPP for its physiological mechanisms and availability of data acquisition and implementation, yet each individual GPP model has exhibited large uncertainties due to input errors and model structure, and further studies of systematic validation, comparison, and fusion of those models with eddy covariance (EC) site data across diverse ecosystem types are still needed in order to further improve GPP estimation. We here compared and fused five GPP models (VPM, EC‐LUE, GOL‐PEM, CHJ, and C‐Fix) across eight ecosystems based on FLUXNET2015 data set using the ensemble methods of Bayesian Model Averaging (BMA), Support Vector Machine (SVM), and Random Forest (RF) separately. Our results showed that for individual models, EC‐LUE gave a better performance to capture interannual variability of GPP than other models, followed by VPM and GLO‐PEM, while CHJ and C‐Fix were more limited in their estimation performance. We found RF and SVM were superior to BMA on merging individual models at various plant functional types (PFTs) and at the scale of individual sites. On the basis of individual models, the fusion methods of BMA, SVM, and RF were examined by a five‐fold cross validation for each ecosystem type, and each method successfully improved the average accuracy of estimation by 8%, 18%, and 19%, respectively.

Environmental Sciences & Ecology↗

Bayesian Optimization for Reactor Design Optimization

This study present a test case in which the Bayesian Optimization method is applied to a simulation-based reactor core design optimization problem. The test case aims to showcase the potential of an automated design optimization algorithm for reactor designs by streamlining the reactor core design workflow, given the high computational cost of simulations. The contributions of this work are threefold. First, the existing HTGR model is converted into a simulation-based design optimization test case by developing a pipeline that enables modification of key design parameters and evaluates design performance based on simulation outputs. Second, Bayesian Optimization is implemented and adapted to demonstrate the feasibility of automatic design optimization for nuclear reactor core. Proposed approach leverages Gaussian Process models to characterize the relationship between design variables and performance metrics, while incorporating novel acquisition functions that balance exploration of the design space with exploitation of promising configurations. This implementation lays the foundation for the future developments of reactor design optimization algorithms.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Functional Data Analysis for Extracting the Intrinsic Dimensionality of Spectra: Application to Chemical Homogeneity in the Open Cluster M67

High-resolution spectroscopic surveys of the Milky Way have entered the Big Data regime and have opened avenues for solving outstanding questions in Galactic archeology. However, exploiting their full potential is limited by complex systematics, whose characterization has not received much attention in modern spectroscopic analyses. In this work, we present a novel method to disentangle the component of spectral data space intrinsic to the stars from that due to systematics. Using functional principal component analysis on a sample of 18,933 giant spectra from APOGEE, we find that the intrinsic structure above the level of observational uncertainties requires ≈10 functional principal components (FPCs). Our FPCs can reduce the dimensionality of spectra, remove systematics, and impute masked wavelengths, thereby enabling accurate studies of stellar populations. To demonstrate the applicability of our FPCs, we use them to infer stellar parameters and abundances of 28 giants in the open cluster M67. We employ Sequential Neural Likelihood, a simulation-based Bayesian inference method that learns likelihood functions using neural density estimators, to incorporate non-Gaussian effects in spectral likelihoods. By hierarchically combining the inferred abundances, we limit the spread of the following elements in M67: Fe ≲ 0.02 dex; C ≲ 0.03 dex; O, Mg, Si, Ni ≲ 0.04 dex; Ca ≲ 0.05 dex; N, Al ≲ 0.07 dex (at 68% confidence). Our constraints suggest a lack of self-pollution by core-collapse supernovae in M67, which has promising implications for the future of chemical tagging to understand the star formation history and dynamical evolution of the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗

Emulating ab initio computations of infinite nucleonic matter

We construct efficient emulators for the computation of the infinite nuclear matter equation of state. These emulators are based on the subspace-projected coupled-cluster method for which we here develop a new algorithm called small-batch voting to eliminate spurious states that might appear when emulating quantum many-body methods based on a non-Hermitian Hamiltonian. The efficiency and accuracy of these emulators facilitate a rigorous statistical analysis within which we explore nuclear matter predictions for > 10 6 different parametrizations of a chiral interaction model with explicit Δ -isobars at next-to-next-to leading order. Constrained by nucleon-nucleon scattering phase shifts and bound-state observables of light nuclei up to He 4 , we use history matching to identify nonimplausible domains for the low-energy coupling constants of the chiral interaction. Within these domains we perform a Bayesian analysis using sampling and importance resampling with different likelihood calibrations and study correlations between interaction parameters, calibration observables in light nuclei, and nuclear matter saturation properties. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Greedy emulators for nuclear two-body scattering

Applications of reduced basis method emulators are increasing in low-energy nuclear physics because they enable fast and accurate sampling of high-fidelity calculations, enabling robust uncertainty quantification. Here, in this paper, we develop, implement, and test two model-driven emulators based on the (Petrov-)Galerkin projection using the prototypical test case of two-body scattering with the Minnesota potential and a more realistic local chiral potential. The high-fidelity scattering equations are solved with the matrix Numerov method, a reformulation of the popular Numerov recurrence relation for solving special second-order differential equations as a linear system of coupled equations. A novel error estimator based on reduced-space residuals is applied to an active learning approach (a greedy algorithm) to choosing training samples (“snapshots”) for the emulator and contrasted with a proper orthogonal decomposition (POD) approach. Both approaches allow for computationally efficient offline-online decompositions, but the greedy approach requires many fewer snapshot calculations. These developments set the groundwork for emulating scattering observables based on chiral nucleon-nucleon and three-nucleon interactions and optical models, where computational speed-ups are necessary for Bayesian uncertainty quantification. Our emulators and error estimators are widely applicable to linear systems.

Bayesian methods↗

Evaluating Probabilistic Deep Learning Methods for Uncertainty Quantification of Precipitation Bias Correction

Climate models often exhibit biases in their precipitation predictions, particularly underestimating high-intensity events and overestimating low precipitation. Deep learning approaches offer promising solutions, but their epistemic uncertainty associated with a deep learning–based bias correction method has not previously been quantified for reliable downstream climate impact studies. While methods for capturing the epistemic uncertainty in deep learning frameworks exist, there is currently no consensus on the best method. In this work, we compare three uncertainty quantification (UQ) methods—Deep Ensembles (DEns), Monte Carlo Dropout (MCD), and Flipout—by assessing the reliability of their uncertainty estimates using standard measures such as sharpness and calibration. These UQ methods are applied to an existing deep learning precipitation bias correction model known as UFNet: a coupled U-Net and fully connected neural network. The methods utilized to assess the models’ uncertainties are 1) calibration, which ensures that the expected probabilities of the model align with reality and 2) sharpness, which is a measure of the precision of the model’s probabilistic predictions. Of the three UQ methods evaluated, the DEns and MCD methods demonstrated the best-calibrated performance (expected calibration error of 0.36 and 0.35, respectively), compared to Flipout (0.58). In contrast, Flipout had the sharpest predictions and the highest metric performance in bias correcting precipitation—especially for higher-order moments such as kurtosis with a spatial correlation of 72% compared to 32% and 55% spatial correlation for DEns and MCD, respectively. Of the three UQ methods, MCD was found to be the most suitable method for UQ purposes based on its calibration, sharpness, and computational requirements.

Bayesian methods↗

Universal reduced basis for the calibration of covariant energy density functionals

The reduced basis method is used to construct a “universal” basis of Dirac orbitals that may be applicable throughout the nuclear chart to calibrate covariant energy density functionals. Relative to the successful development of a reduced basis emulator for the nonrelativistic Schrödinger equation, the Dirac equation adds an extra layer of complexity due to the existence of negative energy states, which complicates building an efficient reduced basis. However, once this problem is mitigated, the resulting reduced basis is able to accurately and efficiently reproduce the high-fidelity model at a fraction of the computational cost. We are confident that the resulting reduced basis will serve as a foundational element in developing rapid and accurate emulators. In turn, these emulators will play a critical role in the Bayesian optimization of covariant energy density functionals.

Bayesian methods↗

Hierarchical Bayesian estimation for adsorption isotherm parameter determination

Estimation of isotherm model parameters from experimental data is necessary in adsorption process modeling. To facilitate isotherm modeling, databases that store experimental data exist. Nevertheless, data inconsistency among different researchers must be resolved to find a single set of isotherm parameters from multiple data sets. Herein, we propose a hierarchical Bayesian estimation method to quantify the discrepancy by a multiplicative factor while simultaneously obtaining the probability distributions of a single set of isotherm parameters. This approach also allows us to identify outliers, which are data sets that are not in agreement with other sets. The proposed approach is demonstrated for the case of CO 2 adsorption in the metal-organic framework UiO-66.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Performance Evaluation of an Offshore Wave Measurement Buoy in Monochromatic Waves

The accurate measurement of waves underpins marine energy resource characterization, device design, and project development. Datawell wave buoys are widely deployed and have long served as a trusted standard for wave measurements. We quantify the measurement performance, including wave elevation and energy flux estimation, of a Datawell DWR-MkIII buoy using prescribed monochromatic heave motions on a large-amplitude six-degree-of-freedom motion platform at the National Laboratory of the Rockies, assuming the buoy behaves as an ideal wave follower. Commanded motions were validated with an optical motion tracking system while buoy elevation and raw acceleration were recorded. Wave elevations were propagated to wave energy flux estimation using four methods, including one frequency-domain method and three time-domain methods. The Bayesian optimization was applied for design of experiments, and records from three test sites were also applied and evaluated in the present study. Results show two error regions within the nominal period range of 1.6 s to 30 s. For wave periods between 5 s and 25 s, the buoy provides accurate wave height measurements. For short periods less than 5 s, the 1.28 Hz sampling frequency induces sub-Nyquist artifacts that bias elevation and can drive maximum energy flux estimation errors above 100%. For long periods exceeding 25 s, the buoy reported elevation is underpredicted with error depending on period but relatively independent of wave height, with maximum wave height and wave energy flux errors reaching 64% and 87%, respectively. Furthermore, analysis of three field-derived cases shows that frequency-domain estimates at 1.28 Hz agree within 2% of the corresponding 100 Hz estimates, while larger method-dependent differences are observed for the Hilbert method.

16 TIDAL AND WAVE POWER↗

The utility of Bayesian data reconciliation for separations

Data reconciliation methods for separation processes typically rely on classical statistical approaches to generate estimates of true mass flow rates from measurements. Knowledge regarding the uncertainty of these estimates has value in decision making, but is often not acquired. Bayesian approaches intrinsically quantify uncertainty; however, literature for Bayesian data reconciliation of separation processes is scarce. This publication outlines two Bayesian data reconciliation models and provides details for how the models were implemented for the BayesMassBal (V 1.0.0) software package written in R. To demonstrate the advantages of this approach for data reconciliation, the models were first applied to simulated data and then compared to a classical model through a Monte Carlo experiment. In this example, the Bayesian models were found to provide more accurate estimates of the simulated data, while also providing quantitative information on the estimate uncertainty. To demonstrate the use of the technique in a practical problem, the models were also applied to real data collected from a pilot-scale rare earth solvent extraction process. Here, this publication provides a small window into how Bayesian methods can be used for data reconciliation, but findings suggest Bayesian data reconciliation models for separation processes have distinct advantages over classical alternatives.

01 COAL, LIGNITE, AND PEAT↗

A predictive discrete-continuum multiscale model of plasticity with quantified uncertainty

Multiscale models of materials, consisting of upscaling discrete simulations to continuum models, are unique in their capability to simulate complex materials behavior. The fundamental limitation in multiscale models is the presence of uncertainty in the computational predictions delivered by them. In this work, a sequential multiscale model has been developed, incorporating discrete dislocation dynamics (DDD) simulations and a strain gradient plasticity (SGP) model to predict the size effect in plastic deformations of metallic micro-pillars. The DDD simulations include uniaxial compression of micro-pillars with different sizes and over a wide range of initial dislocation densities and spatial distributions of dislocations. An SGP model is employed at the continuum level that accounts for the size-dependency of flow stress and hardening rate. Sequences of uncertainty analyses have been performed to assess the predictive capability of the multiscale model. The variance-based global sensitivity analysis determines the effect of parameter uncertainty on the SGP model prediction. The multiscale model is then constructed by calibrating the continuum model using the data furnished by the DDD simulations. A Bayesian calibration method is implemented to quantify the uncertainty due to microstructural randomness in discrete dislocation simulations (density and spatial distribution of dislocations) on the macroscopic continuum model prediction (size effect in plastic deformation). Here, the outcomes of this study indicate that the discrete-continuum multiscale model can accurately simulate the plastic deformation of micro-pillars, despite the significant uncertainty in the DDD results. Additionally, depending on the macroscopic features represented by the DDD simulations, the SGP model can reliably predict the size effect in plasticity responses of the micropillars with below 10% of error.

36 MATERIALS SCIENCE↗

Bayesian optimization of entropy-stabilized metal fluoride conversion cathodes and their synthesis

Fluoride-based conversion cathodes are promising for next-generation Li ion batteries because of their high voltage and energy densities. High entropy earth abundant fluoride cathodes are attractive for sustainable battery because of the potentially higher cycling stability. While Ni and Co containing equimolar alloys stabilized by high entropy were considered previously, Ni and Co free non-equimolar metal alloy compositions might offer new opportunities to increase materials stability and average voltage. This opportunity was pursued using Bayesian optimization of average voltage for the computational prediction of (Fe x1 Cu x2 Zn x3 Mn x4 Mg x5 )F 2 cathode chemistries. Theoretical voltage, room temperature free energy, and electronic structure of potentially high voltage compositions were computed using density functional theory calculations. Here, the experimental realization of non-equimolar quinary Co and Ni free fluorides with stable rutile single phase and improved conversion reaction voltage by up to 28 % compared to the equimolar alloy demonstrated the power of Bayesian optimization methods for the computationally guided experimental synthesis of fluoride cathodes. Finally, non-equimolar cathode chemistries were found with cycling stability superior to known multi-element fluorides.

25 ENERGY STORAGE↗

Coupling 1D xRAGE simulations with machine learning for graded inner shell design optimization in double shell capsules

Advances in machine learning provide the ability to leverage data from expensive simulations of high-energy-density experiments to significantly cut down on computational time and costs associated with the search for optimal target designs. This study presents an application of cutting-edge Bayesian optimization methods to the one-dimensional (1D) design optimization of double shell graded layer targets for inertial confinement fusion experiments. This investigation attempts to reduce hydrodynamic instabilities while retaining high yields for future NIF experiments. Machine learning methods can use predictive physics simulations to identify graded layer designs from within the vast design space that demonstrate high predicted performance, including novel designs with high uncertainty in performance that may hold unexpected promise. By applying machine learning tools to the simulation design, we map the trade-off between 1D yield and instability, specifically isolating parameter ranges, which maintain high performance while showing significantly improved Rayleigh–Taylor stability over the point design. Furthermore, the groundwork laid in this study will be a useful design tool for future NIF experiments with graded layer targets.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Order-by-order uncertainties of nucleon-nucleon Wolfenstein amplitudes in chiral effective field theory

Quantum mechanical invariance principles dictate the most general operator structure that can be present in the nucleon-nucleon (NN) interaction. Five independent operators appear in the on-shell NN amplitude together with five corresponding coefficient functions. The usual choice for these coefficient functions is known as the NN Wolfenstein amplitudes. We analyze the order-by-order convergence of each of the five NN Wolfenstein amplitudes predicted by a semilocal coordinate space potential implementation of chiral effective field theory (𝜒⁢EFT). We do this at laboratory kinetic energies between 25 and 200 MeV for both neutron-proton and proton-proton scattering. Our analysis uses the Gaussian-process methods developed by the BUQEYE Collaboration to describe the contributions of each 𝜒⁢EFT order, and so yields truncation uncertainties for each Wolfenstein amplitude that are correlated across scattering angles. We combine information on the size of different orders in the EFT to infer the 𝜒⁢EFT breakdown scale for each amplitude, finding, on average, Λ 𝑏 between 750 and 800 MeV. Furthermore, with this choice of Λ 𝑏 , the EFT truncation uncertainties cover both higher-order results and empirical Wolfenstein amplitudes well for all orders other than the leading order.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Estimating Carbon Dioxide Emissions in Two California Cities Using Bayesian Inversion and Satellite Measurements

NASA's Orbiting Carbon Observatories (OCO-2 and OCO-3) provide measurements of column-averaged carbon dioxide concentrations (XCO 2 ) with sufficient spatial resolution and precision to constrain bottom-up estimates of CO 2 fluxes at regional scales. We use Bayesian inversion methods assimilating satellite retrievals to improve estimates of CO 2 fluxes in the South Coast Air Basin (SoCAB) which surrounds Los Angeles, and in the San Francisco Bay Area Air Basin (SFBA). We study 2020 to understand the impact of the COVID-19 lockdowns and an active wildfire season. Our results indicated that a 50% (30%) reduction in CO 2 emissions relative to 2015 during the COVID-19 lockdown period was consistent with OCO measurements for SFBA (SoCAB). We find that posterior wildfire emissions differed significantly from the prior at the scale of individual wildfires, though with large uncertainties, and that wildfire emissions in SFBA are significant, attributing 72% of the region's CO 2 emissions during August 2020 to wildfires.

54 ENVIRONMENTAL SCIENCES↗

Bayesian calibration of a physics-based crystal plasticity and damage model

In this work, we present a model parameter calibration procedure for a physics-based crystal plasticity model. The calibration process utilizes a powerful statistics-based Bayesian calibration method. Calibration of the crystal plasticity parameters makes use of experimentally-measured data, i.e. compressive stress–strain response, from $\langle$100$\rangle$ and $\langle$123$\rangle$ single crystal copper dynamically loaded via Kolsky bar tests. The calibration of damage parameters is achieved using experimentally-measured free-surface velocity history data from plate impact test on $\langle$100$\rangle$ and $\langle$110$\rangle$ single crystal copper, which generates shock compression followed by dynamic tensile failure. A validation assessment is then carried out by comparing the calibrated model predictions and experimental measurements of the dynamic tensile damage generated in an impacted bicrystal copper plate. Lastly, a model-informed rationale for the experimentally-observed dependence of the spatial distribution of ductile damage (porosity) on crystallography is provided.

42 ENGINEERING↗