Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “bayesian”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Discovery of Energy Storage Molecular Materials Using Quantum Chemistry-Guided Multiobjective Bayesian Optimization

Redox flow batteries (RFBs) are a promising technology for stationary energy storage applications due to their flexible design, scalability, and low cost. In RFBs, energy is carried in flowable redoxactive materials (redoxmers) which are stored externally and pumped to the cell during operation. Further improvements in the energy density of RFBs necessitates redoxmer designs with wider redox potential windows and higher solubility. Additionally, designing redoxmers with a fluorescence-enabled self-reporting functionality allows monitoring of the state of health of RFBs. To accelerate the discovery of redoxmers with desired properties, state-of-the- art machine learning ( ML) methods, such as multiobjective Bayesian optimization (MBO), are useful. Here, we first employed density functional theory calculations to generate a database of reduction potentials, solvation free energies, and absorption wavelengths for 1400 redoxmer molecules based on a 2,1,3-benzothiadiazole (BzNSN) core structure. From the computed properties, we identified 22 Pareto-optimal molecules that represent best trade-off among all of the desired properties. We further utilized these data to develop and benchmark an MBO approach to identify candidates quickly and efficiently with multiple targeted properties. With MBO, optimal candidates from the 1400-molecule data set can be identified at least 15 times more efficiently compared to the brute force or random selection approach. Importantly, we utilized this approach for discovering promising redoxmers from an unseen database of 1 million BzNSN-based molecules, where we discovered 16 new Pareto-optimal molecules with significant improvements in properties over the initial 1400 molecules. Furthermore, we anticipate that this active learning technique is general and can be utilized for the discovery of any class of functional materials that satisfies multiple desired property criteria.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Determining Atomistic SAXS Models of Tri-Ubiquitin Chains from Bayesian Analysis of Accelerated Molecular Dynamics Simulations

Small-angle X-ray scattering (SAXS) has become an increasingly popular technique for characterizing the solution ensemble of flexible biomolecules. However, data resulting from SAXS is typically low-dimensional and is therefore difficult to interpret without additional structural knowledge. In theory, molecular dynamics (MD) trajectories can provide this information, but conventional simulations rarely sample the complete ensemble. Here, we demonstrate that accelerated MD simulations can be used to produce higher quality models in shorter time scales than standard simulations, and we present an iterative Bayesian Monte Carlo method that is able to identify multistate ensembles without overfitting. This methodology is applied to several ubiquitin trimers to demonstrate the effect of linkage type on the solution states of the signaling protein. Here, we observe that the linkage site directly affects the solution flexibility of the trimer and theorize that this difference in plasticity contributes to their disparate roles in vivo.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Predictions of Boron Phase Stability Using an Efficient Bayesian Machine Learning Interatomic Potential

Thermodynamic phase stability of three elemental boron allotropes, i.e., α-B, β-B, and γ-B, was investigated using a Bayesian interatomic potential trained via a sparse Gaussian process (SGP). SGP potentials trained with datasets from on-the-fly active learning achieve quantum mechanical level accuracy when employed in molecular dynamics simulations to predict wide-ranging thermodynamic, structural, and vibrational properties. The simulated phase diagram (500~1400 K and 0~16 GPa) agrees with experimental measurements. The SGP-based MD simulations also successfully predicted that the B13 defect is critical in stabilizing β-B below 700 K. At higher temperatures, the entropy becomes the dominant factor, making β-B the more stable phase over α-B. Furthermore, this Letter demonstrates that SGP potentials based on a training set consisting of defect-free-only systems could make correct predictions of defect-related phenomena in solid-state crystals, paving the path to investigate crystal phase stability and transitions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Online Bayesian State Estimation for Real-Time Monitoring of Growth Kinetics in Thin Film Synthesis

Rapid validation of newly predicted materials through autonomous synthesis requires real-time adaptive control methods that exploit physics knowledge, a capability that is lacking in most systems. Here, in this study, we demonstrate an approach to enable real-time control of thin film synthesis by combining in situ optical diagnostics with a Bayesian state estimation method. We developed a physical model for film growth and applied the direct filter (DF) method for real-time estimation of nucleation and growth rates during pulsed laser deposition (PLD). We validated the approach using simulated and experimental reflectivity data for WSe 2 growth and ultimately deployed the algorithm on an autonomous PLD system during the growth of 1T'-MoTe 2 . The DF robustly estimates growth parameters in real time at early stages of growth, down to 15% monolayer area coverage. This fusion of in situ diagnostics, data assimilation, and physical modeling opens new opportunities in adaptive control of synthesis trajectories toward desired material states.

36 MATERIALS SCIENCE↗

Source-Resolved Inversion of Elemental Carbon Emissions in California Using Log-Space Bayesian Inference

Elemental carbon (EC), operationally quantified by thermal-optical analysis, is widely used as a proxy for black carbon (BC) relevant to short-term climate forcing and public health. Current EC emission inventories remain highly uncertain, with persistent discrepancies between bottom-up and top-down estimates. In this study, we develop a source-resolved, log-space Bayesian inversion framework applied to estimate California’s statewide EC emissions in 2019. By integrating surface EC measurements from the EPA’s Air Quality System network with high-resolution source contributions simulated by a chemical transport model, we identify a one-third underestimation in the existing statewide EC inventory, requiring an increase of the total from a prior of 8.58 [5.49–13.75] Gg year–1 to a posterior estimate of 12.78 [10.71–15.37] Gg year–1. This discrepancy is primarily driven by substantial underestimations in the power and industrial and off-road mobile sectors. Furthermore, population-weighted exposure analysis reveals a marked sectoral divergence between emission mass and health burden: off-road mobile sources dominate both emissions and exposure, accounting for 31% of statewide exposure, while residential wood combustion contributes 26% of total exposure despite comprising only 19% of total emissions, due to its source proximity to population. These findings underscore the need to update sector-specific EC speciation profiles and demonstrate that mitigation strategies targeting off-road mobile sources and residential wood combustion are critical for reducing EC-related health impacts in California.

Zhang, Jie↗

High-Performance Iridium–Molybdenum Oxide Electrocatalysts for Water Oxidation in Acid: Bayesian Optimization Discovery and Experimental Testing

Ir oxides are costly and scarce catalysts for oxygen evolution reaction (OER) in acid. There has been extensive interest in developing alternatives that are either Ir-free or require smaller amounts of Ir to drive the reactions at acceptable rates. One design strategy is to identify Ir-based mixed oxides that achieve similar performance while requiring smaller amounts of Ir. The obstacle to this strategy has been a very large phase space of the Ir-based mixed metal oxides, in terms of the metals combined with Ir and the different crystallographic structures of the mixed oxides, which prevents a thorough exploration of possible materials. In this work, we developed a workflow that uses machine-learning-aided Bayesian optimization in combination with density functional theory to make the exploration of this phase space plausible. This screening identified Mo as a promising dopant for forming acid-tolerant Ir-based oxides for the OER. We synthesized and characterized the Ir–Mo mixed oxides in the form of thin-film electrocatalysts with a known surface area. We show that these mixed oxides exhibited overpotentials ~30 mV lower than a pure Ir control while maintaining 24% lower Ir dissolution rates than the Ir control. Furthermore, these findings suggest that Mo is a promising dopant and highlight the promise of machine learning to guide the experimental exploration and optimization of catalytic materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multivariate Bayesian Optimization of CoO Nanoparticles for CO 2 Hydrogenation Catalysis

The hydrogenation of CO 2 holds promise for transforming the production of renewable fuels and chemicals. However, the challenge lies in developing robust and selective catalysts for this process. Transition metal oxide catalysts, particularly cobalt oxide, have shown potential for CO 2 hydrogenation, with performance heavily reliant on crystal phase and morphology. Achieving precise control over these catalyst attributes through colloidal nanoparticle synthesis could pave the way for catalyst and process advancement. Yet, navigating the complexities of colloidal nanoparticle syntheses, governed by numerous input variables, poses a significant challenge in systematically controlling resultant catalyst features. We present a multivariate Bayesian optimization, coupled with a data-driven classifier, to map the synthetic design space for colloidal CoO nanoparticles and simultaneously optimize them for multiple catalytically relevant features within a target crystalline phase. The optimized experimental conditions yielded small, phase-pure rock salt CoO nanoparticles of uniform size and shape. These optimized nanoparticles were then supported on SiO 2 and assessed for thermocatalytic CO 2 hydrogenation against larger, polydisperse CoO nanoparticles on SiO 2 and a conventionally prepared catalyst. The optimized CoO/SiO 2 catalyst consistently exhibited higher activity and CH 4 selectivity (ca. 98%) across various pretreatment reduction temperatures as compared to the other catalysts. This remarkable performance was attributed to particle stability and consistent H* surface coverage, even after undergoing the highest temperature reduction, achieving a more stable catalytic species that resists sintering and carbon occlusion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A state-space Bayesian framework for estimating biogeochemical transformations using time-lapse geophysical data

We develop a state-space Bayesian framework to combine time-lapse geophysical data with other types of information for quantitative estimation of biogeochemical parameters during bioremediation. We consider characteristics of end-products of biogeochemical transformations as state vectors, which evolve under constraints of local environments through evolution equations, and consider time-lapse geophysical data as available observations, which could be linked to the state vectors through petrophysical models. We estimate the state vectors and their associated unknown parameters over time using Markov chain Monte Carlo sampling methods. To demonstrate the use of the state-space approach, we apply it to complex resistivity data collected during laboratory column biostimulation experiments that were poised to precipitate iron and zinc sulfides during sulfate reduction. We develop a petrophysical model based on sphere-shaped cells to link the sulfide precipitate properties to the time-lapse geophysical attributes and estimate volume fraction of the sulfide precipitates, fraction of the dispersed, sulfide-encrusted cells, mean radius of the aggregated clusters, and permeability over the course of the experiments. Results of the case study suggest that the developed state-space approach permits the use of geophysical datasets for providing quantitative estimates of end-product characteristics and hydrological feedbacks associated with biogeochemical transformations. Although tested here on laboratory column experiment datasets, the developed framework provides the foundation needed for quantitative field-scale estimation of biogeochemical parameters over space and time using direct, but often sparse wellbore data with indirect, but more spatially extensive geophysical datasets.

54 ENVIRONMENTAL SCIENCES↗

Bayesian Model for HOPE Mass Spectrometers on Van Allen Probes

Space instruments rely heavily on modeling to predict and understand the instrument response, enabling a determination of the capabilities and resolution. The Bayesian approach provides a framework to incorporate prior knowledge and propagate uncertainty to predict the instrument response. We present an empirical Bayes model for the end-to-end performance of the Helium, Oxygen, Proton, and Electron mass spectrometers aboard the Van Allen Probes mission. In this model, we use a combination of external modeling, laboratory calibration, and expert opinion to construct the time-of-flight spectra and demonstrate good agreement with on-orbit data. The empirical Bayes model is applied to explore doubly charged ions and carbon, nitrogen, oxygen discrimination during the Van Allen Probes mission.

47 OTHER INSTRUMENTATION↗

Joint Bayesian Inference for Near-Surface Explosion Yield and Height-of-Burst

Forensic capabilities to understand chemical and nuclear explosions are greatly aided by an accurate estimate of explosive yield with uncertainty. The relationship between explosive size and geophysical observations of seismic, acoustic, and optical waves can be exploited to provide an estimate of yield. Any near-surface yield estimate is complicated by the surface interaction, so an estimate for the explosion height-of-burst is necessarily included in the relationship. Additionally, the relationship dictates a trade-off between estimates of yield and height-of-burst. Fortunately, the surface interaction for each type of observation is different, which breaks the trade-off, and the inclusion of height-of-burst with multiple data types improves yield estimation. We define simple parametric forward models to relate seismoäcoustoöptic observations from a data set of known explosive yields and height-of-bursts. The parameters of the models and a prediction for the yield and height-of-burst of a new event can then be estimated given new observations via Bayesian inference. We report posterior distribution estimates of the parametric models using a Markov chain Monte Carlo sampling technique. These models are then used to predict the yield and height-of-burst of SUGAR, a historical near-surface nuclear explosion, using its reported historical observations. The reported yield of 1.2 ktonne Trinitrotoluene (TNT)-equivalent (Department of Energy, 2015) is within the estimated posterior. Yield uncertainty can be estimated from the spread of the posterior, which is between 0.9 and 2.1 ktonne TNT-equivalent. The posterior for height-of-burst has a wider range between 10 m below and 8 m above ground that includes the true height-of-burst of 1 m.

58 GEOSCIENCES↗

Constraining Bedrock Groundwater Residence Times in a Mountain System With Environmental Tracer Observations and Bayesian Uncertainty Quantification

Groundwater residence time distributions provide fundamental insights on the hydrological processes within watersheds. Yet, observations that can constrain groundwater residence times over broad timescales remain scarce in mountain catchment studies. We use environmental tracers (CFC-12, SF 6 , 3 H, and 4 He) to investigate groundwater residence times along a hillslope in the East River Watershed, Colorado, USA. We develop a Bayesian inference framework that applies a Markov-chain Monte Carlo (MCMC) approach to estimate noble gas recharge temperature, elevation, and excess-air parameters and the resulting environmental tracer concentrations. MCMC is then used to propagate the environmental tracer uncertainties to estimates of groundwater mean residence times inferred with lumped parameter models. All samples contain 3 H, CFC-12, and SF 6 in addition to terrigenic 4 He, suggesting a mixture of water characterized by modern and premodern residence times. 4He exponential mean residence times range from hundreds of years at the upslope well to thousands of years at the toe-slope well assuming average crustal production rates. We find that binary mixing residence time distributions with separate young and old mixing fractions are needed to predict the 4 He, CFC-12, SF 6 , and 3 H observations, supporting the importance of flow path mixing in this bedrock system. Our findings that the fractured bedrock hosts groundwater with a mixture of residence times ranging from decades to millennia suggest variable recharge dynamics and flow path mixing along the hillslope and highlight the importance of characterizing groundwater systems with observations that are sensitive to transport over a broad range of residence times.

54 ENVIRONMENTAL SCIENCES↗

Prediction of the SYM-H Index Using a Bayesian Deep Learning Method With Uncertainty Quantification

We propose a novel deep learning framework, named SYMHnet, which employs a graph neural network and a bidirectional long short-term memory network to cooperatively learn patterns from solar wind and interplanetary magnetic field parameters for short-term forecasts of the SYM-H index based on 1- and 5-min resolution data. SYMHnet takes, as input, the time series of the parameters' values provided by NASA's Space Science Data Coordinated Archive and predicts, as output, the SYM-H index value at time point t + w hours for a given time point t where w is 1 or 2. By incorporating Bayesian inference into the learning framework, SYMHnet can quantify both aleatoric (data) uncertainty and epistemic (model) uncertainty when predicting future SYM-H indices. Experimental results show that SYMHnet works well at quiet time and storm time, for both 1- and 5-min resolution data. The results also show that SYMHnet generally performs better than related machine learning methods. For example, SYMHnet achieves a forecast skill score (FSS) of 0.343 compared to the FSS of 0.074 of a recent gradient boosting machine (GBM) method when predicting SYM-H indices (1 hr in advance) in a large storm (SYM-H = -393 nT) using 5-min resolution data. When predicting the SYM-H indices (2 hr in advance) in the large storm, SYMHnet achieves an FSS of 0.553 compared to the FSS of 0.087 of the GBM method. In addition, SYMHnet can provide results for both data and model uncertainty quantification, whereas the related methods cannot.

79 ASTRONOMY AND ASTROPHYSICS↗

Turn-key constrained parameter space exploration for particle accelerators using Bayesian active learning

Abstract Particle accelerators are invaluable discovery engines in the chemical, biological and physical sciences. Characterization of the accelerated beam response to accelerator input parameters is often the first step when conducting accelerator-based experiments. Currently used techniques for characterization, such as grid-like parameter sampling scans, become impractical when extended to higher dimensional input spaces, when complicated measurement constraints are present, or prior information known about the beam response is scarce. Here in this work, we describe an adaptation of the popular Bayesian optimization algorithm, which enables a turn-key exploration of input parameter spaces. Our algorithm replaces the need for parameter scans while minimizing prior information needed about the measurement’s behavior and associated measurement constraints. We experimentally demonstrate that our algorithm autonomously conducts an adaptive, multi-parameter exploration of input parameter space, potentially orders of magnitude faster than conventional grid-like parameter scans, while making highly constrained, single-shot beam phase-space measurements and accounts for costs associated with changing input parameters. In addition to applications in accelerator-based scientific experiments, this algorithm addresses challenges shared by many scientific disciplines, and is thus applicable to autonomously conducting experiments over a broad range of research topics.

43 PARTICLE ACCELERATORS↗

Bayesian tomography of high-dimensional on-chip biphoton frequency combs with randomized measurements

Abstract Owing in large part to the advent of integrated biphoton frequency combs, recent years have witnessed increased attention to quantum information processing in the frequency domain for its inherent high dimensionality and entanglement compatible with fiber-optic networks. Quantum state tomography of such states, however, has required complex and precise engineering of active frequency mixing operations, which are difficult to scale. To address these limitations, we propose a solution that employs a pulse shaper and electro-optic phase modulator to perform random operations instead of mixing in a prescribed manner. We successfully verify the entanglement and reconstruct the full density matrix of biphoton frequency combs generated from an on-chip Si 3 N 4 microring resonator in up to an 8 × 8-dimensional two-qudit Hilbert space, the highest dimension to date for frequency bins. More generally, our employed Bayesian statistical model can be tailored to a variety of quantum systems with restricted measurement capabilities, forming an opportunistic tomographic framework that utilizes all available data in an optimal way.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Active learning of reactive Bayesian force fields applied to heterogeneous catalysis dynamics of H/Pt

Abstract Atomistic modeling of chemically reactive systems has so far relied on either expensive ab initio methods or bond-order force fields requiring arduous parametrization. Here, we describe a Bayesian active learning framework for autonomous “on-the-fly” training of fast and accurate reactive many-body force fields during molecular dynamics simulations. At each time-step, predictive uncertainties of a sparse Gaussian process are evaluated to automatically determine whether additional ab initio training data are needed. We introduce a general method for mapping trained kernel models onto equivalent polynomial models whose prediction cost is much lower and independent of the training set size. As a demonstration, we perform direct two-phase simulations of heterogeneous H 2 turnover on the Pt(111) catalyst surface at chemical accuracy. The model trains itself in three days and performs at twice the speed of a ReaxFF model, while maintaining much higher fidelity to DFT and excellent agreement with experiment.

42 ENGINEERING↗

A unifying Bayesian framework for merging X-ray diffraction data

Novel X-ray methods are transforming the study of the functional dynamics of biomolecules. Key to this revolution is detection of often subtle conformational changes from diffraction data. Diffraction data contain patterns of bright spots known as reflections. To compute the electron density of a molecule, the intensity of each reflection must be estimated, and redundant observations reduced to consensus intensities. Systematic effects, however, lead to the measurement of equivalent reflections on different scales, corrupting observation of changes in electron density. Here, we present a modern Bayesian solution to this problem, which uses deep learning and variational inference to simultaneously rescale and merge reflection observations. We successfully apply this method to monochromatic and polychromatic single-crystal diffraction data, as well as serial femtosecond crystallography data. We find that this approach is applicable to the analysis of many types of diffraction experiments, while accurately and sensitively detecting subtle dynamics and anomalous scattering.

59 BASIC BIOLOGICAL SCIENCES↗

Low-index mesoscopic surface reconstructions of Au surfaces using Bayesian force fields

Metal surfaces have long been known to reconstruct, significantly influencing their structural and catalytic properties. Many key mechanistic aspects of these subtle transformations remain poorly understood due to limitations of previous simulation approaches. Using active learning of Bayesian machine-learned force fields trained from ab initio calculations, we enable large-scale molecular dynamics simulations to describe the thermodynamics and time evolution of the low-index mesoscopic surface reconstructions of Au (e.g., the Au(111)-‘Herringbone,’ Au(110)-(1 × 2)-‘Missing-Row,’ and Au(100)-‘Quasi-Hexagonal’ reconstructions). This capability yields direct atomistic understanding of the dynamic emergence of these surface states from their initial facets, providing previously inaccessible information such as nucleation kinetics and a complete mechanistic interpretation of reconstruction under the effects of strain and local deviations from the original stoichiometry. We successfully reproduce previous experimental observations of reconstructions on pristine surfaces and provide quantitative predictions of the emergence of spinodal decomposition and localized reconstruction in response to strain at non-ideal stoichiometries. A unified mechanistic explanation is presented of the kinetic and thermodynamic factors driving surface reconstruction. Furthermore, we study surface reconstructions on Au nanoparticles, where characteristic (111) and (100) reconstructions spontaneously appear on a variety of high-symmetry particle morphologies.

36 MATERIALS SCIENCE↗

Off-the-shelf deep learning is not enough, and requires parsimony, Bayesianity, and causality

Abstract Deep neural networks (‘deep learning’) have emerged as a technology of choice to tackle problems in speech recognition, computer vision, finance, etc. However, adoption of deep learning in physical domains brings substantial challenges stemming from the correlative nature of deep learning methods compared to the causal, hypothesis driven nature of modern science. We argue that the broad adoption of Bayesian methods incorporating prior knowledge, development of solutions with incorporated physical constraints and parsimonious structural descriptors and generative models, and ultimately adoption of causal models, offers a path forward for fundamental and applied research.

97 MATHEMATICS AND COMPUTING↗