Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Single-Point Extrapolation to the Complete Basis Set Limit through Deep Learning

Machine learning (ML) offers an attractive method for making predictions about molecular systems while circumventing the need to run expensive electronic structure calculations. Once trained on ab initio data, the promise of ML is to deliver accurate predictions of molecular properties that were previously computationally infeasible. In this work, we develop and train a graph neural network model to correct the basis set incompleteness error (BSIE) between a small and large basis set at the RHF and B3LYP levels of theory. Our results show that, when compared to fitting to the total potential, an ML model fitted to correct the BSIE is better at generalizing to systems not seen during training. We test this ability by training on single molecules while evaluating on molecular complexes. We also show that ensemble models yield better behaved potentials in situations where the training data is insufficient. However, even when only fitting to the BSIE, acceptable performance is only achieved when the training data sufficiently resemble the systems one wants to make predictions on. As a result, the test error of the final model trained to predict the difference between the cc-pVDZ and cc-pV5Z potential is 0.184 kcal/mol for the B3LYP density functional, and the ensemble model accurately reproduces the large basis set interaction energy curves on the S66x8 dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

A Machine Learning Framework for Modeling Ensemble Properties of Atomically Disordered Materials

Atomic disorder can strongly influence material properties such as charge transport, optical response, and catalytic activity. However, efficiently modeling these disorder effects remains challenging for first-principles methods due to the cost of sampling large configurational spaces and computing complex physical quantities. Recent advances of machine learning techniques, particularly graph neural networks (GNNs), has enabled the efficient and accurate predictions of complex material properties, offering promising tools for studying disordered systems. In this work, we present a general machine-learning-assisted computational framework that integrates equivariant GNNs with Monte Carlo simulations to compute the thermodynamic and ensemble-averaged functional properties of disordered materials. Using the surface-termination-disordered MXene monolayer Ti 3 C 2 T 2–x as a representative system, we find that electrical conductivity exhibits an emergent peak near the order–disorder phase transition temperature due to the interplay between electron scattering and doping. In contrast, optical conductivity remains largely insensitive to local atomic disorder and reflects the global surface chemical composition. These results highlight the role of atomic disorder in affecting material properties and demonstrate the potential of our approach for statistically modeling disorder effects in a wide range of materials such as high-entropy alloys and spin liquids.

MXene↗
DOE OSTI2020

CMIP6 Models Predict Significant 21st Century Decline of the Atlantic Meridional Overturning Circulation

We explore the representation of the Atlantic Meridional Overturning Circulation (AMOC) in 27 models from the CMIP6 multi-model ensemble. Comparison with RAPID and SAMBA observations suggests that the ensemble mean represents the AMOC strength and vertical profile reasonably well. Linear trends over the entire historical period (1850-2014) are generally neutral, but many models exhibit an AMOC peak around the 1980’s. Ensemble-mean AMOC decline in future (SSP) scenarios is stronger in CMIP6 than CMIP5 models. In fact, AMOC decline in CMIP6 is surprisingly insensitive to the scenario at least up to 2060. We find an emergent relationship among a majority of models between AMOC strength and 21st century AMOC decline. Constraining this relationship with RAPID observations suggests that the AMOC might decline between 6 and 8 Sv (34-45%) by 2100. A smaller group of models projects much less AMOC weakening of only up to 30%.

58 GEOSCIENCES↗
DOE OSTI2020

Finite-Temperature Structures of Supported Subnanometer Catalysts Inferred via Statistical Learning and Genetic Algorithm-Based Optimization

Single-atom catalysts (SACs) minimize noble metal utilization and can alter the activity and selectivity of supported metal nanoparticles. However, the morphology of active centers, including single atoms and subnanometer clusters of a few atoms, remains elusive due to experimental challenges. The computational cost to describe numerous cluster shapes and sizes makes direct first-principles calculations impractical. We present a computational framework to enable structure determination for single-atom and subnanometer cluster catalysts. As a case study, we obtained the low energy structures of Pd n (n = 1-21) clusters supported on CeO 2 (111), which are critical components of automobile three-way catalysts. Trained on density functional theory data, a three-dimensional cluster expansion is established using statistical learning to describe the Hamiltonian and predict energies of supported Pdn clusters of any structure. Low energy stable and metastable structures are identified using a Metropolis Monte Carlo-based genetic algorithm in the canonical ensemble at 300 K. We observe that supported single atoms sinter to form bilayer clusters and large cluster isomers share similarities in both shape and energy, and elucidate the significance of the support and microstructure on cluster stability. We discovered a simple surrogate structure-energy model, where the energy per atom scales with the square root of the average first coordination number, which can be used to estimate energies and compare the stability of clusters. Our framework, applicable to any metal/support system, fills an important methodological gap to predict the stability of supported metal catalysts in the subnanometer regime.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Comparing quantile regression forest and mixture density long short-term memory models for probabilistic post-processing of satellite precipitation-driven streamflow simulations

Abstract. Deep learning (DL) and machine learning (ML) are widely used in hydrological modelling, which plays a critical role in improving the accuracy of hydrological predictions. However, the trade-off between model performance and computational cost has always been a challenge for hydrologists when selecting a suitable model, particularly for probabilistic post-processing with large ensemble members. This study aims to systematically compare the quantile regression forest (QRF) model and countable mixtures of asymmetric Laplacians long short-term memory (CMAL-LSTM) model as hydrological probabilistic post-processors. Specifically, we evaluate their ability in dealing with biased streamflow simulations driven by three satellite precipitation products across 522 nested sub-basins of the Yalong River basin in China. Model performance is comprehensively assessed using a series of scoring metrics from both probabilistic and deterministic perspectives. Our results show that the QRF model and the CMAL-LSTM model are comparable in terms of probabilistic prediction, and their performances are closely related to the flow accumulation area (FAA) of the sub-basin. The QRF model outperforms the CMAL-LSTM model in most sub-basins with smaller FAA, while the CMAL-LSTM model has an undebatable advantage in sub-basins with FAA larger than 60 000 km2 in the Yalong River basin. In terms of deterministic predictions, the CMAL-LSTM model is preferred, especially when the raw streamflow is poorly simulated and used as input. However, setting aside the differences in model performance, the QRF model with 100-member quantiles demonstrates a noteworthy advantage by exhibiting a 50 % reduction in computation time compared to the CMAL-LSTM model with the same ensemble members in all experiments. As a result, this study provides insights into model selection in hydrological post-processing and the trade-offs between model performance and computational efficiency. The findings highlight the importance of considering the specific application scenario, such as the catchment size and the required accuracy level, when selecting a suitable model for hydrological post-processing.

Geology↗
DOE OSTI2024

Jet suppression and azimuthal anisotropy from RHIC to LHC

Azimuthal anisotropies of high- p T particles produced in heavy-ion collisions are understood as an effect of a geometrical selection bias. Particles oriented in the direction in which the QCD medium formed in these collisions is shorter suffer less energy loss, and thus, are over-represented in the final ensemble compared to those oriented in the direction in which the medium is longer. In this work we present the first semianalytical predictions, including propagation through a realistic, hydrodynamical background, of the elliptic azimuthal anisotropy for jets, obtaining a quantitative agreement with available experimental data as a function of the jet p T , its cone size R , and the collisions centrality. Jets are multipartonic, extended objects and their energy loss is sensitive to substructure fluctuations. This sensitivity is determined by the physics of color coherence that relates to the ability of the medium to resolve those partonic fluctuations. Specifically, color dipoles with an angular separation smaller than a critical angle, θ c , are not resolved by the medium and they effectively act as a coherent source of energy loss. We find that elliptic jet azimuthal anisotropy has a specially strong dependence on coherence physics due to the marked length dependence of θ c . By combining our predictions for the collision systems and center-of-mass energies studied at RHIC and the LHC, covering a wide range of typical values of θ c , we show that the relative size of elliptic jet azimuthal anisotropies for jets with different cone sizes R follows a universal trend that indicates a transition from a coherent regime of jet quenching to a decoherent regime. These results suggest a way forward to reveal the role played by the physics of jet color decoherence in probing deconfined QCD matter. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Generating entangled steady states in multistable open quantum systems via initial state control

Entanglement underpins the power of quantum technologies, yet it is fragile and typically destroyed by dissipation. Paradoxically, the same dissipation, when carefully engineered, can drive a system toward robust entangled steady states. However, this engineering task is nontrivial, as dissipative many-body systems are complex, particularly when they support multiple steady states. Here, we derive analytic expressions that predict how the steady state of a system evolving under a Lindblad equation depends on the initial state, without requiring integration of the dynamics. These results extend Refs. [V. V. Albert and L. Jiang, Phys. Rev. A 89, 022118 (2014); V. V. Albert et al., Phys. Rev. X 6, 041031 (2016)], showing that while the steady-state manifold is determined by the Liouvillian kernel, the weights within it depend on both the Liouvillian and the initial state. We identify a special class of Liouvillians for which the steady state depends only on the initial overlap with the kernel. Our framework provides analytical insight and a computationally efficient tool for predicting steady states in open quantum systems. As an application, we propose schemes to generate metrologically useful entangled steady states in spin ensembles via balanced collective decay.

Dissipative dynamics↗
DOE OSTI2024

Evidential Deep Learning for Probabilistic Modelling of Extreme Storm Events

Uncertainty quantification (UQ) methods play an important role in reducing errors in weather forecasting. Conventional approaches in UQ for weather forecasting rely on generating an ensemble of forecasts from physics-based simulations to estimate the uncertainty. However, it is computationally expensive to generate many forecasts to predict real-time extreme weather events. Evidential Deep Learning (EDL) is an uncertainty-aware deep learning approach designed to provide confidence about its predictions using only one forecast. It treats learning as an evidence acquisition process where more evidence is interpreted as increased predictive confidence. We apply EDL to storm forecasting using real-world weather datasets and compare its performance with traditional methods. Our findings indicate that EDL not only reduces computational overhead but also enhances predictive uncertainty. This method opens up novel opportunities in research areas such as climate risk assessment, where quantifying the uncertainty about future climate is crucial.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Resolving turbulent magnetohydrodynamics: a hybrid operator-diffusion framework

We present a hybrid machine learning framework that combines physics-informed neural operators (PINOs) with score-based generative diffusion models to simulate the full spatio-temporal evolution of two-dimensional, incompressible, resistive magnetohydrodynamic turbulence across a broad range of Reynolds numbers (Re). The framework leverages the equation-constrained generalization capabilities of PINOs to predict coherent, low-frequency dynamics, while a conditional diffusion model stochastically corrects high-frequency residuals, enabling accurate modeling of fully developed turbulence. Trained on a comprehensive ensemble of high-fidelity simulations with Re ϵ {100, 250, 500, 750, 1000, 3000, 10000}, the approach achieves state-of-the-art accuracy in regimes previously inaccessible to deterministic surrogates. At Re = 1000 and 3000, the model faithfully reconstructs the full spectral energy distributions of both velocity and magnetic fields late into the simulation, capturing non-Gaussian statistics, intermittent structures, and cross-field correlations with high fidelity. At extreme turbulence levels (Re = 10 000), it remains the first surrogate capable of recovering the high-wavenumber evolution of the magnetic field, preserving large-scale morphology and enabling statistically meaningful predictions.

Diffusion-Integrated Neural Operators↗
DOE OSTI2020

Persistent Protein Motions in a Rugged Energy Landscape Revealed by Normal Mode Ensemble Analysis

Proteins are allosteric machines that couple motions at distinct, often distant, sites to control biological function. Low-frequency structural vibrations are a mechanism of this long-distance connection and are often used computationally to predict correlations, but experimentally identifying the vibrations associated with specific motions has proved challenging. Spectroscopy is an ideal tool to explore these excitations, but measurements have been largely unable to identify important frequency bands. The result is at odds with some previous calculations and raises the question what methods could successfully characterize protein structural vibrations. Here we show the lack of spectral structure arises in part from the variations in protein structure as the protein samples the energy landscape. However, by averaging over the energy landscape as sampled using an aggregate 18.5 μs of all-atom molecular dynamics simulation of hen egg white lysozyme and normal-mode analyses, we find vibrations with large overlap with functional displacements are surprisingly concentrated in narrow frequency bands. These bands are not apparent in either the ensemble averaged vibrational density of states or isotropic absorption. However, in the case of the ensemble averaged anisotropic absorption, there is persistent spectral structure and overlap between this structure and the functional displacement frequency bands. We systematically lay out heuristics for calculating the spectra robustly, including the need for statistical sampling of the protein and inclusion of adequate water in the spectral calculation. The results show the congested spectrum of these complex molecules obscures important frequency bands associated with function and reveal a method to overcome this congestion by combining structurally sensitive spectroscopy with robust normal mode ensemble analysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Application-specific optimal model weighting of global climate models: A red tide example

Global climate models (GCMs) and Earth system models (ESMs) provide many climate services with environmental relevance. The High Resolution Model Inter-comparison Project (HighResMIP) of the Coupled Model Intercomparison Project Phase 6 (CMIP6) provides model runs of GCMs and ESMs to address regional phenomena. Developing a parsimonious ensemble of CMIP6 requires multiple ensemble methods such as independent-model subset selection, prescreening-based subset selection, and model weighting. The work presented here focuses on application-specific optimal model weighting, with prescreening-based subset selection. As such, independent ensemble members are categorized, selected, and weighted based on their ability to reproduce physically-interpretable features of interest that are problem-specific. We discuss the strengths and caveats of optimal model weighting using a case study of red tide prediction in the Gulf of Mexico along the West Florida Shelf. Red tide is a common name of specific harmful algal blooms that occur worldwide, causing adverse socioeconomic and environmental impacts. Our results indicate the importance of prescreening-based subset selection as optimal model weighting can underplay robust ensemble members by optimizing error cancellation. Prescreening-based subset selection also provides insights about the validity of the model weights. By illustrating the caveats of using non-representative models when optimal model weighting is used, the findings and discussion of this study are pertinent to many other climate services.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Assessing the impact of substrate-level enzyme regulations limiting ethanol titer in Clostridium thermocellum using a core kinetic model

Clostridium thermocellum is a promising candidate for consolidated bioprocessing because it can directly ferment cellulose to ethanol. Despite significant efforts, achieved yields and titers fall below industrially relevant targets. This implies that there still exist unknown enzymatic, regulatory, and/or possibly thermodynamic bottlenecks that can throttle back metabolic flow. By (i) elucidating internal metabolic fluxes in wild-type C. thermocellum grown on cellobiose via 13 C-metabolic flux analysis ( 13 C-MFA), (ii) parameterizing a core kinetic model, and (iii) subsequently deploying an ensemble-docking workflow for discovering substrate-level regulations, this paper aims to reveal some of these factors and expand our knowledgebase governing C. thermocellum metabolism. Generated 13 C labeling data were used with 13 C-MFA to generate a wild-type flux distribution for the metabolic network. Notably, flux elucidation through MFA alluded to serine generation via the mercaptopyruvate pathway. Using the elucidated flux distributions in conjunction with batch fermentation process yield data for various mutant strains, we constructed a kinetic model of C. thermocellum core metabolism (i.e. k-ctherm138). Subsequently, we used the parameterized kinetic model to explore the effect of removing substrate-level regulations on ethanol yield and titer. Upon exploring all possible simultaneous (up to four) regulation removals we identified combinations that lead to many-fold model predicted improvement in ethanol titer. In addition, by coupling a systematic method for identifying putative competitive inhibitory mechanisms using K-FIT kinetic parameterization with the ensemble-docking workflow, we flagged 67 putative substrate-level inhibition mechanisms across central carbon metabolism supported by both kinetic formalism and docking analysis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Scalable Bayesian Physics-Informed Kolmogorov-Arnold Networks

Uncertainty quantification (UQ) plays a pivotal role in scientific machine learning, especially when surrogate models are used to approximate complex systems. Although multilayer perceptions (MLPs) are commonly employed as surrogates, they often suffer from overfitting due to their large number of parameters. Kolmogorov-Arnold networks (KANs) offer an alternative solution with fewer parameters. However, gradient-based inference methods, such as Hamiltonian Monte Carlo (HMC), may result in computational inefficiency when applied to KANs, especially for large-scale datasets, due to the high cost of back-propagation. To address these challenges, we propose a novel approach, combining the dropout Tikhonov ensemble Kalman inversion (DTEKI) with Chebyshev KANs. This gradient-free method effectively mitigates overfitting and enhances numerical stability. In addition, we incorporate the active subspace method to reduce the parameter-space dimensionality, allowing us to improve the accuracy of predictions and obtain more reliable uncertainty estimates. Extensive experiments demonstrate the efficacy of our approach in various test cases, including scenarios with large datasets and high noise levels. Our results show that the new method achieves comparable or better accuracy, much higher efficiency as well as stability compared to HMC, in addition to scalability. Moreover, by leveraging the low-dimensional parameter subspace, our method preserves prediction accuracy while substantially reducing further the computational cost.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Physics-Infused AI/ML Based Digital-Twin Framework for Flow-Induced-Vibration Damage Prediction in a Nuclear Reactor Heat Exchanger

This report summarizes some of the ongoing work related to the development of an expert-elicitation-digital-twin framework for real time damage state prediction in heat exchanger components of a nuclear reactor. The framework is targeted towards predicting damage associated with coupled low cycle fatigue (associated with regular heat-up, cool-down and power operation transients) and high cycle fatigue (associated with flow induced vibration transients). The overall framework will be based on a NoSQL based database, physics-infused-geometry-dependent virtual-sensor data, different AI/ML techniques-based data-driven-predictive-model applications (Apps) and real-time plant sensor measurements available through few existing sensors. Towards this overall goal, this report updates some of the ongoing work, such as on implementation of a NoSQL Database (such as MongoDB), FE based heat transfer analysis of a heat exchanger (e.g. of a PWR steam generator) for generating geometry-dependent virtual sensor data and evaluation of various AI/ML models such as based on multivariate linear regression, ensembled decision-tree based Random-Forest and Gradient-Boosting regression and high-dimensional-kernel-function-transformation based Support-Vector-Machine regression models. The AI/ML models were evaluated for predicting multi-time-series thermal states at thousands of 3D point-clouds

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Notable Contributions of Aerosols to the Predictability of Hail Precipitation

There is an increasing concern of the uncertainty produced by aerosols in forecasting precipitation including hail precipitation. This study provides an assessment of the uncertainties in hail and total precipitation by varying initial cloud condensation nuclei (CCN) number concentration (CCNC) and meteorological conditions based on 1200 cloud-resolving simulations of an idealized hailstorm. Although the meteorological perturbations produce large uncertainties in hail precipitation (including rate and maximum hail size) as well as total precipitation, varying CCNC by an order of magnitude can cause even larger uncertainties, especially pairing with the thermodynamics perturbation (i.e., potential temperature and water vapor). Changing CCNC modifies the predictability of hail precipitation, with a higher predictability in moderate polluted environments compared with the very clean and polluted environments. Increasing CCNC consistently leads a non-monotonic response of ensemble mean with an optimal CCNC for hail precipitation but a monotonic decreasing response of total precipitation with the various meteorological perturbations, meaning the initial meteorological perturbations does not qualitatively change the aerosol effects. Investigation with 10-fold reduced initial perturbation further supports the large CCN effects are not dependent of metrological perturbations. The findings suggest the importance of considering CCN effects in severe weather simulations and forecasting.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Deducing subnanometer cluster size and shape distributions of heterogeneous supported catalysts

Abstract Infrared (IR) spectra of adsorbate vibrational modes are sensitive to adsorbate/metal interactions, accurate, and easily obtainable in-situ or operando. While they are the gold standards for characterizing single-crystals and large nanoparticles, analogous spectra for highly dispersed heterogeneous catalysts consisting of single-atoms and ultra-small clusters are lacking. Here, we combine data-based approaches with physics-driven surrogate models to generate synthetic IR spectra from first-principles. We bypass the vast combinatorial space of clusters by determining viable, low-energy structures using machine-learned Hamiltonians, genetic algorithm optimization, and grand canonical Monte Carlo calculations. We obtain first-principles vibrations on this tractable ensemble and generate single-cluster primary spectra analogous to pure component gas-phase IR spectra. With such spectra as standards, we predict cluster size distributions from computational and experimental data, demonstrated in the case of CO adsorption on Pd/CeO 2 (111) catalysts, and quantify uncertainty using Bayesian Inference. We discuss extensions for characterizing complex materials towards closing the materials gap.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Shortwave absorption by wildfire smoke dominated by dark brown carbon

Abstract Wildfires emit large amounts of black carbon and light-absorbing organic carbon, known as brown carbon, into the atmosphere. These particles perturb Earth’s radiation budget through absorption of incoming shortwave radiation. It is generally thought that brown carbon loses its absorptivity after emission in the atmosphere due to sunlight-driven photochemical bleaching. Consequently, the atmospheric warming effect exerted by brown carbon remains highly variable and poorly represented in climate models compared with that of the relatively nonreactive black carbon. Given that wildfires are predicted to increase globally in the coming decades, it is increasingly important to quantify these radiative impacts. Here we present measurements of ensemble-scale and particle-scale shortwave absorption in smoke plumes from wildfires in the western United States. We find that a type of dark brown carbon contributes three-quarters of the short visible light absorption and half of the long visible light absorption. This strongly absorbing organic aerosol species is water insoluble, resists daytime photobleaching and increases in absorptivity with night-time atmospheric processing. Our findings suggest that parameterizations of brown carbon in climate models need to be revised to improve the estimation of smoke aerosol radiative forcing and associated warming.

54 ENVIRONMENTAL SCIENCES↗