E3SM Atmosphere surrogate construction and calibration using machine learning and reduced order modeling .
Abstract not provided.
Wagman, Benjamin↗
SEARCH · Engineering Papers
Results for “SURROGATE MODELS”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Predicting Catalyst Surface Stability Under Reaction Conditions Using Deep Reinforcement Learning and Machine Learning Potentials
Catalysts are critical for most large-scale energy intensive chemical transformation processes, such as energy storage, liquid fuel production, and the formation of chemical building blocks. The catalyst composition, structure, and morphology impact the performance under reaction conditions and influences properties like activity and selectivity. Many industrial catalysts offer imperfect activity/selectivity, or contain expensive metals. Further, catalysts can deactivate over time as the morphology changes or harsh reactive environments alter the surface structure. Methods to automatically model and predict the kinetics of how catalyst surfaces will restructure would enable engineers to design around these challenges, improve performance, increase longevity. This project investigated a specific type of machine learning model, deep reinforcement learning, machine learning models to act as surrogates for the physical system, and compared the results of these approaches with a specialized high-throughput experimental synthesis and measurement platform.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Improving Accuracy of Stochastic Collocation Surrogates for ODE/PDE Systems via Data-Driven Factorization of Model Dynamics
Explore the source record for details and available documents.
De, Saibal↗
Cholesky-based experimental design for Gaussian process and kernel-based emulation and calibration.
Gaussian processes and other kernel-based methods are used extensively to construct approximations of multivariate data sets. The accuracy of these approximations is dependent on the data used. This paper presents a computationally efficient algorithm to greedily select training samples that minimize the weighted L p error of kernel-based approximations for a given number of data. The method successively generates nested samples, with the goal of minimizing the error in high probability regions of densities specified by users. The algorithm presented is extremely simple and can be implemented using existing pivoted Cholesky factorization methods. Training samples are generated in batches which allows training data to be evaluated (labeled) in parallel. For smooth kernels, the algorithm performs comparably with the greedy integrated variance design but has significantly lower complexity. Numerical experiments demonstrate the efficacy of the approach for bounded, unbounded, multi-modal and non-tensor product densities. We also show how to use the proposed algorithm to efficiently generate surrogates for inferring unknown model parameters from data using Bayesian inference.
97 MATHEMATICS AND COMPUTING↗
Deep Learning for Simultaneous Inference of Hydraulic and Transport Properties
Abstract Identification of a heterogeneous conductivity field and reconstruction of a contaminant release history are key aspects of subsurface remediation. These two goals are achieved by combining model predictions with sparse and noisy hydraulic head and concentration measurements. Solution of this inverse problem is notoriously difficult due to, in part, high dimensionality of the parameter space and high computational cost of repeated forward solves. We use a convolutional adversarial autoencoder (CAAE) to parameterize a heterogeneous non‐Gaussian conductivity field via a low‐dimensional latent representation. A three‐dimensional dense convolutional encoder‐decoder (DenseED) network serves as a forward surrogate of the flow and transport model. The CAAE‐DenseED surrogate is fed into the ensemble smoother with multiple data assimilation (ESMDA) algorithm to sample from the Bayesian posterior distribution of the unknown parameters, forming a CAAE‐DenseED‐ESMDA inversion framework. The resulting CAAE‐DenseED‐ESMDA inversion strategy is used to identify a three‐dimensional contaminant source and conductivity field. A comparison of the inversion results from CAAE‐ESMDA with physical flow and transport simulator and from CAAE‐DenseED‐ESMDA shows that the latter yields accurate reconstruction results at the fraction of the computational cost of the former.
Zhou, Zitong↗
Calibration of hyperelastic constitutive models: the role of boundary conditions, search algorithms, and experimental variability
The calibration of hyperelastic constitutive models of soft tissue and tissue surrogates is often treated as an exercise in curve-fitting to the average experimental response, and many of the complicating factors such as experimental boundary conditions and data variability are ignored. Here, we focus on three questions that arise in this area: the ramifications of ignoring the experimental boundary conditions, the use of local optimizers, and the role of data variability. Using data from a uniaxial extension experiment on a tissue surrogate, we study how these three factors affect the calibration of isotropic hyperelastic constitutive models. Our results show that even with the simplest of constitutive models, it is necessary to look beyond a "good fit" to the average.
60 APPLIED LIFE SCIENCES↗
Characterization of high thermal conductivity fuel surrogates before and after ion irradiation
High thermal conductivity nuclear fuels offer important potential advantages over traditional oxide-based fuels such as higher burnup, reduction in fission gas release, and better overall safety of the system. One proposed approach to high thermal conductivity fuels utilizes high thermal conductivity nonfissile additives with UO 2 fuel to lower the fuel operating temperature and thereby take advantage of the highly favorable radiation resistance of UO 2 at lower operating temperatures. However, differential swelling in the matrix and high conductivity additive phases during high dose irradiation could lead to internal cracking and poor performance. In the current study, ceria (CeO 2 ) and zirconia (ZrO 2 ) surrogate matrices were used to model UO2 behavior. Additives of 10 vol. % Al 2 O 3 or SiC in the form of short fibers or platelets were used for the high conductivity second phase. The nuclear fuel surrogates were sintered to achieve densities greater than 93% of the ideal values. Scanning electron microscopy (SEM) imaging and X-ray diffraction confirmed the uniform distribution of the second phase and that no intermetallic second phase was formed during sintering. The thermal conductivity of the sintered samples was measured from 50 °C to 900 °C and confirmed the desirable increase compared to pure CeO 2 /ZrO 2 pellets. Samples were irradiated with 20 MeV Ni 6+ ions at midrange doses ranging from 1 to 15 displacements per atom (dpa) and temperatures from 300 °C to 700 °C. Post irradiation characterization revealed a good stability of the samples at low to medium doses with matrix lattice parameter swelling of < 0.14 % but showed a significant microstructural deterioration and decrease of the mechanical properties at 15 dpa.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Combustion of petroleum-based transportation fuels and their blends with biofuels: a new approach for developing surrogates and understanding the effects of blending
Accurate and versatile reaction mechanisms are necessary to simulate combustion of transportation fuels blended with biofuels for improving fuel efficiency, reducing fuel consumption and mitigating the formation and emissions of combustion products harmful to the atmosphere. This project involved a combined effort of simulation and experimentation of liquid fuel burning using a combustion configuration amenable to numerical modeling with a level of detail not previously achieved for blends of biofuels with gasoline certification and surrogate fuels. The configuration of an isolated droplet burning under conditions where gas transport arises solely from fuel evaporation was selected as the platform for experiments and numerical modeling. The spherical symmetry and one-dimensional gas transport that results enabled simulating the droplet burning process with an precedented level of detail. Processes associated with unsteady gas and liquid transport, formation of particulate and gaseous products, radiation, multicomponent phase equilibrium at the droplet surface and moving boundary effects from droplet evaporation, were incorporated in a single numerical framework. The numerical model was based on the open source code OPENSmoke++ (OS) adapted to incorporate the effects noted above. In addition to simulation, an experimental design was developed for the isolated droplet configuration to acquire the data needed for validating the numerical model. Several broad accomplishments of the project were the following: demonstrating generally excellent agreement between measured and simulated combustion parameters for the fuel blends examined that included mixtures of heptane and isobutanol as a model system, and surrogates comprised of up to seven miscible components mixed with ethanol or isobutanol as representative biofuel additives; using a new approach to validate reaction mechanisms of biofuel blends which incorporated fuel evaporation into the process along with developing an experimental design for acquiring data to compare with simulations; and showing that a wealth of information could be obtained on the combustion physics of biofuels from experiments requiring volumes on the order of only nanoliters at a time thus opening the way to evaluating biofuels synthesized by new processes early in development.
02 PETROLEUM↗
Transfer learning of neural surrogates on multifidelity groundwater simulations
Multifidelity data used in the paper published in Advances in Water Resources 206 (2025) 105140, https://doi.org/10.1016/j.advwatres.2025.105140 The code used to process the data is openly available on GitHub at https://github.com/Model-Reduction-and-UQ-Group/Transfer_Learning_K_reconstruction Computationally inexpensive surrogates of process-based models, such as deep neural networks, enable ensemble-based computations used in risk assessment, data assimilation, etc. However, generation of large datasets required to train a neural network can be as expensive as the ensemble simulations themselves. We ameliorate this challenge by using data from multifidelity (MF) groundwater simulations and transfer learning (TL) to reduce data generation costs while maintaining model accuracy. As a computational example, we train a deep convolutional neural network (CNN) to reconstruct permeability fields from saturation maps derived from a multiphase flow model. Starting with very low- and low-fidelity data generated on increasingly coarse meshes, we pretrain the CNN, followed by output-layer training and fine-tuning using only a limited number of high-fidelity samples. We demonstrate the surrogate’s robustness when interpreting low-quality inputs—such as interpolated maps or data affected by noise—which has strong implications for the applicability in practical hydrogeological scenarios. This multilevel MF-TL strategy achieves a favorable trade-off between computational efficiency and predictive accuracy, significantly outperforming high-fidelity-only approaches under the same computational budget.
Chiofalo, Alessia [University of Bologna] (ORCID:0↗
Model form and sensitivity analysis of CALPHAD-based nucleation models in b-stabilized Ti alloys
Accurate prediction of α-phase nucleation and growth in β-stabilized titanium alloys is crucial for designing heat treatments to optimize mechanical properties in additively manufactured lightweight components. Ideally, predictions of nucleation and growth would incorporate both top-down observations of past experimental heat treatments and bottom-up modeling of phase transformations; however, the appropriate method of combining these information sources is not self-evident. Combining top-down and bottom-up information requires a unified form of model that can connect between spatiotemporal scales, as well as sets of fitting parameters that can be identified by each data source. The selection of which parameters to fit to which data source can be made based on expert opinion, or by performing a sensitivity analysis. In solid-solid nucleation, direct observation of the nucleation and growth process is challenging. Most data on the heat treatment-controlled phase transformations are not in-situ. To predict the process and outcome of the nucleation, growth and coarsening of precipitates, theoretical models of the nucleation pathway are used to bridge the gap. Many sources of uncertainty affect the modeling of this nucleation process. It can be influenced by small variations in the thermomechanical processing history, chemical composition, and initial microstructure. If molecular dynamics (MD) simulations are used to determine thermodynamic quantities and inform CALPHAD modeling, additional uncertainty can be introduced and accounted for using Bayesian methods. Top-down uncertainties require additional steps to quantify. The influence of nucleation model form on the sensitivity of predictions to input parameters and physical conditions is the focus of this study. Classical nucleation theory (CNT) allows modeling to formulate the nucleation as homogeneous or, more commonly, heterogeneous. Non-classical nucleation models are also increasingly explored as a means of reconciling top-down and bottom-up data. In this study, the sensitivity of the intragranular nucleation of α in a β-annealed, slow-cooled aging (BASCA) heat treatment of β-stabilized Ti5553 alloy is explored using CNT and both heterogeneous and homogeneous assumptions. The Kampmann-Wagner Numerical model of precipitate nucleation and growth is employed. Using open-source tools (pyCalphad and thermodynamic modeling of TiMo as a surrogate system, a sensitivity analysis is performed to measure variations in key parameters, including chemical driving force, interfacial energy, and diffusivity, as they relate to predictions of precipitate number density. The inclusion of top-down and bottom-up data in selection of nucleation model form is discussed.
Rodriguez Negron, A. M.↗
Enabling scientific machine learning in MOOSE using Libtorch
A neural-network-based machine learning interface has been developed for the Multiphysics Object-Oriented Simulation Environment (MOOSE). The interface relies on Libtorch, the C++ front-end of PyTorch, and enables an online interaction between modern machine learning algorithms and all the existing simulation, modeling, and analysis processes available in MOOSE. New capabilities in MOOSE include the native generation and training of artificial neural networks together with options to load pretrained neural networks in TorchScript format. Furthermore, the MOOSE stochastic tools module (MOOSE-STM) has been enhanced with neural network-based surrogate and reduced-order model generation options for efficient stochastic analyses. Lastly, a reinforcement learning capability has been added to MOOSE-STM for the interactive control and optimization of complex multiphysics problems.
97 MATHEMATICS AND COMPUTING↗
Physics-Informed Neural Network Modeling of Li-Ion Batteries: Preprint
Li-ion batteries (LIB) are a promising solution to enable storage of intermittent energy sources due to their high energy density. However, LIBs are known to significantly degrade after about 1000 charge-discharge cycles. LIBs degrade following different degradation modes and at a rate that depends on the operating conditions (external temperature, load). To plan the installation of batteries, appropriate understanding and prediction capabilities of their lifecycle is needed. High-fidelity numerical models of LIBs such as the pseudo-two-dimensional (P2D) model have been shown to accurately represent the charge-discharge-cycle of an LIB given ac- curate choice of the physical parameters. Given the large number of P2D parameters, adjusting them using forward runs is intractable. This work describes the development of a physics-informed neural network (PINN) as a surrogate substitute of the P2D model that captures parameter dependence. The PINN is advantageous as it needs little to no data, and can naturally encode the dependence of every model parameter. Here, a specific training procedure is adopted to efficiently cover parameter space, handle model stiffness and enforce boundary conditions. The trained PINN is validated against numerical solutions of the P2D model, and its applicability to battery degradation modeling is discussed.
battery degradation↗
Autoregressive long-horizon prediction of plasma edge dynamics *
Accurate modeling of scrape-off layer (SOL) and divertor-edge dynamics is vital for designing plasma-facing components in fusion devices. High-fidelity edge fluid/neutral codes such as SOLPS-ITER capture SOL physics with high accuracy, but their computational cost limits broad parameter scans and long transient studies. We present transformer-based, autoregressive surrogates for efficient prediction of 2D, time-dependent plasma edge state fields. Trained on SOLPS-ITER spatiotemporal data for the KSTAR tokamak, the surrogates forecast electron temperature, electron density, and radiated power over extended horizons. We evaluate model variants trained with increasing autoregressive horizons (1–100 steps) on short- and long-horizon prediction tasks. Longer-horizon training systematically improves rollout stability and mitigates error accumulation, enabling stable predictions over hundreds to thousands of steps and reproducing key dynamical features such as the motion of high-radiation regions. Measured end-to-end wall-clock times show the surrogate is orders of magnitude faster than SOLPS-ITER, enabling rapid parameter exploration. Prediction accuracy degrades when the surrogate enters physical regimes not represented in the training dataset, motivating future work on data enrichment and physics-informed constraints. Overall, this approach provides a fast, accurate surrogate for computationally intensive plasma edge simulations, supporting rapid scenario exploration, control-oriented studies, and progress toward real-time applications in fusion devices.
autoregressive deep learning↗
Predictive modeling of Néel temperature in austenitic alloys using CALPHAD and data analytics
The Néel temperature is a crucial yet often overlooked parameter in calculating the stacking fault energy (SFE) of austenitic alloys. Several empirical equations have been proposed to estimate the Néel temperature of austenitic alloys, which are then used to calculate the SFE and explain deformation mechanisms. However, these empirical equations, typically derived using linear regression algorithms, are often simplistic and may fail to capture the complex interactions among multiple alloying elements that influence the Néel temperature. Moreover, their applicability is usually limited to specific compositional ranges. In this study, we propose a CALPHAD based approach and develop a surrogate decision tree based regression model capable of capturing the interactions among multiple alloying elements to predict the Néel temperature. Predictions from both the CALPHAD approach and the regression model show close agreement with experimental measurements reported in the literature. In conclusion, the implications of accurate Néel temperature predictions on the calculated SFE and deformation mechanisms are also discussed.
36 MATERIALS SCIENCE↗
Data-driven learning of nonlocal physics from high-fidelity synthetic data
A key challenge to nonlocal models is the analytical complexity of deriving them from first principles, and frequently their use is justified a posteriori. Here, we extract nonlocal models from data, circumventing these challenges and providing data-driven justification for the resulting model form. Extracting data-driven surrogates is a major challenge for machine learning (ML) approaches, due to nonlinearities and lack of convexity — it is particularly challenging to extract surrogates which are provably well-posed and numerically stable. Our scheme not only yields a convex optimization problem, but also allows extraction of nonlocal models whose kernels may be partially negative while maintaining well-posedness even in small-data regimes. To achieve this, based on established nonlocal theory, we embed in our algorithm sufficient conditions on the non-positive part of the kernel that guarantee well-posedness of the learnt operator. These conditions are imposed as inequality constraints to meet the requisite conditions of the nonlocal theory. We demonstrate this workflow for a range of applications, including reproduction of manufactured nonlocal kernels; numerical homogenization of Darcy flow associated with a heterogeneous periodic microstructure; nonlocal approximation to high-order local transport phenomena; and approximation of globally supported fractional diffusion operators by truncated kernels.
42 ENGINEERING↗
Process‐Oriented Calibration of a Turbulence Scheme in the DOE's Global Storm‐Resolving Model Using Machine Learning
A process‐oriented calibration framework is developed for the Simplified Higher‐Order Closure (SHOC) turbulence scheme in DOE's Simple Cloud Resolving E3SM Atmospheric Model (SCREAM). This framework leverages machine learning surrogates and observational constraints to efficiently calibrate SHOC adjustable parameters across two convective regimes: clear‐sky dry convective boundary layer and fair‐weather shallow cumulus clouds from ARM observations. We use perturbed‐parameter ensembles of a doubly periodic version of SCREAM to train surrogates and apply Markov Chain Monte Carlo sampling guided by cost functions based on benchmarking large‐eddy simulations and observations to identify optimized parameter sets that perform well in both regimes. The calibrated SHOC parameters substantially improve boundary‐layer turbulence and cloud boundaries, and modeled cloud fraction and radiative effects align better with observations than the default. These results demonstrate that combining multiple process‐specific convective regimes with machine‐learning surrogates can reduce parametric uncertainties and yield a model more faithful to cloud–turbulence interactions.
58 GEOSCIENCES↗
Scalable training of graph convolutional neural networks for fast and accurate predictions of HOMO-LUMO gap in molecules
Abstract Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN surrogate for molecular design requires large-scale graph datasets and is usually a time-consuming process. Recent advances in GPUs and distributed computing open a path to reduce the computational cost for GCNN training effectively. However, efficient utilization of high performance computing (HPC) resources for training requires simultaneously optimizing large-scale data management and scalable stochastic batched optimization techniques. In this work, we focus on building GCNN models on HPC systems to predict material properties of millions of molecules. We use HydraGNN, our in-house library for large-scale GCNN training, leveraging distributed data parallelism in PyTorch. We use ADIOS, a high-performance data management framework for efficient storage and reading of large molecular graph data. We perform parallel training on two open-source large-scale graph datasets to build a GCNN predictor for an important quantum property known as the HOMO-LUMO gap. We measure the scalability, accuracy, and convergence of our approach on two DOE supercomputers: the Summit supercomputer at the Oak Ridge Leadership Computing Facility (OLCF) and the Perlmutter system at the National Energy Research Scientific Computing Center (NERSC). We present our experimental results with HydraGNN showing (i) reduction of data loading time up to 4.2 times compared with a conventional method and (ii) linear scaling performance for training up to 1024 GPUs on both Summit and Perlmutter.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
One‐Pot Synthesis of Xanthone by Carbonylative Suzuki Coupling Reaction
Abstract Xanthone derivatives have a dibenzo‐y‐pyrone scaffold which has gained great interest in Medicinal Chemistry due to their diverse biological activities. Usually, its synthesis requires multi‐step synthetic routes using harsh conditions and high catalyst loadings. In this communication, we report for the first time a one‐pot synthesis of the xanthone scaffold based on a carbonylative Suzuki coupling. Iodophenol and (2‐methoxyphenyl)boronic acid were coupled under carbon monoxide, generated from a carbon monoxide surrogate. An experimental data‐based model was built to guide the reaction optimization. The optimized conditions were 1 mol% of a pincer complex as palladium catalyst, 5 equivalents of K 2 CO 3 as base, and DMF:water (7 : 3) as solvent. The robustness of the synthetic method, namely in terms of the reactants scope, was also evaluated. This approach provided the xanthone scaffold in high yields and provided a deep insight into the carbonylative Suzuki couplings.
Loureiro, Daniela R. P.↗