Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SURROGATE MODELS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

End-to-End Differentiable Modeling and Management of the Environment

Focal Area: (2) Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization. We emphasize the importance of leveraging optimization techniques from AI/machine learning (ML) to solve challenging problems in Earth system modeling. Science Challenge: Automatic differentiation has had a transformative effect on ML by allowing the calculation of gradients of arbitrary functions in an incredibly large class of models. We can potentially realize similar improvements in parameter estimation and control for Earth system models (ESMs) by reimplementing them in computational frameworks from ML. Practitioners working with large (>10 7 parameters) models in ML and AI can obtain good predictive performance in a range of spatiotemporal tasks by making use of optimization via stochastic gradient descent and incorporating prior knowledge at multiple levels. We propose writing ESMs in open-source computational frameworks such as Torch, Tensorflow, and JAX to greatly expand the scope of environmental forecasting and management challenges, which can be addressed by leveraging automatic differentiation and gradient descent-like algorithms. We do not call for a wholesale replacement of physical models with data-driven surrogates, but rather advocate for interleaving physical and empirical equations in a manner that is most faithful to the extent of our scientific knowledge and observational data. Central to this topic is the merging of differentiable physical simulations with differentiable optimization layers, which are now both beginning to come to the forefront.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Dual-Purpose Canister Filling Demonstration Project Progress Report

This report discusses the progress made at the Oak Ridge National Laboratory to support direct disposal of dual-purpose canisters (DPCs). Acceptable filler materials should demonstrate that the probability of criticality in DPCs during the disposal timeframe is below the probability threshold for inclusion in a repository performance assessment. This effort, which will ultimately result in a full-scale demonstration, includes computational fluid dynamics (CFD) modelling developed to gauge the filling process and to uncover any unforeseen issues. Filling simulations of the lower region (mouse holes) of a prototypic DPC show successfully simulate filling of the void space inside the canister and a smooth, even progression of the liquid level. Flow through a pipe that is similar to the drainpipe in a DPC is being investigated separately to gain valuable insight of the flow regime inside a pipe. Three physical experiments validating the computational filling model have been completed using surrogate liquids. One experiment using molten metal has been completed and the results demonstrate adequate filling of the canister void spaces. Although the scale experiment observed some void spaces related to shrinkage of the metal during cooling, the volume filled is expected to be sufficient to meet the purpose of moderator exclusion. Further experiments will scale up the geometry, moving towards a full-sized DPC demonstration, and provide a more rigorous investigation of candidate filler materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Soot formation and precursor chemistry in Counterflow flames of aviation fuel surrogates

To meet market demands, the aviation sector is interested in utilizing drop-in Synthetic Aviation Turbine Fuels (SATF), either as neat fuels or in blends with conventional Jet A. SATF currently approved in standard specifications may have lower aromatic content with significant fractions of normal, branched, and cyclo-alkanes. Fundamental studies on soot formation from aviation fuels (Jet A, SATF) and their surrogate components are essential to understand how fuel composition influences soot and soot precursor formation. Here, this study reports new measurements of polycyclic aromatic hydrocarbons (PAH) and soot in counterflow diffusion flames (CDFs) of aviation fuel surrogates. Both intrusive and non-intrusive diagnostics are employed to determine the profiles of temperature, gas phase species, PAHs (up to C16), and soot volume fraction (SVF) in CDFs of iso-octane and surrogate mixtures. These measurements shed light on the transition of soot precursors to primary soot particles. In addition to serving as a common surrogate component in Jet A surrogate mixtures, iso-octane is a template species for larger, less volatile branched alkanes found in SATF mixtures. The newly developed Lawrence Livermore National Laboratory (LLNL) PAH and soot model successfully captures temperature, precursor species, and SVF profiles for the mixtures and conditions discussed in this work. Finally, a high-fidelity surrogate for Jet A is proposed that matches targeted physical and chemical properties well, while leveraging the wide range of candidate fuel molecules available in the LLNL detailed chemical model. The proposed surrogate formulation is validated against newly acquired measurements of the surrogate and literature measurements of Jet A. These new experiments and simulations provide critical insights into the PAH and soot formation from aviation fuels. Reaction pathways which require further investigation are highlighted, such that future work may bridge the remaining quantitative gaps in predicting soot formation from aviation fuel surrogates and surrogate components.

Aviation fuels↗
DOE OSTI2025

Resolving turbulent magnetohydrodynamics: a hybrid operator-diffusion framework

We present a hybrid machine learning framework that combines physics-informed neural operators (PINOs) with score-based generative diffusion models to simulate the full spatio-temporal evolution of two-dimensional, incompressible, resistive magnetohydrodynamic turbulence across a broad range of Reynolds numbers (Re). The framework leverages the equation-constrained generalization capabilities of PINOs to predict coherent, low-frequency dynamics, while a conditional diffusion model stochastically corrects high-frequency residuals, enabling accurate modeling of fully developed turbulence. Trained on a comprehensive ensemble of high-fidelity simulations with Re ϵ {100, 250, 500, 750, 1000, 3000, 10000}, the approach achieves state-of-the-art accuracy in regimes previously inaccessible to deterministic surrogates. At Re = 1000 and 3000, the model faithfully reconstructs the full spectral energy distributions of both velocity and magnetic fields late into the simulation, capturing non-Gaussian statistics, intermittent structures, and cross-field correlations with high fidelity. At extreme turbulence levels (Re = 10 000), it remains the first surrogate capable of recovering the high-wavenumber evolution of the magnetic field, preserving large-scale morphology and enabling statistically meaningful predictions.

Diffusion-Integrated Neural Operators↗
DOE OSTI2022

Combustion characteristics and detailed simulations of surrogates for a Tier II gasoline certification fuel

An experimental and numerical study of combustion of a gasoline certification fuel (‘indolene’), and four (S4) and five (S5) component surrogates for it, is reported for the configurations of an isolated droplet burning with near spherical symmetry in the standard atmosphere, and a single cylinder engine designed for advanced compression ignition of pre-vaporized fuel. The intent was to compare performance of the surrogate for these different combustion configurations and to assess the broader applicability of the kinetic mechanism and property database for the simulations. A kinetic mechanism comprised of 297 species and 16,797 reactions was used in the simulations that included soot formation and evolution, and accounted for unsteady transport, liquid diffusion inside the droplet, radiative heat transfer, and variable properties. The droplet data showed a clear preference for the S5 surrogate in terms of burning rate. The simulations showed generally very good agreement with measured droplet, flame, and soot shell diameters. Measurements of combustion timing, in-cylinder pressure, and mass-averaged gas temperature were also well predicted with a slight preference for the S5 surrogate. Preferential vaporization was not evidenced from the evolution of droplet diameter but was clearly revealed in simulations of the evolution of mixture fractions inside the droplets. Here, the influence of initial droplet diameter (D o ) on droplet burning was strong, with S5 burning rates decreasing with increasing D o due to increasing radiation losses from the flame. Flame extinction was predicted for D o =3.0 mm as a radiative loss mechanism but not predicted for smaller D o for the conditions of the simulations.

42 ENGINEERING↗
DOE OSTI2025

Sequence modeling of higher-order wave modes of quasi-circular, spinning, non-precessing binary black hole mergers

Higher-order gravitational wave modes from quasi-circular, spinning, non-precessing binary-black-hole (BBH) mergers encode rich information about the nonlinear dynamics of strong-field gravity. We present a transformer-based sequence-completion surrogate that, given an early-inspiral segment, forecasts the subsequent late inspiral, merger, and ringdown. The intended applications are (i) patching or completing expensive or interrupted numerical-relativity (NR) simulations and (ii) providing late-time cross-checks and rapid hybridization studies. The training set is built from the NRHybSur3dq8 surrogate, which provides spherical-harmonic modes up to $\ell$ ≤ 4 (excluding (4, 0) and (4,±1), and including (5, 5)) for mass ratios q ≤ 8, dimensionless spin components s$^{z}_{1,2}$ ϵ[–0.8, 0.8], and inclination angles θ ϵ [0, π]. Waveforms are supplied on the interval t ϵ [–5000M, –100 M) and the model autoregressively generates the plus and cross polarizations (h + , h x ) on t ϵ [–100 M, 130M]. Training on the Delta supercomputer with 16 NVIDIA A100 GPUs required ~15 h on more than 14 million hybrid waveforms. Evaluation on a held-out test set of 840,000 samples yields mean and median overlaps of 0.996 and 0.997, respectively, with respect to the surrogate ground truth.

black-hole merger↗
DOE OSTI2025

Accelerating Hamiltonian Monte Carlo for Bayesian inference in neural networks and neural operators

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high dimensionality of the network’s parameter space and the non-convexity of their posterior distributions. Therefore, various approximation techniques, such as variational inference (VI) or stochastic gradient MCMC, are often employed to infer the posterior distribution of the network parameters. Such approximations introduce inaccuracies in the inferred distributions, resulting in unreliable uncertainty estimates. In this work, we propose a hybrid approach that combines inexpensive VI and accurate HMC methods to efficiently and accurately quantify uncertainties in neural networks and neural operators. The proposed approach leverages an initial VI training on the full network. We examine the influence of individual parameters on the prediction uncertainty, which shows that a large proportion of the parameters do not contribute substantially to uncertainty in the network predictions. This information is then used to significantly reduce the dimension of the parameter space, and HMC is performed only for the subset of network parameters that strongly influence prediction uncertainties. This yields a framework for accelerating the full batch HMC for posterior inference in neural networks. We demonstrate the efficiency and accuracy of the proposed framework on deep neural networks and operator networks, showing that inference can be performed for large networks with tens to hundreds of thousands of parameters. Finally, we show that this method can effectively learn surrogates for complex physical systems by modeling the operator that maps from upstream conditions to wall-pressure data on a cone in hypersonic flow.

Bayesian inference↗
DOE OSTI2026

Deep Gaussian process-based cost-aware batch Bayesian optimization for complex materials design campaigns

The accelerating pace and expanding scope of materials discovery demand optimization frameworks that efficiently navigate vast design spaces with complex response surfaces while judiciously allocating limited evaluation resources. We present a cost-aware, batch Bayesian optimization scheme powered by deep Gaussian process (DGP) surrogates and a heterotopic querying strategy. Our DGP surrogate, formed by stacking GP layers, models complex hierarchical relationships among high-dimensional compositional features and captures correlations across multiple target properties, propagating uncertainty through successive layers. We integrate evaluation cost into an upper-confidence-bound acquisition extension, which, together with heterotopic querying, proposes small batches of candidates in parallel, balancing exploration of under-characterized regions with exploitation of high-mean, low-variance predictions across correlated properties. Applied to refractory high-entropy alloys for high-temperature applications, our framework converges to optimal formulations in fewer iterations with cost-aware queries than conventional GP-based BO, highlighting the value of deep, uncertainty-aware, cost-sensitive strategies in materials campaigns.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Predicting Hugoniot equation of state in erythritol with ab initio and reactive molecular dynamics

Erythritol has been proposed as an inert surrogate for developing theoretical and computational models to study aging in energetic materials. In this work, we present a comparison of mechanical and shock properties of erythritol computed using the ReaxFF reactive force field and from ab initio calculations employing density functional theory (DFT). We screened eight different ReaxFF parameterizations, of which the CHO parameters developed for hydrocarbon oxidation provide the most accurate predictions of mechanical properties and the crystal structure of erythritol. Further validation of the applicability of this ReaxFF parameterization for modeling erythritol is demonstrated by comparing predictions of the elastic constants, crystal structure, vibrational density of states, and Hugoniot curves against DFT calculations. The ReaxFF predictions are in close agreement with the DFT simulations for the elastic constants and shock Hugoniot when the crystal is loaded along its c axis but show as much as 30% disagreement in the elastic constants in the ab plane and 12% difference in shock pressures when shocked along the a or b crystal axes. Last, we compare thermomechanical properties predicted from classical molecular dynamics with those calculated using the quasi-harmonic approximation and show that quantum mechanical effects produce large discrepancies in the computed values of heat capacity and thermal expansion coefficients compared with classical assumptions. Combining classical molecular dynamics predictions of mechanical behavior with phonon-based calculations of thermal behaviors, we show that predicted shock-induced temperatures for pressures up to 6.5 GPa do not exceed the pressure-dependent melting point of erythritol.

Hu, Jing↗
DOE OSTI2023

MRT 7365 Power flow physics and key physics phenomena: EMPIRE verification suite

This milestone work baselines electromagnetic particle-in-cell capability of the EMPIRE plasma simulation code to model key processes germane to the physics of electrode plasmas arising in magnetically-insulated transmission lines operating at or near 20 MA. This evaluation is done so through the provision of benchmark verification problems designed to exercise the individual and combined physics models on a small-scale surrogate geometry for the final-feed-to-load region of the Z accelerator under representative operating conditions. In this report, we overview our test designs, and present a portfolio of simulation results along with performance assessments which altogether establish state-of-the-art. In particular, two main verification categories are covered this report: (1) Z-relevant desorption physics (Temkin isotherm), and (2) two approaches to simulate electrode plasma creation and dynamics (automatic creation versus self-consistent creation through direct simulation Monte Carlo collisions).

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Equipping Neural Network Surrogates with Uncertainty for Propagation in Physical Systems

Coarse-grained or filtered models typically rely on closure models to account for unresolved scales. For instance, large eddy simulation for modeling turbulent fluid flows explicitly resolves the largest scales, but requires modeling closure terms to account for the sub-filter scales. With the vast amount of data available from high-fidelity simulations, there are unique opportunities to leverage data-driven modeling techniques to formulate expressive and flexible closure models. Despite their flexibility, data-driven models struggle in domain shift settings, i.e. when deployed in configurations not captured in the training dataset. In particular, the efficacy of neural network surrogates is difficult to assess a priori due to the deterministic, point-estimate nature of predictions. In high-consequence applications, such models require reliable uncertainty estimates in the data-informed and out-of-distribution regimes. To quantify uncertainties in both regimes, we employ Bayesian neural networks which are able to capture both epistemic and aleatoric uncertainties. We will discuss challenges associated with the training and evaluation of these networks. Furthermore, we will discuss uncertainty embedding strategies to enable efficient sampling and propagation of uncertainty through high-fidelity simulations.

Bayesian neural networks↗
DOE OSTI2021

A Transported Livengood–Wu Integral Model for Knock Prediction in Computational Fluid Dynamics Simulation

This work describes the development of a transported Livengood–Wu (L–W) integral model for computational fluid dynamics (CFD) simulation to predict autoignition and engine knock tendency. The currently employed L–W integral model considers both single-stage and two-stage ignition processes, thus can be generally applied to different fuels such as paraffin, olefin, aromatics, and alcohol. The model implementation is first validated in simulations of homogeneous charge compression ignition (HCCI) combustion for three different fuels, showing good accuracy in prediction of autoignition timing for fuels with either single-stage or two-stage ignition characteristics. Then, the L–W integral model is coupled with G-equation model to indicate end-gas autoignition and knock tendency in CFD simulations of a direct-injection spark-ignition engine. This modeling approach is about 10 times more efficient than the ones that based on detailed chemistry calculation and pressure oscillation analysis. Two fuels with same Research Octane Number (RON) but different octane sensitivity are studied, namely, Co-Optima alkylate and Co-Optima E30. Feed-forward neural network model in conjunction with multivariable minimization technique is used to generate fuel surrogates with targets of matched RON, octane sensitivity, and ethanol content. The CFD model is validated against experimental data in terms of pressure traces and heat release rate for both fuels under a wide range of operating conditions. The knock tendency—indicated by the fuel energy contained in the autoignited region—of the two fuels at different load conditions correlates well with the experimental results and the fuel octane sensitivity, implying the current knock modeling approach can capture the octane sensitivity effect and can be applied to further investigation on composition of octane sensitivity.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Plasma production and ion heating systems for the Material Plasma Exposure eXperiment

Plasma production and ion heating in the Material Plasma Exposure eXperiment (MPEX), whose design is nearing completion, is accomplished using continuous wave RF power with average power density up to 1.6 MW/m2 at the plasma interface. Plasma is produced using helicon waves coupled through a single helical antenna at 13.56 MHz with power supplied by three 100 kW fixed-frequency RF generators feeding a power combiner network followed by the matching network and launcher. The helicon source can utilize various gasses including hydrogen, deuterium, and helium, with a magnetic field strength in the source region up to 0.2 T, and maximum device |B| of 2.5 T. Power is coupled to ions via ion cyclotron heating at the fundamental resonance using a pair of phased helical antennas operating in the frequency range 4-9 MHz, that launch waves towards the resonance from the antenna region where ω > ωci. ICH power is supplied by a single 500 kW tunable RF transmitter through a 90° power splitter and matching/decoupling network. In the case of both the helicon and ICH systems the antennas are located external to the vacuum, with power transferred through novel water-cooled coaxial vacuum windows consisting of fused quartz outer cylinders and silicon nitride inner cylinders with forced convection water cooling between them. The antenna enclosures are pressurized with dry air to 3 bar absolute for voltage standoff.Several 3-D COMSOL models have been created to simulate the two systems. A model of the helicon region utilizing a cold plasma dielectric tensor with accurate magnetic field and realistic plasma density profiles has been used to calculate the plasma loading/complex antenna input impedance at the launcher feed for various ne and |B| values, for the purpose of estimating power handling. It also incorporates the geometry of all launcher structures relevant to this determination. A still more detailed model of the launcher together with a lossy dielectric plasma surrogate has been used to determine RF electric field values and power losses in the device components.Similar models have been produced to predict the performance and power handling of the ICH launcher. For this device the impedance matrix of the two-element antenna array is calculated using a warm plasma model, necessary to properly determine the wave propagation and absorption.

Goulding, Richard↗
DOE OSTI2022

Estimating dermal contact soil exposure for amphibians

Abstract Chemical exposure estimation through the dermal route is an underemphasized area of ecological risk assessment for terrestrial animals. Currently, there are efforts to create exposure models to estimate doses from this pathway for use in ecological risk assessment. One significant limitation has been insufficient published data to characterize exposure and to support the selection and parameterization of appropriate models, particularly for amphibians in terrestrial habitats. Recent publications measuring pesticide doses to terrestrial‐phase amphibians have begun to rectify this situation. We collated and summarized available measurements of terrestrial amphibian dermal exposure to pesticides from 11 studies in which researchers measured tissue concentrations associated with known pesticide experimental application rates. This data set included tissue concentrations in 11 amphibian species and 14 different pesticides. We then compared the results of two screening exposure models that differed based on surface area scaling approaches as a function of body weight (one based on birds as surrogates for amphibians and another amphibian‐specific) to the measured tissue residue concentrations. We define a false‐negative rate for each screening model as the proportion of amphibians for which the predicted concentration is less than the observed concentration (i.e., underestimate), contrary to the intent of screening models, which are intended to have a bias for higher exposure concentrations. The screening model that uses birds as surrogates did not have any instances where estimated expected avian doses were less than measured amphibian body burdens. When using the amphibian‐specific exposure model that corrected for differences between avian and amphibian surface area, measured concentrations were greater than model estimates for 11.3% of the 1158 comparisons. The database of measured pesticide concentrations in terrestrial amphibians is provided for use in calculating bioconcentration factors and for future amphibian dermal exposure model development. Integr Environ Assess Manag 2023;19:9–16. © 2022 SETAC. This article has been contributed to by U.S. Government employees and their work is in the public domain in the USA.

Environmental Sciences & Ecology↗
DOE OSTI2022

Online Machine Learning for Accelerating Molecular Dynamics Modeling of Cells

We developed a biomechanics-informed online learning framework to learn the dynamics with ground truth generated with multiscale modeling simulation. It was built on Summit-like supercomputers, which were also used to benchmark and validate our framework on one physiologically significant modeling of deformable biological cells. We generalized the century-old equation of Jeffery orbits to a new equation of motion with additional parameters to account for the flow conditions and the cell deformability. Using simulation data at particle-based resolutions for flowing cells and the learned parameters from our framework, we validated the new equation by the motions, mostly rotations, of a human platelet in shear blood flow at various shear stresses and platelet deformability. Our online framework, which surrogates redundant computations in the conventional multiscale modeling by solutions of our learned equation, accelerates the conventional modeling by three orders of magnitude without visible loss of accuracy.

multiscale modeling↗
DOE OSTI2026

Regional surrogates for predictive control of digital twins

Digital twins of complex systems must involve a model that is fast, generalizable, and usable for real-time control. For example, high-fidelity nonlinear multiphysics simulations can capture laser-material interactions, but are too slow for optimization or model predictive control (MPC). Reduced-order models, used to accelerate such computation, frequently fail to generalize to unseen inputs or control states. We show theoretically that this failure is intrinsic, i.e., that a learned model is non-unique outside the sampled subspace when its low-rank structure arises from limited excitation and clustered eigenvalues, rather than from a user-imposed truncation alone. Motivated by this result, we propose a control-ready regional surrogate-construction framework for both autonomous and nonautonomous dynamics; it employs Koopman lifting to represent nonlinearities, while preserving spatial locality. We illustrate our approach by constructing a control-ready surrogate for the digital twin of a thermal component of additive-manufacturing process. Our surrogate, localized in space through a von Neumann stencil, is learned from noisy high-fidelity simulations that emulate thermal-camera images collected during the manufacturing. It is linear in thermo-physically augmented states so that MPC reduces to a convex quadratic program. The surrogate requires no online correction, generalizes to unseen scan paths and power profiles of the laser, and is more than three orders of magnitude faster than a finite-difference solver. Furthermore, when the MPC sequence computed on the digital twin is applied to this solver, closed-loop temperature regulation is recovered, showing that the surrogate preserves control-relevant input-output behavior.

Data-driven model↗
DOE OSTI2026

Learning turbulent flows with generative models for super resolution and sparse flow reconstruction

Neural operators are promising surrogates for dynamical systems but when trained with standard L 2 losses they tend to oversmooth fine-scale turbulent structures. Here, we show that combining operator learning with generative modeling overcomes this limitation. We consider three practical turbulent-flow challenges where conventional neural operators fail: spatio-temporal super-resolution, forecasting, and sparse flow reconstruction. For Schlieren jet super-resolution, an adversarially trained neural operator (adv-NO) reduces the energy-spectrum error by 15 × while preserving sharp gradients at neural operator-like inference cost. For 3D homogeneous isotropic turbulence, adv-NO trained on only 160 timesteps from a single trajectory forecasts accurately for five eddy-turnover times and offers 114 × wall-clock speed-up at inference than the baseline diffusion-based forecasters, enabling near-real-time rollouts. For reconstructing cylinder wake flows from highly sparse Particle Tracking Velocimetry-like inputs, a conditional generative model infers full 3D velocity and pressure fields with correct phase alignment and statistics. These advances enable accurate reconstruction and forecasting at low compute cost, bringing near-real-time analysis and control within reach in experimental and computational fluid mechanics.

Fluid dynamics↗
DOE OSTI2023

Constructing a Simulation Surrogate with Partially Observed Output

Gaussian process surrogates are a popular alternative to directly using computationally expensive simulation models. When the simulation output consists of many responses, dimension-reduction techniques are often employed to construct these surrogates. However, surrogate methods with dimension reduction generally rely on complete output training data. This article proposes a new Gaussian process surrogate method that permits the use of partially observed output while remaining computationally efficient. The new method involves the imputation of missing values and the adjustment of the covariance matrix used for Gaussian process inference. The resulting surrogate represents the available responses, disregards the missing responses, and provides meaningful uncertainty quantification. In conclusion, the proposed approach is shown to offer sharper inference than alternatives in a simulation study and a case study where an energy density functional model that frequently returns incomplete output is calibrated.

42 ENGINEERING↗