Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Fast Time-Stepping Strategy for Dynamical Systems Equipped with a Surrogate Model

Simulation of complex dynamical systems arising in many applications is computationally challenging due to their size and complexity. Model order reduction, machine learning, and other types of surrogate modeling techniques offer cheaper and simpler ways to describe the dynamics of these systems but are inexact and introduce additional approximation errors. In order to overcome the computational difficulties of the full complex models, on one hand, and the limitations of surrogate models, on the other, this work proposes a new accelerated time-stepping strategy that combines information from both. This approach is based on the multirate infinitesimal general-structure additive Runge--Kutta framework. The inexpensive surrogate model is integrated with a small time step to guide the solution trajectory, and the full model is treated with a large time step to occasionally correct for the surrogate model error and ensure convergence. Here, we provide a theoretical error analysis, and several numerical experiments, to show that this approach can be significantly more efficient than using only the full or only the surrogate model for the integration.

Surrogate models↗
DOE OSTI2025

Surrogate Model Integration with MOOSE XFEM for Creep Crack Growth

Ferritic-martensitic steels are key structural materials for advanced reactors but experience time-dependent deformation and damage under prolonged high temperature and irradiation, leading to creep-driven crack initiation and growth. High-fidelity models—crystal plasticity with irradiation mechanisms, phase-field for microstructural evolution, and continuum-damage viscoplasticity—capture the underlying physics but are too computationally intensive for broad design-space exploration and uncertainty quantification. This milestone advances a scalable alternative by integrating a microstructure-sensitive surrogate creep model into the Multiphysics Object-Oriented Simulation Environment (MOOSE) finite element framework and extending it to fracture via the extended finite element method (XFEM). The surrogate model, developed with collaborators at Sandia and Los Alamos National Laboratories, maps relevant microstructural descriptors to the viscoplastic response of HT9. We embed this surrogate within a coupled deformation-damage workflow in MOOSE/XFEM to simulate creep-driven crack initiation and propagation. Implementation enhancements include updates to the material interface, a plastic correction phase involving microstructure evolution, and fracture criteria to ensure numerical robustness and compatibility with the surrogate structure. Demonstrations on canonical creep benchmarks spanning uniaxial and multiaxial states show that the surrogate reproduces key trends of high-fidelity models while substantially reducing computational cost. The resulting capability bridges physics fidelity and performance, providing a practical path to a predictive, microstructure-aware assessment of creep and fracture in reactor materials.

36 - MATERIALS SCIENCE↗
DOE OSTI2021

Deep Learning Approaches to Surrogates for Solving the Diffusion Equation for Mechanistic Real-World Simulations

In many mechanistic medical, biological, physical, and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs), especially for diffusion, fluid flow and mechanical relaxation, can make simulations impractically slow. Biological models of tissues and organs often require the simultaneous calculation of the spatial variation of concentration of dozens of diffusing chemical species. One clinical example where rapid calculation of a diffusing field is of use is the estimation of oxygen gradients in the retina, based on imaging of the retinal vasculature, to guide surgical interventions in diabetic retinopathy. Furthermore, the ability to predict blood perfusion and oxygenation may one day guide clinical interventions in diverse settings, i.e., from stent placement in treating heart disease to BOLD fMRI interpretation in evaluating cognitive function (Xie et al., 2019; Lee et al., 2020). Since the quasi-steady-state solutions required for fast-diffusing chemical species like oxygen are particularly computationally costly, we consider the use of a neural network to provide an approximate solution to the steady-state diffusion equation. Machine learning surrogates, neural networks trained to provide approximate solutions to such complicated numerical problems, can often provide speed-ups of several orders of magnitude compared to direct calculation. Surrogates of PDEs could enable use of larger and more detailed models than are possible with direct calculation and can make including such simulations in real-time or near-real time workflows practical. Creating a surrogate requires running the direct calculation tens of thousands of times to generate training data and then training the neural network, both of which are computationally expensive. Often the practical applications of such models require thousands to millions of replica simulations, for example for parameter identification and uncertainty quantification, each of which gains speed from surrogate use and rapidly recovers the up-front costs of surrogate generation. We use a Convolutional Neural Network to approximate the stationary solution to the diffusion equation in the case of two equal-diameter, circular, constant-value sources located at random positions in a two-dimensional square domain with absorbing boundary conditions. Such a configuration caricatures the chemical concentration field of a fast-diffusing species like oxygen in a tissue with two parallel blood vessels in a cross section perpendicular to the two blood vessels. To improve convergence during training, we apply a training approach that uses roll-back to reject stochastic changes to the network that increase the loss function. The trained neural network approximation is about 1000 times faster than the direct calculation for individual replicas. Because different applications will have different criteria for acceptable approximation accuracy, we discuss a variety of loss functions and accuracy estimators that can help select the best network for a particular application. We briefly discuss some of the issues we encountered with overfitting, mismapping of the field values and the geometrical conditions that lead to large absolute and relative errors in the approximate solution.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Karhunen–Loève deep learning method for surrogate modeling and approximate Bayesian parameter estimation

We evaluate the performance of the Karhunen-Loève Deep Neural Network (KL-DNN) framework for surrogate modeling and approximate Bayesian parameter estimation in partial differential equation models. In the surrogate model, the Karhunen-Loève (KL) expansions are used for the dimensionality reduction of the number of unknown parameters and variables, and a deep neural network is employed to relate the reduced space of parameters to that of the state variables. The KL-DNN surrogate model is used to formulate a maximum-a-posteriori-like least-squares problem, which is randomized to draw samples of the posterior distribution of the parameters. We test the proposed framework for a hypothetical unconfined aquifer via comparison with the forward MODFLOW and inverse PEST++ iterative ensemble smoother (IES) solutions as well as the state-of-the-art Fourier neural operator (FNO) and deep operator networks (DeepONets) operator learning surrogate models. Our results show that the KL-DNN surrogate model outperforms FNO and DeepONet for forward predictions. For solving inverse problems, the randomized algorithm provides the same or more accurate Bayesian predictions of the parameters than IES as evidenced by the higher log-predictive probability of both the estimated parameter field and the forecast hydraulic head. The posterior mean obtained from the randomized algorithm is closer to the reference parameter field than that obtained with FNO as the maximum a posteriori estimate.

Approximate Bayesian inference↗
DOE OSTI2025

Experimental and fuel-surrogates modeling study of the high-pressure pyrolysis of specialty cetane number fuels: implications for fall-off in ethylene unimolecular dissociation

Single pulse shock tube experiments were conducted at 50 atm nominal pressure and 4 ms nominal reaction time over a temperature range of 900–1800 K, to study the pyrolysis speciation of a multi-component jet fuel, F-24, and six cetane number (CN) specialty fuels - CN30, CN35, CN40, CN45, CN50, and CN55. Gas chromatography (GC) was used to qualitatively and quantitatively analyze the post shock gases. The relationship between the formation of key pyrolysis species and the chemically controlled combustion propensity as reflected by the cetane number of each fuel was examined. A surrogate-based mechanism from the CRECK Modelling Group and chemical-functional group based optimized surrogates (CFGO) were used to simulate the pyrolysis speciation results. The model was able to capture the chemistry of most species except two important pyrolysis intermediates – ethylene and acetylene. Chemical kinetic analyses were performed to identify the important reactions which affect the chemistry of these species; however, the rate parameters of critical reactions were found to be unsuitable for simulating the present high-pressure studies. Here, to address this unsuitability, a theory-based fall-off analysis for three reactions representing the decomposition of ethylene and subsequent formation of acetylene was performed, and these are included in an updated version of the CRECK mechanism. This update resolves discrepancies between the experimental results and simulations for ethylene and acetylene. Reaction flux analyses using the updated surrogate model were also performed to identify the important reaction pathways responsible for the formation of crucial species and to provide an analysis of the chemistry of complex multi-component fuel systems. The fundamental reactions responsible for driving pyrolysis chemistry were greatly influenced by the chemical functional groups present in these fuels. In addition to updating the rate parameters of specific reactions to improve modeling, this study also emphasizes the effectiveness of the fuel-surrogate approach, where surrogates representing the chemical functional group composition of the parent fuel serve as a valuable tool for predicting the combustion chemistry of novel fuels.

Chemical Kinetics↗
DOE OSTI2023

Machine learning surrogate of physics-based building-stock simulator for end-use load forecasting

Building energy models are used to simulate heat and mass transfer and estimate end-use load in buildings. With the proliferation of solar photovoltaics on residential and commercial buildings, increasingly, buildings are expected to provide grid services, for which accurate and computationally efficient building energy simulations and end-use load prediction are imperative. Existing building energy simulation tools, however, have significant computational overhead that make them less practical in real-time deployment for optimization, design, uncertainty quantification and control in building energy management systems. Here this article presents a data-driven machine learning model based on light gradient boosting method (LightGBM) as a surrogate for a physics-based simulator for residential buildings to predict end-use load. The machine learning based surrogate model accounts for time-series related variables, seasonality and trend component of end-use load, and history of end-use load. The accuracy of the surrogate model is assessed on the prediction of the load profiles of 100 different houses in Cook County, Illinois, USA. The LightGBM surrogate model is shown to reduce the root-mean-squared error by 53% relative to a reference decision tree (DT) based model reported previously in the literature. Moreover, the model predicts the load spikes and high-ramp rate events throughout the year which are often the Achilles heel of other models in the literature. The machine learning based surrogate model is demonstrated to be computationally efficient, with a ten-fold reduction in the computational time compared to a physics-based building energy simulation, and suitable for uncertainty analysis and real-time control of building characteristics in response to uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Higher-order factorization machine for accurate surrogate modeling in material design

Efficient and robust optimization is important in material science for identifying optimal structural parameters and enhancing material performance. Surrogate-based active learning algorithms have recently gained great attention for their ability to efficiently navigate large, high-dimensional design spaces. Among surrogate models, 2 nd -order factorization machine (FM) models are widely employed as the surrogate model in active learning algorithms due to their balance between simplicity and effectiveness. However, their quadratic nature limits their capacity to capture complex, higher-order interactions among variables, often leading to suboptimal solutions. To overcome this limitation, we propose an active learning scheme integrating a 3 rd -order FM model, capable of modeling three-variable interactions and more intricate relationships in material systems. We comprehensively evaluate the surrogate modeling performance of the 3 rd -order FM case using various objective functions. Furthermore, we examine the optimization reliability and efficiency of the 3 rd -order FM-based active learning in a real-world material design task (e.g., nanophotonic structures for transparent radiative cooling). Our study shows that the 3 rd -order FM outperforms the 2 nd -order model in both surrogate accuracy and optimization performance, highlighting higher-order models’ promises for material design and optimization problems.

Factorization machine↗
DOE OSTI2023

General Multifidelity Surrogate Models: Framework and Active-Learning Strategies for Efficient Rare Event Simulation

Estimating the probability of failure for complex real-world systems using high-fidelity computational models is often prohibitively expensive, especially when the probability is small. Exploiting low-fidelity models can make this process more feasible, but merging information from multiple low-fidelity and high-fidelity models poses several challenges. Here, this paper presents a robust multi-fidelity surrogate modeling strategy in which the multi-fidelity surrogate is assembled using an active learning strategy using an on-the-fly model adequacy assessment set within a subset simulation framework for efficient reliability analysis. The multi-fidelity surrogate is assembled by first applying a Gaussian process correction to each low-fidelity model and assigning a model probability based on the model's local predictive accuracy and cost. Three strategies are proposed to fuse these individual surrogates into an overall surrogate model based on model averaging and deterministic/stochastic model selection. The strategies also dictate which model evaluations are necessary. No assumptions are made about the relationships between low-fidelity models, while the high-fidelity model is assumed to be the most accurate and most computationally expensive model. Through two analytical and two numerical case studies, including a case study evaluating the failure probability of Tristructural isotropic-coated (TRISO) nuclear fuels, the algorithm is shown to be highly accurate while drastically reducing the number of high-fidelity model calls (and hence computational cost).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Constructing a Simulation Surrogate with Partially Observed Output

Gaussian process surrogates are a popular alternative to directly using computationally expensive simulation models. When the simulation output consists of many responses, dimension-reduction techniques are often employed to construct these surrogates. However, surrogate methods with dimension reduction generally rely on complete output training data. This article proposes a new Gaussian process surrogate method that permits the use of partially observed output while remaining computationally efficient. The new method involves the imputation of missing values and the adjustment of the covariance matrix used for Gaussian process inference. The resulting surrogate represents the available responses, disregards the missing responses, and provides meaningful uncertainty quantification. In conclusion, the proposed approach is shown to offer sharper inference than alternatives in a simulation study and a case study where an energy density functional model that frequently returns incomplete output is calibrated.

42 ENGINEERING↗
DOE OSTI2025

Acceleration of Power System Dynamic Simulations Using a Deep Equilibrium Layer and Neural ODE Surrogate

The dominant paradigm for power system dynamic simulation is to build system-level simulations by combining physics-based models of individual components. The sheer size of the system along with the rapid integration of inverter-based resources exacerbates the computational burden of running time domain simulations. Here, in this paper, we propose a data-driven surrogate model based on implicit machine learningspecifically deep equilibrium layers and neural ordinary differential equationsto learn a reduced order model of a portion of the full underlying system. The data-driven surrogate achieves similar accuracy and reduction in simulation time compared to a physics-based surrogate, without the constraint of requiring detailed knowledge of the underlying dynamic models. This work also establishes key requirements needed to integrate the surrogate into existing simulation workflows; the proposed surrogate is initialized to a steady state operating point that matches the power flow solution by design.

Neural ordinary differential equations↗
DOE OSTI2023

Development of Microreactor Automated Control System (MACS): Surrogate Plant-level Modeling and Control Algorithms Integration

This report discusses progress on the modeling and integration task as part of the development of Microreactor Automated Control System (MACS). What follows is a discussion of the software tools used to develop a surrogate microreactor plant-level model, MACS module development, and a summary of the findings from integration with a hardware-in-the-loop (HIL) setup at Idaho National Laboratory (INL). Oak Ridge National Laboratory worked with INL to understand available hardware at INL (such as existing control platforms). With this information and using a preliminary framework for MACS with software interfaces defined, surrogate models and initial automated control algorithms were created for integration into the hardware to provide a HIL demonstration platform for MACS. Available reduced order reactor models that leverage existing microreactor neutronics and thermal hydraulics models have been integrated in the surrogate plant-level model. The surrogate model has been evaluated for sensitivity of all parameters and the MACS software modules (including the surrogate model) have been demonstrated to interact with the hardware. The integration, however, pointed to the need for further improvements to the framework—and specifically improvements to the interfaces to ensure that the HIL simulator is capable of longer-term stable operation with MACS in the loop. These improvements will be the focus of future research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Using a surrogate-assisted Bayesian framework to calibrate the runoff-generation scheme in the Energy Exascale Earth System Model (E3SM) v1

Abstract. Runoff is a critical component of the terrestrial water cycle, and Earth system models (ESMs) are essential tools to study its spatiotemporal variability. Runoff schemes in ESMs typically include many parameters so that model calibration is necessary to improve the accuracy of simulated runoff. However, runoff calibration at a global scale is challenging because of the high computational cost and the lack of reliable observational datasets. In this study, we calibrated 11 runoff relevant parameters in the Energy Exascale Earth System Model (E3SM) Land Model (ELM) using a surrogate-assisted Bayesian framework. First, the polynomial chaos expansion machinery with Bayesian compressed sensing is used to construct computationally inexpensive surrogate models for ELM-simulated runoff at 0.5∘ × 0.5∘ for 1991–2010. The error metric between the ELM simulations and the benchmark data is selected to construct the surrogates, which facilitates efficient calibration and avoids the more conventional, but challenging, construction of high-dimensional surrogates for the ELM simulated runoff. Second, the Sobol' index sensitivity analysis is performed using the surrogate models to identify the most sensitive parameters, and our results show that, in most regions, ELM-simulated runoff is strongly sensitive to 3 of the 11 uncertain parameters. Third, a Bayesian method is used to infer the optimal values of the most sensitive parameters using an observation-based global runoff dataset as the benchmark. Our results show that model performance is significantly improved with the inferred parameter values. Although the parametric uncertainty of simulated runoff is reduced after the parameter inference, it remains comparable to the multimodel ensemble uncertainty represented by the global hydrological models in ISMIP2a. Additionally, the annual global runoff trend during the simulation period is not well constrained by the inferred parameter values, suggesting the importance of including parametric uncertainty in future runoff projections.

58 GEOSCIENCES↗
NASA NTRS1995

Computer-Simulation Surrogates for Optimization: Application to Trapezoidal Ducts and Axisymmetric Bodies

Engineering design and optimization efforts using computational systems rapidly become resource intensive. The goal of the surrogate-based approach is to perform a complete optimization with limited resources. In this paper we present a Bayesian-validated approach that informs the designer as to how well the surrogate performs; in particular, our surrogate framework provides precise (albeit probabilistic) bounds on the errors incurred in the surrogate-for-simulation substitution. The theory and algorithms of our computer{simulation surrogate framework are first described. The utility of the framework is then demonstrated through two illustrative examples: maximization of the flowrate of fully developed ow in trapezoidal ducts; and design of an axisymmetric body that achieves a target Stokes drag.

Otto, John C.↗
NASA NTRS2005

Surrogate-based Analysis and Optimization

A major challenge to the successful full-scale development of modem aerospace systems is to address competing objectives such as improved performance, reduced costs, and enhanced safety. Accurate, high-fidelity models are typically time consuming and computationally expensive. Furthermore, informed decisions should be made with an understanding of the impact (global sensitivity) of the design variables on the different objectives. In this context, the so-called surrogate-based approach for analysis and optimization can play a very valuable role. The surrogates are constructed using data drawn from high-fidelity models, and provide fast approximations of the objectives and constraints at new design points, thereby making sensitivity and optimization studies feasible. This paper provides a comprehensive discussion of the fundamental issues that arise in surrogate-based analysis and optimization (SBAO), highlighting concepts, methods, techniques, as well as practical implications. The issues addressed include the selection of the loss function and regularization criteria for constructing the surrogates, design of experiments, surrogate selection and construction, sensitivity analysis, convergence, and optimization. The multi-objective optimal design of a liquid rocket injector is presented to highlight the state of the art and to help guide future efforts.

Queipo, Nestor V.↗
NASA NTRS2017

The Use of a Satellite Communications System for Command and Control of the National Aeronautics and Space Administration Surrogate Unmanned Aerial System Research Aircraft

The NASA Langley Research Center has transformed a Cirrus Design SR22 general aviation (GA) aircraft into an Unmanned Aerial Systems (UAS) Surrogate research aircraft which has served for several years as a platform for unmanned systems research and development. The aircraft is manned with a Safety Pilot and a Research Systems Operator (RSO) that allows for flight operations almost any-where in the national airspace system (NAS) without the need for a Federal Aviation Administration (FAA) Certificate of Authorization (COA). The UAS Surrogate can be remotely controlled from a modular, transportable ground control station (GCS) like a true UAS. Ground control of the aircraft is accomplished by the use of data links that allow the two-way passage of the required data to control the aircraft and provide the GCS with situational awareness. The original UAS Surrogate data-link system was composed of redundant very high frequency (VHF) data radio modems with a maximum range of approximately 40 nautical miles. A new requirement was developed to extend this range beyond visual range (BVR). This new requirement led to the development of a satellite communications system that provided the means to command and control the UAS Surrogate at ranges beyond the limits of the VHF data links. The system makes use of the Globalstar low earth orbit (LEO) satellite communications system. This paper will provide details of the development, implementation, and flight testing of the satellite data communications system on the UAS Surrogate research aircraft.

Howell, Charles T.↗
NASA NTRS2018

Probabilistic Sensitivity Analyses Incorporating Surrogate Models for the Structural Response of a Representative Inflatable Space Structure

This study concentrates on results from probabilistic analysis and numerical simulation tools to identify parameter sensitivities and assess surrogate model suitability for a novel inflatable airlock concept, specifically the Non-Axisymmetric Inflatable Pressure Structure (NAIPS) under NASA's Minimalistic Advanced Softgoods Hatch (MASH) Program. The current studies extended the demonstration of probabilistic analysis tools to identify parameter sensitivities by: incorporating nonlinear material load-strain property curves and orthotropic representation of the fabric; and exploring the use of surrogate models to facilitate rapid evaluations as new information becomes available, as well as enable optimizations. The airlock model has been simplified to focus on the end dome section. Brief overviews of the finite element model and associated surrogate models are provided along with the probabilistic sensitivity analysis approaches. Responses of interest include the sensitivities of various loads in the structural elements of the NAIPS to material properties, cord lengths, inflation pressure and friction between softgoods components. The use of surrogate models was explored to facilitate rapid sensitivity evaluations as parameter ranges change. The completion of the sensitivity studies improved understanding of the dependence of load responses to several uncertain parameters and confidence in the ability to use surrogate models to represent the finite element simulations.

Lyle, Karen H.↗
DOE OSTI2022

Peridynamics and surrogate modeling of pressure-driven well stimulation

In this work we use the peridynamics theory of solid mechanics to simulate fracture in an annular rock domain subject to an in-situ stress and create surrogate models that predict the area of the resulting cracks. Peridynamics is a non-local formulation of continuum mechanics that naturally accommodates material discontinuities. Furthermore, unlike other fracture modeling techniques there is no need to provide information about the crack path. We utilize the peridynamics code Peridigm and take a two-stage approach to fracture modeling. First an implicit solve is performed to compute the in-situ stress state. We then execute an explicit solve where a pressure loading designed to emulate fluid-driven hydraulic fracture is applied at the borehole and transmitted to the pre-stressed rock. We present results from polynomial and single and multi-level Gaussian process surrogate models constructed from a sampling study of the peridynamics model. The surrogates predict crack area given a measure of the in-situ stress anisotropy and rise time and amplitude of the pressure loading. These surrogates take a minuscule fraction of peridynamics model's running time to evaluate and are a step towards enabling advanced optimization and uncertainty quantification workflows that require many model evaluations.

42 ENGINEERING↗
DOE OSTI2021

On the use of air temperature and precipitation as surrogate predictors in soil respiration modelling

Soil respiration (R S ), the soil-to-atmosphere CO 2 flux that is a major component of the global carbon cycle, is strongly influenced by local soil temperature (T soil ) and water content (SWC). Regional to global-scale R S modelling thus requires this information at local scales, but few high-quality, wall-to-wall (global) T soil and SWC data exist. As a result, such modelling efforts commonly use air temperature (T air ) and monthly precipitation (P m ) as surrogate predictors, but their site-scale accuracy and potential bias are unknown. In this report we used monthly data from 880 sites across a wide variety of different environmental conditions (i.e., climate, ecosystem type, elevation, vegetation leaf habit and drainage conditions) to determine the suitability of T air as a surrogate for T soil , and data from 507 sites to examine the suitability of P m as a surrogate for SWC. Site-specific linear and second-order exponential non-linear models were compared using model evaluation metrics (i.e., slope, p-value of slope, root mean square error [RMSE], index of agreement and model efficiency). We found that T soil and T air are highly correlated and explain similar R S variability. In contrast, P m is not a good surrogate for SWC, even though P m explains a similar amount of R S variability to SWC. The wide variability in the site-specific relationships between R S and SWC means that no single relationship can be used for large-scale modelling. The results from this study support the use of T air in continental-to-global scale R S models, and highlight the urgent need for continental-to-global scale SWC datasets for the modelling and evaluation of future soil carbon dynamics under global climate change.

54 ENVIRONMENTAL SCIENCES↗