Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Karhunen–Loève deep learning method for surrogate modeling and approximate Bayesian parameter estimation

We evaluate the performance of the Karhunen-Loève Deep Neural Network (KL-DNN) framework for surrogate modeling and approximate Bayesian parameter estimation in partial differential equation models. In the surrogate model, the Karhunen-Loève (KL) expansions are used for the dimensionality reduction of the number of unknown parameters and variables, and a deep neural network is employed to relate the reduced space of parameters to that of the state variables. The KL-DNN surrogate model is used to formulate a maximum-a-posteriori-like least-squares problem, which is randomized to draw samples of the posterior distribution of the parameters. We test the proposed framework for a hypothetical unconfined aquifer via comparison with the forward MODFLOW and inverse PEST++ iterative ensemble smoother (IES) solutions as well as the state-of-the-art Fourier neural operator (FNO) and deep operator networks (DeepONets) operator learning surrogate models. Our results show that the KL-DNN surrogate model outperforms FNO and DeepONet for forward predictions. For solving inverse problems, the randomized algorithm provides the same or more accurate Bayesian predictions of the parameters than IES as evidenced by the higher log-predictive probability of both the estimated parameter field and the forecast hydraulic head. The posterior mean obtained from the randomized algorithm is closer to the reference parameter field than that obtained with FNO as the maximum a posteriori estimate.

Approximate Bayesian inference↗
DOE OSTI2020

Comparative analysis of temperature dependent properties of commercial nuclear fuel pellet and surrogates undergoing cracking: A review

A variety of normal and accident scenarios can generate thermal stresses enough to cause cracking in light water reactor (LWR) fuel. To better understand this behavior, cracking experiments have been carried out to induce thermal gradients in fuel pellets via induction heating and direct resistance heating. In this study, Ceria (CeO 2 ) and yttria stabilized zirconia (YSZ) pellets were chosen as a surrogate fuel material for uranium dioxide (UO 2 ). Induction heating was done using copper coils and molybdenum susceptors which heated the surrogates to a threshold temperature that is sufficiently high for the fuel material to conduct current. Thereafter, direct resistance heating was achieved by passing current through the specimen using a DC power supply to introduce volumetric heating to replicate reactor operating conditions. Simultaneous real-time dual imaging of the ceria pellet surface has been designed using optical and infra-red camera system to capture images of cracks and full-field temperature gradients on pellet. It was observed that YSZ pellets need a much higher voltage-current for volumetric heating and do not exhibit the cracking pattern as ceria and UO 2 , hence YSZ was ruled out for further consideration. Ceria was found to be an appropriate surrogate for UO 2 . Furthermore, the experimental set up and test conditions demand the need to primarily understand the thermo-physical, mechanical and optical properties of UO 2 and the surrogates. Thus, it is essential to have an in-depth knowledge about the various temperature dependent properties of UO 2 and CeO 2 for establishing a comparative analysis between the surrogate and UO 2 for conducting experiments.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Experimental and fuel-surrogates modeling study of the high-pressure pyrolysis of specialty cetane number fuels: implications for fall-off in ethylene unimolecular dissociation

Single pulse shock tube experiments were conducted at 50 atm nominal pressure and 4 ms nominal reaction time over a temperature range of 900–1800 K, to study the pyrolysis speciation of a multi-component jet fuel, F-24, and six cetane number (CN) specialty fuels - CN30, CN35, CN40, CN45, CN50, and CN55. Gas chromatography (GC) was used to qualitatively and quantitatively analyze the post shock gases. The relationship between the formation of key pyrolysis species and the chemically controlled combustion propensity as reflected by the cetane number of each fuel was examined. A surrogate-based mechanism from the CRECK Modelling Group and chemical-functional group based optimized surrogates (CFGO) were used to simulate the pyrolysis speciation results. The model was able to capture the chemistry of most species except two important pyrolysis intermediates – ethylene and acetylene. Chemical kinetic analyses were performed to identify the important reactions which affect the chemistry of these species; however, the rate parameters of critical reactions were found to be unsuitable for simulating the present high-pressure studies. Here, to address this unsuitability, a theory-based fall-off analysis for three reactions representing the decomposition of ethylene and subsequent formation of acetylene was performed, and these are included in an updated version of the CRECK mechanism. This update resolves discrepancies between the experimental results and simulations for ethylene and acetylene. Reaction flux analyses using the updated surrogate model were also performed to identify the important reaction pathways responsible for the formation of crucial species and to provide an analysis of the chemistry of complex multi-component fuel systems. The fundamental reactions responsible for driving pyrolysis chemistry were greatly influenced by the chemical functional groups present in these fuels. In addition to updating the rate parameters of specific reactions to improve modeling, this study also emphasizes the effectiveness of the fuel-surrogate approach, where surrogates representing the chemical functional group composition of the parent fuel serve as a valuable tool for predicting the combustion chemistry of novel fuels.

Chemical Kinetics↗
DOE OSTI2023

Machine learning surrogate of physics-based building-stock simulator for end-use load forecasting

Building energy models are used to simulate heat and mass transfer and estimate end-use load in buildings. With the proliferation of solar photovoltaics on residential and commercial buildings, increasingly, buildings are expected to provide grid services, for which accurate and computationally efficient building energy simulations and end-use load prediction are imperative. Existing building energy simulation tools, however, have significant computational overhead that make them less practical in real-time deployment for optimization, design, uncertainty quantification and control in building energy management systems. Here this article presents a data-driven machine learning model based on light gradient boosting method (LightGBM) as a surrogate for a physics-based simulator for residential buildings to predict end-use load. The machine learning based surrogate model accounts for time-series related variables, seasonality and trend component of end-use load, and history of end-use load. The accuracy of the surrogate model is assessed on the prediction of the load profiles of 100 different houses in Cook County, Illinois, USA. The LightGBM surrogate model is shown to reduce the root-mean-squared error by 53% relative to a reference decision tree (DT) based model reported previously in the literature. Moreover, the model predicts the load spikes and high-ramp rate events throughout the year which are often the Achilles heel of other models in the literature. The machine learning based surrogate model is demonstrated to be computationally efficient, with a ten-fold reduction in the computational time compared to a physics-based building energy simulation, and suitable for uncertainty analysis and real-time control of building characteristics in response to uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2015

Magnetic Resonance Imaging–Guided versus Surrogate-Based Motion Tracking in Liver Radiation Therapy: A Prospective Comparative Study

Purpose: This study applied automatic feature detection on cine–magnetic resonance imaging (MRI) liver images in order to provide a prospective comparison between MRI-guided and surrogate-based tracking methods for motion-compensated liver radiation therapy. Methods and Materials: In a population of 30 subjects (5 volunteers plus 25 patients), 2 oblique sagittal slices were acquired across the liver at high temporal resolution. An algorithm based on scale invariant feature transform (SIFT) was used to extract and track multiple features throughout the image sequence. The position of abdominal markers was also measured directly from the image series, and the internal motion of each feature was quantified through multiparametric analysis. Surrogate-based tumor tracking with a state-of-the-art external/internal correlation model was simulated. The geometrical tracking error was measured, and its correlation with external motion parameters was also investigated. Finally, the potential gain in tracking accuracy relying on MRI guidance was quantified as a function of the maximum allowed tracking error. Results: An average of 45 features was extracted for each subject across the whole liver. The multi-parametric motion analysis reported relevant inter- and intrasubject variability, highlighting the value of patient-specific and spatially-distributed measurements. Surrogate-based tracking errors (relative to the motion amplitude) were were in the range 7% to 23% (1.02-3.57mm) and were significantly influenced by external motion parameters. The gain of MRI guidance compared to surrogate-based motion tracking was larger than 30% in 50% of the subjects when considering a 1.5-mm tracking error tolerance. Conclusions: Automatic feature detection applied to cine-MRI allows detailed liver motion description to be obtained. Such information was used to quantify the performance of surrogate-based tracking methods and to provide a prospective comparison with respect to MRI-guided radiation therapy, which could support the definition of patient-specific optimal treatment strategies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2025

Higher-order factorization machine for accurate surrogate modeling in material design

Efficient and robust optimization is important in material science for identifying optimal structural parameters and enhancing material performance. Surrogate-based active learning algorithms have recently gained great attention for their ability to efficiently navigate large, high-dimensional design spaces. Among surrogate models, 2 nd -order factorization machine (FM) models are widely employed as the surrogate model in active learning algorithms due to their balance between simplicity and effectiveness. However, their quadratic nature limits their capacity to capture complex, higher-order interactions among variables, often leading to suboptimal solutions. To overcome this limitation, we propose an active learning scheme integrating a 3 rd -order FM model, capable of modeling three-variable interactions and more intricate relationships in material systems. We comprehensively evaluate the surrogate modeling performance of the 3 rd -order FM case using various objective functions. Furthermore, we examine the optimization reliability and efficiency of the 3 rd -order FM-based active learning in a real-world material design task (e.g., nanophotonic structures for transparent radiative cooling). Our study shows that the 3 rd -order FM outperforms the 2 nd -order model in both surrogate accuracy and optimization performance, highlighting higher-order models’ promises for material design and optimization problems.

Factorization machine↗
DOE OSTI2023

General Multifidelity Surrogate Models: Framework and Active-Learning Strategies for Efficient Rare Event Simulation

Estimating the probability of failure for complex real-world systems using high-fidelity computational models is often prohibitively expensive, especially when the probability is small. Exploiting low-fidelity models can make this process more feasible, but merging information from multiple low-fidelity and high-fidelity models poses several challenges. Here, this paper presents a robust multi-fidelity surrogate modeling strategy in which the multi-fidelity surrogate is assembled using an active learning strategy using an on-the-fly model adequacy assessment set within a subset simulation framework for efficient reliability analysis. The multi-fidelity surrogate is assembled by first applying a Gaussian process correction to each low-fidelity model and assigning a model probability based on the model's local predictive accuracy and cost. Three strategies are proposed to fuse these individual surrogates into an overall surrogate model based on model averaging and deterministic/stochastic model selection. The strategies also dictate which model evaluations are necessary. No assumptions are made about the relationships between low-fidelity models, while the high-fidelity model is assumed to be the most accurate and most computationally expensive model. Through two analytical and two numerical case studies, including a case study evaluating the failure probability of Tristructural isotropic-coated (TRISO) nuclear fuels, the algorithm is shown to be highly accurate while drastically reducing the number of high-fidelity model calls (and hence computational cost).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Constructing a Simulation Surrogate with Partially Observed Output

Gaussian process surrogates are a popular alternative to directly using computationally expensive simulation models. When the simulation output consists of many responses, dimension-reduction techniques are often employed to construct these surrogates. However, surrogate methods with dimension reduction generally rely on complete output training data. This article proposes a new Gaussian process surrogate method that permits the use of partially observed output while remaining computationally efficient. The new method involves the imputation of missing values and the adjustment of the covariance matrix used for Gaussian process inference. The resulting surrogate represents the available responses, disregards the missing responses, and provides meaningful uncertainty quantification. In conclusion, the proposed approach is shown to offer sharper inference than alternatives in a simulation study and a case study where an energy density functional model that frequently returns incomplete output is calibrated.

42 ENGINEERING↗
DOE OSTI2025

Acceleration of Power System Dynamic Simulations Using a Deep Equilibrium Layer and Neural ODE Surrogate

The dominant paradigm for power system dynamic simulation is to build system-level simulations by combining physics-based models of individual components. The sheer size of the system along with the rapid integration of inverter-based resources exacerbates the computational burden of running time domain simulations. Here, in this paper, we propose a data-driven surrogate model based on implicit machine learningspecifically deep equilibrium layers and neural ordinary differential equationsto learn a reduced order model of a portion of the full underlying system. The data-driven surrogate achieves similar accuracy and reduction in simulation time compared to a physics-based surrogate, without the constraint of requiring detailed knowledge of the underlying dynamic models. This work also establishes key requirements needed to integrate the surrogate into existing simulation workflows; the proposed surrogate is initialized to a steady state operating point that matches the power flow solution by design.

Neural ordinary differential equations↗
DOE OSTI2020

Development of an Optimized Gasoline Surrogate Formulation for PACE Experiments and Simulations

New powertrain solutions are needed to address societal challenges stemming in part from a transportation sector which relies heavily on combustion of conventional hydrocarbon fuels like gasoline. One way to advance new solutions is through predictive simulations. Predictive simulations can potentially limit the extent of experimental validations, reduce time spent in engineering design cycles, unlock new strategies for high efficiency combustion with power density, and minimize tailpipe emissions. However, the simulation tools currently available are either too computationally expensive, inadequate in their accuracy, or a combination of the two. A DOE-funded consortium of national laboratories called the Partnership to Advance Combustion Engines (PACE) seeks to address this gap by rapidly delivering new knowledge and tools which enable market-competitive powertrain solutions for light-duty vehicles. Approaches to modeling combustion in powertrain systems typically incorporate computational fluid dynamics (CFD) simulations with chemical kinetic models. These CFD simulations generally use surrogate fuels featuring a limited number of existing components in a reduced kinetic model to limit computational costs. Such surrogate fuels often sacrifice matching several or more combustion and physical properties of the target gasoline fuel. Validation of surrogate fuels is also often only pursued for a small subset of standard metrics such as research or motor octane number (RON, MON). The purpose of this project is to develop an optimal E10 gasoline surrogate fuel suitable for tasks across PACE to facilitate rapid common analysis and progression toward consortium goals. This project received contributions from tasks led by eight PACE principal investigators. The project funding here reflects all tasks under Pitz, whose tasks also contributed to additional PACE projects. Based on the optimal gasoline surrogate fuel composition, a reduced chemical kinetic model will be shared with PACE researchers, industry, and the broader combustion community.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Development of Microreactor Automated Control System (MACS): Surrogate Plant-level Modeling and Control Algorithms Integration

This report discusses progress on the modeling and integration task as part of the development of Microreactor Automated Control System (MACS). What follows is a discussion of the software tools used to develop a surrogate microreactor plant-level model, MACS module development, and a summary of the findings from integration with a hardware-in-the-loop (HIL) setup at Idaho National Laboratory (INL). Oak Ridge National Laboratory worked with INL to understand available hardware at INL (such as existing control platforms). With this information and using a preliminary framework for MACS with software interfaces defined, surrogate models and initial automated control algorithms were created for integration into the hardware to provide a HIL demonstration platform for MACS. Available reduced order reactor models that leverage existing microreactor neutronics and thermal hydraulics models have been integrated in the surrogate plant-level model. The surrogate model has been evaluated for sensitivity of all parameters and the MACS software modules (including the surrogate model) have been demonstrated to interact with the hardware. The integration, however, pointed to the need for further improvements to the framework—and specifically improvements to the interfaces to ensure that the HIL simulator is capable of longer-term stable operation with MACS in the loop. These improvements will be the focus of future research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Using a surrogate-assisted Bayesian framework to calibrate the runoff-generation scheme in the Energy Exascale Earth System Model (E3SM) v1

Abstract. Runoff is a critical component of the terrestrial water cycle, and Earth system models (ESMs) are essential tools to study its spatiotemporal variability. Runoff schemes in ESMs typically include many parameters so that model calibration is necessary to improve the accuracy of simulated runoff. However, runoff calibration at a global scale is challenging because of the high computational cost and the lack of reliable observational datasets. In this study, we calibrated 11 runoff relevant parameters in the Energy Exascale Earth System Model (E3SM) Land Model (ELM) using a surrogate-assisted Bayesian framework. First, the polynomial chaos expansion machinery with Bayesian compressed sensing is used to construct computationally inexpensive surrogate models for ELM-simulated runoff at 0.5∘ × 0.5∘ for 1991–2010. The error metric between the ELM simulations and the benchmark data is selected to construct the surrogates, which facilitates efficient calibration and avoids the more conventional, but challenging, construction of high-dimensional surrogates for the ELM simulated runoff. Second, the Sobol' index sensitivity analysis is performed using the surrogate models to identify the most sensitive parameters, and our results show that, in most regions, ELM-simulated runoff is strongly sensitive to 3 of the 11 uncertain parameters. Third, a Bayesian method is used to infer the optimal values of the most sensitive parameters using an observation-based global runoff dataset as the benchmark. Our results show that model performance is significantly improved with the inferred parameter values. Although the parametric uncertainty of simulated runoff is reduced after the parameter inference, it remains comparable to the multimodel ensemble uncertainty represented by the global hydrological models in ISMIP2a. Additionally, the annual global runoff trend during the simulation period is not well constrained by the inferred parameter values, suggesting the importance of including parametric uncertainty in future runoff projections.

58 GEOSCIENCES↗
NASA NTRS1995

Computer-Simulation Surrogates for Optimization: Application to Trapezoidal Ducts and Axisymmetric Bodies

Engineering design and optimization efforts using computational systems rapidly become resource intensive. The goal of the surrogate-based approach is to perform a complete optimization with limited resources. In this paper we present a Bayesian-validated approach that informs the designer as to how well the surrogate performs; in particular, our surrogate framework provides precise (albeit probabilistic) bounds on the errors incurred in the surrogate-for-simulation substitution. The theory and algorithms of our computer{simulation surrogate framework are first described. The utility of the framework is then demonstrated through two illustrative examples: maximization of the flowrate of fully developed ow in trapezoidal ducts; and design of an axisymmetric body that achieves a target Stokes drag.

Otto, John C.↗
NASA NTRS2005

Surrogate-based Analysis and Optimization

A major challenge to the successful full-scale development of modem aerospace systems is to address competing objectives such as improved performance, reduced costs, and enhanced safety. Accurate, high-fidelity models are typically time consuming and computationally expensive. Furthermore, informed decisions should be made with an understanding of the impact (global sensitivity) of the design variables on the different objectives. In this context, the so-called surrogate-based approach for analysis and optimization can play a very valuable role. The surrogates are constructed using data drawn from high-fidelity models, and provide fast approximations of the objectives and constraints at new design points, thereby making sensitivity and optimization studies feasible. This paper provides a comprehensive discussion of the fundamental issues that arise in surrogate-based analysis and optimization (SBAO), highlighting concepts, methods, techniques, as well as practical implications. The issues addressed include the selection of the loss function and regularization criteria for constructing the surrogates, design of experiments, surrogate selection and construction, sensitivity analysis, convergence, and optimization. The multi-objective optimal design of a liquid rocket injector is presented to highlight the state of the art and to help guide future efforts.

Queipo, Nestor V.↗
NASA NTRS2017

The Use of a Satellite Communications System for Command and Control of the National Aeronautics and Space Administration Surrogate Unmanned Aerial System Research Aircraft

The NASA Langley Research Center has transformed a Cirrus Design SR22 general aviation (GA) aircraft into an Unmanned Aerial Systems (UAS) Surrogate research aircraft which has served for several years as a platform for unmanned systems research and development. The aircraft is manned with a Safety Pilot and a Research Systems Operator (RSO) that allows for flight operations almost any-where in the national airspace system (NAS) without the need for a Federal Aviation Administration (FAA) Certificate of Authorization (COA). The UAS Surrogate can be remotely controlled from a modular, transportable ground control station (GCS) like a true UAS. Ground control of the aircraft is accomplished by the use of data links that allow the two-way passage of the required data to control the aircraft and provide the GCS with situational awareness. The original UAS Surrogate data-link system was composed of redundant very high frequency (VHF) data radio modems with a maximum range of approximately 40 nautical miles. A new requirement was developed to extend this range beyond visual range (BVR). This new requirement led to the development of a satellite communications system that provided the means to command and control the UAS Surrogate at ranges beyond the limits of the VHF data links. The system makes use of the Globalstar low earth orbit (LEO) satellite communications system. This paper will provide details of the development, implementation, and flight testing of the satellite data communications system on the UAS Surrogate research aircraft.

Howell, Charles T.↗
NASA NTRS2018

Probabilistic Sensitivity Analyses Incorporating Surrogate Models for the Structural Response of a Representative Inflatable Space Structure

This study concentrates on results from probabilistic analysis and numerical simulation tools to identify parameter sensitivities and assess surrogate model suitability for a novel inflatable airlock concept, specifically the Non-Axisymmetric Inflatable Pressure Structure (NAIPS) under NASA's Minimalistic Advanced Softgoods Hatch (MASH) Program. The current studies extended the demonstration of probabilistic analysis tools to identify parameter sensitivities by: incorporating nonlinear material load-strain property curves and orthotropic representation of the fabric; and exploring the use of surrogate models to facilitate rapid evaluations as new information becomes available, as well as enable optimizations. The airlock model has been simplified to focus on the end dome section. Brief overviews of the finite element model and associated surrogate models are provided along with the probabilistic sensitivity analysis approaches. Responses of interest include the sensitivities of various loads in the structural elements of the NAIPS to material properties, cord lengths, inflation pressure and friction between softgoods components. The use of surrogate models was explored to facilitate rapid sensitivity evaluations as parameter ranges change. The completion of the sensitivity studies improved understanding of the dependence of load responses to several uncertain parameters and confidence in the ability to use surrogate models to represent the finite element simulations.

Lyle, Karen H.↗
DOE OSTI2022

Peridynamics and surrogate modeling of pressure-driven well stimulation

In this work we use the peridynamics theory of solid mechanics to simulate fracture in an annular rock domain subject to an in-situ stress and create surrogate models that predict the area of the resulting cracks. Peridynamics is a non-local formulation of continuum mechanics that naturally accommodates material discontinuities. Furthermore, unlike other fracture modeling techniques there is no need to provide information about the crack path. We utilize the peridynamics code Peridigm and take a two-stage approach to fracture modeling. First an implicit solve is performed to compute the in-situ stress state. We then execute an explicit solve where a pressure loading designed to emulate fluid-driven hydraulic fracture is applied at the borehole and transmitted to the pre-stressed rock. We present results from polynomial and single and multi-level Gaussian process surrogate models constructed from a sampling study of the peridynamics model. The surrogates predict crack area given a measure of the in-situ stress anisotropy and rise time and amplitude of the pressure loading. These surrogates take a minuscule fraction of peridynamics model's running time to evaluate and are a step towards enabling advanced optimization and uncertainty quantification workflows that require many model evaluations.

42 ENGINEERING↗
DOE OSTI2021

On the use of air temperature and precipitation as surrogate predictors in soil respiration modelling

Soil respiration (R S ), the soil-to-atmosphere CO 2 flux that is a major component of the global carbon cycle, is strongly influenced by local soil temperature (T soil ) and water content (SWC). Regional to global-scale R S modelling thus requires this information at local scales, but few high-quality, wall-to-wall (global) T soil and SWC data exist. As a result, such modelling efforts commonly use air temperature (T air ) and monthly precipitation (P m ) as surrogate predictors, but their site-scale accuracy and potential bias are unknown. In this report we used monthly data from 880 sites across a wide variety of different environmental conditions (i.e., climate, ecosystem type, elevation, vegetation leaf habit and drainage conditions) to determine the suitability of T air as a surrogate for T soil , and data from 507 sites to examine the suitability of P m as a surrogate for SWC. Site-specific linear and second-order exponential non-linear models were compared using model evaluation metrics (i.e., slope, p-value of slope, root mean square error [RMSE], index of agreement and model efficiency). We found that T soil and T air are highly correlated and explain similar R S variability. In contrast, P m is not a good surrogate for SWC, even though P m explains a similar amount of R S variability to SWC. The wide variability in the site-specific relationships between R S and SWC means that no single relationship can be used for large-scale modelling. The results from this study support the use of T air in continental-to-global scale R S models, and highlight the urgent need for continental-to-global scale SWC datasets for the modelling and evaluation of future soil carbon dynamics under global climate change.

54 ENVIRONMENTAL SCIENCES↗