Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Development of Microreactor Automated Control System (MACS): Surrogate Plant-level Modeling and Control Algorithms Integration

This report discusses progress on the modeling and integration task as part of the development of Microreactor Automated Control System (MACS). What follows is a discussion of the software tools used to develop a surrogate microreactor plant-level model, MACS module development, and a summary of the findings from integration with a hardware-in-the-loop (HIL) setup at Idaho National Laboratory (INL). Oak Ridge National Laboratory worked with INL to understand available hardware at INL (such as existing control platforms). With this information and using a preliminary framework for MACS with software interfaces defined, surrogate models and initial automated control algorithms were created for integration into the hardware to provide a HIL demonstration platform for MACS. Available reduced order reactor models that leverage existing microreactor neutronics and thermal hydraulics models have been integrated in the surrogate plant-level model. The surrogate model has been evaluated for sensitivity of all parameters and the MACS software modules (including the surrogate model) have been demonstrated to interact with the hardware. The integration, however, pointed to the need for further improvements to the framework—and specifically improvements to the interfaces to ensure that the HIL simulator is capable of longer-term stable operation with MACS in the loop. These improvements will be the focus of future research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Using a surrogate-assisted Bayesian framework to calibrate the runoff-generation scheme in the Energy Exascale Earth System Model (E3SM) v1

Abstract. Runoff is a critical component of the terrestrial water cycle, and Earth system models (ESMs) are essential tools to study its spatiotemporal variability. Runoff schemes in ESMs typically include many parameters so that model calibration is necessary to improve the accuracy of simulated runoff. However, runoff calibration at a global scale is challenging because of the high computational cost and the lack of reliable observational datasets. In this study, we calibrated 11 runoff relevant parameters in the Energy Exascale Earth System Model (E3SM) Land Model (ELM) using a surrogate-assisted Bayesian framework. First, the polynomial chaos expansion machinery with Bayesian compressed sensing is used to construct computationally inexpensive surrogate models for ELM-simulated runoff at 0.5∘ × 0.5∘ for 1991–2010. The error metric between the ELM simulations and the benchmark data is selected to construct the surrogates, which facilitates efficient calibration and avoids the more conventional, but challenging, construction of high-dimensional surrogates for the ELM simulated runoff. Second, the Sobol' index sensitivity analysis is performed using the surrogate models to identify the most sensitive parameters, and our results show that, in most regions, ELM-simulated runoff is strongly sensitive to 3 of the 11 uncertain parameters. Third, a Bayesian method is used to infer the optimal values of the most sensitive parameters using an observation-based global runoff dataset as the benchmark. Our results show that model performance is significantly improved with the inferred parameter values. Although the parametric uncertainty of simulated runoff is reduced after the parameter inference, it remains comparable to the multimodel ensemble uncertainty represented by the global hydrological models in ISMIP2a. Additionally, the annual global runoff trend during the simulation period is not well constrained by the inferred parameter values, suggesting the importance of including parametric uncertainty in future runoff projections.

58 GEOSCIENCES↗
DOE OSTI2022

Peridynamics and surrogate modeling of pressure-driven well stimulation

In this work we use the peridynamics theory of solid mechanics to simulate fracture in an annular rock domain subject to an in-situ stress and create surrogate models that predict the area of the resulting cracks. Peridynamics is a non-local formulation of continuum mechanics that naturally accommodates material discontinuities. Furthermore, unlike other fracture modeling techniques there is no need to provide information about the crack path. We utilize the peridynamics code Peridigm and take a two-stage approach to fracture modeling. First an implicit solve is performed to compute the in-situ stress state. We then execute an explicit solve where a pressure loading designed to emulate fluid-driven hydraulic fracture is applied at the borehole and transmitted to the pre-stressed rock. We present results from polynomial and single and multi-level Gaussian process surrogate models constructed from a sampling study of the peridynamics model. The surrogates predict crack area given a measure of the in-situ stress anisotropy and rise time and amplitude of the pressure loading. These surrogates take a minuscule fraction of peridynamics model's running time to evaluate and are a step towards enabling advanced optimization and uncertainty quantification workflows that require many model evaluations.

42 ENGINEERING↗
DOE OSTI2021

On the use of air temperature and precipitation as surrogate predictors in soil respiration modelling

Soil respiration (R S ), the soil-to-atmosphere CO 2 flux that is a major component of the global carbon cycle, is strongly influenced by local soil temperature (T soil ) and water content (SWC). Regional to global-scale R S modelling thus requires this information at local scales, but few high-quality, wall-to-wall (global) T soil and SWC data exist. As a result, such modelling efforts commonly use air temperature (T air ) and monthly precipitation (P m ) as surrogate predictors, but their site-scale accuracy and potential bias are unknown. In this report we used monthly data from 880 sites across a wide variety of different environmental conditions (i.e., climate, ecosystem type, elevation, vegetation leaf habit and drainage conditions) to determine the suitability of T air as a surrogate for T soil , and data from 507 sites to examine the suitability of P m as a surrogate for SWC. Site-specific linear and second-order exponential non-linear models were compared using model evaluation metrics (i.e., slope, p-value of slope, root mean square error [RMSE], index of agreement and model efficiency). We found that T soil and T air are highly correlated and explain similar R S variability. In contrast, P m is not a good surrogate for SWC, even though P m explains a similar amount of R S variability to SWC. The wide variability in the site-specific relationships between R S and SWC means that no single relationship can be used for large-scale modelling. The results from this study support the use of T air in continental-to-global scale R S models, and highlight the urgent need for continental-to-global scale SWC datasets for the modelling and evaluation of future soil carbon dynamics under global climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Data-Driven Surrogate Modeling with Microstructure-Sensitivity of Viscoplastic Creep in Grade 91 Steel

Abstract To support the development of advanced steel alloys tailored to withstand extreme conditions, it is imperative to account for the mechanical performance of components, while considering the influence of local microstructure on the macroscopic response. To this end, this study focuses on the development of microstructure-sensitive constitutive models for the mechanical response of Grade 91 steel exposed to extreme thermo-mechanical environments. Polynomial chaos expansion (PCE) surrogates are used to emulate high-fidelity polycrystal simulations of the viscoplastic response of Grade 91 steel as a function of the microstructure fingerprint (e.g., dislocations and precipitates). To cover a wide temperature–stress domain, two separate PCE surrogates—one that captures softening and the other that captures hardening behavior—are combined using another (sparse) Gaussian process regression model. The resulting constitutive creep surrogate model is integrated within the MOOSE finite element framework to simulate the intricate effects of microstructure, in particular MX-phase precipitates, on a component with a graded microstructure. Surrogate sensitivity analysis is applied to quantify the relevant impact of spatially varying microstructure on the creep response in a test-case involving a Grade 91 alloy with a prototypical weld.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Linear model decision trees as surrogates in optimization of engineering applications

Machine learning models are promising as surrogates in optimization when replacing difficult to solve equations or black-box type models. This work demonstrates the viability of linear model decision trees as piecewise-linear surrogates in decision-making problems. Linear model decision trees can be represented exactly in mixed-integer linear programming (MILP) and mixed-integer quadratic constrained programming (MIQCP) formulations. Furthermore, they can represent discontinuous functions, bringing advantages over neural networks in some cases. We present several formulations using transformations from Generalized Disjunctive Programming (GDP) formulations and modifications of MILP formulations for gradient boosted decision trees (GBDT). We then compare the computational performance of these different MILP and MIQCP representations in an optimization problem and illustrate their use on engineering applications. Importantly, we observe faster solution times for optimization problems with linear model decision tree surrogates when compared with GBDT surrogates using the Optimization and Machine Learning Toolkit (OMLT).

42 ENGINEERING↗
DOE OSTI2025

Surrogate-driven design optimization with uncertainty constraints in Monte Carlo simulations

In multi-objective design tasks, the computational cost increases rapidly when high-fidelity simulations are used to evaluate objective functions. Surrogate models help mitigate this cost by approximating the simulation output, simplifying the design process. However, under high uncertainty, surrogate models trained on noisy data can produce inaccurate predictions, as their performance depends heavily on the quality of training data. This study investigates the impact of data uncertainty on two multi-objective design problems modelled using Monte Carlo transport simulations: a neutron moderator and an ion-to-neutron converter. For each, a grid search was performed using five different tally uncertainty levels to generate training data for neural network surrogate models. These models were then optimized using NSGA-III. The recovered Pareto-fronts were analyzed across uncertainty levels: in the moderator problem, normalized hypervolume dropped from 0.886 at 1.0% uncertainty to 0.748 at 10% uncertainty, while in the converter problem it remained near 0.50 for all cases. Average simulation times were also compared to evaluate the trade-off between accuracy and computational cost. Results show that the influence of simulation uncertainty is strongly problem-dependent. In the neutron moderator case, higher uncertainties led to exaggerated objective sensitivities and distorted Pareto-fronts, reducing normalized hypervolume. In contrast, the ion-to-neutron converter task was less affected—low-fidelity simulations produced results similar to those from high-fidelity data. These findings suggest that a fixed-fidelity approach is not optimal. Surrogate models can recover the Pareto-front under noisy conditions, and multi-fidelity studies help identify suitable uncertainty levels for each problem to balance efficiency and accuracy.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2023

Laminar flame speed measurements of a gasoline surrogate and its mixtures with ethanol at elevated pressure and temperature

Laminar Flame speed measurements of a gasoline surrogate and mixtures of it with ethanol were conducted using a heated, constant-volume vessel. A spherical propagating flame was observed using a high-speed camera, and laminar flame speed was determined therefrom. Here, the gasoline surrogate, which serves as the baseline for the current study, consisted of four components, namely, iso-octane, n-heptane, toluene, and 1-hexene. Different mixtures of the gasoline surrogate and ethanol were studied, governed by the ethanol percentage in the mixture. That is, E0, E30, E50, and E85 mixtures represent 0%, 30%, 50%, and 85% ethanol in the gasoline surrogate mixture by liquid volume, respectively. Initial temperatures of 335, 359, and 408 K and initial pressures of 1 and 3 bar were investigated. The findings of this study are compared to results in the literature, which show good agreement for E0 but some deviation for the E30 blend. In general, the study showed an increase in laminar flame speed as the ethanol percentage increases in the mixture. Similarly, increasing the initial temperature with fixed ethanol percentage resulted in an increase in laminar flame speed, as expected. In contrast, increasing the initial pressure with fixed Ethanol percentage showed a decrease in laminar flame speed. Finally, the results are compared to an existing chemical kinetics model designed for ethanol and gasoline. Although agreement between the model and data is reasonable and mostly within about 10%, some improvement to the kinetics model is needed to uniformly lower the calculated flame speeds.

09 BIOMASS FUELS↗
DOE OSTI2022

Combustion characteristics and detailed simulations of surrogates for a Tier II gasoline certification fuel

An experimental and numerical study of combustion of a gasoline certification fuel (‘indolene’), and four (S4) and five (S5) component surrogates for it, is reported for the configurations of an isolated droplet burning with near spherical symmetry in the standard atmosphere, and a single cylinder engine designed for advanced compression ignition of pre-vaporized fuel. The intent was to compare performance of the surrogate for these different combustion configurations and to assess the broader applicability of the kinetic mechanism and property database for the simulations. A kinetic mechanism comprised of 297 species and 16,797 reactions was used in the simulations that included soot formation and evolution, and accounted for unsteady transport, liquid diffusion inside the droplet, radiative heat transfer, and variable properties. The droplet data showed a clear preference for the S5 surrogate in terms of burning rate. The simulations showed generally very good agreement with measured droplet, flame, and soot shell diameters. Measurements of combustion timing, in-cylinder pressure, and mass-averaged gas temperature were also well predicted with a slight preference for the S5 surrogate. Preferential vaporization was not evidenced from the evolution of droplet diameter but was clearly revealed in simulations of the evolution of mixture fractions inside the droplets. Here, the influence of initial droplet diameter (D o ) on droplet burning was strong, with S5 burning rates decreasing with increasing D o due to increasing radiation losses from the flame. Flame extinction was predicted for D o =3.0 mm as a radiative loss mechanism but not predicted for smaller D o for the conditions of the simulations.

42 ENGINEERING↗
DOE OSTI2024

Heat release surrogates for NH 3 /H 2 /N 2 –air premixed flames

The present study investigates the performance of NH, NH 2 , O-atom, and H-atom as heat release rate (HRR) surrogates for NH 3 /H 2 /N 2 –air premixed flame through simulations. The simulations are conducted across different pressures, reactant inlet temperatures, fuel blend compositions, and equivalence ratios. Cantera is used to simulate one-dimensional (1D) freely propagating flames to investigate the spatial correlations of the species with the HRR. PeleLMeX, a low-Mach direct numerical simulation (DNS) code with Adaptive Mesh Refinement (AMR), is used to simulate two-dimensional (2D) flame-vortex interactions to investigate the temporal correlations including stretch effects. Three different mechanisms (Jiang et al. 2020; Glarborg et al. 2018; Okafor et al. 2018) were considered in the 1D flame simulations, whereas only the Jiang mechanism was considered in the flame-vortex simulations. The HRR surrogate performance for the 2D flames is evaluated at two different locations: (1) the centerline and (2) the flame cusp. The cusp is defined as the region in the flame front with the greatest curvature and the centerline encounters the highest tangential strain rate. The 1D flame results suggest that, although there is not uniformly good spatial correlation for HRR across all flame conditions, NH is the best overall as a HRR surrogate for laminar flames. The 2D flame results, however, suggest that O-atom and H-atom have satisfactory temporal correlations at different conditions—the former for rich flames, the latter for high-pressure flames. Furthermore, these simulations provide guidance to experimental measurements of surrogate HRR markers in unsteady multi-dimensional flames using laser diagnostics to detect species such as NH, O-atom, and H-atom.

Ammonia↗
DOE OSTI2025

Selection of Sampling and Surrogate Modeling Methods for State-Point Evaluations of an AGN-201M Reactor

Nuclear reactor digital twins (DTs) have been proposed for use as a safeguards technology to efficiently monitor new and novel reactors as they come online. A safeguards DT needs to be capable of detecting misuse and diversion as they occur, requiring physics models to be accurate and efficient. Mathematical surrogate models are capable of achieving the necessary efficiency and can largely maintain the accuracy of higher-order models given a quality training sample. The Multiphysics Object-Oriented Simulation Environment (MOOSE) code framework is specifically equipped to generate training samples and create surrogate models using full-order reactor physics models. Utilizing an operational AGN-201M reactor’s specifications, two surrogate types were trained on samples of variable size, and using Cartesian products, Latin hypercube sampling, and quadrature sampling, each was compared and evaluated on accuracy when compared to a full-order Monte Carlo model. Both surrogate types were able to capture reactivity changes within 0.05 $ of the Monte Carlo model while reducing the computation costs by eight orders of magnitude.

MOOSE↗
DOE OSTI2024

Surrogate modelling for urban building energy simulation based on the bidirectional long short-term memory model

Here, the urban microclimate is essential for accurate simulation-based urban building energy modelling (UBEM). However, a high spatial-resolution microclimate can increase the computational resources demands of UBEM. Surrogate modelling is one of the promising approaches for fast UBEM. This study proposes a bidirectional Long Short-Term Memory (LSTM)-based approach for simulation-based UBEM surrogate modelling. The estimations are aggregated into census tracts using total building floor area. A case study using UBEM to estimate annual hourly building energy use and anthropogenic heat from all existing buildings in Los Angeles County found that most of the surrogate models can complete the annual hourly simulation within 90 minutes with a normalized mean absolute error lower than 10%, and that the bidirectional LSTM outperforms the standard LSTM in accuracy. This study demonstrates the advantages of bidirectional RNN architecture in building energy surrogate modelling and is expected to promote long-term and high-resolution UBEM with detailed microclimates.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models

Uncertainty visualization is a key component in translating important insights from ensemble simulation data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models trained on ensemble data, we can substitute computationally expensive simulations, which allows users to interact with more aspects of data spaces than ever before. However, the use of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble data↗
DOE OSTI2025

Polynomial Chaos Surrogate Construction for Random Fields with Parametric Uncertainty

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many simulations for acceptable accuracy. Surrogate models provide a means of circumventing the high computational expense of sampling such complex models. In particular, polynomial chaos expansions (PCEs) have been successfully used for uncertainty quantification studies of deterministic models where the dominant source of uncertainty is parametric. We discuss an extension to conventional PCE surrogate modeling to enable surrogate construction for stochastic computational models that have intrinsic noise in addition to parametric uncertainty. We develop a PCE surrogate on a joint space of intrinsic and parametric uncertainty, enabled by Rosenblatt transformations, which are evaluated via kernel density estimation of the associated conditional cumulative distributions. Furthermore, we extend the construction to random field data via the Karhunen–Loève expansion. We then take advantage of closed-form solutions for computing PCE Sobol indices to perform a global sensitivity analysis of the model which quantifies the intrinsic noise contribution to the overall model output variance. Additionally, the resulting joint PCE is generative in the sense that it allows generating random realizations at any input parameter setting that are statistically approximately equivalent to realizations from the underlying stochastic model. The method is demonstrated on a chemical catalysis example model and a synthetic example controlled by a parameter that enables a switch from unimodal to bimodal response distributions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Adaptive resource allocation for surrogate modeling of systems comprised of multiple disciplines with varying fidelity

We present an adaptive algorithm for constructing surrogate models for integrated systems composed of a set of coupled components. With this goal we introduce ‘coupling’ variables with a priori unknown distributions that allow approximations of each component to be built independently. Once built, the surrogates of the components are combined and used to predict system-level quantities of interest (QoI) at a fraction of the cost of interrogating the full system model. We use a greedy experimental design procedure, based upon a modification of Multi-Index Stochastic Collocation (MISC), to minimize the error of the combined surrogate. This is achieved by refining each component surrogate in accordance with its relative contribution to error in the approximation of the system-level QoI. Our adaptation of MISC is a multi-fidelity procedure that can leverage ensembles of models of varying cost and accuracy, for one or more components, to produce estimates of system-level QoI. Several numerical examples demonstrate the efficacy of the proposed approach on systems involving feed-forward and feedback coupling. For a fixed computational budget, the proposed algorithm is able to produce approximations that are orders of magnitude more accurate than approximations that treat the integrated system as a black-box.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

One System, Many Models: Designing a Surrogate Model for Sulfur Thermal Energy Storage: Preprint

Industrial process heating (IPH) relies primarily on thermal energy generated by fossil fuel combustion to produce, treat, and alter manufactured goods. Thermal energy storage (TES) helps reduce the carbon footprint of IPH systems by facilitating the utilization of renewable and waste heat sources. A promising new TES technology uses elemental sulfur as the heat-storage medium. The design of sulfur TES systems can be evaluated with the aid of computational fluid dynamics (CFD). However, the computational cost of such CFD efforts is prohibitive to comprehensive optimizations over design parameters. To reduce this computational cost, machine learning (ML) models can be developed to act as surrogates for CFD. In this paper, we describe the process of building and evaluating surrogate ML models for facilitating optimization of sulfur TES systems for IPH. To enforce the thermodynamic relationship between the two modeled quantities, we develop a hybrid model for sulfur temperature using both direct predictions of temperature and calculations of temperature from predictions of the heat transfer coefficient. The hybrid model enforces this constraint at the expense of the slightly reduced accuracy compared to two disjoint models. The overall high accuracy observed in our model evaluation demonstrates the usefulness of such surrogate modeling for studying TES systems. This work contributes to the field of TES surrogate modeling by offering a novel accurate hybrid approach to predicting simultaneously the heat transfer coefficient and temperature of the heat storage medium.

computational fluid dynamics↗
DOE OSTI2024

Surrogate Model Guided Optimization of Expensive Black-Box Multi-Objective Problems: A Posteriori Methods

Many engineering applications require the simultaneous optimization of multiple conflicting objective functions. Often, these objective functions are evaluated using highly accurate computer simulations that are computationally too expensive to be evaluated hundreds or thousands of times during optimization. Thus, the goal is to find good approximations of the Pareto front using as few of these expensive simulations as possible. Here, we describe an optimization approach based on surrogate models and diverse sampling strategies to accelerate the search for the Pareto solutions. We use a separate surrogate model for approximating each objective function and then we use the surrogate models to inform where additional expensive simulations should be run. The surrogate models are updated in an active learning framework whenever new information from the expensive simulations becomes available. The sampling strategies aim at balancing local improvements of the approximate Pareto front and global exploration to identify the extrema and fill in large gaps of the approximate Pareto front. We demonstrate on a large set of benchmark problems the effectiveness of the method for finding good approximations of the Pareto front.

MATHEMATICS AND COMPUTING↗