SEARCH · Engineering Papers

Results for “Surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Surrogate Model Guided Optimization of Expensive Black-Box Multi-Objective Problems: A Posteriori Methods

Many engineering applications require the simultaneous optimization of multiple conflicting objective functions. Often, these objective functions are evaluated using highly accurate computer simulations that are computationally too expensive to be evaluated hundreds or thousands of times during optimization. Thus, the goal is to find good approximations of the Pareto front using as few of these expensive simulations as possible. Here, we describe an optimization approach based on surrogate models and diverse sampling strategies to accelerate the search for the Pareto solutions. We use a separate surrogate model for approximating each objective function and then we use the surrogate models to inform where additional expensive simulations should be run. The surrogate models are updated in an active learning framework whenever new information from the expensive simulations becomes available. The sampling strategies aim at balancing local improvements of the approximate Pareto front and global exploration to identify the extrema and fill in large gaps of the approximate Pareto front. We demonstrate on a large set of benchmark problems the effectiveness of the method for finding good approximations of the Pareto front.

MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models: Preprint

Uncertainty visualization is a key component in translating important insights from ensemble data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models for computationally expensive simulations, users can interact with more aspects of data spaces than ever before. However, the integration of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble visualization↗

DOE OSTI2024

Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty

Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the distributions of the high-dimensional solution fields of a model with stochastic input parameters. However, due to the highly nonlinear nature of the parameter-to-solution map in even the simplest dynamical systems, the constructed SC surrogates are often inaccurate. Here, this work presents an alternative approach, where we apply the SC approximation over the dynamics of the model, rather than the solution. By combining the data-driven sparse identification of nonlinear dynamics framework with SC, we construct dynamics surrogates and integrate them through time to construct the surrogate solutions. We demonstrate that the SC-over-dynamics framework leads to smaller errors, both in terms of the approximated system trajectories as well as the model state distributions, when compared against full-field SC applied to the solutions directly. We present numerical evidence of this improvement using three test problems: a chaotic ordinary differential equation, and two partial differential equations from solid mechanics.

42 ENGINEERING↗

DOE OSTI2021

Prospects for Surrogate Neutron Capture Measurements with Radioactive Ion Beams and GODDESS

Neutron capture reactions are responsible for the synthesis of almost all of the elements heavier than iron through the slow s-process, that proceeds close to the line of stability, and the rapid r-process, with very neutron-rich waiting points. Uncertainties in (n,γ) rates in neutron rich nuclei, especially near closed neu- tron shells, can have significant impact [1] on the predictions of final abundances for different astrophysical scenarios for the r process. Understanding (n,γ) rates on neutron-rich fission fragments is also important for nuclear forensics and stockpile stewardship science. Ratkiewicz et al. [2 and references therein] has recently demonstrated that the (d,pγ) reaction is a valid surrogate for (n,γ), where the formation of the compound nucleus from the breakup of the deuteron has been calculated in a reaction model and the subsequent measured gamma-decay probabilities are reproduced with standard level density and strength functions in a Bayesian approach. In parallel to the surrogate validation efforts, we have demonstrated that the (d,pγ) reaction can be measured in inverse kinematics with Gammasphere ORRUBA: Dual Detectors for Experimental Structure Studies (GODDESS) [3] where the Gammasphere array of Compton-suppressed HPGe detectors is coupled to the Oak Ridge Rutgers University Barrel Array of position-sensitive silicon strip detectors. During the commissioning campaign we measured the (d,pγ) reaction with 134 Xe and 95 Mo beams, the latter to demonstrate the surrogate method in inverse kinematics. The present talk will present preliminary results from this campaign including γ-decay probabilities and prospects for surrogate (n,γ) measurements with 143 Ba fission-fragment beams.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Dynamic flux surrogate-based partitioned methods for interface problems

Loosely coupled partitioned methods for multiphysics problems treat each subproblem as a separate entity and advance them independently in time. In so doing these methods enable code reuse, increase concurrency and provide a convenient framework for plug-and-play multiphysics simulations. However, mathematically loosely coupled schemes are equivalent to a single step of an iterative solution method, which can compromise their accuracy and stability. We present a new data-driven partitioned method for coupled parametric PDEs that can improve upon the accuracy of traditional loosely coupled methods without incurring a performance penalty. To that end, we replace conventional field transfers across the interface by a surrogate for the dynamics of the interface flux exchanged between the subdomains. To develop this surrogate we apply dynamic mode decomposition to a non-standard staggered-in-time state, comprising the interface flux and small solution patches near the interface. The new approach shifts the main computational burden to an offline training phase, whereas application of the surrogate in the online phase amounts to a single matrix–vector multiplication. In conclusion, we provide stability analysis of the surrogate-based partitioned scheme and include numerical results that demonstrate its potential.

Dynamic mode decomposition (DMD)↗

DOE OSTI2016

Compositional effects on the ignition of FACE gasolines [Compositional effects on the ignition of FACE gasoline fuels: experiments, surrogate fuel formulation, and chemical kinetic modeling]

As regulatory measures for improved fuel economy and decreased emissions are pushing gasoline engine combustion technologies towards extreme conditions (i.e., boosted and intercooled intake with exhaust gas recirculation), fuel ignition characteristics become increasingly important for enabling stable operation. Here, this study explores the effects of chemical composition on the fundamental ignition behavior of gasoline fuels. Two well-characterized, high-octane, non-oxygenated FACE (Fuels for Advanced Combustion Engines) gasolines, FACE F and FACE G, having similar antiknock indices but different octane sensitivities and chemical compositions are studied. Ignition experiments were conducted in shock tubes and a rapid compression machine (RCM) at nominal pressures of 20 and 40 atm, equivalence ratios of 0.5 and 1.0, and temperatures ranging from 650 to 1270 K. Results at temperatures above 900 K indicate that ignition delay time is similar for these fuels. However, RCM measurements below 900 K demonstrate a stronger negative temperature coefficient behavior for FACE F gasoline having lower octane sensitivity. In addition, RCM pressure profiles under two-stage ignition conditions illustrate that the magnitude of low-temperature heat release (LTHR) increases with decreasing fuel octane sensitivity. However, intermediate-temperature heat release is shown to increase as fuel octane sensitivity increases. Various surrogate fuel mixtures were formulated to conduct chemical kinetic modeling, and complex multicomponent surrogate mixtures were shown to reproduce experimentally observed trends better than simpler two- and three-component mixtures composed of n-heptane, iso-octane, and toluene. Measurements in a Cooperative Fuels Research (CFR) engine demonstrated that the multicomponent surrogates accurately captured the antiknock quality of the FACE gasolines. Simulations were performed using multicomponent surrogates for FACE F and G to reveal the underlying chemical kinetics linking fuel composition with ignition characteristics. Finally, a key discovery of this work is the kinetic coupling between aromatics and naphthenes, which affects the radical pool population and thereby controls ignition.

02 PETROLEUM↗

DOE OSTI2025

Self-consistent equilibrium and transport simulations for NSTX-U plasmas enhanced via machine learning surrogate models

The Control-Oriented Transport SIMulator (COTSIM) is an advanced equilibrium and transport code designed for simulating tokamak discharges at computational speeds suitable for control applications. COTSIM’s modular framework enables users to select models that balance accuracy with speed according to specific needs, allowing the code to operate from fast to faster-than-real-time performance levels. This work presents recent enhancements to COTSIM’s predictive accuracy for NSTX-U scenarios, achieved by integrating neural-network-based surrogate models and self-consistent equilibrium calculations. To improve source deposition predictions, a surrogate model for NUBEAM has been incorporated. Additionally, a surrogate model for the Multi-Mode Module (MMM) now supports predictions of anomalous thermal, momentum, and particle diffusivities—key factors for modeling the evolution of temperature and rotation. Each surrogate model was specifically trained for the NSTX-U operational regime to enhance COTSIM’s accuracy while maintaining computational efficiency. Moreover, COTSIM now couples fixed-boundary equilibrium solvers with its transport solvers, enabling self-consistent predictions of plasma profiles and equilibrium evolution over the discharge. Simulation results demonstrate strong agreement between COTSIM and TRANSP predictions for NSTX-U discharges. These substantial advancements expand COTSIM’s utility in model-based control applications for NSTX-U. Potential applications include simultaneous optimization of equilibrium and transport scenarios, integration into digital twins, real-time profile estimation (e.g., temperature and rotation) from limited or noisy measurements, and advanced feedback-based scenario control.

Equilibrium and transport modeling↗

DOE OSTI2016

Residual position errors of lymph node surrogates in breast cancer adjuvant radiotherapy: Comparison of two arm fixation devices and the effect of arm position correction

Residual position errors of the lymph node (LN) surrogates and humeral head (HH) were determined for 2 different arm fixation devices in radiotherapy (RT) of breast cancer: a standard wrist-hold (WH) and a house-made rod-hold (RH). The effect of arm position correction (APC) based on setup images was also investigated. A total of 113 consecutive patients with early-stage breast cancer with LN irradiation were retrospectively analyzed (53 and 60 using the WH and RH, respectively). Residual position errors of the LN surrogates (Th1-2 and clavicle) and the HH were investigated to compare the 2 fixation devices. The position errors and setup margins were determined before and after the APC to investigate the efficacy of the APC in the treatment situation. A threshold of 5 mm was used for the residual errors of the clavicle and Th1-2 to perform the APC, and a threshold of 7 mm was used for the HH. The setup margins were calculated with the van Herk formula. Irradiated volumes of the HH were determined from RT treatment plans. With the WH and the RH, setup margins up to 8.1 and 6.7 mm should be used for the LN surrogates, and margins up to 4.6 and 3.6 mm should be used to spare the HH, respectively, without the APC. After the APC, the margins of the LN surrogates were equal to or less than 7.5/6.0 mm with the WH/RH, but margins up to 4.2/2.9 mm were required for the HH. The APC was needed at least once with both the devices for approximately 60% of the patients. With the RH, irradiated volume of the HH was approximately 2 times more than with the WH, without any dose constraints. Use of the RH together with the APC resulted in minimal residual position errors and setup margins for all the investigated bony landmarks. Based on the obtained results, we prefer the house-made RH. However, more attention should be given to minimize the irradiation of the HH with the RH than with the WH.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2018

Sooting tendencies of co-optima test gasolines and their surrogates

Here, this study characterized the sooting tendencies of a set of gasolines and their surrogates using both experimental and computational methods. Sooting tendency was defined in terms of the soot yield when 1000 ppm of the test fuel is doped into the fuel of a methane/air flame, and it provides a measure of the intrinsic chemical tendency of the fuels to form soot in a generic combustion environment. The test fuels were real gasolines containing enhanced concentrations of alkanes, aromatics, cycloalkanes, olefins, and ethanol. These compositional differences caused the experimentally measured sooting tendencies of the fuels to vary by 240%. The surrogates were 3 mixtures defined by Szybist et al. (2017) and 3 alternative formulations modified for greater experimental convenience. The sooting tendencies measured for the surrogate mixtures agreed with the real fuels to within 15%, and varied with composition in the same order. The sooting tendencies of the surrogates could be predicted to within experimental error with an empirical quantitative structure-property relationship and a linear mixing model. The experimental flames were computationally simulated with a 743-species mechanism, and sooting tendencies derived from the results agreed with the measured values to within 11%. Altogether, these results show that the sooting behavior of gasoline can vary considerably within the range of acceptable compositions, and that these variations can be accurately predicted with empirical models and computational simulations.

09 BIOMASS FUELS↗

DOE OSTI2017

Uncertainty propagation through an aeroelastic wind turbine model using polynomial surrogates

Polynomial surrogates are used to characterize the energy production and lifetime equivalent fatigue loads for different components of the DTU 10 MW reference wind turbine under realistic atmospheric conditions. The variability caused by different turbulent inflow fields are captured by creating independent surrogates for the mean and standard deviation of each output with respect to the inflow realizations. A global sensitivity analysis shows that the turbulent inflow realization has a bigger impact on the total distribution of equivalent fatigue loads than the shear coefficient or yaw miss-alignment. The methodology presented extends the deterministic power and thrust coefficient curves to uncertainty models and adds new variables like damage equivalent fatigue loads in different components of the turbine. These surrogate models can then be implemented inside other work-flows such as: estimation of the uncertainty in annual energy production due to wind resource variability and/or robust wind power plant layout optimization. It can be concluded that it is possible to capture the global behavior of a modern wind turbine and its uncertainty under realistic inflow conditions using polynomial response surfaces. In conclusion, the surrogates are a way to obtain power and load estimation under site specific characteristics without sharing the proprietary aeroelastic design.

17 WIND ENERGY↗

DOE OSTI2026

Machine learning surrogates for ion energy–angle distributions in thermal and RF plasma sheaths

Ion energy–angle distributions (IEADs) at material surfaces are a critical input for plasma–material interaction (PMI) studies in fusion devices, yet they are computationally expensive to obtain using particle-in-cell (PIC) simulations. In this work, we develop a machine learning surrogate based on a deep deconvolutional neural network (DDeCNN) trained on large databases generated with the hPIC2 code. The surrogate is capable of reconstructing IEADs from sheath parameters for both thermal and radio-frequency (RF) plasmas, including cases with multiple ion species. Across thousands of test cases, the model achieves high accuracy, with over 97 % of predictions classified as good or average based on standard error metrics (MAE, MSE, L2). Even in the more challenging RF and multi-species regimes, the surrogate reliably captures the multi-peak structure of PIC results. Once trained, the surrogate produces IEADs in milliseconds on a common workstation, yielding speedups of six to seven orders of magnitude compared with running a full PIC simulation. This computational gain enables dense parameter scans and direct coupling of IEAD predictions with PMI and erosion models on whole-device scales in fusion-relevant conditions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Efficient learning of accurate surrogates for simulations of complex systems

Machine learning methods are increasingly deployed to construct surrogate models for complex physical systems at a reduced computational cost. However, the predictive capability of these surrogates degrades in the presence of noisy, sparse or dynamic data. Here, we introduce an online learning method empowered by optimizer-driven sampling that has two advantages over current approaches: it ensures that all local extrema (including endpoints) of the model response surface are included in the training data, and it employs a continuous validation and update process in which surrogates undergo retraining when their performance falls below a validity threshold. We find, using benchmark functions, that optimizer-directed sampling generally outperforms traditional sampling methods in terms of accuracy around local extrema even when the scoring metric is biased towards assessing overall accuracy. Finally, the application to dense nuclear matter demonstrates that highly accurate surrogates for a nuclear equation-of-state model can be reliably autogenerated from expensive calculations using few model evaluations.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Deep learning surrogate model for kinetic Landau-fluid closure with collision

In this work, the kinetic Landau-fluid (LF) closure with collision and periodic boundary condition is used in the development of the deep learning (DL) surrogate model. A classical neural network, namely, feedforward neural network or sometimes termed multilayer perceptron, is constructed and trained to learn the kinetic LF closure in the static limit and arbitrary mean free path in configuration space. The preliminary relation between best hyperparameters and critical parameters for data generation is found. Compared with the numerical approach (non-Fourier method) of the LF closure, the deep learning surrogate model shows an order of magnitude of improvement in terms of accuracy. Perhaps most importantly, the surrogate model closure has been integrated for the first time with fluid simulations. Our DL-enabled fluid simulations, for the first time, give the correct Landau damping rate for a wide range of wave vectors, while the Hammett–Perkins closure cannot produce the correct damping rate. We correctly connect the collisionless Hammett–Perkins closure and collisional Braginskii closure to reproduce the intrinsic nonlocal feature of the heat flux with DL techniques. We address the most concerning error accumulation problem and find that simulations with the deep learning surrogate model are as good as, if not better than, simulations with the analytic closure in terms of long-term numerical stability in the linear Landau damping test.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2026

Constraining hydrodynamic models of inertial confinement fusion implosions using capsule surrogate experiments

We conduct capsule surrogate experiments at the National Ignition Facility to calibrate radiation hydrodynamic simulations to infer hydrodynamic conditions that are not observable in indirect drive ignition implosions. We tune the simulations by applying laser power and cross beam energy transfer (CBET) saturation multipliers to match the observables from capsule surrogate experiments. Shock timing, velocity, and symmetry are measured in liquid D 2 filled Keyhole capsule surrogate experiments and implosion trajectory, stagnation time, and shape time history are measured in in-flight 2D backlit x-ray radiography experiments (“2DConA”) of D 2 gas filled capsule implosions. Calibrated simulations suggest that the N210808 ignition implosion (fusion target gain = 0.7) had a shell mass remaining at stagnation of less than the nominal %5 (3.8%) and resulted in less confinement. For N221204, the shell was made 5.75 μm thicker to trade implosion velocity for increased confinement and resulted in a target gain = 1.5 with a shell mass remaining of 5.7%. Furthermore, a single adjusted model can reproduce all shock timing data as changes are made to shell thickness (79–85 μm) and laser wavelength separation (1.8–4.0 Å). However, for the 2DConA implosions, a 5% variation in the peak power laser multipliers and a 30% variation in late-time CBET between experiments are needed to match the observed stagnation times, in-flight $P_2$ shape, and hot-spot $P_2$ shape. While progress is being made to improve the models in simulations using focused experiments, capsule surrogate experiments will continue to be needed to optimize future ignition designs.

Lasers↗

DOE OSTI2023

Constraints on OPF Surrogates for Learning Stable Local Volt/Var Controllers

We consider the problem of learning local Volt/Var controllers in distribution grids (DGs). Our approach starts from learning separable surrogates that take both local voltages and reactive powers as arguments and predict the reactive power setpoints that approximate optimal power flow (OPF) solutions. We propose an incremental control algorithm and identify two different sets of slope conditions on the local surrogates such that the network is collectively steered toward desired configurations asymptotically. Our results reveal the trade-offs between each set of conditions, with coupled voltage-power slope constraints allowing an arbitrary shape of surrogate functions but risking limitations on exploiting generation capabilities, and reactive power slope constraints taking full advantage of generation capabilities but constraining the shape of surrogate functions. AC power flow simulations on the IEEE 37-bus feeder illustrate their guaranteed stability properties and respective advantages in two DG scenarios.

asymptotic stability↗

DOE OSTI2020

Risk Assessment of Rare Events in Probabilistic Power Flow via Hybrid Multi-Surrogate Method

The risks associated with rare events threatening the security of power system operation are of paramount importance to power system planners and operators. To analyze the risks caused by high-impact, low-frequency rare events, an immensely large number of samples are typically required for the Monte-Carlo (MC) method on the high-fidelity power system model to achieve a sufficient accuracy, thereby rendering this approach computationally prohibitive. To handle this problem efficiently, it is desirable to construct a surrogate model for the power system response. However, the straightforward MC sampling of the low-fidelity surrogate can lead to biased results in the low-probability tail regions that are vital to risk assessment. Moreover, a single surrogate is unable to handle the topology uncertainties caused by random branch outages. To overcome these issues, we propose a hybrid multi-surrogate (HMS) method based on the polynomial chaos expansion (PCE) with low-probability tail events reevaluated by the high-fidelity model through a probabilistic analysis. This method improves the computational efficiency of the MC method for rare-event risk assessment by leveraging multi-fidelity models while retaining the desired accuracy. Simulations conducted in three test systems verify the excellent performances of the HMS method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2019

Convolutional Neural Network Surrogate Models for the Mechanical Properties of Periodic Structures

The work in this paper describes neural network surrogate models for calculating the effective mechanical properties of a periodic composites. The models achieve good accuracy even when only provided with training data sampling a small portion of the design space. As an example, the surrogate models are applied to solving the inverse design problem of finding structures with optimal mechanical properties. The surrogate models are sufficiently accurate to recover optimal solutions in general agreement with established topology optimization methods. However, improvements will be required to develop robust, efficient neural network-based surrogate models and several directions for future research are highlighted here.

42 ENGINEERING↗

DOE OSTI2023

Auto-HPCnet: An Automatic Framework to Build Neural Network-based Surrogate for High-Performance Computing Applications

High-performance computing communities are increasingly adopt- ing Neural Networks (NN) as surrogate models in their applications to generate scientific insights. Replacing an execution phase in the application with NN models can bring significant performance im- provement. However, there is a lack of tools that can help domain scientists automatically apply NN-based surrogate models to HPC applications. We introduce a framework, named Auto-HPCnet, to democratize the usage of NN-based surrogates. Auto-HPCnet is the first end-to-end framework that makes past proposals for the NN-based surrogate model practical and disciplined. Auto-HPCnet introduces a workflow to address unique challenges when apply- ing the approximation, such as feature acquisition and meeting the application-specific constraint on the quality of final computation outcome. We show that Auto-HPCnet can leverage NN for a set of HPC applications and achieve 5.50× speedup on average (up to 16.8× speedup and with data preparation cost included) while meeting the application-specific constraint on the final computation quality.

Dong, Wenqian↗