Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

SysCaps (Language Interfaces for Simulation Surrogates of Complex Systems) [SWR-24-97]

You've found the official code repository for the paper "SysCaps: Language Interfaces for Simulation Surrogates of Complex Systems," presented at the Foundation Models for Science: Progress, Opportunities, and Challenges workshop at NeurIPS 2024. Our paper conjectures that interfaces (both text templates as well as conversational) makes interacting with simulation surrogate models for complex systems more intuitive and accessible for both non-experts and experts. "System captions", or SysCaps, are text-based descriptions of systems based on information contained in simulation metadata. Our paper's goal is to train multimodal regression models that take text inputs (SysCaps) and timeseries inputs (exogenous system conditions such as hourly weather) and regress timeseries simulation outputs (e.g. hourly building energy consumption). The experiments in our paper with building and wind farm simulators, which can be reproduced using this codebase, aim to help us understand whether a) accurate regression in this setting is possible and b) if so, how well can we do it. Paper: https://arxiv.org/abs/2405.19653

Emami, Patrick↗
DOE OSTI2026

GP Cosmology Surrogate v1.0

GP Cosmology Surrogate is a Python library for building and training a generalized multi-output Gaussian process (GP) framework of @takhtaganov2021cosmic. In this approach, the surrogate is constructed sequentially, guided by a Bayesian optimization acquisition function that targets reduction of emulation error in the regions most consistent with the observational data. This adaptive design concentrates computational resources where they have the greatest impact on inference accuracy. The library supports efficient training for separable GP kernels, which allows the use of Kronecker algebra to handle high-dimensional input spaces and large numbers of correlated outputs. This makes it well suited for applications such as modeling cosmological power spectra, large-scale physical simulations, and multi-output hyperparameter tuning. By combining scalable multi-output GP modeling with data-driven adaptive sampling, GPsurrogate enables parameter inference and optimization with substantially fewer simulations than conventional space-filling designs.

Lukic, Zarija [Lawrence Berkeley National Laborato↗
DOE OSTI2024

Spatially Local Surrogate Modeling of Subgrid-Scale Effects in Idealized Atmospheric Flows: A Deep Learned Approach Using High-Resolution Simulation Data

Abstract We introduce a machine learned surrogate model from high-resolution simulation data to capture the subgrid-scale effects in dry, stratified atmospheric flows. We use deep neural networks (NNs) to model the spatially local state differences between a coarse-resolution simulation and a high-resolution simulation. The setup enables the capture of both dissipative and antidissipative effects in the state differences. The NN model is able to accurately capture the state differences in offline tests outside the training regime. In online tests intended for production use, the NN-coupled coarse simulation has higher accuracy over a significant period of time compared to the coarse-resolution simulation without any correction. We provide evidence of the capability of the NN model to accurately capture high-gradient regions in the flow field. With the accumulation of the errors, the NN-coupled simulation becomes computationally unstable after approximately 90 coarse simulation time steps. Insights gained from these surrogate models further pave the way for formulating stable, complex, physics-based spatially local NN models which are driven by traditional subgrid-scale turbulence closure models. Significance Statement Flows in the atmosphere are highly chaotic and turbulent, comprising flow structures of broad scales. For effective computational modeling of atmospheric flows, the effects of the small- and large-scale structures need to be captured by the simulations. Capturing the small-scale structures requires fine-resolution simulations. Even with the current state-of-the-art supercomputers, it can be prohibitively expensive to simulate these flows when computed for the entire earth over climate time scales. Thus, it is necessary to focus on the larger-scale structures using a coarse-resolution simulation while capturing the effects of the smaller-scale structures using some parameterization (approximation) scheme and incorporating it into the coarse-resolution simulation. We use machine learning to model the effects of the small-scale structures (subgrid-scale effects) in atmospheric flows. Data from a fine-resolution simulation is used to compute the missing subgrid-scale effects in coarse-resolution simulations. We then use machine learning models to approximate these differences between the coarse- and fine-resolution simulations. We see improved accuracy for the coarse-resolution simulations when corrected using these machine learned models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Assessment of an E10 gasoline surrogate: Qualitative and quantitative comparisons of in-cylinder spray morphology

A minimum-component gasoline fuel surrogate that captures both chemical and physical behaviors of a full-distillate fuel is needed for high-fidelity CFD simulations. This study evaluates gasoline spray characteristics in a direct-injection spark-ignition engine under motored operation. Two fuels are compared; PACE-20, which is a 9-component surrogate formulation of RD5-87, is compared with its target fuel RD5-87, which is a full-boiling range research grade E10 gasoline. The spray morphologies of both fuels are recorded for a centrally-located direct-injection 8-hole spray subject to intake air cross-flow during the early part of the intake stroke. High-speed imaging recorded scattered light of the side and axial projections of the liquid spray. Quantitative metrics were developed and employed to facilitate comparison of spray morphologies as well as to identify the transition in spray morphology due to flash boiling. This paper builds on a previous study of RD5-87 where coolant temperature (20°C–100°C), in-cylinder pressure (40–110 kPa), engine speed (650–1950 rpm), and injection pressure (60–180 bar) were systematically changed to span operating conditions with and without flash boiling. Images of the PACE-20 morphology are selected for a sub-set of operating conditions from the previous study where distinctive morphology changes occurred. Visual inspection of the images and quantitative metrics demonstrate that the PACE-20 spray morphology is equivalent to that of the RD5-87 in most cases. The exception was for changes in the ambient-gas pressure where the flash-boiling transition occurred at ∼5 kPa higher in-cylinder pressure for PACE-20. Three empirical metrics, Merging Index, Asymmetry, and Flash Index are proposed here and they were found to be useful both as quantitative comparisons of the fuel morphologies, and for identifying the transition in spray morphology due to flash boiling.

Kim, Namho↗
DOE OSTI2023

Solving multiphysics-based inverse problems with learned surrogates and constraints

Abstract Solving multiphysics-based inverse problems for geological carbon storage monitoring can be challenging when multimodal time-lapse data are expensive to collect and costly to simulate numerically. We overcome these challenges by combining computationally cheap learned surrogates with learned constraints. Not only does this combination lead to vastly improved inversions for the important fluid-flow property, permeability, it also provides a natural platform for inverting multimodal data including well measurements and active-source time-lapse seismic data. By adding a learned constraint, we arrive at a computationally feasible inversion approach that remains accurate. This is accomplished by including a trained deep neural network, known as a normalizing flow, which forces the model iterates to remain in-distribution, thereby safeguarding the accuracy of trained Fourier neural operators that act as surrogates for the computationally expensive multiphase flow simulations involving partial differential equation solves. By means of carefully selected experiments, centered around the problem of geological carbon storage, we demonstrate the efficacy of the proposed constrained optimization method on two different data modalities, namely time-lapse well and time-lapse seismic data. While permeability inversions from both these two modalities have their pluses and minuses, their joint inversion benefits from either, yielding valuable superior permeability inversions and CO 2 plume predictions near, and far away, from the monitoring wells.

Yin, Ziyi (ORCID:0000000250248771)↗
DOE OSTI2025

Prediction of cccDNA dynamics in hepatitis B patients by a combination of serum surrogate markers

Quantification of intrahepatic covalently closed circular DNA (cccDNA) is a key for evaluating an elimination of hepatitis B virus (HBV) in infected patients. However, quantifying cccDNA requires invasive methods such as a liver biopsy, which makes it impractical to access the dynamics of cccDNA in patients. Although HBV RNA and HBV core-related antigens (HBcrAg) have been proposed as surrogate markers for evaluating cccDNA activity, they do not necessarily estimate the amount of cccDNA. Here, we employed a recently developed multiscale mathematical model describing intra- and intercellular viral propagation and applied it in HBV-infected patients under treatment. We developed a model that can predict intracellular HBV dynamics by use of extracellular viral markers, including HBsAg, HBV DNA, and HBcrAg in peripheral blood. Importantly, the model prediction of the amount of cccDNA in patients over time was confirmed to be well correlated with the data for quantified cccDNA by paired liver biopsy. Thus, our method combining classic and emerging surrogate markers enables us to predict the decay dynamics of cccDNA in patients undergoing treatment.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Fiats: Functional inference and training for surrogates

Fiats provides a platform for research on the training and deployment of neural-network surrogate models for computational science. Fiats also supports exploring, advancing, and combining functional, object-oriented, and parallel programming patterns in Fortran 2023. As such, the Fiats name has dual expansions: “Functional Inference And Training for Surrogates” or “Fortran Inference And Training for Science.” Fiats inference and training procedures are pure and therefore satisfy a language constraint imposed on procedure invocations inside Fortran’s parallel loop construct: do concurrent. Furthermore, the Fiats training procedures are built around a do concurrent parallel reduction. Several compilers can automatically parallelize do concurrent on Central Processing Units (CPUs) or Graphics Processing Units (GPUs). Fiats thus aims to achieve performance portability through standard language mechanisms.

Rouson, Damian [Lawrence Berkeley National Laborat↗
DOE OSTI2024

A manifold learning perspective on surrogate modeling of nitrate concentration in the Kansas River

Abstract A non-linear surrogate model of nitrate concentration in the Kansas River (USA) is described. The model is an (almost) Piece-wise Linear response surface that provides a mean field approximation to the dynamics of the measured data for nitrate plus nitrite (target product) correlations to turbidity and chlorophyll-a concentrations (input variables). The method extends the United States Geological Survey’s linear procedures for surrogate data modeling allowing for better approximations for river systems exhibiting algal blooms due to nutrient-rich source waters. The model and visualization procedures illustrated in the Kansas River example should be generally applicable to many medium-size rivers in agricultural regions.

Tufillaro, Nicholas (ORCID:0009000628968832)↗
DOE OSTI2020

Detection and Perception of Sound by Eagles and Surrogate Raptors

One overarching objective of this program of study was the accumulation of objective, scientifically valid information relating to auditory performance of bald and golden eagles that may be used to guide the development of acoustic alerting/deterrence technologies intended to discourage encroachment into wind energy air spaces. To that end, analyses aimed at the characterization of sensitivity to sound in bald and golden eagles, along with findings in the supra-threshold, dynamic frequency spaces related to response latencies and amplitudes, leads us to conclude that bald, and golden eagles navigate the same basic working auditory space, as in other known and thus far characterized members of the diurnal raptor family. Specifically, bald and golden eagles, along with other raptor species within the group, operate in an auditory space characterized by a frequency band at least four octaves wide and centered on 2 kHz, with an upper frequency limit between 6 and 10 kHz at 80 dB SPL and a lower frequency limit that almost certainly extends below 0.2 kHz. Consequently, we recommend that signal designers use these data as a guideline in efforts to design effective and efficient acoustic alerting/deterrent systems. It is important to note that signal energy broadcast outside of this frequency band at moderate levels will not contribute to the efficacy of a deterrent but will add an unnecessary fraction to the overall acoustic pollution budget. The importance of this consideration is heightened by contemporaneous concerns related to the transmission of noise broadcast by wind energy farms. In addition, based on analyses of data acquired from red-tailed hawks using the same experimental paradigm and data acquisition system, we conclude that auditory function in the red-tailed hawk is sufficiently like that observed in bald and golden eagles to permit its use as a surrogate species. Response waveforms, threshold-frequency curves, and input-output characteristics match those of eagles closely. It should be noted however, that differences in sensitivity and slightly extended high-frequency limits of hearing should be taken into account when extrapolating findings from one species to the others. Although the inclusion of behavioral tests of red-tailed hawks to acoustic stimuli was beyond the scope of this investigation, future efforts to assess response parameters like signal-type preference and habituation rate will further elucidate their suitability to serve as eagle surrogates in behavioral studies; nonetheless, the species in question are well matched with respect to basic auditory performance. A second essential objective of this program of study was the acoustic characterization of a subset of calls comprising the vocal repertoires of bald and golden eagles that may be used to supplement auditory performance findings in the effort to guide the development of acoustic alerting signals. With regard to that objective, the vocal repertoires of both bald and golden eagle species are rich and varied. While similar in spectrographic structure, distinctive differences are also clear. Generally, golden eagles produce some calls with shorter durations, and similar “sounding” calls exhibit distinctively different spectrographic patterns than those of bald eagles. Both species produce calls that contain a wide variety of nonlinear elements that operate to enhance the rich and varied nature of commonly observed vocal products. Comparison of the average power spectra of commonly observed bald and golden eagle calls with threshold-frequency curves leads to the conclusion that call energies fall within the frequency bounds of hearing. Further, the acoustic energy of calls considered in this report tend to fall into overlapping, but different frequency ranges of the acoustic sensitivity curve. This condition may encourage signal designers to vary the frequency content of acoustic deterrence signals in the field. Finally, preliminary observations relating to the tendencies and proclivities of bald eagles to attend to the acoustic landscape lead to the conclusion that eagles monitor their immediate sound environment assiduously. Individuals respond to a variety of natural and synthetic sound signals reliably and, perhaps most relevant in the context of the engineering of acoustic alerting/deterrence technologies, habituation to most sounds considered in this effort was minimal. These preliminary results, while calling for extended behavioral testing, are promising and set the stage for the exportation of behavioral studies into real world scenarios.

17 WIND ENERGY↗
DOE OSTI2022

Development of the uncertainty quantification toolkit's python interface and surrogate construction tutorial

The uncertainty quantification toolkit (UQTk) is a collection of c++ libraries that assess the confidence of numerical models. Surrogate approximations, often polynomial chaos expansions (PCEs), lessen the computational cost of these assessments. I developed a Python interface in UQTk for regression and Bayesian compressive sensing to add to the existing Galerkin projection method. These methods receive an object containing the polynomial basis information and NumPy arrays of sample points, call c++ methods, and return the PCE coefficients in a NumPy array. To demonstrate these methods, I wrote a tutorial in which I use them to construct surrogates for Genz functions and calculate the resulting error.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Property Measurements of NaCl-UCl 3 and LiF-NaF-KF Molten Salts Doped with Surrogate Fission Products

Knowing thermophysical and thermochemical property values of salts over the expected range of operating temperatures is essential to modeling and simulation efforts that support the commercialization of molten salt reactor (MSR) technologies. Salt properties being measured at Argonne include thermal transitions, phase behavior, heat capacity, density, surface tension, volumetric thermal expansion, thermal diffusivity, thermal conductivity, and viscosity. The properties of several salts of interest including NaCl-UCl 3 and LiF-NaF-KF (FLiNaK) have been measured at Argonne and reported previously. These property measurements are suitable for use in evaluating reactor performance during startup and the early operating life of the reactor. The physical and chemical behavior of the fuel salt is altered by the buildup of fission products and the resulting changes in heat transfer and other properties must be understood by reactor developers. This report summarizes melting behavior, heat capacity, and thermal diffusivity values that were measured for mixtures of FLiNaK and NaCl-UCl 3 salts that have been doped with surrogate fission products. Additional heat capacity measurements were also performed on a separate mixture of FLiNaK without dopants. Measured properties are suitable for incorporation into the Molten Salt Thermal Properties Database–Thermochemical (MSTDB–TC) and the Molten Salt Thermal Properties Database–Thermophysical (MSTDB–TP) to support the development of MSRs. Salts were prepared by doping eutectic mixtures of NaCl-UCl 3 and FLiNaK with surrogate fission products. These salts were prepared for use in salt spill experiments being performed at Argonne and were subsequently used for thermal property measurements. Thermal transitions and heat capacities were measured by using differential scanning calorimetry (DSC) and thermal diffusivity was measured by using laser flash analysis (LFA) at temperatures spanning the typical MSR operating range. The measured property values of the doped salts were compared to measured property values of salts without fission products to quantify the effects of the doped fission products.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Mini-Canister Radiolysis Testing of ASNF Materials and Surrogates

An experimental irradiation campaign to investigate radiolysis behavior of ASNF was conducted using in situ gas monitoring of small, sealed stainless-steel vessels (mini-canisters) containing aluminum samples with adherent (oxy)hydroxide films under helium backfill. The samples were irradiated with gamma radiation from a Co-60 irradiator. The samples tested included aluminum plate assemblies with lab-grown (oxy)hydroxides as surrogates for fuel as well as an end cropping from an actual ASNF assembly retrieved from long-term wet storage. These experiments enabled investigation of the impacts of various fuel drying approaches on the radiolytic generation rate and measurement of the H 2 yield associated with a reactor exposed sample with reactor-formed (oxy)hydroxide. The resulting data can be incorporated into model development for ASNF in dry storage. This report presents the cumulative results from four surrogate assemblies tested after application of different preparation (drying) conditions as well as the ASNF cropping; some post-irradiation testing was included. The mini-canister results are compared to data from related experimental campaigns that also tested the impact of drying conditions using samples irradiated in glass ampoules and discusses implications of the combined data

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

wa-hls4ml: A Benchmark and Surrogate Models for hls4ml Resource and Latency Estimation

As machine learning (ML) is increasingly implemented in hardware to address real-time challenges in scientific applications, the development of advanced toolchains has significantly reduced the time required to iterate on various designs. These advancements have solved major obstacles, but also exposed new challenges. For example, processes that were not previously considered bottlenecks, such as hardware synthesis, are becoming limiting factors in the rapid iteration of designs. To mitigate these emerging constraints, multipleefforts have been undertaken to develop an ML-based surrogate model that estimates resource usage of synthesized ML accelerator architectures. We introduce wa-hls4ml, a benchmark for ML accelerator resource and latency estimation, and its corresponding initial dataset of over 680 000 fully connected and convolutional neural networks, all synthesized using hls4ml and targeting Xilinx FPGAs. The benchmark evaluates the performance of resource and latency predictors against several common ML model architectures, primarily originating from scientific domains, as exemplar models, and the average performance across a subset of the dataset. Additionally, we introduce GNN- and transformer-based surrogate models that predict latency and resources for ML accelerators. We present the architecture and performance of the models and find that the models generally predict latency and resources for the 75% percentile within several percent of the synthesized resources on the synthetic test dataset.

Hawks, Benjamin G. [Fermilab]↗
DOE OSTI2025

HOLISTIC CREDIBILITY ASSESSMENT OF A MACHINE LEARNING-BASED SURROGATE MODEL IN AN AERODYNAMICS APPLICATION

Elements of ASME V&V 20 credibility assessment methodology are used in tandem with credibility assessment tools from the machine learning community to assess the credibility of a deep neural network based surrogate model. This surrogate model is trained, tested, validated, and employed in the context of aerodynamic coefficient prediction for a NACA 0012 airfoil in subsonic and transonic flow. The parameter space is defined by angle of attack, Reynolds number, and Mach number.

Kirsch, Jared Roelof [Sandia National Laboratories↗
DOE OSTI2026

Bayesian Exploration and Surrogate Emulation of Nonlinear Beam-Response Geometry in the LBNF Beamline

Next-generation long-baseline neutrino experiments aim to achieve multi-MW proton beam power while reducing accelerator-induced systematic uncertainties. At Fermilab, the LBNF beamline is designed for 1.2 MW operation with PIP-II and is upgradeable to 2.4 MW. DUNE will probe the three-flavor neutrino paradigm and search for CP violation, requiring precise neutrino-flux normalization and improved control of accelerator-related uncertainties. Within the LBNF beamline, the System for On-Axis Neutrino Detection (SAND) will constrain flux uncertainties using precision near-detector measurements, while the Muon Monitor System (MuMS) will provide beamline diagnostics sensitive to the proton beam, target, and horn configuration. However, the pion phase space relevant for DUNE depends simultaneously on many correlated parameters, including beam centroid, beam width, horn current and alignment, target position, optics shifts, and radiation-induced changes. Consequently, MuMS observables exhibit nonlinear and coupled responses that are difficult to characterize using traditional one-parameter scans. To address this challenge, we are developing a Bayesian Exploration framework coupled to physics-informed surrogate emulators trained on Geant4 beamline simulations. Gaussian-process emulators provide both fast predictions and uncertainty estimates, enabling adaptive selection of new simulation points in beam-parameter space. As an initial demonstration, we construct surrogate emulators for MuMS response observables using a verified simulation campaign spanning proton-beam steering conditions. The emulators reproduce the simulated dependence of MuMS centroid and gradient observables while providing predictive uncertainties, and serve as the foundation for future multidimensional exploration including beam width, horn current, and additional beamline parameters. This work establishes a framework for uncertainty-aware beam monitoring, adaptive simulation campaigns, and rapid beam-response inference for future DUNE operations.

Ganguly, Sudeshna [Fermilab] (ORCID:00000003163482↗
DOE OSTI2025

Graph Neural Networks for Surrogate Modeling of Offshore Floating Platforms

Floating offshore wind turbines (FOWTs) present an significant opportunity to increase renewable energy generation. However, significant challenges remain before FOWTs can be widely commercialized and deployed. In particular, hydrodynamic loading on the platforms can stress the overall structure, damage the mooring systems, and impact power generation. Studying these loads is difficult and often relies on computationally expensive models or experiments. In this work, we explore the use of graph neural networks (GNNs) to construct flexible, data-driven surrogates for hydrodynamic loads on platforms. We leverage the natural graph-like structure of offshore wind platform designs to enable the GNN model to learn to approximate the loads for different wave conditions and structural designs. We demonstrate potential uses for the surrogate by performing parameter sweeps and ridge analysis on the trained model to identify the impacts of different wave and structural features on the loads.

floating offshore wind turbines↗
DOE OSTI2022

A Rapid Sintering Method for Cerium Nitride Pellet: A Uranium Mononitride Surrogate

Uranium mononitride (UN) is a candidate fuel material for light water reactors with higher uranium (U) loading and thermal conductivity than uranium dioxide (UO 2 ). However, the sintering of UN pellets is challenging as the UN powder particles oxidize rapidly at high temperatures unless the oxygen concentration is extremely low. Oxidation during sintering either reduces the relative density of the sintered UN pellet or disintegrates the sintered UN pellet to powder. To address this problem, the present work developed a rapid sintering method for producing highly densified UN surrogate pellets with minimal oxidation. Cerium nitride (CeN) is used as a surrogate for UN to reduce radiation hazards. With the custom-developed fast-heating system, the sintering process was completed within 150 s. The sintering atmosphere was flowing nitrogen (N 2 ). The sintered CeN pellet density was 95% of the theoretical density (TD) or higher. The microstructure was uniform with a 10–25 µm grain size as demonstrated by scanning electron microscopy (SEM) and contained trivial levels of oxides as demonstrated by X-ray diffraction (XRD). The resultant pellets indicate that the rapid sintering method is a promising method to make UN fuel pellets with equivalent or higher density to pellets made by conventional sintering methods, while also being more efficient in time and costs.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Optimization with Neural Network Feasibility Surrogates: Formulations and Application to Security-Constrained Optimal Power Flow

In many areas of constrained optimization, representing all possible constraints that give rise to an accurate feasible region can be difficult and computationally prohibitive for online use. Satisfying feasibility constraints becomes more challenging in high-dimensional, non-convex regimes which are common in engineering applications. A prominent example that is explored in the manuscript is the security-constrained optimal power flow (SCOPF) problem, which minimizes power generation costs, while enforcing system feasibility under contingency failures in the transmission network. In its full form, this problem has been modeled as a nonlinear two-stage stochastic programming problem. In this work, we propose a hybrid structure that incorporates and takes advantage of both a high-fidelity physical model and fast machine learning surrogates. Neural network (NN) models have been shown to classify highly non-linear functions and can be trained offline but require large training sets. In this work, we present how model-guided sampling can efficiently create datasets that are highly informative to a NN classifier for non-convex functions. We show how the resultant NN surrogates can be integrated into a non-linear program as smooth, continuous functions to simultaneously optimize the objective function and enforce feasibility using existing non-linear solvers. Overall, this allows us to optimize instances of the SCOPF problem with an order of magnitude CPU improvement over existing methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗