Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Solving multiphysics-based inverse problems with learned surrogates and constraints

Abstract Solving multiphysics-based inverse problems for geological carbon storage monitoring can be challenging when multimodal time-lapse data are expensive to collect and costly to simulate numerically. We overcome these challenges by combining computationally cheap learned surrogates with learned constraints. Not only does this combination lead to vastly improved inversions for the important fluid-flow property, permeability, it also provides a natural platform for inverting multimodal data including well measurements and active-source time-lapse seismic data. By adding a learned constraint, we arrive at a computationally feasible inversion approach that remains accurate. This is accomplished by including a trained deep neural network, known as a normalizing flow, which forces the model iterates to remain in-distribution, thereby safeguarding the accuracy of trained Fourier neural operators that act as surrogates for the computationally expensive multiphase flow simulations involving partial differential equation solves. By means of carefully selected experiments, centered around the problem of geological carbon storage, we demonstrate the efficacy of the proposed constrained optimization method on two different data modalities, namely time-lapse well and time-lapse seismic data. While permeability inversions from both these two modalities have their pluses and minuses, their joint inversion benefits from either, yielding valuable superior permeability inversions and CO 2 plume predictions near, and far away, from the monitoring wells.

Yin, Ziyi (ORCID:0000000250248771)↗
DOE OSTI2025

Prediction of cccDNA dynamics in hepatitis B patients by a combination of serum surrogate markers

Quantification of intrahepatic covalently closed circular DNA (cccDNA) is a key for evaluating an elimination of hepatitis B virus (HBV) in infected patients. However, quantifying cccDNA requires invasive methods such as a liver biopsy, which makes it impractical to access the dynamics of cccDNA in patients. Although HBV RNA and HBV core-related antigens (HBcrAg) have been proposed as surrogate markers for evaluating cccDNA activity, they do not necessarily estimate the amount of cccDNA. Here, we employed a recently developed multiscale mathematical model describing intra- and intercellular viral propagation and applied it in HBV-infected patients under treatment. We developed a model that can predict intracellular HBV dynamics by use of extracellular viral markers, including HBsAg, HBV DNA, and HBcrAg in peripheral blood. Importantly, the model prediction of the amount of cccDNA in patients over time was confirmed to be well correlated with the data for quantified cccDNA by paired liver biopsy. Thus, our method combining classic and emerging surrogate markers enables us to predict the decay dynamics of cccDNA in patients undergoing treatment.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Fiats: Functional inference and training for surrogates

Fiats provides a platform for research on the training and deployment of neural-network surrogate models for computational science. Fiats also supports exploring, advancing, and combining functional, object-oriented, and parallel programming patterns in Fortran 2023. As such, the Fiats name has dual expansions: “Functional Inference And Training for Surrogates” or “Fortran Inference And Training for Science.” Fiats inference and training procedures are pure and therefore satisfy a language constraint imposed on procedure invocations inside Fortran’s parallel loop construct: do concurrent. Furthermore, the Fiats training procedures are built around a do concurrent parallel reduction. Several compilers can automatically parallelize do concurrent on Central Processing Units (CPUs) or Graphics Processing Units (GPUs). Fiats thus aims to achieve performance portability through standard language mechanisms.

Rouson, Damian [Lawrence Berkeley National Laborat↗
DOE OSTI2024

A manifold learning perspective on surrogate modeling of nitrate concentration in the Kansas River

Abstract A non-linear surrogate model of nitrate concentration in the Kansas River (USA) is described. The model is an (almost) Piece-wise Linear response surface that provides a mean field approximation to the dynamics of the measured data for nitrate plus nitrite (target product) correlations to turbidity and chlorophyll-a concentrations (input variables). The method extends the United States Geological Survey’s linear procedures for surrogate data modeling allowing for better approximations for river systems exhibiting algal blooms due to nutrient-rich source waters. The model and visualization procedures illustrated in the Kansas River example should be generally applicable to many medium-size rivers in agricultural regions.

Tufillaro, Nicholas (ORCID:0009000628968832)↗
DOE OSTI2020

Detection and Perception of Sound by Eagles and Surrogate Raptors

One overarching objective of this program of study was the accumulation of objective, scientifically valid information relating to auditory performance of bald and golden eagles that may be used to guide the development of acoustic alerting/deterrence technologies intended to discourage encroachment into wind energy air spaces. To that end, analyses aimed at the characterization of sensitivity to sound in bald and golden eagles, along with findings in the supra-threshold, dynamic frequency spaces related to response latencies and amplitudes, leads us to conclude that bald, and golden eagles navigate the same basic working auditory space, as in other known and thus far characterized members of the diurnal raptor family. Specifically, bald and golden eagles, along with other raptor species within the group, operate in an auditory space characterized by a frequency band at least four octaves wide and centered on 2 kHz, with an upper frequency limit between 6 and 10 kHz at 80 dB SPL and a lower frequency limit that almost certainly extends below 0.2 kHz. Consequently, we recommend that signal designers use these data as a guideline in efforts to design effective and efficient acoustic alerting/deterrent systems. It is important to note that signal energy broadcast outside of this frequency band at moderate levels will not contribute to the efficacy of a deterrent but will add an unnecessary fraction to the overall acoustic pollution budget. The importance of this consideration is heightened by contemporaneous concerns related to the transmission of noise broadcast by wind energy farms. In addition, based on analyses of data acquired from red-tailed hawks using the same experimental paradigm and data acquisition system, we conclude that auditory function in the red-tailed hawk is sufficiently like that observed in bald and golden eagles to permit its use as a surrogate species. Response waveforms, threshold-frequency curves, and input-output characteristics match those of eagles closely. It should be noted however, that differences in sensitivity and slightly extended high-frequency limits of hearing should be taken into account when extrapolating findings from one species to the others. Although the inclusion of behavioral tests of red-tailed hawks to acoustic stimuli was beyond the scope of this investigation, future efforts to assess response parameters like signal-type preference and habituation rate will further elucidate their suitability to serve as eagle surrogates in behavioral studies; nonetheless, the species in question are well matched with respect to basic auditory performance. A second essential objective of this program of study was the acoustic characterization of a subset of calls comprising the vocal repertoires of bald and golden eagles that may be used to supplement auditory performance findings in the effort to guide the development of acoustic alerting signals. With regard to that objective, the vocal repertoires of both bald and golden eagle species are rich and varied. While similar in spectrographic structure, distinctive differences are also clear. Generally, golden eagles produce some calls with shorter durations, and similar “sounding” calls exhibit distinctively different spectrographic patterns than those of bald eagles. Both species produce calls that contain a wide variety of nonlinear elements that operate to enhance the rich and varied nature of commonly observed vocal products. Comparison of the average power spectra of commonly observed bald and golden eagle calls with threshold-frequency curves leads to the conclusion that call energies fall within the frequency bounds of hearing. Further, the acoustic energy of calls considered in this report tend to fall into overlapping, but different frequency ranges of the acoustic sensitivity curve. This condition may encourage signal designers to vary the frequency content of acoustic deterrence signals in the field. Finally, preliminary observations relating to the tendencies and proclivities of bald eagles to attend to the acoustic landscape lead to the conclusion that eagles monitor their immediate sound environment assiduously. Individuals respond to a variety of natural and synthetic sound signals reliably and, perhaps most relevant in the context of the engineering of acoustic alerting/deterrence technologies, habituation to most sounds considered in this effort was minimal. These preliminary results, while calling for extended behavioral testing, are promising and set the stage for the exportation of behavioral studies into real world scenarios.

17 WIND ENERGY↗
DOE OSTI2022

Development of the uncertainty quantification toolkit's python interface and surrogate construction tutorial

The uncertainty quantification toolkit (UQTk) is a collection of c++ libraries that assess the confidence of numerical models. Surrogate approximations, often polynomial chaos expansions (PCEs), lessen the computational cost of these assessments. I developed a Python interface in UQTk for regression and Bayesian compressive sensing to add to the existing Galerkin projection method. These methods receive an object containing the polynomial basis information and NumPy arrays of sample points, call c++ methods, and return the PCE coefficients in a NumPy array. To demonstrate these methods, I wrote a tutorial in which I use them to construct surrogates for Genz functions and calculate the resulting error.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Property Measurements of NaCl-UCl 3 and LiF-NaF-KF Molten Salts Doped with Surrogate Fission Products

Knowing thermophysical and thermochemical property values of salts over the expected range of operating temperatures is essential to modeling and simulation efforts that support the commercialization of molten salt reactor (MSR) technologies. Salt properties being measured at Argonne include thermal transitions, phase behavior, heat capacity, density, surface tension, volumetric thermal expansion, thermal diffusivity, thermal conductivity, and viscosity. The properties of several salts of interest including NaCl-UCl 3 and LiF-NaF-KF (FLiNaK) have been measured at Argonne and reported previously. These property measurements are suitable for use in evaluating reactor performance during startup and the early operating life of the reactor. The physical and chemical behavior of the fuel salt is altered by the buildup of fission products and the resulting changes in heat transfer and other properties must be understood by reactor developers. This report summarizes melting behavior, heat capacity, and thermal diffusivity values that were measured for mixtures of FLiNaK and NaCl-UCl 3 salts that have been doped with surrogate fission products. Additional heat capacity measurements were also performed on a separate mixture of FLiNaK without dopants. Measured properties are suitable for incorporation into the Molten Salt Thermal Properties Database–Thermochemical (MSTDB–TC) and the Molten Salt Thermal Properties Database–Thermophysical (MSTDB–TP) to support the development of MSRs. Salts were prepared by doping eutectic mixtures of NaCl-UCl 3 and FLiNaK with surrogate fission products. These salts were prepared for use in salt spill experiments being performed at Argonne and were subsequently used for thermal property measurements. Thermal transitions and heat capacities were measured by using differential scanning calorimetry (DSC) and thermal diffusivity was measured by using laser flash analysis (LFA) at temperatures spanning the typical MSR operating range. The measured property values of the doped salts were compared to measured property values of salts without fission products to quantify the effects of the doped fission products.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Mini-Canister Radiolysis Testing of ASNF Materials and Surrogates

An experimental irradiation campaign to investigate radiolysis behavior of ASNF was conducted using in situ gas monitoring of small, sealed stainless-steel vessels (mini-canisters) containing aluminum samples with adherent (oxy)hydroxide films under helium backfill. The samples were irradiated with gamma radiation from a Co-60 irradiator. The samples tested included aluminum plate assemblies with lab-grown (oxy)hydroxides as surrogates for fuel as well as an end cropping from an actual ASNF assembly retrieved from long-term wet storage. These experiments enabled investigation of the impacts of various fuel drying approaches on the radiolytic generation rate and measurement of the H 2 yield associated with a reactor exposed sample with reactor-formed (oxy)hydroxide. The resulting data can be incorporated into model development for ASNF in dry storage. This report presents the cumulative results from four surrogate assemblies tested after application of different preparation (drying) conditions as well as the ASNF cropping; some post-irradiation testing was included. The mini-canister results are compared to data from related experimental campaigns that also tested the impact of drying conditions using samples irradiated in glass ampoules and discusses implications of the combined data

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

wa-hls4ml: A Benchmark and Surrogate Models for hls4ml Resource and Latency Estimation

As machine learning (ML) is increasingly implemented in hardware to address real-time challenges in scientific applications, the development of advanced toolchains has significantly reduced the time required to iterate on various designs. These advancements have solved major obstacles, but also exposed new challenges. For example, processes that were not previously considered bottlenecks, such as hardware synthesis, are becoming limiting factors in the rapid iteration of designs. To mitigate these emerging constraints, multipleefforts have been undertaken to develop an ML-based surrogate model that estimates resource usage of synthesized ML accelerator architectures. We introduce wa-hls4ml, a benchmark for ML accelerator resource and latency estimation, and its corresponding initial dataset of over 680 000 fully connected and convolutional neural networks, all synthesized using hls4ml and targeting Xilinx FPGAs. The benchmark evaluates the performance of resource and latency predictors against several common ML model architectures, primarily originating from scientific domains, as exemplar models, and the average performance across a subset of the dataset. Additionally, we introduce GNN- and transformer-based surrogate models that predict latency and resources for ML accelerators. We present the architecture and performance of the models and find that the models generally predict latency and resources for the 75% percentile within several percent of the synthesized resources on the synthetic test dataset.

Hawks, Benjamin G. [Fermilab]↗
DOE OSTI2025

HOLISTIC CREDIBILITY ASSESSMENT OF A MACHINE LEARNING-BASED SURROGATE MODEL IN AN AERODYNAMICS APPLICATION

Elements of ASME V&V 20 credibility assessment methodology are used in tandem with credibility assessment tools from the machine learning community to assess the credibility of a deep neural network based surrogate model. This surrogate model is trained, tested, validated, and employed in the context of aerodynamic coefficient prediction for a NACA 0012 airfoil in subsonic and transonic flow. The parameter space is defined by angle of attack, Reynolds number, and Mach number.

Kirsch, Jared Roelof [Sandia National Laboratories↗
DOE OSTI2026

Bayesian Exploration and Surrogate Emulation of Nonlinear Beam-Response Geometry in the LBNF Beamline

Next-generation long-baseline neutrino experiments aim to achieve multi-MW proton beam power while reducing accelerator-induced systematic uncertainties. At Fermilab, the LBNF beamline is designed for 1.2 MW operation with PIP-II and is upgradeable to 2.4 MW. DUNE will probe the three-flavor neutrino paradigm and search for CP violation, requiring precise neutrino-flux normalization and improved control of accelerator-related uncertainties. Within the LBNF beamline, the System for On-Axis Neutrino Detection (SAND) will constrain flux uncertainties using precision near-detector measurements, while the Muon Monitor System (MuMS) will provide beamline diagnostics sensitive to the proton beam, target, and horn configuration. However, the pion phase space relevant for DUNE depends simultaneously on many correlated parameters, including beam centroid, beam width, horn current and alignment, target position, optics shifts, and radiation-induced changes. Consequently, MuMS observables exhibit nonlinear and coupled responses that are difficult to characterize using traditional one-parameter scans. To address this challenge, we are developing a Bayesian Exploration framework coupled to physics-informed surrogate emulators trained on Geant4 beamline simulations. Gaussian-process emulators provide both fast predictions and uncertainty estimates, enabling adaptive selection of new simulation points in beam-parameter space. As an initial demonstration, we construct surrogate emulators for MuMS response observables using a verified simulation campaign spanning proton-beam steering conditions. The emulators reproduce the simulated dependence of MuMS centroid and gradient observables while providing predictive uncertainties, and serve as the foundation for future multidimensional exploration including beam width, horn current, and additional beamline parameters. This work establishes a framework for uncertainty-aware beam monitoring, adaptive simulation campaigns, and rapid beam-response inference for future DUNE operations.

Ganguly, Sudeshna [Fermilab] (ORCID:00000003163482↗
DOE OSTI2025

Graph Neural Networks for Surrogate Modeling of Offshore Floating Platforms

Floating offshore wind turbines (FOWTs) present an significant opportunity to increase renewable energy generation. However, significant challenges remain before FOWTs can be widely commercialized and deployed. In particular, hydrodynamic loading on the platforms can stress the overall structure, damage the mooring systems, and impact power generation. Studying these loads is difficult and often relies on computationally expensive models or experiments. In this work, we explore the use of graph neural networks (GNNs) to construct flexible, data-driven surrogates for hydrodynamic loads on platforms. We leverage the natural graph-like structure of offshore wind platform designs to enable the GNN model to learn to approximate the loads for different wave conditions and structural designs. We demonstrate potential uses for the surrogate by performing parameter sweeps and ridge analysis on the trained model to identify the impacts of different wave and structural features on the loads.

floating offshore wind turbines↗
DOE OSTI2022

A Rapid Sintering Method for Cerium Nitride Pellet: A Uranium Mononitride Surrogate

Uranium mononitride (UN) is a candidate fuel material for light water reactors with higher uranium (U) loading and thermal conductivity than uranium dioxide (UO 2 ). However, the sintering of UN pellets is challenging as the UN powder particles oxidize rapidly at high temperatures unless the oxygen concentration is extremely low. Oxidation during sintering either reduces the relative density of the sintered UN pellet or disintegrates the sintered UN pellet to powder. To address this problem, the present work developed a rapid sintering method for producing highly densified UN surrogate pellets with minimal oxidation. Cerium nitride (CeN) is used as a surrogate for UN to reduce radiation hazards. With the custom-developed fast-heating system, the sintering process was completed within 150 s. The sintering atmosphere was flowing nitrogen (N 2 ). The sintered CeN pellet density was 95% of the theoretical density (TD) or higher. The microstructure was uniform with a 10–25 µm grain size as demonstrated by scanning electron microscopy (SEM) and contained trivial levels of oxides as demonstrated by X-ray diffraction (XRD). The resultant pellets indicate that the rapid sintering method is a promising method to make UN fuel pellets with equivalent or higher density to pellets made by conventional sintering methods, while also being more efficient in time and costs.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Optimization with Neural Network Feasibility Surrogates: Formulations and Application to Security-Constrained Optimal Power Flow

In many areas of constrained optimization, representing all possible constraints that give rise to an accurate feasible region can be difficult and computationally prohibitive for online use. Satisfying feasibility constraints becomes more challenging in high-dimensional, non-convex regimes which are common in engineering applications. A prominent example that is explored in the manuscript is the security-constrained optimal power flow (SCOPF) problem, which minimizes power generation costs, while enforcing system feasibility under contingency failures in the transmission network. In its full form, this problem has been modeled as a nonlinear two-stage stochastic programming problem. In this work, we propose a hybrid structure that incorporates and takes advantage of both a high-fidelity physical model and fast machine learning surrogates. Neural network (NN) models have been shown to classify highly non-linear functions and can be trained offline but require large training sets. In this work, we present how model-guided sampling can efficiently create datasets that are highly informative to a NN classifier for non-convex functions. We show how the resultant NN surrogates can be integrated into a non-linear program as smooth, continuous functions to simultaneously optimize the objective function and enforce feasibility using existing non-linear solvers. Overall, this allows us to optimize instances of the SCOPF problem with an order of magnitude CPU improvement over existing methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Heterogeneous oxidation of amorphous organic aerosol surrogates by O 3 , NO 3 , and OH at typical tropospheric temperatures

Typical tropospheric temperatures render possible phase states of amorphous organic aerosol (OA) particles of solid, semisolid, and liquid. This will affect the multiphase oxidation kinetics involving the organic condensed-phase and gaseous oxidants and radicals. To quantify this effect, we determined the reactive uptake coefficients (γ) of O 3 , NO 3 , and OH by substrate films composed of single and binary OA surrogate species under dry conditions for temperatures from 213 to 313 K. A temperature-controlled coated-wall flow reactor coupled to a chemical ionization mass spectrometer was applied to determine γ with consideration of gas diffusion transport limitation and gas flow entrance effects, which can impact heterogeneous reaction kinetics. The phase state of the organic substrates was probed via the poke-flow technique, allowing the estimation of the substrates' glass transition temperatures. γ values for O 3 and OH uptake to a canola oil substrate, NO 3 uptake to a levoglucosan and a levoglucosan / xylitol substrate, and OH uptake to a glucose and glucose / 1,2,6-hexanetriol substrate have been determined as a function of temperature. We observed the greatest changes in γ with temperature for substrates that experienced the largest changes in viscosity as a result of a solid-to-liquid phase transition. Organic substrates that maintain a semisolid or solid phase state and as such a relatively higher viscosity do not display large variations in heterogeneous reactivity. From 213 to 293 K, γ values of O 3 with canola oil, of NO 3 with a levoglucosan / xylitol mixture, and of OH with a glucose / 1,2,6-hexanetriol mixture and canola oil, increase by about a factor of 34, 3, 2, and 5, respectively, due to a solid-to-liquid phase transition of the substrate. These results demonstrate that the surface and bulk lifetime of the OA surrogate species can significantly increase due to the slowed heterogeneous kinetics when OA species are solid or highly viscous in the middle and upper troposphere. This experimental study will further our understanding of the chemical evolution of OA particles with subsequent important consequences for source apportionment, air quality, and climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Building a machine learning surrogate model for wildfire activities within a global Earth system model

Abstract. Wildfire is an important ecosystem process, influencing land biogeophysical and biogeochemical dynamics and atmospheric composition. Fire-driven loss of vegetation cover, for example, directly modifies the surface energy budget as a consequence of changing albedo, surface roughness, and partitioning of sensible and latent heat fluxes. Carbon dioxide and methane emitted by fires contribute to a positive atmospheric forcing, whereas emissions of carbonaceous aerosols may contribute to surface cooling. Process-based modeling of wildfires in Earth system land models is challenging due to limited understanding of human, climate, and ecosystem controls on fire counts, fire size, and burned area. Integration of mechanistic wildfire models within Earth system models requires careful parameter calibration, which is computationally expensive and subject to equifinality. To explore alternative approaches, we present a deep neural network (DNN) scheme that surrogates the process-based wildfire model with the Energy Exascale Earth System Model (E3SM) interface. The DNN wildfire model accurately simulates observed burned area with over 90 % higher accuracy with a large reduction in parameterization time compared with the current process-based wildfire model. The surrogate wildfire model successfully captured the observed monthly regional burned area during validation period 2011 to 2015 (coefficient of determination, R2=0.93). Since the DNN wildfire model has the same input and output requirements as the E3SM process-based wildfire model, our results demonstrate the applicability of machine learning for high accuracy and efficient large-scale land model development and predictions.

58 GEOSCIENCES↗
DOE OSTI2025

Transfer learning of neural surrogates on multifidelity groundwater simulations

Multifidelity data used in the paper published in Advances in Water Resources 206 (2025) 105140, https://doi.org/10.1016/j.advwatres.2025.105140 The code used to process the data is openly available on GitHub at https://github.com/Model-Reduction-and-UQ-Group/Transfer_Learning_K_reconstruction Computationally inexpensive surrogates of process-based models, such as deep neural networks, enable ensemble-based computations used in risk assessment, data assimilation, etc. However, generation of large datasets required to train a neural network can be as expensive as the ensemble simulations themselves. We ameliorate this challenge by using data from multifidelity (MF) groundwater simulations and transfer learning (TL) to reduce data generation costs while maintaining model accuracy. As a computational example, we train a deep convolutional neural network (CNN) to reconstruct permeability fields from saturation maps derived from a multiphase flow model. Starting with very low- and low-fidelity data generated on increasingly coarse meshes, we pretrain the CNN, followed by output-layer training and fine-tuning using only a limited number of high-fidelity samples. We demonstrate the surrogate’s robustness when interpreting low-quality inputs—such as interpolated maps or data affected by noise—which has strong implications for the applicability in practical hydrogeological scenarios. This multilevel MF-TL strategy achieves a favorable trade-off between computational efficiency and predictive accuracy, significantly outperforming high-fidelity-only approaches under the same computational budget.

Chiofalo, Alessia [University of Bologna] (ORCID:0↗
DOE OSTI2022

New directions for surrogate models and differentiable programming for High Energy Physics detector simulation

The computational cost for high energy physics detector simulation in future experimental facilities is going to exceed the current available resources. To overcome this challenge, new ideas on surrogate models using machine learning methods are being explored to replace computationally expensive components. Additionally, differentiable programming has been proposed as a complementary approach, providing controllable and scalable simulation routines. In this document, new and ongoing efforts for surrogate models and differential programming applied to detector simulation are discussed in the context of the 2021 Particle Physics Community Planning Exercise (`Snowmass').

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗