Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SURROGATE MODELS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

High-Level Model Articulation with BuildingSync and OpenStudio

The use of the BuildingSync schema for describing the contents of buildings is becoming more common with its recent integration into the Audit Template tool as well as ASHRAE’s Building Energy Quotient (bEQ) web portal. Although BuildingSync was initially created to store and transfer data related to building energy audits (as defined by ASHRAE Standard 211), it has since been expanded to store the data needed to articulate fully defined physics-based building energy models. BuildingSync combined with abstracted high-level input methods defined in OpenStudio’s Standards project and the newly developed BuildingSync gem allows BuildingSync eXtensible Markup Language (XML) (Bray, Paoli, Sperberg-McQueen, Maler, Eve (Sun Microsystems, & Francois, 2008) document to be converted into OpenStudio models. Automatic generation of a building energy model from data collected during an audit 1) eliminates the need to separately generate an energy model, 2) improves consistency between model generation, and 3) simplifies evaluation of various energy efficiency measures. This manuscript will discuss this open-source project, including: development of the validation infrastructure necessary to provide formalized expectations of informational requirements for BuildingSync documents; development of the BuildingSync gem for translation of BuildingSync documents to OpenStudio models as well as example implementations; and finally, the manuscript will elaborate on the advantages and disadvantages of using high-level models generated from BuildingSync as surrogates to detailed models.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2020

Optimal carbon storage reservoir management through deep reinforcement learning

Model-based optimization plays a central role in energy system design and management. The complexity and high-dimensionality of many process-level models, especially those used for geosystem energy exploration and utilization, often lead to formidable computational costs when the dimension of decision space is also large. This work adopts elements of recently advanced deep learning techniques to solve a sequential decision-making problem in applied geosystem management. Specifically, a deep reinforcement learning framework was formed for optimal multiperiod planning, in which a deep Q-learning network (DQN) agent was trained to maximize rewards by learning from high-dimensional inputs and from exploitation of its past experiences. To expedite computation, deep multitask learning was used to approximate high-dimensional, multistate transition functions. Both DQN and deep multitask learning are pattern based. As a demonstration, the framework was applied to optimal carbon sequestration reservoir planning using two different types of management strategies: monitoring only and brine extraction. Both strategies are designed to mitigate potential risks due to pressure buildup. Results show that the DQN agent can identify the optimal policies to maximize the reward for given risk and cost constraints. Finally, experiments also show that knowledge the agent gained from interacting with one environment is largely preserved when deploying the same agent in other similar environments.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Unified differentiable digital twin for the IOTA/FAST facility

As the design complexity of modern accelerators grows, there is more interest in using advanced simulations that have fast execution time or produce insights about accelerator state. One notable example of additional information are gradients of physical observables with respect to design parameters produced by differentiable simulations. The IOTA/FAST facility has recently begun a program to implement and experimentally validate a unified start-to-end differentiable digital twin to serve as a virtual accelerator test stand, allowing for rapid prototyping of new software and experiments with minimal beam time costs. In this contribution we will discuss our plans and progress. Specifically, we will cover the selection and benchmarking of both physics and ML codes, the development of generic interfaces between device models and surrogate or physics-based sections, and the export of the parameters through either a deterministic event loop or a fully asynchronous EPICS soft input/output controller. We will also discuss challenges in model calibration and uncertainty quantification, as well as future plans to support larger proton accelerators like PIPII and Booster.

Kuklev, Nikita [Fermilab]↗
DOE OSTI2023

Entropy-driven Optimal Sub-sampling of Fluid Dynamics for Developing Machine-learned Surrogates

Optimal sub-sampling of large datasets from fluid dynamics simulations is essential for training reduced-order machine learned models. A method using Shannon entropy was developed to weight flow features according to their level of information content, such that the most informative features can be extracted and used for training a surrogate model. The method is demonstrated in the canonical flow over a cylinder problem simulated with OpenFOAM. Both time-independent predictions and temporal forecasting were investigated as well as two types of prediction targets: local per-grid-point predictions and global per-time-step predictions. When tested on training a surrogate model, results indicate that our entropy-based sampling method typically outperforms random sampling and yields more reproducible results in less iterations. Finally, the method was used to train a surrogate model for modeling turbulence in magnetohydrodynamic flows, which revealed various challenges and opportunities for future research.

Brewer, Wes↗
DOE OSTI2023

Practical Multi-Cycle Refueling Simulation of Stable Salt Reactors Based on REBUS Depletion Calculation

A Python software tool ReloadPy has been developed to assistant in formulating online refueling strategies for a family of stable salt reactors. ReloadPy wraps over the legacy fast reactor analysis codes REBUS, DIF3D, and PERSENT. These codes are used to perform single cycle depletion analysis and calculate reactivity worth and power density. ReloadPy determines a refueling assembly position to achieve the user-specified primary objective while satisfying constraints on various performance parameters such as the maximum power density, the maximum reactivity worth of reloaded assembly, and the minimum cycle length. Various capabilities of prescribing refueling sequence or a range of candidate refueling positions and restarting a previous simulation with altered options are implemented to reduce the required user’s efforts to investigate different refueling strategies. This report presents the computational models and methods and also serves as a user guide. Long-term simulation capabilities with different refueling strategies are demonstrated by a series of sample SSR refueling calculations with two-dimensional surrogate core models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Graph-Based Modeling for the Detection and Tracking of Sarin-Surrogate-Induced Neurotoxicity Using a Human-Relevant, In-Vitro Brain Model

Organophosphorus (OP) nerve agents are a chemical threat to the United States, to the civilian population (e.g., pesticides) and historically weaponized (e.g., sarin) as chemical warfare agents. The unprecedented, accelerated process from “bench-to-bedside” during the SARSCov2 pandemic has made it clear that technology and tools need to be readily available for immediate response. Advances in human organ tissue mimetic systems are a promising technology to evaluate the human-relevant response in vitro for basic and applied research and drug screening. In particular, current brain microphysiological systems (MPS) have the capability to monitor and detect changes in engineered human neural circuit activity. However, current data analytics approaches for these systems lack the granularity to functionally detect and distinguish the different mechanisms that occur in the brain following neurotoxicity, injury, and disease. The goal of this project was to advance the computational analytical capabilities of the brain MPS to detect functional changes in neural circuit structure at different stages of Sarin surrogate-induced neurotoxicity. We developed graph-based models to (1) identify the composition of the neural circuit structure; (2) detect and monitor how this structure changes following sarin-induced neurotoxicity; and (3) evaluate the analytical pipeline using known/promising oxime reactivators. Through experiments on the bMPS where in vitro neuronal cultures were exposed to a sarin surrogate, we demonstrated the capabilities of our computational pipeline to identify different responses in the functional networks of brain cells exposed to low and high concentrations of the nerve agent. We identified a biphasic response of human neural network activity following exposure to a sarin-surrogate that had not been reported in the literature before. The graph-based models and software developed in this project can be used for future studies that leverage the brain MPS technology, such as treatment efficacy assessment.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Generalized Bayesian MARS: Tools for Stochastic Computer Model Emulation

The multivariate adaptive regression spline (MARS) approach of Friedman and its Bayesian counterpart are effective approaches for the emulation of computer models. The traditional assumption of Gaussian errors limits the usefulness of MARS, and many popular alternatives, when dealing with stochastic computer models. Here, we propose a generalized Bayesian MARS (GBMARS) framework which admits the broad class of generalized hyperbolic distributions as the induced likelihood function. This allows us to develop tools for the emulation of stochastic simulators which are parsimonious, scalable, and interpretable and require minimal tuning, while providing powerful predictive and uncertainty quantification capabilities. GBMARS is capable of robust regression with t distributions, quantile regression with asymmetric Laplace distributions, and a general form of “Normal-Wald” regression in which the shape of the error distribution and the structure of the mean function are learned simultaneously. We demonstrate the effectiveness of GBMARS on various stochastic computer models, and we show that it compares favorably to several popular alternatives.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Development of advanced machine learning models for analysis of plutonium surrogate optical emission spectra

This work investigates and applies machine learning paradigms seldom seen in analytical spectroscopy for quantification of gallium in cerium matrices via processing of laser-plasma spectra. Ensemble regressions, support vector machine regressions, Gaussian kernel regressions, and artificial neural network techniques are trained and tested on cerium-gallium pellet spectra. A thorough hyperparameter optimization experiment is conducted initially to determine the best design features for each model. The optimized models are evaluated for sensitivity and precision using the limit of detection (LoD) and root mean-squared error of prediction (RMSEP) metrics, respectively. Gaussian kernel regression yields the superlative predictive model with an RMSEP of 0.33% and an LoD of 0.015% for quantification of Ga in a Ce matrix. This study concludes that these machine learning methods could yield robust prediction models for rapid quality control analysis of plutonium alloys.

Rao, Ashwin P. (ORCID:0000000319312568)↗
DOE OSTI2023

Microstructure modeling of nuclear structural materials: Recent progress and future directions

Modeling and simulation of microstructures are essential to understand the complex responses and behaviors of nuclear materials in extreme environments. The needs to assess the extended life operation as well as the growing interest in accelerating nuclear materials development and qualification have stimulated the use of high-fidelity multiscale models aided by empirical and ab initio data. This paper reviews the role of various models across different length and time scales in investigating irradiation effects on microstructure evolution and degradation, in particular the embrittlement caused by radiation induced or enhanced formation of nanoscale chemical heterogeneities. The strength and limitations of these models, including classical rate theories, cluster dynamics, phase-field methods, and atomistic models informed by ab initio energies, are discussed with seminal examples. Challenges regarding the lack of thermo-kinetic data and theoretical treatments considering chemical complexities and magnetic excitations, as well as the stabilizing effect by excess point defects in nuclear structural materials are presented, along with potential solutions based on ab initio informed surrogate energy models and statistical sampling by Monte Carlo simulations. Further, the review then highlights the opportunities to leverage the advantages of different methods by establishing hybrid models by shared variables or coupled codes and applications. Finally, the review concludes with forward-looking remarks on how the use of physics-based models can aid the improvement of machine-learning models of property degradation and vice versa.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Machine Learned Empirical Numerical Integrator from Simulated Data

Recently, a number of state-of-the-art surrogate machine learning (ML) models have been designed for global weather and climate prediction, which have been trained using reanalysis data products. Reanalysis data products are constructed using numerical model simulations that combine numerical integration of partial differential equations and parameterization schemes. These products are typically only archived and made available using coarsened spatial and temporal resolutions. This study explores the impact of the numerical generation methods used to produce the training datasets and the temporal resolution of those datasets on machine learning surrogate models. Using the nonlinear vector autoregression (NVAR) machine as an explainable ML technique, simple dynamical systems are emulated with ML models trained on data produced by three classical numerical integration schemes. NVAR is validated as a skillful ML method, capable of producing accurate predictions and, more importantly, reconstructing both the underlying dynamics and the numerical integration scheme used to generate the training data. However, the machine fails to generalize predictions on unseen test data generated by different numerical integration schemes, despite the underlying dynamical system being the same. This result provides a word of caution for the growing field of machine learning emulation of weather and climate dynamics. Furthermore, we illustrate using NVAR that training on temporally coarsened data may increase the required complexity of ML models and potentially introduce new numerical challenges. Finally, we discover that empirical integration schemes with arbitrary time-stepping sizes can be constructed directly from the data, which implies a potential for the development of empirical numerical integration schemes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Flow Reactor Study and Kinetic Model Development of HEFA-SPK and its Surrogate

In this work, we formulate a two-component surrogate for HEFA-SPK, incorporating aromatic or cycloalkane components, and develop reduced kinetic models for the surrogates to be used in high-performance computing simulations. The HEFA-SPK surrogate was selected and optimized based on the fuel's physical and combustion properties, including ignition delay times and flame speeds. The resulting surrogate consists of 40% n-undecane and 60% 2-methylnonane. The surrogate was confirmed by flow reactor experiments for both the HEFA-SPK fuel and the suggested two-component surrogates, where excellent agreement was observed. To meet aromatic requirements, 1,2,4-trimethylbenzene (8%) was selected, and we determined that incorporating 30% propylcyclohexane into the HEFA-SPK will achieve a volume swell equivalent to 8% aromatics. The properties of the surrogates were measured, and a new reduced kinetic model was developed based on the semi-decoupling methodology, using a reduced CH4 chemistry from NUIG 1.0 as base chemistry. Kinetic models will be employed in combustor simulations to enable a comprehensive understanding of the effect of SAF fuel properties on aviation combustor performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A comparative study of machine learning models for predicting the state of reactive mixing

Mixing phenomena are important mechanisms controlling flow, species transport, and reaction processes in fluids and porous media. Accurate predictions of reactive mixing are critical for many Earth and environmental science problems such as contaminant fate and remediation, macroalgae growth, and plankton biomass evolution. Here, to investigate the evolution of mixing dynamics under different scenarios (e.g., anisotropy, fluctuating velocity fields), a finite-element-based numerical model was built to solve the fast, irreversible bimolecular reaction-diffusion equations to simulate a range of reactive-mixing scenarios. A total of 2,315 simulations were performed using different sets of model input parameters comprising various spatial scales of vortex structures in the velocity field, time-scales associated with velocity oscillations, the perturbation parameter for the vortex-based velocity, anisotropic dispersion contrast (i.e., ratio of longitudinal-to-transverse dispersion), and molecular diffusion. The outputs comprised concentration profiles of reactants and products. The inputs to and outputs from these simulations were concatenated into feature and label matrices, respectively, to train 20 different machine learning (ML) models intended to emulate system behavior. These 20 ML emulators, based on linear methods, Bayesian methods, ensemble learning methods, and multilayer perceptrons (MLPs), were trained to classify the state of mixing and predict three quantities of interest (QoIs) characterizing species production, decay (i.e., average concentration, square of average concentration), and degree of mixing (i.e., variances of species concentration). Unsurprisingly, linear classifiers and regressors failed to reproduce the QoIs; however, ensemble methods (classifiers and regressors) and the MLP model accurately classified the state of reactive mixing and the QoIs. Among ensemble methods, random forest and decision-tree-based AdaBoost faithfully predicted the QoIs. At run time, trained ML emulators produced results times faster than the finite-element simulations. Due to their low computational expense and high accuracy, ensemble and MLP models are excellent emulators for these numerical simulations and great utilities in uncertainty quantification exercises, which can require 1,000s of forward model runs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Monitoring water quality in the lower Kansas River using remote sensing

Abstract We demonstrate how to combine remote sensing data from satellite imagery (Sentinel‐2) with in situ water quality gauging (USGS Super Gages and the Gybe hyperspectral radiometer) to create spatially dense maps of water quality parameters (chlorophyll‐a concentration, turbidity, and nitrate plus nitrite concentration) along the lower Kansas River. The water quality maps are created using locally tuned models of the target water quality parameters, and this study describes the steps used to design, calibrate, and validate the empirical correlations. Water quality parameters such as chlorophyll‐a concentration are correlated with well‐studied absorption and scattering features in the visible spectrum (roughly 400–700 nm). Nutrients (such as nitrate plus nitrite concentration) lack strong absorption features in the visible spectrum, and in those cases we describe a novel surrogate data modeling approach that identifies overlapping water parcels between the in situ gauging and the remote sensing imagery. Measurements from the overlapping water parcels yield excellent correlations () for the target water quality parameters for limited windows of time (or limited sections of river reaches). Examples are provided illustrating how the water quality maps can be used to track river inputs from ungauged sources (such as creeks), or reveal the mixing patterns at the confluences.

Tufillaro, Nicholas↗
DOE OSTI2025

Machine-Learning-Based Multiscale Methods for 3D Modelling of Granular Materials by Incorporating History-Dependent State Variables

Over the past decades, the prevalence of machine learning (ML) methods has made the development of ML-based constitutive models for granular materials undoubtedly a popular subject. Numerous studies have been made to feature the loading path or history-dependent stress-strain response of granular media using neural networks. In this work, a novel finite element method (FEM)–ML multiscale approach was developed by incorporating internal variables to improve the simulation accuracy of 3D history-dependent granular materials for the first time. To this end, a surrogate constitutive model based on the single-step-based multi-layer perceptron (MLP) neural network was used to replace representative volume element (RVE) simulations conducted by the discrete element method (DEM) in the multiscale FEM–DEM approach. Although the prediction principle of the MLP aligns with the FEM algorithm, artificially added internal variables are required to differentiate the loading history. To address this issue, history variables associated with the Frobenius norm are proposed to be fed into the MLP coupled with the strain tensor to extract the history-dependent behaviour of granular assemblies. The developed FEM–ML approach was demonstrated in 3D conventional triaxial compression (CTC) simulations. Compared to the multiscale FEM–DEM approach, the proposed FEM–ML method exhibits a significantly improved computational efficiency.

granular materials↗
DOE OSTI2025

Integrating Analytical Solutions and U-Net Model for Predicting Groundwater Contaminant Plumes in Pump-and-Treat Systems

Pump-and-treat (P&T) is a common technique for groundwater remediation involving the extraction and treatment of contaminated water above ground. Optimizing the design and operation of the P&T well network is essential for maximizing the system’s effectiveness and efficiency. However, this optimization often necessitates many model evaluations, leading to computationally demanding tasks. This study introduces a novel approach that integrates analytical solutions for groundwater dynamics with the U-Net (Ronneberger et al., 2015) deep learning framework to predict groundwater contaminant plume migration under dynamic pumping conditions. By incorporating the Thiem equation (Thiem, 1906) into the input preprocessing, the U-Net model transforms sparse well data into a continuous spatial field that captures the hydraulic impacts of pumping activities. This integration enables the model to leverage both deep learning capabilities and classical physics-based groundwater theories, enhancing prediction accuracy and computational efficiency. These advancements can facilitate rapid, large-scale evaluations of P&T optimization simulations, allowing for timely and effective decision-making in well placement and system management. We demonstrate the model's robust performance across both simplified transient 2D models and a more complex 3D heterogeneous site model at the 200 West P&T facility at the Hanford Site. The U-Net-based model offers substantial computational advantages, reducing simulation times significantly compared to full physics-based models and providing a powerful tool for rapid site evaluation and P&T system optimization, such as evaluating alternative P&T well network designs. Our findings highlight the potential of advanced machine learning models to significantly enhance the efficiency and sustainability of groundwater remediation efforts, offering a novel application of U-Net architecture in environmental science.

Pump-and-treat↗
DOE OSTI2021

Deterministic symbolic regression with derivative information: General methodology and application to equations of state

Symbolic regression methods simultaneously determine the model functional form and the regression parameter values by generating expression trees. Symbolic regression can capture the complexity of real–world phenomena but the use of deterministic optimization for symbolic regression has been limited due to the complexity of the search space of existing formulations. Herein we present a novel deterministic mixed–integer nonlinear programming formulation for symbolic regression that incorporates derivative constraints through auxiliary expression trees. By applying the chain rule to mathematical operations, binary expression trees are capable of representing the calculation of first and second derivatives. We apply this formulation to illustrative examples using derivative information to show increased model discrimination capability. In addition, we perform a case study of a thermodynamic equation of state to gain insight on valid functional forms with thermodynamics–based constraints on the first and second derivatives.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Coarse Graining Discrete Element Method Information in Particle-in-Cell Length Scales Using a Machine Learning Approach

This report details the development of a machine learning (ML)-driven framework to coarse-grain inter-particle collision dynamics from high-fidelity Discrete Element Method (DEM) simulations to Particle-in-Cell (PIC) scales for gas-solid systems. Traditional PIC models, while computationally efficient, rely on empirical granular stress formulations that fail to capture the full complexity of collision physics, particularly the heterogeneity in particle dynamics. This study adopts a bottom-up approach, integrating insights from DEM simulations to improve the physical fidelity and interpretability of PIC-scale models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗