Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SURROGATE MODELS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Simulating the CMS High Granularity Calorimeter with ML

Detector simulation is a key component of physics analysis and related activities in CMS. In the upcoming High Luminosity LHC era, simulation will be required to use a smaller fraction of computing in order to satisfy resource constraints. At the same time, CMS will be upgraded with the new High Granularity Calorimeter (HGCal), which requires significantly more resources to simulate than the existing CMS calorimeters. This computing challenge motivates the use of generative machine learning models as surrogates to replace full physics-based simulation. We study the application of state-of-the-art diffusion models to simulate particle showers in the CMS HGCal. We will discuss methods to overcome the challenges posed by the high-dimensional, irregular geometry of the HGCal. The quality of the showers produced by the diffusion model will be assessed by comparison to the full GEANT4-based simulation. The increase in simulation throughput will be quantified and methods to accelerate the diffusion model inference will also be discussed.

Amram, Oz↗
DOE OSTI2023

AI-accelerated protein-ligand docking for SARS-CoV-2 is 100-fold faster with no significant change in detection

Protein-ligand docking is a computational method for identifying drug leads. The method is capable of narrowing a vast library of compounds down to a tractable size for downstream simulation or experimental testing and is widely used in drug discovery. While there has been progress in accelerating scoring of compounds with artificial intelligence, few works have bridged these successes back to the virtual screening community in terms of utility and forward-looking development. We demonstrate the power of high-speed ML models by scoring 1 billion molecules in under a day (50 k predictions per GPU seconds). We showcase a workflow for docking utilizing surrogate AI-based models as a pre-filter to a standard docking workflow. Our workflow is ten times faster at screening a library of compounds than the standard technique, with an error rate less than 0.01% of detecting the underlying best scoring 0.1% of compounds. Our analysis of the speedup explains that another order of magnitude speedup must come from model accuracy rather than computing speed. In order to drive another order of magnitude of acceleration, we share a benchmark dataset consisting of 200 million 3D complex structures and 2D structure scores across a consistent set of 13 million “in-stock” molecules over 15 receptors, or binding sites, across the SARS-CoV-2 proteome. We believe this is strong evidence for the community to begin focusing on improving the accuracy of surrogate models to improve the ability to screen massive compound libraries 100 × or even 1000 × faster than current techniques and reduce missing top hits. The technique outlined aims to be a fast drop-in replacement for docking for screening billion-scale molecular libraries.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Model-form Error Correction using Universal Differential Equations for an Agent-Based Model of Infectious Disease

This report demonstrates universal differential equations (UDEs) as an approach to bridge the gap between ordinary differential equations (ODE) models and agent-based models (ABMs). Using UDE models as surrogates for ABMs allows us to preserve the foundational ODE that represents global disease dynamics while coupling it with a neural network model to approximate functions for the local behaviors of the ABM.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

A Phenomenological Model for Cavitation

A phenomenological model of cavitation is presented, based on observations that both large relative negative pressures and large negative time derivatives of pressure are required for cavitation onset. We simulated two cavitation experiments to generate cavitation scaling parameters for relative pressure drop and rate of pressure drop. Our results show the model, while simple, is effective at reproducing results from laboratory experiments of cavitation. The parameters were then used in conjunction with a human surrogate computational model to predict, at any position within the head, the probability of intracranial cavitation caused by exposure to a blast event. The results suggest that the magnitude of blast overpressure observed in field data is sufficient to cause intracranial cavitation. Our analysis indicates that the helmeted head, when compared to the unhelmeted head configuration, results in a decrease but not elimination of cavitation exposure. When density functions of cavitation probability versus cumulative brain volume are combined with an injury severity model, the results show helmet efficacy at low and moderate risk levels. However, the convergence of unhelmeted and helmeted probability density functions at high-to-excessive risk thresholds indicates the helmet offers diminishing protection at elevated exposure levels, relative to the unhelmeted baseline. Future investigation and collaboration with neuroscience subject matter experts are needed to contextualize the current computational results. While the present work contributes specific and quantified predictions of intracranial cavitation location and severity, more research is required to apply our results to clinical settings with population-based brain injury subjects and controls. The relationship between our intracranial cavitation predictions with their anticipated clinical sequelae remains a topic in need of exploration.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Optimization of Operating Profit for the FEED of the PZAS Process for CO 2 Capture on a 460 MW NGCC

A rating model of PZAS (Piperazine with the Advanced Stripper) for a 460 MW natural gas combined cycle was developed from vendor-provided equipment performance data. Surrogate rating models were built and used to optimize variable profit of the system subject to natural gas and electricity price at a fixed value for CO 2 of $\$80$/tonne. Several process constraints were considered between ambient temperatures of 4.4 and 40.5 °C. Lower lean loading resulted in lower reboiler heat duty of about 2.2 GJ/tonne. Lean loading at 0.2 mol/equiv N was sufficient at an ambient temperature of 4.4 °C to maximize variable profit. Solvent precipitation was avoided even at low lean loading (0.18 mol/mol) in the absence of a trim cooler for the lean solvent between the absorber and the cold cross exchanger. Optimal CO 2 removal was always higher than the design case removal of 90% and achieved a peak of 93.6% for 4.4 ºC ambient temperature. Lean solvent rate was a significant driver of profitability. The maximum capacity of the compressor was a significant constraint on profitability. Increasing compressor capacity by 20–30% could increase variable profit by about 21% in the case of 0.18 lean loading at 4.4 °C ambient temperature. Furthermore, this increase in profit was lower at higher ambient temperature and higher lean loading. The breakeven gas price was $\$4.6$/MMBtu at high lean loading of 0.22 mol/mol. Below this value, profit was maximized by increasing the boiler heat rate. Above this value, profit could not be increased by burning additional natural gas, requiring a reduction in boiler heat rate and consequently, specific heat duty. At lower lean loading (0.2, 0.18 mol/mol), this transition in heat duty was not observed due to the lower heat duty. As the ambient temperature increased, a similar trend in heat duty was observed at 0.22 lean loading, but the transition to lower heat duty occurred earlier at $\$4$/MMBtu. This was because of the lower CO 2 production at higher ambient temperature, making the process unprofitable at a gas price higher than $\$3$/MMBtu unless the heat duty of the stripper and natural gas boiler is steeply decreased.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Reservoir Computing as a Tool for Climate Predictability Studies

Reduced-order dynamical models play a central role in developing our understanding of predictability of climate irrespective of whether we are dealing with the actual climate system or surrogate climate models. In this context, the linear inverse modeling (LIM) approach, by capturing a few essential interactions between dynamical components of the full system, has proven valuable in providing insights into predictability of the full system. We demonstrate that reservoir computing (RC), a form of learning suitable for systems with chaotic dynamics, provides an alternative nonlinear approach that improves on the predictive skill of the LIM approach. We do this in the example setting of predicting sea surface temperature in the North Atlantic in the preindustrial control simulation of a popular earth system model, the Community Earth System Model so that we can compare the performance of the new RC-based approach with the traditional LIM approach both when learning data are plentiful and when such data are more limited. The improved predictive skill of the RC approach over a wide range of conditions—larger number of retained EOF coefficients, extending well into the limited data regime, etc.—suggests that this machine-learning technique may have a use in climate predictability studies. While the possibility of developing a climate emulator—the ability to continue the evolution of the system on the attractor long after failing to be able to track the reference trajectory—is demonstrated in the Lorenz-63 system, it is suggested that further development of the RC approach may permit such uses of the new approach in more realistic predictability studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Polynomial Chaos Surrogate Construction for Random Fields with Parametric Uncertainty

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many simulations for acceptable accuracy. Surrogate models provide a means of circumventing the high computational expense of sampling such complex models. In particular, polynomial chaos expansions (PCEs) have been successfully used for uncertainty quantification studies of deterministic models where the dominant source of uncertainty is parametric. We discuss an extension to conventional PCE surrogate modeling to enable surrogate construction for stochastic computational models that have intrinsic noise in addition to parametric uncertainty. We develop a PCE surrogate on a joint space of intrinsic and parametric uncertainty, enabled by Rosenblatt transformations, which are evaluated via kernel density estimation of the associated conditional cumulative distributions. Furthermore, we extend the construction to random field data via the Karhunen–Loève expansion. We then take advantage of closed-form solutions for computing PCE Sobol indices to perform a global sensitivity analysis of the model which quantifies the intrinsic noise contribution to the overall model output variance. Additionally, the resulting joint PCE is generative in the sense that it allows generating random realizations at any input parameter setting that are statistically approximately equivalent to realizations from the underlying stochastic model. The method is demonstrated on a chemical catalysis example model and a synthetic example controlled by a parameter that enables a switch from unimodal to bimodal response distributions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Stellarator Design Exploration Using Symbolic-Regression Neutronics Surrogates

Systems codes require fast, simplified models to rapidly evaluate fusion power plant concepts, but neutronics analyses are often a computational bottleneck. Here, to address this, surrogate models for key neutronics responses have been developed using 3-D neutronics-ready models built with the open-source code ParaStell from a database of stellarator equilibria. Neutronics responses such as tritium breeding ratio (TBR), nuclear heating, and neutron-induced radiation damage displacements per atom (dpa) were simulated using OpenMC. Through sensitivity analysis and symbolic regression (SR), simple power-law formulas were derived connecting these neutronics responses to global stellarator parameters, including fusion power, plasma surface area, and plasma elongation. Validation shows these formulas can predict the simulation results with low error, enabling quick and accurate assessment of neutronics requirements in stellarator design exploration activities with systems codes.

Modeling↗
DOE OSTI2022

Generalized optimization-based synthesis of membrane systems for multicomponent gas mixture separation

Synthesizing a membrane system to separate multicomponent gas mixture is challenging due to the combinatorial number of feasible configurations and the difficulties in describing the multicomponent permeators. Here we present a mixed-integer nonlinear programming (MINLP) model for synthesizing membrane systems for multicomponent gas mixture separation. The approach employs a richly connected superstructure to represent numerous potential system configurations, and different physics-based surrogate permeator models, such as countercurrent flow or crossflow, to be used in each stage. Moreover, to describe realistic systems, pressure drop equations can be included. We also present solution methods to accelerate the solution process. Through a case study of natural gas sweetening, we demonstrate that the proposed approach is able to obtain good solutions using an off-the-shelf global optimization solver. Finally, we expand the conventional membrane system synthesis problem by introducing feed variability in our model through a case study of an integrated reactor-separation system.

42 ENGINEERING↗
DOE OSTI2022

Model calibration of the liquid mercury spallation target using evolutionary neural networks and sparse polynomial expansions

The mercury constitutive model predicting the strain and stress in the target vessel plays a central role in improving the lifetime prediction and future target designs of the mercury targets at the Spallation Neutron Source. We leverage the experiment strain data collected over multiple years to improve the mercury constitutive model through a combination of large scale simulations of the target behavior and the use of machine learning tools for parameter estimation. We present two interdisciplinary approaches for surrogate-based model calibration of expensive simulations using evolutionary neural networks and sparse polynomial expansions. The newly calibrated simulations achieve 7% average improvement on the prediction accuracy and 8% reduction in mean absolute error compared to previously reported reference parameters, with some individual sensors experiencing up to 30% improvement. The calibrated simulations can aid in fatigue analysis to estimate the mercury target lifetime, which reduces abrupt failure and saves tremendous amount of costs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Deriving effective electrode–ion interactions from free-energy profiles at electrochemical interfaces

Understanding ion adsorption at electrified metal–electrolyte interfaces is essential for accurate modeling of electrochemical systems. Here, in this study, we systematically investigate the free energy profiles of Na + , Cl − , and F − ions at the Au(111)–water interface using enhanced sampling molecular dynamics with both classical force fields and machine-learned interatomic potentials (MLIPs). Our classical metadynamics results reveal a strong dependence of predicted ion adsorption on the Lennard-Jones parameters, highlighting that—without due care—standard mixing rules can lead to qualitatively incorrect descriptions of ion–metal interactions. We present a systematic methodology for tuning the cross term LJ parameters to control adsorption energetics in agreement with more accurate models. As a surrogate for an ab initio model, we employed the recently released Universal Models for Atoms MLIP, which validates classical trends and displays strong specific adsorption for chloride, weak adsorption for fluoride, and no specific adsorption for sodium, in agreement with experimental and theoretical expectations. By integrating molecular-level adsorption free energies into continuum models of the electric double layer, we show that specific ion adsorption substantially alters the interfacial ion population, the potential of zero charge, and the differential capacitance of the system. Our results underscore the critical importance of force field parameterization and advanced interatomic potentials for the predictive modeling of ion-specific effects at electrified interfaces and provide a robust framework for bridging molecular simulations and continuum electrochemical models.

Roncoroni, Fabrice [Lawrence Berkeley National Lab↗
DOE OSTI2020

High-Level Model Articulation with BuildingSync and OpenStudio

The use of the BuildingSync schema for describing the contents of buildings is becoming more common with its recent integration into the Audit Template tool as well as ASHRAE’s Building Energy Quotient (bEQ) web portal. Although BuildingSync was initially created to store and transfer data related to building energy audits (as defined by ASHRAE Standard 211), it has since been expanded to store the data needed to articulate fully defined physics-based building energy models. BuildingSync combined with abstracted high-level input methods defined in OpenStudio’s Standards project and the newly developed BuildingSync gem allows BuildingSync eXtensible Markup Language (XML) (Bray, Paoli, Sperberg-McQueen, Maler, Eve (Sun Microsystems, & Francois, 2008) document to be converted into OpenStudio models. Automatic generation of a building energy model from data collected during an audit 1) eliminates the need to separately generate an energy model, 2) improves consistency between model generation, and 3) simplifies evaluation of various energy efficiency measures. This manuscript will discuss this open-source project, including: development of the validation infrastructure necessary to provide formalized expectations of informational requirements for BuildingSync documents; development of the BuildingSync gem for translation of BuildingSync documents to OpenStudio models as well as example implementations; and finally, the manuscript will elaborate on the advantages and disadvantages of using high-level models generated from BuildingSync as surrogates to detailed models.

30 DIRECT ENERGY CONVERSION↗
NASA NTRS2014

A Priori Analysis of Flamelet-Based Modeling for a Dual-Mode Scramjet Combustor

An a priori investigation of the applicability of flamelet-based combustion models to dual-mode scramjet combustion was performed utilizing Reynolds-averaged simulations (RAS). For this purpose, the HIFiRE Direct Connect Rig (HDCR) flowpath, fueled with a JP-7 fuel surrogate and operating in dual- and scram-mode was considered. The chemistry of the JP-7 fuel surrogate was modeled using a 22 species, 18-step chemical reaction mechanism. Simulation results were compared to experimentally-obtained, time-averaged, wall pressure measurements to validate the RAS solutions. The analysis of the dual-mode operation of this flowpath showed regions of predominately non-premixed, high-Damkohler number, combustion. Regions of premixed combustion were also present but associated with only a small fraction of the total heat-release in the flow. This is in contrast to the scram-mode operation, where a comparable amount of heat is released from non-premixed and premixed combustion modes. Representative flamelet boundary conditions were estimated by analyzing probability density functions for temperature and pressure for pure fuel and oxidizer conditions. The results of the present study reveal the potential for a flamelet model to accurately model the combustion processes in the HDCR and likely other high-speed flowpaths of engineering interest.

Quinlan, Jesse R.↗
DOE OSTI2020

Optimal carbon storage reservoir management through deep reinforcement learning

Model-based optimization plays a central role in energy system design and management. The complexity and high-dimensionality of many process-level models, especially those used for geosystem energy exploration and utilization, often lead to formidable computational costs when the dimension of decision space is also large. This work adopts elements of recently advanced deep learning techniques to solve a sequential decision-making problem in applied geosystem management. Specifically, a deep reinforcement learning framework was formed for optimal multiperiod planning, in which a deep Q-learning network (DQN) agent was trained to maximize rewards by learning from high-dimensional inputs and from exploitation of its past experiences. To expedite computation, deep multitask learning was used to approximate high-dimensional, multistate transition functions. Both DQN and deep multitask learning are pattern based. As a demonstration, the framework was applied to optimal carbon sequestration reservoir planning using two different types of management strategies: monitoring only and brine extraction. Both strategies are designed to mitigate potential risks due to pressure buildup. Results show that the DQN agent can identify the optimal policies to maximize the reward for given risk and cost constraints. Finally, experiments also show that knowledge the agent gained from interacting with one environment is largely preserved when deploying the same agent in other similar environments.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Unified differentiable digital twin for the IOTA/FAST facility

As the design complexity of modern accelerators grows, there is more interest in using advanced simulations that have fast execution time or produce insights about accelerator state. One notable example of additional information are gradients of physical observables with respect to design parameters produced by differentiable simulations. The IOTA/FAST facility has recently begun a program to implement and experimentally validate a unified start-to-end differentiable digital twin to serve as a virtual accelerator test stand, allowing for rapid prototyping of new software and experiments with minimal beam time costs. In this contribution we will discuss our plans and progress. Specifically, we will cover the selection and benchmarking of both physics and ML codes, the development of generic interfaces between device models and surrogate or physics-based sections, and the export of the parameters through either a deterministic event loop or a fully asynchronous EPICS soft input/output controller. We will also discuss challenges in model calibration and uncertainty quantification, as well as future plans to support larger proton accelerators like PIPII and Booster.

Kuklev, Nikita [Fermilab]↗
DOE OSTI2023

Entropy-driven Optimal Sub-sampling of Fluid Dynamics for Developing Machine-learned Surrogates

Optimal sub-sampling of large datasets from fluid dynamics simulations is essential for training reduced-order machine learned models. A method using Shannon entropy was developed to weight flow features according to their level of information content, such that the most informative features can be extracted and used for training a surrogate model. The method is demonstrated in the canonical flow over a cylinder problem simulated with OpenFOAM. Both time-independent predictions and temporal forecasting were investigated as well as two types of prediction targets: local per-grid-point predictions and global per-time-step predictions. When tested on training a surrogate model, results indicate that our entropy-based sampling method typically outperforms random sampling and yields more reproducible results in less iterations. Finally, the method was used to train a surrogate model for modeling turbulence in magnetohydrodynamic flows, which revealed various challenges and opportunities for future research.

Brewer, Wes↗