Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SURROGATE MODELS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Market-Integrated Optimization of Wind-Battery-Hydrogen Hybrids for Peaking Capacity via Storage

As Integrated Energy Systems (IES) combine multiple energy and storage technologies to provide potentially more value and less risk via resource diversification, complementary overbuild, increased flexibility, and revenue-stacking, IES value is dependent on electricity market dispatch and grid interactions should play an important role in IES design and operation. This study hybridizes and retrofits wind and combustion turbine plants to study the impacts of replacing gas generation capacity with wind, battery, PEM electrolysis, hydrogen tanks and hydrogen turbines. The optimized design is co-simulated in a production cost model with different bidding strategies in order to compare performance and highlight the importance of grid-interactions. We analyze the revenue and dispatch changes as well as the price and cost implications of wind-battery-hydrogen IESs.

electrolysis↗

Optimization of the generator coordinate method with machine-learning techniques for nuclear spectra and neutrinoless double- β decay: Ridge regression for nuclei with axial deformation

The generator coordinate method (GCM) is an important tool of choice for modeling large-amplitude collective motion in atomic nuclei. The computational complexity of the GCM increases rapidly with the number of collective coordinates. It imposes a strong restriction on the applicability of the method. In this work, we propose a subspace-reduction algorithm that employs optimal statistical ML models as surrogates for exact quantum-number projection calculations for norm and Hamiltonian kernels. The model space of the original GCM is reduced to a subspace relevant for nuclear low energy spectra and the NME of ground state to ground state 0νββ decay based on the orthogonality condition (OC) and the energy-transition-orthogonality procedure (ENTROP), respectively. For simplicity, the polynomial ridge regression (RR) algorithm is used to learn the norm and Hamiltonian kernels of axially deformed configurations. The efficiency and accuracy of this algorithm are illustrated for 76 Ge and 76 Se by comparing results obtained using the optimal RR models to direct GCM calculations. The low-lying energy spectra of 76 Ge and 76 Se, as well as the 0νββ-decay NME between their ground states, are computed. Furthermore, the results show that the performance of the GCM+OC/ENTROP+RR is more robust than that of the GCM+RR alone, and the former can reproduce the results of the original GCM calculation accurately with a significantly reduced computational cost.

59 ≤ A ≤ 89↗

Parametric model-order reduction for radiation transport using multi-resolution proper orthogonal decomposition

For parametric high-fidelity simulations, it is often desirable to utilize a reduced-order model (ROM) to emulate, at a reduced computational cost, parametric solutions of the governing partial differential equations (PDEs) for unseen parameter values. One commonly employed option is to utilize a data-driven, projection-based ROM supplemented with subspace identification via proper orthogonal decomposition (POD). POD discovers the ROM subspace by computing the singular value decomposition (SVD) of a set of training data from the full-order model (FOM). In streaming-dominated radiation transport simulations with localized sources, solutions often greatly vary over the spatial domain by many orders of magnitude. In such cases, machine-precision arithmetic can be insufficient to obtain an accurate SVD, resulting in a poorly performing ROM. We present a method called multiresolution POD (mrPOD) that mitigates these inaccuracies. The mrPOD method works by decomposing the spatial domain into regions and performing proper orthogonal decomposition on the training dataset separately in each region. In conclusion, mrPOD is tested on single energy group and multigroup atmospheric shielding transport problems and is shown to outperform classic POD.

42 ENGINEERING↗

An Edge-Cloud Integrated Solution for Buildings Demand Response Using Reinforcement Learning

Buildings, as major energy consumers, can provide great untapped demand response (DR) resources for grid services. However, their participation remains low in real-life. One major impediment for popularizing DR in buildings is the lack of cost-effective automation systems that can be widely adopted. Existing optimization-based smart building control algorithms suffer from high costs on both building-specific modeling and on-demand computing resources. To tackle these issues, this paper proposes a cost-effective edge-cloud integrated solution using reinforcement learning (RL). Beside RL’s ability to solve sequential optimal decision-making problems, its adaptability to easy-to-obtain building models and the off-line learning feature are likely to reduce the controller’s implementation cost. Using a surrogate building model learned automatically from building operation data, an RL agent learns an optimal control policy on cloud infrastructure, and the policy is then distributed to edge devices for execution. Simulation results demonstrate the control efficacy and the learning efficiency in buildings of different sizes. A preliminary cost analysis on a 4-zone commercial building shows the annual cost for optimal policy training is only 2.25% of the DR incentive received. Results of this study show a possible approach with higher return on investment for buildings to participate in DR programs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Simulating the CMS High Granularity Calorimeter with ML

Detector simulation is a key component of physics analysis and related activities in CMS. In the upcoming High Luminosity LHC era, simulation will be required to use a smaller fraction of computing in order to satisfy resource constraints. At the same time, CMS will be upgraded with the new High Granularity Calorimeter (HGCal), which requires significantly more resources to simulate than the existing CMS calorimeters. This computing challenge motivates the use of generative machine learning models as surrogates to replace full physics-based simulation. We study the application of state-of-the-art diffusion models to simulate particle showers in the CMS HGCal. We will discuss methods to overcome the challenges posed by the high-dimensional, irregular geometry of the HGCal. The quality of the showers produced by the diffusion model will be assessed by comparison to the full GEANT4-based simulation. The increase in simulation throughput will be quantified and methods to accelerate the diffusion model inference will also be discussed.

Amram, Oz↗

AI-accelerated protein-ligand docking for SARS-CoV-2 is 100-fold faster with no significant change in detection

Protein-ligand docking is a computational method for identifying drug leads. The method is capable of narrowing a vast library of compounds down to a tractable size for downstream simulation or experimental testing and is widely used in drug discovery. While there has been progress in accelerating scoring of compounds with artificial intelligence, few works have bridged these successes back to the virtual screening community in terms of utility and forward-looking development. We demonstrate the power of high-speed ML models by scoring 1 billion molecules in under a day (50 k predictions per GPU seconds). We showcase a workflow for docking utilizing surrogate AI-based models as a pre-filter to a standard docking workflow. Our workflow is ten times faster at screening a library of compounds than the standard technique, with an error rate less than 0.01% of detecting the underlying best scoring 0.1% of compounds. Our analysis of the speedup explains that another order of magnitude speedup must come from model accuracy rather than computing speed. In order to drive another order of magnitude of acceleration, we share a benchmark dataset consisting of 200 million 3D complex structures and 2D structure scores across a consistent set of 13 million “in-stock” molecules over 15 receptors, or binding sites, across the SARS-CoV-2 proteome. We believe this is strong evidence for the community to begin focusing on improving the accuracy of surrogate models to improve the ability to screen massive compound libraries 100 × or even 1000 × faster than current techniques and reduce missing top hits. The technique outlined aims to be a fast drop-in replacement for docking for screening billion-scale molecular libraries.

59 BASIC BIOLOGICAL SCIENCES↗

Model-form Error Correction using Universal Differential Equations for an Agent-Based Model of Infectious Disease

This report demonstrates universal differential equations (UDEs) as an approach to bridge the gap between ordinary differential equations (ODE) models and agent-based models (ABMs). Using UDE models as surrogates for ABMs allows us to preserve the foundational ODE that represents global disease dynamics while coupling it with a neural network model to approximate functions for the local behaviors of the ABM.

59 BASIC BIOLOGICAL SCIENCES↗

A Phenomenological Model for Cavitation

A phenomenological model of cavitation is presented, based on observations that both large relative negative pressures and large negative time derivatives of pressure are required for cavitation onset. We simulated two cavitation experiments to generate cavitation scaling parameters for relative pressure drop and rate of pressure drop. Our results show the model, while simple, is effective at reproducing results from laboratory experiments of cavitation. The parameters were then used in conjunction with a human surrogate computational model to predict, at any position within the head, the probability of intracranial cavitation caused by exposure to a blast event. The results suggest that the magnitude of blast overpressure observed in field data is sufficient to cause intracranial cavitation. Our analysis indicates that the helmeted head, when compared to the unhelmeted head configuration, results in a decrease but not elimination of cavitation exposure. When density functions of cavitation probability versus cumulative brain volume are combined with an injury severity model, the results show helmet efficacy at low and moderate risk levels. However, the convergence of unhelmeted and helmeted probability density functions at high-to-excessive risk thresholds indicates the helmet offers diminishing protection at elevated exposure levels, relative to the unhelmeted baseline. Future investigation and collaboration with neuroscience subject matter experts are needed to contextualize the current computational results. While the present work contributes specific and quantified predictions of intracranial cavitation location and severity, more research is required to apply our results to clinical settings with population-based brain injury subjects and controls. The relationship between our intracranial cavitation predictions with their anticipated clinical sequelae remains a topic in need of exploration.

60 APPLIED LIFE SCIENCES↗

Optimization of Operating Profit for the FEED of the PZAS Process for CO 2 Capture on a 460 MW NGCC

A rating model of PZAS (Piperazine with the Advanced Stripper) for a 460 MW natural gas combined cycle was developed from vendor-provided equipment performance data. Surrogate rating models were built and used to optimize variable profit of the system subject to natural gas and electricity price at a fixed value for CO 2 of $\$80$/tonne. Several process constraints were considered between ambient temperatures of 4.4 and 40.5 °C. Lower lean loading resulted in lower reboiler heat duty of about 2.2 GJ/tonne. Lean loading at 0.2 mol/equiv N was sufficient at an ambient temperature of 4.4 °C to maximize variable profit. Solvent precipitation was avoided even at low lean loading (0.18 mol/mol) in the absence of a trim cooler for the lean solvent between the absorber and the cold cross exchanger. Optimal CO 2 removal was always higher than the design case removal of 90% and achieved a peak of 93.6% for 4.4 ºC ambient temperature. Lean solvent rate was a significant driver of profitability. The maximum capacity of the compressor was a significant constraint on profitability. Increasing compressor capacity by 20–30% could increase variable profit by about 21% in the case of 0.18 lean loading at 4.4 °C ambient temperature. Furthermore, this increase in profit was lower at higher ambient temperature and higher lean loading. The breakeven gas price was $\$4.6$/MMBtu at high lean loading of 0.22 mol/mol. Below this value, profit was maximized by increasing the boiler heat rate. Above this value, profit could not be increased by burning additional natural gas, requiring a reduction in boiler heat rate and consequently, specific heat duty. At lower lean loading (0.2, 0.18 mol/mol), this transition in heat duty was not observed due to the lower heat duty. As the ambient temperature increased, a similar trend in heat duty was observed at 0.22 lean loading, but the transition to lower heat duty occurred earlier at $\$4$/MMBtu. This was because of the lower CO 2 production at higher ambient temperature, making the process unprofitable at a gas price higher than $\$3$/MMBtu unless the heat duty of the stripper and natural gas boiler is steeply decreased.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Reservoir Computing as a Tool for Climate Predictability Studies

Reduced-order dynamical models play a central role in developing our understanding of predictability of climate irrespective of whether we are dealing with the actual climate system or surrogate climate models. In this context, the linear inverse modeling (LIM) approach, by capturing a few essential interactions between dynamical components of the full system, has proven valuable in providing insights into predictability of the full system. We demonstrate that reservoir computing (RC), a form of learning suitable for systems with chaotic dynamics, provides an alternative nonlinear approach that improves on the predictive skill of the LIM approach. We do this in the example setting of predicting sea surface temperature in the North Atlantic in the preindustrial control simulation of a popular earth system model, the Community Earth System Model so that we can compare the performance of the new RC-based approach with the traditional LIM approach both when learning data are plentiful and when such data are more limited. The improved predictive skill of the RC approach over a wide range of conditions—larger number of retained EOF coefficients, extending well into the limited data regime, etc.—suggests that this machine-learning technique may have a use in climate predictability studies. While the possibility of developing a climate emulator—the ability to continue the evolution of the system on the attractor long after failing to be able to track the reference trajectory—is demonstrated in the Lorenz-63 system, it is suggested that further development of the RC approach may permit such uses of the new approach in more realistic predictability studies.

54 ENVIRONMENTAL SCIENCES↗

Polynomial Chaos Surrogate Construction for Random Fields with Parametric Uncertainty

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many simulations for acceptable accuracy. Surrogate models provide a means of circumventing the high computational expense of sampling such complex models. In particular, polynomial chaos expansions (PCEs) have been successfully used for uncertainty quantification studies of deterministic models where the dominant source of uncertainty is parametric. We discuss an extension to conventional PCE surrogate modeling to enable surrogate construction for stochastic computational models that have intrinsic noise in addition to parametric uncertainty. We develop a PCE surrogate on a joint space of intrinsic and parametric uncertainty, enabled by Rosenblatt transformations, which are evaluated via kernel density estimation of the associated conditional cumulative distributions. Furthermore, we extend the construction to random field data via the Karhunen–Loève expansion. We then take advantage of closed-form solutions for computing PCE Sobol indices to perform a global sensitivity analysis of the model which quantifies the intrinsic noise contribution to the overall model output variance. Additionally, the resulting joint PCE is generative in the sense that it allows generating random realizations at any input parameter setting that are statistically approximately equivalent to realizations from the underlying stochastic model. The method is demonstrated on a chemical catalysis example model and a synthetic example controlled by a parameter that enables a switch from unimodal to bimodal response distributions.

97 MATHEMATICS AND COMPUTING↗

Stellarator Design Exploration Using Symbolic-Regression Neutronics Surrogates

Systems codes require fast, simplified models to rapidly evaluate fusion power plant concepts, but neutronics analyses are often a computational bottleneck. Here, to address this, surrogate models for key neutronics responses have been developed using 3-D neutronics-ready models built with the open-source code ParaStell from a database of stellarator equilibria. Neutronics responses such as tritium breeding ratio (TBR), nuclear heating, and neutron-induced radiation damage displacements per atom (dpa) were simulated using OpenMC. Through sensitivity analysis and symbolic regression (SR), simple power-law formulas were derived connecting these neutronics responses to global stellarator parameters, including fusion power, plasma surface area, and plasma elongation. Validation shows these formulas can predict the simulation results with low error, enabling quick and accurate assessment of neutronics requirements in stellarator design exploration activities with systems codes.

Modeling↗

Generalized optimization-based synthesis of membrane systems for multicomponent gas mixture separation

Synthesizing a membrane system to separate multicomponent gas mixture is challenging due to the combinatorial number of feasible configurations and the difficulties in describing the multicomponent permeators. Here we present a mixed-integer nonlinear programming (MINLP) model for synthesizing membrane systems for multicomponent gas mixture separation. The approach employs a richly connected superstructure to represent numerous potential system configurations, and different physics-based surrogate permeator models, such as countercurrent flow or crossflow, to be used in each stage. Moreover, to describe realistic systems, pressure drop equations can be included. We also present solution methods to accelerate the solution process. Through a case study of natural gas sweetening, we demonstrate that the proposed approach is able to obtain good solutions using an off-the-shelf global optimization solver. Finally, we expand the conventional membrane system synthesis problem by introducing feed variability in our model through a case study of an integrated reactor-separation system.

42 ENGINEERING↗

Model calibration of the liquid mercury spallation target using evolutionary neural networks and sparse polynomial expansions

The mercury constitutive model predicting the strain and stress in the target vessel plays a central role in improving the lifetime prediction and future target designs of the mercury targets at the Spallation Neutron Source. We leverage the experiment strain data collected over multiple years to improve the mercury constitutive model through a combination of large scale simulations of the target behavior and the use of machine learning tools for parameter estimation. We present two interdisciplinary approaches for surrogate-based model calibration of expensive simulations using evolutionary neural networks and sparse polynomial expansions. The newly calibrated simulations achieve 7% average improvement on the prediction accuracy and 8% reduction in mean absolute error compared to previously reported reference parameters, with some individual sensors experiencing up to 30% improvement. The calibrated simulations can aid in fatigue analysis to estimate the mercury target lifetime, which reduces abrupt failure and saves tremendous amount of costs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Deriving effective electrode–ion interactions from free-energy profiles at electrochemical interfaces

Understanding ion adsorption at electrified metal–electrolyte interfaces is essential for accurate modeling of electrochemical systems. Here, in this study, we systematically investigate the free energy profiles of Na + , Cl − , and F − ions at the Au(111)–water interface using enhanced sampling molecular dynamics with both classical force fields and machine-learned interatomic potentials (MLIPs). Our classical metadynamics results reveal a strong dependence of predicted ion adsorption on the Lennard-Jones parameters, highlighting that—without due care—standard mixing rules can lead to qualitatively incorrect descriptions of ion–metal interactions. We present a systematic methodology for tuning the cross term LJ parameters to control adsorption energetics in agreement with more accurate models. As a surrogate for an ab initio model, we employed the recently released Universal Models for Atoms MLIP, which validates classical trends and displays strong specific adsorption for chloride, weak adsorption for fluoride, and no specific adsorption for sodium, in agreement with experimental and theoretical expectations. By integrating molecular-level adsorption free energies into continuum models of the electric double layer, we show that specific ion adsorption substantially alters the interfacial ion population, the potential of zero charge, and the differential capacitance of the system. Our results underscore the critical importance of force field parameterization and advanced interatomic potentials for the predictive modeling of ion-specific effects at electrified interfaces and provide a robust framework for bridging molecular simulations and continuum electrochemical models.

Roncoroni, Fabrice [Lawrence Berkeley National Lab↗