Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Fuel Property-Informed Process Design for the Direct Catalytic Conversion of Cellulosics

The direct catalytic conversion of cellulosics (DC3) with supercritical methanol presents a promising pathway to completely solubilize woody biomass and produce >60% mass yield of C2-C6 oxygenates for light duty vehicle applications. Although the oxygenate composition can be tuned by modifying catalyst and process conditions, limited efforts to date have examined DC3 fuel properties for light duty fuel applications to iteratively inform conversion process design. In this work, we designed and evaluated multi-component surrogate bioblendstocks that represent major DC3 light oxygenates and refined catalyst formulations and distillation parameters to improve the resulting light duty fuel quality. Surrogate design for this novel fuel production pathway was based on a preliminary product slate that was systematically adjusted to determine impacts on fuel properties of interest including heating value, oxidative stability, and heat of vaporization, among others. The resulting predictions and measurements of these surrogates were then used to inform improvement of conversion process, and specifically, reformulation of the catalyst which resulted in production of a higher energy density fuel product primarily comprised of saturated alcohols. Fuel testing outcomes also informed downstream oxygenate separations requirements. This resulted in the production of a promising DC3 light-duty fuel blendstock with >15% greater energy density relative to ethanol, while maintaining high octane number and octane sensitivity.

BIOMASS FUELS↗
DOE OSTI2012

Mechanism of Phase Formation in the Batch Mixtures for Slag-Bearing Glass Ceramics - 12207

Slag surrogate was produced from chemicals by heating to 900 deg. C and keeping at this temperature for 1 hr. The product obtained was intermixed with either sodium di-silicate (75 wt.% waste loading) or borax (85 wt.% slag loading). The mixtures were heat-treated within a temperature range of 25 to 1300 deg. C. The products were examined by X-ray diffraction and infrared spectroscopy. The products prepared at temperatures of up to 1000 deg. C contained both phase typical of the source slag and intermediate phases as well as phases typical of the materials melted at 1350 deg. C such as nepheline, britholite, magnetite and matrix vitreous phase. Vitrification process in batch mixtures consisting of slag surrogate and either sodium di-silicate or sodium tetraborate runs through formation of intermediate phases mainly silico-phosphates capable to incorporate Sm as trivalent actinides surrogate. Reactions in the batch mixtures are in the whole completed by ∼1000 deg. C but higher temperatures are required to homogenize the products. If in the borate-based system the mechanism is close to simple dissolution of slag constituents in the low viscous borate melt, then in the silicate-based system the mechanism was found to be much complicated and includes re-crystallization during melting with segregation of newly-formed nepheline type phase. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2018

Immobilization of Radioactive Materials Using Porous Iron Composite Media - 18582

High levels of nitrate (NO{sub 3}) derived from agriculture and naturally occurring radioactive materials (NORM), primarily uranium (U) and natural decay chain products that have been mobilized by the influx of oxygenated, high-alkalinity water, are a threat to shallow groundwater resources in California. Porous Iron Composite (PIC) materials were evaluated as a water treatment option in a series of batch experiments. While the use of Zero Valent Iron (ZVI) to address groundwater contaminated with NO{sub 3} or U has been demonstrated, the ability of PICs to chemically reduce and immobilize U and other associated contaminants in oxygenated alkaline groundwater where soluble uranyl-carbonate species dominate and high NO{sub 3} levels may compete for reductive capacity remain a concern. Additionally, ZVI materials have been used to immobilize other redox sensitive radionuclides (e.g., technetium-99 ({sup 99}Tc)) with limited success. Batch tests were conducted using an artificial groundwater surrogate (i.e., CAGW for California Groundwater) containing ∼ 100 mg L{sup -1} NO{sub 3}{sup -}, 200 mg L{sup -1} alkalinity, 100 μg L{sup -1} U, 100 μg L{sup -1} rhenium (Re) as a non-radioactive surrogate for the nuclear fission product technetium-99 ({sup 99}Tc), 100 μg L{sup -1} stable strontium (Sr) as a surrogate for radium (Ra) and the fission product strontium-90 ({sup 90}Sr), and 50 μg L{sup -1} arsenic (As), a common groundwater contaminant. Five gram samples of the PIC material were reacted with 200 mL of CAGW under two different atmospheric conditions to evaluate the impact of O{sub 2}. Batch tests were also conducted in the presence and absence of another oxidized species, NO{sub 3}. At specific time intervals, a small aliquot was collected from each batch treatment for chemical analysis (i.e., U, Re, As, Fe, NO{sub 3}, etc.) and the pH and ORP of the remaining suspension was measured. The PIC was effective at fully reducing NO{sub 3}{sup -} levels over the extended reaction time, even though the reactor pH quickly increased above 8.0 during equilibration. Soluble levels of U and Re decreased in a similar fashion to NO{sub 3}{sup -} in the presence and absence of O{sub 2}. Soluble As levels decreased more rapidly than other contaminants, but remained at ∼ 1 μg L{sup -1}. Very little nitrite (NO{sub 2}{sup -}) was detected in the batch tests, with NH{sub 4}{sup +} levels consistent with the amount of NO{sub 3}{sup -} reduced. Similar rates of immobilization for U, Re, and As were observed in the presence and absence of NO{sub 3}{sup -}. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Adaptive, Active Learning, and Multifidelity Monte Carlo Methods in the MOOSE Stochastic Tools Module

MOOSE is an open-source computational platform for constructing multi-physics models and executing them in a massively parallel fashion. It has a stochastic tools module (STM) for forward/inverse uncertainty quantification (UQ) and surrogate modeling. This presentation details some recent developments to the STM with respect to the implementation of adaptive, active learning, and multifidelity Monte Carlo methods for forward UQ of computational models. Specifically, the adaptive Monte Carlo methods include Markov Chain Monte Carlo (MCMC)-driven algorithms like adaptive importance sampling and parallelized subset simulation for statistical QoI estimation, rare events analysis, and stochastic gradient-free optimization. The active learning methods include Gaussian Process (GP) surrogates and their training via Adam optimization, design of acquisition functions, and integration with samplers like Monte Carlo, adaptive importance, and parallelized subset simulation. These active learning methods are also designed to work in a batch mode, wherein, the required calls to the full computational model are executed in parallel whenever a user-specified batch size is met. The multifidelity methods in STM are broadly divided into two categories: hierarchical, where a defined hierarchy exists among the low-fidelity models, and peer, where all the low-fidelity models are treated equally. A GP surrogate is used to learn the differences between the low- and high-fidelity models in both multifidelity categories, and acquisition functions from the active learning classes are used to decide whether to rely on a low-fidelity model or call the expensive high-fidelity model. Alongside the software description and usage, applications are also presented to nuclear engineering computational models including a TRISO nuclear fuel particle, a reactor pressure vessel, and a heat-pipe microreactor.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Uncertainty Quantification and Sensitivity Analysis of Non-Nuclear Advanced Controls Testbed Reactor Mockup

The research presented in this report describes our progress in applying stochastic methods and uncertainty quantification, parametric study, and variance-based sensitivity analysis (also known as Sobol sensitivity analysis) to a full-core model of a nuclear thermal propulsion (NTP) system simulated with Griffin, with the goal of developing a reduced order (surrogate) model which can be rapidly sampled while perturbing multiple input parameters. In this NTP system, reactivity and power feedback affect the rotation of control drums, which are controlled by a hybrid proportional, integral and derivative (PID) controller, actuated by the power demand and reactivity feedback from the numerical model. This model uses reactor kinetic feedback (mean generation time and $\beta$ from a transient Griffin simulation executed with the improved quasi-static method to provide the kinetic parameters) as inputs to functions which control the CD rotation angle. Using a number of stochastic method approaches, we developed a dual purpose training-surrogate model of the NTP system using polynomial regression. The trained model can be rapidly sampled while simultaneously perturbing various input parameters of the model, such as coefficients on the PID control, or temperature (directly affect the neutron cross section). The surrogate model delivers accurate results orders-of-magnitude faster (minutes, not days) than the base model. Once the base model has been trained, distributions of the uncertain parameters can be changed at will to investigate the effects of perturbing multiple inputs and their effect on the output. For example, coefficients used in the PID control system may vary due to some physical interference, or there may be uncertainty in the temperature of the neutron cross sections in various regions of the reactor. A distribution can be placed on these parameters and operational boundaries can be determined. The goal of this work is to support development of an advanced control system to operate CDs in a functioning NTP system.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Beyond Price Taker: Optimizing Integrated Energy Systems Considering Market/Grid Interactions

Integrated Energy Systems (IES) combine two or more processes to increase the efficiency, flexibility of operation, and the overall reliability. However, analyzing IESs in volatile electricity markets is challenging, since the volatility in electricity prices makes the conventional levelized cost-type analysis less realistic. This work presents two approaches to address the challenge: price-taker and a surrogates-based approach for incorporating market interactions. The price-taker approach formulates a multiperiod optimization problem that takes the time-varying electricity prices into account, and solves the optimization problem to determine the optimal operational schedule that maximizes the chosen economic metric. This approach is successfully applied to investigate the performance of flexible power and hydrogen co-production systems. The market surrogates approach trains a machine learning model to predict the market behavior as a function of the characteristics of the IES. The trained surrogate model is used to optimize the design and operation of the given IES in an electricity market. This approach is demonstrated on a case study involving a nuclear power plant retrofitted with a low-temperature electrolysis unit to co-produce power and hydrogen.

beyond price taker↗
DOE OSTI2021

Machine learning enables national assessment of wind plant controls with implications for land use

Summary As deployment of wind energy continues to expand, computationally efficient tools for predicting wind plant performance over a wide range of layout designs, technology innovations, and spatial locations are increasingly important for policy and investment decisions. We demonstrate two approaches to training a surrogate model to predict annual energy production (AEP) of parameterized wind plant layouts: one using a Gaussian process (GP) and the other using a fully convolutional neural network (FCNN). We leverage the powerful FCNN architecture by encoding wind plant design parameters and output response surface as an image. The FCNN produces more accurate results than the GP with mean absolute errors equivalent to 1% and 1.9% of plant rated power, respectively, although the GP performs well under limited training data and provides useful uncertainty information. We also evaluate a surrogate model for wake steering, enabling a nationwide assessment of the impact of plant control strategies and plant layout decisions. Across two million locations, we find that wake steering strategies boost AEP with relative gains upwards of 3%. Gains are most pronounced at sites without a dominant wind direction and where layout optimization is less fruitful. Additionally, we perform a nationwide sensitivity analysis showing that wake steering can mitigate wake losses from higher density plant layouts. Our results suggest that regions which have not been previously viable for wind deployment due to moderate wind resources are especially well enhanced by wake steering strategies that could help overcome land constraints and inflexible layout options, potentially identifying new deployment opportunities.

17 WIND ENERGY↗
DOE OSTI2023

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Here this article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results for model-free DRL-based methods in power systems control problems. But in power systems applications, these model-free methods have certain issues related to training time (clock time) and sample efficiency; both are critical for making state-of-the-art DRL algorithms practically applicable. DRL-agent learns an optimal policy via a trial-and-error method while interacting with the real-world environment. It is also desirable to minimize the direct interaction of the DRL agent with the real-world power grid due to its safety-critical nature. Additionally, the state-of-the-art DRL-based policies are mostly trained using a physics-based grid simulator where dynamic simulation is computationally intensive, lowering the training efficiency. We propose a novel model-based DRL framework where a deep neural network (DNN)-based dynamic surrogate model (SM), instead of a real-world power grid or physics-based simulation, is utilized within the policy learning framework, making the process faster and more sample efficient. However, having stable training in model-based DRL is challenging because of the complex system dynamics of large-scale power systems. We addressed these issues by incorporating imitation learning to have a warm start in policy learning, reward-shaping, and multi-step loss in surrogate model training. Finally, we achieved 97.5% reduction in samples and 87.7% reduction in training time for an application to the IEEE 300-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Manifold learning for coarse-graining atomistic simulations: Application to amorphous solids

In this work, we introduce a generalized machine learning framework to probabilistically parameterize upper-scale models in the form of nonlinear PDEs consistent with a continuum theory, based on coarse-grained atomistic simulation data of mechanical deformation and flow processes. The proposed framework utilizes a hypothesized coarse-graining methodology with manifold learning and surrogate-based optimization techniques. Coarse-grained high-dimensional data describing quantities of interest of the multiscale models are projected onto a nonlinear manifold whose geometric and topological structure is exploited for measuring behavioral discrepancies in the form of manifold distances. A surrogate model is constructed using Gaussian process regression to identify a mapping between stochastic parameters and distances. Derivative-free optimization is employed to adaptively identify a unique set of parameters of the upper-scale model capable of rapidly reproducing the system's behavior while maintaining consistency with coarse-grained atomic-level simulations. The proposed method is applied to learn the parameters of the shear transformation zone (STZ) theory of plasticity that describes plastic deformation in amorphous solids as well as coarse-graining parameters needed to translate between atomistic and continuum representations. We show that the methodology is able to successfully link coarse-grained microscale simulations to macroscale observables and achieve a high-level of parity between the models across scales.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A novel machine learning-based optimization algorithm (ActivO) for accelerating simulation-driven engine design

A novel design optimization approach (ActivO) that employs an ensemble of machine learning algorithms is presented. The proposed approach is a surrogate-based scheme, where the predictions of a weak leaner and a strong learner are utilized within an active learning loop. The weak learner is used to identify promising regions within the design space to explore, while the strong learner is used to determine the exact location of the optimum within promising regions. For each design iteration, exploration is done by randomly selecting evaluation points within regions where the weak learner-predicted fitness is high. The global optimum obtained by using the strong learner as a surrogate is also evaluated to enable rapid convergence once the most promising region has been identified. First, the performance of ActivO was compared against five other optimizers on a cosine mixture function with 25 local optima and one global optimum. In the second problem, the objective was to minimize indicated specific fuel consumption of a compression-ignition internal combustion (IC) engine while adhering to desired constraints associated with in-cylinder pressure and emissions. In this work, the efficacy of the proposed approach is compared to that of a genetic algorithm, which is widely used within the internal combustion engine community for engine optimization, showing that ActivO reduces the number of function evaluations needed to reach the global optimum, and thereby time-to-design by 80%. Furthermore, the optimization of engine design parameters leads to savings of around 1.9% in energy consumption, while maintaining operability and acceptable pollutant emissions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Visibility-enhanced model-free deep reinforcement learning algorithm for voltage control in realistic distribution systems using smart inverters

Increasing integration of distributed solar photovoltaic (PV) into distribution networks could result in adverse effects on grid operation. Traditional model-based control algorithms require accurate model information that is difficult to acquire and thus are challenging to implement in practice. Here, this paper proposes a surrogate model-enabled grid visibility scheme to empower deep reinforcement learning (DRL) approach for distribution network voltage regulation using PV inverters with minimal system knowledge. In contrast to existing DRL methods, this paper presents and corroborates the adverse impact of missing load information on DRL performance and, based on this finding, proposes a surrogate model methodology to impute load information utilizing observable data. Additionally, a multi-fidelity neural network is utilized to construct the DRL training environment, chosen for its efficient data utilization and enhanced robustness to data uncertainty. The feasibility and effectiveness of the proposed algorithm are assessed by considering DRL testing across varying degrees of observable load information and diverse training environments on a realistic power system.

14 SOLAR ENERGY↗
DOE OSTI2021

Bayesian calibration of strength model parameters from Taylor impact data

Materials strength plays a key role in determining the mechanical response of engineered structures. As such, accurate strength models are crucial in simulations involving complex loading conditions, particularly when deformation in the plastic regime is deemed important. In this work, a Gaussian process based surrogate for a finite element simulation of a Taylor impact test is developed and used for Bayesian calibration of the Preston–Tonks–Wallace strength model. Here, the surrogate model is shown to closely approximate the salient features of the Taylor cylinder deformation and is validated against simulation output before being used in the strength model calibration routine. The results show that Taylor impact test data can be used in the calibration of constitutive equations through the use of a combination of data science techniques, namely Gaussian processes and Bayesian inference.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Managing uncertainty in data-driven simulation-based optimization

Optimization using data from complex simulations has become an attractive decision-making option, due to ability to embed high-fidelity, non-linear understanding of processes within the search for optimal values. Due to lack of tractable algebraic equations, the link between simulations and optimization is oftentimes a surrogate metamodel. However, several forms of uncertainty exist within the cycle that links simulation data, to metamodels, to optimization. Uncertainty may originate from parameters of the simulation, or the form and fitted parameters of the metamodel. This paper reviews different literatures that are relevant to surrogate-based optimization and proposes different strategies for handling uncertainty, by combining machine learning with stochastic programming, robust optimization, and discrepancy modeling. We show that incorporating uncertainty management within simulation-based optimization leads to more robust solutions, which protect the decision-maker from infeasible solutions. Here, we present the results of our proposed approaches through a case study for direct-air capture through temperature swing adsorption.

42 ENGINEERING↗
DOE OSTI2025

Parallel derivative-free optimization for simulation-based design of behind-the-meter energy systems

In this work, the integrated design and dispatch of behind-the-meter or distributed resources (e.g. stationary battery storage and solar PV generation) is considered. A simulation-based framework is employed, generating high-fidelity results with closed-loop predictive control at a fine resolution, at the expense of high computational cost (several minutes to a few hours per design point). To address this challenge, parallel derivative-free design methods are considered. Four methods are compared, including state-of-the-art surrogate-based methods (Radial-Basis Functions and Gaussian processes) and sampling strategies, an evolutionary-based method, and a simple sequential grid refinement method. As a case study, two types of design problem with increasing complexity are considered, namely, the design of behind-the-meter resources (three design variables) and the inclusion of grid capacity (four design variables). The second yields a constrained design problem for which violations can only be determined after solving the computationally expensive simulation. For the three-dimensional case, all methods present a good performance, achieving a solution within 1% of the optimum after the first iteration, with the sequential grid refinement exhibiting the fastest convergence and achieving the best final objective value. This indicates that the parallel evaluation of multiple sampling points may be more important than the choice of method for small decision spaces. For the four-dimensional constrained case, the Genetic Algorithm presents the best tradeoff between performance and computational effort, while the rough objective function terrain generated by constraint violation penalties reduces the performance of surrogate-based methods. Contour plots with flat regions indicate flexibility in the optimal design and highlight the importance of characterizing the solution space.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Incorporating corrosion design constraints in desalination process optimization: A case study in mechanical vapor compression

Corrosion is an expensive and complex challenge for desalination, yet current design approaches do not explicitly account for corrosion mechanisms in process modeling and technoeconomic analysis. Here, to address this gap, we present a workflow for incorporating corrosion design constraints directly into desalination process optimization models. We develop surrogate models for general and localized corrosion metrics as functions of temperature, pH, salinity, dissolved oxygen, and material using data from OLI Systems’ Corrosion Analyzer. We then integrate these surrogates as corrosion design constraints in a cost-optimization MVC model that minimizes the levelized cost of water (LCOW). For a case study of mechanical vapor compression (MVC) treating seawater across a range of recoveries, we find dissolved oxygen (DO) is the dominant driver of localized corrosion, and thus of cost-optimal material choice and operating conditions. Reducing the DO from 8 mg/L to 0.5 mg/L reduces the LCOW by 15-35%, informing the breakeven costs for implementing DO removal or selecting highly corrosion-resistant alloys. This framework is broadly applicable across corrosion types, materials, and components and enables desalination process design that minimizes capital costs.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Shadow masks predictions in SPARC tokamak plasma-facing components using HEAT code and machine learning methods

Here, this work uses machine learning (ML) to complement HEAT (Heat flux Engineering Analysis Toolkit) by developing 3-D footprint surrogate models for fast and accurate heat load calculations in the divertor of the SPARC tokamak. The focus is on shadowed regions, or magnetic shadows, caused by the 3-D geometry of plasma-facing components (PFCs). ML classifiers are employed to create a surrogate model for HEAT generated shadow masks, predicting these shadow masks and divertor heat flux profiles based on a diverse range of equilibria and only the plasma current, safety factor(q95) at the edge, and magnetic flux angles as input parameters. The ultimate goal is to integrate the model for real-time control and future operational decisions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2016

Combining multiple lower-fidelity models for emulating complex model responses for CCS environmental risk assessment

Numerical modeling is essential to support natural resource management and environmental policy-making. In the context of CO 2 geological sequestration, these models are indispensible parts of risk assessment tools. However, because of increasing complexity, modern numerical models require a great computational effort, which in some cases may be infeasible. An increasingly popular approach to overcome computational limitations is the use of surrogate models. This paper presents a new surrogate modeling approach to reduce the computational cost of running a complex, high-fidelity model. The approach is based on the simplification the high-fidelity model into computationally efficient, lower-fidelity models and on linking them with a mathematical function (linking function) that addresses the discrepancies between outputs from models with different levels of fidelity. The resulting linking function model, which can be developed with small computational effort, can be efficiently used in numerical applications where multiple runs of the original high-fidelity model are required, such as for uncertainty quantification or sensitivity analysis. The proposed approach was then applied to the development of a reduced order model for the prediction of groundwater quality impacts from CO 2 and brine leakage for the National Risk Assessment Partnership (NRAP) project.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A deep learning-accelerated data assimilation and forecasting workflow for commercial-scale geologic carbon storage

Fast assimilation of monitoring data to update forecasts of pressure buildup and carbon dioxide (CO 2 ) plume migration under geologic uncertainties is a challenging problem in geologic carbon storage. The high computational cost of data assimilation with a high-dimensional parameter space impedes fast decision-making for commercial-scale reservoir management. We propose to leverage physical understandings of porous medium flow behavior with deep learning techniques to develop a fast data assimilation-reservoir response forecasting workflow. Applying an Ensemble Smoother Multiple Data Assimilation (ES-MDA) framework, the workflow updates geologic properties and predicts reservoir performance with quantified uncertainty from pressure history and CO 2 plumes interpreted through seismic inversion. As the most computationally expensive component in such a workflow is reservoir simulation, we developed surrogate models to predict dynamic pressure and CO 2 plume extents under multi-well injection. The surrogate models employ deep convolutional neural networks, specifically, a wide residual network and a residual U-Net. The workflow is validated against a flat threedimensional reservoir model representative of a clastic shelf depositional environment. Intelligent treatments are applied to bridge between quantities in a true-3D reservoir model and those in a single-layer reservoir model. The workflow can complete history matching and reservoir forecasting with uncertainty quantification in less than one hour on a mainstream personal workstation.

25 ENERGY STORAGE↗