Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “surrogate approximator”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Using Approximations to Accelerate Engineering Design Optimization

Optimization problems that arise in engineering design are often characterized by several features that hinder the use of standard nonlinear optimization techniques. Foremost among these features is that the functions used to define the engineering optimization problem often are computationally intensive. Within a standard nonlinear optimization algorithm, the computational expense of evaluating the functions that define the problem would necessarily be incurred for each iteration of the optimization algorithm. Faced with such prohibitive computational costs, an attractive alternative is to make use of surrogates within an optimization context since surrogates can be chosen or constructed so that they are typically much less expensive to compute. For the purposes of this paper, we will focus on the use of algebraic approximations as surrogates for the objective. In this paper we introduce the use of so-called merit functions that explicitly recognize the desirability of improving the current approximation to the objective during the course of the optimization. We define and experiment with the use of merit functions chosen to simultaneously improve both the solution to the optimization problem (the objective) and the quality of the approximation. Our goal is to further improve the effectiveness of our general approach without sacrificing any of its rigor.

Torczon, Virginia↗

Bayesian calibration of strength model parameters from Taylor impact data

Materials strength plays a key role in determining the mechanical response of engineered structures. As such, accurate strength models are crucial in simulations involving complex loading conditions, particularly when deformation in the plastic regime is deemed important. In this work, a Gaussian process based surrogate for a finite element simulation of a Taylor impact test is developed and used for Bayesian calibration of the Preston–Tonks–Wallace strength model. Here, the surrogate model is shown to closely approximate the salient features of the Taylor cylinder deformation and is validated against simulation output before being used in the strength model calibration routine. The results show that Taylor impact test data can be used in the calibration of constitutive equations through the use of a combination of data science techniques, namely Gaussian processes and Bayesian inference.

36 MATERIALS SCIENCE↗

Practical algorithms for multivariate rational approximation

We present two approaches for computing rational approximations to multivariate functions, motivated by their effectiveness as surrogate models for high-energy physics (HEP) applications. Our first approach builds on the Stieltjes process to efficiently and robustly compute the coefficients of the rational approximation. Our second approach is based on an optimization formulation that allows us to include structural constraints on the rational approximation (in particular, constraints demanding the absence of singularities), resulting in a semi-infinite optimization problem that we solve using an outer approximation approach. We present results for synthetic and real-life HEP data, and we compare the approximation quality of our approaches with that of traditional polynomial approximations.

97 MATHEMATICS AND COMPUTING↗

Surrogate Hessian accelerated structural optimization for stochastic electronic structure theories

In this work, we present an efficient energy-based method for structural optimization with stochastic electronic structure theories, such as diffusion quantum Monte Carlo (DMC). This method is based on robust line-search energy minimization in reduced parameter space, exploiting approximate but accurate Hessian information from a surrogate theory, such as density functional theory. The surrogate theory is also used to characterize the potential energy surface, allowing for simple but reliable ways to maximize statistical efficiency while retaining controllable accuracy. We demonstrate the method by finding the minimum DMC energy structures of the selected flake-like aromatic molecules, such as benzene, coronene, and ovalene, represented by 2, 6, and 19 structural parameters, respectively. In each case, the energy minimum is found within two parallel line-search iterations. The method is near-optimal for a line-search technique and suitable for a broad range of applications. It is easily generalized to any electronic structure method where forces and stresses are still under active development and implementation, such as diffusion Monte Carlo, auxiliary-field Monte Carlo, and stochastic configuration interaction, as well as deterministic approaches such as the random-phase approximation. Accurate and efficient means of geometry optimization could shed light on a broad class of materials and molecules, showing high sensitivity of induced properties to structural variables.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Visible and Near-IR Reflectance Spectra of Smectite Acquired Under Dry Conditions for Interpretation of Martian Surface Mineralogy

Visible and near-IR (VNIR) spectra from the MEx OMEGA and the MRO CRISM hyper-spectral imaging instruments have spectral features associated with the H2O molecule and M OH functional groups (M = Mg, Fe, Al, and Si). Mineralogical assignments of martian spectral features are made on the basis of laboratory VNIR spectra, which were often acquired under ambient (humid) conditions. Smectites like nontronite, saponite, and montmorillionite have interlayer H2O that is exchangeable with their environment, and we have acquired smectite reflectance spectra under dry environmental conditions for interpretation of martian surface mineralogy. We also obtained chemical, Moessbauer (MB), powder X-ray diffraction (XRD), and thermogravimetric (TG) data to understand variations in spectral properties. VNIR spectra were recorded in humid lab air at 25-35C, in a dynamic dry N2 atmosphere (50-150 ppmv H2O) after exposing the smectite samples (5 nontronites, 3 montmorillionites, and 1 saponite) to that atmosphere for up to approximately l000 hr each at 25-35C, approximately 105C, and approximately 215C, and after re-exposure to humid lab air. Heating at 105C and 215C for approximately 1000 hr is taken as a surrogate for geologic time scales at lower temperatures. Upon exposure to dry N2, the position and intensity of spectral features associated with M-OH were relatively insensitive to the dry environment, and the spectral features associated with H2O (e.g., approximately 1.90 micrometers) decreased in intensity and are sometimes not detectable by the end of the 215C heating step. The position and intensity of H2O spectral features recovered upon re-exposure to lab air. XRD data show interlayer collapse for the nontronites and Namontmorillionites, with the interlayer remaining collapsed for the latter after re-exposure to lab air. The interlayer did not collapse for the saponite and Ca-montmorillionite. TG data show that the concentration of H2O derived from structural OH was invariant to the dry N2 treatment for saponite and the montmorillionites, but the nontronites had additional structural OH after treatment. Upon exposure to dry N2, the VNIR spectra also acquired a red slope with decreasing albedo between approximately 0.4 and approximately 2.0 micrometers. The magnitude of the effects covaries with exposure time to dry N2 and heating temperature. Upon re-exposure to lab air, the slope and albedo do not completely recover to pre-exposure values. MB data show that these effects do not result from partial reduction of ferric to ferrous iron, and TG data show they do not result from loss of structural OH. Possible explanations include formation of small clusters of (superparamagnetic) ferric oxide and reduced smectite crystallinity. The difference in spectral properties between spectra acquired in humid lab air and under dry conditions are consequential for interpretation of CRISM and OMEGA spectra. For example, nontronite by itself and not nontronite plus ferrihydrite can account for the red spectral slope in martian spectra where nontronite is indicated by the Fe-OH spectral features.

Morris, Richard V.↗

Deep Learning Approaches to Surrogates for Solving the Diffusion Equation for Mechanistic Real-World Simulations

In many mechanistic medical, biological, physical, and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs), especially for diffusion, fluid flow and mechanical relaxation, can make simulations impractically slow. Biological models of tissues and organs often require the simultaneous calculation of the spatial variation of concentration of dozens of diffusing chemical species. One clinical example where rapid calculation of a diffusing field is of use is the estimation of oxygen gradients in the retina, based on imaging of the retinal vasculature, to guide surgical interventions in diabetic retinopathy. Furthermore, the ability to predict blood perfusion and oxygenation may one day guide clinical interventions in diverse settings, i.e., from stent placement in treating heart disease to BOLD fMRI interpretation in evaluating cognitive function (Xie et al., 2019; Lee et al., 2020). Since the quasi-steady-state solutions required for fast-diffusing chemical species like oxygen are particularly computationally costly, we consider the use of a neural network to provide an approximate solution to the steady-state diffusion equation. Machine learning surrogates, neural networks trained to provide approximate solutions to such complicated numerical problems, can often provide speed-ups of several orders of magnitude compared to direct calculation. Surrogates of PDEs could enable use of larger and more detailed models than are possible with direct calculation and can make including such simulations in real-time or near-real time workflows practical. Creating a surrogate requires running the direct calculation tens of thousands of times to generate training data and then training the neural network, both of which are computationally expensive. Often the practical applications of such models require thousands to millions of replica simulations, for example for parameter identification and uncertainty quantification, each of which gains speed from surrogate use and rapidly recovers the up-front costs of surrogate generation. We use a Convolutional Neural Network to approximate the stationary solution to the diffusion equation in the case of two equal-diameter, circular, constant-value sources located at random positions in a two-dimensional square domain with absorbing boundary conditions. Such a configuration caricatures the chemical concentration field of a fast-diffusing species like oxygen in a tissue with two parallel blood vessels in a cross section perpendicular to the two blood vessels. To improve convergence during training, we apply a training approach that uses roll-back to reject stochastic changes to the network that increase the loss function. The trained neural network approximation is about 1000 times faster than the direct calculation for individual replicas. Because different applications will have different criteria for acceptable approximation accuracy, we discuss a variety of loss functions and accuracy estimators that can help select the best network for a particular application. We briefly discuss some of the issues we encountered with overfitting, mismapping of the field values and the geometrical conditions that lead to large absolute and relative errors in the approximate solution.

60 APPLIED LIFE SCIENCES↗

Scalable Bayesian optimization with randomized prior networks

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment. Bayesian Optimization (BO) techniques are known to be effective in tackling global optimization problems using a relatively small number objective function evaluations, but their performance suffers when dealing with high-dimensional outputs. To overcome the major challenge of dimensionality, here we propose a deep learning framework for BO and sequential decision making based on bootstrapped ensembles of neural architectures with randomized priors. Using appropriate architecture choices, we show that the proposed framework can approximate functional relationships between design variables and quantities of interest, even in cases where the latter take values in high-dimensional vector spaces or even infinite-dimensional function spaces. In the context of BO, we augmented the proposed probabilistic surrogates with re-parameterized Monte Carlo approximations of multiple-point (parallel) acquisition functions, as well as methodological extensions for accommodating black-box constraints and multi-fidelity information sources. We test the proposed framework against state-of-the-art methods for BO and demonstrate superior performance across several challenging tasks with high-dimensional outputs, including a constrained multi-fidelity optimization task involving shape optimization of rotor blades in turbo-machinery.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Quantification Enabled by Automatic Differentiation for Hydrodynamic Simulation of Shock‐to‐Detonation Transition in High Explosives

Quantifying the effects of uncertainty in a reactive burn model on the run-to-detonation time in high explosives (HEs) provides a robust methodology for assessing the probability of an HE failing the IHE qualification standard. Moreover, uncertainty quantification helps evaluate whether the model calibration accurately represents data outside the calibration set. This study uses a specialized hydrodynamic simulation code for modeling detonation to determine the run-to-detonation time of the HE PBX 9502 for various impact velocities. To quickly approximate uncertainties in the model, a surrogate was constructed using a Taylor series expansion centered at the mean of the input parameters. To obtain the sensitivities required for constructing the Taylor series, HYP-percomplex Automatic Differentiation (HYPAD) was implemented. HYPAD is a methodology for infusing existing codes with automatic differentiation capabilities by augmenting variables with one or more imaginary units to compute step-size independent partial derivatives. These derivatives are accurate to machine precision with respect to the implemented numerical algorithm, meaning their accuracy reflects that of the underlying method (e.g., integration or discretization schemes). Using reduced order modeling techniques, the mean and standard deviation of the run-to-detonation time of a shock within PBX 9502 were computed for a number of initial impact velocities. A weighted least squares regression was then performed to obtain a best fit curve and prediction interval for the computed statistics. Historical data points from explosively driven wedge tests were utilized to validate the prediction interval, ensuring its reliability in predicting future outcomes. With this prediction interval and a known safety constraint curve, the most probable point of failure and the probability of failure for the HE PBX 9502 were determined.

97 MATHEMATICS AND COMPUTING↗

A hybrid numerical and machine learning framework for evaluating the performance of a 780 cm 2 aqueous organic redox flow battery

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low capacity degradation in 10 cm2 cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier for commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm 2 DHP-based AORFB by combining physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical quantities and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. These combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks the first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE↗

Adsorption of Natural Gas in Metal–Organic Frameworks: Selectivity, Cyclability, and Comparison to Methane Adsorption

Evaluation of metal–organic frameworks (MOFs) for adsorbed natural gas (ANG) technology employs pure methane as a surrogate for natural gas (NG). This approximation is problematic, as it ignores the impact of other heavier hydrocarbons present in NG, such as ethane and propane, which generally have more favorable adsorption interactions with MOFs compared to methane. Herein, using quantitative Raman spectroscopic analysis and Monte Carlo calculations, we demonstrate the adsorption selectivity of high-performing MOFs, such as MOF-5, MOF-177, and SNU-70, for a methane and ethane mixture (95:5) that mimics the composition of NG. The impact of selectivity on the storage and deliverable capacities of these adsorbents during successive cycles of adsorption and desorption, simulating the filling and emptying of an ANG tank, is also demonstrated. Finally, the study reveals a gradual reduction in the storage performance of MOFs, particularly with smaller pore volumes, due to ethane accumulation over long-term cycling, until a steady state is reached with substantially degraded storage performance.

03 NATURAL GAS↗

Navigating Uncertainty: Challenges in Visualizing Ensemble Data and Surrogate Models for Decision Systems

Uncertainty visualization plays a critical role in transforming ensemble simulation data into actionable insights by effectively communicating various dimensions of uncertainty within a system. The emergence of artificial intelligence-driven surrogate models trained on multirun ensemble data offers a transformative opportunity to replace computationally intensive simulations with fast estimates, enabling users to explore data spaces with unprecedented depth and interactivity. However, integrating ensemble data and surrogate models into decision-making workflows and tools introduces novel challenges for uncertainty visualization. These include reconciling and clearly communicating the unique uncertainties associated with ensembles and their surrogate model estimates, and leveraging these approximations to inform actionable decisions. This work explores these challenges in the context of high-dimensional data visualization, bridging discrete datasets with their continuous representations and addressing the complexities of systems that support iterative navigation between input and output spaces. We evaluate the role of uncertainty visualization in fostering intuitive, actionable interactions and identify critical hurdles in advancing this frontier of computational simulation.

97 MATHEMATICS AND COMPUTING↗

Evaluating large scale aqueous organic redox flow battery performance with a hybrid numerical and machine learning framework

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low-capacity degradation in 10 cm$^2$ cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier to commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm$^2$ DHP-based AORFB by combining a physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. Such combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE↗

Airborne Simulation of Launch Vehicle Dynamics

In this paper we present a technique for approximating the short-period dynamics of an exploration-class launch vehicle during flight test with a high-performance surrogate aircraft in relatively benign endoatmospheric flight conditions. The surrogate vehicle relies upon a nonlinear dynamic inversion scheme with proportional-integral feedback to drive a subset of the aircraft states into coincidence with the states of a time-varying reference model that simulates the unstable rigid body dynamics, servodynamics, and parasitic elastic and sloshing dynamics of the launch vehicle. The surrogate aircraft flies a constant pitch rate trajectory to approximate the boost phase gravity-turn ascent, and the aircraft's closed-loop bandwidth is sufficient to simulate the launch vehicle's fundamental lateral bending and sloshing modes by exciting the rigid body dynamics of the aircraft. A novel control allocation scheme is employed to utilize the aircraft's relatively fast control effectors in inducing various failure modes for the purposes of evaluating control system performance. Sufficient dynamic similarity is achieved such that the control system under evaluation is optimized for the full-scale vehicle with no changes to its parameters, and pilot-control system interaction studies can be performed to characterize the effects of guidance takeover during boost. High-fidelity simulation and flight test results are presented that demonstrate the efficacy of the design in simulating the Space Launch System (SLS) launch vehicle dynamics using NASA Dryden Flight Research Center's Full-scale Advanced Systems Testbed (FAST), a modified F/A-18 airplane, over a range of scenarios designed to stress the SLS's adaptive augmenting control (AAC) algorithm.

Gilligan, Eric T.↗

Airborne Simulation of Launch Vehicle Dynamics

In this paper we present a technique for approximating the short-period dynamics of an exploration-class launch vehicle during flight test with a high-performance surrogate aircraft in relatively benign endoatmospheric flight conditions. The surrogate vehicle relies upon a nonlinear dynamic inversion scheme with proportional-integral feedback to drive a subset of the aircraft states into coincidence with the states of a time-varying reference model that simulates the unstable rigid body dynamics, servodynamics, and parasitic elastic and sloshing dynamics of the launch vehicle. The surrogate aircraft flies a constant pitch rate trajectory to approximate the boost phase gravity turn ascent, and the aircraft's closed-loop bandwidth is sufficient to simulate the launch vehicle's fundamental lateral bending and sloshing modes by exciting the rigid body dynamics of the aircraft. A novel control allocation scheme is employed to utilize the aircraft's relatively fast control effectors in inducing various failure modes for the purposes of evaluating control system performance. Sufficient dynamic similarity is achieved such that the control system under evaluation is configured for the full-scale vehicle with no changes to its parameters, and pilot-control system interaction studies can be performed to characterize the effects of guidance takeover during boost. High-fidelity simulation and flight-test results are presented that demonstrate the efficacy of the design in simulating the Space Launch System (SLS) launch vehicle dynamics using the National Aeronautics and Space Administration (NASA) Armstrong Flight Research Center Fullscale Advanced Systems Testbed (FAST), a modified F/A-18 airplane (McDonnell Douglas, now The Boeing Company, Chicago, Illinois), over a range of scenarios designed to stress the SLS's Adaptive Augmenting Control (AAC) algorithm.

airborne simulation↗

Adaptive resource allocation for surrogate modeling of systems comprised of multiple disciplines with varying fidelity

We present an adaptive algorithm for constructing surrogate models for integrated systems composed of a set of coupled components. With this goal we introduce ‘coupling’ variables with a priori unknown distributions that allow approximations of each component to be built independently. Once built, the surrogates of the components are combined and used to predict system-level quantities of interest (QoI) at a fraction of the cost of interrogating the full system model. We use a greedy experimental design procedure, based upon a modification of Multi-Index Stochastic Collocation (MISC), to minimize the error of the combined surrogate. This is achieved by refining each component surrogate in accordance with its relative contribution to error in the approximation of the system-level QoI. Our adaptation of MISC is a multi-fidelity procedure that can leverage ensembles of models of varying cost and accuracy, for one or more components, to produce estimates of system-level QoI. Several numerical examples demonstrate the efficacy of the proposed approach on systems involving feed-forward and feedback coupling. For a fixed computational budget, the proposed algorithm is able to produce approximations that are orders of magnitude more accurate than approximations that treat the integrated system as a black-box.

97 MATHEMATICS AND COMPUTING↗

A linear surrogate for optimising functions of an orthogonal matrix with applications in wave function theory

The technique of surrogate optimisation is to use a simpler function to approximate a complex function that is time-consuming to evaluate. Here we show that the maximum of a special type of surrogate function f(U)=Tr(AU),UϵO(n) is at A T (AA T ) 1/2 , and that there is one and only one local maximum both in SO(n) and O(n)–SO(n). This function f(U) has been found to be useful in various aspects of electronic structure theory, including proving the Carlson-Keller theorem, and localising orbitals. As one other example, we apply it here to optimise the ground state of molecules using the Generalised Valence Bond wavefunction.

74 ATOMIC AND MOLECULAR PHYSICS↗

Machine-Learning Accelerated Studies of Materials with High Performance and Edge Computing

In the studies of materials, experimental measurements often serve as the reference to verify physics theory and modeling; while theory and modeling provide a fundamental understanding of the physics and principles behind. However, the interactions and cross validation between them have long been a challenge even to-date. Not only that inferring a physics model from experimental data is itself a difficult inverse problem, another major challenge is the orders-of-magnitude longer wall-clock time required to carry out high-fidelity computer modeling to match the timescale of experiments. We envisage that by combining high performance computing, data science, and edge computing technology, the current predicament can be alleviated, and a new paradigm of data-driven physics research will open up. For example, we can accelerate computer simulations by first performing the large-scale modeling on high performance computers and train a machine-learned surrogate model. This computationally inexpensive surrogate model can then be transferred to the computing units residing closely to the experimental facilities to perform high-fidelity simulations at a much higher throughout. The model will also be more amenable to analyzing and validating experimental observations in comparable time scales at a much lower computational cost. Further integration of these accelerated computer simulations with an outer machine learning loop can also inform and direct future experiments, while making the inverse problem of physics model inference more tractable. We will demonstrate a proof-of-concept by using a quantum Monte Carlo application, Dynamical Cluster Approximation (DCA++), to machine-learn a surrogate model and accelerate the study of quantum correlated materials.

Li, Ying Wai↗

Conceptual Design of Integrated Energy Systems with Market Interaction Surrogate Models

Most integrated energy system (IES) optimization frameworks employ the price-taker approximation, which ignores important interactions with the market and can result in overestimated economic values. In this work, we propose a machine learning surrogate-assisted optimization framework to quantify IES/market interactions and thus go beyond price-taker. We use time series clustering to generate representative IES operation profiles for the optimization problem and use machine learning surrogate models to predict the IES/market interaction. We quantify the accuracy of the time series clustering and surrogate models in a case study to optimally retrofit a nuclear power plant with a polymer electrolyte membrane electrolyzer to co-produce electricity and hydrogen.

Chen, Xinhe↗