Surrogate Models for Analyzing Performance Behavior of HPC Applications Using the RAJA Performance Suite
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Conference abstract being submitted by the University of Michigan in collaboration with INL
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Here, we propose a methodology for improving the accuracy of surrogate models of the observable response of physical systems as a function of the systems’ spatially heterogeneous parameter fields, with applications to uncertainty quantification and parameter estimation in high-dimensional problems. Practitioners often formulate finite-dimensional representations of spatially heterogeneous parameter fields using truncated unconditional Karhunen–Loève expansions (KLEs) for a certain choice of unconditional covariance kernel and construct surrogate models of the observable response with respect to the KLE coefficients. When direct measurements of the parameter fields are available, we propose improving the accuracy of these surrogate models by representing the parameter fields via conditional Karhunen-Loève expansions (CKLEs). CKLEs are constructed by conditioning the covariance kernel of the unconditional expansion on the direct measurements of the parameter field via Gaussian process regression, and then truncating the corresponding KLE. We apply the proposed methodology to constructing surrogate models via the Basis Adaptation (BA) method of the stationary hydraulic head response, measured at spatially discrete observation locations, of a groundwater flow model of the Hanford Site, as a function of the 1000-dimensional representation of the model’s log-transmissivity field. We find that BA surrogate models of the hydraulic head based on CKLEs are more accurate than BA surrogate models based on unconditional expansions for forward uncertainty quantification tasks. Furthermore, we find that inverse estimates of the hydraulic transmissivity field computed using CKLE-based BA surrogate models are more accurate than those computed using unconditional BA surrogate models.
An investigation utilizing Reynolds-averaged simulations (RAS) was performed in order to demonstrate the use of design and analysis of computer experiments (DACE) methods in Sandia’s DAKOTA software package for surrogate modeling and optimization. These methods were applied to a flow- path fueled with an interdigitated flushwall injector suitable for scramjet applications at hyper- velocity conditions and ascending along a constant dynamic pressure flight trajectory. The flight Mach number, duct height, spanwise width, and injection angle were the design variables selected to maximize two objective functions: the thrust potential and combustion efficiency. Because the RAS of this case are computationally expensive, surrogate models are used for optimization. To build a surrogate model a RAS database is created. The sequence of the design variables comprising the database were generated using a Latin hypercube sampling (LHS) method. A methodology was also developed to automatically build geometries and generate structured grids for each design point. The ensuing RAS analysis generated the simulation database from which the two objective functions were computed using a one-dimensionalization (1D) of the three-dimensional simulation data. The data were fitted using four surrogate models: an artificial neural network (ANN), a cubic polynomial, a quadratic polynomial, and a Kriging model. Variance-based decomposition showed that both objective functions were primarily driven by changes in the duct height. Multiobjective design optimization was performed for all four surrogate models via a genetic algorithm method. Optimal solutions were obtained at the upper and lower bounds of the flight Mach number range. The Kriging model predicted an optimal solution set that exhibited high values for both objective functions. Additionally, three challenge points were selected to assess the designs on the Pareto fronts. Further sampling among the designs of the Pareto fronts may be required to lower the surrogate model errors and perform more accurate surrogate-model-based optimization.
Production of low carbon gasoline-like fuels such as methanol-to-gasoline (MTG) is a promising approach to achieve rapid greenhouse gas emission reduction of the transportation sector. Despite the fact that gasoline that meets the ASTM D4814 standard for automotive spark-ignition engine fuel can be readily produced from these processes, it is unclear how the composition of MTG may affect engine performance and emissions. Here, in this paper, a surrogate for an MTG is used to numerically study the effects of gasoline composition on knock propensity and on the sensitivity of knock to thermal and fuel stratification, to oxygen dilution and to nitric oxide from exhaust gas recirculation of residual gases. Simulations were performed in ANSYS CHEMKIN-PRO using a comprehensive chemical kinetic mechanism for gasoline surrogates, and results of the MTG surrogate were compared against those of a petroleum-based regular E10 gasoline, termed PACE-20. A premium-grade MTG fuel was also formulated by adding ethanol to the MTG surrogate, and results were compared against those of four premium-grade, gasoline-like fuels representative of future alternative gasoline formulations. Surrogates and mechanism were evaluated by comparison against experimental engine data, and the model showed high accuracy at stoichiometric conditions (mean absolute error of ignition timing equal to 1.46 crank angle degrees) but larger deviations at lean conditions (mean absolute error of ignition timing equal to 5.52 crank angle degrees). Despite the fact that the MTG surrogate has a RON 1.1 units higher than that of PACE-20, it may show higher knock propensity at medium temperature conditions due to a less intense NTC behavior. MTG autoignition was more temperature- and equivalence ratio-sensitive than that of PACE20, suggesting that MTG can benefit more from naturally-occurring thermal stratification or from induced fuel stratification of the end gas to mitigate knock intensity. The sensitivity of autoignition reactivity to oxygen dilution and to NO concentration was higher for MTG than for regular gasoline at medium loads, but the opposite trend was observed at high loads due to the effect of pressure on the low-temperature chemistry of regular gasoline. Approximately 14 % vol ethanol content was required to upgrade the octane rating of MTG from regular grade to premium grade. Adding 13.6 % vol ethanol made the fuel autoignition less sensitive to both oxygen dilution and NO content (ignition time varies approx. 17 % and 50 % less with oxygen dilution and NO addition, respectively, when adding ethanol at high engine loads).
In this article, we trained a machine learning (ML) model to connect microstructural details of an energetic material formulation to its performance for the purpose of guiding the discovery of new explosive formulations. Our hypothesis was that the algorithm would robustly learn the training data and produce an accurate surrogate model. Specifically, the algorithm learned the relationship between details of the void size distribution (VSD), initiating shock pressure, and the energetic material performance. We used realistic constraints on the VSD and a range of cases were ingested by a physically informed reactive flow model working within a hydrodynamic solver running on high-performance computing resources. The ML algorithm produced a surrogate model that accurately predicted known test points around the parameter space. In addition to the utility of the model and the process used for its development, we noted interesting comparisons between what we, the authors—subject matter experts, would heuristically conclude from the training data and the surrogate model predictions. We detected nuanced details that were missed by the surrogate model; however, these details are not important to an energetic material formulator. We concluded that the algorithm did indeed robustly learn the training data and produce an accurate surrogate model. We further concluded that the surrogate model is a powerful tool to guide the formulator in the absence of subject matter experts and limited-access computing resources.
To assess the reliability of critical technologies like nuclear plants and infrastructure systems and improve the robustness of design, engineers have to quantify the uncertainties surrounding the system behavior accurately. However, the complexity of the problem can make standard reliability analysis algorithms prohibitively expensive, primarily due to the high computational cost of estimating the system response at each iteration. This cost can be greatly reduced by using multi-fidelity modeling and machine learning to build a surrogate model to replace the expensive response function. We propose a general and robust method for building surrogates from multiple Low Fidelity (LF) models coupled with machine learning to retain accuracy. Our framework first constructs “Corrected Low Fidelity models” (CLFs) by coupling a High Fidelity (HF) model inferred Gaussian Process correction term with each of the LF models. It then uses the correction terms to assign model probabilities to each of these CLFs in an explainable way before using them to assemble the final surrogate. No assumptions are made about the type of the LF models or their correlation with the HF model. The proposed surrogate modeling framework is used within the subset simulation algorithm (a variance-reduced MCMC-based reliability analysis algorithm) for enhanced efficiency. Additionally, an active learning step is added to the algorithm to adaptively decide when the surrogate is not sufficiently accurate, at which point the HF model is called and used to refine the surrogate. Through a frame buckling example, our method is shown to be highly efficient at reducing the expensive HF model calls while accurately estimating the failure probability.
Optimization is a promising candidate for studying the utility of variational quantum algorithms (VQAs). However, evaluating cost functions using quantum hardware introduces runtime overheads that limit exploration. Surrogate-based methods can reduce calls to a quantum computer, yet existing approaches require hyperparameter pre-training and have been tested only on small problems. Here, we show that surrogate-based methods can enable successful optimization at scale, without pre-training, by using radial basis function interpolation (RBF) to construct an adaptive, hyperparameter-free surrogate. Using the surrogate as an acquisition function drives hardware queries to the vicinity of the true optima. For 16-qubit random 3-regular Max-Cut instances with the Quantum Approximate Optimization Algorithm (QAOA), our method outperforms state-of-the-art approaches, without considering their upfront training costs. Furthermore, we successfully optimize QAOA circuits for 127-qubit random Ising models on an IBM processor using 10 4 −10 5 measurements. Strong empirical performance demonstrates the promise of automated surrogate-based learning for large-scale VQA applications.
We report numerical homogenization enables efficient computational analysis and design of multiscale structures made of micro-architected materials including lattice unit cells. However, predicting yield is nontrivial because it requires accurate and efficient predictions of the maximum stress inside the homogenized unit cells. To address this challenge, we develop a macroscale anisotropic yield function for micro-architected materials. The yield function depends on the three-dimensional macroscale stress state and the parameters describing a family of micro-architectures, such as the radii of the struts in a lattice unit cell. To ensure accuracy, we determine the maximum stress using three-dimensional continuum finite-element analysis. To ensure efficiency, we construct surrogate models from the aforementioned high-fidelity results for yield prediction. To reduce simulation costs and surrogate modeling complexity, we leverage orthotropic symmetry commonly found in lattice unit cells. In this paper, we provide a thorough presentation of group representations and the systematic procedure to exploit orthotropic domain symmetry in homogenization and surrogate modeling. We illustrate the use of linear homogenization results to predict yield in specific unit cells without further simulations. We furthermore show that surrogate modeling presents a viable option for anisotropic yield prediction in a continuously parametrized family of micro-architectures. More specifically, despite the dimensionality and degree of nonlinearity in the maximum micro von Mises stress within the unit cell, the surrogate models can predict it with less than 5% error at least 90% of the time. Moreover, the largest under-prediction error, which is more critical than the over-prediction error, is typically less than 10%.
The computational cost of high-fidelity numerical models makes outer-loop analysis, which requires repeated interrogation of the model such as uncertainty quantification, computationally demanding. Multi-fidelity methods, which construct a surrogate model using data from an ensemble of models of varying cost and accuracy, can substantially reduce the cost of outer-loop analysis. However, these methods can be difficult to apply when the model ensemble does not admit a clear hierarchy a priori and the correlations between models are low. Consequently, in this paper, we present a multi-fidelity method that leverages dimension reduction to enhance the correlation between models, thereby reducing the amount of data needed to train a surrogate from an unordered ensemble of models. Our method utilizes basis adaptation to build low-dimensional polynomial chaos expansions of each model and employs Multi-fidelity Networks to encode the relationships among models. We show that the resulting method exhibit two notable advantages over its counterpart: (1) enhanced accuracy (both reduced bias and variance); and (2) reduced dependency on the graph structure encoding relationships among models. We demonstrate the approach on an analytical test problem and a challenging finite element model for a spent nuclear fuel. Our method produces a surrogate model that is significantly more accurate than either a single-fidelity surrogate or a multi-fidelity surrogate constructed without basis adaptation.