Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parametric surrogate model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Machine learning for nonintrusive model order reduction of the parametric inviscid transonic flow past an airfoil

Fluid flow in the transonic regime finds relevance in aerospace engineering, particularly in the design of commercial air transportation vehicles. Computational fluid dynamics models of transonic flow for aerospace applications are computationally expensive to solve because of the high degrees of freedom as well as the coupled nature of the conservation laws. While these issues pose a bottleneck for the use of such models in aerospace design, computational costs can be significantly minimized by constructing special, structure-preserving surrogate models called reduced-order models. In this work, we propose a machine learning method to construct reduced-order models via deep neural networks and we demonstrate its ability to preserve accuracy with a significantly lower computational cost. In addition, our machine learning methodology is physics-informed and constrained through the utilization of an interpretable encoding by way of proper orthogonal decomposition. Application to the inviscid transonic flow past the RAE2822 airfoil under varying freestream Mach numbers and angles of attack, as well as airfoil shape parameters with a deforming mesh, shows that the proposed approach adapts to high-dimensional parameter variation well. Notably, the proposed framework precludes the knowledge of numerical operators utilized in the data generation phase, thereby demonstrating its potential utility in the fast exploration of design space for diverse engineering applications. Comparison against a projection-based nonintrusive model order reduction method demonstrates that the proposed approach produces comparable accuracy and yet is orders of magnitude computationally cheap to evaluate, despite being agnostic to the physics of the problem.

97 MATHEMATICS AND COMPUTING↗

PALMO: An OVERFLOW Machine Learning Airfoil Performance Database

The OVERFLOW Machine Learning Airfoil Performance (PALMO) database has been created to enable robust modeling of airfoil performance in a variety of applications. The database uses OVERFLOW simulation data second-order accurate in time and fourth-order accurate in space with Spalart-Allmaras turbulence closure. The foundation of the in-development PALMO database is the airfoil base cube. Each base cube includes simulation data parametrized over a range of Mach numbers, Reynolds numbers, and angles-of-attack. This first release of the database includes the NACA 4-series airfoils, with parametrization in airfoil thickness and camber from an NACA 0006 to an NACA 4424. In total, 52,480 NACA 4-series calculations were run on the NASA High-End Compute Capability (HECC) supercomputer and the corresponding airfoil performance coefficients are embedded in the Appendix of this document for public distribution. This provides high-order-accurate simulation data covering a wide range of aerospace design applications, which enables users to develop OVERFLOW-quality airfoil performance look-up tables without additional high-performance computing. In addition to engineering design and analysis of aerospace vehicles, PALMO is well suited to be a benchmark dataset for the development and testing of machine learning methods in aerospace engineering. Downstream surrogate models enable OVERFLOW- quality airfoil performance predictions for any arbitrary combination of camber, thickness, Mach number, Reynolds number, and angle-of-attack within the bounds of the database.

Database↗

Cross sections for neutron-induced reactions from surrogate data: Reexamining the Weisskopf-Ewing approximation for ( n , n ' ) and ( n , 2 n ) reactions

Background: Modeling nuclear reaction networks for nuclear science applications and for simulations of astrophysical environments relies on cross section data for a vast number of reactions, many of which have never been measured. Cross sections for neutron-induced reactions on unstable nuclei are particularly scarce, since they are the most difficult to measure. Consequently, we must rely on theoretical predictions or indirect measurements to obtain the requisite reaction data. For compound nuclear reactions, the surrogate reaction method can be used to determine many cross sections of interest. Purpose: Earlier work has demonstrated that cross sections for neutron-induced fission and radiative neutron capture can be determined from a combination of surrogate reaction data and theory. For the fission case, it was shown that the Weisskopf-Ewing approximation, which significantly simplifies the implementation of the surrogate method, can be employed. Capture cross sections cannot be obtained, and require a detailed description of the surrogate reaction process. Here, we examine the validity of the Weisskopf-Ewing approximation for determining unknown (n, n') and (n, 2n) cross sections from surrogate data. Methods: Using statistical reaction calculations with realistic parametrizations, we investigate first whether the assumptions underlying the Weisskopf-Ewing approximation are valid for (n, n') and (n, 2n) reactions on representative target nuclei. We then produce simulated surrogate reaction data and assess the impact of applying the Weisskopf-Ewing approximation when extracting (n, n') and (n, 2n) cross sections in situations where the approximation is not strictly justified. Results: We find that peak cross sections can be estimated using the Weisskopf-Ewing approximation, but the shape of the (n, n') and (n, 2n) cross sections, especially for low neutron energies, cannot be reliably determined without accounting for the angular-momentum differences between the neutron-induced and surrogate reaction. Conclusions: To obtain reliable (n, n') and (n, 2n) cross sections from surrogate reaction data, a detailed description of the surrogate reaction mechanisms is required. To do so for the compound-nucleus energies and decay channels relevant to these reactions, it becomes necessary to extend current modeling capabilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Characterization of Swirl-Venturi Lean Direct Injection Designs for Aviation Gas-Turbine Combustion

Injector geometry, physical mixing, chemical processes, and engine cycle conditions together govern performance, operability and emission characteristics of aviation gas-turbine combustion systems. The present investigation explores swirl-venturi lean direct injection combustor fundamentals, characterizing the influence of key geometric injector parameters on reacting flow physics and emission production trends. In this computational study, a design space exploration was performed using a parameterized swirl-venturi lean direct injector model. From the parametric geometry, 20 three-element lean direct injection combustor sectors were produced and simulated using steady-state, Reynolds-averaged Navier-Stokes reacting computations. Species concentrations were solved directly using a reduced 18-step reaction mechanism for Jet-A. Turbulence closure was obtained using a nonlinear κ-ε model. Results demonstrate sensitivities of the geometric perturbations on axially averaged flow field responses. Output variables include axial velocity, turbulent kinetic energy, static temperature, fuel patternation and minor species mass fractions. Significant trends have been reduced to surrogate model approximations, intended to guide future injector design trade studies and advance aviation gas-turbine combustion research.

Combustion Chamber↗

Numerical Investigation of a Central Fuel Property Hypothesis under Boosted Spark-ignition Conditions

In the present work, a central fuel property hypothesis (CFPH), which states that fuel properties are sufficient to provide an indication of a fuel's performance irrespective of its chemical composition, was numerically investigated In particular, the objective of the study was to determine whether Research Octane Number (RON) and Motor Octane Number (MON), as fuel properties, are sufficient to describe a fuel's knock-limited performance under boosted spark-ignition (SI) conditions within the framework of CFPH. To this end, four TPRF-bioblendstock surrogates having different compositions but matched RON (= 98) and MON (= 90), were first generated using a non-linear regression model based on artificial neural network (ANN). Three unconventional bioblendstocks were included in the analysis: Di-isobutylene (DIB), Isobutanol and Anisole. Skeletal reaction mechanisms were generated for the TPRF-DIB, TPRF-isobutanol and TPRF-anisole blends from a detailed kinetic mechanism. Thereafter, numerical simulations were performed for the fuel surrogates using the skeletal mechanisms and a virtual cooperative fuel research (CFR) engine model, under a representative boosted operating condition. In the computational fluid dynamics (CFD) model, the G-equation approach was employed to track the turbulent flame front and the well-stirred reactor model combined with multi-zone binning strategy was used to capture auto-ignition in the end-gas. In addition, laminar flame speed was tabulated for each blend as a function of pressure, temperature and equivalence ratio a priori, and the lookup tables were used to prescribe laminar flame speed as an input to the G-equation model. Parametric spark timing sweeps were performed for each fuel blend to determine the corresponding knock-limited spark advance (KLSA) and 50% burn point (CA50) at the respective KLSA timing. It was observed that despite same RON, MON and engine operating conditions, the TPRF-Anisole blend exhibited markedly different knock-limited performance from the other three blends. This deviation from the octane index (DI) expectation was shown to be caused by differences in laminar flame speed (LFS). However; it was found that relatively large fuel-specific differences in LFS (> 20%) would have to be present to cause any appreciable deviation from the 01 framework. Otherwise, RON and MON would still be robust enough to predict a fuel's knock-limited performance.

Pal, Pinaki↗

Numerical Investigation of a Central Fuel Property Hypothesis Under Boosted Spark-Ignition Conditions

In the present work, a central fuel property hypothesis (CFPH), which states that fuel properties are sufficient to provide an indication of a fuel’s performance irrespective of its chemical composition, was numerically investigated. In particular, the objective of the study was to determine whether Research Octane Number (RON) and Motor Octane Number (MON), as fuel properties, are sufficient to describe a fuel’s knock-limited performance under boosted spark-ignition (SI) conditions within the framework of CFPH. To this end, four TPRF-bioblendstock surrogates having different compositions but matched RON (=98) and MON (=90), were first generated using a non-linear regression model based on artificial neural network (ANN). Additionally, three unconventional bioblendstocks were included in the analysis: di-isobutylene (DIB), isobutanol, and Anisole. Skeletal reaction mechanisms were generated for the TPRF-DIB, TPRF-isobutanol, and TPRF-anisole blends from a detailed kinetic mechanism. Thereafter, numerical simulations were performed for the fuel surrogates using the skeletal mechanisms and a virtual cooperative fuel research (CFR) engine model, under a representative boosted operating condition. In the computational fluid dynamics (CFD) model, the G-equation approach was employed to track the turbulent flame front and the well-stirred reactor model combined with the multi-zone binning strategy was used to capture auto-ignition in the end-gas. In addition, laminar flame speed (LFS) was tabulated for each blend as a function of pressure, temperature, and equivalence ratio a priori, and the lookup tables were used to prescribe laminar flame speed as an input to the G-equation model. Parametric spark timing sweeps were performed for each fuel blend to determine the corresponding knock-limited spark advance (KLSA) and 50% burn point (CA50) at the respective KLSA timing. It was observed that despite same RON, MON, and engine operating conditions, the TPRF-anisole blend exhibited markedly different knock-limited performance from the other three blends. This deviation from the octane index (OI) expectation was shown to be caused by differences in laminar flame speed. However, it was found that relatively large fuel-specific differences in LFS (>20%) would have to be present to cause any appreciable deviation from the OI framework. Otherwise, RON and MON would still be robust enough to predict a fuel’s knock-limited performance.

42 ENGINEERING↗

Probability Bounds Analysis Applied to Multi-Purpose Crew Vehicle Nonlinearity

The Multi-Purpose Crew Vehicle (MPCV) Program Orion vehicle finite element model (FEM) was updated based on a modal test performed by Lockheed Martin. Due to nonlinearity observed in the test results, linear low force level (LL) and high force level (HL) FEMs were developed for use during various Space Launch System (SLS) flight regimes depending on expected forcing levels. Uncertainty models were derived for the combined MPCV and MPCV Stage Adaptor LL and HL Hurty/Craig-Bampton (HCB) components based on the MPCV structural test article Configuration 4 modal test-analysis correlation results. Subsequently, system-level uncertainty quantification analyses were performed using both models for various SLS flight configurations to determine the impact of the nonlinearity on important system metrics. The system metrics included both transfer functions associated with attitude control and dynamic loads associated with aerodynamic buffeting during ascent. In each case, an independent Monte Carlo (MC) analysis was performed, and no attempt was made to combine the results. The Hybrid Parametric Variation (HPV) method was used to develop the LL and HL MPCV HCB uncertainty models. The HPV method provides both parametric and non-parametric components of uncertainty. The non-parametric uncertainty accounts for the difference in model-form between the linearized analytical model and the corresponding linearized component test results in the form of mode shapes and frequencies at that force level. This linear model-form uncertainty is implemented in the HPV method using random matrix theory. However, the HPV uncertainty models developed for the linear LL and HL MPCV components do not account for the nonlinearity in the MPCV. With respect to the linearized models, this nonlinearity is also an uncertainty in model form, but in this case, it must be treated independently as an epistemic uncertainty. It represents a lack of knowledge, in contrast to an aleatory uncertainty due to the randomness of a variable. In the case of an epistemic variable, the true value is unknown, only the interval within which it lies is known. Epistemic uncertainty can be reduced with increased knowledge, while in general, aleatory uncertainty cannot. This work combines the epistemic uncertainty due to the MPCV nonlinearity with the parametric and non-parametric uncertainty within the HPV method using a second order propagation approach. The LL and HL test data is augmented with surrogate test data derived from a nonlinear MPCV representation. The impact of the MPCV nonlinearity on system response statistics is determined using a series of cumulative distribution functions in the form of a horsetail plot, or p-box. This results in an interval of probabilities for a specific response value, or an interval of response values at a specific probability.

Daniel C Kammer↗

Symplectic neural network and its application to charged particle dynamics in electromagnetic fields

Recently, machine learning models have shown many successes in various applications in science and technology. In this work, we focus on the charged particle dynamics, with the development of a class of symplectic neural networks, including a linear version, SympMat, and a nonlinear version, HénonNet. Both are designed to preserve the structure of Hamiltonian systems. We show that they can be used to model relevant Hamiltonian systems of interest in plasma physics and astrophysics, for linear and nonlinear charged particle dynamics, with the potential to bridge multi-scale simulations. These symplectic neural networks are adapted to the applications in plasma simulations and particle-wave interaction with parametric dependence and periodicity, where we have investigated their performance and accuracy. In particular, SympMat is shown to outperform the traditional Boris particle pusher down to the sub-gyroperiod scale in the case of charged particles in uniform magnetic fields. HénonNet successfully predicts the hot electron distribution, which is validated against theoretical results. These results highlight the potential of symplectic neural networks as a trajectory integrator for particle-in-cell simulations or a fast surrogate to replace conventional numerical schemes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Fast Computational Algorithms for Partial Differential Equations and Uncertainty Quantifications

This project concerned the construction, testing and analysis of computational algorithms for solving parameterized and stochastic partial differential equations. The study and understanding of equations of this type is of fundamental importance in numerous engineering and scientific applications. Examples include simulation of plasma dynamics in models of electric propulsion and nuclear fusion, simulation of multiphase flows, such as the flow of water, gas and oil in reservoirs, and structural analysis of the dependence of structures on materials. Parametrization is used in such settings when properties of the models such as viscosity of fluids or electric resistivity of materials are not precisely understood and instead are treated as random variables. The resulting solutions are themselves random, and having such solutions will enable engineers to use probabilistic methods to assess the likelihood of events, for example, whether a pollutant in a liquid will exceed a limit, and to use such analyses to develop ways to ensure positive outcomes. Construction of accurate (high resolution) computational solutions is expensive, requiring significant computer time and computational resources, and there is need to reduce computational cost to make simulation useful and effective. The aim of the project was to construct algorithms to efficiently compute surrogate solutions to parameterized problems to allow for efficient and accurate simulation. The technical approach used focused on two related strategies, based on rank-reduction methods and reduced-order models. These methods construct surrogate solutions of parameter-dependent models by projection or interpolation into low-dimensional approximation spaces. Cost savings are achieved if the low-dimensional spaces can be identified and constructed efficiently and if the resulting low-dimensional algebraic systems can be solved cheaply. Accomplishments include: Theoretical and empirical demonstration of the effectiveness of fast multigrid solution strategies for computing low-rank representations of parameter-dependent solutions to discrete partial differential equations, including the first proof establishing so-called textbook convergence properties for low-rank methods. Development of efficient solution algorithms for solving nonlinear parameter-dependent partial differential equations used in models of fluid dynamics. Developent of efficient algorithms for low-rank representation of solutions of time-dependent simulations of fluid dynamics using multi-dimensional tensor representations of solutions.

97 MATHEMATICS AND COMPUTING↗

A Boundary Topology Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing

Minimizing the mass in electric machines while maintaining superior performance has become a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization for light-weighting electric machines using traditional approaches typically explore a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods like cell-based density approaches suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary TO where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the IEA-15MW radial flux direct-drive wind turbine generator. The free-from boundary TO resulted in smooth and concise shapes that can be easily additively manufactured with upto 20-ton reduction in electrical steel mass.

additive manufacturing↗

Comparative Study of Differentially Private Data Synthesis Methods

When sharing data among researchers or releasing data for public use, there is a risk of exposing sensitive information of individuals in the data set. Data synthesis is a statistical disclosure limitation technique for releasing synthetic data sets with pseudo individual records. Traditional data synthesis techniques often rely on strong assumptions of a data intruder’s behaviors and background knowledge to assess disclosure risk. Differential privacy (DP) formulates a theoretical approach for a strong and robust privacy guarantee in data release without having to model intruders’ behaviors. Efforts have been made aiming to incorporate the DP concept in the data synthesis process. Here, we examine current DIfferentially Private Data Synthesis (DIPS) techniques for releasing individual-level surrogate data for the original data, compare the techniques conceptually and evaluate the statistical utility and inferential properties of the synthetic data via each DIPS technique through extensive simulation studies. Our work sheds light on the practical feasibility and utility of the various DIPS approaches, and suggests future research directions for DIPS.

97 MATHEMATICS AND COMPUTING↗

A New Shape Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing: Preprint

Minimizing the mass in electric machines while maintaining superior performance is a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization (TO) for lightweighting electric machines using traditional approaches typically explores a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods, such as cell-based density approaches, suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary TO where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning-based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque, and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the International Energy Agency (IEA) 15-MW radial flux direct-drive wind turbine generator. The free-form boundary TO resulted in smooth and concise shapes that can be easily additively manufactured with up to a 20-ton reduction in electrical steel mass.

additive manufacturing↗

A New Shape Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing

Minimizing the mass in electric machines while maintaining superior performance is a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization (TO) for lightweighting electric machines using traditional approaches typically explores a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods, such as cell-based density approaches, suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary optimization where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning-based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque, and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the International Energy Agency (IEA) 15-MW radial flux direct-drive wind turbine generator. The new approach to shape optimization resulted in smooth and concise shapes that can be easily additively manufactured with up to a 20-ton reduction in electrical steel mass.

additive manufacturing↗

Effects of fuel composition and octane sensitivity on polycyclic aromatic hydrocarbon and soot emissions of gasoline–ethanol blend surrogates

The sooting propensity of a fuel is closely coupled with the fuel composition and chemistry. A detailed understanding of their effects is, therefore, needed to develop next-generation fuels which can minimize particulate emissions. With this overarching goal, the present work numerically investigates the effects of fuel composition and octane sensitivity (S) on polycyclic aromatic hydrocarbons (PAH) and soot emissions, for four-component gasoline-ethanol blend surrogates comprising isooctane, n-heptane, toluene, and ethanol. A partially-premixed counterflow flame is chosen as the canonical configuration for this study and simulations are performed using CHEMKIN-Pro-employing a kinetic mechanism developed by Park et al. (2017). In addition, a, detailed soot model based on the sectional method is used to capture the spatial characteristics of soot emissions. The kinetic mechanism and soot model are validated using available experimental data for various targets. A total of 86 TPRF-E mixtures, spanning a wide range of concentration of each component, and a wide range of S are analyzed. The effect of each non-paraffinic fuel component on the resultant PAH and soot emissions is investigated. PAH and soot emissions are found to vary significantly depending upon the blend composition. Additionally, based on the parametric sweeps, a regression analysis is carried out to identify global parameters that govern the formation of PAHs and soot. The analysis shows that both toluene content and S have a prominent effect on the formation of PAHs and soot, with toluene content having a stronger impact. Moreover, larger PAHs have higher dependency on toluene content and S. Furthermore, a detailed analysis is carried out to understand the physical and chemical phenomena associated with the observed trends of PAH and soot emissions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncertainty propagation in pore water chemical composition calculation using surrogate models

Performance assessment in deep geological nuclear waste repository systems necessitates an extended knowledge of the pore water chemical conditions prevailing in host-rock formations. In the last two decades, important progress has been made in the experimental characterization and thermodynamic modeling of pore water speciation, but the influence of experimental artifacts and uncertainties of thermodynamic input parameters are seldom evaluated. In this respect, we conducted an uncertainty propagation study in a reference geochemical model describing the pore water chemistry of the Callovian-Oxfordian clay formation. Nineteen model input parameters were perturbed, including those associated to experimental characterization (leached anions, exchanged cations, cation exchange selectivity coefficients) and those associated to generic thermodynamic databases (solubilities). A set of 13 quantities of interest were studied by the use of polynomial chaos expansions built non-intrusively with a least-squares forward stepwise regression approach. Training and validation sets of simulations were carried out using the geochemical speciation code PHREEQC. The statistical results explored the marginal distribution of each quantity of interest, their bivariate correlations as well as their global sensitivity indices. The influence of the assumed distributions for input parameters uncertainties was evaluated by considering two parametric domain sizes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Non-autoregressive time-series methods for stable parametric reduced-order models

Advection-dominated dynamical systems, characterized by partial differential equations, are found in applications ranging from weather forecasting to engineering design where accuracy and robustness are crucial. There has been significant interest in the use of techniques borrowed from machine learning to reduce the computational expense and/or improve the accuracy of predictions for these systems. These rely on the identification of a basis that reduces the dimensionality of the problem and the subsequent use of time series and sequential learning methods to forecast the evolution of the reduced state. Often, however, machine-learned predictions after reduced-basis projection are plagued by issues of stability stemming from incomplete capture of multiscale processes as well as due to error growth for long forecast durations. To address these issues, we have developed a non-autoregressive time series approach for predicting linear reduced-basis time histories of forward models. In particular, we demonstrate that non-autoregressive counterparts of sequential learning methods such as long short-term memory (LSTM) considerably improve the stability of machine-learned reduced-order models. Further, we evaluate our approach on the inviscid shallow water equations and show that a non-autoregressive variant of the standard LSTM approach that is bidirectional in the principal component directions obtains the best accuracy for recreating the nonlinear dynamics of partial observations. Moreover-and critical for many applications of these surrogates-inference times are reduced by three orders of magnitude using our approach, compared with both the equation-based Galerkin projection method and the standard LSTM approach.

97 MATHEMATICS AND COMPUTING↗

Projection pursuit adaptation on polynomial chaos expansions

Here, the present work addresses the issue of accurate stochastic approximations in high-dimensional parametric space using tools from uncertainty quantification (UQ). The basis adaptation method and its accelerated algorithm in polynomial chaos expansions (PCE) were recently proposed to construct low-dimensional approximations adapted to specific quantities of interest (QoI). The present paper addresses one difficulty with these adaptations, namely their reliance on quadrature point sampling, which limits the reusability of potentially expensive samples. Projection pursuit (PP) is a statistical tool to find the “interesting” projections in high-dimensional data and thus bypass the curse-of-dimensionality. In the present work, we combine the fundamental ideas of basis adaptation and projection pursuit regression (PPR) to propose a novel method to simultaneously learn the optimal low-dimensional spaces and PCE representation from given data. While this projection pursuit adaptation (PPA) can be entirely data-driven, the constructed approximation exhibits mean-square convergence to the solution of an underlying governing equation and thus captures the supports and probability distributions associated with the physics constraints. The proposed approach is demonstrated on a borehole problem and a structural dynamics problem, demonstrating the versatility of the method and its ability to discover low-dimensional manifolds with high accuracy with limited data. In addition, the method can learn surrogate models for different quantities of interest while reusing the same data set.

97 MATHEMATICS AND COMPUTING↗

Reliable extrapolation of deep neural operators informed by physics or sparse observations

Deep neural operators can learn nonlinear mappings between infinite-dimensional function spaces via deep neural networks. As promising surrogate solvers of partial differential equations (PDEs) for real-time prediction, deep neural operators such as deep operator networks (DeepONets) provide a new simulation paradigm in science and engineering. Pure data-driven neural operators and deep learning models, in general, are usually limited to interpolation scenarios, where new predictions utilize inputs within the support of the training set. However, in the inference stage of real-world applications, the input may lie outside the support, i.e., extrapolation is required, which may result to large errors and unavoidable failure of deep learning models. Here, we address this challenge of extrapolation for deep neural operators. First, we systematically investigate the extrapolation behavior of DeepONets by quantifying the extrapolation complexity, via the 2-Wasserstein distance between two function spaces and propose a new strategy of bias–variance trade-off for extrapolation with respect to model capacity. Subsequently, we develop a complete workflow, including extrapolation determination, and we propose five reliable learning methods that guarantee a safe prediction under extrapolation by requiring additional information—the governing PDEs of the system or sparse new observations. The proposed methods are based on either fine-tuning a pre-trained DeepONet or multifidelity learning. We demonstrate the effectiveness of the proposed framework for various types of parametric PDEs. Furthermore, our systematic comparisons provide practical guidelines for selecting a proper extrapolation method depending on the available information, desired accuracy, and required inference speed.

42 ENGINEERING↗