COMPARISONS BETWEEN HIGH-FIDELITY AND LOW-FIDELITY MODELING OF THE TURBULENT FLOW IN THE HIGH FLUX ISOTOPE REACTOR COOLING CHANNEL USING NEK5000-V17 AND STAR-CCM+
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Abstract not provided.
Presently the training of neural networks relies on data of comparable accuracy but in real applications only a very small set of high-fidelity data is available while inexpensive lower fidelity data may be plentiful. We propose a new composite neural network (NN) that can be trained based on multi-fidelity data. It is comprised of three NNs, with the first NN trained using the low-fidelity data and coupled to two high-fidelity NNs, one with activation functions and another one without, in order to discover and exploit nonlinear and linear correlations, respectively, between the low-fidelity and the high-fidelity data. We first demonstrate the accuracy of the new multi-fidelity NN for approximating some standard benchmark functions but also a 20-dimensional function that is not easy to approximate with other methods, e.g. Gaussian process regression. Subsequently, we extend the recently developed physics-informed neural networks (PINNs) to be trained with multi-fidelity data sets (MPINNs). MPINNs contain four fully-connected neural networks, where the first one approximates the low-fidelity data, while the second and third construct the correlation between the low- and high-fidelity data and produce the multi-fidelity approximation, which is then used in the last NN that encodes the partial differential equations (PDEs). Specifically, by decomposing the correlation into a linear and nonlinear part, the present model is capable of learning both the linear and complex nonlinear correlations between the low- and high-fidelity data adaptively. By training the MPINNs, we can: (1) obtain the correlation between the low- and high-fidelity data, (2) infer the quantities of interest based on a few scattered data, and (3) identify the unknown parameters in the PDEs. In particular, we employ the MPINNs to learn the hydraulic conductivity field for unsaturated flows as well as the reactive models for reactive transport. The results demonstrate that MPINNs can achieve relatively high accuracy based on a very small set of high-fidelity data. Despite the relatively low dimension and limited number of fidelities (two-fidelity levels) for the benchmark problems in the present study, the proposed model can be readily extended to very high-dimensional regression and classification problems involving multi-fidelity data.
In the traditional aerospace vehicle design process, each successive design phase is accompanied by an increment in the modeling fidelity of the disciplinary analyses being performed. This trend follows a corresponding shrinking of the design space as more and more design decisions are locked in. The correlated increase in knowledge about the design and decrease in design freedom occurs partly because increases in modeling fidelity are usually accompanied by significant increases in the computational expense of performing the analyses. When running high fidelity analyses, it is not usually feasible to explore a large number of variations, and so design space exploration is reserved for conceptual design, and higher fidelity analyses are run only once a specific point design has been selected to carry forward. The designs produced by this traditional process have been recognized as being limited by the uncertainty that is present early on due to the use of lower fidelity analyses. For example, uncertainty in aerodynamics predictions produces uncertainty in trajectory optimization, which can impact overall vehicle sizing. This effect can become more significant when trajectories are being shaped by active constraints. For example, if an optimal trajectory is running up against a normal load factor constraint, inaccuracies in the aerodynamic coefficient predictions can cause a feasible trajectory to be considered infeasible, or vice versa. For this reason, a trade must always be performed between the desired fidelity and the resources available. Apart from this trade between fidelity and computational expense, it is very desirable to use higher fidelity analyses earlier in the design process. A large body of work has been performed to this end, led by efforts in the area of surrogate modeling. In surrogate modeling, an up-front investment is made by running a high fidelity code over a Design of Experiments (DOE); once completed, the DOE data is used to create a surrogate model, which captures the relationships between input variables and responses into regression equations. Depending on the dimensionality of the problem and the fidelity of the code for which a surrogate model is being created, the initial DOE can itself be computationally prohibitive to run. Cokriging, a modeling approach from the field of geostatistics, provides a desirable compromise between computational expense and fidelity. To do this, cokriging leverages a large body of data generated by a low fidelity analysis, combines it with a smaller set of data from a higher fidelity analysis, and creates a kriging surrogate model with prediction fidelity approaching that of the higher fidelity analysis. When integrated into a multidisciplinary environment, a disciplinary analysis module employing cokriging can raise the analysis fidelity without drastically impacting the expense of design iterations. This is demonstrated through the creation of an aerodynamics analysis module in NASA’s OpenMDAO framework. Aerodynamic analyses including Missile DATCOM, APAS, and USM3D are leveraged to create high fidelity aerodynamics decks for parametric vehicle geometries, which are created in NASA’s Vehicle Sketch Pad (VSP). Several trade studies are performed to examine the achieved level of model fidelity, and the overall impact to vehicle design is quantified.
High-fidelity modeling is an essential design tool for many engineering applications. However, for complex systems, computational cost can be a limiting factor. Analyzing parameter sensitivity, uncertainty quantification, and design optimization require many model evaluations. Surrogate models are often used to develop the relationship between model parameters and quantities of interest. However, in the case of complex systems, surrogate models require several degrees of freedom and, thus, a large number of data points to determine the correct dependencies. For many applications, this may be prohibitively expensive. The reduction of computational requirements can be achieved by leveraging low-fidelity models. Low-fidelity models represent the system at a coarser resolution with the advantage of computational efficiency. Therefore, a bi-fidelity modeling paradigm, which augments the accuracy of a low-fidelity model in a computationally efficient manner by invoking limited runs of a high-fidelity model, can be leveraged to sufficiently balance the accuracy and computational requirements. In this work, a bi-fidelity weighted transfer learning method using neural networks was applied to a computational fluid dynamics heat transfer modeling problem. The transfer learning advantage was investigated as a function of hyperparameters. Our main finding is that the use of a bi-fidelity modeling paradigm achieves accuracy close to that of a high-fidelity Gaussian process model while significantly reducing computational cost. The bi-fidelity model achieves comparable performance with 90 high-fidelity samples-that is, 60% less than the samples needed to achieve similar accuracy without the use of bi-fidelity modeling,
First-order approximation and model management is a methodology for a systematic use of variable-fidelity models or approximations in optimization. The intent of model management is to attain convergence to high-fidelity solutions with minimal expense in high-fidelity computations. The savings in terms of computationally intensive evaluations depends on the ability of the available lower-fidelity model or a suite of models to predict the improvement trends for the high-fidelity problem, Variable-fidelity models can be represented by data-fitting approximations, variable-resolution models. variable-convergence models. or variable physical fidelity models. The present work considers the use of variable-fidelity physics models. We demonstrate the performance of model management on an aerodynamic optimization of a multi-element airfoil designed to operate in the transonic regime. Reynolds-averaged Navier-Stokes equations represent the high-fidelity model, while the Euler equations represent the low-fidelity model. An unstructured mesh-based analysis code FUN2D evaluates functions and sensitivity derivatives for both models. Model management for the present demonstration problem yields fivefold savings in terms of high-fidelity evaluations compared to optimization done with high-fidelity computations alone.
Deep learning-based surrogate models have been widely applied in geological carbon storage (GCS) problems to accelerate the prediction of reservoir pressure and CO2 plume migration. Large amounts of data from physics-based numerical simulators are required to train a model to accurately predict the complex physical behaviors associated with this process. In practice, the available training data are always limited in large-scale 3D problems due to the high computational cost. Therefore, we propose to use a multi-fidelity Fourier neural operator (FNO) to solve large-scale GCS problems with more affordable multi-fidelity training datasets. FNO has a desirable grid-invariant property, which simplifies the transfer learning procedure between datasets with different discretization. Here, we first test the model efficacy on a GCS reservoir model being discretized into 110 k grid cells. The multi-fidelity model can predict with accuracy comparable to a high-fidelity model trained with the same amount of high-fidelity data with 81% less data generation costs. We further test the generalizability of the multi-fidelity model on a same reservoir model with a finer discretization of 1 million grid cells. This case was made more challenging by employing high-fidelity and low-fidelity datasets generated by different geostatistical models and reservoir simulators. We observe that the multi-fidelity FNO model can predict pressure fields with reasonable accuracy even when the high-fidelity data are extremely limited. The findings of this study can help for better understanding of the transferability of multi-fidelity deep learning surrogate models.
This paper proposes a multi-fidelity learning approach for distribution voltage probabilistic analysis with high penetration of PVs. Unlike the existing machine learning-based approaches that require a large number of high fidelity data to achieve satisfactory results, our approach strategically leverage massive low fidelity data from inaccurate model simulations and limited high fidelity historical data. The key idea is to use low-fidelity data to establish an initial model and then the high-fidelity data to calibrate and correct the constructed low-fidelity model. This allows us to fuse low- and high-fidelity data, yielding a high fidelity prediction model. Results obtained from a realistic feeder in US with 80% penetration of PVs show that the proposed approach can achieve a similar accuracy to the one with a large number of high fidelity data. This significantly highlights the advantages of the proposed method as compared to existing data-hungry machine learning methods. Different levels of fidelity data and their impacts are also investigated.
Abstract Surrogate-based Bayesian optimization has been widely applied in design optimization to increase sampling efficiency. However, the cost for each evaluation of the objective function can still be very high when physical experiments or large-scale simulations are involved. Multi-fidelity Bayesian optimization is the new approach to further improve the sampling efficiency by reducing the number of expensive samples at the highest fidelity level and supplementing them with less expensive ones at low-fidelity levels. In this paper, a new consequential improvement (CI) acquisition function is proposed to allow for the simultaneous selection of the solution and the fidelity level in problems with a known hierarchy of fidelity levels. The new CI acquisition function incorporates the consequential effectiveness of objective improvement with the considerations of cost, accuracy, and validity differences between high- and low-fidelity samples in engineering practice. The new method of multi-fidelity Bayesian optimization based on the CI is demonstrated with several analytical and simulation-based design examples. In the simulation-based design optimization example, the results show that the CI acquisition function has a decisive advantage in the sampling efficiency over the other methods of multi-fidelity Bayesian optimization with simultaneous selection. The results indicate that the proposed method is particularly advantageous in solving high-dimensional problems and when large cost ratios between high- and low-fidelity evaluations exist and high-fidelity validation is mandatory. Furthermore, the method robustly avoids the prevalent issue of over sampling at low-fidelity levels.
Bayesian optimization has shown promise for the design optimization of inertial confinement fusion targets. Specifically, in Vazirani et al. [Phys. Plasmas 28 , 122709 (2021)], optimal designs for double shell capsules with graded inner shells were identified using one-dimensional xRAGE simulation yield calculations. While the machine learning models were able to accurately learn and predict one-dimensional simulation target performance, using simulations with higher fidelity would improve design optimization and better match with the expected experimental performance. However, higher fidelity physics modeling, i.e., two-dimensional xRAGE simulations, requires significantly larger computational time/cost, usually at least an order of magnitude, in comparison with one-dimensional simulations. This study presents a multi-fidelity Bayesian optimization, in which the machine learning model leverages low-fidelity (one-dimensional xRAGE) and high-fidelity (two-dimensional xRAGE) simulations to more accurately predict “pre-shot” target performance with respect to the expected experimental performance. By building a multi-fidelity Bayesian optimization framework coupled with xRAGE, the low-fidelity and high-fidelity simulations are able to inform one another, such that we have: (1) improved physics modeling in comparison with using low-fidelity simulations alone, (2) reduced computational time/cost in comparison with using high-fidelity simulations alone, and (3) more confidence in the expected performance of optimized targets during real-world experiments. In the future, we plan to use this robust multi-fidelity Bayesian optimization methodology to expedite the design of graded inner shells further and eventually full capsules as a part of the current double shell campaign at the National Ignition Facility.
Next-generation microreactors are currently being designed to be operated terrestrial and extraterrestrial for remote surface power production. These systems will provide an alternative source of carbon-free energy that is versatile and can be utilized for various applications. These applications of microreactors have prompted the usage of high-fidelity unstructured finite element (FE) based approaches to provide time-dependent solutions for multiple physics fields. Computing these high-fidelity (4-D) solutions for multiple design iterations, physics fields, and transient events requires an immense computational cost. These high-fidelity solutions are computational expensive and the cost can be reduced through the implementation of less accurate low-fidelity solutions. Unlike the current fleet of commercial nuclear reactors, these next-gen systems present challenges due to the material and physical limitations required. Due to these constraints, the brute force technique of parameterizing important system characteristics determines whether a design meets the project objective. A system such as a nuclear reactor could have thousands of design parameters that affect system performance. In order to analyze the entire parameter space of such a complex system would require millions of CPU hours and countless design iterations. This costly approach is not practical due to regulatory and budget limitations. In this proposal, an approach that utilizes hybrid high-fidelity and low-fidelity FE models to reduce the computational cost of evaluating these applications in 4-D will be presented. The accuracy of the high-fidelity model and the computational efficiency of the low-fidelity model are taken advantage of to produce a solution that closely resembles the full order high-fidelity solution. By utilizing an unconverged coarse FE mesh, operation limits such as temperature, structural loading, etc., can be evaluated in an accelerated fashion and then can be spatially interpolated onto a finer mesh. The resulting error arising from the coarse mesh can be mitigated with a discrepancy function that actively quantifies and corrects the error in the coarse solution. This discrepancy function can be periodically updated with high-fidelity calculations across the temporal domain thus requiring less iterations on the fine mesh. As a result, the computational cost can be reduced for the evaluation and design iteration of microreactors. The proposal for this research contains three sections: Section 2 provides a literature review, Section 3 outlines the methodology for the proposed multi-fidelity scheme, and Section 4 displays preliminary results of the proposed research.
The objective of this work was to investigate a multi-fidelity modeling approach to accurately and efficiently predict the laminar and turbulent convective heating on adaptable, deployable entry placement technology vehicles in Mars entry. A previously developed co-Kriging based multi-fidelity modeling approach was used to model the laminar and turbulent convective heat fluxes at several surface locations along the vehicle, including the rib sections. The laminar convective heat flux multi-fidelity model was found to have a mean convective heat rate error of approximately 3% when compared to high-fidelity CFD simulations. The turbulent convective heat flux multi-fidelity model was found to have a mean convective heat rate error of approximately 8% when compared to high-fidelity CFD simulations. Compared to a single fidelity model, the multi-fidelity model required approximately one-third the number of high-fidelity model evaluations to obtain the same accuracy level. The computational cost of evaluating the multi-fidelity model was approximately five orders of magnitude less than one high-fidelity model simulation.
Multi-fidelity Bayesian optimization (MFBO) is a powerful approach that utilizes lowfidelity, cost-effective sources to expedite the exploration and exploitation of a high-fidelity objective function. Existing MFBO methods with theoretical foundations either lack justification for performance improvements over single-fidelity optimization or rely on strong assumptions about the relationships between fidelity sources to construct surrogate models and direct queries to low-fidelity sources. To mitigate the dependency on cross-fidelity assumptions while maintaining the advantages of low-fidelity queries, we introduce a random sampling and partition-based MFBO framework with deep kernel learning. This framework is robust to cross-fidelity model misspecification and explicitly illustrates the benefits of low-fidelity queries. Our results demonstrate that the proposed algorithm effectively manages complex cross-fidelity relationships and efficiently optimizes the target fidelity function.
When simulations are very expensive and many are required, as for optimization or uncertainty quantification, a way to reduce cost is using surrogates. With multiple simulations to predict the quantity of interest, some being very expensive and accurate (high-fidelity simulations) and others cheaper but less accurate (low-fidelity simulations), it may be worthwhile to use multifidelity surrogates (MFSs). Moreover, if we can afford just a few high-fidelity simulations or experiments, MFS becomes necessary. Co-Kriging, which is probably the most popular MFS, replaces both low-fidelity and high-fidelity simulations by a single MFS. A recently proposed linear regression–based MFS (LR-MFS) offers the option to correct the LF simulations instead of correcting the LF surrogate in the MFS. When the low-fidelity simulation is cheap enough for use in an application, such as optimization, this may be an attractive option. Here, we explore the performance of LR-MFS using exact and surrogate-replaced low-fidelity simulations. The concern studied is a cylindrical dispersal of 100-μ m-diameter solid particles after detonation and the quantity of interest is a measure of the amplification of the departure from axisymmetry. We find very substantial accuracy improvements for this problem using the LR-MFS with exact low-fidelity simulations. Inspired by these results, we also compare the performance of co-Kriging to the use of Kriging to correct exact low-fidelity simulations and find a similar accuracy improvement when simulations are directly used. For this problem, further improvements in accuracy are achievable by taking advantage of inherent parametric symmetries. These findings may alert users of MFSs to the possible advantages of using exact low-fidelity simulations when this is affordable.
We report that machine learning techniques typically rely on large datasets to create accurate classifiers. However, there are situations when data is scarce and expensive to acquire. This is the case of studies that rely on state-of-the-art computational models which typically take days to run, thus hindering the potential of machine learning tools. In this work, we present a novel classifier that takes advantage of lower fidelity models and inexpensive approximations to predict the binary output of expensive computer simulations. We postulate an autoregressive model between the different levels of fidelity with Gaussian process priors. We adopt a fully Bayesian treatment for the hyper-parameters and use Markov Chain Monte Carlo samplers. We take advantage of the probabilistic nature of the classifier to implement active learning strategies. We also introduce a sparse approximation to enhance the ability of the multi-fidelity classifier to handle a large amount of low fidelity samples. We test these multi-fidelity classifiers against their single-fidelity counterpart with synthetic data, showing a median computational cost reduction of 23% for a target accuracy of 90%. In an application to cardiac electrophysiology, the multi-fidelity classifier achieves an F1 score, the harmonic mean of precision and recall, of 99.6% compared to 74.1% of a single-fidelity classifier when both are trained with 50 samples. In general, our results show that the multi-fidelity classifiers outperform their single-fidelity counterpart in terms of accuracy in all cases. Finally, we envision that this new tool will enable researchers to study classification problems that would otherwise be prohibitively expensive. Source code is available at https://github.com/fsahli/MFclass.
Due to their high degree of expressiveness, neural networks have recently been used as surrogate models for mapping inputs of an engineering system to outputs of interest. Once trained, neural networks are computationally inexpensive to evaluate and remove the need for repeated evaluations of computationally expensive models in uncertainty quantification applications. However, given the highly parameterized construction of neural networks, especially deep neural networks, accurate training often requires large amounts of simulation data that may not be available in the case of computationally expensive systems. In this paper, to alleviate this issue for uncertainty propagation, we explore the application of transfer learning techniques using training data generated from both high- and low-fidelity models. We explore two strategies for coupling these two datasets during the training procedure, namely, the standard transfer learning and the bi-fidelity-weighted learning. In the former approach, a neural network model mapping the inputs to the outputs of interest is trained based on the low-fidelity data. The high-fidelity data are then used to adapt the parameters of the upper layer(s) of the low-fidelity network, or train a simpler neural network to map the output of the low-fidelity network to that of the high-fidelity model. In the latter approach, the entire low-fidelity network parameters are updated using data generated via a Gaussian process model trained with a small high-fidelity dataset. The parameter updates are performed via a variant of stochastic gradient descent with learning rates given by the Gaussian process model. Using three numerical examples, we illustrate the utility of these bi-fidelity transfer learning methods where we focus on accuracy improvement achieved by transfer learning over standard training approaches.
Multi-fidelity approaches are emerging as effective strategies in computational science to handle otherwise intractable tasks like Uncertainty Quantification (UQ), training of Machine Learning (ML) models, and optimization, for expensive high-fidelity applications in which the amount of available simulations or data is limited. The main idea is simple: large datasets generated for low-fidelity approximations of the problem at hand are fused with a much sparser dataset for the target (high-fidelity) system. In this paper, we build on our recent success in designing random Fourier Neural Networks (rFNNs) [1] to target problems arising in wind energy applications and in particular problems of interest for hurricane modeling. In this context, data for the high-fidelity models are limited and lower fidelity alternatives are needed. In this work, we introduce a novel multi-fidelity training approach for our rFNNs and demonstrate its use on a simple verification problem and on a hurricane modeling problem in which high-fidelity data are generated via Large-Eddy Simulations (LES), while low-fidelity data are given by a mesoscale model. Initial results demonstrate how the multi-fidelity training approach can improve the quality of the resulting surrogate.