Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Fidelity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Coupling multi-fidelity xRAGE with machine learning for graded inner shell design optimization in double shell capsules

Bayesian optimization has shown promise for the design optimization of inertial confinement fusion targets. Specifically, in Vazirani et al. [Phys. Plasmas 28 , 122709 (2021)], optimal designs for double shell capsules with graded inner shells were identified using one-dimensional xRAGE simulation yield calculations. While the machine learning models were able to accurately learn and predict one-dimensional simulation target performance, using simulations with higher fidelity would improve design optimization and better match with the expected experimental performance. However, higher fidelity physics modeling, i.e., two-dimensional xRAGE simulations, requires significantly larger computational time/cost, usually at least an order of magnitude, in comparison with one-dimensional simulations. This study presents a multi-fidelity Bayesian optimization, in which the machine learning model leverages low-fidelity (one-dimensional xRAGE) and high-fidelity (two-dimensional xRAGE) simulations to more accurately predict “pre-shot” target performance with respect to the expected experimental performance. By building a multi-fidelity Bayesian optimization framework coupled with xRAGE, the low-fidelity and high-fidelity simulations are able to inform one another, such that we have: (1) improved physics modeling in comparison with using low-fidelity simulations alone, (2) reduced computational time/cost in comparison with using high-fidelity simulations alone, and (3) more confidence in the expected performance of optimized targets during real-world experiments. In the future, we plan to use this robust multi-fidelity Bayesian optimization methodology to expedite the design of graded inner shells further and eventually full capsules as a part of the current double shell campaign at the National Ignition Facility.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Multi-Fidelity Scheme for Accelerating 4D Finite Element Analysis for Mircoreactors

Next-generation microreactors are currently being designed to be operated terrestrial and extraterrestrial for remote surface power production. These systems will provide an alternative source of carbon-free energy that is versatile and can be utilized for various applications. These applications of microreactors have prompted the usage of high-fidelity unstructured finite element (FE) based approaches to provide time-dependent solutions for multiple physics fields. Computing these high-fidelity (4-D) solutions for multiple design iterations, physics fields, and transient events requires an immense computational cost. These high-fidelity solutions are computational expensive and the cost can be reduced through the implementation of less accurate low-fidelity solutions. Unlike the current fleet of commercial nuclear reactors, these next-gen systems present challenges due to the material and physical limitations required. Due to these constraints, the brute force technique of parameterizing important system characteristics determines whether a design meets the project objective. A system such as a nuclear reactor could have thousands of design parameters that affect system performance. In order to analyze the entire parameter space of such a complex system would require millions of CPU hours and countless design iterations. This costly approach is not practical due to regulatory and budget limitations. In this proposal, an approach that utilizes hybrid high-fidelity and low-fidelity FE models to reduce the computational cost of evaluating these applications in 4-D will be presented. The accuracy of the high-fidelity model and the computational efficiency of the low-fidelity model are taken advantage of to produce a solution that closely resembles the full order high-fidelity solution. By utilizing an unconverged coarse FE mesh, operation limits such as temperature, structural loading, etc., can be evaluated in an accelerated fashion and then can be spatially interpolated onto a finer mesh. The resulting error arising from the coarse mesh can be mitigated with a discrepancy function that actively quantifies and corrects the error in the coarse solution. This discrepancy function can be periodically updated with high-fidelity calculations across the temporal domain thus requiring less iterations on the fine mesh. As a result, the computational cost can be reduced for the evaluation and design iteration of microreactors. The proposal for this research contains three sections: Section 2 provides a literature review, Section 3 outlines the methodology for the proposed multi-fidelity scheme, and Section 4 displays preliminary results of the proposed research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Robust Multi-fidelity Bayesian Optimization with Deep Kernel and Partition

Multi-fidelity Bayesian optimization (MFBO) is a powerful approach that utilizes lowfidelity, cost-effective sources to expedite the exploration and exploitation of a high-fidelity objective function. Existing MFBO methods with theoretical foundations either lack justification for performance improvements over single-fidelity optimization or rely on strong assumptions about the relationships between fidelity sources to construct surrogate models and direct queries to low-fidelity sources. To mitigate the dependency on cross-fidelity assumptions while maintaining the advantages of low-fidelity queries, we introduce a random sampling and partition-based MFBO framework with deep kernel learning. This framework is robust to cross-fidelity model misspecification and explicitly illustrates the benefits of low-fidelity queries. Our results demonstrate that the proposed algorithm effectively manages complex cross-fidelity relationships and efficiently optimizes the target fidelity function.

Zhang, Fengxue [University of Chicago, Illinois, U↗

Advancements on Multi-Fidelity Random Fourier Neural Networks: Application to Hurricane Modeling for Wind Energy

Multi-fidelity approaches are emerging as effective strategies in computational science to handle otherwise intractable tasks like Uncertainty Quantification (UQ), training of Machine Learning (ML) models, and optimization, for expensive high-fidelity applications in which the amount of available simulations or data is limited. The main idea is simple: large datasets generated for low-fidelity approximations of the problem at hand are fused with a much sparser dataset for the target (high-fidelity) system. In this paper, we build on our recent success in designing random Fourier Neural Networks (rFNNs) [1] to target problems arising in wind energy applications and in particular problems of interest for hurricane modeling. In this context, data for the high-fidelity models are limited and lower fidelity alternatives are needed. In this work, we introduce a novel multi-fidelity training approach for our rFNNs and demonstrate its use on a simple verification problem and on a hurricane modeling problem in which high-fidelity data are generated via Large-Eddy Simulations (LES), while low-fidelity data are given by a mesoscale model. Initial results demonstrate how the multi-fidelity training approach can improve the quality of the resulting surrogate.

Fourier Neural Networks↗

Multi-fidelity modeling to predict the rheological properties of a suspension of fibers using neural networks and Gaussian processes

Unveiling the rheological properties of fiber suspensions is of paramount interest to many industrial applications. There are multiple factors, such as fiber aspect ratio and volume fraction, that play a significant role in altering the rheological behavior of suspensions. Three-dimensional (3D) numerical simulations of coupled differential equations of the suspension of fibers are computationally expensive and time-consuming. Machine learning algorithms can be trained on the available data and make predictions for the cases where no numerical data are available. However, some widely used machine learning surrogates, such as neural networks, require a relatively large training dataset to produce accurate predictions. Multi-fidelity models, which combine high-fidelity data from numerical simulations and less expensive lower fidelity data from resources such as simplified constitutive equations, can pave the way for more accurate predictions. Here, we focus on neural networks and the Gaussian processes with two levels of fidelity, i.e., high and low fidelity networks, to predict the steady-state rheological properties, and compare them to the single-fidelity network. High-fidelity data are obtained from direct numerical simulations based on an immersed boundary method to couple the fluid and solid motion. The low-fidelity data are produced by using constitutive equations. Multiple neural networks and the Gaussian process structures are used for the hyperparameter tuning purpose. Results indicate that with the best choice of hyperparameters, both the multi-fidelity Gaussian processes and neural networks are capable of making predictions with a high level of accuracy with neural networks demonstrating marginally better performance.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Multi-fidelity modeling to predict the rheological properties of fiber suspensions

Unveiling the rheological properties of fiber suspensions is of paramount interest to many industrial applications like biofuel production. The 3D numerical simulations of the suspension of fibers are often computationally expensive and time-consuming. Machine learning methods such as neural networks can simplify the prediction of rheological behavior; however, they require a relatively large training data set. Multi -fidelity models, which combine high-fidelity data from numerical simulations and less expensive lower fidelity data from resources such as simplified physical equations, can lead to optimized predictions. Here, we focus on a neural network with two levels of fidelity, i.e., high and low fidelity networks. To produce high-fidelity data, we perform direct numerical simulations to model the fibers as one-dimensional inextensible slender bodies that obey the Euler- Bernoulli beam equation. The Navier-Stokes equations govern the suspended fluid, and an immersed boundary method is used to couple the fluid and solid motion. The low-fidelity data is produced by using constitutive equations. Noticeable improvements have been observed in the accuracy of predicting the rheological behavior when a multi-fidelity network is used compared to the single-fidelity network.

Boodaghidizaji, Miad↗

Review of multi-fidelity models

Multi-fidelity models provide a framework for integrating computational models of varying complexity, allowing for accurate predictions while optimizing computational resources. These models are especially beneficial when acquiring high-accuracy data is costly or computationally intensive. This review offers a comprehensive analysis of multi-fidelity models, focusing on their applications in scientific and engineering fields, particularly in optimization and uncertainty quantification. It classifies publications on multi-fidelity modeling according to several criteria, including application area, surrogate model selection, types of fidelity, combination methods and year of publication. The study investigates techniques for combining different fidelity levels, with an emphasis on multi-fidelity surrogate models. Here this work discusses reproducibility, open-sourcing methodologies and benchmarking procedures to promote transparency. The manuscript also includes educational toy problems to enhance understanding. Additionally, this paper outlines best practices for presenting multi-fidelity-related savings in a standardized, succinct and yet thorough manner. The review concludes by examining current trends in multi-fidelity modeling, including emerging techniques, recent advancements, and promising research directions.

42 ENGINEERING↗

Multi-fidelity physics-informed machine learning for probabilistic damage diagnosis

Machine learning (ML) models are gaining popularity in structural health monitoring (SHM) because of their ability to learn the complex relationship between damage and sensor data. However, the lack of sufficient experimental data for structures with different degrees of damage is a key problem in training ML models for SHM. This problem can be alleviated by using physics-based models to generate the required training data to build physics-informed ML (PIML) models for SHM. However, it takes significant computational effort to perform enough high-fidelity simulations of the diagnostic test. It is thus desirable to know whether the available computational resource budget should be expended on numerous low-fidelity physics simulations, or a small number of high-fidelity simulations, or their combination. In this paper, we investigate this aspect of generating adequate training data for PIML, by constructing multi-fidelity PIML models. We evaluate the performance of several PIML models, trained with different amounts of low-fidelity and high-fidelity data, in locating hidden cracks in concrete structures using a nonlinear dynamics-based diagnosis technique. Here, we find that high-fidelity physics simulations that do not cover the (test and damage) parameter space do not improve the performance of diagnostic PIML models built using data from many low-fidelity physics simulations.

42 ENGINEERING↗

Multi-Fidelity Active Subspaces for Wind Farm Uncertainty Quantification

Wind plants operate in stochastic environments characterized by complex turbulent flow dynamics and high-dimensional random variables. A key step in uncertainty quantification studies is sensitivity analysis and dimension reduction that can facilitate the development of surrogate models to be used for forward and inverse propagation or optimization under uncertainty. Prior work has shown active subspaces are an effective tool for identifying important directions in the space of stochastic inputs; however, they have only been applied to single-fidelity wind plant models. In this study, we investigate the efficacy of a multi-fidelity active subspace method for analyzing the uncertainty in wind plant power output. The multi-fidelity active subspace estimator offers the promise of increased accuracy in identifying active subspaces as compared to a single-fidelity estimator for the same computational cost, or a reduction in cost for the same accuracy. This makes the study of uncertainty in larger wind plants and with higher fidelity physics tractable. The multi-fidelity active subspace method is applied to gridded and existing wind plant layouts with single and multiple inflow conditions and its performance for surrogate modeling and uncertainty propagation is compared against a single-fidelity active subspace method. This multi-fidelity approach yields substantial computational speedups of 2x - 3.4x across the test cases along with acceptable accuracy in surrogate modeling and computing statistical moments.

active subspace↗

Machine learning for impurity charge-state transition levels in semiconductors from elemental properties using multi-fidelity datasets

Quantifying charge-state transition energy levels of impurities in semiconductors is critical to understanding and engineering their optoelectronic properties for applications ranging from solar photovoltaics to infrared lasers. While these transition levels can be measured and calculated accurately, such efforts are time-consuming and more rapid prediction methods would be beneficial. Here, we significantly reduce the time typically required to predict impurity transition levels using multi-fidelity datasets and a machine learning approach employing features based on elemental properties and impurity positions. We use transition levels obtained from low-fidelity (i.e., local-density approximation or generalized gradient approximation) density functional theory (DFT) calculations, corrected using a recently proposed modified band alignment scheme, which well-approximates transition levels from high-fidelity DFT (i.e., hybrid HSE06). Further, the model fit to the large multi-fidelity database shows improved accuracy compared to the models trained on the more limited high-fidelity values. Crucially, in our approach, when using the multi-fidelity data, high-fidelity values are not required for model training, significantly reducing the computational cost required for training the model. Our machine learning model of transition levels has a root mean squared (mean absolute) error of 0.36 (0.27) eV vs high-fidelity hybrid functional values when averaged over 14 semiconductor systems from the II–VI and III–V families. As a guide for use on other systems, we assessed the model on simulated data to show the expected accuracy level as a function of bandgap for new materials of interest. Finally, we use the model to predict a complete space of impurity charge-state transition levels in all zinc blende III–V and II–VI systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Bayesian Multi-fidelity Neural Network to Predict Nonlinear Frequency Backbone Curves

The use of structural mechanics models during the design process often leads to the development of models of varying fidelity. Often low-fidelity models are efficient to simulate but lack accuracy, while the high-fidelity counterparts are accurate with less efficiency. Here, this paper presents a multi-fidelity surrogate modeling approach that combines the accuracy of a high-fidelity finite element model with the efficiency of a low-fidelity model to train an even faster surrogate model that parameterizes the design space of interest. The objective of these models is to predict the nonlinear frequency backbone curves of the Tribomechadynamics Research Challenge benchmark structure which exhibits simultaneous nonlinearities from frictional contact and geometric nonlinearity. The surrogate model consists of an ensemble of neural networks that learn the mapping between low and high-fidelity data through nonlinear transformations. Bayesian neural networks are used to assess the surrogate model's uncertainty. Once trained, the multi-fidelity neural network is used to perform sensitivity analysis to assess the influence of the design parameters on the predicted backbone curves. Additionally, Bayesian calibration is performed to update the input parameter distributions to correlate the model parameters to the collection of experimentally measured backbone curves.

42 ENGINEERING↗

Bi-fidelity Gradient-Based Approach for Nonlinear Well Logging Inverse Problems

Solving a non-linear inverse problem is challenging in computational science and engineering. Sampling based methods require a large number of model valuations; gradientbased methods require fewer model evaluations but only find the local minima. Multifidelity optimization combines the low fidelity model and the high-fidelity model to achieve both high accuracy and high efficiency. In this paper, we present a bi-fidelity approach to solve non-linear inverse problems. In the bi-fidelity inversion method, the low-fidelity model is used to acquire a good initial guess, and the high-fidelity model is used to locate the global minimum. Combined with a multi-start optimization scheme, the proposed approach significantly increases the possibility of finding the global minimum for nonlinear inverse problems with many local minima. The method is tested with two toy problems and then applied to an electromagnetic well logging inverse problem, which is difficult to solve using traditional gradient-based methods. The bi-fidelity method provides promising inversion results and can be easily applied to traditional gradient-based methods.

42 ENGINEERING↗

High- and Mid-Fidelity Modeling Comparison for a Floating Marine Turbine System

There is a lack of suitable numerical tools, particularly open-source tools, that can be used for designing and optimizing marine turbine systems. The National Renewable Energy Laboratory has added features to their widely used mid-fidelity wind turbine modeling code, OpenFAST, to enable modeling of axial-flow marine turbines. This necessitated the addition of several physical effects relevant to marine turbines that are neglected for wind turbines. These include buoyancy, added mass and inertial loads, wave-current superposition, and changes to the coordinate systems. This updated version of OpenFAST allows for the modeling of both fixed and floating marine turbines at a speed comparable to real time. While efficient for large sets of load cases and design studies, mid-fidelity codes make simplifying assumptions that may impact their accuracy. High-fidelity computational fluid dynamics (CFD) simulations can capture more flow effects with fewer assumptions and provide detailed body pressure mapping and flow-field information. It is important to compare predictions between mid-fidelity and high-fidelity codes, both to verify the models and to understand the limitations. A floating marine turbine system was modeled both with OpenFAST and with the commercial CFD code STAR-CCM+. The CFD model used a three-dimensional unsteady Reynolds-averaged Navier-Stokes solver for a volume-of-fluid numerical wave and current tank. The blade-resolved simulations used the sliding-interface technique for the spinning rotor and an overset grid to accommodate the rigid-body motion of the floating system. The mooring system was modeled with a custom coupling of the CFD solver with the open-source code MoorDyn. This improves upon the existing quasi-static catenary solver in STAR-CCM+, which lacks seabed contact or line-to-line connections. Simulation results for a floating marine turbine are compared between OpenFAST and CFD, highlighting the capabilities of the mid-fidelity code and identifying the areas where a high-fidelity approach is needed.

CFD↗

High- and Mid-Fidelity Modeling Comparison for a Floating Marine Turbine System: Preprint

There is a lack of suitable numerical tools, particularly open-source tools, that can be used for designing and optimizing marine turbine systems. The National Renewable Energy Laboratory (NREL) has added features to their widely used mid-fidelity wind turbine modeling code, OpenFAST, to enable modeling of axial flow marine turbines. This necessitated the addition of several physical effects relevant to marine turbines that can be neglected for wind turbines. These include buoyant loads, added mass and inertia loads, wave-current superposition, and changes to the coordinate systems. This updated version of OpenFAST allows for the modeling of both fixed and floating marine turbine systems at a speed comparable to real time. While efficient for long simulations, large sets of load cases, and design studies, mid-fidelity codes cannot capture all of the potentially important physical phenomenon impacting marine turbine systems. High-fidelity computational fluid dynamics (CFD) simulations can capture more flow effects with fewer assumptions and provide detailed body pressure mapping and flow-field information. It is important to compare predictions between mid-fidelity and high-fidelity codes, both to verify the models and to understand the limitations. A floating marine turbine system designed by NREL was modeled both with OpenFAST and with the commercial CFD code, STARCCM+. The CFD model used a 3-D unsteady Reynolds-averaged Navier-Stokes solver for a volume-of-fluid numerical wave and current tank. The blade-resolved simulations used the sliding-interface technique for the spinning rotor and an overset grid to accommodate the rigid-body motion of the floating system. The mooring system was modelled with a custom coupling of the CFD solver with the open-source code, MoorDyn. This improves upon the existing quasi-static catenary solver in STARCCM+, which lacks seabed contact or line-to-line connections. Spatial and temporal convergence studies were conducted. The simulation results for a combined current and wave condition are compared between OpenFAST and CFD, highlighting the capabilities of the mid-fidelity code and identifying the areas where a high-fidelity approach is needed.

CFD↗

Feature-adjacent multi-fidelity physics-informed machine learning for partial differential equations

Physics-informed neural networks have emerged as an alternative method for solving partial differential equations. However, for complex problems, the training of such networks can still require high-fidelity data which can be expensive to generate. To reduce or even eliminate the dependency on high-fidelity data, we propose a novel multi-fidelity architecture which is based on a feature space shared by the low- and high-fidelity solutions. In the feature space, the projections of the low-fidelity and high-fidelity solutions are adjacent by constraining their relative distance. The feature space is represented with an encoder and its mapping to the original solution space is effected through a decoder. In conclusion, the proposed multi-fidelity approach is validated on forward and inverse problems for steady and unsteady problems described by partial differential equations.

97 MATHEMATICS AND COMPUTING↗

Quancorde: Boosting fidelity with Quantum Canary Ordered Diverse Ensembles

On today's noisy imperfect quantum devices, execution fidelity tends to collapse dramatically for most applications beyond a handful of qubits. It is therefore imperative to employ novel techniques that can boost quantum fidelity in new ways. Here, this paper aims to boost quantum fidelity with Clifford canary circuits by proposing Quancorde: Quantum Canary Ordered Diverse Ensembles, a fundamentally newapproach to identifying the correct outcomes of extremely low-fidelity quantum applications. It is based on the key idea of diversity in quantum devices - variations in noise sources, make each (portion of a) device unique, and therefore, their impact on an application's fidelity, also unique. Quancorde utilizes Clifford canary circuits (which are classically simulable, but also resemble the target application structure and thus suffer similar structural noise impact) to order a diverse ensemble of devices or qubits/mappings approximately along the direction of increasing fidelity of the target application. Quancorde then estimates the correlation of the ensemble-wide probabilities of each output string of the application, with the canary ensemble ordering, and uses this correlation to weight the application's noisy probability distribution. The correct application outcomes are expected to have higher correlation with the canary ensemble order, and thus their probabilities are boosted in this process. Doing so, Quancorde improves the fidelity of evaluated quantum applications by a mean of 8.9x/4.2x (wrt. different baselines) and up to a maximum of 34x.

clifford↗

Transfer Learning of High-Fidelity Opacity Spectra in Autoencoders and Surrogate Models

Simulations of high energy density physics are expensive, largely in part for the need to produce nonlocal thermodynamic equilibrium opacities. High-fidelity spectra may reveal new physics in the simulations not seen with low-fidelity spectra, but the cost of these simulations also scales with the level of fidelity of the opacities being used. Neural networks are capable of reproducing these spectra, but neural networks need data to train them, which limits the level of fidelity of the training data. Here this article demonstrates that it is possible to reproduce high-fidelity spectra with median errors in the realm of 3%–4% using as few as 50 samples of high-fidelity Krypton data by performing transfer learning on a neural network trained on many times more low-fidelity data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Impact of Radial Reflector Fidelity on Neutronics and Vessel Fluence Simulations

The Consortium for Advanced Simulation of Light Water Reactors is developing the Virtual Environment for Reactor Applications (VERA), and the MPACT code, which is the primary deterministic neutron transport solver in VERA, provides sub-pin level flux and power distributions as part of full-scale cycle depletion and analysis. In such calculations, an important aspect is the radial reflector treatment. To improve the fidelity of the radial reflector treatment, MPACT was extended to approximate the modeling of the reactor’s structural components such as the core shroud, barrel, neutron pads, and vessel. This work explores several modeling configurations with varying levels of fidelity and computational burden and assesses the importance of modeling fidelity on the eigenvalue and pin power distribution. Two two-dimensional (2-D) problems were analyzed to assess the impact on eigenvalue and pin power distributions with low-fidelity, coarse square cell reflector representations: (1) a Watts Bar Nuclear Plant Unit 1 (WBN1) quarter-core slice with depletion and (2) an AP1000 quarter-core slice. In this work, the analyses showed that the effect on eigenvalue is fairly small, but the effect on pin power is more pronounced, especially locally in the assemblies closest to the periphery, where the maximum pin power difference is nearly 3.5% in the AP1000 case. Two additional 2-D problems were used to assess the comparison between the low-fidelity coarse square cell treatment and a high-fidelity geometric representation that uses subpin material specification: (1) the same WBN1 quarter-core slice and (2) a representative model of the NuScale small modular reactor (SMR), which features a solid reflector design with moderator holes. These results demonstrate that even a coarse, low-fidelity representation adequately captures the necessary simulation characteristics. Last, these capabilities were applied to the 2-D WBN1 quarter-core depletion to assess the impact on vessel fluence using VeraShift. From adjoint calculations, pins along the periphery were observed to be of highest importance for fluence calculation, so the impact of the reflector representation in MPACT could theoretically substantially affect the predicted result. However, it was observed that the change in pin powers along the periphery minimally impacts the maximum vessel fluence with a difference within the statistical uncertainty but provides terrific insight on the sensitivity of the peripheral pins.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗