Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multifidelity modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Improving the Aircraft Design Process Using Web-Based Modeling and Simulation

Designing and developing new aircraft systems is time-consuming and expensive. Computational simulation is a promising means for reducing design cycle times, but requires a flexible software environment capable of integrating advanced multidisciplinary and multifidelity analysis methods, dynamically managing data across heterogeneous computing platforms, and distributing computationally complex tasks. Web-based simulation, with its emphasis on collaborative composition of simulation models, distributed heterogeneous execution, and dynamic multimedia documentation, has the potential to meet these requirements. This paper outlines the current aircraft design process, highlighting its problems and complexities, and presents our vision of an aircraft design process using Web-based modeling and simulation.

Reed, John A.↗

Modern Monte Carlo methods for efficient uncertainty quantification and propagation: A survey

Uncertainty quantification (UQ) includes the characterization, integration, and propagation of uncertainties that result from stochastic variations and a lack of knowledge or data in the natural world. Monte Carlo (MC) method is a sampling-based approach that has widely used for quantification and propagation of uncertainties. However, the standard MC method is often time-consuming if the simulation-based model is computationally intensive. This article gives an overview of modern MC methods to address the existing challenges of the standard MC in the context of UQ. Specifically, multilevel Monte Carlo (MLMC) extending the concept of control variates achieves a significant reduction of the computational cost by performing most evaluations with low accuracy and corresponding low cost, and relatively few evaluations at high accuracy and corresponding high cost. Multifidelity Monte Carlo (MFMC) accelerates the convergence of standard Monte Carlo by generalizing the control variates with different models having varying fidelities and varying computational costs. Multimodel Monte Carlo method (MMMC), having a different setting of MLMC and MFMC, aims to address the issue of UQ and propagation when data for characterizing probability distributions are limited. Multimodel inference combined with importance sampling is proposed for quantifying and efficiently propagating the uncertainties resulting from small data sets. All of these three modern MC methods achieve a significant improvement of computational efficiency for probabilistic UQ, particularly uncertainty propagation. Finally, an algorithm summary and the corresponding code implementation are provided for each of the modern MC methods. The extension and application of these methods are discussed in detail.

97 MATHEMATICS AND COMPUTING↗

Release on the Virtual Test Bed of a Molten Salt Reactor Experiment SAM-Pronghorn Coupled Model using the Domain Overlapping Approach

The nuclear industry is taking leaps in innovations with companies seeking a sustainable energy future through advanced nuclear reactors. The Department of Energy (DOE)’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program seeks to substantiate and bolster the deployment of advanced reactors through flexible multifidelity, multiphysics simulations of advanced nuclear reactors. Applications like SAM for one-dimensional systems thermalhydraulics, and Pronghorn for multidimensional coarse mesh thermal-hydraulics, are geared to support innovations in industry by facilitating design, optimization, and licensing of advanced nuclear reactors. Coupling systems thermal-hydraulics and computational fluid dynamics codes can be difficult as the pressure coupling converges slowly; however, it is important to obtain the desired accuracy in each part of the primary loop. The authors of this model created an Overlapping-Domain Coupling (ODC) approach to coupling SAM and Pronghorn. Leveraging this coupling technique, a Molten Salt Reactor Experiment (MSRE) model was developed and released to the NEAMS/National Reactor Innovation Center (NRIC) Virtual Test Bed (VTB). The MSRE was chosen to be modeled because of the wealth of experimental data available and because of the strong physics coupling between the core and primary circuit. This paper contextualizes the history of the MSRE, describes the thermal hydraulics models used, and detail the implementation of multidimensional thermal-hydraulics and system codes based on the ODC method for the MSRE model. Finally, this paper presents how other modelers could apply the SAM Pronghorn ODC for other advanced reactor models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Stacked networks improve physics-informed training: Applications to neural networks and deep operator networks

Physics-informed neural networks and operator networks have shown promise for effectively solving equations modeling physical systems. However, these networks can happen to be difficult or impossible to train accurately. Here, we present a novel multifidelity framework for stacking physics-informed neural networks and operator networks that facilitates training. We successively build a chain of networks, where the output at one step can act as a low-fidelity input for training a longer chain, gradually increasing the expressivity of the learnt model. The equations imposed at each step of the iterative process can be the same or different (akin to simulated annealing). The iterative (stacking) nature of the proposed method allows us to learn progressively features of a solution which could have been hard to learn directly. Through benchmark problems including a nonlinear pendulum, the wave equation, and the viscous Burgers equation, we show how stacking can be used to improve the accuracy and reduce the required size of physics-informed neural networks and operator networks.

97 MATHEMATICS AND COMPUTING↗

A multifidelity Bayesian optimization method for inertial confinement fusion design

Due to their cost, experiments for inertial confinement fusion (ICF) heavily rely on numerical simulations to guide design. As simulation technology progresses, so too can the fidelity of models used to plan for new experiments. However, these high-fidelity models are by themselves insufficient for optimal experimental design, because their computational cost remains too high to efficiently and effectively explore the numerous parameters required to describe a typical experiment. Therefore, traditionally, ICF design has relied on low-fidelity modeling to initially identify potentially interesting design regions, which are then subsequently explored via selected high-fidelity modeling. In this paper, we demonstrate that this two-step approach can be insufficient: even for simple design problems, a two-step optimization strategy can lead high-fidelity searching toward incorrect regions and consequently waste computational resources on parameter regimes far away from the true optimal solution. We reveal that a primary cause of this behavior in ICF design problems is the presence of low-fidelity optima in different regions of the parameter space far away from high-fidelity optima. To address this issue, we propose an iterative multifidelity Bayesian optimization method based on Gaussian Process Regression that leverages both low- and high-fidelity models simultaneously. We demonstrate, using both two- and eight-dimensional ICF test problems, that our algorithm can effectively utilize both low-fidelity and high-fidelity models to refine the designs. This approach proves to be more efficient than relying solely on high-fidelity modeling for optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Transfer learning of neural surrogates on multifidelity groundwater simulations

Multifidelity data used in the paper published in Advances in Water Resources 206 (2025) 105140, https://doi.org/10.1016/j.advwatres.2025.105140 The code used to process the data is openly available on GitHub at https://github.com/Model-Reduction-and-UQ-Group/Transfer_Learning_K_reconstruction Computationally inexpensive surrogates of process-based models, such as deep neural networks, enable ensemble-based computations used in risk assessment, data assimilation, etc. However, generation of large datasets required to train a neural network can be as expensive as the ensemble simulations themselves. We ameliorate this challenge by using data from multifidelity (MF) groundwater simulations and transfer learning (TL) to reduce data generation costs while maintaining model accuracy. As a computational example, we train a deep convolutional neural network (CNN) to reconstruct permeability fields from saturation maps derived from a multiphase flow model. Starting with very low- and low-fidelity data generated on increasingly coarse meshes, we pretrain the CNN, followed by output-layer training and fine-tuning using only a limited number of high-fidelity samples. We demonstrate the surrogate’s robustness when interpreting low-quality inputs—such as interpolated maps or data affected by noise—which has strong implications for the applicability in practical hydrogeological scenarios. This multilevel MF-TL strategy achieves a favorable trade-off between computational efficiency and predictive accuracy, significantly outperforming high-fidelity-only approaches under the same computational budget.

Chiofalo, Alessia [University of Bologna] (ORCID:0↗

A Multifidelity Ensemble Kalman Filter with Reduced Order Control Variates

This work develops a new multi delity ensemble Kalman lter (MFEnKF) algorithm based on linear control variate framework. The approach allows for rigorous multi delity extensions of the EnKF, where the uncertainty in coarser delities in the hierarchy of models represent control variates for the uncertainty in ner delities. Small ensembles of high delity model runs are com- plemented by larger ensembles of cheaper, lower delity runs, to obtain much improved analyses at only small additional computational costs. We investigate the use of reduced order models as coarse delity control variates in the MFEnKF, and provide analyses to quantify the improvements over the traditional ensemble Kalman lters. We apply these ideas to perform data assimilation with a quasi-geostrophic test problem, using direct numerical simulation and a corresponding POD-Galerkin reduced order model. Numerical results show that the two- delity MFEnKF provides better analyses than existing EnKF algorithms at comparable or reduced computational costs.

97 MATHEMATICS AND COMPUTING↗

An efficient Bayesian data-worth analysis using a multilevel Monte Carlo method

Improving the understanding of subsurface systems and thus reducing prediction uncertainty requires collection of data. As the collection of subsurface data is costly, it is important that the data collection scheme is cost-effective. Design of a cost-effective data collection scheme, i.e., data-worth analysis, requires quantifying model parameter, prediction, and both current and potential data uncertainties. Assessment of these uncertainties in large-scale stochastic subsurface hydrological model simulations using standard Monte Carlo (MC) sampling or surrogate modeling is extremely computationally intensive, sometimes even infeasible. In this paper, we propose an efficient Bayesian data-worth analysis using a multilevel Monte Carlo (MLMC) method. Compared to the standard MC that requires a significantly large number of high-fidelity model executions to achieve a prescribed accuracy in estimating expectations, the MLMC can substantially reduce computational costs using multifidelity approximations. Since the Bayesian data-worth analysis involves a great deal of expectation estimation, the cost saving of the MLMC in the assessment can be outstanding. While the proposed MLMC-based data-worth analysis is broadly applicable, we use it for a highly heterogeneous two-phase subsurface flow simulation to select an optimal candidate data set that gives the largest uncertainty reduction in predicting mass flow rates at four production wells. Finally, the choices made by the MLMC estimation are validated by the actual measurements of the potential data, and consistent with the standard MC estimation. But compared to the standard MC, the MLMC greatly reduces the computational costs.

97 MATHEMATICS AND COMPUTING↗

Release on the Virtual Test Bed of an MSRE thermal hydraulics model

The nuclear industry is taking leaps in innovations with companies seeking a sustainable energy future through advanced nuclear reactors. The \gls{DOE}’s \gls{neams} program seeks to substantiate and bolster the deployment of advanced reactors through flexible multifidelity, multiphysics simulations of advanced nuclear reactors. Applications like SAM for one-dimensional systems thermal-hydraulics, and Pronghorn for multidimensional coarse mesh thermal-hydraulics, are geared to support innovations in industry by facilitating design, optimization, and licensing of advanced nuclear reactors. Coupling systems thermal-hydraulics and computational fluid dynamics codes can be difficult as the pressure coupling converges slowly; however, it is important to obtain the desired accuracy in each part of the primary loop. The authors of this model created an \gls{odc}~\cite{Mau23} approach to coupling SAM and Pronghorn. Leveraging this coupling technique, a \gls{msre} model was developed and released to the \gls{neams}/\gls{nric} \gls{vtb}. The \gls{msre} was chosen to be modeled because of the wealth of experimental data available and because of the strong physics coupling between the core and primary circuit \cite{doi:10.13182/NT8-2-118}. This document contextualizes the history of the \gls{msre}, describes the thermal hydraulics models used, and detail the implementation of multidimensional thermal-hydraulics and system codes based on the \gls{odc} method~\cite{Penn} for the \gls{msre} model. Finally, this document presents how other modelers could apply the SAM-Pronghorn \gls{odc} for other advanced reactor models. Current item is the set of slides for ANS Winter 23. The release of the model and the ANS summary have already been approved

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Release on the Virtual Test Bed of an MSRE thermal hydraulics model

The nuclear industry is taking leaps in innovations with companies seeking a sustainable energy future through advanced nuclear reactors. The \gls{DOE}’s \gls{neams} program seeks to substantiate and bolster the deployment of advanced reactors through flexible multifidelity, multiphysics simulations of advanced nuclear reactors. Applications like SAM for one-dimensional systems thermal-hydraulics, and Pronghorn for multidimensional coarse mesh thermal-hydraulics, are geared to support innovations in industry by facilitating design, optimization, and licensing of advanced nuclear reactors. Coupling systems thermal-hydraulics and computational fluid dynamics codes can be difficult as the pressure coupling converges slowly; however, it is important to obtain the desired accuracy in each part of the primary loop. The authors of this model created an \gls{odc}~\cite{Mau23} approach to coupling SAM and Pronghorn. Leveraging this coupling technique, a \gls{msre} model was developed and released to the \gls{neams}/\gls{nric} \gls{vtb}. The \gls{msre} was chosen to be modeled because of the wealth of experimental data available and because of the strong physics coupling between the core and primary circuit \cite{doi:10.13182/NT8-2-118}. This document contextualizes the history of the \gls{msre}, describes the thermal hydraulics models used, and detail the implementation of multidimensional thermal-hydraulics and system codes based on the \gls{odc} method~\cite{Penn} for the \gls{msre} model. Finally, this document presents how other modelers could apply the SAM-Pronghorn \gls{odc} for other advanced reactor models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Integrating machine learning and multiscale modeling—perspectives, challenges, and opportunities in the biological, biomedical, and behavioral sciences

Fueled by breakthrough technology developments, the biological, biomedical, and behavioral sciences are now collecting more data than ever before. There is a critical need for time- and cost-efficient strategies to analyze and interpret these data to advance human health. The recent rise of machine learning as a powerful technique to integrate multimodality, multifidelity data, and reveal correlations between intertwined phenomena presents a special opportunityin this regard. However, classical machine learning techniques often ignore the fundamental laws of physics and result in ill-posed problems or non-physical solutions. Multiscale modeling is a successful strategy to integrate multiscale, multiphysics data and uncover mechanisms that explain the emergence of function. However, multiscale modeling alone often fails to efficiently combine large data sets from different sources and different levels of resolution. Here we demonstrate that machine learning and multiscale modeling can naturally complement each other to create robust predictive models that integrate the underlying physics to manage ill-posed problems and explore massive design spaces. We critically review the current literature, highlight applications and opportunities, address open questions, and discuss potential challenges and limitations in four overarching topical areas: ordinary differential equations, partial differential equations, data-driven approaches, and theory-driven approaches. Towards these goals, we leverage expertise in applied mathematics, computer science, computational biology, biophysics, biomechanics, engineering mechanics, experimentation, and medicine. Our multidisciplinary perspective suggests that integrating machine learning and multiscale modeling can provide new insights into disease mechanisms, help identify new targets and treatment strategies, and inform decision making for the benefit of human health.

97 MATHEMATICS AND COMPUTING↗

An improved multilevel Monte Carlo method for estimating probability distribution functions in stochastic oil reservoir simulations

In this paper, we develop an improved multilevel Monte Carlo (MLMC) method for estimating cumulative distribution functions (CDFs) of a quantity of interest, coming from numerical approximation of large-scale stochastic subsurface simulations. Compared with Monte Carlo (MC) methods, that require a significantly large number of high-fidelity model executions to achieve a prescribed accuracy when computing statistical expectations, MLMC methods were originally proposed to significantly reduce the computational cost with the use of multifidelity approximations. The improved performance of the MLMC methods depends strongly on the decay of the variance of the integrand as the level increases. However, the main challenge in estimating CDFs is that the integrand is a discontinuous indicator function whose variance decays slowly. To address this difficult task, we approximate the integrand using a smoothing function that accelerates the decay of the variance. In addition, we design a novel a posteriori optimization strategy to calibrate the smoothing function, so as to balance the computational gain and the approximation error. The combined proposed techniques are integrated into a very general and practical algorithm that can be applied to a wide range of subsurface problems for high-dimensional uncertainty quantification, such as a fine-grid oil reservoir model considered in this effort. The numerical results reveal that with the use of the calibrated smoothing function, the improved MLMC technique significantly reduces the computational complexity compared to the standard MC approach. Finally, we discuss several factors that affect the performance of the MLMC method and provide guidance for effective and efficient usage in practice.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Making inertial confinement fusion models more predictive

Computer models of inertial confinement fusion (ICF) implosions play an essential role in experimental design and interpretation as well as our understanding of fundamental physics under the most extreme conditions that can be reached in the laboratory. Building truly predictive models is a significant challenge, with the potential to greatly accelerate progress to high yield and ignition. One path to more predictive models is to use experimental data to update the underlying physics in a way that can be extrapolated to new experiments and regimes. We describe a statistical framework for the calibration of ICF simulations using data collected at the National Ignition Facility (NIF). We perform Bayesian inferences for a series of laser shots using an approach that is designed to respect the physics simulation as much as possible and then build a second model that links the individual-shot inferences together. We show that this approach is able to match multiple X-ray and neutron diagnostics for a whole series of NIF “BigFoot” shots. Within the context of 2D radiation hydrodynamic simulations, our inference strongly favors a significant reduction in fuel compression over other known degradation mechanisms (namely, hohlraum issues and engineering perturbations). This analysis is expanded using a multifidelity technique to pick fuel-ablator mix from several candidate causes of the degraded fuel compression (including X-ray preheat and shock timing errors). Finally, we use our globally calibrated model to investigate the extra laser drive energy that would be required to overcome the inferred fuel compression issues in NIF BigFoot implosions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Prediction and uncertainty quantification of shale well performance using multifidelity Monte Carlo

Uncertainty quantification is an integral component of reservoir management, especially considering the inherent uncertainty in subsurface systems. While a standard practice to estimate the uncertainty, Monte Carlo (MC) simulation is computationally intense when the sampling population comprises high-fidelity simulations. Alternatively, the Multi-fidelity Monte Carlo (MFMC) simulation overcomes this computational intensity by integrating low- and high-fidelity simulations. Our goal is to minimize the number of expensive high-fidelity simulations while maintaining accuracy and using numerous fast and cheap low-fidelity simulations to efficiently sample to input parameter space of interest. We selected gas production from unconventional wells to demonstrate the potential speedups and accuracy of the MFMC approach. The model fidelity usually determines the trade-off between accuracy and efficiency. While the high-fidelity model is more accurate, the low-fidelity model is more efficient. Our high-fidelity simulation includes reservoir simulations of a hydraulically fractured well. On the other hand, our low-fidelity model comprises the parallel-plate flow model. We used differential programming to efficiently solve the 1D flow model, where automatic differentiation is used to efficiently compute the gradients. We matched the production profile of high-fidelity simulations with our low-fidelity simulations. Then, we used a support vector regression to map the high- and low-fidelity input parameters. The mapping function is essential to tune the low-dimensional parameter space of the low-fidelity model to the high-dimensional parameter space of the high-fidelity model. We found that we can use a combination of 9 high fidelity and 10,000 low fidelity simulations to efficiently and accurately simulate pressure management. This method is at least two orders of magnitude faster than only using high-fidelity simulations. Finally, from a broader perspective, MFMC could efficiently estimate the uncertainty of various systems and models, integrating low- and high-fidelity models.

04 OIL SHALES AND TAR SANDS↗

An Adaptive Bayesian Parameter Estimation of a Synchronous Generator Under Gross Errors

Polynomial-chaos-expansion-based surrogate models have recently been advocated in the literature for power system dynamic parameter estimation. Regarding the estimation of the uncertain generator parameters, a Bayesian inference framework has been proposed based on a polynomial-based reduced-order representation of the synchronous machines using assumed parameter values. Then, the non-Gaussian posterior probability distribution functions (pdfs) of these parameters are recovered through the stochastic sampling approach efficiently. However, facing very large parameter errors, the reliability of the surrogate model decreases, yielding biased estimation results. To overcome this problem, here we develop hierarchical Bayesian inference framework that processes the measurements provided by phasor measurement units, while making use of multifidelity surrogates together with the importance sampling method. The latter allows us to estimate in an efficient manner the posterior pdfs of the uncertain parameters through the normalized weights of the prior samples. To improve the accuracy of the posterior pdfs, an adaptive procedure is further adopted in the importance sampling for the gradual evolution of its proposal functions. The new proposals assist in fine-tuning the sample space and thereby help to construct surrogates with higher fidelity. Through an iterative process, this approach is able to estimate accurately and efficiently non-Gaussian posterior pdfs of the uncertain generator parameters subject to gross errors.

42 ENGINEERING↗

MFNets: data efficient all-at-once learning of multifidelity surrogates as directed networks of information sources

We present an approach for constructing a surrogate from ensembles of information sources of varying cost and accuracy. The multifidelity surrogate encodes connections between information sources as a directed acyclic graph, and is trained via gradient-based minimization of a nonlinear least squares objective. While the vast majority of state-of-the-art assumes hierarchical connections between information sources, our approach works with flexibly structured information sources that may not admit a strict hierarchy. The formulation has two advantages: (1) increased data efficiency due to parsimonious multifidelity networks that can be tailored to the application; and (2) no constraints on the training data—we can combine noisy, non-nested evaluations of the information sources. Finally, numerical examples ranging from synthetic to physics-based computational mechanics simulations indicate the error in our approach can be orders-of-magnitude smaller, particularly in the low-data regime, than single-fidelity and hierarchical multifidelity approaches.

97 MATHEMATICS AND COMPUTING↗

Building a Practical Natural Laminar Flow Design Capability

A preliminary natural laminar flow (NLF) design method that has been developed and applied to supersonic and transonic wings with moderate-to-high leading-edge sweeps at flight Reynolds numbers is further extended and evaluated in this paper. The modular design approach uses a knowledge-based design module linked with different flow solvers and boundary layer stability analysis methods to provide a multifidelity capability for NLF analysis and design. An assessment of the effects of different options for stability analysis is included using pressures and geometry from an NLF wing designed for the Common Research Model (CRM). Several extensions to the design module are described, including multiple new approaches to design for controlling attachment line contamination and transition. Finally, a modification to the NLF design algorithm that allows independent control of Tollmien-Schlichting (TS) and cross flow (CF) modes is proposed. A preliminary evaluation of the TS-only option applied to the design of an NLF nacelle for the CRM is performed that includes the use of a low-fidelity stability analysis directly in the design module.

Campbell, Richard L.↗