Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multifidelity modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

89 records · Page 5

Release on the Virtual Test Bed of a Molten Salt Reactor Experiment SAM-Pronghorn Coupled Model using the Domain Overlapping Approach

The nuclear industry is taking leaps in innovations with companies seeking a sustainable energy future through advanced nuclear reactors. The Department of Energy (DOE)’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program seeks to substantiate and bolster the deployment of advanced reactors through flexible multifidelity, multiphysics simulations of advanced nuclear reactors. Applications like SAM for one-dimensional systems thermalhydraulics, and Pronghorn for multidimensional coarse mesh thermal-hydraulics, are geared to support innovations in industry by facilitating design, optimization, and licensing of advanced nuclear reactors. Coupling systems thermal-hydraulics and computational fluid dynamics codes can be difficult as the pressure coupling converges slowly; however, it is important to obtain the desired accuracy in each part of the primary loop. The authors of this model created an Overlapping-Domain Coupling (ODC) approach to coupling SAM and Pronghorn. Leveraging this coupling technique, a Molten Salt Reactor Experiment (MSRE) model was developed and released to the NEAMS/National Reactor Innovation Center (NRIC) Virtual Test Bed (VTB). The MSRE was chosen to be modeled because of the wealth of experimental data available and because of the strong physics coupling between the core and primary circuit. This paper contextualizes the history of the MSRE, describes the thermal hydraulics models used, and detail the implementation of multidimensional thermal-hydraulics and system codes based on the ODC method for the MSRE model. Finally, this paper presents how other modelers could apply the SAM Pronghorn ODC for other advanced reactor models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Stacked networks improve physics-informed training: Applications to neural networks and deep operator networks

Physics-informed neural networks and operator networks have shown promise for effectively solving equations modeling physical systems. However, these networks can happen to be difficult or impossible to train accurately. Here, we present a novel multifidelity framework for stacking physics-informed neural networks and operator networks that facilitates training. We successively build a chain of networks, where the output at one step can act as a low-fidelity input for training a longer chain, gradually increasing the expressivity of the learnt model. The equations imposed at each step of the iterative process can be the same or different (akin to simulated annealing). The iterative (stacking) nature of the proposed method allows us to learn progressively features of a solution which could have been hard to learn directly. Through benchmark problems including a nonlinear pendulum, the wave equation, and the viscous Burgers equation, we show how stacking can be used to improve the accuracy and reduce the required size of physics-informed neural networks and operator networks.

97 MATHEMATICS AND COMPUTING↗

A multifidelity Bayesian optimization method for inertial confinement fusion design

Due to their cost, experiments for inertial confinement fusion (ICF) heavily rely on numerical simulations to guide design. As simulation technology progresses, so too can the fidelity of models used to plan for new experiments. However, these high-fidelity models are by themselves insufficient for optimal experimental design, because their computational cost remains too high to efficiently and effectively explore the numerous parameters required to describe a typical experiment. Therefore, traditionally, ICF design has relied on low-fidelity modeling to initially identify potentially interesting design regions, which are then subsequently explored via selected high-fidelity modeling. In this paper, we demonstrate that this two-step approach can be insufficient: even for simple design problems, a two-step optimization strategy can lead high-fidelity searching toward incorrect regions and consequently waste computational resources on parameter regimes far away from the true optimal solution. We reveal that a primary cause of this behavior in ICF design problems is the presence of low-fidelity optima in different regions of the parameter space far away from high-fidelity optima. To address this issue, we propose an iterative multifidelity Bayesian optimization method based on Gaussian Process Regression that leverages both low- and high-fidelity models simultaneously. We demonstrate, using both two- and eight-dimensional ICF test problems, that our algorithm can effectively utilize both low-fidelity and high-fidelity models to refine the designs. This approach proves to be more efficient than relying solely on high-fidelity modeling for optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Transfer learning of neural surrogates on multifidelity groundwater simulations

Multifidelity data used in the paper published in Advances in Water Resources 206 (2025) 105140, https://doi.org/10.1016/j.advwatres.2025.105140 The code used to process the data is openly available on GitHub at https://github.com/Model-Reduction-and-UQ-Group/Transfer_Learning_K_reconstruction Computationally inexpensive surrogates of process-based models, such as deep neural networks, enable ensemble-based computations used in risk assessment, data assimilation, etc. However, generation of large datasets required to train a neural network can be as expensive as the ensemble simulations themselves. We ameliorate this challenge by using data from multifidelity (MF) groundwater simulations and transfer learning (TL) to reduce data generation costs while maintaining model accuracy. As a computational example, we train a deep convolutional neural network (CNN) to reconstruct permeability fields from saturation maps derived from a multiphase flow model. Starting with very low- and low-fidelity data generated on increasingly coarse meshes, we pretrain the CNN, followed by output-layer training and fine-tuning using only a limited number of high-fidelity samples. We demonstrate the surrogate’s robustness when interpreting low-quality inputs—such as interpolated maps or data affected by noise—which has strong implications for the applicability in practical hydrogeological scenarios. This multilevel MF-TL strategy achieves a favorable trade-off between computational efficiency and predictive accuracy, significantly outperforming high-fidelity-only approaches under the same computational budget.

Chiofalo, Alessia [University of Bologna] (ORCID:0↗

Release on the Virtual Test Bed of an MSRE thermal hydraulics model

The nuclear industry is taking leaps in innovations with companies seeking a sustainable energy future through advanced nuclear reactors. The \gls{DOE}’s \gls{neams} program seeks to substantiate and bolster the deployment of advanced reactors through flexible multifidelity, multiphysics simulations of advanced nuclear reactors. Applications like SAM for one-dimensional systems thermal-hydraulics, and Pronghorn for multidimensional coarse mesh thermal-hydraulics, are geared to support innovations in industry by facilitating design, optimization, and licensing of advanced nuclear reactors. Coupling systems thermal-hydraulics and computational fluid dynamics codes can be difficult as the pressure coupling converges slowly; however, it is important to obtain the desired accuracy in each part of the primary loop. The authors of this model created an \gls{odc}~\cite{Mau23} approach to coupling SAM and Pronghorn. Leveraging this coupling technique, a \gls{msre} model was developed and released to the \gls{neams}/\gls{nric} \gls{vtb}. The \gls{msre} was chosen to be modeled because of the wealth of experimental data available and because of the strong physics coupling between the core and primary circuit \cite{doi:10.13182/NT8-2-118}. This document contextualizes the history of the \gls{msre}, describes the thermal hydraulics models used, and detail the implementation of multidimensional thermal-hydraulics and system codes based on the \gls{odc} method~\cite{Penn} for the \gls{msre} model. Finally, this document presents how other modelers could apply the SAM-Pronghorn \gls{odc} for other advanced reactor models. Current item is the set of slides for ANS Winter 23. The release of the model and the ANS summary have already been approved

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Release on the Virtual Test Bed of an MSRE thermal hydraulics model

The nuclear industry is taking leaps in innovations with companies seeking a sustainable energy future through advanced nuclear reactors. The \gls{DOE}’s \gls{neams} program seeks to substantiate and bolster the deployment of advanced reactors through flexible multifidelity, multiphysics simulations of advanced nuclear reactors. Applications like SAM for one-dimensional systems thermal-hydraulics, and Pronghorn for multidimensional coarse mesh thermal-hydraulics, are geared to support innovations in industry by facilitating design, optimization, and licensing of advanced nuclear reactors. Coupling systems thermal-hydraulics and computational fluid dynamics codes can be difficult as the pressure coupling converges slowly; however, it is important to obtain the desired accuracy in each part of the primary loop. The authors of this model created an \gls{odc}~\cite{Mau23} approach to coupling SAM and Pronghorn. Leveraging this coupling technique, a \gls{msre} model was developed and released to the \gls{neams}/\gls{nric} \gls{vtb}. The \gls{msre} was chosen to be modeled because of the wealth of experimental data available and because of the strong physics coupling between the core and primary circuit \cite{doi:10.13182/NT8-2-118}. This document contextualizes the history of the \gls{msre}, describes the thermal hydraulics models used, and detail the implementation of multidimensional thermal-hydraulics and system codes based on the \gls{odc} method~\cite{Penn} for the \gls{msre} model. Finally, this document presents how other modelers could apply the SAM-Pronghorn \gls{odc} for other advanced reactor models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Prediction and uncertainty quantification of shale well performance using multifidelity Monte Carlo

Uncertainty quantification is an integral component of reservoir management, especially considering the inherent uncertainty in subsurface systems. While a standard practice to estimate the uncertainty, Monte Carlo (MC) simulation is computationally intense when the sampling population comprises high-fidelity simulations. Alternatively, the Multi-fidelity Monte Carlo (MFMC) simulation overcomes this computational intensity by integrating low- and high-fidelity simulations. Our goal is to minimize the number of expensive high-fidelity simulations while maintaining accuracy and using numerous fast and cheap low-fidelity simulations to efficiently sample to input parameter space of interest. We selected gas production from unconventional wells to demonstrate the potential speedups and accuracy of the MFMC approach. The model fidelity usually determines the trade-off between accuracy and efficiency. While the high-fidelity model is more accurate, the low-fidelity model is more efficient. Our high-fidelity simulation includes reservoir simulations of a hydraulically fractured well. On the other hand, our low-fidelity model comprises the parallel-plate flow model. We used differential programming to efficiently solve the 1D flow model, where automatic differentiation is used to efficiently compute the gradients. We matched the production profile of high-fidelity simulations with our low-fidelity simulations. Then, we used a support vector regression to map the high- and low-fidelity input parameters. The mapping function is essential to tune the low-dimensional parameter space of the low-fidelity model to the high-dimensional parameter space of the high-fidelity model. We found that we can use a combination of 9 high fidelity and 10,000 low fidelity simulations to efficiently and accurately simulate pressure management. This method is at least two orders of magnitude faster than only using high-fidelity simulations. Finally, from a broader perspective, MFMC could efficiently estimate the uncertainty of various systems and models, integrating low- and high-fidelity models.

04 OIL SHALES AND TAR SANDS↗

Building a Practical Natural Laminar Flow Design Capability

A preliminary natural laminar flow (NLF) design method that has been developed and applied to supersonic and transonic wings with moderate-to-high leading-edge sweeps at flight Reynolds numbers is further extended and evaluated in this paper. The modular design approach uses a knowledge-based design module linked with different flow solvers and boundary layer stability analysis methods to provide a multifidelity capability for NLF analysis and design. An assessment of the effects of different options for stability analysis is included using pressures and geometry from an NLF wing designed for the Common Research Model (CRM). Several extensions to the design module are described, including multiple new approaches to design for controlling attachment line contamination and transition. Finally, a modification to the NLF design algorithm that allows independent control of Tollmien-Schlichting (TS) and cross flow (CF) modes is proposed. A preliminary evaluation of the TS-only option applied to the design of an NLF nacelle for the CRM is performed that includes the use of a low-fidelity stability analysis directly in the design module.

Campbell, Richard L.↗

Multifidelity Approach to Sensitivity Estimation in Large-Eddy Simulation

A novel approach to compute affordable approximate sensitivities in a large-eddy simulation (LES) is proposed and assessed. The approach is based on solving a Reynolds-averaged Navier–Stokes (RANS) problem that has been linearized around the mean LES solution, with closure modeling required for the linearized changes in turbulent Reynolds stresses. In the present study, the closure modeling is based on a linearized algebraic turbulence model. The method is assessed for the flow over a NACA0012 airfoil at a fixed angle of attack, with the Reynolds number as the variable parameter. The results show that, provided an accurate linearized closure model, the method predicts the correct sensitivity of the skin friction coefficient and the mean velocity field at the cost of a linearized RANS, which provides an important proof-of-concept for this approach. Here, the linearized algebraic turbulence model with standard model coefficients produces a reasonably accurate sensitivity, but the results also suggest that accuracy could be gained from recalibrating the model coefficients for this new use of the model.

42 ENGINEERING↗

Multifidelity DRAM Simulation in SST [Poster]

We will always want to speed up simulation. While architects are able to pick between levels of detail when designing simulation, we will find further speed-up if we can adjust the level of detail during simulation, depending on the behavior of the simulated components. We create a simple fixed-latency model for each phase. On the first execution of a phase, we record the average latency of accesses. On subsequent executions, we skip DRAMSin 3 and send the response back using the average latency.

97 MATHEMATICS AND COMPUTING↗

Reliable extrapolation of deep neural operators informed by physics or sparse observations

Deep neural operators can learn nonlinear mappings between infinite-dimensional function spaces via deep neural networks. As promising surrogate solvers of partial differential equations (PDEs) for real-time prediction, deep neural operators such as deep operator networks (DeepONets) provide a new simulation paradigm in science and engineering. Pure data-driven neural operators and deep learning models, in general, are usually limited to interpolation scenarios, where new predictions utilize inputs within the support of the training set. However, in the inference stage of real-world applications, the input may lie outside the support, i.e., extrapolation is required, which may result to large errors and unavoidable failure of deep learning models. Here, we address this challenge of extrapolation for deep neural operators. First, we systematically investigate the extrapolation behavior of DeepONets by quantifying the extrapolation complexity, via the 2-Wasserstein distance between two function spaces and propose a new strategy of bias–variance trade-off for extrapolation with respect to model capacity. Subsequently, we develop a complete workflow, including extrapolation determination, and we propose five reliable learning methods that guarantee a safe prediction under extrapolation by requiring additional information—the governing PDEs of the system or sparse new observations. The proposed methods are based on either fine-tuning a pre-trained DeepONet or multifidelity learning. We demonstrate the effectiveness of the proposed framework for various types of parametric PDEs. Furthermore, our systematic comparisons provide practical guidelines for selecting a proper extrapolation method depending on the available information, desired accuracy, and required inference speed.

42 ENGINEERING↗

Learning Optimal Aerodynamic Designs

This project created a framework for efficient, accurate, and scalable deep neural network representations of design optimization problem solutions. The inputs to these DNN representations are the vector of design requirement parameters, the outputs are the optimal design variables, and the goal is to learn the map from inputs to outputs (i.e., inverse design). The team addressed the problem of the optimal shape design of aerodynamic lifting surfaces—in particular aircraft wings—using a Reynolds-Average Navier Stokes model to govern the CFD-based aerodynamic shape optimization. The inverse design map for such problems is very complex and high-dimensional, involving inputs and outputs on the order of 1000s. To approximate this inverse design map, the team developed algorithms to construct parsimonious DNN architectures, which automatically identify low-dimensional manifolds in which design requirements affect optimal shape parameters, and trained these architectures with multifidelity optimization methods. The resulting methodology accurately and automatically designs optimal aerodynamic lifting surfaces with very high accuracy (99%) at interactive speeds, of the order of milliseconds, resulting in factors of one million or more speedup relative to CFD-based design optimization.

97 MATHEMATICS AND COMPUTING↗

Improving Multi-Model Trajectory Simulation Estimators using Model Selection and Tuning

Multi-model Monte Carlo methods have been demonstrated to be an efficient and accurate alternative to standard Monte Carlo (MC) in the model-based propagation of uncertainty in entry, descent, and landing (EDL) applications. These multi-model MC methods fuse predictions from low-fidelity models with the high-fidelity EDL model of interest to produce unbiased statistics with a fraction of the computational cost. The accuracy and efficiency of the multi-model MC methods are dependent upon the magnitude of correlations of the low-fidelity models with the high-fidelity model, but also upon the correlation amongst the low-fidelity models, and their relative computational cost. Because of this layer of complexity, the question of how to optimally select the set of low-fidelity models has remained open. In this work, methods for optimal model construction and tuning are investigated as a means to increase the speed and precision of trajectory simulation for EDL. Specifically, the focus is on the inclusion of low-fidelity model tuning within the sample allocation optimization that accompanies multi-model MC methods. Preliminary results indicate that low-fidelity model tuning can significantly improve efficiency and precision of trajectory simulations and provide an increased edge to multi-model MC methods when compared to standard MC. The challenges and potential benefits to exploring a fully iterative and comprehensive optimization strategy in future work are highlighted.

uncertainty quantification↗

Toward digital design at the exascale: An overview of project ICECap

High performance computing has entered the Exascale Age. Capable of performing over 1018 floating point operations per second, exascale computers, such as El Capitan, the National Nuclear Security Administration's first, have the potential to revolutionize the detailed in-depth study of highly complex science and engineering systems. However, in addition to these kind of whole machine “hero” simulations, exascale systems could also enable new paradigms in digital design by making petascale hero runs routine. Currently, untenable problems in complex system design, optimization, model exploration, and scientific discovery could all become possible. Motivated by the challenge of uncovering the next generation of robust high-yield inertial confinement fusion (ICF) designs, project ICECap (Inertial Confinement on El Capitan) attempts to integrate multiple advances in machine learning (ML), scientific workflows, high performance computing, GPU-acceleration, and numerical optimization to prototype such a future. Built on a general framework, ICECap is exploring how these technologies could broadly accelerate scientific discovery on El Capitan. In addition to our requirements, system-level design, and challenges, we describe some of the key technologies in ICECap, including ML replacements for multiphysics packages, tools for human-machine teaming, and algorithms for multifidelity design optimization under uncertainty. As a test of our prototype pre-El Capitan system, we advance the state-of-the art for ICF hohlraum design by demonstrating the optimization of a 17-parameter National Ignition Facility experiment and show that our ML-assisted workflow makes design choices that are consistent with physics intuition, but in an automated, efficient, and mathematically rigorous fashion.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Design Environment for Multifidelity and Multidisciplinary Components

One of the greatest challenges when developing propulsion systems is predicting the interacting effects between the fluid loads, thermal loads, and structural deflection. The interactions between technical disciplines often are not fully analyzed, and the analysis in one discipline often uses a simplified representation of other disciplines as an input or boundary condition. For example, the fluid forces in an engine generate static and dynamic rotor deflection, but the forces themselves are dependent on the rotor position and its orbit. It is important to consider the interaction between the physical phenomena where the outcome of each analysis is heavily dependent on the inputs (e.g., changes in flow due to deflection, changes in deflection due to fluid forces). A rigid design process also lacks the flexibility to employ multiple levels of fidelity in the analysis of each of the components. This project developed and validated an innovative design environment that has the flexibility to simultaneously analyze multiple disciplines and multiple components with multiple levels of model fidelity. Using NASA's open-source multidisciplinary design analysis and optimization (OpenMDAO) framework, this multifaceted system will provide substantially superior capabilities to current design tools.

Platt, Michael↗

Subsampling of Parametric Models with Bifidelity Boosting

Least squares regression is a ubiquitous tool for building emulators (a.k.a. surrogate models) of problems across science and engineering for purposes such as design space exploration and uncertainty quantification. When the regression data are generated using an experimental design process (e.g., a quadrature grid) involving computationally expensive models, or when the data size is large, sketching techniques have shown promise at reducing the cost of the construction of the regression model while ensuring accuracy comparable to that of the full data. However, random sketching strategies, such as those based on leverage scores, lead to regression errors that are random and may exhibit large variability. To mitigate this issue, we present a novel boosting approach that leverages cheaper, lower-fidelity data of the problem at hand to identify the best sketch among a set of candidate sketches. This in turn specifies the sketch of the intended high-fidelity model and the associated data. We provide theoretical analyses of this bifidelity boosting (BFB) approach and discuss the conditions the low- and high-fidelity data must satisfy for a successful boosting. In doing so, we derive a bound on the residual norm of the BFB sketched solution relating it to its ideal, but computationally expensive, high-fidelity boosted counterpart. Finally, empirical results on both manufactured and PDE data corroborate the theoretical analyses and illustrate the efficacy of the BFB solution in reducing the regression error, as compared to the nonboosted solution.

97 MATHEMATICS AND COMPUTING↗