Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Closure model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

MLUQ (Uncertainty quantification for ML closure models) [SWR-24-36]

Data-based closure models are increasingly being used to replace physic-based closure models because of their flexibility and the growing availability of data. However, closure models are subject to uncertainty because of lack of data in parts of the input space (epistemic uncertainty) or because of noise in the data (aleatoric uncertainty). This software contains a toolbox for training bayesian neural nets that can estimate both uncertainties. A specific treatment is provided to ensure accuracy outside of the data distribution. A set of tools are provided to reduce the dimensionality of the uncertain parameter space, thereby enabling fast uncertainty propagation.

Hassanaly, Malik↗

Improvements to CTF Closure Models for Modelling of Two-Phase Flow

This report documents the efforts to improve the CTF prediction of void fraction and two-phase pressure drop by improving two-phase closure models. Previous validation activities have revealed that CTF tends to overpredict void fraction and two-phase pressure drop. In response to this, two approaches were taken to improve CTF’s predictive capabilities. Based on findings that the interfacial drag and subcooled boiling models significantly impact void prediction, alternative closure models for these physical effects were found and implemented into the code. An extensive assessment was performed by using the existing and newly added two-phase experimental data, which showed that void prediction, wall temperature, and two-phase pressure-drop results are improved by using the newly implemented models. A second approach for improving CTF modeling accuracy involved the use of a Bayesian calibration process that uses CTF validation data to optimize selected modeling coefficients and closure model multipliers to achieve a more accurate prediction of experimental results. A similar assessment was performed with calibrated models that improved the void and pressure-drop prediction for test cases that were both included and not included in the calibration dataset. Results of this study will be used to change the models used in CTF to achieve more accurate BWR analyses moving forward. This study also identified opportunities for improving additional closure models and other opportunities to use calibration techniques to improve CTF.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Variational multiscale reinforcement learning for discovering reduced order closure models of nonlinear spatiotemporal transport systems

Abstract A central challenge in the computational modeling and simulation of a multitude of science applications is to achieve robust and accurate closures for their coarse-grained representations due to underlying highly nonlinear multiscale interactions. These closure models are common in many nonlinear spatiotemporal systems to account for losses due to reduced order representations, including many transport phenomena in fluids. Previous data-driven closure modeling efforts have mostly focused on supervised learning approaches using high fidelity simulation data. On the other hand, reinforcement learning (RL) is a powerful yet relatively uncharted method in spatiotemporally extended systems. In this study, we put forth a modular dynamic closure modeling and discovery framework to stabilize the Galerkin projection based reduced order models that may arise in many nonlinear spatiotemporal dynamical systems with quadratic nonlinearity. However, a key element in creating a robust RL agent is to introduce a feasible reward function, which can be constituted of any difference metrics between the RL model and high fidelity simulation data. First, we introduce a multi-modal RL to discover mode-dependant closure policies that utilize the high fidelity data in rewarding our RL agent. We then formulate a variational multiscale RL (VMRL) approach to discover closure models without requiring access to the high fidelity data in designing the reward function. Specifically, our chief innovation is to leverage variational multiscale formalism to quantify the difference between modal interactions in Galerkin systems. Our results in simulating the viscous Burgers equation indicate that the proposed VMRL method leads to robust and accurate closure parameterizations, and it may potentially be used to discover scale-aware closure models for complex dynamical systems.

97 MATHEMATICS AND COMPUTING↗

Machine Learning Moment Closure Models for the Radiative Transfer Equation III: Enforcing Hyperbolicity and Physical Characteristic Speeds

This is the third paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation. In our previous work (Huang et al. in J Comput Phys 453:110941, 2022), we proposed an approach to learn the gradient of the unclosed high order moment, which performs much better than learning the moment itself and the conventional $P_N$ closure. However, while the ML moment closure has better accuracy, it is not able to guarantee hyperbolicity and has issues with long time stability. In our second paper (Huang et al., in: Machine learning moment closure models for the radiative transfer equation II: enforcing global hyperbolicity in gradient based closures, 2021. arXiv:2105.14410), we identified a symmetrizer which leads to conditions that enforce that the gradient based ML closure is symmetrizable hyperbolic and stable over long time. The limitation of this approach is that in practice the highest moment can only be related to four, or fewer, lower moments. In this paper, we propose a new method to enforce the hyperbolicity of the ML closure model. Motivated by the observation that the coefficient matrix of the closure system is a lower Hessenberg matrix, we relate its eigenvalues to the roots of an associated polynomial. Here, we design two new neural network architectures based on this relation. The ML closure model resulting from the first neural network is weakly hyperbolic and guarantees the physical characteristic speeds, i.e., the eigenvalues are bounded by the speed of light. The second model is strictly hyperbolic and does not guarantee the boundedness of the eigenvalues. Several benchmark tests including the Gaussian source problem and the two-material problem show the good accuracy, stability and generalizability of our hyperbolic ML closure model.

97 MATHEMATICS AND COMPUTING↗

a priori uncertainty quantification of reacting turbulence closure models using Bayesian neural networks

While many physics-based closure model forms have been posited for the sub-filter scale (SFS) in large eddy simulation (LES), vast amounts of data available from direct numerical simulations (DNS) create opportunities to leverage data-driven modeling techniques. Albeit flexible, data-driven models still depend on the dataset and the functional form of the model chosen. Increased adoption of such models requires reliable uncertainty estimates both in the data-informed and out-of-distribution regimes. Here, in this work, we employ Bayesian neural networks (BNNs) to capture both epistemic and aleatoric uncertainties in a reacting flow model. In particular, we model the filtered progress variable scalar dissipation rate which plays a key role in the dynamics of turbulent premixed flames. We demonstrate that BNN models can provide unique insights about the structure of uncertainty of the data-driven closure models. We also propose a method for the incorporation of out-of-distribution information in a BNN, which can be used for out-of-distribution query detection. The efficacy of the model is demonstrated by a priori evaluation on a dataset consisting of a variety of flame conditions and fuels.

97 MATHEMATICS AND COMPUTING↗

Achievements and Ongoing Challenges for advanced CFD Boiling Closure Model Development using Physical Insights from Validation-Oriented High-Fidelity Boiling Experiment

The fundamental understanding of the boiling-associated heat transfer, including sliding bubble effect, is still challenging despite the intensive research for decades in both experimental and computational boiling research communities. One of the main difficulties of boiling experiment come from the fact that direct observation of the underlying principle through experiment is very difficult due to the high complexity of the boiling phenomenon. Also, since the heat transfer characteristics associated with boiling is the result of non-linear interaction of various physical parameters coupled to each other, it is challenging to find the relationship between the parameters for modeling. This paper discusses the authors’ past and ongoing boiling research under CASL (Consortium for Advanced Simulation of Light Water Reactors) program, including the efforts to overcome the difficulties of boiling measurement and model development. In particular, we focus on describing the major achievements, lessons learnt, and ongoing challenges for the CFD boiling closure model development based on the high-fidelity subcooled flow boiling experiment at Texas A&M University (TAMU). The major research achievements discussed through this paper include (i) novel boiling measurement strategy and high-fidelity validation data production, (ii) dedicated effort to identify the critical measurement issues in boiling experiment, (iii) new physical insight into sliding bubble heat transfer mechanisms, and (iv) new boiling closure model development. Discussion is also made on the ongoing challenges for the boiling closure model development and the future research plan based on the lessons learnt.

42 ENGINEERING↗

Initial use of Nek5000/Cardinal to improve closure models in Pronghorn

Heat transfer coefficient closure models for pebble bed reactors are built using a data-driven approach by leveraging the capabilities of an Evolutionary Algorithm entitled Particle Swarm Optimization (PSO). In the present work, the Computational Fluid Dynamics code nekRS was used in order to collect the high-fidelity flow data for a core with 1,568 pebbles. To characterize the heat transfer, multiple concentric regions were considered to extract the physical quantities of interest, e.g./ the Reynolds number. The PSO algorithm is employed as part of an inverse problem targeting determine what are the coefficients for a Nusselt number correlation to match the collected data. Such correlation should follow any given format that is defined a priori. Finally, two correlations are proposed, one with an implicit dependence on the pebbles’ wall temperatures and another expressed as a fully explicit correlation depending on the flow conditions and the position within the core. Anyway, given the generic nature of the proposed approach, correlations following different formats could be tested. Preliminary results for the high-fidelity simulation of a fast MSR core are presented. The target Reynolds number is currently 20K, with the expectation that this will increase, pending the availability of further computational resources. These simulations will be used to inform lower fidelity models, including a coarse CFD turbulence model in Pronghorn. Additionally, they will serve as a reference for the RANS models in Nek5000/NekRS.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Machine learning moment closure models for the radiative transfer equation I: Directly learning a gradient based closure

In this paper, we take a data-driven approach and apply machine learning to the moment closure problem for the radiative transfer equation in slab geometry. Instead of learning the unclosed high order moment, we propose to directly learn the gradient of the high order moment using neural networks. This new approach is consistent with the exact closure we derive for the free streaming limit and also provides a natural output normalization. Finally, a variety of benchmark tests, including the variable scattering problem, the Gaussian source problem with both periodic and reflecting boundaries, and the two-material problem, show both good accuracy and generalizability of our machine learning closure model.

Computer science↗

A careful examination of closure models in Euler–Lagrange Simulations of compressible multiphase flow in a planar shock particle curtain problem

In this work we present a comprehensive investigation of state-of-the-art closure models employed to represent interphase momentum, thermal, and work exchange between the gas and particulate phases for Euler–Lagrange (EL) simulations in shock-driven flows. A complete list of closures for the force, torque, heat transfer, and work exchange models is provided. In particular, the present work includes a stochastic closure for the particle-to-particle variation in the quasi-steady force and a deterministic closure for particle-to-particle variation in the added mass force in an EL framework. These variations arise due to the presence of neighboring particles and particle–particle interactions. To investigate the importance of each closure term, we carry out fully three-dimensional simulations for a planar shock propagating over a random bed of inert particles. The primary goal is to evaluate the role of each closure term on the gas dynamic features (such as transmitted and reflected shock locations) and particle curtain features (such as upstream and downstream curtain locations). To this end, thirteen cases are considered, with each case progressively including a closure model with the goal to identify and quantify its contribution to the simulated dynamics. We show that the volume fraction dependence of the mean force models plays an important role in generating wave-like instabilities that lead to concentration bands. In addition, fluctuations in quasi-steady and added mass forces primarily decrease the internal instabilities that tend to enhance local volume fraction variations. Particle rotation is primarily due to inter-particle collisions, is generally weak, and does not play an important role in the translational dynamics for the present configuration. Inter-phase heat transfer has a strong effect on gas phase temperature, slows down the transmitted and reflected shocks, and decreases the width of the curtain. Furthermore, the absence of a work-coupling model fails to conserve the total energy, greatly under-predicts the gas temperature which in turn affects the particle dynamics.

Compressible flow↗

Differentiable physics-enabled closure modeling for Burgers’ turbulence

Abstract Data-driven turbulence modeling is experiencing a surge in interest following algorithmic and hardware developments in the data sciences. We discuss an approach using the differentiable physics paradigm that combines known physics with machine learning to develop closure models for Burgers’ turbulence. We consider the one-dimensional Burgers system as a prototypical test problem for modeling the unresolved terms in advection-dominated turbulence problems. We train a series of models that incorporate varying degrees of physical assumptions on an a posteriori loss function to test the efficacy of models across a range of system parameters, including viscosity, time, and grid resolution. We find that constraining models with inductive biases in the form of partial differential equations that contain known physics or existing closure approaches produces highly data-efficient, accurate, and generalizable models, outperforming state-of-the-art baselines. Addition of structure in the form of physics information also brings a level of interpretability to the models, potentially offering a stepping stone to the future of closure modeling.

97 MATHEMATICS AND COMPUTING↗

3D Cell-centered hydrodynamics with subscale closure model and multi-material remap

We extend a higher-order finite volume cell-centered hydrodynamic (CCH) formulation to include an interface-aware subscale closure model and a multi-material remap for simulating 3D compressible hydrodynamic problems within an arbitrary Lagrangian-Eulerian (ALE) framework. This CCH formulation involves a multidirectional approximate Riemann solution using quadratic polynomial reconstructions of the stress tensor and the velocity. At the subscale level, we determine pair-wise material interactions by solving a distinct approximate Riemann problem at the common interface, using the volume of fluids (VOF) method to find the interface. Material interactions are constrained to ensure smooth pressure equilibration among materials. The accuracy and robustness of the ALE method is demonstrated by simulating a suite of 3D Cartesian multi-material problems covering both gas and solid dynamics, where each test case has two or more materials.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Point-particle drag, lift, and torque closure models using machine learning: Hierarchical approach and interpretability

Developing deterministic neighborhood-informed point-particle closure models using machine learning has garnered interest recently from the dispersed multiphase flow community. The robustness of neural models for this complex multibody problem is hindered by the availability of particle-resolved data. Here, the present work addresses this unavoidable limitation of data paucity by implementing two strategies: (1) by using a rotation and reflection equivariant neural network and (2) by pursuing a physics-based hierarchical machine learning approach. The resulting machine-learned models are observed to achieve a maximum accuracy of 85% and 96% in the prediction of neighbor-induced force and torque fluctuations, respectively, for a wide range of Reynolds number and volume fraction conditions considered. Furthermore, we pursue force and torque network architectures that provide universal prediction spanning a wide range of Reynolds number (0.25 ≤ Re ≤250) and particle volume fraction (0 ≤ φ ≤0.4). The hierarchical nature of the approach enables improved prediction of quantities such as streamwise torque, by going beyond binary interactions to include trinary interactions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

On Master-Length Scale Formulations for Stable Conditions in Turbulence Closure Models

Three formulations of the turbulence-length scales used in numerical modelling of atmospheric flows are compared. The comparison is made using the Mellor–Yamada–Nakanishi–Niino turbulence closure model within the stable boundary layer local similarity framework. With an appropriate choice of model constants, the model predictions are barely discernible and compare well with the empirical data obtained from the SHEBA campaign.

54 ENVIRONMENTAL SCIENCES↗

Deep learning closure models for large-eddy simulation of flows around bluff bodies

Near-wall flow simulation remains a central challenge in aerodynamics modelling: Reynolds-averaged Navier–Stokes predictions of separated flows are often inaccurate, and large-eddy simulation (LES) can require prohibitively small near-wall mesh sizes. A deep learning (DL) closure model for LES is developed by introducing untrained neural networks into the governing equations and training in situ for incompressible flows around rectangular prisms at moderate Reynolds numbers. The DL-LES models are trained using adjoint partial differential equation (PDE) optimization methods to match, as closely as possible, direct numerical simulation (DNS) data. They are then evaluated out-of-sample – for aspect ratios, Reynolds numbers and bluff-body geometries not included in the training data – and compared with standard LES models. The DL-LES models outperform these models and are able to achieve accurate LES predictions on a relatively coarse mesh (downsampled from the DNS mesh by factors of four or eight in each Cartesian direction). We study the accuracy of the DL-LES model for predicting the drag coefficient, near-wall and far-field mean flow, and resolved Reynolds stress. A crucial challenge is that the LES quantities of interest are the steady-state flow statistics; for example, a time-averaged velocity component $\langle {u}_i\rangle (x) = \lim _{t \rightarrow \infty } ({1}/{t}) \int _0^t u_i(s,x)\, {\rm d}s$ . Calculating the steady-state flow statistics therefore requires simulating the DL-LES equations over a large number of flow times through the domain. It is a non-trivial question whether an unsteady PDE model with a functional form defined by a deep neural network can remain stable and accurate on $t \in [0, \infty )$ , especially when trained over comparatively short time intervals. Our results demonstrate that the DL-LES models are accurate and stable over long time horizons, which enables the estimation of the steady-state mean velocity, fluctuations and drag coefficient of turbulent flows around bluff bodies relevant to aerodynamics applications.

Mechanics↗

Scientific machine learning for closure models in multiscale problems: A review

Here, closure problems are omnipresent when simulating multiscale systems, where some quantities and processes cannot be fully prescribed despite their effects on the simulation's accuracy. Recently, scientific machine learning approaches have been proposed as a way to tackle the closure problem, combining traditional (physics-based) modeling with data-driven (machine-learned) techniques, typically through enriching differential equations with neural networks. This paper reviews the different reduced model forms, distinguished by the degree to which they include known physics, and the different objectives of a priori and a posteriori learning. The importance of adhering to physical laws (such as symmetries and conservation laws) in choosing the reduced model form and choosing the learning method is discussed. The effect of spatial and temporal discretization and recent trends toward discretization-invariant models are reviewed. In addition, we make the connections between closure problems and several other research disciplines: inverse problems, Mori-Zwanzig theory, and multi-fidelity methods. In conclusion, much progress has been made with scientific machine learning approaches for solving closure problems, but many challenges remain. In particular, the generalizability and interpretability of learned models is a major issue that needs to be addressed further.

97 MATHEMATICS AND COMPUTING↗

Neural network representability of fully ionized plasma fluid model closures

The closure problem in fluid modeling is a well-known challenge to modelers aiming to accurately describe their systems of interest. Over many years, analytic formulations in a wide range of regimes have been presented but a practical, generalized fluid closure for magnetized plasmas remains an elusive goal. Here, as a first step toward constructing a novel data-based approach to this problem, we apply ever-maturing machine learning methods to assess the capability of neural network architectures to reproduce crucial physics inherent in known magnetized plasma closures. We find encouraging results, indicating the applicability of neural networks to closure physics, but also arrive at recommendations on how one should choose appropriate network architectures for the given locality properties dictated by the underlying physics of the plasma.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Improvement of two-phase closure models in CTF using Bayesian inference

Under the Consortium for Advanced Simulation of Light Water Reactors (CASL) program, extensive capabilities have been developed in CTF to analyze light-water reactors (LWRs) for normal operating conditions, departure from nucleate boiling (DNB), and system transients. However, further improvements are required in the modeling and simulation of boiling water reactors (BWRs), which is a focus of the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. In this work, CTF validation results were used to optimize selected modeling coefficients by calibrating to experimental data using a Bayesian inference approach. Here, calibration studies were conducted to improve (vapor) void fraction prediction without worsening the two-phase pressure drop prediction, as well as to improve the two-phase pressure drop prediction. Calibration was performed for interfacial drag and wall shear models. Surrogates were developed to alleviate the computational expense required for sampling the parameter space using Markov chain Monte Carlo (MCMC). An assessment performed with calibrated models demonstrated an improvement of CTF in its prediction of key parameters such as void fraction and two-phase pressure drop.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗