Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Finite Volume”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Developing And Scaling an OpenFOAM Model to Study Turbulent Flow in a HFIR Coolant Channel

Improving the understanding of how computational fluid dynamics (CFD) direct numerical simulations (DNS) of flows in the High Flux Isotope Reactor (HFIR) perform when run in parallel using the high performance computing (HPC) platform Summit at the Oak Ridge Leadership Computing Facility (OLCF) is of particular importance to boost the computational tools used to support HFIR conversion to low enriched fuel (LEU). Evaluation of scaling performance was driven by the increasing importance of graphics processing unit (GPU) usage in HPC, which is becoming the standard for modern supercomputers such as Summit. The desired results are to obtain a strong positive correlation between the computational resources dedicated to a problem and the relative speed-up of the simulation in comparison to a benchmark. This capability will allow substantially improvement in HFIR flow analytical capabilities, specifically when predicting turbulence properties at high Reynolds numbers. The study leverages previous simulation results performed with code PHASTA (finite element) on HPC platforms Cori (NERSC) and Theta (ALCF) [1] with computing options provided in the computing platform OpenFOAM (finite volume) at OLCF. Transitioning from PHASTA to OpenFOAM will (1) eliminate dependence on third-party software for mesh generation and manipulation, (2) reduce resource needs by employing modern architectures, and (3) build expertise for future modeling of HFIR-specific problems like heat transfer in involute geometry, entrance effects, flow structure in channel corners, and so on—all important issues when defining the available thermal margins in the transition to LEU. CPUs and GPUs differ significantly in their architecture and utilization, as discussed in the literature [2]. The most important differences are in the approach to computations and their memory. A single GPU contains a large quantity of cores, enabling it to perform with a much higher throughput than a CPU, but execution requires a different approach. GPU codes execute instructions using the Single-Instruction Multiple-Thread (SIMT) approach in which a single instruction is used for groups of threads called warps. A warp typically consists of 32 threads which must execute the same set of instructions, although on separate threads. Alternately, a CPU has far fewer cores that are much more flexible in their operation, excelling at quickly performing more complex serial computations. This is why GPUs have greater throughput when properly utilized. The second important difference is seen when comparing their memory spaces. Limited memory allocations and CPU–GPU communications cause a significant bottleneck in GPU-accelerated programs. Further study was required to properly take advantage of GPU resources. A comprehensive analysis of code performance and the model-specific features of turbulence constitutes the core of this work. In this study, a DNS simulation of HFIR channel turbulence was performed with the finite volume CFD code OpenFOAM v2112 and CUDA v11.0 on Red Hat Enterprise Linux v8.2. The OpenFOAM installation had AMGx integrated to enable GPU acceleration and utilizes the PETSc4FOAM library. The computational resources and the problem size were scaled on CPU and CPU + GPU architectures to gain a better understanding of the performance of a DNS problem on modern computing hardware. The study aimed to analyze the scaling of the code exclusively on CPUs and then to examine the scaling of the codes with GPU acceleration enabled. Scaling studies included CPU and GPU acceleration on a mesh of varying resolution to analyze the impact of problem size relative to computational resources. In the course of preparing the GPU configuration on Summit, mainly using the AMGX solvers, difficulties were encountered stemming from constant changes resulting from extensive ongoing development activities and the changing environment. This resulted in the inability to complete the GPU portion of the work. The code was compiled and tested, but production runs to assess acceleration were not performed because the used discretional compute time allocation expired as year-end approached. The Summit HPC platform is scheduled for decommissioning in 2024, making it unattractive for future use with Nvidia-based GPUs. Therefore, the work will be moved onto NERSC machines in FY24. An application was prepared and submitted, and sufficient node-hours were awarded to continue the research in the next calendar year. This report summarizes work performed thus far, which mostly focused on CPU OpenFOAM computing.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Moving Embedded Boundary Approach for the Compressible Navier-Stokes Equations in a Block-Structured Adaptive Refinement Framework

A computational technique has been developed to perform compressible flow simulations involving moving boundaries using an embedded boundary approach within the block-structured adaptive mesh refinement (SAMR) framework of AMReX [1], [91], [92]. We leverage the SAMR capability to obtain quantitatively accurate results whilst using robust, second-order finite volume schemes. A conservative, unsplit, cut-cell approach is utilized and a ghost-cell approach is developed for computing the flux on the moving, embedded boundary faces. A third-order least-squares formulation has been developed to compute the wall velocity gradients, and was found to significantly improve the performance of the solver in terms of the quantitative comparison of surface quantities such as the skin friction coefficient. Various test cases are performed to validate the method, and compared with analytical, experimental, and other numerical results in literature. Inviscid and viscous test cases are performed that span a wide regime of flow speeds - acoustic (harmonically pulsating sphere), smooth flows (expansion fan created by a receding piston) and flows with shocks (shock-cylinder interaction, shock-wedge interaction, pitching NACA 0012 airfoil and shock-cone interaction). A closed system with moving boundaries - an oscillating piston in a cylinder, showed that the percentage error in mass within the system decreases with refinement, demonstrating that the numerical scheme is conservative with grid refinement, but is not discretely conservative. Viscous test cases involve that of a horizontally moving cylinder at Re = 40, an inline oscillating cylinder at Re = 100, and a transversely oscillating cylinder at Re = 185. The judicious use of adaptive mesh refinement with appropriate refinement criteria to capture the regions of interest leads to well-resolved flow features, and good quantitative comparison is observed with the results available in literature.

adaptive refinement↗

Linear and Nonlinear Solvers for Simulating Multiphase Flow within Large-Scale Engineered Subsurface Systems

Simulation of multiphase flow in the subsurface is well-known to be computationally challenging. While there have been many studies that have explored approaches to overcoming these challenges, they often utilize relatively simple case studies. In this paper, we focus on the unique numerical challenges posed by modeling large-scale engineered subsurface systems, characterized by discrete features embedded in a heterogeneous natural subsurface setting. The man-made features such as shafts, tunnels, and barriers often cause multiple challenges in modeling the domain for multiphase porous media flow. This flow scenario can have a wide range of applications such as nuclear waste repositories, enhanced recovery of a petroleum reservoir, geothermal engineering, and carbon sequestration. An example of these severe numerical challenges is the case of performance assessment (PA) for Waste Isolation Pilot Plant (WIPP), the only operating deep geological repository in the US, which simulates extreme material properties of bedded salt rock formation and extreme contrast due to open excavation next to the formation. The models have extremes not only of permeability and porosity but also of the constitutive models needed for multiphase flow; additionally, they have process models like salt creep closure reducing porosity over time, fracturing in clay and anhydrite interbeds of the bedded salt, gas generation from the waste materials, and unintentional human borehole intrusions in some scenarios. Numerical simulations require the solution of coupled systems of nonlinear PDEs; in our work, we use the open-source simulator PFLOTRAN which is based on Finite Volume discretization. The solution of the nonlinear equations requires use of the Newton-Raphson iteration at each time step, which entails the solution of the linearized Jacobian system at each iteration. The effects of all the processes (i.e., large number of unknowns, highly nonlinear constitutive relations, large contrasts in material properties in short distances) lead to an ill-conditioned Jacobian matrix that severely challenges traditional linear solver, i.e., stabilized biconjugate gradient with block Jacobi incomplete LU preconditioner (BCGS-ILU) leading to non-convergence for traditional Newton-Raphson nonlinear solver causing unacceptably long computation time for each model. This paper presents linear solvers such as constrained pressure residual (CPR) two-stage preconditioner with alternate-block-factorization (ABF) and quasi- implicit pressure and explicit saturation (QIMPES) decouplers and flexible generalized residual solver (FGMRES). The new general-purpose nonlinear solver, Newton trust-region dogleg Cauchy (NTRDC), is also introduced to resolve extreme nonlinearities in the models. We demonstrate the effectiveness of each method relative to the default BCGS-Newton solver. The two best cases had nearly 50 times speed-up and achieved completion of a simulation in 14 hours that never completed due to non-convergence with the default solver. We also investigate the strong scalability of each method and discuss some of the deficiencies found for Block Jacobi preconditioner using parallel domain decomposition, and node packing effects of modern processor architecture.

Preconditioner, Nonlinear, Porous media, Multiphas↗

Low-dissipation centred schemes for hyperbolic equations in conservative and non-conservative form

We propose a one-parameter family of low-dissipation centred numerical schemes for solving hyperbolic equations in conservative or non-conservative form, using finite volume or discontinuous Galerkin finite element methods. The new schemes spring out from the multi-dimensional FORCE method and are determined by a single parameter α ≥ 1. Given an increasing sequence of real numbers 1 ≤ α 1 < α 2 < . . . < α K , there corresponds a sequence of numerical schemes with stability restriction associated to a decreasing sequence of Courant numbers 1 > c 1 > c 2 > . . . > c K > 0 and a decreasing sequence of corresponding numerical viscosity functions d 1 > d 2 > . . . > d K . For a given Courant number c k ≤ 1 there is a real number α k > 0 and a corresponding stable scheme with minimal numerical viscosity d k . The proposed schemes suit very well the family of high-order discontinuous Galerkin finite element methods and the recently proposed class of ADER-TR schemes, whose orders of accuracy define decreasing sequences of Courant numbers, as the order of accuracy increases. The centred methods of this paper are stable in 2D and 3D in the frame of simultaneous updating formulae, unlike other centred methods, such as 1D FORCE, which are not. Furthermore, the schemes are highly accurate for slowly-moving waves, which is precisely the kind of waves that traditional centred methods smear disastrously. Additional features of the proposed schemes include ease of implementation and applicability to any hyperbolic system either in conservative or non-conservative form. Here, the proposed schemes are analysed and computationally assessed through a suite of test problems for a linear model system, for the Euler equations in one and two space dimensions, and for the Baer-Nunziato equations for compressible two-phase flow.

97 MATHEMATICS AND COMPUTING↗

Sequential formulation of all‐way coupled finite strain thermoporomechanics for largely deformable gas hydrate deposits

We develop a numerically stable sequential formulation of thermoporomechanics for largely deformable gas hydrate deposits, extended from the fixed stress split of infinitesimal transformation. Constitutive equations are based on the total Lagrangian approach for both flow and geomechanics, including dynamic full tensor permeability and thermal conductivity updated from the deformation gradient. For space discretization, we take the cell-centered finite volume and node-based finite element method for flow and geomechanics, respectively. Then, we propose a sequential implicit method for all-way coupled thermoporomechanics, where the nonisothermal multiphase flow problem of gas hydrates is solved implicitly first and then the geomechanics problem is solved implicitly at the next step. During solution of the flow problem, we fix the rate of first Pioal total stress for numerical stability as well as apply porosity correction and entropy correction to account for geomechanical effects. We test numerical examples where flow and geomechanics parameters are based on deep oceanic gas hydrate deposits. When applying depressurization, even though the results between the infinitesimal transformation and finite strain geomechanics are similar in the early stages due to small deformation, we find differences between them in the late times as deformation becomes large. Accordingly, permeability and thermal conductivity tensors become nonisotropic full tensors although they are initially isotropic. Furthermore, we identify numerical stability of the developed sequential method from the test cases that exhibit the highly complex coupled gas hydrate systems with large deformation. Thus, the proposed sequential formulation can be applied in largely deformable gas hydrate systems.

42 ENGINEERING↗

Lattice calculation of light meson radiative leptonic decays

In this work, we perform a lattice QCD calculation of the branching ratios and the form factors\r\nof radiative leptonic decays P →ℓνℓγ (P= π,K) using Nf = 2+1 domain wall fermion ensembles\r\ngenerated by the RBC and UKQCD collaborations at the physical pion mass. We adopt the\r\ninfinite-volume reconstruction (IVR) method, which extends lattice data to infinite volume and\r\neffectively controls the finite-volume effects. This study represents a first step toward a complete\r\ncalculation of radiative corrections to leptonic decays using the IVR method, including both real\r\nphoton emissions and virtual photon loops. For decays involving a final-state electron, collinear\r\nradiative corrections, enhanced by the large logarithmic factors such as ln(m2\r\nπ/m2e) and ln(m2K/m2e), can reach the level of O(10%) and are essential at the current level of theoretical and experimental precision. After including these corrections, our result for π →eνeγ agrees with the PIBETA measurement; for K →eνeγ, our results are consistent with the KLOE data and exhibit a 1.7σtension with E36; and for K →µνµγ, where radiative corrections are negligible, our results confirm the previously observed discrepancies between lattice results and the ISTRA/OKA measurements at large photon energies, and with the E787 results at large muon–photon angles.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NEAMS Technical Area Support in MOOSE

The Multiphysics Object-Oriented Simulation Environment (MOOSE) framework is a foundational capability used by the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program to create over 15 different simulation tools for advanced nuclear reactors. Due to this ubiquity, improvements to the framework in support of modeling and simulation goals are critical to the program. These improvements can take many forms, including optimization, improved user experience, streamlined application programming interfaces (APIs), parallelism, and new capabilities. The work transcribed in this report was conducted in direct support of the simulation tools and has already been deployed. The capabilities outlined in this report include a factor of 10^4 improvement in dependency resolution speed, sorting of user objects, ability to compute residuals and Jacobians together, transfer fixes, support for the mortar method in finite volume discretizations, addition of generalized advection schemes for fluid simulations, 10^2 speedup in some Griffin simulations due to a new matrix-only solve type, and much more.

97 MATHEMATICS AND COMPUTING↗

MOOSE Navier–Stokes module

The MOOSE Navier–Stokes module solves mass, momentum, energy, and passive scalar conservation equations in the context of fluid flow. The module supports solution of these equations in both free flow and porous medium contexts and for a range of fluid compressibility. The conservation equations can be discretized in space using continuous Galerkin finite elements or with cell centered finite volumes.

97 MATHEMATICS AND COMPUTING↗

Multilevel Spectral Coarsening for Graph Laplacian Problems with Application to Reservoir Simulation

We extend previously developed two-level coarsening procedures for graph Laplacian problems written in a mixed saddle point form to the fully recursive multilevel case. The resulting hierarchy of discretizations gives rise to a hierarchy of upscaled models, in the sense that they provide approximation in the natural norms (in the mixed setting). This property enables us to utilize them in three applications: (i) as an accurate reduced model, (ii) as a tool in multilevel Monte Carlo simulations (in application to finite volume discretizations), and (iii) for providing a sequence of nonlinear operators in a full approximation scheme for solving nonlinear pressure equations discretized by the conservative two-point flux approximation. Finally, we illustrate the potential of the proposed multilevel technique in all three applications on a number of popular benchmark problems used in reservoir simulation.

multilevel Monte Carlo↗

Applying Time-Parallelization to Turbulent Flows

Parallelization of the temporal domain is explored for the solution of turbulent flows. Multigrid reduction-in-time (MGRIT) is used to advance the large-scale fluid dynamics in time sequentially on the coarsest space-time grid but propagate the information in time parallel on all other levels. The goal of this process is to accurately and efficiently resolve the coarse-scale turbulence structure and use that to drive the fine-scales of the turbulent flow. The extra forcing from nonlinear multigrid facilitates the coupling and interaction between fine and coarse scales, through which the multiscale nonlinear physics is properly captured. Adaptive mesh refinement is employed to finely resolve only the regions with strong gradients, which provides further computational efficiency. The underlying computational fluid dynamics solver is a fourth-order finite-volume scheme with the standard 4-stage Runge-Kutta method. An advanced approach is devised and implemented to enable MGRIT to solve highly turbulent flows successfully. Furthermore, the method is applied to solve a Taylor-Green vortex problem and a doubleshear-layer turbulent mixing flow. Results are promising, validating that MGRIT with the filtering approach has the potential to efficiently solve general turbulent flows.

Computational Fluid Dynamics↗

Numerical schemes for 3-wave kinetic equations: A complete treatment of the collision operator

In our previous work Walton and Tran (2023), numerical schemes for a simplified version of 3-wave kinetic equations, in which only the simple forward-cascade terms of the collision operators are kept, have been successfully designed, especially to capture the long time dynamics of the equation given the multiple blow-up time phenomenon. In this second work in the series, we propose numerical treatments for the complete 3-wave kinetic equations, in which the complete, much more complicated collision operators are fully considered based on a novel conservative form of the equation. Here we then derive an implicit finite volume scheme to solve the equation. The new discretization uses an adaptive time-stepping method which allows for the simulations to be carried to very long times. Our computed solutions are compared with previously derived long-time asymptotic estimates for the decay rate of total energy of time-dependent solutions of 3-wave kinetic equations and found to be in excellent agreement.

97 MATHEMATICS AND COMPUTING↗

A modern concept of Lagrangian hydrodynamics

Here, we offer a modern interpretation of Lagrangian hydrodynamics as employed in Lagrangian simulations of compressible fluid flow. Our main result is to show that artificial viscosity, traditionally viewed as a numerical artifice to control unphysical oscillations in flows with shocks, actually represents a physical process and is necessary to derive accurate simulations in any compressible flow. We begin by reviewing the origins of two numerical devices, artificial viscosity and finite-volume methods. We proceed to construct a mathematical (PDE) model that incorporates those numerics and in which a new length scale, the observer, arises representing the discretization. Associated with that length scale, there are new inviscid fluxes that are the artificial viscosity as first formulated by Richtmyer and an artificial heat flux postulated by Noh but typically not included in Lagrangian codes. We discuss the connection of our results to bivelocity hydrodynamics. We conclude with some speculation as to the direction of future developments in multidimensional Lagrangian codes as computers get faster and have larger memories.

97 MATHEMATICS AND COMPUTING↗

Progress with the 5D full-F continuum gyrokinetic code COGENT

COGENT is an Eulerian gyrokinetic code being developed for edge plasma modelling. The code is distinguished by the use of a high-order finite-volume (conservative) discretization combined with mapped multi-block grid technology. Our recent work is focused on the development of a 5D full-F COGENT version.Anumerical algorithm utilizing locally a field-aligned multi-block coordinate system is implemented to facilitate simulations of highly anisotropic microturbulence in the presence of a strong magnetic shear. In this approach, the toroidal direction is divided into blocks such that,within each block, the cells are field-aligned and a non-matching (non-conformal) grid interface is allowed at the block boundaries. In this paper we report on details of the numerical implementation and present preliminary results of verification studies performed for the case of the ion temperature gradient (ITG) instability in a sheared toroidal annulus geometry.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Adaptive Uncertainty Quantification for Stochastic Hyperbolic Conservation Laws

Here, we propose a predictor-corrector adaptive method for the study of hyperbolic partial differential equations (PDEs) under uncertainty. Constructed around the framework of stochastic finite volume (SFV) methods, our approach circumvents sampling schemes or simulation ensembles while also preserving fundamental properties, in particular hyperbolicity of the resulting systems and conservation of the discrete solutions. Furthermore, we augment the existing SFV theory with a priori convergence results for statistical quantities, in particular push-forward densities, which we demonstrate through numerical experiments. By linking refinement indicators to regions of the physical and stochastic spaces, we drive anisotropic refinements of the discretizations, introducing new degrees of freedom where deemed profitable. To illustrate our proposed method, we consider a series of numerical examples for nonlinear hyperbolic PDEs based on Burgers’ and Euler’s equations.

97 MATHEMATICS AND COMPUTING↗

Massively parallel axisymmetric fluid model for streamer discharges

A highly parallelizable fluid plasma simulation tool based upon the first-order drift-diffusion equations is discussed. Atmospheric pressure plasmas have densities and gradients that require small element sizes in order to accurately simulate the plasm resulting in computational meshes on the order of millions to tens of millions of elements for realistic size plasma reactors. To enable simulations of this nature, parallel computing is required and must be optimized for the particular problem. Here, a finite-volume, electrostatic drift-diffusion implementation for low-temperature plasma is discussed. The implementation is built upon the Message Passing Interface (MPI) library in C++ using Object Oriented Programming. The underlying numerical method is outlined in detail and benchmarked against simple streamer formation from other streamer codes. Electron densities, electric field, and propagation speeds are compared with the reference case and show good agreement. Convergence studies are also performed showing a minimal space step of approximately 4 μm required to reduce relative error to below 1% during early streamer simulation times and even finer space steps are required for longer times. Additionally, strong and weak scaling of the implementation are studied and demonstrate the excellent performance behavior of the implementation up to 100 million elements on 1024 processors. Lastly, different advection schemes are compared for the simple streamer problem to analyze the influence of numerical diffusion on the resulting quantities of interest.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

First implementation of gyrokinetic exact linearized Landau collision operator and comparison with models

Gyrokinetic simulations are fundamental to understanding and predicting turbulent transport in magnetically confined fusion plasmas. Previous simulations have used model collision operators with approximate field-particle terms of unknown accuracy and/or have neglected collisional finite Larmor radius (FLR) effects. We have implemented the linearized Fokker–Planck collision operator with exact field-particle terms and full FLR effects in a gyrokinetic code (GENE). The new operator, referred to as “exact” in this paper, allows the accuracy of model collision operators to be assessed. The conservative Landau form is implemented because its symmetry underlies the conservation laws and the H-theorem, and enables numerical methods to preserve this conservation, independent of resolution. The implementation utilizes the finite-volume method recently employed to discretize the Sugama collision model in GENE, allowing direct comparison between the two operators. Results show that the Sugama model appears accurate for the growth rates of trapped electron modes (TEMs) driven only by density gradients, but appreciably underestimates the growth rates as the collisionality and electron temperature gradient increase. The TEM turbulent fluxes near the nonlinear threshold using the exact operator are similar to the Sugama model for the n e = d ln T e /d ln n e = 0 case, but substantially larger than the Sugama model for the n e = 1 case. The FLR effects reduce the growth rates increasingly with wavenumber deepening a “valley” at the intermediate binormal wavenumber as the unstable mode extends from the TEM regime to the electron temperature gradient instability regime. Application to the Hinton–Rosenbluth problem shows that zonal flows decay faster as the radial wavenumber increases and the exact operator yields weaker decay rates.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗