Engineering Papers⌕ Search

Engineering topics

Tomboulides, Ananias

Publications and source records attributed to Tomboulides, Ananias.

Towards exascale for wind energy simulations

We examine large-eddy-simulation modeling approaches and computational performance of two open-source computational fluid dynamics codes for the simulation of atmospheric boundary layer flows that are of direct relevance to wind energy production. The first code, NekRS, is a high-order, unstructured-grid, spectral element code. The second code, AMR-Wind, is a second-order, block-structured, finite-volume code with adaptive mesh refinement capabilities. The objective of this study is to co-develop these codes in order to improve model fidelity and performance for each. These features will be critical for running ABL-based applications such as wind farm analysis on advanced computing architectures. To this end, we investigate the performance of NekRS and AMR-Wind on the Oak Ridge Leadership Facility supercomputers Summit, using 4 to 800 nodes (24 to 4,800 NVIDIA V100 GPUs), and Crusher, the testbed for the Frontier exascale system, using 18 to 384 Graphics Compute Dies on AMD MI250X GPUs. We compare strong- and weak-scaling capabilities, linear solver performance, and time to solution. We also identify leading inhibitors to parallel scaling.

17 WIND ENERGY↗

CFD simulations of Molten Salt Fast Reactor core cavity flows

Computational Fluid Dynamics (CFD) has become increasingly important in the research and development of advanced nuclear reactors. Here, in the current study, extensive CFD simulations were conducted for the coolant flow in Molten Salt Fast Reactor (MSFR) core models using the state-of-the-art spectral element flow solver Nek5000 and multiscale coarse-mesh thermal-hydraulic software Pronghorn. The underlying motivation is to seek an in-depth understanding of how the internal velocity distribution can be influenced by the MSFR core cavity shape, the Reynolds number, turbulence modeling options and the inlet boundary conditions. The CFD techniques involved in this investigation range from coarse-mesh CFD, RANS modeling, to the high-fidelity LES calculations. Specifically, a series of RANS simulations were performed for the 2-D axisymmetric core model and 3-D wedge domains to study the flow distribution inside the MSFR core. It is observed that a proper representation of the MSFR inlet channel duct is important for the prediction of internal flow distribution. It is also showcased here how researchers can leverage the Nek5000 CFD results to calibrate more efficient coarse-mesh CFD tools, like Pronghorn, for the actual MSFR design needs. Moreover, this paper highlights a 3-D LES model for an entire MSFR core using the spectral element method and demonstrates the feasibility of this modeling approach. The readiness and potential limitations of the RANS approach are examined with respect to the high-fidelity LES simulations. The present investigation lays a solid foundation as we are leveraging the high-fidelity CFD capabilities to inform MSFR design efforts.

97 MATHEMATICS AND COMPUTING↗

Verification and Validation of Spectral Element Code for Supercritical CO2 Flow in Vertical Heated Tubes

The investigation of heat transfer in supercritical CO2 (sCO2) has garnered considerable attention in recent decades, given sCO2's potential as a promising working fluid for advanced power conversion cycles. Despite previous research efforts, there are still gaps in our understanding of sCO2 heat transfer, particularly in conditions associated with heat transfer deterioration. To delve into sCO2 heat transfer more comprehensively, we propose employing the high-fidelity computational fluid dynamics code NekRS to simulate sCO2 flow using the large eddy simulation technique. Through graphics processing unit acceleration, NekRS achieves a higher computational speed than traditional CPU-based systems. However, before using NekRS in practical applications involving sCO2, it is imperative to perform verification and validation. Here, this paper presents our efforts to verify and validate the NekRS code's capability for simulating sCO2 using heated vertical tubes, where heat transfer deterioration usually happens. To accommodate the unique properties of sCO2, we have modified the NekRS code by integrating third-party property modules, such as REFPROP and PROPATH. Our simulations are compared with experimental and numerical data from the literature, instilling confidence in leveraging NekRS for future engineering applications. Our simulations also reveal that the accuracy of the property module significantly impacts the results, with REFPROP outperforming PROPATH for sCO2 properties. Additionally, we observed that, depending on the flow direction, buoyancy can either enhance or suppress turbulence in sCO2 flow. In upward flow, under certain conditions, the suppressed turbulence leads to heat transfer deterioration, resulting in elevated wall temperatures.

NekRS↗

Energy Exascale Computational Fluid Dynamics Simulations With the Spectral Element Method

Development and application of the open-source GPU-based fluid-thermal simulation code, NekRS, are described. Time advancement is based on an efficient kth-order accurate timesplit formulation coupled with scalable iterative solvers. Spatial discretization is based on the high-order spectral element method (SEM), which affords the use of fast, low-memory, matrix-free operator evaluation. Further, recent developments include support for nonconforming meshes using overset grids and for GPU-based Lagrangian particle tracking. Results of large-eddy simulations of atmospheric boundary layers for wind-energy applications as well as extensive nuclear energy applications are presented.

42 ENGINEERING↗

Turbulence Modeling with Nek5000/RS, SOD2D and Alya

We present Validation and Verification (V & V) study of two high-order spectral element method (SEM) based Computational Fluid Dyanimcs (CFD) codes that we will utilize for work on turbulence modeling: Nek5000 and SOD2D. While the former solves the incompressible form of Navier-Stokes equation, the latter works with compressible set of equations and uses an entropy-viscosity formulation to account for the discontinuities for high Mach number flows. We demonstrate the accuracy of these codes for two benchmark sub-sonic turbulent flows: periodic channel and pipe flow, by carrying out first and second order statistical analysis, grid convergence and turbulent structure analysis using wall-resolved large eddy simulations (WRLES). Later, we report on the implementation and testing of various wall-modeling strategies for large eddy simulation of turbulent flows in Nek5000. These include both classical log-law based and decision-tree based machine-learning models. Accuracy of these closure strategies are analyzed and necessary future work is outlined.

97 MATHEMATICS AND COMPUTING↗

Stakeholder-Driven Improvements to Nek5000 and NekRS

As a key part of the U.S. Department of Energy’s Nuclear Energy Advanced Modeling and Simulation program (NEAMS), the next generation of tools for nuclear reactor design are being developed. A primary metric for success of this program is the adoption of those tools by industry stakeholders. Based on feedback provided directly to NEAMS, two of the major weaknesses have been a lack of moderate-fidelity Reynolds-averaged Navier-Stokes (RANS) turbulence models and available documentation. Over the past several years, developments have been focused on addressing the needs of those stakeholders. The outcome of those efforts are described herein.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Demonstration of RANS models with wall functions in the spectral element code Nek5000

The spectral element based computational fluid dynamics (CFD) code Nek5000 has been traditionally used for high-fidelity applications, such as direct numerical simulation (DNS) and large eddy simulation (LES). These techniques require very fine numerical resolution to accurately capture turbulent fluctuations which can be prohibitively expensive for users without access to leadership class computing facilities. For broader application and adoption, significant effort has been invested to develop Reynolds-averaged Navier–Stokes (RANS) capabilities in Nek5000. Here, this work presents details of the implementation and demonstration of the standard wall functions for the κ–τ model in Nek5000. Results using the wall-modeled approach are compared to a wall-resolved approach for cases with negligible pressure gradient, viz., channel flow, pipe flow and flow in a reactor subchannel. Results show reasonably good agreement between the two approaches for friction factor and Nusselt number. Some expected differences are identified near the wall. These cases demonstrate the potential for significant computational savings by using much coarser meshes for the wall-modeled approach, with only minor differences between the predicted result. Additionally, several Reynolds numbers up to 1,000,000 are demonstrated for pipe flow and predicted friction factors and Nusselt numbers compared well to available correlations, with the worst below 10%. As the Reynolds number is increased, better agreement is observed between the correlations and the wall-modeled approach. In addition, flow in a molten salt fast reactor (MSFR) core is considered which features an adverse pressure gradient and flow separation. It showcases the inability of standard wall functions to accurately predict flows with adverse pressure gradients. The results, however, match reasonably well in trend in regions of the flow where the boundary layer is attached. Ongoing research is dedicated to include a pressure gradient correction to wall functions to improve the accuracy of flows with separation or reattachment and adverse or favorable pressure gradients.

42 ENGINEERING↗