Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “NekRS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Nek5000/RS Performance on Advanced GPU Architectures

We demonstrate NekRS performance results on various advanced GPU architectures. NekRS is a GPU-accelerated version of Nek5000 that is targeting high performance on forthcoming exascale platforms. It is being developed in DOE’s Center of Efficient Exascale Discretizations (CEED), which is one of the co-design centers under the Exascale Computing Project (ECP). In this report, we consider Frontier, Crusher, Spock, Polaris, Perlmutter, ThetaGPU and Summit. Simulations are performed using ExaSMR’s 17x17 rod-bundle geometries with different problem sizes. The report focuses on strong scaling performance and analysis. Many of the results shown in this report are the outcome from participation in the ALCF GPU Hackathon on Polaris, which was held on 7/19/22, and 7/26–7/28/22. Members of the Nek5000/RS team included Misun Min, Yu-Hsiang Lan, Paul Fischer and Thilina Rathnayake. Mentors were Kris Rowe (ALCF) and Peng Wang (NVIDIA). Also presented in this report are results on Frontier, which were obtained in collaboration with John Holmen at OLCF.

97 MATHEMATICS AND COMPUTING↗

Exascale Multiphysics Nuclear Reactor Simulations for Advanced Designs

ENRICO is a coupled application developed under the U.S. Department of Energy's Exascale Computing Project (ECP) targeting the modeling of advanced nuclear reactors. It couples radiation transport with heat and fluid simulation, including the high-fidelity, highresolution Monte-Carlo code Shift and the Computational fluid dynamics code NekRS. NekRS is a highly-performant open-source code for simulation of incompressible and low-Mach fluid flow, heat transfer, and combustion with a particular focus on turbulent flows in complex domains. It is based on rapidly convergent high-order spectral element discretizations that feature minimal numerical dissipation and dispersion. State-of-the-art multilevel preconditioners, efficient high-order time-splitting methods, and runtime-adaptive communication strategies are built on a fast OCCA-based kernel library, libParanumal, to provide scalability and portability across the spectrum of current and future high-performance computing platforms. On Frontier, Nek5000/RS has recently achieved an unprecedented milestone in breaching over 1 billion spectral elements and 350 billion degrees of freedom. Shift has demonstrated the capability to transport upwards of 1 billion particles per second in full core nuclear reactor simulations featuring complete temperature-dependent, continuous-energy physics on Frontier. Shift achieved a weak-scaling efficiency of 97.8% on 8192 nodes of Frontier and calculated 6 reactions in 214,896 fuel pin regions below 1% statistical error yielding first-of-a-kind resolution for a Monte Carlo transport application.

Hamilton, Steven P.↗

A Hybrid Domain Overlapping Method for Coupling System Thermal Hydraulics and CFD Codes

A hybrid multiscale coupling methodology based on a domain overlapping approach has been developed for coupling System Thermal Hydraulics (STH) and Computational Fluid Dynamics (CFD) codes. The method has been implemented between the modern STH code SAM and the CFD code NekRS, using the coupling tool Cardinal. The coupling aims to extend the STH code's applicability to scenarios where local momentum and energy transfers are important yet difficult for STH codes to capture, such as three-dimensional mixing. Two coupling strategies are implemented and compared: a hybrid domain overlapping method and the conventional domain decomposition method. Here, the strategies are applied to two closed-loop applications, and the present method shows superior stability behavior when compared to the domain decomposition method. Then, the present coupling method is validated against experimental data from a double T-junction experiment. The present STH/CFD coupling shows improved agreement with experimental data when compared to STH standalone simulations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

High fidelity multiphysics tightly coupled model for a lead cooled fast reactor concept and application to statistical calculation of hot channel factors

A tightly coupled multiphysics code system is established using the MOOSE framework for hot channel factor (HCF) evaluation on a Lead Fast Reactor (LFR) concept. The coupled system is driven by the Griffin multiphysics coupling capability under which the MOOSE Heat Transfer module and NekRS computational fluid dynamics solver are coupled for conjugate heat transfer using the Cardinal application. The coupled capability is demonstrated on an LFR assembly model based on materials and geometry of a prototypical lead-cooled fast reactor design by Westinghouse Electric Company, LLC. Moreover, the work integrates the Multiphysics Object Oriented Simulation Environment (MOOSE) Stochastic Tools Module (STM) to perform calculations for statistical analysis of HCF. Furthermore, the coupling strategy and workflow demonstrated in this paper is not only useful for predicting accurate hot channel factors for different kinds of advanced reactors but also for other engineering applications such as control rod worth assessment, generation of high-fidelity database for Artificial intelligence (AI)/machine learning (ML) training, design optimization and multi-resolution modeling.

Cardinal↗

High-Fidelity CFD Simulation of Mixed Convection and Forced Convection in a Pebble Bed Test Reactor Core

The Hermes low-power [35-MW(thermal)] reactor will be built and operated by Kairos Power LLC (KP) to demonstrate its fluoride salt-cooled high-temperature reactor (FHR) technology. In the KP FHR, the reactor core is composed of randomly packed pebbles with TRISO fuel particles inside with FLiBe flow upward through the core acting as a coolant. Previous numerical and experimental studies have been limited to either a small-size bed or to a lack of detailed measurements for heat transfer. Here, to address the lack of high-fidelity heat transfer data in a real-size FHR core, in this study, we simulated a pebble bed core with 34 374 pebbles randomly packed, similar to the Hermes reactor's size. The core radius was 14 times that of the pebble diameter, while the core height was 45 times. In this work, we were particularly interested in a mixed convection regime, where buoyancy is important. Therefore, we performed several large-eddy simulations at different Reynolds numbers (160 to 1000) with gravitational force included. The spectral element computational fluid dynamics code NekRS with graphics processing unit acceleration was used for this study. The low-Mach number approximation was applied to address property changes in the FLiBe and to account for buoyancy. A pure hexahedral mesh with 60 million elements was generated by the Voronoi cell method. At the polynomial order of 5, the total degrees of freedom was 7.5 billion. The developed case in this work is the first of its kind in terms of size and complexity. The local numerical data across the domain were obtained and compared with empirical correlations. After examining the data, we found the following conclusions. For pressure drop, the Reger correlation predicted less than a 5% error. On the other hand, for heat transfer, the Wakao correlation outperformed the others. Based on our findings, we recommend the use of the Wakao correlation for the Nusselt number calculation, and for pressure drop, the KTA (Kerntechnischer Ausschuss) correclation, among the available experimental correlations. In conclusion, the Reger direct numerical simulation-driven correlation for pressure drops should also be considered, given its best agreement with our calculations.

Mixed Convection↗

High Fidelity Simulations of Air-Cooled Reactor Cavity Cooling System

Nuclear energy is increasingly acknowledged as pivotal in the global shift towards cleaner energy solutions. Advanced nuclear technologies, including High Temperature Gas-cooled Reactors (HTGRs), stand out as appealing options among Generation IV reactors due to their high temperature heat output and potential for cogeneration. HTGR designs incorporate passive safety systems, such as the Reactor Cavity Cooling System (RCCS), which utilize natural principles to manage heat dissipation from the reactor pressure vessel (RPV) during accidents or routine shutdowns. Regulatory bodies require thorough validation of safety systems like the RCCS to ensure they meet specified standards. Consequently, there is a pressing need within the industry for advanced simulation tools capable of assessing these systems’ performance accurately. There is a knowladge gap in the literature concerning high-fidelity data for the RCCS, which motivates the focus of this study. This research focuses on a specific RCCS designed for the Modular High-Temperature Gas Reactor developed by General Atomics (GA- MHTGR). Experimental studies on a scaled version of the air-cooled RCCS of GA-MHTGR were conducted by the University of Wisconsin-Madison. This work contributes to a broader initiative aimed at establishing a numerical benchmark based on the UW-Madison experiments. As first step we performed high fidelity simulations of the experimental facility setup, to analyze flow physics in such systems and validate NekRS and the MOOSE heat transfer and radiation modules.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Data-Driven RANS Turbulence Closures for Forced Convection Flow in Reactor Downcomer Geometry

Recent progress in data-driven turbulence modeling has shown its potential to enhance or replace traditional equation-based Reynolds-averaged Navier-Stokes (RANS) turbulence models. Here, this work utilizes invariant neural network (NN) architectures to model Reynolds stresses and turbulent heat fluxes in forced convection flows (when the models can be decoupled). As the considered flow is statistically one dimensional, the invariant NN architecture for the Reynolds stress model reduces to the linear eddy viscosity model. To develop the data-driven models, direct numerical and RANS simulations in vertical planar channel geometry mimicking a part of the reactor downcomer are performed. Different conditions and fluids relevant to advanced reactors (sodium, lead, unitary-Prandtl-number fluid, and molten salt) constitute the training database. The models enabled accurate predictions of velocity and temperature, and compared to the baseline k–τ turbulence model with the simple gradient diffusion hypothesis, do not require tuning of the turbulent Prandtl number. The data-driven framework is implemented in the open-source graphics processing unit–accelerated spectral element solver nekRS and has shown the potential for future developments and consideration of more complex mixed convection flows.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

High-Fidelity Simulation of the Light-to-Dense Stratification Transient in the HiRJET Facility

Density stratification in a large enclosure is a crucial phenomenon to heat transfer and sustainable passive heat removal of a sodium fast reactor during reactivity transients. However, engineering turbulence models were identified to have unsatisfactory performance in predicting propagation of a stratified front. Yet, the scarcity of high-resolution data for stratification hampers the development of models. To explor e applications of leveraging direct numerical simulation (DNS) data to support turbulence model development, this work conducted DNS using NekRS to study a long stratification transient in the High-Resolution Jet (HiRJET) experimental facility. Here, this work considers an experiment run where light fluid is injected into a tank containing a denser fluid with a relative density difference of 1.5%. Formation of the stratified layer is identified as impingement of the buoyant jet promoting mixing of the two fluids. Based on the transient statistics, transport of the concentration can be characterized by regions with dominating effects of turbulent mixing, buoyant dissipation, and molecular diffusion, respectively, as moving away from the elevation of jet impingement. Concentration near the stratified front also exhibits oscillation at Brunt-Väisälä frequency. Preliminary validation of the simulation showed encouraging agreement of the concentration distribution with the reference experiment.

buoyant mixing↗

Large Eddy Simulation of Convective Heat Transfer in a Random Pebble Bed Using the Spectral Element Method

The development of fluoride-cooled high-temperature reactors has drastically increased the demand for an in-depth understanding of the heat transfer (HT) in packed beds cooled by liquid salts. The complex flow fields and space-dependent porosity found in a pebble bed require a detailed understanding to ensure the proper cooling of the reactor core during normal and accident conditions. As detailed experimental data are complicated to obtain for these configurations, high-fidelity simulation such as large eddy simulation and direct numerical simulation (DNS) can be employed to create a high-resolution heat transfer numerical database that can assist in addressing industrial-driven issues associated with the heat transfer behavior of fluoride-cooled high-temperature reactors. In this paper, we performed a series of large eddy simulation using computational fluid dynamics (CFD) code NekRS to investigate the heat transfer for a bed of 1741 pebbles. Further, the characteristics of the flow, such as average, rms, and time series of velocity and temperature, have been analyzed. Porous media averages have also been performed. The simulation results show a good agreement between non-conjugate heat transfer and conjugate heat transfer. The generated data will be used to benchmark heat transfer modeling methods and local maxima/minima of heat transfer parameters. It will also be used for supporting convective heat transfer quantification for Kairos Power and benchmarking lower fidelity models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Energy Exascale Computational Fluid Dynamics Simulations With the Spectral Element Method

Development and application of the open-source GPU-based fluid-thermal simulation code, NekRS, are described. Time advancement is based on an efficient kth-order accurate timesplit formulation coupled with scalable iterative solvers. Spatial discretization is based on the high-order spectral element method (SEM), which affords the use of fast, low-memory, matrix-free operator evaluation. Further, recent developments include support for nonconforming meshes using overset grids and for GPU-based Lagrangian particle tracking. Results of large-eddy simulations of atmospheric boundary layers for wind-energy applications as well as extensive nuclear energy applications are presented.

42 ENGINEERING↗

HipBone: A performance-portable graphics processing unit-accelerated C++ version of the NekBone benchmark

We present hipBone, an open-source performance-portable proxy application for the Nek5000 (and NekRS) computational fluid dynamics applications. HipBone is a fully GPU-accelerated C++ implementation of the original NekBone CPU proxy application with several novel algorithmic and implementation improvements which optimize its performance on modern fine-grain parallel GPU accelerators. Our optimizations include a conversion to store the degrees of freedom of the problem in assembled form in order to reduce the amount of data moved during the main iteration and a portable implementation of the main Poisson operator kernel. We demonstrate near-roofline performance of the operator kernel on three different modern GPU accelerators from two different vendors. We present a novel algorithm for splitting the application of the Poisson operator on GPUs which aggressively hides MPI communication required for both halo exchange and assembly. Our implementation of nearest-neighbor MPI communication then leverages several different routing algorithms and GPU-Direct RDMA capabilities, when available, which improves scalability of the benchmark. We demonstrate the performance of hipBone on three different clusters housed at Oak Ridge National Laboratory, namely, the Summit supercomputer and the Frontier early-access clusters, Spock and Crusher. Our tests demonstrate both portability across different clusters and very good scaling efficiency, especially on large problems.

Computer Science↗

Coupled Monte Carlo and thermal-hydraulics modeling of a prismatic gas reactor fuel assembly using Cardinal

Cardinal is a MOOSE application that couples OpenMC Monte Carlo transport and NekRS computational fluid dynamics to the MOOSE framework, closing the neutronics and thermal-fluid gaps in conducting tightly-coupled, high-resolution multiscale and multiphysics analyses. By leveraging MOOSE's interfaces for wrapping external codes, Cardinal overcomes many challenges encountered in earlier multiphysics coupling works, such as file-based I/O or overly-restrictive geometry mapping requirements. In this work, we leverage a subset of the multiphysics interfaces in Cardinal to perform coupling of OpenMC neutron transport, MOOSE heat conduction, and THM thermal-fluids for steady-state modeling of a prismatic gas reactor fuel assembly.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Challenge Problem 1: Preliminary Model Development and Assessment of Flexible Heat Transfer Modeling Approaches

This report presents the modeling progress of a university consortium studying flexible modeling for turbulent heat transfer. In the context of advanced nuclear reactor design, where challenges include non-unity Prandtl fluids, free and mixed convection, and transitional flow, computational fluid dynamics methods are underutilized due to low confidence in modeling approaches and high computational cost. This report evaluates the performance of engineering CFD models in diabatic, buoyant turbulent flow. It finds that all turbulence models including several variants of the k-ε and k-ω models struggle to predict accurate turbulent momentum and heat transfer in such flows. The Nusselt numbers have been compared between the models and the DNS data, where calculations have been performed for each case and trends have shown a good agreement between DNS estimated Nusselt numbers and available correlations as well as experimental data. A novel DNS correlation for high Pr cases as they are transitioning from mixed convection to natural convection has been proposed. While Nusselt number errors relative to DNS range from 20% to 50%, the models capture similar trends to DNS with respect to Nusselt suppression and amplification under varying levels of buoyancy effect. This report also highlights model form error as a significant contributor to CFD predictions and proposes a framework for quantifying model error and improving confidence in CFD calculations. To improve the predictive capability of engineering CFD models, data-driven approaches for turbulence models are investigated. Theoretical frameworks based on the invariant tensor / vector basis neural networks for prediction of Reynolds stresses and turbulent heat fluxes are employed. The models are developed using direct numerical simulations data for forced convection flows of different fluids in vertical planar channel domain. The framework is implemented in spectral element solvers Nek5000 / nekRS and has shown a potential for future development and consideration of mixed convection flows.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

MOSCATO Development and Integration in Fiscal Year 2022

During FY21, we conducted ongoing development work for the MOSCATO (Molten Salt Chemistry and Transport) solver. The code development work primarily consisted of transitioning capabilities from the original version of the solver, which was written in OpenFOAM, into Nek5000. In doing so, a fast, highly parallelizable solver was created that is capable of complex chemistry and corrosion simulations for engineering-scale molten salt systems. The Nek5000 version of MOSCATO is now fully featured and capable of higher-fidelity simulations than were previously possible. Demonstration cases including a thermal convection loop have been simulated to test these new capabilities. We built upon the work for FY22 and improved the code from several different perspectives. First, we improved the user interface by adding a new component to the official Nek5000 input file (.par). This new part contains documents parameters like, salt properties (density, viscosity, Cp, thermal conductivity), diffusion coefficients, standard potential, etc. Second, we built a conversion script to extract salt properties from the MSTDB-TP salt database and write to MOSCATO input file. Third, we migrated the code to NekRS, which is the GPU branch of Nek5000 and suitable for next generation supercomputers. Verification and Validation (V&V) work was also continued in FY22. Two tasks were performed. The first V&V task involved the validation of the Poisson-Nernst-Planck equation solver and Butler-Volmer electrode kinetics, by comparing with numerical and experimental data about thermoelectric cells. The second task involved the comparisons to corrosion results from a thermal convection loop run during the MSRE era. Satisfactory agreement was obtained from both tasks.

Yuan, Haomin↗

Multiphysics Simulations of MSRE with NEAMS Thermal Hydraulics Tools

This report documents the benchmarks being developed and simulations performed using tools and codes developed under the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, utilizing MSRE experimental data. In FY23, three main work scopes were investigated under the NEAMS MSR work package at ANL. The first scope investigated the Griffin-SAM coupling model for simulating the pump startup transient experiment of MSRE. The analyses start with a simple model (single-channel, single-lattice), gradually adding more details (multi-channel, full-core) into the model. The results show that the reactivity loss curve is very sensitive to the axial boundary conditions and the radial core discretization. The simple model can predict a similar reactivity trend as that of the more sophisticated model, which is likely due to error cancellation. Accurately modeling the axial boundary condition may further improve the reactivity trend but would require significant efforts to generate the mesh of the MSRE inlet and upper plenum. The core channel radial discretization for the Griffin-SAM coupled model also depends on the flow distribution. Given the complex geometry in the inlet plenum, the flow distribution needed to be calculated from CFD analysis, which was performed using the NekRS code. This analysis employed a MSRE CAD model developed by Copenhagen Atomics. The CAD model was disassembled to keep the inlet plenum region only, which was subsequently cleaned and modified so that the mesh generated is under the memory limit. The results are merged to a few radial regions to show that the flow rate is highest in the central region. This would be useful for future improvement of the Griffin-SAM coupling model of the MSRE core. The last task investigated is tritium transport modeling using the standalone SAM code. This task aimed to initiate the effort to demonstrate and validate the tritium transport model implemented in SAM. The preliminary investigation employed an MSRE model consisting of the primary loop. Three tritium transport pathways were examined including the retention in the graphite, the permeation through the HX tube wall, and the removal from the off-gas system. The results compare well with the MSRE data, but improvements are still needed on the initial conditions (i.e., the present state may not have reached equilibrium), the boundary conditions, the off-gas system modeling, and a better numerical strategy to reach the equilibrium state.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

High-Temperature Gas-Cooled Pebble-Bed Reactors Running In And Transient Modeling Capabilities Demonstration

This study presents a comprehensive benchmarking and verification effort of several thermal-hydraulic and multiphysics capabilities for high-temperature gas-cooled reactor (HTGR) applications. The first part of this effort focuses on the running-in verification of Griffin's multiphysics capabilities, specifically for simulating the evolution of Pebble Bed reactor cores from startup to equilibrium. In the absence of validation data, code-to-code comparisons are conducted with Kugelpy, showing good agreement for key quantities like maximum power density and fresh core k-eigenvalue predictions. However, discrepancies in equilibrium core predictions suggest potential issues with cross sections, underscoring the need for further refinement and evaluation. The HTTF system analysis code benchmark involves RELAP5-3D, SAM, and GAMMA+ to assess their predictive capabilities for HTTF behavior under both normal operation and pressurized conduction cooldown (PCC) transient conditions. While there is good agreement in predicting major parameters such as coolant temperature, solid temperature, and flow distribution, discrepancies in transient behavior highlight differences in modeling approaches, nodalizations, and heat transfer models. The HTTF lower plenum CFD benchmark employs nekRS to simulate flow mixing phenomena, successfully capturing relevant flow physics and demonstrating mesh independence in complex geometries. Preliminary results suggest a relatively uniform temperature field but significant unsteadiness in the flow, requiring time-averaging analyses. The GPBR200 system analysis code benchmark uses SAM's core channel and porous media models, incorporating an RCCS loop for decay heat removal. During steady-state and transient conditions, including protected de-pressurized and pressurized loss of forced cooling (DLOFC and PLOFC), both models show good agreement in predicting temperature profiles and key parameters. Notably, while the core channel model underpredicts convective heat transfer effects, both models maintain temperatures well below the TRISO fuel safety limit. These benchmarking efforts collectively enhance the predictive capabilities of the tools used in HTGR design and safety analysis, guiding developments to improve their accuracy and applicability.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

MOSCATO Development and Integration in Fiscal Year 2023

In FY23, significant developments were made to the MOSCATO code package, enhancing its capabilities in many aspects. The improvements and advancements can be summarized as follows: Code Restructuring: The MOSCATO code underwent a restructuring process, enabling both Nek5000 and NekRS to share the same interface when using MOSCATO. This integration facilitates smoother interactions between the different modules and streamlines the overall simulation process. Automatic Domain Extension: To allow simulations to propagate over longer time frames, an automatic domain extension capability was added to the metal diffusion module. This enhancement enables more accurate and reliable simulations of diffusion processes, especially in scenarios with extended time requirements. Expanded Corrosion Reactions: The updated MOSCATO package now includes additional reactions that contribute to corrosion. This addition enhances the code’s ability to model corrosion effects more comprehensively, providing a more realistic representation of the systems being studied. Example Case Setup: To assist users and showcase MOSCATO’s capabilities, we developed example cases for various applications. Notably, we created example cases for thermal cells and corrosion loops. These pre-configured cases allow users to get started quickly and effectively with their simulations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Spectrally Stabilized Interface Capturing Formulation and Implementation in Nek5000/NekRS

This report documents the formulation of a novel level-set method for incompressible two-phase flows in the continuous Galerkin (CG) high order spectral element framework. The overall method hinges on a novel implementation of the spectral vanishing viscosity (SVV) operator for the stabilization of linear/non-linear hyperbolic problems. The multidimensional SVV convolution kernels, which in essence, have a similar effect as a high pass filter applied to the derivatives, are formulated by exploiting the tensor product form, analogous to the construction of the usual stiffness matrix system. The resulting kernels are directionally decoupled and ensure a linear, symmetric positive definite, elliptic matrix operator. The SVV formulation is demonstrated to provide a robust stabilizing mechanism through challenging linear and non-linear hyperbolic problems, including problems pertinent to the level-set formulation. The two-phase framework conceptualized herein is based on the conservative level-set (CLS) method which represents the interface between the fluids by the 0.5 iso-contour of the smoothed Heaviside function. The CLS method is augmented with a preconditioning procedure for interface normals using the signed distance function which precludes the manifestation of spurious oscillations in the vicinty of the interface. Further, the existing mixed explicit-implicit approach for the solution of Navier-Stokes equations in Nek5000, as described in Tomboulides et al, is augmented with a pressure coefficient splitting approach for the Poisson equation, which greatly accelerated the convergence of pressure solver for two-phase systems with large density ratio. The robustness and accuracy of the overall two-phase method is demonstrated through canonical challenging problems involving high density and viscosity ratios, with and without surface tension. The two-phase formulation is wholly implemented in Nek5000 and the SVV stabilization method is implemented in NekRS, which is the essential precursor to the two-phase framework, undergoing active development.

97 MATHEMATICS AND COMPUTING↗