Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “NEK5000”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Enhancements to the SHARP Build System and NEK5000 Coupling

The SHARP project for the Department of Energy's Nuclear Energy Advanced Modeling and Simulation (NEAMS) program provides a multiphysics framework for coupled simulations of advanced nuclear reactor designs. It provides an overall coupling environment that utilizes custom interfaces to couple existing physics codes through a common spatial decomposition and unique solution transfer component. As of this writing, SHARP couples neutronics, thermal hydraulics, and structural mechanics using PROTEUS, Nek5000, and Diablo respectively. This report details two primary SHARP improvements regarding the Nek5000 and Diablo individual physics codes: (1) an improved Nek5000 coupling interface that lets SHARP achieve a vast increase in overall solution accuracy by manipulating the structure of the internal Nek5000 spatial mesh, and (2) the capability to seamlessly couple structural mechanics calculations into the framework through improvements to the SHARP build system. The Nek5000 coupling interface now uses a barycentric Lagrange interpolation method that takes the vertex-based power and density computed from the PROTEUS neutronics solver and maps it to the user-specified, general-order Nek5000 spectral element mesh. Before this work, SHARP handled this vertex-based solution transfer in an averaging-based manner. SHARP users can now achieve higher levels of accuracy by specifying any arbitrary Nek5000 spectral mesh order. This improvement takes the average percentage error between the PROTEUS power solution and the Nek5000 interpolated result down drastically from over 23 % to just above 2 %, and maintains the correct power profile. We have integrated Diablo into the SHARP build system to facilitate the future coupling of structural mechanics calculations into SHARP. Previously, simulations involving Diablo were done in an iterative manner, requiring a large amount manual work, and left only as a task for advanced users. This report will detail a new Diablo build system that was implemented using GNU Autotools, mirroring much of the current SHARP build system, and easing the use of structural mechanics calculations for end-users of the SHARP multiphysics framework. It lets users easily build and use Diablo as a stand-alone simulation, as well as fully couple with the other SHARP physics modules. The top-level SHARP build system was modified to allow Diablo to hook in directly. New dependency handlers were implemented to let SHARP users easily build the framework with these new simulation capabilities. The remainder of this report will describe this work in full, with a detailed discussion of the overall design philosophy of SHARP, the new solution interpolation method introduced, and the Diablo integration work. We will conclude with a discussion of possible future SHARP improvements that will serve to increase solution accuracy and framework capability.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Nek5000 developments in support of industry and the NRC

This year, the Nuclear Energy Advanced Modeling Simulation program (NEAMS) thermal-hydraulics verification and validation (V&V) work has focused in three areas of Nek5000 V&V-driven development. First, in a close collaborative effort with the U. S. Nuclear Regulatory Commission (NRC) staff, we have continued V&V efforts for the HYMERES-2 project using the OECD/NEA sponsored testing in the PSI PANDA facility. This year’s focus of ANL-NRC collaboration involves Nek5000 setups and validation for a range of problems relevant to and including the HYMERES-2 benchmark from PSI. The primary outcome of this year efforts is a more efficient geometry and inlet modeling simplification after a careful sensitivity study of the inlet profiles and pipe geometries. The resulting modeling choice of a short recycling/fully-developed turbulent inlet is within the experimental uncertainty estimate. This finding simplifies the next step of the cross-V&V HYMERES-2 project. In addition, the ANL team continue to provide assistance to the NRC staff in the form of Nek5000 application support in general and on the use of the HPC platforms of ALCF and INL in particular. This supports the NRC’s assessment of Nek5000 for use with the NRC Blue CRAB code suite. Second, we have implemented and tested more robust model of URANS, namely the k – τ model, a variant of the k-ω model, along with other improvements to RANS Nek5000 modeling in general. Because of its demonstrated robustness and stability, the k – τ model is the only RANS model that has been implemented in the new GPU version of the Nek5000 code, nekRS. Lastly, we report the initial implementation of Jacobian-free Newton Krylov approach to the direct Newton method for steady fluid solvers aimed at acceleration of RANS modeling and at IC improvement for LES campaigns. Also leveraging the Exascale Computing Project (ECP) ANL/CEED & SMR team’s software development effort to support NEAMS problems at large scale of the advanced computing architectures, NekRS, a GPU variant of Nek5000, built on top of kernels from libParanumal using OCCA for portability, has been successfully run on the full system of Summit (4608 nodes, 27648 GPUs).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Multi-Physics Simulations of Molten Chloride Fast Reactor using Nek5000 and PROTEUS-NODAL

This report documents the FY20 work to demonstrate a specific multi-physics capability within NEAMS tools to model molten chloride fast reactors (MCFR). Specifically, the CFD code Nek5000 and the neutronics code PROTEUS-NODAL were coupled off-line to calculate the delayed neutron precursor distribution within the flowing fuel salts in an MCFR core. An MCFR benchmark problem and a 3D test problem based on a conceptual MSR design were successfully solved through the coupled simulation of Nek5000 and PROTEUS-NODAL. In the coupled simulations for these test problems, Nek5000 provided high-quality flow field information, and PROTEUS-NODAL performed the neutron diffusion calculation along with the precursor drift model. The impact of precursor drift on the core status was also investigated. Additionally, the precursor drift model implemented in PROTEUS-NODAL was verified by making use of the reference precursor distribution generated from Nek5000. Results of these test problems suggest that the multi-physics capability of Nek5000 and PROTEUS-NODAL was properly developed for tracking delayed neutron precursor drift.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

NEK5000 Assessment Milestone Report: Single-Phase Natural Circulation using Direct Numerical Simulation (DNS) & Large Eddy Simulation (LES) Methods

This study evaluates the capabilities of the NEK5000 open-source code as an alternative to the commercially available software that is currently heavily relied upon. The first three case studies initiated the author with (1) the syntax and flow of the program, (2) varying initial and boundary conditions and (3) geometries of greater complexity & dimension. Case 1 studies transient conjugate heat transfer in the entry region of a pipe. Cases 2 & 3 simulate the natural convection flow in an enclosed differentially heated cavity (DHC) of two and three dimensions, respectively. The final case study, Case 4, produces three-dimensional single-phase natural convective flow using the Boussinesq approximation within a simplified representation of an aqueous homogeneous reactor system. The Boussinesq flow in Case 4 clearly depicts both Rayleigh-Taylor and Kelvin-Helmholtz instabilities qualitatively during post-processing analysis. Further analysis of Case 4, up to the point of a quasi-steady state (i.e. thermal-equilibrium condition), is done using the LES solver method in NEK5000. The volume-averaged solution temperatures, when compared between solvers, showed no significant difference. Due to its minimal compromise in fidelity of solution resolution and inexpensive computing cost, compared to the DNS solver, the LES solver is recommended for the current application. Methodology development for the four case studies are reported and a preliminary optimization study with different polynomial resolutions for Case 4 is addressed as a resource when performing future simulations using NEK5000. Hence, this report can be used as a reference starting point to the end user of NEK5000 for natural circulation phenomena in nuclear reactor safety applications.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Updates to Nek5000: RANS wall functions, NRC support, and documentation

As a key part of the U.S. Department of Energy’s Nuclear Energy Advanced Modeling and Simulation program (NEAMS), the next generation of tools for nuclear reactor design are being developed. A primary metric for success of this program is the adoption of those tools by industry stakeholders. To help meet this metric for Nek5000, development efforts this year have focused on the expansion of the available Reynolds-averaged Navier-Stokes (RANS) turbulence models to include wall function models, continued support of the U.S. Nuclear Regulatory Commission in simulating a hydrogen mitigation benchmark experiment, and expansion of the Nek5000 documentation to enhance the code’s usability. The implementation of wall functions is intended to significantly decrease time to-solution for a wide range of problems and it has been identified as an important feature by stakeholders across the nuclear community. The initial implementation of standard and pressure corrected wall functions has been tested in Nek5000 on the classical problems of channel flow and a backward facing step. It has also been tested on a 2D molten salt fast reactor core and a T-junction. The recommended formulation of choosing y + = 30 as a boundary value combined with a Neumann-Neumann formulation of the boundary condition for k and τ produces the most consistent results compared to a wall resolved approach. The collaboration with the NRC is a continuing exercise that has been ongoing for multiple years. This year we have concluded investigations into appropriate inlet conditions, showing that fully developed turbulent conditions are adequate for the full PANDA domain. We have also concluded simulations for an unobstructed jet and are now refocusing to the original obstructed jet case. The expansion of the code documentation has also been an ongoing effort over the past few years to address feedback from the various stakeholders. The documentation now more fully covers many of the available features and closes identified SQA gaps. Finally we report on three training sessions that were offered over the past year in an effort to expand the Nek5000 user base.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Demonstration of RANS models with wall functions in the spectral element code Nek5000

The spectral element based computational fluid dynamics (CFD) code Nek5000 has been traditionally used for high-fidelity applications, such as direct numerical simulation (DNS) and large eddy simulation (LES). These techniques require very fine numerical resolution to accurately capture turbulent fluctuations which can be prohibitively expensive for users without access to leadership class computing facilities. For broader application and adoption, significant effort has been invested to develop Reynolds-averaged Navier–Stokes (RANS) capabilities in Nek5000. Here, this work presents details of the implementation and demonstration of the standard wall functions for the κ–τ model in Nek5000. Results using the wall-modeled approach are compared to a wall-resolved approach for cases with negligible pressure gradient, viz., channel flow, pipe flow and flow in a reactor subchannel. Results show reasonably good agreement between the two approaches for friction factor and Nusselt number. Some expected differences are identified near the wall. These cases demonstrate the potential for significant computational savings by using much coarser meshes for the wall-modeled approach, with only minor differences between the predicted result. Additionally, several Reynolds numbers up to 1,000,000 are demonstrated for pipe flow and predicted friction factors and Nusselt numbers compared well to available correlations, with the worst below 10%. As the Reynolds number is increased, better agreement is observed between the correlations and the wall-modeled approach. In addition, flow in a molten salt fast reactor (MSFR) core is considered which features an adverse pressure gradient and flow separation. It showcases the inability of standard wall functions to accurately predict flows with adverse pressure gradients. The results, however, match reasonably well in trend in regions of the flow where the boundary layer is attached. Ongoing research is dedicated to include a pressure gradient correction to wall functions to improve the accuracy of flows with separation or reattachment and adverse or favorable pressure gradients.

42 ENGINEERING↗

Crucible Melter Simulation in Nek5000

Nuclear tank waste at the Hanford site is slated for vitrification in large scale refractory-lined melters to transform it into a stable borosilicate waste form suitable for long-term storage or disposal. Molten glass corrodes the refractory lining over time at a rate correlated to the velocity of molten glass against the refractory-lined wall. To properly design a melter and plan for maintenance, it is necessary to accurately model the glass flow and find the correlation between flow velocity and corrosion rate. This modeling was started in STAR-CCM+ CFD software and is being continued in Nek5000 for its fast-running and quick turnaround code. This poster explains the basic process of reconstructing the geometry, fluid properties, and heating of test melters in Nek5000. The geometry is imported from a mesh file and boundary conditions assigned based on surface IDs. The fluid properties are set in the .par and .usr case files. The heating of the actual crucibles in joule heating with electrodes but simulated in Nek5000 with a volumetric heat source term. This volumetric heat source is fit to the actual heating profile with piecewise polynomials and exponentials. Basic results and verification methods are explained in the poster, as well as further work that must be done to complete modeling.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Towards Adaptive Mesh Refinement for the Spectral Element Solver Nek5000

When performing computational fluid dynamics (CFD) simulations of complex flows, the a priori knowledge of the flow physics and the location of the dominant flow features are usually unknown. For this reason, the development of adaptive remeshing techniques is crucial for large-scale computational problems. Some work has been made recently to provide Nek5000 with adaptive mesh refinement (AMR) capabilities in order to facilitate the generation of the grid and push forward the limit in terms of problem size and complexity [10]. Nek5000 is an open-source, highly scalable and portable code based on the spectral element method (SEM) [4], which offers minimal dissipation and dispersion, high accuracy and exponential convergence. It is aimed at solving direct and large-eddy simulations of turbulent incompressible or low Mach-number flows with heat transfer and species transport. The approach chosen for adapting the mesh is the h-refinement method, where elements are split locally, which requires the relaxation of the conforming grid constraint currently imposed by Nek5000. Other challenges include the implementation of an efficient management of the grid as refinement is applied, the development of tools to localize the critical flow regions via error estimators and the extension of the current preconditioning strategy to non-conforming grids. In this paper, we present a new procedure to setup an algebraic multigrid solver used as part of the preconditioner for the pressure equation.

Offermans, N.↗

Dakota Uncertainty Quantification Methods Applied to the CFD code Nek5000

Predictive modeling and simulation of the performance of a nuclear reactor and its fuel is a challenging task because of the large number of coupled physical phenomena that must be addressed. In addition to this intrinsic complexity, model uncertainty must be accounted for in any analysis if the model will be used to facilitate design or operational decisions which may impact safety and performance. Rigorous, structured uncertainty analyses are performed by first characterizing the model's input uncertainties and, by propagating the uncertainty through the model in order to estimate the output's uncertainty. This paper presents the state of advancement of the Nuclear Energy Advanced Modeling and Simulation (NEAMS) project to characterize the uncertainty of the CFD code Nek5000 using the Dakota package. Nek5000 is a high order spectral element computational fluid dynamics (CFD) code developed at Argonne National Laboratory for high resolution spectral-filtered large eddy simulations (LESs) and unsteady Reynolds averaged Navier-Stokes (RANS) simulations. The Dakota package developed at Sandia National Laboratory can be integrated with many scientific and engineering codes to facilitate efficient, effective uncertainty quantification (UQ) and sensitivity analyses. Dakota is designed to interface with external packages/codes such as Nek5000 through a script-driven interface called fork. Such interface provides maximum flexibility to the users for pre- and post-processing tasks preceding and following each function evaluation. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Numerical Simulation of Isothermal Flow Across Slant Five-Tube Bundle with Spectral Element Method Code Nek5000

The helical coil steam generator (HCSG) is a specific type of shell-and-tube heat exchanger known for having a higher heat transfer coefficient than many other designs. For this reason, they are considered in small modular reactor and high temperature reactor designs. Investigation of flow behavior in HCSGs is important for better design. In this paper we present our study for modeling the coolant flow in the primary side of the HCSG. We used Nek5000, an open source, high-order spectral element computational fluid dynamics code developed in Argonne National Laboratory. Nek5000 accepts only hexahedral mesh, which makes the meshing process for the complicated HCSG geometry very challenging. A tetrahedral-to-hexahedral meshing strategy was applied to bypass the geometric complexities. In this study large eddy simulation (LES) was performed at the Reynolds number of 9000 based on the inlet velocity and the tube diameter. The employed subgrid-scale model for LES relies on explicit filtering. First- and second-order statistics were compared to available experimental data. We report overall velocity and turbulent kinetic energy showed good agreement with particle image velocimetry data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

CFD Evaluation of Pressure Change Along Coolant Passages in Sodium-Cooled Fast Reactor with Nek5000

To support the design efforts of advanced sodium-cooled fast reactors (SFRs), a series of computational fluid dynamics (CFD) simulations are performed to investigate the pressure change along various flow passages in the proposed SFR system. The simulations are carried out with the state-of-the-art spectral element flow solver, Nek5000. Two specific case studies are presented in this paper: the flow exiting the axial neutron reflector channels and the flow entering the fuel pin bundle. Due to the high Reynolds numbers expected, a Reynolds-averaged Navier-Stokes (RANS) approach is necessary to model the turbulence. A newly developed regularized k-omega RANS model is adopted in the related CFD calculations. The first case study explores the effect of Reynolds number on the pressure change when flow exits the reflector channels. The pressure change in this case has two major contributors: the change due to wall friction and the Bernoulli effect. It is noted that the nondimensional pressure loss follows a log-linear trend up to Re = 10 5 , and then the trend is flattened. In the second case study, the advanced NekNek coupling capability is tested where an integral domain can be divided into multiple subdomains with coupling interfaces, which would greatly ease the meshing process of complex engineering geometries and potentially save computational resources. The preliminary results obtained so far confirm the consistency between the NekNek results and those produced by regular Nek5000 simulation. The presented work demonstrates the readiness and flexibility of the related CFD techniques, which is part of the broader effort to leverage cutting-edge CFD to inform the advanced nuclear reactor designs.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

On the Strong Scaling of the Spectral Element Solver Nek5000 on Petascale Systems. In: EASC '16 Proceedings of the Exascale Applications and Software Conference 2016, Article No. 5

The present work is targeted at performing a strong scaling study of the high-order spectral element fluid dynamics solver Nek5000. Prior studies such as [5] indicated a recommendable metric for strong scalability from a theoretical viewpoint, which we test here extensively on three parallel machines with different performance characteristics and interconnect networks, namely Mira (IBM Blue Gene/Q), Beskow (Cray XC40) and Titan (Cray XK7). The test cases considered for the simulations correspond to a turbulent flow in a straight pipe at four different friction Reynolds numbers Reτ = 180, 360, 550 and 1000. Considering the linear model for parallel communication we quantify the machine characteristics in order to better assess the scaling behaviors of the code. Subsequently sampling and profiling tools are used to measure the computation and communication times over a large range of compute cores. We also study the effect of the two coarse grid solvers XXT and AMG on the computational time. Super-linear scaling due to a reduction in cache misses is observed on each computer. The strong scaling limit is attained for roughly 5000-10,000 degrees of freedom per core on Mira, 30,000 - 50,0000 on Beskow, with only a small impact of the problem size for both machines, and ranges between 10,000 and 220,000 depending on the problem size on Titan. This work aims at being a reference for Nek5000 users and also serves as a basis for potential issues to address as the community heads towards exascale supercomputers.

Offermans, Nicolas↗

OpenACC acceleration of the Nek5000 spectral element code

We present a case study of porting NekBone, a skeleton version of the Nek5000 code, to a parallel GPU-accelerated system. Nek5000 is a computational fluid dynamics code based on the spectral element method used for the simulation of incompressible flow. The original NekBone Fortran source code has been used as the base and enhanced by OpenACC directives. The profiling of NekBone provided an assessment of the suitability of the code for GPU systems, and indicated possible kernel optimizations. To port NekBone to GPU systems required little effort and a small number of additional lines of code (approximately one OpenACC directive per 1000 lines of code). The naïve implementation using OpenACC leads to little performance improvement: on a single node, from 16 Gflops obtained with the version without OpenACC, we reached 20 Gflops with the naïve OpenACC implementation. An optimized NekBone version leads to a 43 Gflop performance on a single node. In addition, we ported and optimized NekBone to parallel GPU systems, reaching a parallel efficiency of 79.9% on 1024 GPUs of the Titan XK7 supercomputer at the Oak Ridge National Laboratory.

Computer Science↗

Dakota Uncertainty Quantification Methods Applied to the CFD code Nek5000

This report presents the state of advancement of a Nuclear Energy Advanced Modeling and Simulation (NEAMS) project to characterize the uncertainty of the computational fluid dynamics (CFD) code Nek5000 using the Dakota package for flows encountered in the nuclear engineering industry. Nek5000 is a high-order spectral element CFD code developed at Argonne National Laboratory for high-resolution spectral-filtered large eddy simulations (LESs) and unsteady Reynolds-averaged Navier-Stokes (URANS) simulations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Nek5000: improvements in the available RANS models, meshing, tutorials, and training

This year, the Nuclear Energy Advanced Modeling Simulation program (NEAMS) thermal-hydraulics report for Nek5000 NRC- and verification and validation (V&V)-driven development focuses on following areas of code application and improvement. First we have continued improvements of RANS modeling capabilities in Nek5000 including improved k-tau model focusing mostly on wallfunction initial implementation with spectral element method (SEM) and initiating investigation of an alternative approach XSEM that greatly reduces discretization errors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DNS Study of Supercritical CO{sub 2} Flow Using Spectral Element Code Nek5000

The study of supercritical CO{sub 2} (s-CO{sub 2}) heat transfer has become popular in recent decades. The driving factor is the growing interest of using s-CO{sub 2} in future power conversion cycles. The supercritical CO{sub 2} Brayton cycle has gained the most focus for its high efficiency, compact design, economics, etc, . In this cycle, heat exchangers are used to heat up or cool down CO{sub 2}. Thus, the heat transfer characteristics of s-CO{sub 2} need to be well understood for heat exchanger design. In this research, we use the open-source spectral-element code Nek5000, developed by Argonne National Laboratory, to perform a direct numerical simulation (DNS) for s-CO{sub 2} flow through a straight heated tube. The pioneering paper by Bae et al. is used to validate the results from the Nek5000 simulation. (authors)

74 ATOMIC AND MOLECULAR PHYSICS↗

OpenACC acceleration for the P N – P N - 2 algorithm in Nek5000

Due to its high performance and throughput capabilities, GPU-accelerated computing is becoming a popular technology in scientific computing, in particular using programming models such as CUDA and OpenACC. The main advantage with OpenACC is that it enables to simply port codes in their ‘‘original’’ form to GPU systems through compiler directives, thus allowing an incremental approach. An OpenACC implementation is applied to the CFD code Nek5000 for simulation of incompressible flows, based on the spectral-element method. The work follows up previous implementations and focuses now on the P N - P N-2 method for the spatial discretization of the Navier–Stokes equations. Performance results of the ported code show a speed-up of up to 3.1 on multi-GPU for a polynomial order N > 11.

97 MATHEMATICS AND COMPUTING↗