Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Numerical benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Towards Unifying the Planetary Boundary Layer and Shallow Convection in CAM5 with the Eddy-Diffusivity/Mass-Flux Approach

The modular structure of the boundary layer and convection parameterizations in atmospheric models have long been affecting the numerical representation of subgrid-scale motions and their mutual interactions. A promising alternative, the eddy-diffusivity/mass-flux approach (EDMF), has the potential for unifying the existing formulations into a consistent scheme and improving some of the long-standing issues. This study documents a step towards developing such a unified approach by implementing a stochastic multi-plume EDMF scheme into the Community Atmosphere Model (Version 5.0). Its performance in single-column mode is evaluated against the control parameterization and large-eddy simulation (LES) for two benchmark cases: marine and continental shallow convection. Overall, the results for the two parameterizations agree well with each other and with LES in terms of mean profiles of moist conserved variables and their vertical fluxes, as well as the updraft properties. However, systematic differences between the two schemes, especially for transient continental convection, are also documented. Using EDMF helps improve some of the parameterized features of shallow convection. In particular, for the highest tested vertical resolution, the EDMF cloud base and top heights and the vertical fluxes of energy and water are remarkably close to LES.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2007

A New Look at Stratospheric Sudden Warmings. Part II: Evaluation of Numerical Model Simulations

The simulation of major midwinter stratospheric sudden warmings (SSWs) in six stratosphere-resolving general circulation models (GCMs) is examined. The GCMs are compared to a new climatology of SSWs, based on the dynamical characteristics of the events. First, the number, type, and temporal distribution of SSW events are evaluated. Most of the models show a lower frequency of SSW events than the climatology, which has a mean frequency of 6.0 SSWs per decade. Statistical tests show that three of the six models produce significantly fewer SSWs than the climatology, between 1.0 and 2.6 SSWs per decade. Second, four process-based diagnostics are calculated for all of the SSW events in each model. It is found that SSWs in the GCMs compare favorably with dynamical benchmarks for SSW established in the first part of the study. These results indicate that GCMs are capable of quite accurately simulating the dynamics required to produce SSWs, but with lower frequency than the climatology. Further dynamical diagnostics hint that, in at least one case, this is due to a lack of meridional heat flux in the lower stratosphere. Even though the SSWs simulated by most GCMs are dynamically realistic when compared to the NCEP-NCAR reanalysis, the reasons for the relative paucity of SSWs in GCMs remains an important and open question.

Charlton, Andrew J.↗
DOE OSTI2021

FPGA-based HPC accelerators: An evaluation on performance and energy efficiency

Hardware specialization is a promising direction for the future of digital computing. Reconfigurable technologies enable hardware specialization with modest non-recurring engineering cost, but their performance and energy efficiency compared to state-of-the-art processor architectures remain an open question. In this article, we use FPGAs to evaluate the benefits of building specialized hardware for numerical kernels found in scientific applications. In order to properly evaluate performance, we not only compare Intel Arria 10 and Xilinx U280 performance against Intel Xeon, Intel Xeon Phi, and NVIDIA V100 GPUs, but we also extend the Empirical Roofline Toolkit (ERT) to FPGAs in order to assess our results in terms of the Roofline model. We show design optimization and tuning techniques for peak FPGA performance at reasonable hardware usage and power consumption. As FPGA peak performance is known to be far less than that of a GPU, we also benchmark the energy efficiency of each platform for the scientific kernels comparing against microbenchmark and technological limits. Results show that while FPGAs struggle to compete in absolute terms with GPUs on memory- and compute-intensive kernels, they require far less power and can deliver nearly the same energy efficiency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

GPU-acceleration of the ELPA2 distributed eigensolver for dense symmetric and hermitian eigenproblems

The solution of eigenproblems is often a key computational bottleneck that limits the tractable system size of numerical algorithms, among them electronic structure theory in chemistry and in condensed matter physics. Large eigenproblems can easily exceed the capacity of a single compute node, thus must be solved on distributed-memory parallel computers. We here present GPU-oriented optimizations of the ELPA two-stage tridiagonalization eigensolver (ELPA2). On top of cuBLAS-based GPU offloading, we add a CUDA kernel to speed up the back-transformation of eigenvectors, which can be the computationally most expensive part of the two-stage tridiagonalization algorithm. Furthermore, we benchmark the performance of this GPU-accelerated eigensolver on two hybrid CPU–GPU architectures, namely a compute cluster based on Intel Xeon Gold CPUs and NVIDIA Volta GPUs, and the Summit supercomputer based on IBM POWER9 CPUs and NVIDIA Volta GPUs. Consistent with previous benchmarks on CPU-only architectures, the GPU-accelerated two-stage solver exhibits a parallel performance superior to the one-stage counterpart. Finally, we demonstrate the performance of the GPU-accelerated eigensolver developed in this work for routine semi-local KS-DFT calculations comprising thousands of atoms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A Poisson equation method for prescribing fully developed non-Newtonian inlet conditions for computational fluid dynamics simulations in models of arbitrary cross-section

Prescribing inlet boundary conditions for computational fluid dynamics (CFD) simulations of internal flow in complex geometries such as anatomical vascular models is challenging. In the absence of patient-specific inlet velocity data, a common approach for long blood vessels is to assume that the inlet flow is fully developed. In vessels of irregular cross section, however, prescribing fully developed conditions is complicated due to the lack of a general closed-form analytical solution. In this study, we develop a simple Poisson equation method for prescribing fully developed inlet conditions for the flow of either Newtonian or non-Newtonian fluids in CFD models of arbitrary cross-section. We first derive the generalized Poisson equation for fully developed flow of a non-Newtonian fluid and we then develop and verify a methodology for numerically computing the solution on any planar boundary domain. In addition, we develop a simple extension of the method for prescribing a non-orthogonal inlet velocity that represents fully developed flow from an upstream tube that is connected to the CFD inlet at a non-orthogonal angle. This may be used to investigate a common source of uncertainty in CFD simulations of internal flow that is due to a lack of information concerning the exact streamwise flow direction at the inlets. Comparison to several Newtonian and non-Newtonian benchmark verification solutions shows the method to be extremely accurate. As a practical demonstration case, we use the method to prescribe fully developed conditions on multiple non-circular inlets for the non-Newtonian flow of blood in a patient-specific model of the inferior vena cava (IVC). Finally, we further demonstrate the utility of the method by performing a sensitivity study using the patient-specific IVC model, wherein we investigate the influence of inlet velocity flow direction on the non-Newtonian IVC hemodynamics. Given its simplicity and computational efficiency, the method is shown to be far superior to alternative approaches for prescribing fully developed inlet conditions in such complicated geometries. In conclusion, to facilitate the adoption of our Poisson equation method, we have distributed our OpenFOAM source code and the associated test cases from this study as open-source software.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Calculations of non-adiabatic couplings within equation-of-motion coupled-cluster framework: Theory, implementation, and validation against multi-reference methods

In this work, we report an implementation of non-adiabatic coupling (NAC) forces within the equation-of-motion coupled-cluster with single and double excitations (EOM-CCSD) framework via the summed-state approach. Using illustrative examples, we compare NAC forces computed with EOM-CCSD and multi-reference (MR) wave functions (for selected cases, we also consider configuration interaction singles). In addition to the magnitude of the NAC vectors, we analyze their direction, which is important for the calculations of the rate of non-adiabatic transitions. Our benchmark set comprises three doublet radical-cations (hexatriene, cyclohexadiene, and uracil), neutral uracil, and sodium-doped ammonia clusters. When the characters of the states agree among different methods, we observe good agreement between the respective NAC vectors, both in the Franck-Condon region and away. In the cases of large discrepancies between the methods, the disagreement can be attributed to the difference in the states’ character, which, in some cases, is very sensitive to electron correlation, both within single-reference and multi-reference frameworks. Finally, the numeric results confirm that the accuracy of NAC vectors depends critically on the quality of the underlying wave functions. Within their domain of applicability, EOM-CC methods provide a viable alternative to MR approaches.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

Modeling of Cloud Microphysics: Can We Do Better?

Representation of cloud microphysics is a key aspect of simulating clouds. From the early days of cloud modeling, numerical models have relied on an Eulerian approach for all cloud and thermodynamic and microphysics variables. Over time the sophistication of microphysics schemes has steadily increased, from simple representations of bulk masses of cloud and rain in each grid cell, to including different ice particle types and bulk hydrometeor concentrations, to complex schemes referred to as bin or spectral schemes that explicitly evolve the hydrometeor size distributions within each model grid cell. As computational resources grow, there is a clear trend toward wider use of bin schemes, including their use as benchmarks to develop and test simplified bulk schemes. We argue that continuing on this path brings fundamental challenges difficult to overcome. The Lagrangian particle-based probabilistic approach is a practical alternative in which the myriad of cloud and precipitation particles present in a natural cloud is represented by a judiciously selected ensemble of point particles called superdroplets or superparticles. Here, the advantages of the Lagrangian particle-based approach when compared to the Eulerian bin methodology are explained, and the prospects of applying the method to more comprehensive cloud simulations—for instance, targeting deep convection or frontal cloud systems—are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2013

Validation of Criticality Safety Calculations with SCALE 6.2

SCALE 6.2 provides numerous updates in nuclear data, nuclear data processing, and computational tools utilized in the criticality safety calculational sequences relative to SCALE 6.1. A new 252-group ENDF/B-VII.0 multigroup neutron library, improved ENDF/B-VII.0 continuous energy data, as well as the previously deployed 238-group ENDF/B-VII.0 neutron library are included in SCALE 6.2 for criticality safety analysis. The performance of all three libraries for keff calculations is examined with a broad sampling of critical experiment models covering a range of fuels and moderators. Critical experiments from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (IHECSBE) that are available in the SCALE Verified, Archived Library of Inputs and Data (VALID) are used in this validation effort. Over 300 cases are used in the validation of KENO V.a, and a more limited set of approximately 50 configurations are used for KENO-VI validation. Additionally, some KENO V.a cases are converted to KENO-VI models so that an equivalent set of experiments can be used to validate both codes. For continuous-energy calculations, SCALE 6.2 provides improved performance relative to SCALE 6.1 in most areas with notable improvements in fuel pin lattice cases, particularly those with mixed oxide fuel. Multigroup calculations with the 252-group library also demonstrate improved performance for fuel lattices, uranium (high and intermediate enrichment) and plutonium metal experiments, and plutonium solution systems. Overall, SCALE 6.2 provides equivalent or smaller biases than SCALE 6.1, and the two versions of KENO provide similar results on the same suite of problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2012

STOMP Subsurface Transport Over Multiple Phases: STOMP-CO2 and STOMP-CO2e Guide: Version 1.0

This STOMP (Subsurface Transport Over Multiple Phases) guide document describes the theory, use, and application of the STOMP-CO2 and STOMP-CO2e operational modes. These operational modes of the STOMP simulator are configured to solve problems involving the sequestration of CO2 in geologic saline reservoirs. STOMP-CO2 is the isothermal version and STOMP-CO2e is the nonisothermal version. These core operational modes solve the governing conservation equations for component flow and transport through geologic media; where, the STOMP-CO2 components are water, CO2 and salt and the STOMP-CO2e operational mode also includes an energy conservation equation. Geochemistry can be included in the problem solution via the ECKEChem (Equilibrium-Conservation-Kinetic-Equation Chemistry) module, and geomechanics via the EPRMech (Elastic-Plastic-Rock Mechanics) module. This addendum is designed to provide the new user with a full guide for the core capabilities of the STOMP-CO2 and -CO2e simulators, and to provide the experienced user with a quick reference on implementing features. Several benchmark problems are provided in this addendum, which serve as starting points for developing inputs for more complex problems and as demonstrations of the simulator’s capabilities.

Carbon Dioxide↗
DOE OSTI2024

Task-oriented machine learning surrogates for tipping points of agent-based models

We present a machine learning framework bridging manifold learning, neural networks, Gaussian processes, and Equation-Free multiscale approach, for the construction of different types of effective reduced order models from detailed agent-based simulators and the systematic multiscale numerical analysis of their emergent dynamics. The specific tasks of interest here include the detection of tipping points, and the uncertainty quantification of rare events near them. Our illustrative examples are an event-driven, stochastic financial market model describing the mimetic behavior of traders, and a compartmental stochastic epidemic model on an Erdös-Rényi network. We contrast the pros and cons of the different types of surrogate models and the effort involved in learning them. Importantly, the proposed framework reveals that, around the tipping points, the emergent dynamics of both benchmark examples can be effectively described by a one-dimensional stochastic differential equation, thus revealing the intrinsic dimensionality of the normal form of the specific type of the tipping point. This allows a significant reduction in the computational cost of the tasks of interest.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Late-time growth rate, mixing, and anisotropy in the multimode narrowband Richtmyer–Meshkov instability: The θ-group collaboration

Turbulent Richtmyer–Meshkov instability (RMI) is investigated through a series of high resolution three-dimensional simulations of two initial conditions with eight independent codes. The simulations are initialised with a narrowband perturbation such that instability growth is due to non-linear coupling/backscatter from the energetic modes, thus generating the lowest expected growth rate from a pure RMI. By independently assessing the results from each algorithm and computing ensemble averages of multiple algorithms, the results allow a quantification of key flow properties as well as the uncertainty due to differing numerical approaches. A new analytical model predicting the initial layer growth for a multimode narrowband perturbation is presented, along with two models for the linear and non-linear regimes combined. Overall, the growth rate exponent is determined as θ=0.292±0.009, in good agreement with prior studies; however, the exponent is decaying slowly in time. Also, θ is shown to be relatively insensitive to the choice of mixing layer width measurements. The asymptotic integral molecular mixing measures Θ=0.792±0.014, Ξ=0.800±0.014, and Ψ=0.782±0.013 are lower than some experimental measurements but within the range of prior numerical studies. The flow field is shown to be persistently anisotropic for all algorithms, at the latest time having between 49% and 66% higher kinetic energy in the shock parallel direction compared to perpendicular and does not show any return to isotropy. The plane averaged volume fraction profiles at different time instants collapse reasonably well when scaled by the integral width, implying that the layer can be described by a single length scale and thus a single θ. In conclusion, quantitative data given for both ensemble averages and individual algorithms provide useful benchmark results for future research.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

A Comparison of GPU-Accelerated Multiphase CFD Solvers on the Polaris Supercomputer: Part 1

This report is in support of the Innovative and Novel Computational Impact on Theory and Experiment (INCITE) program sponsored by the U.S. Department of Energy (USDOE). With INCITE-level resources, one project, titled BubblyFlow, was granted computational resources for the 2025 calendar year on the Polaris supercomputer at the Argonne Leadership Computing Facility (ALCF). The project aims to conduct simulations to understand the fundamental characteristics of turbulent bubbly flow phenomena in nature. Staff at the ALCF and Argonne’s Computational Science division, along with collaborators at the City College of New York and University of Illinois at Chicago, helped a summer student to assess the accuracy and performance of two high performance computing (HPC) codes. Both codes, ImExLBM and FluTAS, are fundamentally different in their mathematical and numerical modeling. However, both may be used to solve the same physical problem. The collaboration sought to better understand the differences between both codes in terms of accuracy and efficiency. This would ultimately help the BubblyFlow project better utilize resources and establish a knowledge-base of code capabilities in future simulation campaigns. We compare ImExLBM and FluTAS, two high-performance multiphase computational fluid dynamics (CFD) solvers, in terms of physical fidelity, time-to-solution, and parallel efficiency. We validate ImExLBM (Implicit-Explicit Lattice Boltzmann Method) against a canonical benchmark and assess it’s performance relative to FluTAS (Fluid Transport Accelerated Solver), a well-established open-source CFD code.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2015

Polarized Bidirectional Reflectance of Optically Thick Sparse Particulate Layers: an Efficient Numerically Exact Radiative-Transfer Solution

We describe a simple yet efficient numerical algorithm for computing polarized bidirectional reflectance of an optically thick (semi-infinite), macroscopically flat layer composed of statistically isotropic and mirror symmetric random particles. The spatial distribution of the particles is assumed to be sparse, random, and statistically uniform. The 44 Stokes reflection matrix is calculated by iterating the Ambartsumian's vector nonlinear integral equation. The result is a numerically exact solution of the vector radiative transfer equation and as such fully satisfies the energy conservation law and the fundamental reciprocity relation. Since this technique bypasses the computation of the internal radiation field, it is very fast and highly accurate. The FORTRAN implementation of the technique is publicly available on the World Wide Web at http://www.giss.nasa.gov/staff/ mmishchenko/brf. It can be combined with several existing computer programs providing the requisite single-scattering properties of spherical or morphologically complex particles and applied to a wide range of optical characterization problems. Benchmark results obtained with this program can be used for testing alternative solvers of the vector radiative transfer equation.

radiative transfer↗
DOE OSTI2026

Numerical implementation of the MOOSE subchannel module (SCM) algorithm

The subchannel module of moose (SCM), previously referred to as Pronghorn-SC, is a subchannel code designed to resolve single-phase flow fields and calculate the relevant flow variables, in nuclear reactor fuel-pin assemblies. The assemblies it models are: water-cooled, with bare fuel-pins in a square ducted, quadrilateral lattice and liquid-metal/water-cooled, with bare/wire-wrapped fuel pins in a hexagonal ducted, triangular lattice. Previous publications have presented the development, validation and verification of SCM. This work presents an comparative overview of the different solvers implemented within SCM. This includes the solver algorithm description, and a performance comparison. The two test cases chosen to demonstrate the solver performance were taken from the PSBT enthalpy mixing benchmark and the ORNL-19 pin benchmark.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2017

Deploy production sliding mesh capability with linear solver benchmarking (ECP Milestone Report, Ver. 1.0)

Wind applications require the ability to simulate rotating blades. To support this use-case, a novel design-order sliding mesh algorithm has been developed and deployed. The hybrid method combines the control volume finite element methodology (CVFEM) with concepts found within a discontinuous Galerkin (DG) finite element method (FEM) to manage a sliding mesh. The method has been demonstrated to be design-order for the tested polynomial basis (P=1 and P=2) and has been deployed to provide production simulation capability for a Vestas V27 (225 kW) wind turbine. Other stationary and canonical rotating flow simulations are also presented. As the majority of wind-energy applications are driving extensive usage of hybrid meshes, a foundational study that outlines near-wall numerical behavior for a variety of element topologies is presented. Results indicate that the proposed nonlinear stabilization operator (NSO) is an effective stabilization methodology to control Gibbs phenomena at large cell Peclet numbers. The study also provides practical mesh resolution guidelines for future analysis efforts. Application-driven performance and algorithmic improvements have been carried out to increase robustness of the scheme on hybrid production wind energy meshes. Specifically, the Kokkos-based Nalu Kernel construct outlined in the FY17/Q4 ExaWind milestone has been transitioned to the hybrid mesh regime. This code base is exercised within a full V27 production run. Simulation timings for parallel search and custom ghosting are presented. As the low-Mach application space requires implicit matrix solves, the cost of matrix reinitialization has been evaluated on a variety of production meshes. Results indicate that at low element counts, i.e., fewer than 100 million elements, matrix graph initialization and preconditioner setup times are small. However, as mesh sizes increase, e.g., 500 million elements, simulation time associated with "setup-up" costs can increase to nearly 50% of overall simulation time when using the full Tpetra solver stack and nearly 35% when using a mixed Tpetra- Hypre-based solver stack. The report also highlights the project achievement of surpassing the 1 billion element mesh scale for a production V27 hybrid mesh. A detailed timing breakdown is presented that again suggests work to be done in the setup events associated with the linear system. In order to mitigate these initialization costs, several application paths have been explored, all of which are designed to reduce the frequency of matrix reinitialization. Methods such as removing Jacobian entries on the dynamic matrix columns (in concert with increased inner equation iterations), and lagging of Jacobian entries have reduced setup times at the cost of numerical stability. Artificially increasing, or bloating, the matrix stencil to ensure that full Jacobians are included is developed with results suggesting that this methodology is useful in decreasing reinitialization events without loss of matrix contributions. With the above foundational advances in computational capability, the project is well positioned to begin scientific inquiry on a variety of wind-farm physics such as turbine/turbine wake interactions.

Domino, Stefan P.↗
DOE OSTI2021

An efficient reconstruction algorithm for diffusion on triangular grids using the nodal discontinuous Galerkin method

High-energy-density (HED) hydrodynamics studies such as those relevant to inertial confinement fusion and astrophysics require highly disparate densities, temperatures, viscosities, and other diffusion parameters over relatively short spatial scales. This presents a challenge for high-order accurate methods to effectively resolve the hydrodynamics at these scales, particularly in the presence of highly disparate diffusion. A significant volume of engineering and physics applications use an unstructured discontinuous Galerkin (DG) method developed based on the finite element mesh generation and algorithmic framework. This work discusses the application of an affine reconstructed nodal DG method for unstructured grids of triangles. Solving the diffusion terms in the DG method is non-trivial due to the solution representations being piecewise continuous. Hence, the diffusive flux is not defined on the interface of elements. The proposed numerical approach reconstructs a smooth solution in a parallelogram that is enclosed by the quadrilateral formed by two adjacent triangle elements. The interface between these two triangles is the diagonal of the enclosed parallelogram. Similar to triangles, the mapping of parallelograms from a physical domain to a reference domain is an affine mapping, which is necessary for an accurate and efficient implementation of the numerical algorithm. Thus, all computations can still be performed on the reference domain, which promotes efficiency in computation and storage. This reconstruction does not make assumptions on choice of polynomial basis. Reconstructed DG algorithms have previously been developed for modal implementations of the convection–diffusion equations. However, to the best of the authors’ knowledge, this is the first practical guideline that has been proposed for applying the reconstructed algorithm on a nodal discontinuous Galerkin method with a focus on accuracy and efficiency. As a result, the algorithm is demonstrated on a number of benchmark cases as well as a challenging substantive problem in HED hydrodynamics with highly disparate diffusion parameters.

Computational efficiency↗
DOE OSTI2022

A high accuracy/resolution spectral element/Fourier–Galerkin method for the simulation of shoaling non-linear internal waves and turbulence in long domains with variable bathymetry

A high-order hybrid continuous-Galerkin numerical method, designed for the simulation of non-linear, non -hydrostatic internal waves and turbulence in long computational domains with complex bathymetry, is presented. The spatial discretization in the non-periodic wave-propagating directions, utilizes the nodal spectral element method. Such a high-order element-based discretization allows the highly accurate representation of complex domain geometry along with the flexibility of concentrating resolution in areas of interest. Under the assumption of the normal-to-isobath propagation of non-linear internal waves, a third periodic direction is incorporated via a Fourier-Galerkin discretization. The distinct non-hydrostatic nature of non-linear internal waves and, any instabilities and turbulence therein, necessitates the numerically challenging solution of the pressure Poisson problem. A defining feature of this work is the application of a domain decomposition approach, combined with block-Jacobi/deflation-based preconditioning to the pressure Poisson problem. Such a combined approach is particularly suitable for the long high aspect-ratio complex domains of interest and enables the efficient high-accuracy reproduction of the non-hydrostatic dynamics of non-linear internal waves. Implementation details are also described in the context of the stability of the solver and its parallelization strategy. A series of benchmarks of increasing complexity demonstrate the robustness of the flow solver. The benchmarks culminate with the three-dimensional simulation of a convectively breaking mode-one non-linear internal wave over a realistic South-China-Sea bathymetric transect and background current/stratification profiles.

Deflation↗
DOE OSTI2021

Immortal rays: Rethinking random ray neutron transport on GPU architectures

The Random Ray Method (TRRM) is a recently developed adaptation of the Method of Characteristics for neutral particle transport simulations. TRRM has demonstrated excellent performance on 3D nuclear reactor benchmark problems using CPU-based compute systems. When porting to GPU-based systems, however, new performance challenges arise that are unique to processors targeting massive fine-grained parallelism. For smaller problems, or for large problems that are domain decomposed across many computational nodes, the problem size per node has insufficient parallelism to saturate GPU node resources, thus greatly limiting speedup. In this study, we report on a newly developed “immortal ray” variant of TRRM. Here, the immortal ray technique exposes significantly more fine-grained parallelism by fundamentally reformulating the numerical details of ray discretization, resulting in performance tradeoffs with significant overall benefit on GPUs. For very small 2D simulation problems we found the new immortal ray variant allowed for up to a 4.4x speedup when run on a single GPU. For larger 3D simulation problems we found the new variant improved strong scaling by 3x when run on the Summit supercomputer.

97 MATHEMATICS AND COMPUTING↗