Engineering Papers⌕ Search

Engineering topics

Johnson, Seth R.

Publications and source records attributed to Johnson, Seth R..

At least 19 records

Point containment algorithms for constructive solid geometry with unbounded primitives

Here, we present several algorithms for evaluating point containment in constructive solid geometry (CSG) trees with unbounded primitives. Three algorithms are presented based on postfix, prefix, and infix notations of the CSG binary expression tree. We show that prefix and infix notations enable short-circuiting logic, which reduces the number of primitives that must be checked during point containment. To evaluate the performance of the algorithms, each algorithm was implemented in the OpenMC Monte Carlo particle transport code, which relies on CSG to represent solid bodies through which subatomic particles travel. Two sets of tests were carried out. First, the execution time to generate a rasterized image of a 2D slice of three CSG models of varying complexity was measured. Use of both prefix and infix notations offered significant speedup over the postfix notation that has traditionally been used in particle transport codes, with infix resulting in a 6 x reduction in execution time relative to postfix for a model of a tokamak fusion device. We then measured the execution time of neutron transport simulations of the same three models using each of the algorithms. The results and performance improvements reveal the same trends as for the rasterization test, with a 5.52 x overall speedup using the infix notation relative to the original postfix notation in OpenMC for the tokamak model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Celeritas: Accelerating Geant4 with GPUs

Celeritas [1] is a new Monte Carlo (MC) detector simulation code designed for computationally intensive applications (specifically, High Lumi- nosity Large Hadron Collider (HL-LHC) simulation) on high-performance heterogeneous architectures. In the past two years Celeritas has advanced from prototyping a GPU-based single physics model in infinite medium to implementing a full set of electromagnetic (EM) physics processes in complex geometries. The current release of Celeritas, version 0.3, has incorporated full device-based navigation, an event loop in the presence of magnetic fields, and detector hit scoring. New functionality incorporates a scheduler to offload electromagnetic physics to the GPU within a Geant4-driven simulation, enabling integration of Celeritas into high energy physics (HEP) experimental frameworks such as CMSSW. On the Summit supercomputer, Celeritas performs EM physics between 6 and 32 faster using the machine’s Nvidia GPUs compared to using only CPUs. When running a multithreaded Geant4 ATLAS test beam application with full hadronic physics, using Celeritas to accelerate the EM physics results in an overall simulation speedup of 1.8–2.3× on GPU and 1.2× on CPU.

Johnson, Seth R.↗

Comparison of Temperature-Dependent Cross Section Treatments Within the Shift Monte Carlo Radiation Transport Code

Multiple calculation methods have been developed to account for Doppler broadening of cross sections in Monte Carlo radiation transport simulations. This work compares the accuracy and performance of four different broadening methods, including an on-the-fly multipole treatment, applied to three different geometries of increasing complexity, including a nuclear reactor assembly with a realistic temperature profile. The comparisons reveal how the combination of physics implementations in the Shift Monte Carlo code result in slightly different temperature-dependent behavior, and different levels of performance, for a variety of materials and situations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Celeritas R&D Report: Accelerating Geant4

Celeritas is a new Monte Carlo (MC) detector simulation code designed for computationally intensive applications on high-performance heterogeneous architectures. In the past two years Celeritas has advanced from prototyping a Graphics Processing Unit (GPU)-based single physics model in infinite medium to implementing a full set of electromagnetic (EM) physics processes in complex geometries. The current release of Celeritas, version 0.4, has incorporated full device-based navigation, an event loop in the presence of magnetic fields, and detector hit scoring. New functionality incorporates a scheduler to offload electromagnetic physics to the GPU within a Geant4-driven simulation, enabling straightforward integration of Celeritas into the high energy physics (HEP) experimental frameworks CMSSW and ATLAS FullSimLight. On the Perlmutter supercomputer, Celeritas performs EM physics between 3× and 18× faster using the machine’s Nvidia GPUs compared to using only CPUs, corresponding to an electrical power efficiency up to a factor of 5. When running a multithreaded Geant4 ATLAS test beam application with full hadronic physics, using Celeritas to accelerate the EM physics results in an overall simulation speedup of 1.7–2.2× on GPU and 1.2× on CPU. In a CMS test application using tt¯ events and the prototype Run 4 configuration, compared to Geant4 CPU, Celeritas with a Nvidia A100 improves overall throughput up to a factor of 2.7× but cannot be efficiently shared with more than 8 cores.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

An implicit barotropic mode solver for MPAS-ocean using a modern Fortran solver interface

Here, we demonstrate use of a modern Fortran solver interface to manage solver algorithms for an implicit barotropic mode solver in the Model for Predictions Across Scales-Ocean (MPAS-O). ForTrilinos, a Fortran interface to Trilinos that contains a large collection of solver capabilities written in C++, has been implemented in MPAS-O to provide access to a suite of linear solver options. By virtue of the simplified wrapper and interface generator (SWIG) automation tool that generates modern Fortran interfaces to C++ code, we were able to implement the Fortran solver interface in MPAS-O using a familiar Fortran coding style while minimizing performance degradation. The ForTrilinos solver interface is written within MPAS-O’s time stepping modules as a subroutine in conjunction with MPAS-O code. Applied to an idealized ocean and a high-resolution realistic ocean test case, parallel performance of ForTrilinos solvers is examined. It is found that parallel scalability of the ForTrilinos solvers is highly dependent on the number of global synchronization points per solver iteration in each iterative solver algorithm. ForTrilinos solvers perform best compared to the Fortran hand-crafted (FHC) solver when the amount of work per processor is large enough. However, parallel scalability is better with the FHC solver and so when the work per core is modest FHC outperforms ForTrilinos. The intercomparison between the ForTrilinos and FHC solvers reveals that this performance hit in the ForTrilinos solver mostly comes from the global synchronization process, while suggesting that the matrix-vector multiplication process in the FHC solver needs to be optimized for better performance.

97 MATHEMATICS AND COMPUTING↗

Modeling, Performance Assessment, and Nodal Data Analysis of TRISO-Fueled Systems with Shift

This technical report documents several enhancements to the Shift Monte Carlo (MC) code under the US Department of Energy (DOE) Nuclear Energy Advanced Modeling and Simulation (NEAMS) program in fiscal year (FY) 2022. Performance enhancements were added to Shift specifically for tristructural isotropic (TRISO)–fueled reactor systems and guided based on performance analysis in FY 2021. For the pebble performance model developed in previous studies, the runtime improved by ~ 91× compared to the original model and ~ 2× compared to the user-optimized model. Compared to Serpent, Shift is ~ 3× slower if Serpent delta-tracking is enabled but ~ 2× faster when delta-tracking is disabled. The multigroup cross section generation was improved through simplifying tally input definitions, porting several post-processing tally operations from Python scripts into the Shift code base, and accounting for production reactions in the scattering multiplicity. Progress was also made on two emerging capabilities: (1) the development of Titan (a Shift reactor physics user interface) and (2) initial investigation into path-length tallies for computing multigroup scattering matrices.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Five years of ForTrilinos ECP

The ForTrilinos subproject of the Exascale Computing Project (ECP) was initiated to bring the capabilities and scalability of the Trilinos numerical solver collection to Fortran scientific application codes. A novel Fortran extension to the Simplified Wrapper and Interface Generator (SWIG) tool, which automatically generates Fortran bindings from existing C/C++ library code, has been applied to key Trilinos solver libraries to generate the new ForTrilinos libraries. SWIG-Fortran has additionally been used to generate new Fortran compatibility layers for additional scientific libraries and applications. This report summarizes the products and impact of the ForTrilinos subproject.

97 MATHEMATICS AND COMPUTING↗

Celeritas

Celeritas is a new Monte Carlo transport code designed for high-performance simulation of high-energy physics detectors.

Johnson, Seth R.↗

SWIG+Fortran User Manual

This report explains the detailed capabilities, usage, and implementation of the Fortran target language extension to the SWIG tool. The SWIG+Fortran extension is used to generate Fortran-2003 bindings to existing C and C++ library codes.

97 MATHEMATICS AND COMPUTING↗

Flibcpp User Manual

Flibcpp uses SWIG-Fortran to generate native Fortran-2003 interfaces to efficient and robust algorithms and data containers implemented in the C++ standard library.

97 MATHEMATICS AND COMPUTING↗

Novel features and GPU performance analysis for EM particle transport in the Celeritas code

Celeritas is a new computational transport code designed for high-performance simulation of high-energy physics detectors. This work describes some of its current capabilities and the design choices that enable the rapid development of efficient on-device physics. The abstractions that underpin the code design facilitate low-level performance tweaks that require no changes to the higher-level physics code. We evaluate a set of independent changes that together yield an almost 40% speedup over the original GPU code for a net performance increase of 220× for a single GPU over a single CPU running 8.4M tracks on a small demonstration physics app.

Johnson, Seth R.↗

Omnibus User Manual

This manual provides instructions for using Omnibus to run the Exnihilo code suite, which contains the Denovo and Shift transport solvers.

97 MATHEMATICS AND COMPUTING↗

Initial Neutronics and Thermal-Hydraulic Coupling for Spent Nuclear Fuel Canister

This report documents work performed supporting the US Department of Energy (DOE) Nuclear Energy Spent Fuel and Waste Disposition, Spent Fuel and Waste Science and Technology, under work breakdown structure element 1.08.01.03.05, “Direct Disposal of Dual Purpose Canisters.” In particular, this appendix fulfills the M3 milestone, M3SF-19OR010305015, “Multiphysics criticality consequence analysis capability development status report,” as Revision 1 to M3SF-19OR010305016, “Initial neutronic and thermal hydraulic coupling for waste package” within work package SF-19OR01030501, “Direct Disposal of Dual Purpose Canisters–ORNL.” This report presents the initial development status of a multiphysics criticality consequence simulation framework, Terrenus. Terrenus currently couples two physics codes: the Monte Carlo radiation transport code Shift and the thermal-hydraulics code COBRA-SFS. The coupling capability has been demonstrated using a simplified 3 x 3 fuel pin lattice. Terrenus will be developed further to include (1) general geometry package support, allowing modeling of a spent nuclear fuel (SNF) cask with all structural details, (2) a depletion solver to determine the change in nuclide composition at the end of each time step, and (3) a mechanics code to determine any structural impact due to a criticality event. Future research and development works include identifying/developing a modern two-phase thermal-hydraulics code and developing an approach to solve fast neutronic transients. The goal of this multiphysics framework is to determine the feasibility of direct disposal of currently loaded SNF canisters by including or excluding a criticality event from a repository performance analysis framework in terms of consequences. The revision 1 to this report includes extending Terrenus to a 17 x 17 pressurized water reactor (PWR) fuel assembly. We also investigated the phenomena necessary to quench a critical reaction, and investigated the water level necessary to achieve criticality in a typical canister. Finally, we describe the initial implementation of a critical power search capability.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Source Range Detector Response Modeling using VERA

The CASL reactor simulation package VERA has been adapted to provide high-fidelity simulation capabilities for modeling source range detector response during subcritical reactor configurations. New features include the activation and shuffling of secondary source assemblies, transfer of burned fuel neutron emission data from the ORIGEN depletion solver to the MPACT deterministic neutron transport solver, allowance of user-defined sources in MPACT based on material composition, ability to solve the subcritical source-driven system with neutron multiplication using the MPACT diffusion solver, and transfer of the calculated fission source from MPACT to the continuous energy Monte Carlo solver Shift for final detector response evaluation. These new capabilities were benchmarked against Watts Bar Unit 1 plant operating data and found to be in very good agreement.

Gentry, Cole↗