Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “parallel simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

The impact of multi-sensor land data assimilation on river discharge estimation

River discharge is one of the most critical renewable water resources. Accurately estimating river discharge with land surface models (LSMs) remains challenging due to the difficulty in estimating land water storages such as snow, soil moisture, and groundwater. While data assimilation (DA) ingesting optical, microwave, and gravity measurements from space can help constrain theses storage states, its impacts on runoff and eventually river discharge are not fully understood. In this study, by taking advantage of recently published land DA results that jointly assimilate eight different combinations of observations from the Moderate Resolution Imaging Spectroradiometer (MODIS), Gravity Recovery and Climate Experiment (GRACE), and Advanced Microwave Scanning Radiometer for EOS (AMSR-E), we quantify to what degree multi-sensor land DA improves the river discharge simulation skills over 40 global river basins, and investigate the complementary strengths of different satellite measurements on river discharge. To be more specific, river discharge is updated by feeding gridded runoff from the eight multi-sensor DA simulations into a vector-based river routing model named the Routing Application for Parallel computatIon of Discharge (RAPID). Our modeling results, including 7-year simulations at 177,458 river reaches globally, are used to study the seasonal to interannual variability of river discharge. It is found that assimilating GRACE has the greatest impact on global runoff patterns, leading to the most pronounced improvements in spatial river discharge in the middle and high latitudes with the R 2 increased by 0.16. The seasonal variation of spatial discharge is most skillful during the boreal summer. However, our evaluation also shows model and DA still struggle to generate reasonable variability and averaged discharge over permafrost regions. Finally, by assessing how different satellites add value to discharge forecasts, this study paves the way for more advanced multi-sensor satellite data assimilation to predict the terrestrial hydrological cycle.

54 ENVIRONMENTAL SCIENCES↗

Numerical modeling of pedestal stability and broadband turbulence of wide-pedestal QH-mode plasmas on DIII-D

The wide-pedestal quiescent high confinement mode discovered on DIII-D in recent years is a stationary and quiescent H-mode (QH-mode) with the pedestal width exceeding EPED prediction by at least 25%. Its characteristics, such as low rotation, high energy confinement and edge localized mode-free operation, make it an attractive operation mode for future reactors. Linear and nonlinear simulations using BOUT++ reduced two fluid MHD models and awere carried out to investigate the bursty broadband turbulence often observed in the edge of wide-pedestal QH-mode plasmas. Two kinds of MHD-scale instabilities in different spatial locations within the pedestal were found in the simulations: one mild peeling–ballooning (PB) mode γ PB < 0.04ω A ) located near the minimum in E r</:sub> well propagating in ion diamagnetic drift direction; and one drift-Alfvén wave locates at smaller radius compared to E r</:sub> well propagating in the electron diamagnetic drift direction and unstable only when the parallel electron dynamics is included in the simulation. The coupling between drift wave and shear Alfvén wave provides a possible cause of the experimentally observed local profile flattening in the upper-pedestal. The rotation direction, mode location, as well as the wavenumber of these two modes from BOUT++ simulations agree reasonably well with the experimental measurements, while the lack of quantitative agreement is likely due to the lack of trapped electron physics in current fluid model. This work presents improved physics understanding of the pedestal stability and turbulence dynamics for wide-pedestal QH-mode.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Investigation of Cycle-to-Cycle Variations in Internal Combustion Engine Using Proper Orthogonal Decomposition

The understanding, modeling and control of the cycle-to-cycle variation (CCV) in the modern internal combustion engine (ICE) is a key scientific challenge to achieve stable engine operation. High CCV in the engine combustion chamber may contribute to partial burn, misfire and knock, which adversely affects the engine performance and may potentially damage the engine. The objective of the current study is to leverage high-fidelity numerical simulations to improve the understanding of the causes of CCV. Using the massively parallel code, Nek5000, multi-cycle, wall-resolved large-eddy simulations (LES) were performed for the General Motors (GM), Transparent Combustion Chamber (TCC-III) optical engine under motored operating conditions. Further, the large-scale structures of the in-cylinder flow were investigated using a triple proper orthogonal decomposition (POD) technique to explore the characteristics of different parts of the flow and their contributions to CCV. The kinetic energy of the subset of flow structures were determined and correlated between the intake and compression strokes. The insights from the analysis of the large-scale flow structures will be used to assist the development of improved engine designs with reduced CCV and enhance the engine performance.

33 ADVANCED PROPULSION SYSTEMS↗

Ion temperature anisotropy model with cross‐field drifts in the scrape‐off layer

Abstract An ion temperature anisotropy model including cross‐field drifts has been implemented in the 2D transport code UEDGE. Two ion temperature equations are solved in the model to give separate ion temperatures perpendicular and parallel to the magnetic field, which results in an additional mirror force for ion parallel transport and also leads to an additional curvature drift in the perpendicular direction. In our previous work, an ion temperature anisotropy model was implemented and applied to the full 2D version of UEDGE including recycled neutrals. The simulation results showed that the mirror force due to anisotropy reduces ion parallel flow velocity, however, the simulations were presented without cross‐field electric and magnetic drifts. Nevertheless, in present medium‐size tokamaks or future compact fusion devices, cross‐fields are important. In this work, the anisotropy model is extended to be compatible with the inclusion of cross‐field drifts. Preliminary results on comparison between the model solutions with and without cross‐field drifts are presented.

Zhao, Menglong↗

SERGHEI (SERGHEI-SWE) v1.0: a performance-portable high-performance parallel-computing shallow-water solver for hydrology and environmental hydraulics

The Simulation EnviRonment for Geomorphology, Hydrodynamics, and Ecohydrology in Integrated form (SERGHEI) is a multi-dimensional, multi-domain, and multi-physics model framework for environmental and landscape simulation, designed with an outlook towards Earth system modelling. At the core of SERGHEI's innovation is its performance-portable high-performance parallel-computing (HPC) implementation, built from scratch on the Kokkos portability layer, allowing SERGHEI to be deployed, in a performance-portable fashion, in graphics processing unit (GPU)-based heterogeneous systems. In this work, we explore combinations of MPI and Kokkos using OpenMP and CUDA backends. In this contribution, we introduce the SERGHEI model framework and present with detail its first operational module for solving shallow-water equations (SERGHEI-SWE) and its HPC implementation. This module is designed to be applicable to hydrological and environmental problems including flooding and runoff generation, with an outlook towards Earth system modelling. Its applicability is demonstrated by testing several well-known benchmarks and large-scale problems, for which SERGHEI-SWE achieves excellent results for the different types of shallow-water problems. Finally, SERGHEI-SWE scalability and performance portability is demonstrated and evaluated on several TOP500 HPC systems, with very good scaling in the range of over 20 000 CPUs and up to 256 state-of-the art GPUs.

58 GEOSCIENCES↗

Performance of explicit and IMEX MRI multirate methods on complex reactive flow problems within modern parallel adaptive structured grid frameworks

Large-scale multiphysics simulations are computationally challenging due to the coupling of multiple processes with widely disparate time scales. The advent of exascale computing systems exacerbates these challenges since these systems enable ever-increasing size and complexity. In recent years, there has been renewed interest in developing multirate methods as a means to handle the large range of time scales, as these methods may afford greater accuracy and efficiency than more traditional approaches of using implicit-explicit (IMEX) and low-order operator splitting schemes. However, to date there have been few performance studies that compare different classes of multirate integrators on complex application problems. In this work, we study the performance of several newly developed multirate infinitesimal (MRI) methods, implemented in the SUNDIALS solver package, on two reacting flow model problems built on structured mesh frameworks. The first model revisits prior work on a compressible reacting flow problem with complex chemistry that is implemented using BoxLib but where we now include comparisons between a new explicit MRI scheme with the multirate spectral deferred correction (SDC) methods in the original paper. The second problem uses the same complex chemistry as the first problem, combined with a simplified flow model, but runs at a large spatial scale where explicit methods become infeasible due to stability constraints. Two recently developed IMEX MRI multirate methods are tested. These methods rely on advanced features of the AMReX framework on which the model is built, such as multilevel grids and multilevel preconditioners. The results from these two problems show that MRI multirate methods can offer significant performance benefits on complex multiphysics application problems and that these methods may be combined with advanced spatial discretization to compound the advantages of both.

97 MATHEMATICS AND COMPUTING↗

Situational Awareness of Grid Anomalies (SAGA)

The modern power industry becomes more vulnerable to cyber events due to the growing interconnectivity, interdependence, and complexity of the electric power grid. High-fidelity modeling and simulation tools that support the preventative risk analysis on potential cyber-relevant events is essential for ensuring the situational awareness of the system operator as it provides an inexpensive and risk-free environment to test the system responses under various cyber-relevant events and hereby can support research on cyber anomaly detection, optimal protective resource allocation, and mitigation measures. In this webinar, we will share NREL's cybersecurity research capabilities by highlighting the development of a scalable cyber-physical event test bed and demonstration with real hardware in the loop. The developed cyber-physical event test bed is backboned by an integrated transmission, distribution, and communication dynamic co-simulation framework and a plug-and-play cyber event generation module. It is designed to be modular and compatible with parallel computing, and thereby supports large-scale system simulations at an affordable computation cost. The test bed can capture millisecond-to-minutes dynamic frequency and voltage responses under cyber events from the bulk transmission system to the active distribution systems and distributed energy resources at the grid edge.

co-simulation↗

Data and Scripts associated with “Lambda-PFLOTRAN: Workflow for Incorporating Organic Matter Chemistry Informed by Ultra High Resolution Mass Spectrometry into Biogeochemical Modeling.”

This data package is associated with the publication “Lambda-PFLOTRAN: Workflow for Incorporating Organic Matter Chemistry Informed by Ultra High Resolution Mass Spectrometry into Biogeochemical Modeling” submitted to Geoscientific Model Development (Muller et al., 2024). In this manuscript, organic matter chemistry and thermodynamics are directly connected to reactive transport simulators through the newly developed Lambda-PFLOTRAN (Parallel Reactive Flow and Transport model) workflow tool that succinctly incorporates organic matter chemistry data generated from Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) into reaction networks to simulate aerobic respiration of the organic matter and the resulting biogeochemistry. Lambda-PFLOTRAN is a python-based workflow, executed through a Jupyter Notebook interface, that digests raw FTICR-MS data, develops a representative reaction network based on substrate-explicit thermodynamic modeling (also termed lambda modeling due to its key thermodynamic parameter λ used therein), and completes a biogeochemical simulation with the open source, reactive flow, and transport code PFLOTRAN. This data package contains Jupyter Notebook based workflows for two test cases for running biogeochemical simulations of organic matter oxidation identified by FTICR-MS. It contains four primary folders (workflow, data, src, and analysis), a file-level metadata file (Muller_2024_Lambda_PFLOTRAN_Manuscript_Data_Package_flmd.csv) that lists all the files contained in this data package with a short description of each, and a data dictionary (Muller_2024_Lambda_PFLOTRAN_Manuscript_Data_Package_dd.csv) file that describes the tabular column headers. The ‘workflow’ folder contains the Jupyter Notebook based workflows for running the lambda analysis, PFLOTRAN simulation, sensitivity analysis and parameter estimation. The ‘data’ folder contains the FTICR-MS data, initial conditions, and incubation data for test cases 1 and 2 in folders titled ‘WHONDRS’ and ‘Colloids’, respectively. The data folder also has a ‘Database’ folder containing a reaction network for bulk organic matter (assumed to be CH2O) and a general database for PFLOTRAN (hanford_rxn_network). The CH2O reaction network defines bulk organic matter oxidation. Biogeochemical simulations are completed for both the lambda binned organic matter and bulk organic matter reaction networks. The ‘hanford_rxn_network’ database includes information required for PFLTORAN simulations including ion size, molar mass, and charge of the aqueous species, gases, and minerals phases. The ‘src’ folder contains python source codes for performing lambda analysis, PFLOTRAN simulation, sensitivity analysis and parameter estimation. The ‘analysis’ folder contains outputs from the test cases 1 and 2 including lambda analysis, PFLOTRAN runs and the calibration results.

54 ENVIRONMENTAL SCIENCES↗

Verification of electromagnetic simulation capabilities in global gyrokinetic particle-in-cell code GTS

Recently, the numerical scheme presented by Mishchenko et al. enabled explicit gyrokinetic simulations of low-frequency electromagnetic instabilities in tokamaks at experimentally relevant values of plasma β⁠. This scheme resolved the long-standing cancellation problem that previously hindered gyrokinetic particle-in-cell code simulations of magnetohydrodynamic phenomena with inherently small parallel electric fields. Moreover, the scheme did not employ approximations that eliminate critical tearing-type instabilities. Here, we report on the implementation of this numerical scheme in the global gyrokinetic particle-in-cell code GTS. This implementation allows for a more complete and accurate picture of interaction between small scale turbulence and MHD modes in tokamaks. Additionally, we present a comprehensive set of verification simulations of numerous electromagnetic instabilities relevant to present-day tokamaks. These simulations encompass the kinetic ballooning mode, the internal kink mode, the tearing mode, the micro-tearing mode, and the toroidal Alfven eigenmode destabilized by energetic ions, which are all instrumental in understanding tokamak physics. We will also showcase the preliminary nonlinear simulations of kinetic ballooning instabilities and (2,1) island formation due to tearing mode instability. These simulations validate the accuracy of the scheme implementation and pave the way for studying how these instabilities affect plasma confinement and performance.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Parallel algorithms for hyperdynamics and local hyperdynamics

Hyperdynamics (HD) is a method for accelerating the timescale of standard molecular dynamics (MD). It can be used for simulations of systems with an energy potential landscape that is a collection of basins, separated by barriers, where transitions between basins are infrequent. HD enables the system to escape from a basin more quickly while enabling a statistically accurate renormalization of the simulation time, thus effectively boosting the timescale of the simulation. In [Kim, Perez, Voter, J Chem Phys, 139:144110, 2013)1, a local version of HD was formulated, which exploits the intrinsic locality characteristic typical of most systems to mitigate the poor scaling properties of standard HD as the system size is increased. In this paper, we discuss how both HD and local HD can be formulated to run efficiently in parallel. We have implemented these ideas in the LAMMPS MD code, which means HD can be used with any interatomic potential LAMMPS supports. Together, these parallel methods allow simulations of any size to achieve the time acceleration offered by HD (which can be orders of magnitude), at a cost 3-5x that of standard MD. As examples, we performed two simulations of a million-atom system to model the diffusion and clustering of Pt adatoms on a large patch of Pt(100) surface for 80 and 160 μs.

74 ATOMIC AND MOLECULAR PHYSICS↗

Nonresonant particle acceleration in strong turbulence: Comparison to kinetic and MHD simulations

Collisionless, magnetized turbulence offers a promising framework for the generation of nonthermal high-energy particles in various astrophysical sites. Yet, the detailed mechanism that governs particle acceleration has remained subject to debate. By means of 2D and 3D particle-in-cell, as well as 3D (incompressible) magnetohydrodynamic (MHD) simulations, we test here a recent model of nonresonant particle acceleration in strongly magnetized turbulence, which ascribes the energization of particles to their continuous interaction with the random velocity flow of the turbulence, in the spirit of the original Fermi model. To do so, we compare, for a large number of particles that were tracked in the simulations, the predicted and the observed histories of particles momenta. The predicted history is that derived from the model, after extracting from the simulations, at each point along the particle trajectory, the three force terms that control acceleration: the acceleration of the field line velocity projected along the field line direction, its shear projected along the same direction, and its transverse compressive part. Overall, we find a clear correlation between the model predictions and the numerical experiments, indicating that this nonresonant model can successfully account for the bulk of particle energization through Fermi-type processes in strongly magnetized turbulence. Additionally we also observe that the parallel shear contribution tends to dominate the physics of energization in the particle-in-cell simulations, while in the magnetohydrodynamic incompressible simulation, both the parallel shear and the transverse compressive term provide about equal contributions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

TOUGH3-FLAC3D: a modeling approach for parallel computing of fluid flow and geomechanics

The recent development of the TOUGH3 code allows for a faster and more reliable fluid flow simulator. At the same time, new versions of FLAC3D are released periodically, allowing for new features and faster execution. In this paper, we present the first implementation of the coupling between TOUGH3 and FLAC3Dv6/7, maintaining parallel computing capabilities for the coupled fluid flow and geomechanical codes. We compare the newly developed version with analytical solutions and with the previous approach, and provide some performance analysis on different meshes and varying the number of running processors. Finally, we present two case studies related to fault reactivation during CO 2 sequestration and nuclear waste disposal. The use of parallel computing allows for meshes with a larger number of elements, and hence more detailed understanding of thermo-hydro-mechanical processes occurring at depth.

58 GEOSCIENCES↗

NWChem: Past, present, and future

Specialized computational chemistry packages have permanently reshaped the landscape of chemical sciences by providing tools to support and guide the experimental effort and for prediction of chemical and materials properties. In this regard, a special role has been played by electronic structure packages where complex chemical and materials processes can be modeled using first-principle-driven methodologies. Over the last few decades, the rapid development of computing technologies and a tremendous increase in computational power has offered a unique chance to study complex chemical transformations using sophisticated and predictive many-body techniques to describe correlated behavior of electrons in molecular and condensed phase systems at different levels of theory. In enabling these simulations, a critical role has been played by novel parallel algorithms capable of taking advantage of computational resources to address polynomial scaling of electronic structure methods. NWChem was among the first electronic structure codes that focused on delivering scalable performance for electronic structure simulations. Herein, we briefly review the NWChem suite of computational codes including its history, design principles, parallel tools, current capabilities, outreach and outlook.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dayflow: CONUS Daily Streamflow Reanalysis, Version 1 (V1)

Dayflow V1 is a historical streamflow reanalysis dataset reconstructed for a 36-year period (1980-2015). The dataset provides both daily and monthly scale streamflow information at about 2.7 million NHDPlusV2 stream reaches in the conterminous US (CONUS). Dayflow is the result of a nationally scalable modeling framework that integrates the simulated runoff from the Variable Infiltration Capacity (VIC) model with the Routing Application for Parallel computatIon of Discharge (RAPID) routing model. Two types of streamflow products, simulated streamflow with or without assimilation of historic US Geological Survey (USGS) streamflow observations, are provided in Dayflow V1. A comprehensive evaluation at 7,526 USGS National Water Information System (NWIS) gauges is performed for both types of streamflow products. The resulting key evaluation metrics are also included in the Dayflow V1 Dataset.

13 HYDRO ENERGY↗

PySAGES: flexible, advanced sampling methods accelerated with GPUs

Abstract Molecular simulations are an important tool for research in physics, chemistry, and biology. The capabilities of simulations can be greatly expanded by providing access to advanced sampling methods and techniques that permit calculation of the relevant underlying free energy landscapes. In this sense, software that can be seamlessly adapted to a broad range of complex systems is essential. Building on past efforts to provide open-source community-supported software for advanced sampling, we introduce PySAGES, a Python implementation of the Software Suite for Advanced General Ensemble Simulations (SSAGES) that provides full GPU support for massively parallel applications of enhanced sampling methods such as adaptive biasing forces, harmonic bias, or forward flux sampling in the context of molecular dynamics simulations. By providing an intuitive interface that facilitates the management of a system’s configuration, the inclusion of new collective variables, and the implementation of sophisticated free energy-based sampling methods, the PySAGES library serves as a general platform for the development and implementation of emerging simulation techniques. The capabilities, core features, and computational performance of this tool are demonstrated with clear and concise examples pertaining to different classes of molecular systems. We anticipate that PySAGES will provide the scientific community with a robust and easily accessible platform to accelerate simulations, improve sampling, and enable facile estimation of free energies for a wide range of materials and processes.

Chemistry↗

Effect of Anoxic Iron Corrosion on WIPP Brine Geochemistry FY23 Final Report (U)

A 280-day study was completed to evaluate the effect of zero-valent iron (Fe 0 ) on the Waste Isolation Pilot Plant (WIPP) brine geochemistry under anticipated reducing conditions. Hydrogen (H 2 ) gas is expected to be present in the repository after closure due to the anoxic corrosion of a vast quantity of iron contained in the waste forms disposed at WIPP; therefore, a background argon atmosphere containing H 2 was chosen for this study. WIPP groundwater brine pH and E h will impact the mobility and fate of plutonium within the repository. Modeling and laboratory results for Castile WIPP brine indicate that equilibrium fa values relative to the standard hydrogen electrode (SHE) are 40 mV more reducing (i.e., more negative) than those for Salado WIPP brine (-480 mV vs. -440 mV, respectively) because of the higher pH of the Castile brine (pH 9 .3 for Castile vs. pH 8.8 for Salado). The E h and pH data were corrected for the effects of high ionic strength. The experimental results for both brines are consistent with thermodynamic predictions using OLI Systems' Mixed Solvent Electrolyte chemical equilibrium model. The measured and corrected pH and E h data from this study are provided in Table ES-I and Table ES-2, respectively. The experimental study, with four test conditions in triplicate, was performed in a dual glovebox with a nominally 3 vol.% H 2 in argon atmosphere (target H 2 range: 3 ± I vol.%). Simulants containing MgO only ( experimental control) and MgO+Fe 0 (WIPP base case) were prepared for both the Salado and Castile brines. MgO was included in all simulants to account for the use of bulk magnesium oxide in the WIPP repository. Fe 0 was included in some simulants to incorporate the effects of the anoxic corrosion of iron and in-situ hydrogen generation in the study. The brine compositions were developed by Sandia National Laboratory (SNL; Xiong, 2008) and have been used in previous WIPP evaluations. The test method (agitation, etc.) is partially based on ASTM D3987-12. Twelve rounds of periodic measurements of pH and E h were performed over the course of the study. Chemical analysis results for liquids and solids (ICP-MS, ICP-ES, IC Anion, TIC, SEM-EDX) are consistent with the pH, E h , and thermodynamic modeling results. This study included the following conditions that deviate from anticipated post-closure conditions following brine intrusion, but were selected to facilitate bench-scale testing to validate modeling of pH and E h for the post-closure WIP P repository: an anoxic glove box atmosphere containing ≤ 4 vol. % H 2 vs. substantially higher H 2 gas concentrations assumed in the WIPP Performance Assessment (PA); a significantly higher liquid-to-solid test ratio compared to the much lower phase ratio anticipated in the WIP P repository; agitation of the simulant bottles to maximize mass transfer; and finally the use of Fe 0 reagents having a much greater surface area than expected in the WIP P repository. Non-representative conditions were chosen for various reasons such as: to provide bounding conservative results, to provide a margin of safety for testing, or to facilitate simulant sub-sampling and analysis. In a parallel effort, aqueous electrolyte thermodynamic models were developed for the synthetic Salado and Castile brines to inform the experimental design, facilitate laboratory data interpretation, and allow extension of evaluations beyond the parameters tested. Thermodynamic modeling simulations including the MgO and Fe 0 additives that are directly relevant to the experimental measurements (e.g., pH calibration curve, ORP corrections) are included in this report. The measured fa of the simulants was close to the OLI model predictions for both brines and was largely controlled by the background H 2 partial pressure in the vapor phase as well as H 2 generated in situ in the aqueous phase by the Fe 0 corrosion. The H 2 gas-phase concentration tested and thermodynamically evaluated was much lower than is assumed in the WIPP PA; however, H 2 (g) concentrations significantly below this level are still predicted to result in very reducing conditions. In conclusion: • The experimental results are consistent with thermodynamic model predictions for fa, pH, and the effects of high ionic strength. • Evidence to date suggests that the H2 concentration in the glovebox atmosphere ultimately determined the final E h values of the simulants and resulted in highly reducing conditions. As a result, little difference was observed between the control simulants containing only MgO and the WIPP base-case simulants that contained MgO and Fe 0 . • This test methodology is recommended for future studies evaluating WIPP repository conditions. The methodology includes: (1) background H 2 in argon with agitation ( or could alternatively include in-situ-generated H 2 in sealed bottles); (2) carefully measured and corrected ORP data ( with much effort focused on allowing the probes to fully stabilize); and (3) ionic-strength-corrected pH data. Other best practices, such as simulant sparging/handling, ORP probe replacement, etc., should also be considered. • The coupling of experimental studies and thermodynamic modeling is also highly recommended because these methods inform and direct one another leading to greater confidence in and understanding of the results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

CaTS: Integration of Geant4 and Opticks

CaTS [6]is an advanced example that is part of Geant4 since version 11.0. It demonstrates the use of Opticks to offload the simulation of optical photons to GPUs. Opticks interfaces with the Geant4 toolkit to collect all the necessary information to generate and trace optical photons, re-implements the optical physics processes to be run on the GPU, and automatically translates the Geant4 geometry into a GPU appropriate format. To trace the photons, Opticks uses NVIDIA OptiX®. In this report, we describe CaTS and the integration of Opticks with Geant4. We demonstrate that the generation and tracing of optical photons represents an ideal application to be offloaded to GPUs, fully utilizing the high degree of available parallelism. In a typical liquid argon TPC simulation, a speedup of several hundred times is observed compared to an equivalent simulation using single threaded Geant4.

Wenzel, Hans↗

Massively parallel transport sweeps on meshes with cyclic dependencies

When solving the first-order form of the linear Boltzmann equation, a common misconception is that the matrix-free computational method of “sweeping the mesh”, used in conjunction with the Discrete Ordinates method, is too complex or does not scale well enough to be implemented in modern high performance computing codes. This has led to considerable efforts in the development of matrix-based methods that are computationally expensive and is partly driven by the requirements placed on modern spatial discretizations. In particular, modern transport codes are required to support higher order elements, a concept that invariably adds a lot of complexity to sweeps because of the introduction of cyclic dependencies with curved mesh cells. In this article we will present a comprehensive implementation of sweeping, to a piecewise-linear DFEM spatial discretization with particular focus on handling cyclic dependencies and possible extensions to higher order spatial discretizations. We find that these methods are implemented in a new C++ simulation framework called Chi-Tech (). We present some typical simulation results with some performance aspects that one can expect during real world simulations, we also present a scaling study to >100k processes where Chi-Tech maintains greater than 80% efficiency solving a total of 87.7 trillion angular flux unknowns for a 116 group simulation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗