LAMMPS and SPARTA: Performance Portability of Particle Methods Through Kokkos
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
In this talk we introduce Kynema, an open-source general flexible-multibody-dynamics solver that is well suited for simulating wind turbine structural dynamics. Kynema uses a Lie-group time integrator for constrained systems and runs on both CPUs and GPUs. Timing results for simulations are presented for the IEA 15-MW turbine with and without aerodynamic forces.
Activation detectors developed at LLNL for measuring real-time neutron fluence from fusion sources are used in the broader fusion community. The recommended fluence operating range of this diagnostic is 5x10 2 – 1x10 6 n/cm2. The upper limit on this fluence range is set by the dead time caused by data transfer between the detector and data acquisition computer. Delaying the start of counting is a possible strategy to operate these detectors in higher fluences.
Presentation on grad school work scaling FLARE with LAMMPS and Kokkos to trillion atoms
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Presentation at LAMMPS workshop, content identical to recently submitted paper IR 1786384
Explore the source record for details and available documents.
The goal of this project has been to develop a lossless compression algorithm for message-passing libraries that can accelerate HPC systems by reducing the communication time. Because both compression and decompression have to be performed in software in real time, the algorithm has to be extremely fast while still delivering a good compression ratio. During the first half of this project, they designed a new compression algorithm called FPC for scientific double-precision data, made the source code available on the web, and published two papers describing its operation, the first in the proceedings of the Data Compression Conference and the second in the IEEE Transactions on Computers. At comparable average compression ratios, this algorithm compresses and decompresses 10 to 100 times faster than BZIP2, DFCM, FSD, GZIP, and PLMI on the three architectures tested. With prediction tables that fit into the CPU's L1 data acache, FPC delivers a guaranteed throughput of six gigabits per second on a 1.6 GHz Itanium 2 system. The C source code and documentation of FPC are posted on-line and have already been downloaded hundreds of times. To evaluate FPC, they gathered 13 real-world scientific datasets from around the globe, including satellite data, crash-simulation data, and messages from HPC systems. Based on the large number of requests they received, they also made these datasets available to the community (with permission of the original sources). While FPC represents a great step forward, it soon became clear that its throughput was too slow for the emerging 10 gigabits per second networks. Hence, no speedup can be gained by including this algorithm in an MPI library. They therefore changed the aim of the second half of the project. Instead of implementing FPC in an MPI library, they refocused their efforts to develop a parallel compression algorithm to further boost the throughput. After all, all modern high-end microprocessors contain multiple CPUs on a single die and will undoubtedly contain even larger numbers of CPUs in the future. Hence, a compute node in a parallel system is likely to have multiple processors per interconnection link. Thus, they investigated how to best exploit multiple CPUs to compress and decompress data for a single link, i.e., they developed a parallel version of the FPC algorithm called pFPC. On a 4-core 3 GHz Xeon system, pFPC exceeds 10 gigabits per second both in compression and decompression throughput while still reaching a compression ratio of 18%, which is reasonable for their double-precision floating-point datasets. At half this throughput, it achieves a 41% compression ratio. Moreover, the algorithm scales well to four cores and promises even higher throughputs on larger machines. Additional results and a description of the pFPC algorithm have recently been published in the proceedings of the Data Compression Conference. The C source code of pFPC is also publicly available.
Event generators simulate particle interactions using Monte Carlo techniques, providing the primary connection between experiment and theory in experimental high energy physics. These software packages, which are the first step in the simulation worflow of collider experiments, represent approximately 5 to 20% of the annual WLCG usage for the ATLAS and CMS experiments. With computing architectures becoming more heterogeneous, it is important to ensure that these key software frameworks can be run on future systems, large and small. In this contribution, recent progress on porting and speeding up the Madgraph5_aMC@NLO event generator on hybrid architectures, i.e. CPU with GPU accelerators, is discussed. The main focus of this work has been in the calculation of scattering amplitudes and "matrix elements", which is the computational bottleneck of an event generation application. For physics processes limited to QCD leading order, the code generation toolkit has been expanded to produce matrix element calculations using C++ vector instructions on CPUs and using CUDA for NVidia GPUs, as well as using Alpaka, Kokkos and SYCL for multiple CPU and GPU architectures. Performance is reported in terms of matrix element calculations per time on NVidia, Intel, and AMD devices. The status and outlook for the integration of this work into a production release usable by the LHC experiments, with the same functionalities and very similar user interfaces as the current Fortran version, is also described.
An automated system is developed for optimizing the hydrogen generation in the hydrolysis of magnesium–nickel alloy in aqueous sodium-chloride solution and the catalytic hydrolysis of sodium borohydride.
The weak absorption spectra of isoprene and acetone have been measured in the wavelength range of 261–275 nm using cavity ringdown spectroscopy. The measured absorption cross-sections of isoprene in the wavelength region of 261–266 nm range from 3.65 ×10 –21 cm 2 ·molecule –1 at 261 nm to 1.42 × 10 –21 cm 2 ·molecule –1 at 266 nm; these numbers are in good agreement with the values reported in the literature. In the longer wavelength range of 270–275 nm, however, where attractive applications using a single wavelength compact diode laser operating at 274 nm is located, isoprene has been reported in the literature to have no absorption (too weak to be detected). Small absorption cross-sections of isoprene in this longer wavelength region are measured using cavity ringdown spectroscopy for the first time in this work, i.e., 6.20 ×10 –23 cm 2 ·molecule –1 at 275 nm. With the same experimental system, wavelength-dependent absorption cross-sections of acetone have also been measured. Theoretical detection limits of isoprene and comparisons of absorbance of isoprene, acetone, and healthy breath gas in this wavelength region are also discussed.
The quantification of methane concentrations in air is essential for the quantification of methane emissions, which in turn is necessary to determine absolute emissions and the efficacy of emission mitigation strategies. These are essential if countries are to meet climate goals. Large-scale deployment of methane analyzers across millions of emission sites is prohibitively expensive, and lower-cost instrumentation has been recently developed as an alternative. Currently, it is unclear how cheaper instrumentation will affect measurement resolution or accuracy. To test this, the Wireless Autonomous Transportable Methane Emission Reporting System (WATCH 4 ERS) has been developed, comprising four commercially available sensing technologies: metal oxide (MOx,), Non-dispersion Infrared (NDIR), integrated infrared (INIR), and tunable diode laser absorption spectrometer (TDLAS). WATCHERS is the accumulated knowledge of several long-term methane measurement projects at Colorado State University’s Methane Emission Technology Evaluation Center (METEC), and this study describes the integration of these sensors into a single unit and reports initial instrument response to calibration procedures and controlled release experiments. Specifically, this paper aims to describe the development of the WATCH 4 ERS unit, report initial sensor responses, and describe future research goals. Meanwhile, future work will use data gathered by multiple WATCH 4 ERS units to 1. better understand the cost–benefit balance of methane sensors, and 2. identify how decreasing instrumentation costs could increase deployment coverage and therefore inform large-scale methane monitoring strategies. Both calibration and response experiments indicate the INIR has little practical use for measuring methane concentrations less than 500 ppm. The MOx sensor is shown to have a logarithmic response to methane concentration change between background and 600 ppm but it is strongly suggested that passively sampling MOx sensors cannot respond fast enough to report concentrations that change in a sub-minute time frame. The NDIR sensor reported a linear change to methane concentration between background and 600 ppm, although there was a noticeable lag in reporting changing concentration, especially at higher values, and individual peaks could be observed throughout the experiment even when the plumes were released 5 s apart. The TDLAS sensor reported all changes in concentration but remains prohibitively expensive. Our findings suggest that each sensor technology could be optimized by either operational design or deployment location to quantify methane emissions. The WATCH4ERS units will be deployed in real-world environments to investigate the utility of each in the future.
We introduce an extension to the AthenaK code for general-relativistic magnetohydrodynamics (GRMHD) in dynamical spacetimes using a 3+1 conservative Eulerian formulation. Like the fixed-spacetime GRMHD solver, we use standard finite-volume methods to evolve the fluid and a constrained-transport scheme to preserve the divergence-free constraint for the magnetic field. We also utilize a first-order flux correction (FOFC) scheme to reduce the need for an artificial atmosphere and optionally enforce a maximum principle to improve robustness. We demonstrate the accuracy of AthenaK using a set of standard tests in flat and curved spacetimes. Using a SANE accretion disk around a Kerr black hole, we compare the new solver to the existing solver for stationary spacetimes using the so-called "HARM-like" formulation. We find that both formulations converge to similar results. We also include the first published binary neutron star (BNS) mergers performed on graphical processing units (GPUs). Thanks to the FOFC scheme, our BNS mergers maintain a relative error of $\mathcal{O}$(10 –11 ) or better in baryon mass conservation up to collapse. Finally, we perform scaling tests of AthenaK on OLCF Frontier, where we show excellent weak scaling of ≥80% efficiency up to 32,768 GPUs and 74% up to 65,536 GPUs for a GRMHD problem in dynamical spacetimes with six levels of mesh refinement. AthenaK achieves an order-of-magnitude speedup using GPUs compared to CPUs, demonstrating that it is suitable for performing numerical relativity problems on modern exascale resources.
Abstract. Ambient aerosol size distributions obtained with a compact scanning mobility analyzer, the “Spider” differential mobility analyzer (DMA), are compared to those obtained with a conventional mobility analyzer, with specific attention to the effect of mobility resolution on the measured size distribution parameters. The Spider is a 12 cm diameter radial differential mobility analyzer that spans the 10–500 nm size range with 30 s mobility scans. It achieves its compact size by operating at a nominal mobility resolution R=3 (sheath flow = 0.9 L min−1; aerosol flow = 0.3 L min−1) in place of the higher ratio of sheath flow to aerosol flow commonly used. The question addressed here is whether the lower resolution is sufficient to capture key characteristics of ambient aerosol size distributions. The Spider, operated at R=3 with 30 s up- and downscans, was co-located with a TSI 3081 long-column mobility analyzer, operated at R=10 with a 360 s sampling duty cycle. Ambient aerosol data were collected over 26 consecutive days of continuous operation, in Pasadena, CA. Over the 17–500 nm size range, the two instruments exhibit excellent correlation in the total particle number concentrations and geometric mean diameters, with regression slopes of 1.13 and 1.00, respectively. Our results suggest that particle sizing at a lower resolution than typically employed may be sufficient to obtain key properties of ambient size distributions, at least for these two moments of the size distribution. Moreover, it enables better counting statistics, as the wider transfer function for a given aerosol flow rate results in a higher counting rate.
Design for a modular display panel is based on a cross-shaped corner connector and wooden lattice bars. The bars are fitted into the arms of the metal connector and a pocket slot holds a modular-size panel.