Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “accelerated computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Using Numba for GPU acceleration of Neutron Beamline Digital Twins

Digital twins of neutron instruments using Monte Carlo ray tracing have proven to be useful in neutron data analysis and verifying instrument and sample designs. However, these simulations can become quite complex and computationally demanding with tens of billions of neutrons. In this paper, we present a GPU accelerated version of MCViNE using Python and Numba to balance user extensibility with performance. Numba is an open-source just-in-time (JIT) compiler for Python using LLVM to generate efficient machine code for CPUs and GPUs with NVIDIA CUDA. The JIT nature of Numba allowed complex instrument kernels to be generated easily. Initial simulations have shown a speedup between 200-1000x over the original CPU implementation. The performance gain with Numba enables more sophisticated data analysis and impacts neutron scattering science and instrument design.

Kendrick, Coleman↗

Multinode Multi-GPU Two-Electron Integrals: Code Generation Using the Regent Language

The computation of two-electron repulsion integrals (ERIs) is often the most expensive step of integral-direct self-consistent field methods. Formally it scales as O(N 4 ), where N is the number of Gaussian basis functions used to represent the molecular wave function. In practice, this scaling can be reduced to O(N 2 ) or less by neglecting small integrals with screening methods. The contributions of the ERIs to the Fock matrix are of Coulomb (J) and exchange (K) type and require separate algorithms to compute matrix elements efficiently. We previously implemented highly efficient GPU-accelerated J-matrix and K-matrix algorithms in the electronic structure code TeraChem. Although these implementations supported the use of multiple GPUs on a node, they did not support the use of multiple nodes. This presents a key bottleneck to cutting-edge ab initio simulations of large systems, e.g., excited state dynamics of photoactive proteins. We present our implementation of multinode multi-GPU J- and K-matrix algorithms in TeraChem using the Regent programming language. Regent directly supports distributed computation in a task-based model and can generate code for a variety of architectures, including NVIDIA GPUs. We demonstrate multinode scaling up to 45 GPUs (3 nodes) and benchmark against hand-coded TeraChem integral code. Finally, we also outline our metaprogrammed Regent implementation, which enables flexible code generation for integrals of different angular momenta.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

AI-enhanced Codesign for Next-Generation Neuromorphic Circuits and Systems

This report details work that was completed to address the Fiscal Year 2022 Advanced Science and Technology (AS&T) Laboratory Directed Research and Development (LDRD) call for “AI-enhanced Co-Design of Next Generation Microelectronics.” This project required concurrent contributions from the fields of 1) materials science, 2) devices and circuits, 3) physics of computing, and 4) algorithms and system architectures. During this project, we developed AI-enhanced circuit design methods that relied on reinforcement learning and evolutionary algorithms. The AI-enhanced design methods were tested on neuromorphic circuit design problems that have real-world applications related to Sandia’s mission needs. The developed methods enable the design of circuits, including circuits that are built from emerging devices, and they were also extended to enable novel device discovery. We expect that these AI-enhanced design methods will accelerate progress towards developing next-generation, high-performance neuromorphic computing systems.

42 ENGINEERING↗

ORCHA: A performance portability system for extreme heterogeneity

Heterogeneity is the prevalent trend in the rapidly evolving high-performance computing (HPC) landscape in both hardware and application software. The diversity in hardware platforms, currently comprising various accelerators and a future possibility of specializable chiplets, poses a significant challenge for scientific software developers aiming to harness optimal performance across different computing platforms while maintaining the quality of solutions when their applications are simultaneously growing more complex. Code synthesis and code generation can provide mechanisms to mitigate this challenge. We have developed a divide and conquer approach where different aspects of performance are handled by different stand-alone tools that are interfaced with the application through generated code. This portability system, ORCHA, enables users to configure and orchestrate their computations among available resources on a platform by specifying a high-level recipe, thereby permitting a many-to-many paradigm where each recipe results in a different variant of the application. The core design goal is to let users decide the application’s hardware mapping and orchestration by editing only the high-level recipe—without modifying the maintained source code or binding the application to a particular runtime system. Tools in ORCHA distribution are: CG-Kit for translating the recipe into an execution graph; Milhoja to execute the graph by orchestrating data and task movement among hardware resources; and Macroprocessor that enables users to define their own code-shorthand for higher composability and easier management of code variants. Additionally, the design of ORCHA permits tools to work in a plug-and-play mode where the application can build and run without CG-Kit and Milhoja, and either tool can be swapped out for other tools with similar capabilities by modifying the code generation portion of ORCHA. In this paper, we describe the design of ORCHA and the role that code-generation plays in isolating applications from tools. We demonstrate the breadth of configurations ORCHA enables with a case study in which an application configuration is realized on three distinct hardware mappings—a GPU-centric, a CPU/GPU balanced, and a CPU/GPU concurrent layouts by using different recipes.

Lee, Youngjun↗

Accelerating $\mathrm{LHC}$ event generation with simplified pilot runs and fast $\mathrm{PDF}$s

Poor computing efficiency of precision event generators for LHC physics has become a bottleneck for Monte-Carlo event simulation campaigns. We provide solutions to this problem by focusing on two major components of general-purpose event generators: The PDF evaluator and the matrix-element generator. For a typical production setup in the ATLAS experiment, we show that the two can consume about 80% of the total runtime. Using NLO simulations of pp→ℓ + ℓ - +jets and pp→$t\bar{t}$+jets as an example, we demonstrate that the computing footprint of LHAPDF and SHERPA can be reduced by factors of order 10, while maintaining the formal accuracy of the event sample. The improved codes are made publicly available.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Strategies for Computer-Aided Discovery of Novel Open-Shell Polymers

Organic π-conjugated polymers with a triplet ground state have been the focus of recent research for their interesting and unique electronic properties, arising from the presence of the two unpaired electrons. These compounds are usually built from alternating electron-donating and electron-accepting monomer pairs which lower the HOMO–LUMO gap and yield a triplet state instead of the typical singlet ground state. In this paper, we use density functional theory calculations to explore the design rules that govern the creation of a ground-state triplet conjugated polymer and find that a small HOMO–LUMO gap in the singlet state is the best predictor for the existence of a triplet ground state, compared to previous use of a pro-quinoidal bonding character. Furthermore, this work can accelerate the discovery of new stable triplet materials by reducing the computational resources needed for electronic-state calculations and the number of potential candidates for synthesis.

36 MATERIALS SCIENCE↗

Computational simulations and beamline optimizations for an electron beam degrader at CEBAF

An electron beam degrader is under development with the objective of measuring the transverse and longitudinal acceptance of the Continuous Electron Beam Accelerator Facility (CEBAF) at Jefferson Lab. This project is in support of the CE+BAF positron capability. Computational simulations of beam-target interactions and particle tracking were performed integrating the GEANT4 and Elegant toolkits. A solenoid was added to the setup to control the beam's divergence. Parameter optimization of the solenoid field and magnetic quadrupoles gradient was also performed to further reduce particle loss through the rest of the injector beamline.

Lizárraga-Rubio, V.↗

Convergence in nonlinear laser wakefield accelerators modeling in a Lorentz-boosted frame

Laser wakefield acceleration modeling using the Lorentz-boosted frame technique in the particle-in-cell code has demonstrated orders of magnitude speedups. A convergence study was previously conducted in cases with external injection in the linear regime and without injection in the nonlinear regime, and the obtained results have shown a convergence within the percentage level. Here, a convergence study is carried out to model electron self-injection in a 2D–3V configuration. It is observed that the Lorentz-boosted frame technique is capable of modeling complex particle dynamics with a significant speedup. This result is crucial to curtail the computational time of the modeling of future chains of laser wakefield accelerator stages with high accuracy.

43 PARTICLE ACCELERATORS↗

ExaSGD: 2022 Kernel Thrust Activities

The Kernel Thrust milestone ADSE22-407 covers the development of device-capable optimization algorithms and solvers technologies required by the ExaSGD project’s software stack in order to solve security-constrained alternating current optimal power flow (SC-ACOPF) problems on emerging exascale architectures. To this extent, in FY22 the main objective of the Kernel Thrust was (i) provide sparse optimization solver that runs efficiently on hardware accelerator devices (i.e., NVIDIA and AMD GPUs) to perform intra-node computations, (ii) strengthen the reliability and increase the performance of the mixed-dense sparse (MDS) solver of HiOp for deployment on the FY22 target architectures, Summit and Crusher, and (iii) increase performance by improving the mathematical algorithm and refining the parallel MPI-based implementation of the coarse-grain parallel solver HiOp-PriDec for capabilities deployment on the FY22 target architectures, Summit and Crusher. This document presents the developments and contributions done by the Kernels Thrust Team in FY22 toward completion of the above-mentioned objectives. These contributions progressed along four main development (sub)thrusts: (1) Design and implementation of a sparse optimization solver for use on hardware accelerators; (2) Improvement of the mathematical algorithm and of the parallel implementation of HiOp-PriDec to ensure readiness and efficient coarse-grain parallelism for FY23 target exascale machine; and (3) Support Software and Application Development Thrusts of the exaSGD project in their deployment of the project’s software stack on AMD- and NVIDIA-based architectures. The development of the sparse optimization solver (thrust 1 above) was new in FY22 and resulted in a new sparse solver in HiOp (available as of version 0.6). The second development thrust was a continuation of the efforts from FY21 and improved the mathematical algorithm and the communication strategy of the HiOp-PriDec solver. The last developement thrust is a large collaborative effort. Namely, the project’s teams from multiple labs (LLNL, PNNL, ORNL, and NREL) performed large-scale demonstration of the ExaSGD software stack, namely the optimization solvers of HiOp interfaced with the modeling front-end ExaGO and the stochastic sampler PowerScenarios. These demonstration efforts solved large-scale instances of the SC-ACOPF challenge problem of medium network sizes (10, 000-bus system) and large number of contingencies on Summit (NVIDIA accelerators) and Crusher (AMD accelerators) systems at ORNL.

97 MATHEMATICS AND COMPUTING↗

Accelerating transients with NekRS: GPU overlapping domain implementation and multi-rate timestepping

The simulation of nuclear transients using Computational Fluid Dynamics (CFD) presents significant computational challenges due to the inherent complexity and the wide separation in temporal scales between various flow physical phenomena. These disparities lead to high computational costs, often making the simulation of transients impractical without advanced techniques. Consequently, multiple research initiatives are being pursued by the NEAMS thermal-hydraulic area, some driven by academic institutions and some by national laboratories. Overall, they are exploring novel methods to make transient simulations more feasible and efficient. This report delves into recent advancements within the CFD code NekRS, specifically those achieved in Fiscal Year 2024 under the CONNECT effort, aimed at improving the performance and feasibility of transient simulations. The first major advancement involves the porting of NekRS to Aurora, one of the Department of Energy’s (DOE) most powerful supercomputers. Additionally, the report discusses the implementation of an overlapping domain capability within NekRS. This novel GPU-accelerated capability allows different spatial regions of the domain to be solved independently, enhancing the code’s efficiency, particularly when running large-scale simulations in complex domains. The scalability of this approach is demonstrated, highlighting its potential to transform how transients are approached in CFD simulations. Lastly, the report focuses on how this overlapping domain capability specifically accelerates transient simulations through multi-rate timestepping. By decoupling different regions and facilitating faster computations, this method offers a promising pathway to making nuclear transient simulations more computationally feasible, addressing one of the critical bottlenecks in the field. Together, these advancements represent a significant leap forward in transient simulation technology, bringing closer the possibility of handling highly complex nuclear scenarios with greater efficiency and accuracy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Celeritas: Accelerating Geant4 with GPUs

Celeritas [1] is a new Monte Carlo (MC) detector simulation code designed for computationally intensive applications (specifically, High Lumi- nosity Large Hadron Collider (HL-LHC) simulation) on high-performance heterogeneous architectures. In the past two years Celeritas has advanced from prototyping a GPU-based single physics model in infinite medium to implementing a full set of electromagnetic (EM) physics processes in complex geometries. The current release of Celeritas, version 0.3, has incorporated full device-based navigation, an event loop in the presence of magnetic fields, and detector hit scoring. New functionality incorporates a scheduler to offload electromagnetic physics to the GPU within a Geant4-driven simulation, enabling integration of Celeritas into high energy physics (HEP) experimental frameworks such as CMSSW. On the Summit supercomputer, Celeritas performs EM physics between 6 and 32 faster using the machine’s Nvidia GPUs compared to using only CPUs. When running a multithreaded Geant4 ATLAS test beam application with full hadronic physics, using Celeritas to accelerate the EM physics results in an overall simulation speedup of 1.8–2.3× on GPU and 1.2× on CPU.

Johnson, Seth R.↗

Genomic materials design: CALculation of PHAse Dynamics

The CALPHAD system of fundamental phase-level databases, now known as the Materials Genome, has enabled a mature technology of computational materials design and qualification that has already met the acceleration goals of the national Materials Genome Initiative. Here, as first commercialized by QuesTek Innovations, the methodology combines efficient genomic-level parametric design of new material composition and process specifications with multidisciplinary simulation-based forecasting of manufacturing variation, integrating efficient uncertainty management. Recent projects demonstrated under the multi-institutional CHiMaD Design Center notably include novel alloys designed specifically for additive manufacturing. With the proven success of the CALPHAD-based Materials Genome technology, current university research emphasizes new methodologies for affordable accelerated expansion of more accurate CALPHAD databases. Rapid adoption of these new capabilities by US apex corporations has compressed the materials design and development cycle to under 2 years, enabling a new “materials concurrency” integrated into a new level of concurrent engineering supporting an unprecedented level of manufacturing innovation.

36 MATERIALS SCIENCE↗

Parallel sorting algorithm classification: is manual instrumentation necessary?

Understanding parallel algorithms is crucial for accelerating scientific simulations on complex, distributed memory, high-performance computers. Modern algorithm classification approaches learn semantics directly from source code to differentiate between algorithms, however, accessing source code is not always possible. We can learn about parallel algorithms from observing their performance, as programs running the same algorithms and using the same hardware should exhibit similar performance characteristics. We present an approach to learn algorithm classes from parallel performance data directly in order to classify algorithms without access to the source code. We extend previous work to enable classifying parallel sorting algorithms using automatic instrumentation instead of requiring manual region annotations in the source code. In this work, we design and demonstrate a study for classification of parallel sorting algorithms using parallel performance data collected from automatic instrumentation, and evaluate the performance of our new methodology on classification. We leverage Caliper to collect the performance data, Thicket for our exploratory data analysis (EDA), and PyTorch and Scikit-learn to evaluate the effectiveness of random forests, support vector machines (SVMs), decision trees, neural networks, and logistic regressions on parallel performance data. Additionally, we study noise in parallel performance data, whether the removal of noise and pre-processing of the data is necessary to accurately classify parallel sorting algorithms, and determine the effectiveness of features created from performance data. In conclusion, we demonstrate classification accuracy for these five different models of up to 97.7% across four different parallel algorithm classes.

Algorithm Classification↗

Semi-Automated Creation of Density Functional Tight Binding Models through Leveraging Chebyshev Polynomial-Based Force Fields

Density functional tight binding (DFTB) is an attractive method for accelerated quantum simulations of condensed matter due to its enhanced computational efficiency over standard density functional theory (DFT) approaches. However, DFTB models can be challenging to determine for individual systems of interest, especially for metallic and interfacial systems where different bonding arrangements can lead to significant changes in electronic states. In this regard, we have created a rapid-screening approach for determining systematically improvable DFTB interaction potentials that can yield transferable models for a variety of conditions. Our method leverages a recent reactive molecular dynamics force field where many-body interactions are represented by linear combinations of Chebyshev polynomials. This allows for the efficient creation of multi-center representations with relative ease, requiring only a small investment in initial DFT calculations. Here, we have focused our workflow on TiH 2 as a model system and show that a relatively small training set based on unit-cell-sized calculations yields a model accurate for both bulk and surface properties. Our approach is easy to implement and can yield reliable DFTB models over a broad range of thermodynamic conditions, where physical and chemical properties can be difficult to interrogate directly and there is historically a significant reliance on theoretical approaches for interpretation and validation of experimental results.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Boosting Photoelectric Conductivity in Porphyrin-Based MOFs Incorporating C 60

Electronic structure calculations show that guest C60 in the porphyrin-containing metal organic frameworks Zn 2 (TCPB)(DA-ZnP) (DA-MOF; H 4 TCPB = 1,2,4,5-tetrakis(4-carboxyphenyl)benzene, DA-ZnP = [5,15-bis[(4-pyridyl)ethynyl]-10,20-diphenylporphinato]zinc(II)) and Zn 2 (TCPB)(F-ZnP) (F-MOF; F-ZnP = [5,15-di(4-pyridyl)-10,20-bis(pentafluorophenyl)porphinato]zinc(II)) engenders high photoelectrical conductivity due to efficient donor–acceptor charge-transfer (CT) interactions. Structural modifications at the meso position of the porphyrin influence the preferred positions of C 60 within the frameworks, giving rise to host–guest interactions with different anisotropic structural, electronic, and optoelectronic properties. A preferred slipped-parallel π-stacked interaction of C 60 that is predicted for NH 2 -substituted DA-MOF and F-MOF fosters strong CT transitions and lowers band gaps by ~1.0 eV compared to the pristine DA-MOF and F-MOF. Hopping rates computed using Marcus theory are found to be anisotropic and accelerated by multiple orders of magnitude across π-stacked interfaces created by C 60 incorporation, a consequence of strong electronic coupling between initial and final diabatic states. Calculations indicate that photoinduced electron transfer, as well as direct CT from porphyrin to C 60 upon irradiation, triggers a charge separation process that leads to the formation of what should be long-lived electron-trapped states at the heterojunctions. Lastly, design principles revealed here for the control of photophysical and electron-transfer processes will be useful for constructing new MOF-derived visible- and infrared-based optoelectronics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Two–Dimensional Idealized Hadley Circulation Simulation for Global High Resolution Model Development

A new framework for the development of global high resolution models using a vertical- meridional, two-dimensional pole-to-pole domain is proposed. Compared with the three-dimensional global model, the two-dimensional framework can simulate cloud-scale convection at significantly reduced computational cost, data volume, and turn-around time, and accelerate the development phase. Although idealized, it allows for simulation of various clouds and scale interactions under a wide range of environmental conditions, even though zonal waves such as mid latitude storms cannot be simulated. Physics schemes can be tested and assessed over a full array of simultaneously occurring cloud regimes. The framework can serve as an intermediate step between a one-dimensional simulation and a full three-dimensional global model. Using this framework, we analyze the resolution dependencies of simulated clouds and the Hadley circulation in a range of global high resolution models by performing multiple 1000-day simulations; for some resolutions tested, for example, 2 km horizontal resolution, three-dimensional simulation is not feasible at the present time. Analysis shows that both horizontal and vertical resolution determine the properties of the Hadley circulation and clouds, and that the differences among the simulated Hadley circulations are understood as differences in scale interactions influenced by resolution.

54 ENVIRONMENTAL SCIENCES↗

Robust method for broadband efficiency enhancement of electron photocathodes using optical interferences

In this work, we demonstrate the key features of an interference cathode using both simulations and experiments. We deposit Cs 3 Sb photocathodes on Ag to produce an interference enhanced photocathode with 2–5× quantum efficiency (QE) enhancement using a robust procedure that requires only a smooth metal substrate and QE monitoring during growth. We grow both an interference cathode (Ag substrate) and a typical photocathode (Si reference substrate) simultaneously to confirm that the effects are due to optical interactions with the substrate rather than photocathode composition or surface electron affinity differences. Growing the cathodes until the QE converges shows both the characteristic interference peaks during growth and the identical limiting case where the cathode is “infinitely thick,” in agreement with simulations. We also grow a cathode until the QE on Ag peaks and then stop the growth, demonstrating broadband QE enhancement.

36 MATERIALS SCIENCE↗

Tuning microwave losses in superconducting resonators

Abstract The performance of superconducting resonators, particularly cavities for particle accelerators and micro cavities and thin film resonators for quantum computations and photon detectors, has been improved substantially by recent material treatments and technological advances. As a result, the niobium cavities have reached the quality factors Q ∼ 10 11 at 1–2 GHz and 1.5 K and the breakdown radio-frequency (rf) fields H close to the dc superheating field of the Meissner state. These advances raise the questions of whether the state-of-the-art cavities are close to the fundamental limits, what these limits actually are, and to what extent the Q and H limits can be pushed by the materials nano structuring and impurity management. These issues are also relevant for many applications using high-Q thin film resonators, including single-photon detectors and quantum circuits. This topical review outlines basic physical mechanisms of the rf nonlinear surface impedance controlled by quasiparticles, dielectric losses and trapped vortices, as well as the dynamic field limit of the Meissner state. Sections cover methods of engineering an optimum quasiparticle density of states and superfluid density to reduce rf losses and kinetic inductance by pairbreaking mechanisms related to magnetic impurities, rf currents, and proximity-coupled metallic layers at the surface. A section focuses on mechanisms of residual surface resistance, which dominates rf losses at ultra low temperatures. Microwave losses of trapped vortices and their reduction by optimizing the concentration of impurities and pinning potential are also discussed.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗