Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “hardware accelerators”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Electron Cooling With Space-Charge Dominated Proton Beams at IOTA

We describe a new electron cooler being developed for 2.5 MeV protons at the Integrable Optics Test Accelerator (IOTA), which is a highly re-configurable storage ring at Fermilab. This system would enable the study of magnetized electron cooling in the presence of intense space-charge with transverse tune shifts approaching -0.5 as well as highly non-linear focusing optics in the IOTA ring. We present an overview of the design, simulations and hardware to be used for this project.

43 PARTICLE ACCELERATORS↗

Accelerating GNNs on GPU Sparse Tensor Cores through N:M Sparsity-Oriented Graph Reordering

Recent advancements in GPU hardware support have introduced the capability to leverage N:M sparse patterns for substantial performance gains. Graphs in Graph Neural Networks (GNNs) are typically sparse, but the sparsity is often irregular, not conforming to such sparse patterns. In this paper, we propose a novel graph reordering algorithm, the first of its kind, to reshape irregular graph data into the N:M structured sparse pattern at the tile level, allowing linear-algebra-based graph operations in GNNs to benefit from the N:M sparse hardware. The optimization is lossless, maintaining the accuracy of GNN. It can remove 98-100\% violations of the N:M sparse patterns at the vector level, and increase the proportion of conforming graphs in SuiteSparse collection from 5-9\% to 88.7-93.5\%. On A100 GPUs, the optimization accelerates Sparse Matrix Matrix (SpMM) by up to 43X (2.3X -- 7.5X on average) and speeds up the key graph operations in GNNs on real graphs by as much as 8.6X (3.5X on average).

artificial intelligence, graph neural networks↗

Electron Cooling Experiment for Proton Beams with Intense Space-Charge in IOTA

Electron cooling as a method of creating intense ion beams has a practical upper limit when it comes to the peak phase space density of ion beams which can be achieved in practice. We describe a new experiment to study electron cooling of 2.5 MeV protons at the intensity limit using the Integrable Optics Test Accelerator (IOTA), which is a storage ring dedicated to beam physics research at Fermilab. This system will enable the study of magnetized electron cooling of a proton beam with transverse incoherent tune shifts approaching -0.5 due to the presence of intense space-charge forces. We present an overview of the hardware design, simulations and specific experiments planned for this project.

43 PARTICLE ACCELERATORS↗

Progress in developing a superconducting accelerator for efficient eBeam and X-ray production

The PIP-II Accelerator is an 800 MeV superconducting Linac in the injection chain of the Fermilab accelerator complex. The LLRF systems for the 125 cavities which include a few normal conducting cavities in the warm front-end section, use a variety of LLRF hardware components and sub-systems that are part of the timing and synchronization system. This includes a master oscillator and phase averaging reference line, a beam pattern generator to enable beam transfer between non-harmonic RF systems and beam loading compensation systems synchronized to a start of beam trigger. The timing signals are based on a 650 MHz clock with manchester encoded event information and data provided over optical fiber. The timing and synchronization systems and their performance parameters will be described here.

43 PARTICLE ACCELERATORS↗

Optical neural engine for solving scientific partial differential equations

Abstract Solving partial differential equations (PDEs) is the cornerstone of scientific research and development. Data-driven machine learning (ML) approaches are emerging to accelerate time-consuming and computation-intensive numerical simulations of PDEs. Although optical systems offer high-throughput and energy-efficient ML hardware, their demonstration for solving PDEs is limited. Here, we present an optical neural engine (ONE) architecture combining diffractive optical neural networks for Fourier space processing and optical crossbar structures for real space processing to solve time-dependent and time-independent PDEs in diverse disciplines, including Darcy flow equation, the magnetostatic Poisson’s equation in demagnetization, the Navier-Stokes equation in incompressible fluid, Maxwell’s equations in nanophotonic metasurfaces, and coupled PDEs in a multiphysics system. We numerically and experimentally demonstrate the capability of the ONE architecture, which not only leverages the advantages of high-performance dual-space processing for outperforming traditional PDE solvers and being comparable with state-of-the-art ML models but also can be implemented using optical computing hardware with unique features of low-energy and highly parallel constant-time processing irrespective of model scales and real-time reconfigurability for tackling multiple tasks with the same architecture. The demonstrated architecture offers a versatile and powerful platform for large-scale scientific and engineering computations.

Tang, Yingheng (ORCID:0009000153622546)↗

Conceptual design of a replacement 2.1 K cold box for the Spallation Neutron Source Central Helium Liquefier

Abstract After more than 20 years of operation, the cold compressor technology in use at the Spallation Neutron Source (SNS) is obsolete, and replacement parts and service are no longer available. SNS has partnered with Jefferson Lab to design and construct a replacement sub-atmospheric cold box outfitted with modern cold compressor technology. The general design follows from Jefferson Lab’s experience on other recent sub-atmospheric cold box projects. Design decisions are backed by thorough engineering analysis to ensure technical requirements are met in a cost-effective manner. Conceptual design of the replacement cold box has been completed, and will be summarized in this paper. It features five cold compressors with an operating flow range of 80-140 g/s, and includes piping and valving to support cold compressor maintenance without interrupting flow circulation to the load. The approach to thermal shielding, insulation, and integration of the upgraded cold compressor hardware into the existing SNS control system will also be addressed.

Mastracci, B [Thomas Jefferson National Accelerato↗

The Memory Scaling of Reverse-Mode Differentiation in Particle Accelerator Simulations with Space Charge

The recent development of differentiable simulation codes for particle accelerators has enabled gradient-based workflows that promise finer control and more realistic modeling of accelerator facilities. However, when using reverse-mode automatic differentiation, the memory usage continuously increases during the simulation, and can potentially exceed the available hardware memory - especially when costly space charge computation is included. To study the memory requirements for differentiable simulations, we have implemented space charge in Cheetah, a PyTorch-based beam tracking code that supports reverse-mode differentiation. We find that the memory usage for reverse-mode differentiation grows linearly with the number of macroparticles and cells, and that it is proportional to the number of space charge kicks involved in the simulation. This general scaling can be used to evaluate whether a given differentiable simulation is feasible given hardware memory constraints.

Dhamrait, Arjun↗

Designing a Magnetic Measurement Data Acquisition and Control System With Reuse in Mind: A Rotating Coil System Example

Accelerator magnet test facilities frequently need to measure different magnets on differently equipped test stands and with different instrumentation. Designing a modular and highly reusable system that combines flexibility built-in at the architectural level as well as on the component level addresses this need. Specification of the backbone of the system, with the interfaces and dataflow for software components and core hardware modules, serves as a basis for building such a system. The design process and implementation of an extensible magnetic measurement data acquisition and control system are described, including techniques for maximizing the reuse of software. The discussion is supported by showing the application of this methodology to constructing two dissimilar systems for rotating coil measurements, both based on the same architecture and sharing core hardware modules and many software components. The first system is for production testing 10 m long cryo-assemblies containing two MQXFA quadrupole magnets for the high-luminosity upgrade of the Large Hadron Collider and the second for testing IQC conventional quadrupole magnets in support of the accelerator system at Fermilab.

43 PARTICLE ACCELERATORS↗

OpenACC unified programming environment for GPU and FPGA multi-hybrid acceleration

Attached accelerators have been frequently used in recent High Per- formance Computing (HPC) systems because of their high performance/power ratio. In particular, the Graphics Processing Unit (GPU) is the most popu- lar accelerator owing to its high peak FLOPS performance and high memory bandwidth supported by HBM2, etc. However, the performance of GPU depends highly on a large degree of SIMD parallelism and has difficulty sustaining a high performance on programs with frequent branch operations or a partially low degree of parallelism.By contrast, a Field Programmable Gate Array (FPGA) has received attention as a different type of accelerator than GPU as a fully reconfigurable processor fitting the target applications. The high performance of FPGA is mainly provided by a pipelined operation and optimized circuit suitable for any operation even with frequent conditional branches. We have been focusing on the flexibility of FPGA to compensate for the weakness of GPU. We believe that the coupling of GPU with FPGA can result in one of the most powerful accelerating platforms available.However, the program coding of GPU and FPGA coupling can be quite difficult for application users. Traditionally, CUDA by NVIDIA has been the most popular programming language with the largest share of GPUs used in HPC, whereas a hardware description language such as Verilog HDL has been used in FPGA programming. OpenCL coding has recently become available even on high-end FPGAs. Moreover, several recent studies have also enabled the OpenACC coding for use in FPGA. In this study, we provide a unified programming system based on OpenACC for a platform equipped with both GPU and FPGA aiming at the next-generation accelerated supercomputer framework. Our programming environment is called Multi-Hybrid OpenACC Translator (MHOAT), and in this paper, we describe the basic concept and prototype system of MHOAT based on an evaluation on the amount of coding required and the performance of a hybrid multi-device accelerated system.

Tsunashima, Ryuta↗

FitCache: A Transparent Drop-In Framework for Multi-Tier Caching to Accelerate Distributed Deep Learning Workloads

Training in Deep learning (DL) remains highly compute- and data-intensive, with I/O becoming a critical bottleneck as models and datasets scale. Recent studies report that data loading can dominate training time, especially on large-scale HPC systems with shared parallel file systems (PFS). Existing caching approaches either rely on single-tier designs or require intrusive modifications to training pipelines, limiting their portability and effectiveness. In this work, we present FitCache, a transparent drop-in framework for multi-tier caching to accelerate distributed DL training by coordinating fast local memory (e.g., DRAM, Persistent Memory (PMem)) and NVMe as hierarchical caches atop PFS. Our design adapts to hardware diversity, i.e., if NVMe is missing, memory transparently acts as a caching tier, ensuring stable performance. FitCache transparently intercepts I/O requests and issues concurrent fetches across all tiers, returning data from the fastest responder without centralized metadata or static redirection paths. FitCache adapts to dynamic workloads and heterogeneous clusters while maintaining POSIX compatibility. Experiments on Frontier (2048 GPUs) and smaller research clusters show that FitCache reduces training time by up to 40% and per-batch I/O latency by up to 71.6% compared to Lustre Orion PFS, offering a drop-in solution for scalable DL training.

Hu, Guangxing [ORNL] (ORCID:0009000283203614)↗

Performance for GPU exceptions

Techniques for improving performance of accelerated processing devices (“APDs”) when exceptions occur are provided. In APDs, the very large number of parallel processing execution units, and the complexity of the hardware used to execute a large number of work-items in parallel, means that APDs typically stall when an exception occurs (unlike in central processing units (“CPUs”), which are able to execute speculatively and out-of-order). However, the techniques provided herein allow at least some execution to occur past exceptions. Execution past an exception generating instruction occurs by executing instructions that would not lead to a corruption while skipping those that would lead to a corruption. After the exception has been satisfied, execution occurs in a replay mode in which the potentially exception-generating instruction is executed and in which instructions that did not execute in the exception-wait mode are executed. A mask and counter are used to control execution in replay mode.

Gutierrez, Anthony T.↗

Surrogate Neural Architecture Codesign Package (SNAC-Pack)

Neural Architecture Search is a powerful approach for automating model design, but existing methods struggle to accurately optimize for real hardware performance, often relying on proxy metrics such as bit operations. We present Surrogate Neural Architecture Codesign Package (SNAC-Pack), an integrated framework that automates the discovery and optimization of neural networks focusing on FPGA deployment. SNAC-Pack combines Neural Architecture Codesign's multi-stage search capabilities with the Resource Utilization and Latency Estimator, enabling multi-objective optimization across accuracy, FPGA resource utilization, and latency without requiring time-intensive synthesis for each candidate model. We demonstrate SNAC-Pack on a high energy physics jet classification task, achieving 63.84% accuracy with resource estimation. When synthesized on a Xilinx Virtex UltraScale+ VU13P FPGA, the SNAC-Pack model matches baseline accuracy while maintaining comparable resource utilization to models optimized using traditional BOPs metrics. This work demonstrates the potential of hardware-aware neural architecture search for resource-constrained deployments and provides an open-source framework for automating the design of efficient FPGA-accelerated models.

Weitz, Jason [UC, San Diego] (ORCID:00090004631535↗

The High Luminosity LHC interaction region magnets towards series production

The High Luminosity Large Hadron Collider (HL-LHC) is the new flagship project of CERN. First endorsed in 2013 and approved in 2016, HL-LHC is an upgrade of the accelerator aiming to increase by a factor of ten the statistics of the LHC collisions at the horizon of 2035-2040. HL-LHC relies on cutting edge technologies: among them, large aperture superconducting magnets will replace the present hardware to allow a smaller beam size in two interaction points (IPs). The project involves the construction of about 150 magnets of six different types: the quadrupole triplet, two main dipoles and three orbit correctors. The triplet, manufactured at CERN and in the USA, will consist of 30 magnets based on Nb3Sn technology, with an operational peak field of 11.4 T. These will be the first quadrupole Nb3Sn magnets installed in a particle accelerator. The other five types of magnets, all relying on Nb-Ti technology, present non-trivial challenges in the design and construction; they will be manufactured as part of in-kind contribution under the responsibility of institutes in Japan, China, Spain, and Italy. The project is now in the phase of transition between qualification through short models and prototypes and the beginning of the series construction. In this paper we review the magnet requirements, the reasons for selecting the design, the technological challenges with respect to previous projects, and we summarize the steps that have been taken to validate the baseline.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Laser Transport System Vacuum Simulations and LED Atom Tracker

MAGIS-100 is an experiment using atom interferometry on strontium atoms in a 100m vacuum chamber. The laser travels through a laser transport system (LTS) before going down the chamber. Two projects were completed over the course of the internship. One project was conducting vacuum simulations on the LTS to ensure it meets the experimental pressure requirement of 10-11 torr. This was done by characterizing the pressure profile with variations in pump size, pump spacing, and orifice size. The initial design of the LTS included one 30 L/s ion pump in the high vacuum (HV) region, a lens mount with holes of diameter 0.788”, and three 150 L/s ion pumps in the ultra-high vacuum (UHV) region. After adjusting these variables, it was concluded that the lens mount holes could be reduced to 0.200” in diameter and one 150 L/s ion pump in the UHV could be removed and still meet the experimental requirements. The other project was to design an LED atom tracker that shows the position of the strontium atoms in the 100m shaft. This will help with public outreach by allowing visitors to have a visual of the experiment. An Arduino Uno and Arduino Due were programmed using classical physics formulas to direct the RGB LED strips to flash in sync with the falling atoms. The requirements for powering and connecting the hardware were calculated and recommendations for scaling the system to 100m were made.

43 PARTICLE ACCELERATORS↗

Opportunities for retrieval and tool augmented large language models in scientific facilities

Upgrades to advanced scientific user facilities such as next-generation x-ray light sources, nanoscience centers, and neutron facilities are revolutionizing our understanding of materials across the spectrum of the physical sciences, from life sciences to microelectronics. However, these facility and instrument upgrades come with a significant increase in complexity. Driven by more exacting scientific needs, instruments and experiments become more intricate each year. This increased operational complexity makes it ever more challenging for domain scientists to design experiments that effectively leverage the capabilities of and operate on these advanced instruments. Large language models (LLMs) can perform complex information retrieval, assist in knowledge-intensive tasks across applications, and provide guidance on tool usage. Using x-ray light sources, leadership computing, and nanoscience centers as representative examples, we describe preliminary experiments with a Context-Aware Language Model for Science (CALMS) to assist scientists with instrument operations and complex experimentation. With the ability to retrieve relevant information from facility documentation, CALMS can answer simple questions on scientific capabilities and other operational procedures. With the ability to interface with software tools and experimental hardware, CALMS can conversationally operate scientific instruments. By making information more accessible and acting on user needs, LLMs could expand and diversify scientific facilities’ users and accelerate scientific output.

97 MATHEMATICS AND COMPUTING↗

Assessing VQLS for Fluid Dynamics on a Hybrid Quantum-HPC Stack

Recent advances in quantum linear solvers offer a promising direction for accelerating extreme scientific computations such as fluid dynamics. However, the deep and complex circuits required by many quantum algorithms limit their practical use on current quantum hardware. The Variational Quantum Linear Solver (VQLS) presents a viable alternative for near-term quantum devices (NISQ), and initial efforts have explored its application to select fluid dynamics problems. In this work, we evaluate the use of VQLS for canonical fluid dynamics problems, aiming to identify pathways for generalizing its implementation across a broader class of systems. We analyze the impact of various circuit ansatz and classical optimizers on solution quality and convergence behavior. Furthermore, we assess the algorithm's feasibility within a hybrid quantum–high-performance computing (HPC) framework by porting it to QFw, a state-of-the-art quantum-HPC software stack. 11This manuscript has been authored by UT-Battelle, LLC, under contract DE-AC05-00OR22725 with the US Department of Energy (DOE). The US government retains and the publisher, by accepting the article for publication, acknowledges that the US government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for US government purposes. DOE will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan. This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the US DOE under Contract No. DE-AC05-00OR22725.

Gopalakrishnan Meena, Murali [ORNL] (ORCID:0000000↗

Solar Prize Round 5 Software Track: Abbreviated Final Technical Report

Solar Prize Round 5 launched two simultaneous tracks, the Hardware Track and the Software Track, to introduce software innovations into the Solar Prize for the first time. The primary goal of the prize is to accelerate the development, validation, and commercialization of innovative solar software solutions that will increase the competitiveness of the U.S. solar industry. This is accomplished with three escalating challenges, called the Ready!, Set!, and Go! Contests, where teams work to develop their concept from idea to potentially marketable product in less than one year. Competitors also have the option to compete in a Justice, Equity, Diversity, and Inclusion (JEDI) Contest, which recognizes solutions that enable underserved communities in the United States to overcome systemic solar barriers and share equitably in the societal benefits of solar deployment. The Prize concluded by awarding 2 final winners the Go! Contest prize and a 3rd winner to the JEDI Contest prize in the Software Track, after competing in the prize for a year and demonstrating their success through each phase.

14 SOLAR ENERGY↗

Machine learning for arbitrary single-qubit rotations on an embedded device

Here, in this study, we present a technique for using machine learning (ML) for single-qubit gate synthesis on field-programmable logic for a superconducting transmon-based quantum computer based on simulated studies. Our approach is multi-stage. We first “bootstrap” a model based on simulation with access to the full state vector for measuring gate fidelity. We next present an algorithm, named adapted randomized benchmarking (ARB), for fine-tuning the gate on hardware based on measurements of the devices. We also present techniques for deploying the model on programmable devices with care to reduce the required resources. While the techniques here are applied to a transmon-based computer, many of them are portable to other architectures.

97 MATHEMATICS AND COMPUTING↗