Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “High Energy Physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Accelerating End-to-End Deep Learning for Particle Reconstruction using CMS open data

Machine learning algorithms are gaining ground in high energy physics for applications in particle and event identification, physics analysis, detector reconstruction, simulation and trigger. Currently, most data-analysis tasks at LHC experiments benefit from the use of machine learning. Incorporating these computational tools in the experimental framework presents new challenges. This paper reports on the implementation of the end-to-end deep learning with the CMS software framework and the scaling of the end-to-end deep learning with multiple GPUs. The end-to-end deep learning technique combines deep learning algorithms and low-level detector representation for particle and event identification. We demonstrate the end-to-end implementation on a top quark benchmark and perform studies with various hardware architectures including single and multiple GPUs and Google TPU.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Extending Rucio with modern cloud storage support

Rucio is a software framework designed to facilitate scientific collaborations in efficiently organising, managing, and accessing extensive volumes of data through customizable policies. The framework enables data distribution across globally distributed locations and heterogeneous data centres, integrating various storage and network technologies into a unified federated entity. Rucio offers advanced features like distributed data recovery and adaptive replication, and it exhibits high scalability, modularity, and extensibility. Originally developed to meet the requirements of the high-energy physics experiment ATLAS, Rucio has been continuously expanded to support LHC experiments and diverse scientific communities. Recent R&D projects within these communities have evaluated the integration of both private and commercially-provided cloud storage systems, leading to the development of additional functionalities for seamless integration within Rucio. Furthermore, the underlying systems, FTS and GFAL/Davix, have been extended to cater to specific use cases. This contribution focuses on the technical aspects of this work, particularly the challenges encountered in building a generic interface for self-hosted cloud storage, such as MinIO or CEPH S3 Gateway, and established providers like Google Cloud Storage and Amazon Simple Storage Service. Additionally, the integration of decentralised clouds like SEAL is explored. Key aspects, including authentication and authorisation, direct and remote access, throughput and cost estimation, are highlighted, along with shared experiences in daily operations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Distributed Machine Learning Workflow with PanDA and iDDS in LHC ATLAS

Machine Learning (ML) has become one of the important tools for High Energy Physics analysis. As the size of the dataset increases at the Large Hadron Collider (LHC), and at the same time the search spaces become bigger and bigger in order to exploit the physics potentials, more and more computing resources are required for processing these ML tasks. In addition, complex advanced ML workflows are developed in which one task may depend on the results of previous tasks. How to make use of vast distributed CPUs/GPUs in WLCG for these big complex ML tasks has become a popular research area. In this paper, we present our efforts enabling the execution of distributed ML workflows on the Production and Distributed Analysis (PanDA) system and intelligent Data Delivery Service (iDDS). First, we describe how PanDA and iDDS deal with large-scale ML workflows, including the implementation to process workloads on diverse and geographically distributed computing resources. Next, we report real-world use cases, such as HyperParameter Optimization, Monte Carlo Toy confidence limits calculation, and Active Learning. Finally, we conclude with future plans.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Modeling Distributed Computing Infrastructures for HEP Applications

Predicting the performance of various infrastructure design options in complex federated infrastructures with computing sites distributed over a wide area network that support a plethora of users and workflows, such as the Worldwide LHC Computing Grid (WLCG), is not trivial. Due to the complexity and size of these infrastructures, it is not feasible to deploy experimental test-beds at large scales merely for the purpose of comparing and evaluating alternate designs. An alternative is to study the behaviours of these systems using simulation. This approach has been used successfully in the past to identify efficient and practical infrastructure designs for High Energy Physics (HEP). A prominent example is the Monarc simulation framework, which was used to study the initial structure of the WLCG. New simulation capabilities are needed to simulate large-scale heterogeneous computing systems with complex networks, data access and caching patterns. A modern tool to simulate HEP workloads that execute on distributed computing infrastructures based on the SimGrid and WRENCH simulation frameworks is outlined. Studies of its accuracy and scalability are presented using HEP as a case-study. Hypothetical adjustments to prevailing computing architectures in HEP are studied providing insights into the dynamics of a part of the WLCG and candidates for improvements.

Horzela, Maximilian↗
DOE OSTI2024

Application of performance portability solutions for GPUs and many-core CPUs to track reconstruction kernels

Next generation High-Energy Physics (HEP) experiments are presented with significant computational challenges, both in terms of data volume and processing power. Using compute accelerators, such as GPUs, is one of the promising ways to provide the necessary computational power to meet the challenge. The current programming models for compute accelerators often involve using architecture-specific programming languages promoted by the hardware vendors and hence limit the set of platforms that the code can run on. Developing software with platform restrictions is especially unfeasible for HEP communities as it takes significant effort to convert typical HEP algorithms into ones that are efficient for compute accelerators. Multiple performance portability solutions have recently emerged and provide an alternative path for using compute accelerators, which allow the code to be executed on hardware from different vendors. We apply several portability solutions, such as Kokkos, SYCL, C++17 std::execution::par, Alpaka, and OpenMP/OpenACC, on two mini-apps extracted from the mkFit project: p2z and p2r. These apps include basic kernels for a Kalman filter track fit, such as propagation and update of track parameters, for detectors at a fixed z or fixed r position, respectively. The two mini-apps explore different memory layout formats. We report on the development experience with different portability solutions, as well as their performance on GPUs and many-core CPUs, measured as the throughput of the kernels from different GPU and CPU vendors such as NVIDIA, AMD and Intel.

Kwok, Ka Hei Martin↗
DOE OSTI2024

Porting ATLAS Fast Calorimeter Simulation to GPUs with Performance Portable Programming Models

FastCaloSim is a parameterized simulation of the particle energy response and of the energy distribution in the ATLAS calorimeter. It is a relatively small and self-contained package with massive inherent parallelism and captures the essence of GPU offloading via important operations like data transfer, memory initialization, floating point operations, and reduction. It was identified by the High Energy Physics Center for Computational Excellence project as a good testbed for evaluating the performance and ease of portability of programming models. In this paper, we will discuss the results of our evaluation of the porting process to Kokkos, SYCL, Alpaka, OpenMP and std::par (nvc++), and compare performance on NVIDIA, AMD and Intel GPUs, as well as multicore CPUs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Data Placement Optimization for ATLAS in a Multi-Tiered Storage System within a Data Center

Scientific experiments and computations, especially in High Energy Physics, are generating and accumulating data at an unprecedented rate. Effectively managing this vast volume of data while ensuring efficient data analysis poses a significant challenge for data centers, which must integrate various storage technologies. This paper proposes addressing this challenge by designing and developing a precise data popularity prediction model utilizing state-of-theart AI/ML techniques. This model is crafted from the analysis of ATLAS data and access patterns. It enables us to migrate infrequently accessed data to more economical storage media, such as tape drives, while storing frequently accessed data on faster yet costlier storage media like HDD or SSD. This strategic approach ensures data is placed optimally into the appropriate storage classes, thereby maximizing storage capacity while minimizing data access latency for end-users. Furthermore, the paper includes a performance evaluation of the prediction model using various key metrics such as F1 score, accuracy, precision and recall. Finally, we present a prototype use case, leveraging real-world file access data to assess the model’s impact on performance.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Exploiting Kubernetes to Simplify the Deployment and Management of the Multi-purpose CMS Pilot Job Factory

GlideinWMS, a widely utilized workload management system in high-energy physics (HEP) research, serves as the backbone for efficient job provisioning across distributed computing resources. It is utilized by various experiments and organizations, including CMS, OSG, Dune, and FIFE, to create HTCondor pools as large as 600k cores. In particular, a shared factory service historically deployed at UCSD has been configured to interface with more than 500 routes to compute clusters. As part of our team’s initiative to modernize infrastructure and enhance scalability, we undertook the migration of the GlideinWMS factory service into the Kubernetes environment. Leveraging the flexibility and orchestration capabilities of Kubernetes, we successfully deployed the factory service within the OSG Tiger Kubernetes cluster. The major benefits Kubernetes gives us is it streamlines the management and monitoring of the factory infrastructure, and improves fault tolerance through its resilient deployment strategies. Through this case study, we aim to share insights, challenges, and best practices encountered during the migration process. Our experience underscores the benefits of embracing containerization and Kubernetes orchestration for HEP computing infrastructure, paving the way for scalability and resilience in distributed computing environments.

Dost, Jeffrey Michael [UC, San Diego (main)]↗
DOE OSTI2025

Accelerating detector simulations with Celeritas: Profiling and performance optimizations

Celeritas is a GPU-optimized Monte Carlo (MC) particle transport code designed to meet the growing computational demands of next-generation high energy physics (HEP) experiments. It provides efficient simulation of electromagnetic (EM) physics processes in complex geometries with magnetic fields, detector hit scoring, and seamless integration into Geant4-driven applications to offload EM physics to GPUs. Recent efforts have focused on performance optimizations and expanding profiling capabilities. This paper presents some key advancements, including the integration of the Perfetto system profiling tool for detailed performance analysis and the development of track-sorting methods to improve computational efficiency.

Lund, Amanda [Argonne National Laboratory (ANL)]↗
DOE OSTI2024

The FLUKA code: Overview and new developments

The FLUKA Monte Carlo Radiation Transport and Interaction code package is widely used to simulate the interaction of particles with matter in a variety of fields, including high energy physics, space radiation, medical applications, radiation protection and shielding assessments, accelerator studies, astrophysical studies and well logging. This paper gives a brief overview of the FLUKA program and describes recent developments, in particular, improvements in the modelling of particle interactions and transport are described in detail. In addition, an overview of selected applications is given.

Ballarini, Francesca↗
DOE OSTI2021

Adiabatic matching of particle bunches in a plasma-based accelerator in the presence of ion motion

Witness beam stability and preservation of its ultra-low emittance have been identified as critical challenges toward realizing a TeV-class, plasma-based linear collider. In fact, the witness bunch parameters required by a future TeV-class collider have been expected to trigger hosing instability and background ion motion, leading to emittance degradation and, potentially, to bunch loss. Recently, it has been shown that ion motion suppresses the hosing instability, and proper longitudinal bunch shaping can eliminate the ion-motion-induced emittance growth. Here, we propose and analyze a plasma-based method to generate the shaped bunches that enable emittance preservation in the presence of ion motion. The method is based on an adiabatic matching procedure, where a bunch with an initially untapered profile is injected in the plasma accelerator stage with an energy low enough that ion motion effects are initially small. As the bunch accelerates, it is adiabatically compressed, ion motion is gradually triggered, and the bunch slowly but continuously readjusts itself in the ion motion-perturbed wakefield acquiring the desired taper. The production of tapered witness bunch profiles that minimize energy spread and preserve emittance for collider-relevant parameters could enable the use of plasma-based accelerators for high-energy physics applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Distributed fiber-optic sensing in a subscale high-temperature superconducting dipole magnet

High-temperature superconductors, such as REBa2Cu3O7−x (REBCO, RE = rare earth), are becoming pivotal for high-field magnet technology for future circular colliders and compact fusion reactors. The U.S. Magnet Development Program, in collaboration with industry, is developing REBCO magnet technology using round conductors consisting of multiple REBCO tapes. For these multi-tape cables, traditional instrumentation, such as voltage taps and resistive strain gauges, become insufficient to help measure and understand the performance-limiting factors in these model magnets. Distributed fiber-optic sensing (DFOS) is a potential solution to address this challenge. Although DFOS is well established for various applications, measuring temperature and strain in high-temperature superconducting magnets is in its infancy. Here we report the detailed implementation and test results of DFOS based on Rayleigh scattering in a subscale canted cosθ (CCT) dipole magnet using high-temperature superconducting CORC® wires. We co-wound optical fibers in each layer of the CCT magnet and compared different types of commercial fibers and mold-release agents to reduce the power attenuation in the fibers. The DFOS allowed us to measure mechanical deformation and temperature along the conductor during tests at 77 and 4.2 K. The measured strain agreed quantitively with a finite-element mechanical model of the subscale magnet. Our results indicate that DFOS can effectively identify locations of strain and temperature changes, offering unique insight into magnet performance that can advance our understanding and development of the REBCO magnet technology for high-energy physics and fusion applications.

Luo, Linqing↗
DOE OSTI2024

Searching for Exploding black holes

Abstract The observation of the final stages of the evaporation of a light black hole, which Hawking referred to as “black hole explosion”, would offer critical insights on quantum gravity and high-energy physics phenomena. Here, we explore, review, and revisit the observational features and rates expected for nearby, light, evaporating black holes, and we assess and compare the expected sensitivity of a broad range of observatories. We then focus on the search for candidate black hole explosions in archival data from the Fermi Large Area Telescope and Gamma-ray Burst Monitor, and outline possible future observational campaigns.

Astronomy & Astrophysics↗
DOE OSTI2020

Simulating Diverse HEP Workflows on Heterogeneous Architectures

We evaluate key patterns and estimate throughput bounds of simulated transformation of conventional high energy physics (HEP) data processing workflows to heterogeneous equivalents. The simulation parameter space includes the number of offloaded tasks, CPU/accelerator ratios of intra-task computations, offload latencies, and run time efficiency of offloaded computations. The simulation is performed for a diverse set of state-of-the-art event reconstruction scenarios from ATLAS, LHCb and CMS - the frontier HEP experiments of the Large Hadron Collider project.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Application of Portable Parallelization Strategies for GPUs on track reconstruction kernels

Utilizing the computational power of GPUs is one of the key ingredients to meet the computing challenges presented to the next generation of High-Energy Physics (HEP) experiments. Unlike CPUs, developing software for GPUs often involves using architecturespecific programming languages promoted by the GPU vendors and hence limits the platform that the code can run on. Various portability solutions have been developed to achieve portable, performant software across different GPU vendors. Given the rapid evolution of these portability solutions, an early adoption of them in simple HEP testbed applications will help us understand the strengths and weaknesses of respective approaches.We apply several portability solutions, including Alpaka, Kokkos, SYCL and std::execution::par, on kernels for track propagation extracted from the mkFit project. We report on the development experience of the same application with different portability solutions, as well as their performance on GPUs, measured as the throughput of the kernels, from different manufacturers such as NVIDIA, AMD and Intel.

Kwok, Martin [Fermilab] (ORCID:0000000286936146)↗
DOE OSTI2020

Dark matter detection capabilities of a large multipurpose Liquid Argon Time Projection Chamber

Liquid Argon Time Projection Chambers are planned to comprise a central role in the future of the U.S. High Energy Physics neutrino program. In particular, this detector technology will form the basis for the 40 kton Deep Underground Neutrino Experiment (DUNE) . Here in this paper we take as a starting point the dual phase far detector design proposed by the DUNE experiment and ask what changes are necessary to allow one of the four 10 kt modules to be sensitive to heavy Weakly Interacting Massive Particle (WIMP) dark matter. We show that with control over backgrounds and the use of low radioactivity argon, which may be commercially available on that timescale, along with a significant increase in light detection, one DUNE-like module gives a competitive WIMP detection sensitivity, particularly above a dark matter mass of 100 GeV.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Parameterization of electron attachment rate constants for impurities in LArTPC detectors

The ability of free electrons to drift long distances at high velocities in pure liquid argon under an applied electric field has been exploited for the past forty years to implement detectors with increasingly larger volumes for high energy physics research. The attachment of free electrons to impurities in the LAr is an important limit on the free instrumented volume of these extremely large detectors, and impurity concentrations as small as 100 ppt can reduce their resolution and efficiency. In this paper, we summarize the electron attachment rate constants as a function of the applied electric field, for common impurities in LArTPCs, obtained from data in the literature. Here, we further provide analytical functions to parameterize the data, which are useful to compare with new measurements, to model and analyze the performance of existing detectors, and to predict the performance of new detectors.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗