Engineering Papers⌕ Search

Engineering topics

Aurisano, Adam

Publications and source records attributed to Aurisano, Adam.

At least 19 records

Addressing GPU memory limitations for Graph Neural Networks in High-Energy Physics applications

Introduction Reconstructing low-level particle tracks in neutrino physics can address some of the most fundamental questions about the universe. However, processing petabytes of raw data using deep learning techniques poses a challenging problem in the field of High Energy Physics (HEP). In the Exa.TrkX Project, an illustrative HEP application, preprocessed simulation data is fed into a state-of-art Graph Neural Network (GNN) model, accelerated by GPUs. However, limited GPU memory often leads to Out-of-Memory (OOM) exceptions during training, due to the large size of models and datasets. This problem is exacerbated when deploying models on High-Performance Computing (HPC) systems designed for large-scale applications. Methods We observe a high workload imbalance issue during GNN model training caused by the irregular sizes of input graph samples in HEP datasets, contributing to OOM exceptions. We aim to scale GNNs on HPC systems, by prioritizing workload balance in graph inputs while maintaining model accuracy. Our paper introduces diverse balancing strategies aimed at decreasing the maximum GPU memory footprint and avoiding the OOM exception, across various datasets. Results Our experiments showcase memory reduction of up to 32.14% compared to the baseline. We also demonstrate the proposed strategies can avoid OOM in application. Additionally, we create a distributed multi-GPU implementation using these samplers to demonstrate the scalability of these techniques on the HEP dataset. Discussion By assessing the performance of these strategies as data loading samplers across multiple datasets, we can gauge their effectiveness in both single-GPU and distributed environments. Our experiments, conducted on datasets of varying sizes and across multiple GPUs, broaden the applicability of our work to various GNN applications that handle input datasets with irregular graph sizes.

Lee, Claire Songhyun↗

The DUNE Far Detector Vertical Drift Technology. Technical Design Report

DUNE is an international experiment dedicated to addressing some of the questions at the forefront of particle physics and astrophysics, including the mystifying preponderance of matter over antimatter in the early universe. The dual-site experiment will employ an intense neutrino beam focused on a near and a far detector as it aims to determine the neutrino mass hierarchy and to make high-precision measurements of the PMNS matrix parameters, including the CP-violating phase. It will also stand ready to observe supernova neutrino bursts, and seeks to observe nucleon decay as a signature of a grand unified theory underlying the standard model. The DUNE far detector implements liquid argon time-projection chamber (LArTPC) technology, and combines the many tens-of-kiloton fiducial mass necessary for rare event searches with the sub-centimeter spatial resolution required to image those events with high precision. The addition of a photon detection system enhances physics capabilities for all DUNE physics drivers and opens prospects for further physics explorations. Given its size, the far detector will be implemented as a set of modules, with LArTPC designs that differ from one another as newer technologies arise. In the vertical drift LArTPC design, a horizontal cathode bisects the detector, creating two stacked drift volumes in which ionization charges drift towards anodes at either the top or bottom. The anodes are composed of perforated PCB layers with conductive strips, enabling reconstruction in 3D. Light-trap-style photon detection modules are placed both on the cryostat's side walls and on the central cathode where they are optically powered. This Technical Design Report describes in detail the technical implementations of each subsystem of this LArTPC that, together with the other far detector modules and the near detector, will enable DUNE to achieve its physics goals.

47 OTHER INSTRUMENTATION↗

Reconstruction of interactions in the ProtoDUNE-SP detector with Pandora

The Pandora Software Development Kit and algorithm libraries provide pattern-recognition logic essential to the reconstruction of particle interactions in liquid argon time projection chamber detectors. Pandora is the primary event reconstruction software used at ProtoDUNE-SP, a prototype for the Deep Underground Neutrino Experiment far detector. ProtoDUNE-SP, located at CERN, is exposed to a charged-particle test beam. This paper gives an overview of the Pandora reconstruction algorithms and how they have been tailored for use at ProtoDUNE-SP. In complex events with numerous cosmic-ray and beam background particles, the simulated reconstruction and identification efficiency for triggered test-beam particles is above 80% for the majority of particle type and beam momentum combinations. Specifically, simulated 1 GeV/c charged pions and protons are correctly reconstructed and identified with efficiencies of 86.1$\pm 0.6$% and 84.1$\pm 0.6$%, respectively. The efficiencies measured for test-beam data are shown to be within 5% of those predicted by the simulation.

43 PARTICLE ACCELERATORS↗

Searches for New Physics in Neutrino Oscillations at the MINOS+, NOvA, and DUNE Experiments

Neutrinos are some of the most mysterious fundamental particles in Standard Model: they are orders of magnitude lighter than the next lightest massive particle (the electron), and they rarely interact with other particles. In the last 20 years, we have firmly established that neutrinos change flavors as they travel by observing the disappearance of muon neutrinos produced by accelerators and interactions of cosmic rays with the atmosphere; the appearance of electron neutrinos in muon neutrino beams; and the disappearance of electron antineutrinos produced by nuclear reactors. Almost all experiments are consistent with the existence of only three neutrino flavor states which mix with three neutrino mass states. However, there are a few experiments which have seen evidence for oscillations at frequencies incompatible with the three known states, which would suggest the existence of a fourth state, the sterile neutrino. This project supported searches for physics beyond the Standard Model, especially sterile neutrinos, in neutrino oscillations at the MINOS/MINOS+ and NOvA experiments. These efforts were enabled through the use of Deep Learning approaches which have revolutionized selection and reconstruction methods in High Energy Physics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DUNE Offline Computing Conceptual Design Report

This document describes Offline Software and Computing for the Deep Underground Neutrino Experiment (DUNE) experiment, in particular, the conceptual design of the offline computing needed to accomplish its physics goals. Our emphasis in this document is the development of the computing infrastructure needed to acquire, catalog, reconstruct, simulate and analyze the data from the DUNE experiment and its prototypes. In this effort, we concentrate on developing the tools and systems that facilitate the development and deployment of advanced algorithms. Rather than prescribing particular algorithms, our goal is to provide resources that are flexible and accessible enough to support creative software solutions as HEP computing evolves and to provide computing that achieves the physics goals of the DUNE experiment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Tau neutrinos in the next decade: from GeV to EeV

Tau neutrinos are the least studied particle in the standard model. This whitepaper discusses the current and expected upcoming status of tau neutrino physics with attention to the broad experimental and theoretical landscape spanning long-baseline, beam-dump, collider, and astrophysical experiments. This whitepaper was prepared as a part of the NuTau2021 Workshop.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Deep Underground Neutrino Experiment (DUNE) Near Detector Conceptual Design Report

The Deep Underground Neutrino Experiment (DUNE) is an international, world-class experiment aimed at exploring fundamental questions about the universe that are at the forefront of astrophysics and particle physics research. DUNE will study questions pertaining to the preponderance of matter over antimatter in the early universe, the dynamics of supernovae, the subtleties of neutrino interaction physics, and a number of beyond the Standard Model topics accessible in a powerful neutrino beam. A critical component of the DUNE physics program involves the study of changes in a powerful beam of neutrinos, i.e., neutrino oscillations, as the neutrinos propagate a long distance. The experiment consists of a near detector, sited close to the source of the beam, and a far detector, sited along the beam at a large distance. This document, the DUNE Near Detector Conceptual Design Report (CDR), describes the design of the DUNE near detector and the science program that drives the design and technology choices. The goals and requirements underlying the design, along with projected performance are given. It serves as a starting point for a more detailed design that will be described in future documents.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Graph Neural Network for Object Reconstruction in Liquid Argon Time Projection Chambers

This paper presents a graph neural network (GNN) technique for low-level reconstruction of neutrino interactions in a Liquid Argon Time Projection Chamber (LArTPC). GNNs are still a relatively novel technique, and have shown great promise for similar reconstruction tasks in the LHC. In this paper, a multihead attention message passing network is used to classify the relationship between detector hits by labelling graph edges, determining whether hits were produced by the same underlying particle, and if so, the particle type. The trained model is 84% accurate overall, and performs best on the EM shower and muon track classes. The model’s strengths and weaknesses are discussed, and plans for developing this technique further are summarised.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Volume I. Introduction to DUNE

The preponderance of matter over antimatter in the early universe, the dynamics of the supernovae that produced the heavy elements necessary for life, and whether protons eventually decay -- these mysteries at the forefront of particle physics and astrophysics are key to understanding the early evolution of our universe, its current state, and its eventual fate. The Deep Underground Neutrino Experiment (DUNE) is an international world-class experiment dedicated to addressing these questions as it searches for leptonic charge-parity symmetry violation, stands ready to capture supernova neutrino bursts, and seeks to observe nucleon decay as a signature of a grand unified theory underlying the standard model. The DUNE far detector technical design report (TDR) describes the DUNE physics program and the technical designs of the single- and dual-phase DUNE liquid argon TPC far detector modules. This TDR is intended to justify the technical choices for the far detector that flow down from the high-level physics goals through requirements at all levels of the Project. Volume I contains an executive summary that introduces the DUNE science program, the far detector and the strategy for its modular designs, and the organization and management of the Project. The remainder of Volume I provides more detail on the science program that drives the choice of detector technologies and on the technologies themselves. It also introduces the designs for the DUNE near detector and the DUNE computing model, for which DUNE is planning design reports. Volume II of this TDR describes DUNE's physics program in detail. Volume III describes the technical coordination required for the far detector design, construction, installation, and integration, and its organizational structure. Volume IV describes the single-phase far detector technology. A planned Volume V will describe the dual-phase technology.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Volume III. DUNE far detector technical coordination

The preponderance of matter over antimatter in the early universe, the dynamics of the supernovae that produced the heavy elements necessary for life, and whether protons eventually decay -- these mysteries at the forefront of particle physics and astrophysics are key to understanding the early evolution of our universe, its current state, and its eventual fate. The Deep Underground Neutrino Experiment (DUNE) is an international world-class experiment dedicated to addressing these questions as it searches for leptonic charge-parity symmetry violation, stands ready to capture supernova neutrino bursts, and seeks to observe nucleon decay as a signature of a grand unified theory underlying the standard model. The DUNE far detector technical design report (TDR) describes the DUNE physics program and the technical designs of the single- and dual-phase DUNE liquid argon TPC far detector modules. Volume III of this TDR describes how the activities required to design, construct, fabricate, install, and commission the DUNE far detector modules are organized and managed. This volume details the organizational structures that will carry out and/or oversee the planned far detector activities safely, successfully, on time, and on budget. It presents overviews of the facilities, supporting infrastructure, and detectors for context, and it outlines the project-related functions and methodologies used by the DUNE technical coordination organization, focusing on the areas of integration engineering, technical reviews, quality assurance and control, and safety oversight. Because of its more advanced stage of development, functional examples presented in this volume focus primarily on the single-phase (SP) detector module.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Volume IV. The DUNE far detector single-phase technology

The preponderance of matter over antimatter in the early universe, the dynamics of the supernovae that produced the heavy elements necessary for life, and whether protons eventually decay -- these mysteries at the forefront of particle physics and astrophysics are key to understanding the early evolution of our universe, its current state, and its eventual fate. DUNE is an international world-class experiment dedicated to addressing these questions as it searches for leptonic charge-parity symmetry violation, stands ready to capture supernova neutrino bursts, and seeks to observe nucleon decay as a signature of a grand unified theory underlying the standard model. Central to achieving DUNE's physics program is a far detector that combines the many tens-of-kiloton fiducial mass necessary for rare event searches with sub-centimeter spatial resolution in its ability to image those events, allowing identification of the physics signatures among the numerous backgrounds. In the single-phase liquid argon time-projection chamber (LArTPC) technology, ionization charges drift horizontally in the liquid argon under the influence of an electric field towards a vertical anode, where they are read out with fine granularity. A photon detection system supplements the TPC, directly enhancing physics capabilities for all three DUNE physics drivers and opening up prospects for further physics explorations. The DUNE far detector technical design report (TDR) describes the DUNE physics program and the technical designs of the single- and dual-phase DUNE liquid argon TPC far detector modules. Volume IV presents an overview of the basic operating principles of a single-phase LArTPC, followed by a description of the DUNE implementation. Each of the subsystems is described in detail, connecting the high-level design requirements and decisions to the overriding physics goals of DUNE.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Track Seeding and Labelling with Embedded-space Graph Neural Networks

To address the unprecedented scale of HL-LHC data, the Exa.TrkX project is investigating a variety of machine learning approaches to particle track reconstruction. The most promising of these solutions, graph neural networks (GNN), process the event as a graph that connects track measurements (detector hits corresponding to nodes) with candidate line segments between the hits (corresponding to edges). Detector information can be associated with nodes and edges, enabling a GNN to propagate the embedded parameters around the graph and predict node-, edge- and graph-level observables. Previously, message-passing GNNs have shown success in predicting doublet likelihood, and we here report updates on the state-of-the-art architectures for this task. In addition, the Exa.TrkX project has investigated innovations in both graph construction, and embedded representations, in an effort to achieve fully learned end-to-end track finding. Hence, we present a suite of extensions to the original model, with encouraging results for hitgraph classification. In addition, we explore increased performance by constructing graphs from learned representations which contain non-linear metric structure, allowing for efficient clustering and neighborhood queries of data points. We demonstrate how this framework fits in with both traditional clustering pipelines, and GNN approaches. The embedded graphs feed into high-accuracy doublet and triplet classifiers, or can be used as an end-to-end track classifier by clustering in an embedded space. A set of post-processing methods improve performance with knowledge of the detector physics. Finally, we present numerical results on the TrackML particle tracking challenge dataset, where our framework shows favorable results in both seeding and track finding.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Deep Underground Neutrino Experiment (DUNE), Far Detector Technical Design Report, Volume II: DUNE Physics

The preponderance of matter over antimatter in the early universe, the dynamics of the supernovae that produced the heavy elements necessary for life, and whether protons eventually decay -- these mysteries at the forefront of particle physics and astrophysics are key to understanding the early evolution of our universe, its current state, and its eventual fate. DUNE is an international world-class experiment dedicated to addressing these questions as it searches for leptonic charge-parity symmetry violation, stands ready to capture supernova neutrino bursts, and seeks to observe nucleon decay as a signature of a grand unified theory underlying the standard model. The DUNE far detector technical design report (TDR) describes the DUNE physics program and the technical designs of the single- and dual-phase DUNE liquid argon TPC far detector modules. Volume II of this TDR, DUNE Physics, describes the array of identified scientific opportunities and key goals. Crucially, we also report our best current understanding of the capability of DUNE to realize these goals, along with the detailed arguments and investigations on which this understanding is based. This TDR volume documents the scientific basis underlying the conception and design of the LBNF/DUNE experimental configurations. As a result, the description of DUNE's experimental capabilities constitutes the bulk of the document. Key linkages between requirements for successful execution of the physics program and primary specifications of the experimental configurations are drawn and summarized. This document also serves a wider purpose as a statement on the scientific potential of DUNE as a central component within a global program of frontier theoretical and experimental particle physics research. Thus, the presentation also aims to serve as a resource for the particle physics community at large.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Machine Learning in High Energy Physics Community White Paper

Machine learning is an important applied research area in particle physics, beginning with applications to high-level physics analysis in the 1990s and 2000s, followed by an explosion of applications in particle and event identification and reconstruction in the 2010s. In this document we discuss promising future research and development areas in machine learning in particle physics with a roadmap for their implementation, software and hardware resource requirements, collaborative initiatives with the data science community, academia and industry, and training the particle physics community in data science. The main objective of the document is to connect and motivate these areas of research and development with the physics drivers of the High-Luminosity Large Hadron Collider and future neutrino experiments and identify the resource needs for their implementation. Additionally we identify areas where collaboration with external communities will be of great benefit.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine learning at the energy and intensity frontiers of particle physics

Our knowledge of the fundamental particles of nature and their interactions is summarized by the standard model of particle physics. Advancing our understanding in this field has required experiments that operate at ever higher energies and intensities, which produce extremely large and information-rich data samples. The use of machine-learning techniques is revolutionizing how we interpret these data samples, greatly increasing the discovery potential of present and future experiments. Here we summarize the challenges and opportunities that come with the use of machine learning at the frontiers of particle physics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Sterile Neutrino Search in the NOvA Far Detector

The majority of neutrino oscillation experiments have obtained evidence for neutrino oscillations that are compatible with the three-flavor model. Explaining anomalous results from short-baseline experiments, such as LSND and MiniBooNE, in terms of neutrino oscillations requires the existence of sterile neutrinos. The search for sterile neutrino mixing conducted in NOvA uses a long baseline of 810 km between Near Detector (ND) at Fermilab and Far Detector (FD) in Minnesota. The signal for sterile neutrino oscillations is a deficit of neutral-current neutrino interactions at the FD with respect to the ND prediction. In this document, We will present the analysis improvements that we are implementing for future NC sterile neutrino searches with NOvA. These include: improved modelling of our detector response; the inclusion of NC 2p2h interaction modelling; implementing a better energy reconstruction techniques; and including possible oscillation due to sterile neutrinos in the ND . This improvements enable us to do a simultaneous ND-FD shape fit of the NC energy spectrum covering a wider sterile mass range than previous analyses.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NOvA Short-Baseline Tau Neutrino Appearance Search

Standard three-flavor neutrino oscillations have well explained by a wide range of neutrino experiments. However, the anomalous results, such as electron-antineutrino excess seen by LSND and MiniBooNE do not fit the three-flavor paradigm. This can be explained by an additional fourth flavor sterile neutrino at a larger scale than the existing three flavor neutrinos. The NOvA experiment consists of two finely segmented, liquid scintillator detectors operating 14 .6 mrad off-axis from the NuMI muon-neutrino beam. The Near Detector is located on the Fermilab campus, 1 km from the NuMI target, while the Far Detector is located at Ash River, MN, 810 km from the NuMI target. The NOvA experiment is primarily designed to measure electron-neutrino appearance at the Far Detector using the Near Detector to control systematic uncertainties; however, the Near Detector is well suited for searching for anomalous short-baseline oscillations. This poster will present a novel method for selecting tau neutrino interactions with high purity at the Near Detector using a convolutional neural network. Using this method, the sensitivity to anomalous short-baseline tau-neutrino appearance due to sterile neutrino oscillations will be presented.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Search for short-baseline oscillations at the NOvA Near Detector

Anomalous results from past neutrino experiments have been interpreted as potential evidence for an additional sterile neutrino with a mass on order of 1 eV, but this evidence remains inconclusive. The NOvA Near Detector is a 300 ton almost fully-active fine- grained liquid scintillator detector, that was designed for electron-neutrino identification. The detector is placed along the Fermilab NuMI beam line 1 km from the target and 14.6 mrad off-axis. At this off-axis angle the detector is exposed to a narrow band beam peaked at 2 GeV. Therefore the NOvA Near Detector will see neutrinos with a L/E range that is sensitive to oscillations between active neutrinos and light sterile neutrinos. In this report we discuss NOvA sensitivity from the joint electron-neutrino disappearance and muon-neutrino disappearance analysis search for short-baseline sterile neutrino mixing.

43 PARTICLE ACCELERATORS↗