Engineering Papers⌕ Search

Engineering topics

Herner, Kenneth

Publications and source records attributed to Herner, Kenneth.

Darshan for HEP applications

Modern HEP workflows must manage increasingly large and complex data collections. HPC facilities may be employed to help meet these workflows’ growing data processing needs. However, a better understanding of the I/O patterns and underlying bottlenecks of these workflows is necessary to meet the performance expectations of HPC systems.Darshan is a lightweight I/O characterization tool that captures concise views of HPC application I/O behavior. It intercepts application I/O calls at runtime, records file access statistics for each process, and generates log files detailing application I/O access patterns.Typical HEP workflows include event generation, detector simulation, event reconstruction, and subsequent analysis stages. A study of the I/O behavior of the ATLAS simulation and filtering stage, and the CMS simulation workflow using Darshan is presented, including insights into the I/O operations and data access size.

Wang, Rui↗

Accelerating Machine Learning Inference with GPUs in ProtoDUNE Data Processing

Abstract We study the performance of a cloud-based GPU-accelerated inference server to speed up event reconstruction in neutrino data batch jobs. Using detector data from the ProtoDUNE experiment and employing the standard DUNE grid job submission tools, we attempt to reprocess the data by running several thousand concurrent grid jobs, a rate we expect to be typical of current and future neutrino physics experiments. We process most of the dataset with the GPU version of our processing algorithm and the remainder with the CPU version for timing comparisons. We find that a 100-GPU cloud-based server is able to easily meet the processing demand, and that using the GPU version of the event processing algorithm is two times faster than processing these data with the CPU version when comparing to the newest CPUs in our sample. The amount of data transferred to the inference server during the GPU runs can overwhelm even the highest-bandwidth network switches, however, unless care is taken to observe network facility limits or otherwise distribute the jobs to multiple sites. We discuss the lessons learned from this processing campaign and several avenues for future improvements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

SOAR/Goodman Spectroscopic Assessment of Candidate Counterparts of the LIGO/Virgo Event GW190814*

On 2019 August 14 at 21:10:39 UTC, the LIGO/Virgo Collaboration (LVC) detected a possible neutron star–black hole merger (NSBH), the first ever identified. An extensive search for an optical counterpart of this event, designated GW190814, was undertaken using the Dark Energy Camera on the 4 m Victor M. Blanco Telescope at the Cerro Tololo Inter-American Observatory. Target of Opportunity interrupts were issued on eight separate nights to observe 11 candidates using the 4.1 m Southern Astrophysical Research (SOAR) telescope’s Goodman High Throughput Spectrograph in order to assess whether any of these transients was likely to be an optical counterpart of the possible NSBH merger. Here, we describe the process of observing with SOAR, the analysis of our spectra, our spectroscopic typing methodology, and our resultant conclusion that none of the candidates corresponded to the gravitational wave merger event but were all instead other transients. Finally, we describe the lessons learned from this effort. Application of these lessons will be critical for a successful community spectroscopic follow-up program for LVC observing run 4 (O4) and beyond.

79 ASTRONOMY AND ASTROPHYSICS↗

Calibration of the liquid argon ionization response to low energy electronic and nuclear recoils with DarkSide-50

DarkSide-50 has demonstrated the high potential of dual-phase liquid argon time projection chambers in exploring interactions of WIMPs in the GeV=c 2 mass range. The technique, based on the detection of the ionization signal amplified via electroluminescence in the gas phase, allows us to explore recoil energies down to the sub-keV range. We report here on the DarkSide-50 measurement of the ionization yield of electronic recoils down to ~180 eV er , exploiting 37 Ar and 39 Ar decays, and extrapolated to a few ionization electrons with the Thomas-Imel box model. Further, we present a model-dependent determination of the ionization response to nuclear recoils down to ~500 eV nr , the lowest ever achieved in liquid argon, using in situ neutron calibration sources and external datasets from neutron beam experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The Curious Case of PHL 293B: A Long-lived Transient in a Metal-poor Blue Compact Dwarf Galaxy

We report on small-amplitude optical variability and recent dissipation of the unusually persistent broad emission lines in the blue compact dwarf galaxy PHL 293B. The galaxy’s unusual spectral features (P Cygni-like profiles with ~800 km s -1 blueshifted absorption lines) have resulted in conflicting interpretations of the nature of this source in the literature. However, analysis of new Gemini spectroscopy reveals the broad emission has begun to fade after being persistent for over a decade prior. Precise difference imaging light curves constructed with the Sloan Digital Sky Survey and the Dark Energy Survey reveal small-amplitude optical variability of ~0.1 mag in the g band offset by 100 ± 21 pc from the brightest pixel of the host. The light curve is well-described by an active galactic nuclei (AGN)-like damped random walk process. However, we conclude that the origin of the optical variability and spectral features of PHL 293B is due to a long-lived stellar transient, likely a Type IIn supernova or nonterminal outburst, mimicking long-term AGN-like variability. This work highlights the challenges of discriminating between scenarios in such extreme environments, relevant to searches for AGNs in dwarf galaxies. This is the second long-lived transient discovered in a blue compact dwarf, after SDSS1133. Furthermore, our result implies such long-lived stellar transients may be more common in metal-deficient galaxies. Systematic searches for low-level variability in dwarf galaxies will be possible with the upcoming Legacy Survey of Space and Time at the Vera C. Rubin Observatory.

79 ASTRONOMY AND ASTROPHYSICS↗

Effective field theory interactions for liquid argon target in DarkSide-50 experiment

We reanalize data collected with the DarkSide-50 experiment and recently used to set limits on the spin-independent interaction rate of weakly interacting massive particles (WIMPs) on argon nuclei with an effective field theory framework. The dataset corresponds to a total (16660 ± 270) kg d exposure using a target of low-radioactivity argon extracted from underground sources. We obtain upper limits on the effective couplings of the 12 leading operators in the nonrelativistic systematic expansion. For each effective coupling we set constraints on WIMP-nucleon cross sections, setting upper limits between 2.4×10-45 cm2 and 2.3×10-42 cm2 (8.9 ×10-45 cm2 and 6.0 ×10-42 cm2) for WIMPs of mass of 100 GeV/c2 (1000 GeV/c2) at 90% confidence level.

Agnes, P↗

Production Operations Management System (POMS) for Fermilab Experiments

The Production Operations Management System (POMS) software allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs, and currently manages the majority of production computing of experiments at Fermilab.POMS provides a web service interface that enables automated job submission on distributed resources according to customers’ requests, as well as subsequent monitoring of those submissions as well as recovery of failed submissions, debugging and record keeping.POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub (for job submission), SAM (for data management), and Landscape (for monitoring), and in combination with them handles the creation of intermediate datasets of files for multistage campaigns.POMS visualizes these campaigns with an interactive GUI interface. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign.This paper will discuss the current usage, history, and some technical details of POMS, as well as planned future extensions, particularly interfacing with Rucio as well as SAM for file movement.

Mengel, Marc↗

Measurement of the ion fraction and mobility of 218Po produced in 222Rn decays in liquid argon

We report measurements of the charged daughter fraction of 218Po as a result of the 222Rn alpha decay, and the mobility of 218Po+ ions, using radon-polonium coincidences from the 238U chain identified in 532 live-days of DarkSide-50 WIMP-search data. The fraction of 218Po that is charged is found to be 0.37 ± 0.03 and the mobility of 218Po+ is (8.6 ± 0.1) × 10-4 cm2/Vs.

Agnes, P↗

FERRY Frontier Experiments RegistRY

The Frontier Experiments RegistRY (FERRY) service provides a centralized repository for the access control and job management attributes such as batch and storage access policies, quotas, batch priorities and NIS attributes for cluster configuration...

Altunay, Mine↗

Interesting Objects Found while Searching for Hot DAs

We have been searching for southern hemisphere hot DA white dwarfs for roughly the past 10 years. We are using these stars to refine the absolute (color) calibration of the Dark Energy Survey (DES). Along the way however, we have run across an assortment of interesting (to someone) objects which include quasars, magnetic DAs, coolish DAs, a CV, and several non-DAs. We present some of them here; some with results of follow-up observations. Some we are still following ourselves.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Advances and Enhancements in the Fabric for Frontier Experiments Project at Fermilab

The FabrIc for Frontier Experiments (FIFE) project within the Fermilab Scientific Computing Division is charged with integrating offline computing components into a common computing stack for the non-LHC Fermilab experiments, supporting experiment offline computing, and consulting on new, novel workflows. We will discuss the general FIFE onboarding strategy, the upgrades and enhancements in the FIFE toolset, and plans for the coming year. These enhancements include: expansion of opportunistic computing resources (including GPU and high-performance computing resources) available to experiments; assistance with commissioning computing resources at European sites for individual experiments; StashCache repositories for experiments; enhanced job monitoring tools; and a custom workflow management service. Additionally we have completed the first phase of a Federated Identity Management system to make it easier for FIFE users to access Fermilab computing resources.

Herner, Kenneth↗

Cosmology with Gravitational Waves in DES and LSST

Motivated by the prospect of the wealth of data arising from the inauguration of the era of gravitational wave detection by ground-based interferometers the DES collaboration, in partnership with members of the LIGO collaboration and members of the astronomical commu- nity at large, have established a research program to search for their optical counterparts and to explore their use as cosmological probes. In this talk we present the status of our program and discuss prospects for establishing this new probe as part of the portfolio of the Dark Energy research program in the future, in particular for the next generation survey, LSST.

Herner, Kenneth↗

Higgs boson studies at the tevatron

We present the combination of searches for the Standard Model Higgs boson at a center-of-mass energy of √s = 1.96 TeV , using the full Run 2 dataset collected with the CDF and D0 detectors at the Fermilab Tevatron collider. We also present combined measurements of Higgs Boson production cross sections, branching ratios, and couplings to fermions and bosons. Lastly, we present tests of different spin and parity hypotheses for a particle H of mass 125 GeV produced in association with a vector boson and decaying into a pair of b quarks, and place constraints on such hypotheses using the D0 data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Progress on the FabrIc for Frontier Experiments project at Fermilab

The FabrIc for Frontier Experiments (FIFE) project is an ambitious, major-impact initiative within the Fermilab Scientific Computing Division designed to lead the computing model for Fermilab experiments. FIFE is a collaborative effort between experimenters and computing professionals to design and develop integrated computing models for experiments of varying needs and infrastructure. The major focus of the FIFE project is the development, deployment, and integration of Open Science Grid solutions for high throughput computing, data management, database access and collaboration within experiment. To accomplish this goal, FIFE has developed workflows that utilize Open Science Grid sites along with dedicated and commercial cloud resources. The FIFE project has made significant progress integrating into experiment computing operations several services including new job submission services, software and reference data distribution through CVMFS repositories, flexible data transfer client, and access to opportunistic resources on the Open Science Grid. Hence, the progress with current experiments and plans for expansion with additional projects will be discussed. FIFE has taken a leading role in the definition of the computing model for Fermilab experiments, aided in the design of computing for experiments beyond Fermilab, and will continue to define the future direction of high throughput computing for future physics experiments worldwide

97 MATHEMATICS AND COMPUTING↗