Engineering Papers⌕ Search

Engineering topics

Flumerfelt, Eric

Publications and source records attributed to Flumerfelt, Eric.

SULI Project Report: Mu2e otsdaq Documentation and Analytics

This report outlines the history of the CLFV puzzle, gives an overview of the Mu2e Experiment, and details the results of the DOE (Department of Energy)-funded SULI (Science Undergraduate Laboratory Internship) research completed over the summer 2024 on site at Fermilab. The project focused on the otsdaq software responsible for data acquisition. The project included drafting updated documentation for new users, including new procedures relevant for the Alma- Linux 9 operating system update, and the UPS package managing system replacement with Spack (scientific software package manager). A new art module (ReadTriggerCounts) to track trigger rates was created, with compatibility to be displayed via a Grafana server. The author also assisted in calorimeter cable installation in the detector hall.

Saarinen, Talia↗

Mu2e otsdaq Documentation and Online Reconstruction Analytics

This report outlines the results of the DOE-funded SULI (Science Undergraduate Laboratory Internship) research completed over the summer 2024 on site at Fermilab. The project focused on the \textit{otsdaq} software responsible for data acquisition. The project included drafting updated documentation for new users including new procedures relevant for the Alma-Linux 9 operating system update, and the UPS package managing system replacement with spack (scientific software package manager). A new \textit{art} module (ReadTriggerCounts) to track trigger rates was created, with compatibility to be displayed via a Grafana server. The author also assisted in calorimeter cable installation in the detector hall.

Saarinen, Talia↗

Status of the data acquisition, trigger, and slow control systems of the Mu2e experiment at Fermilab

The Mu2e experiment at the Fermilab will search for a coherent neutrinoless conversion of a muon into an electron in the field of an aluminum nucleus with a sensitivity improvement by a factor of 10,000 over existing limits. In this work, the Mu2e Trigger and Data Acquisition System (TDAQ) uses otsdaq framework as the online Data Acquisition System (DAQ) solution. Developed at Fermilab, otsdaq integrates several framework components — an artdaq-based DAQ, an art-based event processing, and an EPICS-based detector control system (DCS), and provides a uniform multi-user interface to its components through a web browser. Data streams from the Mu2e tracker and calorimeter are handled by the artdaq-based DAQ and processed by a one-level software trigger implemented within the art framework. Events accepted by the trigger have their data combined, post-trigger, with the separately read out data from the Mu2e Cosmic Ray Veto system. Foundation of the Mu2e DCS, EPICS – an Experimental Physics and Industrial Control System – is an open-source platform for monitoring, controlling, alarming, and archiving. A prototype of the TDAQ and the DCS systems has been built and tested over the last three years at Fermilab’s Feynman Computing Center, and now the production system installation is underway. This work presents their status and focus on the installation plans and procedures for racks, workstations, network switches, gateway computers, DAQ hardware, slow controls implementation, and testing.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Mu2e DAQ and slow control systems

The Mu2e experiment at the Fermilab Muon Campus will search for the coherent neutrinoless conversion of a muon into an electron in the feld of an aluminum nucleus with a sensitivity improvement by a factor of 10,000 over existing limits. The Mu2e Trigger and Data Acquisition System (TDAQ) uses otsdaq as the online Data Acquisition System (DAQ) solution. Developed at Fermilab, otsdaq integrates both the artdaq DAQ and the art analysis frameworks for event transfer, fltering, and processing. otsdaq is an online DAQ software suite with a focus on fexibility and scalability and provides a multiuser, web-based, interface accessible through a web browser. The data stream from the detector subsystems is read by a software flter algorithm that selects events which are combined with the data fux coming from a Cosmic Ray Veto System. The Detector Control System (DCS) has been developed using the Experimental Physics and Industrial Control System (EPICS) open source platform for monitoring, controlling, alarming, and archiving. The DCS System has been integrated into otsdaq. A prototype of the TDAQ and the DCS systems has been built at Fermilab’s Feynman Computing Center. In this paper, we report on the progress of the integration of this prototype in the online otsdaq software.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Slow control and data acquisition development in the Mu2e experiment

The muon campus program at Fermilab includes the Mu2e experiment that will search for a charged-lepton flavor violating processes where a negative muon converts into an electron in the field of an aluminum nucleus, improving by four orders of magnitude the search sensitivity reached so far.Mu2e’s Trigger and Data Acquisition System (TDAQ) uses {\it otsdaq} solution. Developed at Fermilab, {\it otsdaq} uses the {\it artdaq} DAQ framework and {\it art} analysis framework, for event transfer, filtering, and processing.{\it otsdaq} is an online DAQ software suite with a focus on flexibility and scalability, and provides a multi-user interface accessible through a web browser.A Detector Control System (DCS) for monitoring, controlling, alarming, and archiving has been developed using the Experimental Physics and Industrial Control System (EPICS) open source Platform. The DCS System has also been integrated into {\it otsdaq}, providing a GUI multi-user, web-based control, and monitoring dashboard.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Slow control and data acquisition systems in the Mu2e experiment

The Mu2e experiment at the Fermilab Muon Campus will search for the coherent neutrinolessconversion of a muon into an electron in the field of an aluminum nucleus with a sensitivityimprovement by a factor of 10,000 over existing limits. The Mu2e Trigger and Data AcquisitionSystem (TDAQ) usesotsdaqas the online Data Acquisition System (DAQ) solution. Developed atFermilab,otsdaqintegrates both theartdaqDAQ and theartanalysis frameworks for event transfer,filtering, and processing.otsdaqis an online DAQ software suite with a focus on flexibility andscalability and provides a multi-user, web-based, interface accessible through a web browser. Thedata stream from the detector subsystems is read by a software filter algorithm that selects eventswhich are combined with the data flux coming from a Cosmic Ray Veto System. The DetectorControl System (DCS) has been developed using the Experimental Physics and Industrial ControlSystem (EPICS) open source platform for monitoring, controlling, alarming, and archiving. TheDCS System has been integrated intootsdaq. A prototype of the TDAQ and the DCS systems hasbeen built at Fermilab’s Feynman Computing Center. In this paper, we report on the progress ofthe integration of this prototype in the onlineotsdaqsoftware.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Online DAQ and slow control interface for the Mu2e experiment

The Mu2e experiment at the Fermilab Muon Campus will search for the coherent neutrinolessconversion of a muon into an electron in the field of an aluminum nucleus with a sensitivityimprovement by a factor of 10,000 over existing limits. The Mu2e Trigger and Data AcquisitionSystem (TDAQ) usesotsdaqas the online Data Acquisition System (DAQ) solution. Developed atFermilab,otsdaqintegrates both theartdaqDAQ and theartanalysis frameworks for event transfer,filtering, and processing.otsdaqis an online DAQ software suite with a focus on flexibility andscalability and provides a multi-user, web-based, interface accessible through a web browser. Thedata stream from the detector subsystems is read by a software filter algorithm that selects eventswhich are combined with the data flux coming from a Cosmic Ray Veto System. The DetectorControl System (DCS) has been developed using the Experimental Physics and Industrial ControlSystem (EPICS) open source platform for monitoring, controlling, alarming, and archiving. TheDCS System has been integrated intootsdaq. A prototype of the TDAQ and the DCS systems hasbeen built at Fermilab’s Feynman Computing Center. In this paper, we report on the progress ofthe integration of this prototype in the onlineotsdaqsoftware.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluation of a high-performance storage buffer with 3D XPoint devices for the DUNE data acquisition system

The DUNE detector is a neutrino physics experiment that is expected to take data starting from 2028. The data acquisition (DAQ) system of the experiment is designed to sustain several TB/s of incoming data which will be temporarily buffered while being processed by a software based data selection system. In DUNE, some rare physics processes (e.g. Supernovae Burst events) require storing the full complement of data produced over 1-2 minute window. These are recognised by the data selection system which fires a specific trigger decision. Upon reception of this decision data are moved from the temporary buffers to local, high performance, persistent storage devices. In this paper we characterize the performance of novel 3DXPoint SSD devices under different workloads suitable for high-performance storage applications. We then illustrate how such devices may be applied to the DUNE use-case: to store, upon a specific signal, 100 seconds of incoming data at 1.5 TB/s distributed among 150 identical units each operating at approximately 10GB/s.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Flexible and Scalable Data-Acquisition Using the artdaq Toolkit

The Real-Time Systems Engineering Department of the Scientific Computing Division at Fermilab is developing a flexible, scalable, and powerful data-acquisition (DAQ) toolkit which serves the needs of experiments from bench-top hardware tests to large high-energy physics experiments. The toolkit provides data transport and event building capabilities with the option for experimenters to inject art analysis code at key points in the DAQ for filtering or monitoring. The toolkit also provides configuration management, run control, and low-level hardware communication utilities. Firmware blocks for several commercial data acquisition boards are provided, allowing experimenters to approach the DAQ from a high level. A fully-functional DAQ "solution" of the toolkit is provided in otsdaq, sacrificing some flexibility in favor of being ready-to-use. artdaq is being used for several current and upcoming experiments, and will continue to be refined and expanded for use in the next generation of neutrino and muon experiments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The Fermilab Test Beam Facility Data Acquisition System Based on $otsdaq$

The Real-Time Systems Engineering Department of the Scientific Computing Division at Fermilab has deployed set of customizations to our Off-The-Shelf Data Acquisition solution (otsdaq) at the Fermilab Test Beam Facility (FTBF) to read out the beamline instrumentation in support of FTBF users. In addition to reading out several detectors which use various detection technologies and readout hardware, the FTBF Data Acquisition system (DAQ) can perform basic track reconstruction through the facility in real time and provide data to facility users. An advanced prototype smart coincidence module, known as the NIM+, performs trigger distribution and throttling, allowing the beamline instrumentation to be read out at different rates. Spill data are saved to disk for studies of the facility performance, and hit data are also made available on the FTBF network for experiments' use. A web-based run control and configuration GUI are provided, and the online monitoring snapshots created after each beam spill are viewable from any computer connected to the Fermilab network. The integrated DAQ system for the facility provides users with high-precision tracking data along the beamline and a single location for obtaining data from the facility detectors, which set the baseline for testing their own detectors.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Flexible and Scalable Data-Acquisition Using the $artdaq$ Toolkit [Slides]

The artdaq Toolkit is a data-acquisition (DAQ) framework for use in high-energy physics experiments. Developed at Fermilab, it is the primary DAQ system for Fermilab’s current and next-generation experiments. (1) artdaqi s a single framework used by experiments with radically different DAQ requirements – In addition to those shown below, ICARUS, Fermilab Test Beam Facility (See poster!), SENSEI and other CCD experiments, … (2) otsdaq product is an artdaq-based complete DAQ solution

97 MATHEMATICS AND COMPUTING↗

The Fermilab Test Beam Facility Data Acquisition System Using $otsdaq$

The Fermilab Test Beam Facility is a high-energy test beam used for precision tests of high-energy physics (HEP) detectors. Users include large HEP experiments such as CMS and NOνA, as well as smaller research groups testing novel detector technologies. The beam is variable in energy and intensity, and a target can be inserted into the beam to convert the protons to other particle types for the users.

43 PARTICLE ACCELERATORS↗

artdaq : DAQ software development made simple

For a few years now, the artdaq data acquisition software toolkit has provided numerous experiments with ready-to-use components which allow for rapid development and deployment of DAQ systems. Developed within the Fermilab Scientific Computing Division, artdaq provides data transfer, event building, run control, and event analysis functionality. This latter feature includes built-in support for the art event analysis framework, allowing experiments to run art modules for real-time filtering, compression, disk writing and online monitoring; as art, also developed at Fermilab, is also used for online analysis, a major advantage of artdaq is that it allows developers to easily switch between developing online and online software. artdaq continues to be improved. Support for an alternate mode of running whereby data from some subdetector components are only streamed if requested has been added; this option will reduce unnecessary DAQ throughput. Real-time reporting of DAQ metrics has been implemented, along with the flexibility to choose the format through which experiments receive the reports; these formats include the Ganglia, Graphite and syslog software packages, along with at ASCII files. Additionally, work has been performed investigating more flexible modes of online monitoring, including the capability of being able to run multiple online monitoring processes on different hosts, each running its own set of art modules. Finally, a web-based GUI interface through which users can configure details of their DAQ system has been implemented, increasing the ease of use of the system. Already successfully deployed on the LArIAT, DarkSide-50, DUNE 35ton and Mu2e experiments, artdaq will be employed for SBND and is a strong candidate for use on ICARUS and protoDUNE. With each experiment comes new ideas for how artdaq can be made more flexible and powerful; the above improvements will be described, along with potential ideas for the future.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗