Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SERVER”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

The Sloan Digital Sky Survey Quasar Catalog: Twelfth data release

In this paper, we present the Data Release 12 Quasar catalog (DR12Q) from the Baryon Oscillation Spectroscopic Survey (BOSS) of the Sloan Digital Sky Survey III. This catalog includes all SDSS-III/BOSS objects that were spectroscopically targeted as quasar candidates during the full survey and that are confirmed as quasars via visual inspection of the spectra, have luminosities M i [z = 2] < -20.5 (in a ΛCDM cosmology with H 0 = 70 km s -1 Mpc -1 , Ω M = 0.3, and Ω Λ = 0.7), and either display at least one emission line with a full width at half maximum (FWHM) larger than 500 km s -1 or, if not, have interesting/complex absorption features. The catalog also includes previously known quasars (mostly from SDSS-I and II) that were reobserved by BOSS. The catalog contains 297 301 quasars (272 026 are new discoveries since the beginning of SDSS-III) detected over 9376 deg 2 with robust identification and redshift measured by a combination of principal component eigenspectra. The number of quasars with z > 2.15 (184 101, of which 167 742 are new discoveries) is about an order of magnitude greater than the number of z > 2.15 quasars known prior to BOSS. Redshifts and FWHMs are provided for the strongest emission lines (C iv, C iii], Mg ii). The catalog identifies 29 580 broad absorption line quasars and lists their characteristics. For each object, the catalog presents five-band (u, g, r, i, z) CCD-based photometry with typical accuracy of 0.03 mag together with some information on the optical morphology and the selection criteria. When available, the catalog also provides information on the optical variability of quasars using SDSS and Palomar Transient Factory multi-epoch photometry. The catalog also contains X-ray, ultraviolet, near-infrared, and radio emission properties of the quasars, when available, from other large-area surveys. The calibrated digital spectra, covering the wavelength region 3600–10 500 Å at a spectral resolution in the range 1300 < R < 2500, can be retrieved from the SDSS Catalog Archive Server. Finally, we also provide a supplemental list of an additional 4841 quasars that have been identified serendipitously outside of the superset defined to derive the main quasar catalog.

79 ASTRONOMY AND ASTROPHYSICS↗

How galaxies populate halos in extreme density environments: An analysis of the halo occupation distribution in SDSS

Recent works have shown that the properties of galaxy populations in simulated dark matter halos vary with large-scale environments. These results suggest a variation in the halo occupation distribution (HOD) in extreme density environments since the dynamical and astrophysical conditions prevailing in these regions may significantly affect the formation and evolution of their halos and residing galaxies, influencing the mean number of satellite galaxies. To analyse these effects, we identify cosmic voids and future virialised structures (FVS) in the Sloan Digital Sky Server Data Release 12 (SDSS-DR12) and estimate the HOD within these super-structures using group catalogues as dark matter halo proxies. Our goal is to use observational galaxy data to characterise the HOD within cosmic voids and FVS, explore the different properties of these galaxies populations and compare them with the general results outside these super-structures. We use a publicly available observational galaxy catalogue with information on redshifts, positions, magnitudes and other astrophysical features to build a volume complete galaxy sample and identify cosmic voids and FVS. Using a publicly available galaxy group catalogue as a proxy to dark matter halos, we compute the HOD within both types of super-structures for different absolute magnitude thresholds. We also study the dependence on the results on the main void and FVS properties, density and volume. We also analysed the main characteristics of the stellar content of galaxies inside these extreme-density regions such as the mean stellar age and the galaxy light concentration index. In all cases, we compare the results with those derived from the Field sample, defined by objects outside both types of environments. Inside cosmic voids, we find a strong decrease in HOD concerning the Field results. In the most extreme cases, the mean number of satellites fall to ~ 50%. Inside FVS, the HOD shows a significant increase to the Field, with a ~ 40% excess in the mean number of satellites. These results are present for the different galaxy luminosity ranges explored. In both environments, the differences with respect to the Field increases for the extreme values of the density environments. However, we obtain no signs of variations related to intrinsic characteristics of the super-structures, indicating that the effects depend mainly on the density of the large-scale environment. In addition, we find that the cumulative distribution of the mean age of stars of the central galaxy also varies in the different regions, this suggests that the history of the formation of the dark matter halos may be different. Finally, we explore the HOD for the 25% youngest (oldest) galaxies, based on the mean age of their stars. We find that for the low-mass groups the youngest galaxies are only present inside voids and are generally central galaxies. On the other hand, for the high-mass groups the FVS environments show the same increase in the HOD concerning the Field as previously mentioned. We find that cosmic voids lack a significant fraction of galaxies with the oldest stellar population.

79 ASTRONOMY AND ASTROPHYSICS↗

Understanding the evolution of conditions data access through Frontier for the ATLAS Experiment

The ATLAS Distributed Computing system uses the Frontier system to access the Conditions, Trigger, and Geometry database data stored in the Oracle Offline Database at CERN by means of the HTTP protocol. All ATLAS computing sites use Squid web proxies to cache the data, greatly reducing the load on the Frontier servers and the databases. One feature of the Frontier client is that in the event of failure, it retries with different services. While this allows transient errors and scheduled maintenance to happen transparently, it does open the system up to cascading failures if the load is high enough. Throughout LHC Run 2 there has been an ever increasing demand on the Frontier service. There have been multiple incidents where parts of the service failed due to high load. A significant improvement in the monitoring of the Frontier service was required. The monitoring was needed to identify both problematic tasks, which could then be killed or throttled, and to identify failing site services as the consequence of a cascading failure is much higher. This presentation describes the implementation and features of the monitoring system.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

dCache - Joining the noWORM Storage Club

For over a decade, dCache.ORG has provided robust software, called dCache, that is used at more than 80 universities and research institutes around the world, allowing these sites to provide reliable storage services for the WLCG experiments and many other scientific communities. The flexible architecture of dCache allows running it in a wide variety of configurations and platforms - from all-in-one Raspberry-Pi up to hundreds of nodes in multi-petabyte infrastructures. The life cycle of scientific data is well defined - collected, processed, archived and finally deleted, when it’s not needed anymore. Moreover, during all those stages the data is never modified: either the original data is used, or new derived data is produced. With this knowledge, dCache was designed to handle immutable files as efficiently as possible. Data replication, HSM connectivity and data-server independent operations are only possible due to the immutable nature of stored data. Nowadays many commercial vendors provide such write-once-read-many or WORM storage systems, as they become more and more demanded with grown demand of audio, photo and video content in the web. On the other hand by providing standard NFSv4.1 interface dCache is often used as a general-purpose file-system, especially by new communities, like photon scientists or microbiologists. Although many users are aware of data immutability, some applications and use cases still require in-place updates of stored files. To satisfy new requirements some fundamental changes have to be applied to dCache’s core design. However, new developments must not compromise any aspect of existing functionality. In this presentation we will show new developments in dCache to turn it into a regular file system. We will discuss the challenges to build a distributed storage system, ‘life’ with POSIX compliance, handling of multiple replicas and backward compatibility by providing WORM and noWORM capabilities within the same storage system.

Mkrtchyan, Tigran↗

Performance of the Belle II Conditions Database

The Belle II experiment at KEK observed its first collisions in the summer of 2018. Processing the large amounts of data that will be produced requires conditions data to be readily available to systems worldwide in a fast and efficient manner that is straightforward for both the user and maintainer. This was accomplished by relying on industry-standard tools and methods: the conditions database is built as an HTTP REST service using tools such as Swagger for the API interface development, Payara for the Java EE application server, and Squid for the caching proxy. This article presents the design of the Belle II conditions database production environment as well as details about the capabilities and performance during both Monte Carlo campaigns and data reprocessing.

Wood, Lynn S.↗

RDataFrame: Easy Parallel ROOT Analysis at 100 Threads

The Physics programmes of LHC Run III and HL-LHC challenge the HEP community. The volume of data to be handled is unprecedented at every step of the data processing chain: analysis is no exception. Physicists must be provided with first-class analysis tools which are easy to use, exploit bleeding edge hardware technologies and allow to seamlessly express parallelism. This document discusses the declarative analysis engine of ROOT, RDataFrame, and gives details about how it allows to profitably exploit commodity hardware as well as high-end servers and manycore accelerators thanks to the synergy with the existing parallelised ROOT components. Real-life analyses of LHC experiments’ data expressed in terms of RDataFrame are presented, highlighting the programming model provided to express them in a concise and powerful way. The recent developments which make RDataFrame a lightweight data processing framework are described, such as callbacks and I/O capabilities. Finally, the flexibility of RDataFrame and its ability to read data formats other than ROOT’s are characterised, as an example it is discussed how RDataFrame can directly read and analyse LHCb’s raw data format MDF.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DUNE DAQ R&D integration in ProtoDUNE Single-Phase at CERN

The DAQ system of ProtoDUNE-SP successfully proved its design principles and met the requirements of the beam run of 2018. The technical design of the DAQ system for the DUNE experiment has major differences compared to the prototype due to different requirements placed on the detector, as well as a radically different location of operation. The single-phase prototype at CERN is a major integration facility for R&D aspects of the DUNE DAQ system. The facility allows for the exploration of additional data processing capabilities and optimization of the FELIX system, which is the chosen TPC readout solution for the DUNE single-phase detectors. One of the fundamental differences from the prototype is that the DUNE DAQ relies on self-triggering. Therefore, real-time processing of the data stream for hit and trigger primitive finding is essential for the requirement of continuous readout. The supernova burst trigger requires a large and fast buffering technique, where 3D XPoint persistent memory solutions are evaluated and integrated. In order to maximize resource utilization of the FELIX hosting servers, the elimination of the 100 Gb network communication stack is desired. This implies the design and development of a single-host application layer, which is a fundamental element of the self-triggering chain. This paper discusses the evaluation and integration of these developments for the DUNE DAQ, in the ProtoDUNE environment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Third-party transfers in WLCG using HTTP

Since its earliest days, the Worldwide LHC Computational Grid (WLCG) has relied on GridFTP to transfer data between sites. The announcement that Globus is dropping support of its open source Globus Toolkit (GT), which forms the basis for several FTP client and servers, has created an opportunity to reevaluate the use of FTP. HTTP-TPC, an extension to HTTP compatible with WebDAV, has arisen as a strong contender for an alternative approach.In this paper, we describe the HTTP-TPC protocol itself, along with the current status of its support in different implementations, and the interoperability testing done within the WLCG DOMA working group’s TPC activity. This protocol also provides the first real use-case for token-based authorisation for this community. We will demonstrate the benefits of such authorisation by showing how it allows HTTP-TPC to support new technologies (such as OAuth, OpenID Connect, Macaroons and SciTokens) without changing the protocol. We will also discuss the next steps for HTTP-TPC and the plans to use the protocol for WLCG transfers.

Bockelman, Brian↗

Kubernetes for the Deep Underground Neutrino Experiment Data Acquisition

The Deep Underground Neutrino Experiment (DUNE) is a next-generation long-baseline neutrino experiment based in the USA which is expected to start taking data in 2029. DUNE aims to precisely measure neutrino oscillation parameters by detecting neutrinos from the LBNF beamline (Fermilab) at the Far Detector, 1,300 kilometres away, in South Dakota at the Sanford Underground Research Facility. The Far Detector will consist of four cryogenic Liquid Argon Time Projection Chamber detectors of 17 kT, each producing more than 1 TB/sec of data. The main requirements for the data acquisition system are the ability to run continuously for extended periods of time, with a 99% up-time requirement, and the functionality to record both beam neutrinos and low energy neutrinos from the explosion of a neighbouring supernova, should one occur during the lifetime of the experiment. The key challenges are the high data rates that the detectors generate and the deep underground environment, which places constraints on power and space. To overcome these challenges, DUNE plans to use a highly optimised C++ software suite and a server farm of about 110 nodes continuously running about two hundred multicore processes located close to the detector, 1.5 kilometres underground. Thirty nodes will be at the surface and will run around two hundred processes simultaneously. DUNE is studying the use of the Kubernetes framework to manage containerised workloads and take advantage of its resource definitions and high up-time services to run the DAQ system. Progress in deploying these systems at the CERN neutrino platform on the prototype DUNE experiments is reported.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evolution of the ATLAS TDAQ online software framework towards Phase-II upgrade: Use of Kubernetes as an orchestrator of the ATLAS Event Filter computing farm

The ATLAS experiment at the LHC at CERN continuously evolves its TDAQ system to meet the challenges of new physics goals and technological advancements. As ATLAS prepares for the Phase-II Run 4 of the LHC, significant enhancements in the TDAQ Controls and Configuration (TDAQ-CC) tools have been designed to ensure efficient data collection, processing, and management. This abstract presents the evolution of ATLAS TDAQ-CC system leading up to Phase-II Run 4. As part of the evolution towards Phase-II, Kubernetes has been chosen to orchestrate the Event Filter (EF) farm. By leveraging Kubernetes, ATLAS can dynamically allocate computing resources, scale processing capacity in response to changing data taking conditions and ensure high availability of data processing services. The integration of the Kubernetes with the TDAQ Run Control framework enables perfect synchronisation between the experiment’s data acquisition components and the computing infrastructure. We will discuss the architectural considerations and implementation challenges involved in Kubernetes integration with the ATLAS TDAQ-CC system. We will highlight the benefits of using Kubernetes as an EF farm orchestrator, including improved resource utilization, enhanced fault tolerance, and simplified deployment and management of data processing workflows. In addition, we will report on the extensive testing of Kubernetes that was conducted using a farm of 2500 servers within the experiment data taking environment, demonstrating its scalability and robustness in handling the demands of the ATLAS TDAQ system for Phase-II. The adoption of Kubernetes represents a significant step forward in the evolution of ATLAS TDAQ-CC system, aligning with industry best practices in container orchestration.

Corso Radu, Alina [Univ. of California, Irvine, CA↗

dCache CI/CD migration to Kubernetes

For over two decades, the dCache project has provided open-source to satisfy ever-more demanding storage requirements. More than 80 sites worldwide rely on dCache to provide services for LHC experiments, Belle-II, Eu- XFEL, and others. This can be achieved only with a well-established process from a whiteboard, where ideas are created through development, packaging, and testing. The project’s build and test infrastructure is based on Jenkins CI and a set of virtual machines. This infrastructure is maintained by dCache developers. With the introduction of the DESY-central Gitlab server, the developers have started migrating from VM-based testing to container-based deployments in the onsite Kubernetes cluster. As a result, we have packaged dCache containers and Helm charts that can be used by other sites to reproduce our test and build steps quickly or to evaluate new releases on their pre-production systems and, eventually, become a standard model of dCache deployment at the sites. This paper describes the challenges we have faced, the techniques we used to solve them, and the issues that still need to be addressed.

Mkrtchyan, Tigran [DESY]↗

HEPCloud Operations at Fermilab—The First Five Years

The HEPCloud Facility at Fermilab has now been in production operation for five years. This facility is a unified provisioning gateway to US high performance computing centers, including NERSC, OLCF, and ALCF, other large supercomputers run by the NSF, and commercial clouds. HEPCloud delivers hundreds of millions of core-hours yearly for CMS. HEPCloud also serves other Fermilab experiments including DUNE, Mu2e, Muon g-2, and NOvA. In this paper we present the practical considerations of operating a distributed facility such as HEPCloud. We also mention some of the interesting research and development that HEPCloud has been used for including GPU-based machine learning inference servers, and tests of Quantum Computing.

Timm, Steven [Fermilab]↗

The Data Acquisition System For Multichannel Spectrometer On Base Of The NGDP Framework

In present work it is proposed to implement the data acquisition system (DAQ COMBAS) for the fragment--separator COMBAS under freely distributed UNIX--like operating system (OS) FreeBSD on base of the ngdp framework, which allows to build modular distributed DAQ. As a CAMAC subsystem the camac package (DLNP JINR) is used, which encapsulates code deals with each supported crate controller into corresponding driver. Authors create the driver kh(4) for the PCI adapter of the CC02 controller (Karazin Kharkov National University). The runtime configurable r2h(1) histogram server module is supposed. The histGUI(1) client module is intended for histograms viewing as well as for r2h(1) runtime control and configurating. The histGUI(1) client will not depend on DAQ and ngdp system libraries, so can be compiled under any OS equipped by the ROOT package.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Development and Application of the STARS-based Beamline Control System at the Photon Factory

STARS{sup [1-2]}(Simple Transmission and Retrieval System) is a message transferring software for small-scale control systems with TCP/IP sockets, originally developed at the Photon Factory (PF). Because it has a server-client architecture using TCP/IP sockets and can work on various types of operating systems, the design and application are quite flexible. We have developed a common low-level beamline control system based on the STARS technology. Many kinds of useful STARS clients (device drivers, data acquisitions, user interfaces etc.) are available now, and so far, the system has been installed at 22 PF beamlines. We will describe the development and generalize of the STARS-based beamline control system at the PF.

43 PARTICLE ACCELERATORS↗

Communication: A reduced scaling J-engine based reformulation of SOS-MP2 using graphics processing units

We present a low-prefactor, cubically scaling scaled-opposite-spin second-order Møller-Plesset perturbation theory (SOS-MP2) method which is highly suitable for massively parallel architectures like graphics processing units (GPU). The scaling is reduced from O(N{sup 5}) to O(N{sup 3}) by a reformulation of the MP2-expression in the atomic orbital basis via Laplace transformation and the resolution-of-the-identity (RI) approximation of the integrals in combination with efficient sparse algebra for the 3-center integral transformation. In contrast to previous works that employ GPUs for post Hartree-Fock calculations, we do not simply employ GPU-based linear algebra libraries to accelerate the conventional algorithm. Instead, our reformulation allows to replace the rate-determining contraction step with a modified J-engine algorithm, that has been proven to be highly efficient on GPUs. Thus, our SOS-MP2 scheme enables us to treat large molecular systems in an accurate and efficient manner on a single GPU-server.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Evaluation of stochastic algorithms for financial mathematics problems from point of view of energy-efficiency

The recent developments in the area of high-performance computing are driven not only by the desire for ever higher performance but also by the rising costs of electricity. The use of various types of accelerators like GPUs, Intel Xeon Phi has become mainstream and many algorithms and applications have been ported to make use of them where available. In Financial Mathematics the question of optimal use of computational resources should also take into account the limitations on space, because in many use cases the servers are deployed close to the exchanges. In this work we evaluate various algorithms for option pricing that we have implemented for different target architectures in terms of their energy and space efficiency. Since it has been established that low-discrepancy sequences may be better than pseudorandom numbers for these types of algorithms, we also test the Sobol and Halton sequences. We present the raw results, the computed metrics and conclusions from our tests.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Upgrading of data acquisition software for centralized radiation monitoring system in Malaysian Nuclear Agency

With the growth of technology, many devices and equipments can be connected to the network and internet to enable online data acquisition for real-time data monitoring and control from monitoring devices located at remote sites. Centralized radiation monitoring system (CRMS) is a system that enables area radiation level at various locations in Malaysian Nuclear Agency (Nuklear Malaysia) to be monitored centrally by using a web browser. The Local Area Network (LAN) in Nuclear Malaysia is utilized in CRMS as a communication media for data acquisition of the area radiation levels from radiation detectors. The development of the system involves device configuration, wiring, network and hardware installation, software and web development. This paper describes the software upgrading on the system server that is responsible to acquire and record the area radiation readings from the detectors. The recorded readings are called in a web programming to be displayed on a website. Besides the main feature which is acquiring the area radiation levels in Nuclear Malaysia centrally, the upgrading involves new features such as uniform time interval for data recording and exporting, warning system and dose triggering.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗