Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Development of an open-source regional data assimilation system in PEcAn v. 1.7.2: application to carbon cycle reanalysis across the contiguous US using SIPNET

Abstract. The ability to monitor, understand, and predict the dynamics of the terrestrial carbon cycle requires the capacity to robustly and coherently synthesize multiple streams of information that each provide partial information about different pools and fluxes. In this study, we introduce a new terrestrial carbon cycle data assimilation system, built on the PEcAn model–data eco-informatics system, and its application for the development of a proof-of-concept carbon “reanalysis” product that harmonizes carbon pools (leaf, wood, soil) and fluxes (GPP, Ra, Rh, NEE) across the contiguous United States from 1986–2019. We first calibrated this system against plant trait and flux tower net ecosystem exchange (NEE) using a novel emulated hierarchical Bayesian approach. Next, we extended the Tobit–Wishart ensemble filter (TWEnF) state data assimilation (SDA) framework, a generalization of the common ensemble Kalman filter which accounts for censored data and provides a fully Bayesian estimate of model process error, to a regional-scale system with a calibrated localization. Combined with additional workflows for propagating parameter, initial condition, and driver uncertainty, this represents the most complete and robust uncertainty accounting available for terrestrial carbon models. Our initial reanalysis was run on an irregular grid of ∼ 500 points selected using a stratified sampling method to efficiently capture environmental heterogeneity. Remotely sensed observations of aboveground biomass (Landsat LandTrendr) and leaf area index (LAI) (MODIS MOD15) were sequentially assimilated into the SIPNET model. Reanalysis soil carbon, which was indirectly constrained based on modeled covariances, showed general agreement with SoilGrids, an independent soil carbon data product. Reanalysis NEE, which was constrained based on posterior ensemble weights, also showed good agreement with eddy flux tower NEE and reduced root mean square error (RMSE) compared to the calibrated forecast. Ultimately, PEcAn's new open-source regional data assimilation framework provides a scalable workflow for harmonizing multiple data constraints and providing a uniform synthetic platform for carbon monitoring, reporting, and verification (MRV) as well as accelerating terrestrial carbon cycle research.

54 ENVIRONMENTAL SCIENCES↗

SU-E-T-599: Patient Safety Enhancements Through a Study of R&V System Override Data

Purpose: Record and verify (R&V) software systems include safety checks that compare actual machine parameters with prescribed values for a patient’s treatment, such as treatment couch position, linac, energy, and MUs. The therapist is warned of a mismatch with a pop-up and prompted to approve an override in order to continue without changes. Override approval is often legitimate, but the pop-up can also genuinely indicate a problem that would Result in the wrong treatment. When there are numerous pop-up warnings, human nature leads us to approve any override without careful reading, undermining the effectiveness of the safety mechanism. Methods: Override data was collected from our R&V system for all patients treated between October 8 and 29, 2012, on four linacs and entered into a spreadsheet. Additional data collected included treatment technique, disease site, immobilization, time, linac, and whether localization images were obtained. Data were analyzed using spreadsheet tools to reveal trends, patterns and associations that might suggest appropriate process changes that could decrease the total number of overrides. Results: 76 out of 113 patients had overrides. Out of the 944 treatments, 599 override items were generated. The majority were due to couch positions. 74 of the 84 overrides on a linac equipped with a 6D couch were due to the use of the rotational corrections and the fact that the 6D couch control does not communicate with the R&V system; translations required to rotate the couch appear to the R&V system as translations outside the tolerance range. Conclusion: Many findings were interesting but did not suggest a process change. Proposed process changes include creating site-specific instead of just technique-specific tolerance tables for couch shifts. Proposed improvements to the vendor are to facilitate direct communication between the 6D couch and the R&V system to eliminate those override warnings related to lack of communication.

61 RADIATION PROTECTION AND DOSIMETRY↗

Real-time performance of commercial Intel-based VME Controllers for the CODA data acquisition system

We have evaluated the performance of several Intel-based VME Controllers for the use in the data acquisition systems (DAQs) at Jefferson Lab. For the 12 GeV upgrade, PPC-based VME controllers running vxWorks will be replaced with those that are Intel-based running Linux. Their task will be facilitated by the use of FPGAs on the VME modules to perform trigger logic and communicating trigger information over serial and fiber connections through the DAQ. The need for a hard realtime operating system on the VME controller is removed from the equation as the readout of the digitized data from the VME modules (using VME-2eSST) is done in a threaded environment with multiple CPU cores while digitization takes place in the buffered, pipelined system. In this paper we brief discuss the 12 GeV Hall D DAQ and the requirements of the VME Controller. We present results from baseline testing of various models from different vendors using different Linux kernels, including results from a kernel compiled with the CONFIG_PREEMPT_RT patch.

Moffit, Bryan↗

A triggerless digital data acquisition system for nuclear decay experiments

In nuclear decay experiments an important goal of the Data Acquisition (DAQ) system is to allow the reconstruction of time correlations between signals registered in different detectors. Classically DAQ systems are based in a trigger that starts the event acquisition, and all data related with the event of that trigger are collected as one compact structure. New technologies and electronics developments offer new possibilities to nuclear experiments with the use of sampling ADC-s. This type of ADC-s is able to provide the pulse shape, height and a time stamp of the signal. This new feature (time stamp) allows new systems to run without an event trigger. Later, the event can be reconstructed using the time stamp information. In this work we present a new DAQ developed for {beta}-delayed neutron emission experiments. Due to the long moderation time of neutrons, we opted for a self-trigger DAQ based on commercial digitizers. With this DAQ a negligible acquisition dead time was achieved while keeping a maximum of event information and flexibility in time correlations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Recent Experience with the CMS Data Management System

The CMS[1] experiment manages a large-scale data infrastructure, currently handling over 200 PB of disk and 500 PB of tape storage and transferring more than 1 PB of data per day on average between various WLCG[2] sites. Utilizing Rucio[3] for high-level data management, FTS[4] for data transfers, and a variety of storage and network technologies at the sites, CMS confronts inevitable challenges due to the system’s growing scale and evolving nature. Key challenges include managing transfer and storage failures, optimizing data distribution across different storages based on production and analysis needs, implementing necessary technology upgrades and migrations, and efficiently handling user requests. The data management team has established comprehensive monitoring to supervise this system and has successfully addressed many of these challenges. The team’s efforts aim to ensure data availability and protection, minimize failures and manual interventions, maximize transfer throughput and resource utilization, and provide reliable user support. This paper details the operational experience of CMS with its data management system in recent years, focusing on the encountered challenges, the effective strategies employed to overcome them and the ongoing challenges as we prepare for future demands.

Öztürk, Hasan [CERN]↗

Hybrid data storage system in an HPC exascale environment

A computer-executable method, system, and computer program product for managing I/O requests from a compute node in communication with a data storage system, including a first burst buffer node and a second burst buffer node, the computer-executable method, system, and computer program product comprising striping data on the first burst buffer node and the second burst buffer node, wherein a first portion of the data is communicated to the first burst buffer node and a second portion of the data is communicated to the second burst buffer node, processing the first portion of the data at the first burst buffer node, and processing the second portion of the data at the second burst buffer node.

97 MATHEMATICS AND COMPUTING↗

The MINER$\nu$A Data Acquisition System and Infrastructure

MINERvA (Main INjector ExpeRiment v-A) is a new few-GeV neutrino cross-section experiment that began taking data in the FNAL NuMI (Fermi National Accelerator Laboratory Neutrinos at the Main Injector) beam-line in March of 2010. MINERvA employs a fine-grained scintillator detector capable of complete kinematic characterization of neutrino interactions. This paper describes the MINERvA data acquisition system (DAQ) including the readout electronics, software, and computing architecture.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Development and evaluation of a new 4DEnVar-based weakly coupled ocean data assimilation system in E3SMv2

The development, implementation, and evaluation of a new weakly coupled ocean data assimilation (WCODA) system for the fully coupled Energy Exascale Earth System Model version 2 (E3SMv2) utilizing the four-dimensional ensemble variational (4DEnVar) method are presented in this study. The 4DEnVar method, based on the dimension-reduced projection four-dimensional variational (DRP-4DVar) approach, replaces the adjoint model with the ensemble technique, thereby reducing computational demands. Monthly mean ocean temperature and salinity data from the EN4.2.1 reanalysis are integrated into the ocean component of E3SMv2 from 1950 to 2021 with the goal of providing realistic initial conditions for decadal predictions and predictability studies. The performance of the WCODA system is assessed using various metrics, including the reduction rate of the cost function, root mean square error (RMSE) differences, correlation differences, and model biases. Results indicate that the WCODA system effectively assimilates the reanalysis data into the climate model, consistently achieving negative reduction rates of the cost function and notable improvements in RMSE and correlation across various ocean layers and regions. Significant enhancements are observed in the upper ocean layers across the majority of global ocean regions, particularly in the north Atlantic, north Pacific, and Indian Ocean. Model biases in sea surface temperature and salinity are also substantially reduced. For sea surface temperature, cold biases in the north Pacific and north Atlantic are diminished by about 1–2 °C, and warm biases in the Southern Ocean are corrected by approximately 1.5–2.5 °C. In terms of salinity, improvements are observed with bias reductions of about 0.5–1 psu in the north Atlantic and north Pacific and up to 1.5 psu in parts of the Southern Ocean. The ultimate goal of the WCODA system is to advance the predictive capabilities of E3SM for subseasonal to decadal climate predictions, thereby supporting research on strategic energy-sector policies and planning.

54 ENVIRONMENTAL SCIENCES↗

NJOY21: A Successor to the NJOY Nuclear Data Processing System

NJOY21 is an initiative at Los Alamos National Laboratory (LANL) to develop software to succeed the NJOY nuclear data processing system. Specifically, the aim of the project is to provide: - a stand-alone executable for nuclear data processing in the vein of the original NJOY and, - a hierarchy of reusable loosely-coupled, object-oriented component libraries. The name NJOY21 was chosen to denote a commitment to provide software suitable for the 21. Century; integrating modern development practices and tools from the inception of the project. This summary will expand upon the current goals and design of the project. Before going onto discuss NJOY21, it is worthwhile to briefly establish the historical context and motivating factors. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The ATLAS Data Management System Rucio: Supporting LHC Run-2 and beyond

With this contribution we present some recent developments made to Rucio, the data management system of the High-Energy Physics Experiment ATLAS. Already managing 300 Petabytes of both official and user data, Rucio has seen incremental improvements throughout LHC Run-2, and is currently laying the groundwork for HEP computing in the HL-LHC era. The focus of this contribution are (a) the automations that have been put in place such as data rebalancing or dynamic replication of user data, as well as their supporting infrastructures such as real-time networking metrics or transfer time predictions; (b) the flexible approach towards inclusion of heterogeneous storage systems, including object stores, while unifying the potential access paths using generally available tools and protocols; (c) machine learning approaches to help with transfer throughput estimation; and (d) the adoption of Rucio for two other experiments, AMS and Xenon1t. We conclude by presenting operational numbers and figures to quantify these improvements, and extrapolate the necessary changes and developments for future LHC runs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

APS Data Management System

As the capabilities of modern X-ray detectors and acquisition technologies increase, so do the data rates and volumes produced at synchrotron beamlines. This brings into focus a number of challenges related to managing data at such facilities, including data transfer, near real-time data processing, automated processing pipelines, data storage, handling metadata and remote user access to data. The Advanced Photon Source Data Management System software is designed to help beamlines deal with these issues. Finally, this paper presents the system architecture and describes its components and functionality; the system's current usage is discussed, examples of its use have been provided and future development plans are outlined.

97 MATHEMATICS AND COMPUTING↗

Distributed Storage Systems for Data Intensive Computing

In this chapter, the authors present an overview of the utility of distributed storage systems in supporting modern applications that are increasingly becoming data intensive. Their coverage of distributed storage systems is based on the requirements imposed by data intensive computing and not a mere summary of storage systems. To this end, they delve into several aspects of supporting data-intensive analysis, such as data staging, offloading, checkpointing, and end-user access to terabytes of data, and illustrate the use of novel techniques and methodologies for realizing distributed storage systems therein. The data deluge from scientific experiments, observations, and simulations is affecting all of the aforementioned day-to-day operations in data-intensive computing. Modern distributed storage systems employ techniques that can help improve application performance, alleviate I/O bandwidth bottleneck, mask failures, and improve data availability. They present key guiding principles involved in the construction of such storage systems, associated tradeoffs, design, and architecture, all with an eye toward addressing challenges of data-intensive scientific applications. They highlight the concepts involved using several case studies of state-of-the-art storage systems that are currently available in the data-intensive computing landscape.

99 GENERAL AND MISCELLANEOUS↗

The Dark Energy Survey Data Management System

The Dark Energy Survey (DES) is a project with the goal of building, installing and exploiting a new 74 CCD-camera at the Blanco telescope, in order to study the nature of cosmic acceleration. It will cover 5000 square degrees of the southern hemisphere sky and will record the positions and shapes of 300 million galaxies up to redshift 1.4. The survey will be completed using 525 nights during a 5-year period starting in 2012. About O(1 TB) of raw data will be produced every night, including science and calibration images. The DES data management system has been designed for the processing, calibration and archiving of these data. It is being developed by collaborating DES institutions, led by NCSA. In this contribution, we describe the basic functions of the system, what kind of scientific codes are involved and how the Data Challenge process works, to improve simultaneously the Data Management system algorithms and the Science Working Group analysis codes.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The Heavy Rainfall Mechanism Revealed by a Terrain-Resolving 4DVar Data Assimilation System—A Case Study

In this study, a newly developed terrain-resolving four-dimensional variational (4DVar)-based data assimilation system, Immersed Boundary Method_Variational Doppler Radar Analysis System (IBM_VDRAS), is applied to investigate the mechanisms leading to a heavy precipitation event that occurred in Taiwan during the Southwesterly Monsoon Experiment (SoWMEX) conducted in 2008. The multivariate analyses using IBM_VDRAS and surface observations reveal that the warm and moist southwesterly flow from the ocean decelerates after making landfall, forming a surface convergence zone along the coast, which is further strengthened during the passage of a prefrontal rainband. The flow ascends as it advances inland until reaching the mountains, producing persistent precipitation and the enhancement of evaporative cooling as well as a widespread high pressure zone. A very shallow (<0.4 km) layer of offshore flow can be identified over the southwestern plain, which helps to generate a quasi-stationary convergence zone near the coast. Furthermore, sensitivity studies are carried out to quantify the relative importance of the contributions made by topographic blockage, evaporative cooling, and their nonlinear interaction, to the evolution of this type of convective system. The influence of the topography is identified as the dominant factor in modulating the flow structure of the rainfall system. However, it is the nonlinear interaction between terrain and evaporation that determines the distribution of the temperature and pressure fields.

54 ENVIRONMENTAL SCIENCES↗

The Fermilab Test Beam Facility Data Acquisition System Based on $otsdaq$

The Real-Time Systems Engineering Department of the Scientific Computing Division at Fermilab has deployed set of customizations to our Off-The-Shelf Data Acquisition solution (otsdaq) at the Fermilab Test Beam Facility (FTBF) to read out the beamline instrumentation in support of FTBF users. In addition to reading out several detectors which use various detection technologies and readout hardware, the FTBF Data Acquisition system (DAQ) can perform basic track reconstruction through the facility in real time and provide data to facility users. An advanced prototype smart coincidence module, known as the NIM+, performs trigger distribution and throttling, allowing the beamline instrumentation to be read out at different rates. Spill data are saved to disk for studies of the facility performance, and hit data are also made available on the FTBF network for experiments' use. A web-based run control and configuration GUI are provided, and the online monitoring snapshots created after each beam spill are viewable from any computer connected to the Fermilab network. The integrated DAQ system for the facility provides users with high-precision tracking data along the beamline and a single location for obtaining data from the facility detectors, which set the baseline for testing their own detectors.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Data Acquisition System of Nobeyama MKID Camera

We are developing a superconducting camera based on microwave kinetic inductance detectors (MKIDs) to observe 100-GHz continuum with the Nobeyama 45-m telescope. A data acquisition (DAQ) system for the camera has been designed to operate the MKIDs with the telescope. This system is required to connect the telescope control system (COSMOS) to the readout system of the MKIDs (MKID DAQ) which employs the frequency-sweeping probe scheme. The DAQ system is also required to record the reference signal of the beam switching for the demodulation by the analysis pipeline in order to suppress the sky fluctuation. The system has to be able to merge and save all data acquired both by the camera and by the telescope, including the cryostat temperature and pressure and the telescope pointing. A collection of software which implements these functions and works as a TCP/IP server on a workstation was developed. The server accepts commands and observation scripts from COSMOS and then issues commands to MKID DAQ to configure and start data acquisition. We made a commissioning of the MKID camera on the Nobeyama 45-m telescope and obtained successful scan signals of the atmosphere and of the Moon.

42 ENGINEERING↗

Data acquisition system of Moeller polarimeter Hall A Jefferson Lab (in Russian)

The structure, parameters and test results of a new data acquisition system for Moller polarimeter based on flash-ADC are presented. Flash-ADC is electronic module in VME format that consists of high-speed multichannel ADC piped type and FPGA unit on board. The use of flash-ADC has a lot of advantages: reduce of cable interconnections, events registration with higher rate, considerable decreases of system deadtime and, as result, the accuracy of polarization measurements is increases.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗