Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Data Storage for HEP Experiments in the Era of High-Performance Computing

As particle physics experiments push their limits on both the energy and the intensity frontiers, the amount and complexity of the produced data are also expected to increase accordingly. With such large data volumes, next-generation efforts like the HL-LHC and DUNE will rely even more on both high-throughput (HTC) and high-performance (HPC) computing clusters. Full utilization of HPC resources requires scalable and efficient data-handling and I/O. For the last few decades, ROOT has been used by most HEP experiments to store data. However, other storage technologies like HDF5 may perform better in HPC environments. Initial explorations with HDF5 have begun using ATLAS, CMS and DUNE data; the DUNE experiment has also adopted HDF5 for its data-acquisition system. This paper presents the future outlook of the HEP computing and the role of HPC, and a summary of ongoing and future works to use HDF5 as a possible data storage technology for the HEP experiments to use in HPC environments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Curating Carbon Storage Data for Reuse: Enabling Research and Modeling from Earth’s Surface to Subsurface

The volume of public geologic carbon storage (GCS) data resources has continued to increase in recent years as the result of an increase in funding from government, industry, and academia towards national, basin, regional and field scale studies to ensure carbon capture and storage becomes a commercially viable operation. Despite the increasing volume of data, GCS data applied towards analyses such as geologic, cost, and risk modeling continues to be multi-sourced and often disparate in nature, published across government agencies, websites, data repositories and buried in derivative reports and documents. Much of the time preparing for an analysis and derivative product development is spent collecting, aggregating, transforming and preparing input data. There have been significant efforts within the DOE National Energy Technology Laboratory’s Carbon Storage Program to optimize multi-source, multi-scale subsurface geologic data curation and aggregation to support data discovery, interoperability, and reuse. Methods include the use of artificial intelligence, machine learning, and data science techniques. This talk will discuss the workflows, best practices, and processes developed to support the aggregation and curation of data through the whole system – surface to subsurface data - that support multi-scale, multi-purpose analysis for carbon storage research.

Morkner, Paige↗

Managing high-bandwidth real-time data storage

There exist certain systems which generate real-time data at high bandwidth, but do not necessarily require the long-term retention of that data in normal conditions. In some cases, the data may not actually be useful, and in others, there may be too much data to permanently retain in long-term storage whether it is useful or not. However, certain portions of the data may be identified as being vitally important from time to time, and must therefore be retained for further analysis or permanent storage without interrupting the ongoing collection of new data. We have developed a system, Mahanaxar, intended to address this problem. It provides quality of service guarantees for incoming real-time data streams and simultaneous access to already-recorded data on a best-effort basis utilizing any spare bandwidth. It has built in mechanisms for reliability and indexing, can scale upwards to meet increasing bandwidth requirements, and handles both small and large data elements equally well. We will show that a prototype version of this system provides better performance than a flat file (traditional filesystem) based version, particularly with regard to quality of service guarantees and hard real-time requirements.

99 GENERAL AND MISCELLANEOUS↗

Energy Storage Data Reporting in Perspective—Guidelines for Interpreting the Performance of Electrochemical Energy Storage Systems

Due to the tremendous importance of electrochemical energy storage, numerous new materials and electrode architectures for batteries and supercapacitors have emerged in recent years. Correctly characterizing these systems requires considerable time, effort, and experience to ensure proper metrics are reported. Many new nanomaterials show electrochemical behavior somewhere in between conventional double-layer capacitor and battery electrode materials, making their characterization a non-straightforward task. It is understandable that some researchers may be misinformed about how to rigorously characterize their materials and devices, which can result in inflation of their reported data. Additionally, this is not uncommon considering the current state of the field nearly requires record breaking performance for publication in high-impact journals. Incorrect characterization and data reporting misleads both the materials and device development communities, and it is the shared responsibility of the community to follow rigorous reporting methodologies to ensure published results are reliable to ensure constructive progress. This tutorial aims to clarify the main causes of inaccurate data reporting and to give examples of how researchers should proceed. The best practices for measuring and reporting metrics such as capacitance, capacity, coulombic and energy efficiencies, electrochemical impedance, and the energy and power densities of capacitive and pseudocapacitive materials are discussed.

25 ENERGY STORAGE↗

An open-source data storage and visualization platform for collaborative qubit control

Developing collaborative research platforms for quantum bit control is crucial for driving innovation in the field, as they enable the exchange of ideas, data, and implementation to achieve more impactful outcomes. Furthermore, considering the high costs associated with quantum experimental setups, collaborative environments are vital for maximizing resource utilization efficiently. However, the lack of dedicated data management platforms presents a significant obstacle to progress, highlighting the necessity for essential assistive tools tailored for this purpose. Current qubit control systems are unable to handle complicated management of extensive calibration data and do not support effectively visualizing intricate quantum experiment outcomes. In this paper, we introduce Qubit Control Storage and Visualization ( QubiCSV ), a platform specifically designed to meet the demands of quantum computing research, focusing on the storage and analysis of calibration and characterization data in qubit control systems. As an open-source tool, QubiCSV facilitates efficient data management of quantum computing, providing data versioning capabilities for data storage and allowing researchers and programmers to interact with qubits in real time. The insightful visualization are developed to interpret complex quantum experiments and optimize qubit performance. QubiCSV not only streamlines the handling of qubit control system data but also improves the user experience with intuitive visualization features, making it a valuable asset for researchers in the quantum computing domain.

97 MATHEMATICS AND COMPUTING↗

Electrical Energy Storage Data Submission Guidelines, Version 3

The knowledge of long-term health and reliability of energy storage systems is still unknown, yet these systems are proliferating and are expected increasingly to assist in the maintenance of grid reliability. Understanding long-term reliability and performance characteristics to the degree of knowledge similar to that of traditional utility assets requires operational data. This guideline is intended to inform numerous stakeholders on what data are needed for given functions, how to prescribe access to those data and the considerations impacting data architecture design, as well as provide these stakeholders insight into the data and data systems necessary to ensure storage can meet growing expectations in a safe and cost-efficient manner. Understanding data needs, the systems required, relevant standards, and user needs early in a project conception aids greatly in ensuring that a project ultimately performs to expectations.

25 ENERGY STORAGE↗

High-performance data format for scientific data storage and analysis

Here, in this article, we present the High-Performance Output (HiPO) data format developed at Jefferson Laboratory for storing and analyzing data from Nuclear Physics experiments. The format was designed to efficiently store large amounts of experimental data, utilizing modern fast compression algorithms. The purpose of this development was to provide organized data in the output, facilitating access to relevant information within the large data files. The HiPO data format has features that are suited for storing raw detector data, reconstruction data, and the final physics analysis data efficiently, eliminating the need to do data conversions through the lifecycle of experimental data. The HiPO data format is implemented in C++ and JAVA, and provides bindings to FORTRAN, Python, and Julia, providing users with the choice of data analysis frameworks to use. In this paper, we will present the general design and functionalities of the HiPO library and compare the performance of the library with more established data formats used in data analysis in High Energy and Nuclear Physics (such as ROOT and Parquete). In columnar data analysis, HiPO surpasses established data formats in performance and can be effectively applied to data analysis in other scientific fields.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Performance and scalability evaluation of the Ceph parallel file system. In: PDSW '13 Proceedings of the 8th Parallel Data Storage Workshop

Ceph is an emerging open-source parallel distributed file and storage system. By design, Ceph leverages unreliable commodity storage and network hardware, and provides reliability and fault-tolerance via controlled object placement and data replication. This paper presents our file and block I/O performance and scalability evaluation of Ceph for scientific high-performance computing (HPC) environments. Our work makes two unique contributions. First, our evaluation is performed under a realistic setup for a large-scale capability HPC environment using a commercial high-end storage system. Second, our path of investigation, tuning efforts, and findings made direct contributions to Ceph's development and improved code quality, scalability, and performance. These changes should benefit both Ceph and the HPC community at large.

Wang, Feiyi↗

Two-photon polarization data storage in bacteriorhodopsin films and its potential use in security applications

Bacteriorhodopsin (BR) films allow write-once-read-many recording of polarization data by a two-photon-absorption (TPA) process. The optical changes in BR films induced by the TPA recording were measured and the Müller matrix of a BR film was determined. A potential application of BR films in security technology is shown. Polarization data can be angle-selective retrieved with high signal-to-noise ratio. The BR film does not only carry optical information but serves also as a linear polarizer. This enables that polarization features recorded in BR films may be retrieved by merely using polarized light from a mobile phone display.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An integrated online radioassay data storage and analytics tool for nEXO

Large-scale low-background detectors are increasingly used in rare-event searches as experimental collaborations push for enhanced sensitivity. However, building such detectors, in practice, creates an abundance of radioassay data especially during the conceptual phase of an experiment when hundreds of materials are screened for radiopurity. A tool is needed to manage and make use of the radioassay screening data to quantitatively assess detector design options. We have developed a Materials Database Application for the nEXO experiment to serve this purpose. Furthermore, this paper describes this database application, explains how it functions, and discusses how it streamlines the design of the experiment.

47 OTHER INSTRUMENTATION↗

Nonvolatile data storage using mechanical force-induced polarization switching in ferroelectric polymer

Ferroelectric polymers offer the promise of low-cost and flexible electronic products. They are attractive for information storage due to their spontaneous polarization which is usually switched by electric field. Here, we demonstrate that electrical signals can be readily written on ultra-thin ferroelectric polymer films by strain gradient-induced polarization switching (flexoelectric effect). A force with magnitude as small as 64nN is enough to induce highly localized (40 nm feature size) change in the polarization states. The methodology is capable of realizing nonvolatile memory devices with miniaturized cell size and storage density of tens to hundreds Gbit per square inch.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Low-Latency Ultra-High Capacity Holographic Data Storage Archive Library

Akonia has successfully completed all of its milestones and tasks for Phase 1. The results of these tasks met or exceeded our expectations and we are highly encouraged that every milestone in Phase 2 will be achievable moving forward. One of the highest risk tasks of Phase 1, achieving 1 Tbit/in2 bit densities, was accomplished by August and exceeded our Phase 1 goal by 35%. We achieved world record bit densities of 1.35Terabit/in2 and set our expectations of achieving our goal of 2 Terabits/in2 in Phase 2 quite high with a strong potential for exceeding this bit density as well. Additionally, Phase 1 allowed us to develop some very promising design concepts that would allow holographic storage to be retro-fit into existing LTO library systems with minimum impact on the library designs. These CAD designs are outlined in Section 1 including a new concept of a holographic media card (HMC) that can be stacked in a group of 5 and placed in a magazine that is exactly size compatible with an LTO tape, but will be able to hold at least 10 Terabytes of uncompressed data compared to todays LTO6 format that holds 2.5 Terabytes.

Anderson, Ken↗

Petascale Data Storage Institute (Final Report)

pNFS is an extension to NFSv4 that helps clients overcome NFS scalability and performance barriers. Like NFS, pNFS is a client/server protocol implemented with secure and reliable remote procedure calls. pNFS departs from conventional NFS by allowing clients to access storage directly and in parallel. This helps overcome server bottlenecks inherent to NAS access methods. Making pNFS available to petascale researchers required coordinated progress in several dimensions, a confluence of multiple processes that took nearly ten years. The protocol had to be specified and published by the IETF. Nascent implementations had to track changes in the draft specification, changes in the Linux kernel, and interoperate with one another. The process by which modifications are accepted into the Linux kernel by maintainers and developers (and ultimately by Linus Torvalds himself) itself required consensus and compromise. Finally, pNFS support needed to be provided by the major Linux distributors (Red Hat, SUSE, etc.) and storage vendors (Netapp, EMC, IBM, Microsoft, etc.) on both the engineering and product sides. The specification requirement was met in December 2008, when the IETF approved the NFSv4.1 specification, which incorporates pNFS and pNFS file layouts, as a Proposed Standard as well as the (separate) specifications of pNFS object and block layouts. Throughout the PDSI project, CITI was the key contributor to the Linux-based, open source implementation of NFSv4.1 and pNFS. Considerable effort was devoted to the process of refining the IETF specification, which underwent dozens of preliminary drafts, rebasing implementations to the latest Linux kernel, which itself changed quarterly, and to testing interoperability with other developers. At last, the Linux pNFS implementation was incorporated into the Linux mainline kernel, although this was achieved after the PDSI project ended.

97 MATHEMATICS AND COMPUTING↗