Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA STORAGE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

An improved data transfer and storage technique for hybrid computation

Improved technique was developed for transferring and storing data at faster than real time speeds on hybrid computer. Predominant advantage is combined use of electronic relays, track and store units, and analog-to-digital and digital-to-analog conversion units of hybrid computer.

Hansing, A. M.↗

Immutable Secure Data Exchange and Storage for UAM Environments

Urban Air Mobility (UAM) has become a focus for the next generation of aerial passenger transportation. UAM operations will be leveraging a service-based architecture for airspace solutions. The UAM environment will leverage diverse communications and system access approaches. These approaches include independent Providers of Services for UAM and supplemental data service providers that exchange data between themselves and UAM operators. This research focuses on the secure data exchange and storage of this decentralized UAM environment to address these challenges. This research intends to leverage a permissioned blockchain approach to address cybersecurity threats that may impact a UAM environment.

Urban Air Mobility↗

A Comparison of Groundwater Storage Using GRACE Data, Groundwater Levels, and a Hydrological Model in Californias Central Valley

The Gravity Recovery and Climate Experiment (GRACE) measures changes in total water storage (TWS) remotely, and may provide additional insight to the use of well-based data in California's agriculturally productive Central Valley region. Under current California law, well owners are not required to report groundwater extraction rates, making estimation of total groundwater extraction difficult. As a result, other groundwater change detection techniques may prove useful. From October 2002 to September 2009, GRACE was used to map changes in TWS for the three hydrological regions (the Sacramento River Basin, the San Joaquin River Basin, and the Tulare Lake Basin) encompassing the Central Valley aquifer. Net groundwater storage changes were calculated from the changes in TWS for each of the three hydrological regions and by incorporating estimates for additional components of the hydrological budget including precipitation, evapotranspiration, soil moisture, snow pack, and surface water storage. The calculated changes in groundwater storage were then compared to simulated values from the California Department of Water Resource's Central Valley Groundwater- Surface Water Simulation Model (C2VSIM) and their Water Data Library (WDL) Geographic Information System (GIS) change in storage tool. The results from the three methods were compared. Downscaling GRACE data into the 21 smaller Central Valley sub-regions included in C2VSIM was also evaluated. This work has the potential to improve California's groundwater resource management and use of existing hydrological models for the Central Valley.

Department of Water Resources↗

A New Global Storage-Area-Depth Data Set for Modeling Reservoirs in Land Surface and Earth System Models

Reservoir storage-area-depth relationships are the most important factors controlling thermal stratification in reservoirs and, more broadly, the water, energy and biogeochemical dynamics in the reservoirs and subsequently their impacts on downstream rivers. However, most land surface or earth system models do not account for the gradual changes of reservoir surface area and storage with the changing depth, inhibiting a consistent and accurate representation of mass, energy and biogeochemical balances in reservoirs. Here we present a physically coherent parameterization of reservoir storage-area-depth dataset at the global scale. For each reservoir, the storage-area-depth relationships were derived from an optimal geometric shape selected iteratively from five possible regular geometric shapes that minimizes the error of total storage and surface area estimation. We applied this algorithm to 6,800 reservoirs included in the Global Reservoir and Dam database (GRanD). The relative error between the estimated and observed total storage is no more than 5% and 50% for 66% and 99% of all GRanD reservoirs, respectively. More importantly, the storage-depth profiles derived from the approximated reservoir geometry compared well with remote sensing based estimation at 40 major reservoirs from previous studies, and ground-truth measurements for 34 reservoirs in the United States and China. Furthermore, the new global reservoir storage-area-depth dataset is critical for advancing future modeling and understanding of reservoir processes and subsequent effects on the terrestrial hydrological, ecological and biogeochemical cycles at the regional and global scales.

13 HYDRO ENERGY↗

Advanced solar thermal storage medium test data and analysis

A comparative study has been made of experimentally obtained heat transfer and heat storage characteristics of a solar thermal energy storage bed utilizing containerized water or phase change material (PCM) and rock or brick. It is shown that (1) containers with an L/D ratio of 0.80 and a mass/surface area ratio of 2.74 in a random stacking arrangement have the optimum heat transfer characteristics; and (2) vertical stacking has the least pressure drop across the test bed. It is also found that standard bricks with appropriate holes make an excellent storage medium.

Saha, H.↗

International Offshore Geologic Carbon Storage Project Inventory and Data Collection

We present an interactive data collection to aggregate, understand, and disseminate the data that are publicly available to support offshore GCS which can be leveraged by stakeholders to understand where GCS may be viable offshore, create GCS project analogs, and address challenges to GCS in offshore environments. The Offshore Geologic Carbon Storage Data Collection is an Experience Builder web application of multiple web mapping applications, aggregated into a single tool for each data type for access, visualization, and exploration. We also present a spatial inventory of global offshore GCS efforts to visualize the scale and locations of actualized and potential offshore GCS. It includes project location, project type and stage, CO2 storage resource potential, injection rate, reservoir and seal geology, and key literature references. Quantitative and qualitative comparisons of the distribution and magnitude of projects by their attributes lends spatial insight into the status of global GCS operations and storage resource potential, thereby enabling comparative assessments and cross-cutting knowledge transfer for projects in development. These datasets illuminate trends in ongoing offshore projects and can be leveraged by stakeholders to estimate storage resources, identify subsurface analogs, review regulations, and address challenges to offshore GCS. Additionally, opportunities for concurrent decarbonization strategies can be identified.

Mulhern, Julia↗

Photographic memory: The storage and retrieval of data

The concept of density encoding digital data in a mass-storage computer peripheral is proposed. This concept requires that digital data be encoded as distinguishable density levels (DDLS) of the film to be used as the storage medium. These DDL's are then recorded on the film in relatively large pixels. Retrieval of the data would be accomplished by scanning the photographic record using a relatively small aperture. Multiplexing of the pixels is used to store data of a range greater than the number of DDL's supportable by the film in question. Although a cartographic application is used as an example for the photographic storage of data, any digital data can be stored in a like manner. When the data is inherently spatially-distributed, the aptness of the proposed scheme is even more evident. In such a case, human-readability is an advantage which can be added to those mentioned earlier: speed of acquisition, ease of implementation, and cost effectiveness.

Horton, J.↗

Optimizing checkpoint data placement with guaranteed burst buffer endurance in large-scale hierarchical storage systems

Non-volatile devices, such as SSDs, will be an integral part of the deepening storage hierarchy on large-scale HPC systems. These devices can be on the compute nodes as part of a distributed burst buffer service or they can be external. Wherever they are located in the hierarchy, one critical design issue is the SSD endurance under the write-heavy workloads, such as the checkpoint I/O for scientific applications. For these environments, it is widely assumed that checkpoint operations can occur once every 60 min and for each checkpoint step as much as half of the system memory can be written out. Unfortunately, for large-scale HPC applications, the burst buffer SSDs can be worn out much more quickly given the extensive amount of data written at every checkpoint step. One possible solution is to control the amount of data written by reducing the checkpoint frequency. However, a direct effect caused by reduced checkpoint frequency is the increased vulnerability window of system failures and therefore potentially wasted computation time, especially for large-scale compute jobs.

Computer Science↗

A data acquisition and storage system for the ion auxiliary propulsion system cyclic thruster test

A nine-track tape drive interfaced to a standard personal computer was used to transport data from a remote test site to the NASA Lewis mainframe computer for analysis. The Cyclic Ground Test of the Ion Auxiliary Propulsion System (IAPS), which successfully achieved its goal of 2557 cycles and 7057 hr of thrusting beam on time generated several megabytes of test data over many months of continuous testing. A flight-like controller and power supply were used to control the thruster and acquire data. Thruster data was converted to RS232 format and transmitted to a personal computer, which stored the raw digital data on the nine-track tape. The tape format was such that with minor modifications, mainframe flight data analysis software could be used to analyze the Cyclic Ground Test data. The personal computer also converted the digital data to engineering units and displayed real time thruster parameters. Hardcopy data was printed at a rate dependent on thruster operating conditions. The tape drive provided a convenient means to transport the data to the mainframe for analysis, and avoided a development effort for new data analysis software for the Cyclic test. This paper describes the data system, interfacing and software requirements.

Hamley, John A.↗

Computing erasure metadata and data layout prior to storage using a processing platform

Techniques are provided for computing data and metadata layout prior to storage in a storage system using a processing platform. An exemplary processing platform comprises one or more of a compute node and a burst buffer appliance. The processing platform communicates with a plurality of the compute nodes over a network, wherein a plurality of applications executing on the plurality of compute nodes generate a plurality of data objects; computes erasure metadata for one or more of the data objects on at least one of the compute nodes; and provides the erasure metadata with the corresponding one or more data objects to a storage system. The processing platform optionally determines a full set of the data objects to be stored and queries the storage system to determine an anticipated layout of the full set of the data objects to be stored. The anticipated layout allows special handling, for example, for small files and large files that are identified based on predefined criteria.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Forming Aggregations using Virtual Sharding: Lessons Learned from Simple Scalable Storage (S3)

Data aggregation is the ability to combine separate datasets to form a single new logical dataset provides users with a powerful abstraction. The advantage of an aggregate dataset is that the users are freed from having to understand, and incorporate into their workflow, knowledge about the (ad hoc) organization of the constituent datasets. However, aggregating large numbers of files can be computationally complex with data server systems performing many repetitive operations. As part of the authors work on subsetting data stored on Amazon Web Service (AWS) Simple Storage Service (S3), we developed technology to read portions of otherwise monolithic data files. This enables the formation of virtual shards for user in subsetting data stored in HDF5 (hierarchical data format, version 5) files. This same tool can be used to form aggregations that combine data stored in many HDF5 files when those files are stored on S3. The nature of the virtual sharding and the algorithm that exploits it for subsetting is such that it can also be used for aggregation with the need for many of the repetitive operations required by the per file aggregation techniques. We will present timing information that demonstrates the flexibility of this approach. However, the lessons learned is that while this is a useful result in and of itself, these very same techniques can be applied in other contexts where data are stored in services and on media other than S3. For example, this same technique can be applied to data stored on spinning disk. Pushing the envelope for S3 forced a reexamination of our data access techniques which lead to unexpected positive benefits.

Gallagher, James↗

Solving protein structure from sparse serial microcrystal diffraction data at a storage ring synchrotron source

This dataset consists of 79,992 diffraction patterns stored in cbf format. A step-by-step tutorial on the reconstruction of the Bragg intensities using the EMC algorithm (Loh & Elser 2009) is described [here](https://github.com/tl578/EMC-for-SMX/wiki). We thank the authors of Martin-Garcia et al. (2017) for their gracious access to the data. Reduced data files: For those who would like to try an EMC reconstruction immediately, the data reduction step can be skipped by downloading the reduced data files provided by us. See [here](https://github.com/tl578/EMC-for-SMX/wiki/Data-reduction#skipping-data-reduction) for more details.

23-ID-D↗

Software for Improved Extraction of Data From Tape Storage

A computer program has been written to replace the original software of Racal Storeplex Delta tape recorders, which are used at Stennis Space Center. The original software could be activated by a command- line interface only; the present software offers the option of a command-line or graphical user interface. The present software also offers the option of batch-file operation (activation by a file that contains command lines for operations performed consecutively). The present software is also more reliable than was the original software: The original software was plagued by several deficiencies that made it difficult to execute, modify, and test. In addition, when using the original software to extract data that had been recorded within specified intervals of time, the resolution with which one could control starting and stopping times was no finer than about a second (or, in some cases, several seconds). In contrast, the present software is capable of controlling playback times to within 1/100 second of times specified by the user, assuming that the tape-recorder clock is accurate to within 1/100 second.

Cheng, Chiu-Fu↗

Software for Improved Extraction of Data From Tape Storage

A computer program has been written to replace the original software of Racal Storeplex Delta tape recorders, which are still used at Stennis Space Center but have been discontinued by the manufacturer. Whereas the original software could be activated by a command-line interface only, the present software offers the option of a command-line or graphical user interface. The present software also offers the option of batch-file operation (activation by a file that contains command lines for operations performed consecutively). The present software is also more reliable than was the original software: The original software was plagued by several deficiencies that made it difficult to execute, modify, and test. In addition, when using the original software to extract data that had been recorded within specified intervals of time, the resolution with which one could control starting and stopping times was no finer than about a second (or, in some cases, several seconds). In contrast, the present software is capable of controlling playback times to within 1/100 second of times specified by the user, assuming that the tape-recorder clock is accurate to within 1/100 second.

Cheng, Chiu-Fu↗

Software for Improved Extraction of Data From Tape Storage

A computer program has been written to replace the original software of Racal Storeplex Delta tape recorders, which are still used at Stennis Space Center but have been discontinued by the manufacturer. Whereas the original software could be activated by a command-line interface only, the present software offers the option of a command-line or graphical user interface. The present software also offers the option of batch-file operation (activation by a file that contains command lines for operations performed consecutively). The present software is also more reliable than was the original software: The original software was plagued by several deficiencies that made it difficult to execute, modify, and test. In addition, when using the original software to extract data that had been recorded within specified intervals of time, the resolution with which one could control starting and stopping times was no finer than about a second (or, in some cases, several seconds). In contrast, the present software is capable of controlling playback times to within 1/100 second of times specified by the user, assuming that the tape-recorder clock is accurate to within 1/100 second.

Cheng, Chiu-Fu↗