Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATA STORAGE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90
All sourcesNASA NTRSDOE OSTI
NASA NTRS1975

Set processing in a network environment

A combination of a local network, a mass storage system, and an autonomous set processor serving as a data/storage management machine is described. Its characteristics include: content-accessible data bases usable from all connected devices; efficient storage/access of large data bases; simple and direct programming with data manipulation and storage management handled by the set processor; simple data base design and entry from source representation to set processor representation with no predefinition necessary; capability available for user sort/order specification; significant reduction in tape/disk pack storage and mounts; flexible environment that allows upgrading hardware/software configuration without causing major interruptions in service; minimal traffic on data communications network; and improved central memory usage on large processors.

Hardgrave, W. T.↗
DOE OSTI2015

Data preservation at the Fermilab Tevatron

The Fermilab Tevatron collider's data-taking run ended in September 2011, yielding a dataset with rich scientific potential. The CDF and DO experiments each have nearly 9 PB of collider and simulated data stored on tape. A large computing infrastructure consisting of tape storage, disk cache, and distributed grid computing for physics analysis with the Tevatron data is present at Fermilab. The Fermilab Run II data preservation project intends to keep this analysis capability sustained through the year 2020 or beyond. To achieve this, we are implementing a system that utilizes virtualization, automated validation, and migration to new standards in both software and data storage technology as well as leveraging resources available from currently-running experiments at Fermilab. Furthermore, these efforts will provide useful lessons in ensuring long-term data access for numerous experiments throughout high-energy physics, and provide a roadmap for high-quality scientific output for years to come.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2021

Inference of Rock Flow and Mechanical Properties from Injection-Induced Microseismic Events During Geologic CO 2 Storage

Monitoring microseismic activities during CO 2 injection into geologic formations is important for ensuring the safety of the storage operations. The resulting data provide insight into the response of the storage formation to CO 2 injection and can be used to infer the underlying rock flow and mechanical properties. In this paper, assimilation of microseismic data is performed for dynamic characterization of the storage formation by using a stochastic simulation model to forecast the microseismic response of a geologic formation during CO 2 injection. Two modeling approaches are adopted to predict the space-time distribution of the injection-induced microseismicity. The first model is based on pore pressure relaxation assumption, while the second model uses coupled flow and geomechanics simulation to establish the complex physical relation between the storage formation properties and the corresponding microseismic responses during CO 2 injection. The stochastic predictive models in each case are used in ensemble data assimilation frameworks to estimate rock properties from the observed microseismic data. Two data assimilation methods are considered: (i) a new ensemble-based stochastic point process filter (EnPPF) that can directly integrate discrete microseismic events, and (ii) a variant of ensemble smoother, known as the ensemble smoother with multiple data assimilation (ES-MDA), which requires continuous representation of microseismic events for assimilation. The two methods are successfully applied to a geologically realistic model of the Farnsworth Field in Texas, with complex geologic flow units and interacting fault systems.

42 ENGINEERING↗
NASA NTRS1993

High-performance mass storage system for workstations

Reduced Instruction Set Computer (RISC) workstations and Personnel Computers (PC) are very popular tools for office automation, command and control, scientific analysis, database management, and many other applications. However, when using Input/Output (I/O) intensive applications, the RISC workstations and PC's are often overburdened with the tasks of collecting, staging, storing, and distributing data. Also, by using standard high-performance peripherals and storage devices, the I/O function can still be a common bottleneck process. Therefore, the high-performance mass storage system, developed by Loral AeroSys' Independent Research and Development (IR&D) engineers, can offload a RISC workstation of I/O related functions and provide high-performance I/O functions and external interfaces. The high-performance mass storage system has the capabilities to ingest high-speed real-time data, perform signal or image processing, and stage, archive, and distribute the data. This mass storage system uses a hierarchical storage structure, thus reducing the total data storage cost, while maintaining high-I/O performance. The high-performance mass storage system is a network of low-cost parallel processors and storage devices. The nodes in the network have special I/O functions such as: SCSI controller, Ethernet controller, gateway controller, RS232 controller, IEEE488 controller, and digital/analog converter. The nodes are interconnected through high-speed direct memory access links to form a network. The topology of the network is easily reconfigurable to maximize system throughput for various applications. This high-performance mass storage system takes advantage of a 'busless' architecture for maximum expandability. The mass storage system consists of magnetic disks, a WORM optical disk jukebox, and an 8mm helical scan tape to form a hierarchical storage structure. Commonly used files are kept in the magnetic disk for fast retrieval. The optical disks are used as archive media, and the tapes are used as backup media. The storage system is managed by the IEEE mass storage reference model-based UniTree software package. UniTree software will keep track of all files in the system, will automatically migrate the lesser used files to archive media, and will stage the files when needed by the system. The user can access the files without knowledge of their physical location. The high-performance mass storage system developed by Loral AeroSys will significantly boost the system I/O performance and reduce the overall data storage cost. This storage system provides a highly flexible and cost-effective architecture for a variety of applications (e.g., realtime data acquisition with a signal and image processing requirement, long-term data archiving and distribution, and image analysis and enhancement).

Chiang, T.↗
DOE OSTI2019

Innovative Approach to SCC Inspection and Evaluation of Canister in Dry Storage

This final report is summarized four years of work of awarded project number DE-NE0008442\IRP-15-9318, title as: “Innovative Approach to SCC Inspection and Evaluation of Canister in Dry” supported by Nuclear Energy University Program\Integrated Research Program, NEUP\IRP, where last year is an extension of no cost project. This research work is focused on the possible degradation of dry storage canister holding used nuclear fuel (UNF), due to exposure of marine atmospheric environment. The canister usually designed from a welded austenitic stainless-steel of types 304 or 316, encased in a concrete shell known as an overpack. This canister designed and licensed for 20 years with an extension period need to be determined, in addition 20 years or more. These casks are located throughout the country in Independent Spent Fuel Storage Installations (IFSFIs) often on the site close to nuclear power plants, that are often located in coastal or lake-side regions where a marine atmospheric salt air environment exist. As a result of several recent decisions, such as not pursuing Yucca Mountain as a long-term geologic repository storage facility for UNF and the cancellation of the construction of a reprocessing facility in the 1980s due to proliferation risks, interim dry storage facilities for long-term storage are vital option for the immediate future of nuclear energy technology. One of the primary concerns with respect to the long-term performance of the storage casks is the potential for corrosion initiation due to deliquescence of salts deposited on the canister surface as aerosols; in regions of high residual weld stresses, this may lead to localized stress corrosion cracking (SCC). Dust and aerosols in the air being drawn though ventilation openings in the overpacks of passively ventilated dry canister storage systems may be deposited on the stainless-steel canister outer surfaces. Under these conditions, localized corrosion attack can occur. Chlorides ions deliquescence on the canister surface, a process by which the salts essentially pull moisture out of the air, creating a concentrated salt brine on the canister surface. Chloride-induced stress corrosion cracking (CISCC) of welded zones is of special concern, as it a well-documented mode of attack for austenitic stainless steels marine environments, and many independent spent fuel storage installations (ISFSIs) are located in coastal areas. Recent canister inspections have shown that chloride salts are present on the surface of in-service canisters at near-marine settings. However, canister surface inspections of satisfactory resolution to detect SCC have never been carried out in details, because access to the canister surfaces through vents in the overpacks is extremely limited, and high radiation fields make removal of the canisters from the overpacks undesirable. Although no significant corrosion damage has not been detected up to date, there is concern that this may lead to pitting corrosion, which could in turn develop into stress corrosion cracking, causing canister structural failure. The initiation and propagation of pitting corrosion has been widely studied in full immersion conditions, but limited studies have been done on marine atmospheric conditions, which is a focus of this work, these includes laboratory and field experimentally and propagation rate modeling of pitting and transition to crack, and crack propagation rate. It is known, however, that the rate of atmospheric corrosion can be affected by variations in relative humidity (RH), salt density, salt type, droplet area, temperature and stainless-steel microstructure and residual stress particularly in welded zones of canisters. The integrated research program has identified potential deterioration mechanisms for the stainless-steel canisters containing the UNF in dry storage that require detailed research and investigation and will have an impact on the performance of long-term interim storage under the normal and extreme environmental conditions experienced during the duration of this storage. The prediction and monitoring of canister corrosion processes while in storage can provide important data for the assessment of interim storage performance and the safety to the public. This report comprises of mainly the published results in different journals and covering a wide range spectrum from susceptible stainless-steel types 304\316 microstructural analysis through the implant test at atmospheric environment, residual stress analysis of mockup canister and simulation, inspection methodology includes nonlinear ultrasound and vibro-thermography and stochastic modeling and simulation of pits propagation rates and transition to cracks. Description of field specimens installed at ISFSI of Main Yankee is given in the following chapters and will be analyzed in the coming future and serves as an important data for a stochastic analysis as it was drawn from the publications and reports described in this report. The purpose of this report is to bring together the project efforts that includes improving in our understanding of structural aging performance at current dry storage casks fleet at ISFSIs in the context of remedial maintenance and inspection applications technologies.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Navigating Integration: Key Challenges for Data Centers, Nuclear Stakeholders, and Utility Operators

The rapid expansion of data centers, driven by the exponential growth in data-processing and storage needs, presents significant challenges and opportunities for various stakeholders, including data center developers, nuclear energy providers, and utility companies. Data centers are projected to consume 6.7–12% of United States (U.S.) electricity by 2028, driven by artificial intelligence (AI) and cloud-computing demands. Nuclear energy offers reliability and dispatchable baseload power, but data centers need power now while nuclear still needs time to address siting, fast power ramping, and regulatory hurdles. Utilities must keep pace with the unprecedented acceleration of large load interconnection requests and urgently adapt to high-density loads while maintaining grid stability, reliability, and accelerating interconnection timelines. This report dives into these challenges and proposes key collaboration strategies to streamline data center integration that aligns with recent federal initiatives like America’s AI Action Plan and related executive orders that emphasize the importance of data center growth, nuclear energy expansion, and maintaining a competitive edge in the global AI race.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2020

High-Throughput Optical Mapping for Accelerated Stress Testing of PV Module Materials

The study will provide guidance towards the design and application of larger and/or outdoor-use intended instruments. Measurement capability will be benchmarked against existing specimens, examined in a round-robin study using conventional spectrophotometer instruments. Data acquisition and storage will be integrated into the DuraMAT DataHub network along with data visualization tool, facilitating sharing of information.

14 SOLAR ENERGY↗
NASA NTRS2010

VLBI Data Interchange Format (VDIF)

One important outcome of the 7th International e-VLBI Workshop in Shanghai in June 2008 was the creation of a task force to study and recommend a universal VLBI data format that is suitable for both on-the-wire e-VLBI data transfer, as well as direct disk storage. This task force, called the VLBI Data Interchange Format (VDIF) Task Force, is the first part of a two-part effort, the second of which will address standardization of e-VLBI data-transmission-protocols. The formation of the VDIF Task Force was prompted particularly by increased e-VLBI activity and the difficulties encountered when data arrive at a correlator in different formats from various instruments in various parts of the world. The task force created a streaming packetized data format that may be used for real-time and non-realtime e-VLBI, as well as direct disk storage. The data may contain multiple channels of time-sampled data with an arbitrary number of channels, arbitrary #bits/sample up to 32, and real or complex data; data rates in excess of 100 Gbps are supported. Each data packet is completely self-identifying via a short header, and data may be decoded without reference to any external information. The VDIF task force has completed its work, and the VDIF standard was ratified at the 2009 e-VLBI workshop in Madrid.

Whitney, Alan↗
DOE OSTI2014

Improving Large-scale Storage System Performance via Topology-aware and Balanced Data Placement

With the advent of big data, the I/O subsystems of large-scale compute clusters are becoming a center of focus, with more applications putting greater demands on end-to-end I/O performance. These subsystems are often complex in design. They comprise of multiple hardware and software layers to cope with the increasing capacity, capability and scalability requirements of data intensive applications. The sharing nature of storage resources and the intrinsic interactions across these layers make it to realize user-level, end-to-end performance gains a great challenge. We propose a topology-aware resource load balancing strategy to improve per-application I/O performance. We demonstrate the effectiveness of our algorithm on an extreme-scale compute cluster, Titan, at the Oak Ridge Leadership Computing Facility (OLCF). Our experiments with both synthetic benchmarks and a real-world application show that, even under congestion, our proposed algorithm can improve large-scale application I/O performance significantly, resulting in both the reduction of application run times and higher resolution simulation runs.

Wang, Feiyi↗
DOE OSTI2021

Design and implementation of a portable diagnostic system for Thomson scattering and optical emission spectroscopy measurements

A diagnostic system, which has a design goal of high-portability, has been designed at Oak Ridge National Laboratory (ORNL). This project aims at providing measurements of key plasma parameters (ne, Te, ni, Ti) for fusion-relevant devices, utilizing Thomson scattering (TS) and optical emission spectroscopy (OES). The innovative design employs mostly commercial off-the-shelf instrumentation and a traveling team of researchers to conduct measurements at various magnetic-confinement plasma devices. The TS diagnostic uses a Quantel Q-smart 1500 Nd:YAG laser with a 2ω harmonic generator to produce up to 850 mJ of 532 nm laser pulses at 10 Hz. Collection optics placed at the detection port consists of an 11 × 3 optical fiber bundle, where the TS diagnostic uses an 11 × 1 subset array of the fibers, the OES diagnostic uses another 11 fibers, and the remaining fibers are available to the host institution. The detection system is comprised of two separate IsoPlane-320 spectrometers with triple-grating turrets of various line spacing and two PI-MAX 4 intensified CCD detectors, used simultaneously to measure a broad range of ion, impurity, and electron parameters. The self-contained diagnostic package also includes a data processing and storage system. The design and initial implementation of the TS-OES diagnostic system are described. The experiments from the proof-of-principle operation of the portable package on a high density (∼2.5 × 1022 m−3) and low-temperature (∼5 eV) electrothermal arc source at ORNL are also discussed.

Kafle, N. (ORCID:000000028144787X)↗
DOE OSTI2015

AsyncStageOut: Distributed User Data Management for CMS Analysis

AsyncStageOut (ASO) is a new component of the distributed data analysis system of CMS, CRAB, designed for managing users' data. It addresses a major weakness of the previous model, namely that mass storage of output data was part of the job execution resulting in inefficient use of job slots and an unacceptable failure rate at the end of the jobs. ASO foresees the management of up to 400k files per day of various sizes, spread worldwide across more than 60 sites. It must handle up to 1000 individual users per month, and work with minimal delay. This creates challenging requirements for system scalability, performance and monitoring. ASO uses FTS to schedule and execute the transfers between the storage elements of the source and destination sites. It has evolved from a limited prototype to a highly adaptable service, which manages and monitors the user file placement and bookkeeping. To ensure system scalability and data monitoring, it employs new technologies such as a NoSQL database and re-uses existing components of PhEDEx and the FTS Dashboard. We present the asynchronous stage-out strategy and the architecture of the solution we implemented to deal with those issues and challenges. The deployment model for the high availability and scalability of the service is discussed. The performance of the system during the commissioning and the first phase of production are also shown, along with results from simulations designed to explore the limits of scalability.

Riahi, H.↗
DOE OSTI2025

Hydrogen adsorption and transport in clay-rich geomaterials: Implications for large-volume underground hydrogen storage

Depleted oil and gas reservoirs, characterized by impermeable clay-rich caprocks, are promising sites for large-scale underground hydrogen storage (UHS), which is a key strategy to support hydrogen-based energy systems. However, experimental data on hydrogen storage in clay-rich geomaterials remain scarce. In this work, we experimentally investigated hydrogen adsorption and migration in clay-rich geomaterials in the presence of nitrogen and water under controlled temperatures. Experimental observations showed that hydrogen was adsorbed in dry illite. A dual-porosity transport model was developed to interpret hydrogen transport between large-pore and small-pore domains in illite. The large-pore domain is the space between clay particles (i.e., inter-particle space), whereas the small-pore domain is the nanoscale pore space between clay mineral layers (i.e., inter-layer or intra-particle space). In contrast, nitrogen showed no evidence of adsorption in dry illite because it cannot move into the small-pore domain due to the relatively large kinetic diameter, referred to as the molecular sieving effect. Here, we found that 0.7–1.3 nm is the length scale regulating this molecular sieving effect, matching the interlayer spacing in illite, suggesting that nitrogen is a promising cushion gas in UHS, which aims to maintain adequate pressure in the reservoir for economic operations. In wetted illite, hydrogen was not adsorbed into the interlayer space due to the occupation of adsorption sites by interlayer water, which highlights the critical role of the clay hydration state in controlling hydrogen-clay interactions. Additionally, hydrogen adsorption experiments on crushed shale indicated that the shale surface possessed adsorption sites more favorable for hydrogen than for nitrogen. Through these experiments, we provide new insights into hydrogen storage mechanisms in clay-rich geomaterials and offer valuable laboratory data for evaluating the performance of large-scale UHS systems.

Adsorption↗
NASA NTRS2012

Leveraging Cloud Computing to Improve Storage Durability, Availability, and Cost for MER Maestro

The Maestro for MER (Mars Exploration Rover) software is the premiere operation and activity planning software for the Mars rovers, and it is required to deliver all of the processed image products to scientists on demand. These data span multiple storage arrays sized at 2 TB, and a backup scheme ensures data is not lost. In a catastrophe, these data would currently recover at 20 GB/hour, taking several days for a restoration. A seamless solution provides access to highly durable, highly available, scalable, and cost-effective storage capabilities. This approach also employs a novel technique that enables storage of the majority of data on the cloud and some data locally. This feature is used to store the most recent data locally in order to guarantee utmost reliability in case of an outage or disconnect from the Internet. This also obviates any changes to the software that generates the most recent data set as it still has the same interface to the file system as it did before updates

Chang, George W.↗
DOE OSTI2018

SIRIUS: Enabling Progressive Data Exploration for Extreme-Scale Scientific Data

Scientific simulations on high performance computing (HPC) platforms generate large quantities of data. To bridge the widening gap between compute and I/O, and enable data to be more efficiently stored and analyzed, simulation outputs need to be refactored, reduced, and appropriately mapped to storage tiers. However, a systematic solution to support these steps has been lacking in the current HPC software ecosystem. To that end, this paper develops SIRIUS, a progressive JPEG-like data management scheme for storing and analyzing big scientific data. It co-designs data decimation, compression, and data storage, taking the hardware characteristics of each storage tier into considerations. With reasonably low overhead, our approach refactors simulation data, using either topological or uniform decimation, into a much smaller, reduced-accuracy base dataset, and a series of deltas that is used to augment the accuracy if needed. The base dataset and deltas are compressed and written to multiple storage tiers. Data saved on different tiers can then be selectively retrieved to restore the level of accuracy that satisfies data analytics. Thus, SIRIUS provides a paradigm shift towards elastic data analytics and enables end users to make trade-offs between analysis speed and accuracy on-the-fly. This paper further develops algorithms to preserve statistics for data decimation, a common requirement for reducing data. Here, we assess the impact of SIRIUS on unstructured triangular meshes, a pervasive data model used in scientific simulations. In particular, we evaluate two realistic use cases: the blob detection in fusion and high-pressure area extraction in computational fluid dynamics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Canopus: A Paradigm Shift Towards Elastic Extreme-Scale Data Analytics on HPC

Scientific simulations on high performance computing (HPC) platforms generate large quantities of data. To bridge the widening gap between compute and I/O, and enable data to be more efficiently stored and analyzed, simulation outputs need to be refactored, reduced, and appropriately mapped to storage tiers. However, a systematic solution to support these steps has been lacking on the current HPC software ecosystem. To that end, this paper develops Canopus, a progressive JPEGlike data management scheme for storing and analyzing big scientific data. It co-designs the data decimation, compression and data storage, taking the hardware characteristics of each storage tier into considerations. With reasonably low overhead, our approach refactors simulation data into a much smaller, reduced-accuracy base dataset, and a series of deltas that is used to augment the accuracy if needed. The base dataset and deltas are compressed and written to multiple storage tiers. Data saved on different tiers can then be selectively retrieved to restore the level of accuracy that satisfies data analytics. Thus, Canopus provides a paradigm shift towards elastic data analytics and enables end users to make trade-offs between analysis speed and accuracy on-the-fly. We evaluate the impact of Canopus on unstructured triangular meshes, a pervasive data model used by scientific modeling and simulations. In particular, we demonstrate the progressive data exploration of Canopus using the “blob detection” use case on the fusion simulation data.

Lu, Tao↗
DOE OSTI2020

A Non-Invasive Approach for Elucidating the Spatial Distribution of In Situ Stress in Deep Subsurface Geologic Formations Considered for CO 2 Storage (Task 2 Report Extracting Stress Data from Seismic Data)

This report describes research accomplishments achieved with funding provided through Department of Energy (DOE) Contract DE-FE0031686. The purpose of this DOE funding is to develop methods that can provide key information about stress fields that act on deep rocks without invading the earth to acquire that information. The research objective was to demonstrate methods that extract the azimuth directions of SHmax and SHmin stress in deep rocks from traditional seismic reflection data like the data that are used to explore for deep oil and gas reservoirs. Battelle performed two seismic investigations and achieved estimates of SHmax and SHmin azimuths in both efforts that agreed with local, non-seismic, ground-truth measurements of SHmax orientation. The first procedure utilized vertical seismic profiling (VSP) data; the second effort utilized three-dimensional (3D) seismic data.

58 GEOSCIENCES↗