Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data storage data management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Space station data management system assessment methodology

A computer-aided modeling tool and methodology was developed and is currently being used to assess candidate designs for the Space Station Data Management System (DMS). The DMS will be a complex distributed computer system including processors, storage devices, local area networks, and software that will support all processing functions on board the Space Station. The methodology produces assessments of the performance, reliability, cost, and physical attributes of the candidate designs. This paper describes the architecture and design of the modeling tool and presents the modeling methodology.

Jones, W. R.↗

An interactive environment for the analysis of large Earth observation and model data sets

We propose to develop an interactive environment for the analysis of large Earth science observation and model data sets. We will use a standard scientific data storage format and a large capacity (greater than 20 GB) optical disk system for data management; develop libraries for coordinate transformation and regridding of data sets; modify the NCSA X Image and X Data Slice software for typical Earth observation data sets by including map transformations and missing data handling; develop analysis tools for common mathematical and statistical operations; integrate the components described above into a system for the analysis and comparison of observations and model results; and distribute software and documentation to the scientific community.

Bowman, Kenneth P.↗

An interactive environment for the analysis of large Earth observation and model data sets

We propose to develop an interactive environment for the analysis of large Earth science observation and model data sets. We will use a standard scientific data storage format and a large capacity (greater than 20 GB) optical disk system for data management; develop libraries for coordinate transformation and regridding of data sets; modify the NCSA X Image and X DataSlice software for typical Earth observation data sets by including map transformations and missing data handling; develop analysis tools for common mathematical and statistical operations; integrate the components described above into a system for the analysis and comparison of observations and model results; and distribute software and documentation to the scientific community.

Bowman, Kenneth P.↗

Light Microscopy Module Imaging Tested and Demonstrated

The Fluids Integrated Rack (FIR), a facility-class payload, and the Light Microscopy Module (LMM), a subrack payload, are integrated research facilities that will fly in the U.S. Laboratory module, Destiny, aboard the International Space Station. Both facilities are being engineered, designed, and developed at the NASA Glenn Research Center by Northrop Grumman Information Technology. The FIR is a modular, multiuser scientific research facility that is one of two racks that make up the Fluids and Combustion Facility (the other being the Combustion Integrated Rack). The FIR has a large volume dedicated for experimental hardware; easily reconfigurable diagnostics, power, and data systems that allow for unique experiment configurations; and customizable software. The FIR will also provide imagers, light sources, power management and control, command and data handling for facility and experiment hardware, and data processing and storage. The first payload in the FIR will be the LMM. The LMM integrated with the FIR is a remotely controllable, automated, on-orbit microscope subrack facility, with key diagnostic capabilities for meeting science requirements--including video microscopy to observe microscopic phenonema and dynamic interactions, interferometry to make thin-film measurements with nanometer resolution, laser tweezers to manipulate micrometer-sized particles, confocal microscopy to provide enhanced three-dimensional visualization of structures, and spectrophotometry to measure the photonic properties of materials. Vibration disturbances were identified early in the LMM development phase as a high risk for contaminating the science microgravity environment. An integrated FIR-LMM test was conducted in Glenn's Acoustics Test Laboratory to assess mechanical sources of vibration and their impact to microscopic imaging. The primary purpose of the test was to characterize the LMM response at the sample location, the x-y stage within the microscope, to vibration emissions from the FIR and LMM support structures.

Gati, Frank↗

A Support Database System for Integrated System Health Management (ISHM)

The development, deployment, operation and maintenance of Integrated Systems Health Management (ISHM) applications require the storage and processing of tremendous amounts of low-level data. This data must be shared in a secure and cost-effective manner between developers, and processed within several heterogeneous architectures. Modern database technology allows this data to be organized efficiently, while ensuring the integrity and security of the data. The extensibility and interoperability of the current database technologies also allows for the creation of an associated support database system. A support database system provides additional capabilities by building applications on top of the database structure. These applications can then be used to support the various technologies in an ISHM architecture. This presentation and paper propose a detailed structure and application description for a support database system, called the Health Assessment Database System (HADS). The HADS provides a shared context for organizing and distributing data as well as a definition of the applications that provide the required data-driven support to ISHM. This approach provides another powerful tool for ISHM developers, while also enabling novel functionality. This functionality includes: automated firmware updating and deployment, algorithm development assistance and electronic datasheet generation. The architecture for the HADS has been developed as part of the ISHM toolset at Stennis Space Center for rocket engine testing. A detailed implementation has begun for the Methane Thruster Testbed Project (MTTP) in order to assist in developing health assessment and anomaly detection algorithms for ISHM. The structure of this implementation is shown in Figure 1. The database structure consists of three primary components: the system hierarchy model, the historical data archive and the firmware codebase. The system hierarchy model replicates the physical relationships between system elements to provide the logical context for the database. The historical data archive provides a common repository for sensor data that can be shared between developers and applications. The firmware codebase is used by the developer to organize the intelligent element firmware into atomic units which can be assembled into complete firmware for specific elements.

FROM↗

High Throughput WAN Data Transfer with Hadoop-Based Storage

Hadoop distributed file system (HDFS) is becoming more popular in recent years as a key building block of integrated grid storage solution in the field of scientific computing. Wide Area Network (WAN) data transfer is one of the important data operations for large high energy physics experiments to manage, share and process datasets of PetaBytes scale in a highly distributed grid computing environment. In this paper, we present the experience of high throughput WAN data transfer with HDFS-based Storage Element. Two protocols, GridFTP and fast data transfer (FDT), are used to characterize the network performance of WAN data transfer.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Value-added Data Services at the Goddard Earth Sciences Data and Information Services Center

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), in addition to serving the Earth Science community as one of the major Distributed Active Archives Centers (DAACs), provides much more than just data. Among the value-added services available to general users are subsetting data spatially and/or by parameter, online analysis (to avoid downloading unnecessarily all the data), and assistance in obtaining data from other centers. Services available to data producers and high-volume users include consulting on building new products with standard formats and metadata and construction of data management systems. A particularly useful service is data processing at the DISC (i.e., close to the input data) with the users algorithm. This can take a number of different forms: as a configuration-managed algorithm within the main processing stream; as a stand-alone program next to the on-line data storage; as build-it-yourself code within the Near-Archive Data Mining (NADM) system; or as an on-the-fly analysis with simple algorithms embedded into the web-based tools. Partnerships between the GES DISC and scientists, both producers and users, allow the scientists to concentrate on science, while the GES DISC handles the data management, e.g., formats, integration, and data processing. The existing data management infrastructure at the GES DISC supports a wide spectrum of options: from simple data support to sophisticated on-line analysis tools, producing economies of scale and rapid time-to-deploy. At the same time, such partnerships allow the GES DISC to serve the user community more efficiently and to better prioritize on-line holdings. Several examples of successful partnerships are described in the presentation.

Leptoukh, Gregory G.↗

Integrated pre-feasibility study for CO 2 geological storage in the Cascadia Basin, offshore Washington State, British Columbia

The Cascadia CarbonSAFE project conducted a pre-feasibility study to evaluate technical and nontechnical aspects of storing 50 million metric tons (MMT) of carbon dioxide in a safe, ocean basalt reservoir offshore Washington State and British Columbia. Sub-seafloor basalts are very common on Earth and enable geological mineralization as a long-term storage mechanism, permanently sequestering the carbon in solid rock form. This project evaluated the offshore storage complex, developed potential industrial source/transport scenarios, built an inventory of existing geophysical/geological data and environmental monitoring capabilities, conducted laboratory studies and reservoir modeling to determine storage capacity, and analyzed economic factors, regulatory requirements, and project management risks. Our team included researchers at Columbia University in New York, Pacific Northwest National Laboratory (PNNL) in Washington, University of Victoria in British Columbia, University of California at Santa Cruz, and GHG Underground in Maine, as well as collaborators at University of Iceland in Reykjavik and University of Washington in Saint Louis. In the study region, large emitters (>100,000 MT/year) generate a total of approximately 40 MMT annually from stationary sources, such as power plants, refineries, ammonia production, and mineral processing plants. Five potential industry source/transport scenarios were identified (three in U.SA S. and two in Canada) to potentially provide 50 MMT of carbon dioxide to the offshore reservoir. One scenario included net carbon-negative sources that would reduce atmospheric levels. The inventory of existing data illustrated that basalt properties in the region are potentially beneficial for long-term storage. Permeability is on the order of 0.1 to 1 Darcies within the uppermost 600 m of ocean crust and density-derived porosity reaches 10–20% in thin layers that provide act as flow channels and provide access to porous and permeable basalt. Fine-grained sediments overlying basalt provide a low-permeability barrier separating the storage reservoir from the overlying ocean. Subsurface monitoring of the storage complex benefits from a unique opportunity close proximity of to the nearby NEPTUNE cabled seafloor observatory, which actively transmits data to shore and could be used to monitor reservoir properties. Injection pressure changes, reservoir chemistry, seismicity, well head corrosion, and potential leakage monitoring would be feasible in real time. Using existing data and published models, the STOMP-CO 2 modeling code developed at PNNL was used to simulate carbon dioxide injection, storage, and mineralization in the reservoir. Preliminary simulations indicate that a 50 MMT carbon dioxide plume injected over a 20-year period remains well within the reservoir area, both laterally and vertically, for at least a 50-year period of post-injection monitoring. Laboratory studies on core samples from Cascadia measured dissolution rates in CO 2 –basalt–seawater mixtures and indicated large variability in rates with the potential for complete mineralization. Compared to published data, the dissolution rate measured in these samples is faster, decreasing the time until full conversion to carbonate minerals would occur. Adding geochemical reactivity in the STOMP-CO 2 model indicates that carbon dioxide would be fully converted to carbonate minerals in 135 years or less after injection ceases. The project assessed the viability and costs for the five scenarios using either dedicated offshore pipelines or shipping vessels. Carbon dioxide capture costs were not considered. Shipping incurred lower upfront CAPEX costs, and because most viable sources were located near the shore and waterways, shipping is preferred; no dedicated carbon dioxide pipelines exist in the region. The project also considered potential risks from mixed-use impacts on surrounding lands and ocean areas, such as active use by commercial and recreational fisherman, and other community considerations in planning for public engagement in the future. Other project risks were identified, including project management, permitting and compliance, and financing, as well as technical issues such as long-term instrumentation, plume migration, and model development. Geological concerns like reservoir permeability, seal, and induced seismicity held relatively low risk. The regulatory framework for offshore storage in the U.S. and Canada may be covered by general legal/regulatory programs, but is not yet fully defined. Existing programs appear to restrict the transportation of carbon dioxide across national boundaries (e.g., Canada to U.S.) and its sub-seabed disposal in some circumstances. Our assessment suggests that developing specific and separate pilot projects will help to advance the technical feasibility and regulatory requirements in each country, and lessons learned from such activities may be transferable elsewhere around the globe.

42 ENGINEERING↗

NASA’s MODIS/VIIRS Global Water Reservoir Product Suite from Moderate Resolution Remote Sensing Data

Global reservoir information can not only benefit local water management but can also improve our understanding of the hydrological cycle. This information includes water area, elevation, and storage; evaporation rate and volume values; and other characteristics. However, operational wall-to-wall reservoir storage and evaporation monitoring information is lacking on a global scale. Here we introduce NASA’s new MODIS/VIIRS Global Water Reservoir product suite based on moderate resolution remote sensing data—the Moderate Resolution Imaging Spectroradiometer (MODIS), and the Visible Infrared Imaging Radiometer Suite (VIIRS). This product consists of 8-day (MxD28C2 and VNP28C2) and monthly (MxD28C3 and VNP28C3) measurements for 164 large reservoirs (MxD stands for the product from both Terra (MOD) or Aqua (MYD) satellites). The 8-day product provides area, elevation, and storage values, which were generated by first extracting water areas from surface reflectance data and then applying the area estimations to the pre-established Area–Elevation (A–E) relationships. These values were then further aggregated to monthly, with the evaporation rate and volume information added. The evaporation rate and volume values were calculated after the Lake Temperature and Evaporation Model (LTEM) using MODIS/VIIRS land surface temperature product and meteorological data from the Global Land Data Assimilation System (GLDAS). Validation results show that the 250 m area classifications from MODIS agree well with the high-resolution classifications from Landsat (R^(2) = 0.99). Validation of elevation and storage products for twelve Indian reservoirs show good agreement in terms of R^(2) values (0.71–0.96 for elevation, and 0.79–0.96 for storage) and normalized root-mean-square error (NRMSE) values (5.08–19.34% for elevation, and 6.39–18.77% for storage). The evaporation rate results for two reservoirs (Lake Nasser and Lake Mead) agree well with in situ measurements (R^(2) values of 0.61 and 0.66, and NRMSE values of 16.25% and 21.76%). Furthermore, preliminary results from the VIIRS reservoir product have shown good consistency with the MODIS based product, confirming the continuity of this 20-year product suite. This new global water reservoir product suite can provide valuable information with regard to water-sources-related studies, applications, management, and hydrological modeling and change analysis such as drought monitoring.

Yao Li↗

Development of Secondary Archive System at Goddard Space Flight Center Version 0 Distributed Active Archive Center

The Goddard Space Flight Center (GSFC) version 0 Distributed Active Archive Center (DAAC) has been developed to support existing and pre Earth Observing System (EOS) Earth science datasets, facilitate the scientific research, and test EOS data and information system (EOSDIS) concepts. To ensure that no data is ever lost, each product received at GSFC DAAC is archived on two different media, VHS and digital linear tape (DLT). The first copy is made on VHS tape and is under the control of UniTree. The second and third copies are made to DLT and VHS media under a custom built software package named 'Archer'. While Archer provides only a subset of the functions available with commercial software like UniTree, it supports migration between near-line and off-line media and offers much greater performance and flexibility to satisfy the specific needs of a data center. Archer is specifically designed to maximize total system throughput, rather than focusing on the turn-around time for individual files. The commercial off the shelf software (COTS) hierarchical storage management (HSM) products evaluated were mainly concerned with transparent, interactive, file access to the end-user, rather than a batch-orientated, optimizable (based on known data file characteristics) data archive and retrieval system. This is critical to the distribution requirements of the GSFC DAAC where orders for 5000 or more files at a time are received. Archer has the ability to queue many thousands of file requests and to sort these requests into internal processing schedules that optimize overall throughput. Specifically, mount and dismount, tape load and unload cycles, and tape motion are minimized. This feature did not seem to be available in many COTS pacages. Archer also uses a generic tar tape format that allows tapes to be read by many different systems rather than the proprietary format found in most COTS packages. This paper discusses some of the specific requirements at GSFC DAAC, the motivations for implementing the Archer system, and presents a discussion of the Archer design that resulted.

Sherman, Mark↗

LDEXPT, an intelligent database system for the Composite Load Spectra project

The Composite Load Spectra project develops probabilistic models to simulate the probabilistic loads for selected components of a generic space propulsion system. Tremendous information such as engine load variables and their distributions is needed by the simulation program. An intelligent data base system was constructed and integrated with the probabilistic load simulation program to manage and maintain the knowledge base of the Composite Load Spectra project. The intelligent data base system takes care of the data retrieval and storage functions and has expert knowledge on engine load models and associated engine variables. The integration of the intelligent data base into the load simulation program achieves a smooth coupling between the numeric processing (load simulation calculation) and the symbolic processing (intelligent load information management).

Ho, H.↗

Prospective Seal Unit Spatial Extent Database for U.S. Sedimentary Basins

The Prospective Seal Unit Spatial Extent Database for U.S. Sedimentary Basins contains a series of spatial datasets representing spatial extents of publicly available data for caprock and seal rock units within the Appalachian Basin, Denver-Julesburg Basin, Great Valley Basin (Sacramento and San Joaquin Basins), Illinois Basin, Michigan Basin, San Juan Basin, U.S. Gulf Coast Basin, and Williston Basin. The database is designed to support carbon storage feasibility and resources assessment for carbon transport and storage (CTS) projects while displaying the spatial extent of prospective seal units and provide a guide to the original data source. This database leverages publicly available data resources from authoritative sources (e.g. U.S. Geological Survey, State Geologic Surveys, and published reports), and aims to help guide users to understand the seal unit's spatial coverage and data gaps from the regional to sub-basin/field scale. The database is organized by seal unit/formation, including the spatial extent for data found to be available for the seal unit. The various datasets represented include spatial extents of the lithologic formation, depth to top structural contour maps, and thickness/isopach maps. Included in this submission are the following resources: 1. Geodatabase/Dataset: “prospective-seal-unit-extents-2025.gdb” 2. ReadMe: “readme-prospective-seal-unit-spatial-extent-dataset-2025.pdf” 3. Data Catalog: “prospective-seal-unit-spatial-extents-data-catalog-2025.xlsx” 4. Data Sources Key: “data-source.csv” Please see NETL disclaimers here: https://netl.doe.gov/home/disclaimer

Basin↗

BWR Spent Nuclear Fuel Integrity Research and Development Survey for UKABWR Spent Fuel Interim Storage

The objective of this report is to identify issues and support documentation and identify and detail existing research on spent fuel dry storage; provide information to support potential R&D for the UKABWR (United Kingdom Advanced Boiling Water Reactor) Spent Fuel Interim Storage (SFIS) Pre-Construction Safety Report; and support development of answers to questions developed by the regulator. Where there are gaps or insufficient data, Oak Ridge National Laboratory (ORNL) has summarized the research planned to provide the necessary data along with the schedule for the research, if known. Spent nuclear fuel (SNF) from nuclear power plants has historically been stored on site (wet) in spent fuel pools pending ultimate disposition. Nuclear power users (countries, utilities, vendors) are developing a suite of options and set of supporting analyses that will enable future informed choices about how best to manage these materials. As part of that effort, they are beginning to lay the groundwork for implementing longer-term interim storage of the SNF and the Greater Than Class C (CTCC) waste (dry). Deploying dry storage will require a number of technical issues to be addressed. For the past 4-5 years, ORNL has been supporting the U.S. Department of Energy (DOE) in identifying these key technical issues, managing the collection of data to be used in issue resolution, and identifying gaps in the needed data. During this effort, ORNL subject matter experts (SMEs) have become expert in understanding what information is publicly available and what gaps in data remain. To ensure the safety of the spent fuel under normal and frequent conditions of wet and subsequent dry storage, intact fuel must be shown to: 1.Maintain fuel cladding integrity; 2.Maintain its geometry for cooling, shielding, and subcriticality; 3.Maintain retrievability, and damaged fuel with pinhole or hairline cracks must be shown not to degrade further. Where PWR (pressurized water reactor) information is utilized or referenced, justification has been provided as to why the data can be utilized for BWR fuel.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Architecture and evolution of Goddard Space Flight Center Distributed Active Archive Center

The Goddard Space Flight Center (GSFC) Distributed Active Archive Center (DAAC) has been developed to enhance Earth Science research by improved access to remote sensor earth science data. Building and operating an archive, even one of a moderate size (a few Terabytes), is a challenging task. One of the critical components of this system is Unitree, the Hierarchical File Storage Management System. Unitree, selected two years ago as the best available solution, requires constant system administrative support. It is not always suitable as an archive and distribution data center, and has moderate performance. The Data Archive and Distribution System (DADS) software developed to monitor, manage, and automate the ingestion, archive, and distribution functions turned out to be more challenging than anticipated. Having the software and tools is not sufficient to succeed. Human interaction within the system must be fully understood to improve efficiency to improve efficiency and ensure that the right tools are developed. One of the lessons learned is that the operability, reliability, and performance aspects should be thoroughly addressed in the initial design. However, the GSFC DAAC has demonstrated that it is capable of distributing over 40 GB per day. A backup system to archive a second copy of all data ingested is under development. This backup system will be used not only for disaster recovery but will also replace the main archive when it is unavailable during maintenance or hardware replacement. The GSFC DAAC has put a strong emphasis on quality at all level of its organization. A Quality team has also been formed to identify quality issues and to propose improvements. The DAAC has conducted numerous tests to benchmark the performance of the system. These tests proved to be extremely useful in identifying bottlenecks and deficiencies in operational procedures.

Bedet, Jean-Jacques↗

A design for a new catalog manager and associated file management for the Land Analysis System (LAS)

Due to the larger number of different types of files used in an image processing system, a mechanism for file management beyond the bounds of typical operating systems is necessary. The Transportable Applications Executive (TAE) Catalog Manager was written to meet this need. Land Analysis System (LAS) users at the EROS Data Center (EDC) encountered some problems in using the TAE catalog manager, including catalog corruption, networking difficulties, and lack of a reliable tape storage and retrieval capability. These problems, coupled with the complexity of the TAE catalog manager, led to the decision to design a new file management system for LAS, tailored to the needs of the EDC user community. This design effort, which addressed catalog management, label services, associated data management, and enhancements to LAS applications, is described. The new file management design will provide many benefits including improved system integration, increased flexibility, enhanced reliability, enhanced portability, improved performance, and improved maintainability.

Greenhagen, Cheryl↗

High-performance mass storage system for workstations

Reduced Instruction Set Computer (RISC) workstations and Personnel Computers (PC) are very popular tools for office automation, command and control, scientific analysis, database management, and many other applications. However, when using Input/Output (I/O) intensive applications, the RISC workstations and PC's are often overburdened with the tasks of collecting, staging, storing, and distributing data. Also, by using standard high-performance peripherals and storage devices, the I/O function can still be a common bottleneck process. Therefore, the high-performance mass storage system, developed by Loral AeroSys' Independent Research and Development (IR&D) engineers, can offload a RISC workstation of I/O related functions and provide high-performance I/O functions and external interfaces. The high-performance mass storage system has the capabilities to ingest high-speed real-time data, perform signal or image processing, and stage, archive, and distribute the data. This mass storage system uses a hierarchical storage structure, thus reducing the total data storage cost, while maintaining high-I/O performance. The high-performance mass storage system is a network of low-cost parallel processors and storage devices. The nodes in the network have special I/O functions such as: SCSI controller, Ethernet controller, gateway controller, RS232 controller, IEEE488 controller, and digital/analog converter. The nodes are interconnected through high-speed direct memory access links to form a network. The topology of the network is easily reconfigurable to maximize system throughput for various applications. This high-performance mass storage system takes advantage of a 'busless' architecture for maximum expandability. The mass storage system consists of magnetic disks, a WORM optical disk jukebox, and an 8mm helical scan tape to form a hierarchical storage structure. Commonly used files are kept in the magnetic disk for fast retrieval. The optical disks are used as archive media, and the tapes are used as backup media. The storage system is managed by the IEEE mass storage reference model-based UniTree software package. UniTree software will keep track of all files in the system, will automatically migrate the lesser used files to archive media, and will stage the files when needed by the system. The user can access the files without knowledge of their physical location. The high-performance mass storage system developed by Loral AeroSys will significantly boost the system I/O performance and reduce the overall data storage cost. This storage system provides a highly flexible and cost-effective architecture for a variety of applications (e.g., realtime data acquisition with a signal and image processing requirement, long-term data archiving and distribution, and image analysis and enhancement).

Chiang, T.↗

Using SciDB to Support Photon Science Data Analysis

Array data analytic systems like SciDB hold great potential to accelerate processing data from SLAC's Linac Coherent Light Source and other experiments. SciDB is unique in its ability to integrate storage and processing of array data efficiently, providing both space-efficient storage and out-of-memory efficient parallel array processing. We describe a recent effort to leverage SciDB to store and process LCLS data. The work includes development of software to import data into SciDB, subsequent benchmarks, and interactive manipulation of data in SciDB.

43 PARTICLE ACCELERATORS↗

The Third NASA Goddard Conference on Mass Storage Systems and Technologies

This report contains copies of nearly all of the technical papers and viewgraphs presented at the Goddard Conference on Mass Storage Systems and Technologies held in October 1993. The conference served as an informational exchange forum for topics primarily relating to the ingestion and management of massive amounts of data and the attendant problems involved. Discussion topics include the necessary use of computers in the solution of today's infinitely complex problems, the need for greatly increased storage densities in both optical and magnetic recording media, currently popular storage media and magnetic media storage risk factors, data archiving standards including a talk on the current status of the IEEE Storage Systems Reference Model (RM). Additional topics addressed System performance, data storage system concepts, communications technologies, data distribution systems, data compression, and error detection and correction.

Kobler, Benjamin↗