DataSEA: Mature, modern data management enabling sustainable data strategy.
Abstract not provided.
Wu, Justin↗
SEARCH · Engineering Papers
Results for “Data management”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
DataSEA: Mature, modern data management enabling sustainable data strategy
Explore the source record for details and available documents.
Wu, Justin↗
An Overview of the Challenges With and Proposed Solutions for the Ingest and Distribution Processes for Airborne Data Management
The current data management practices for NASA airborne field projects have successfully served science team data needs over the past 30 years to achieve project science objectives, however, users have discovered a number of issues in terms of data reporting and format. The ICARTT format, a NASA standard since 2010, is currently the most popular among the airborne measurement community. Although easy for humans to use, the format standard is not sufficiently rigorous to be machine-readable. This makes data use and management tedious and resource intensive, and also create problems in Distributed Active Archive Center (DAAC) data ingest procedures and distribution. Further, most DAACs use metadata models that concentrate on satellite data observations, making them less prepared to deal with airborne data.
Beach, Aubrey↗
Configuration and Data Management Process and the System Safety Professional
This article presents a discussion of the configuration management (CM) and the Data Management (DM) functions and provides a perspective of the importance of configuration and data management processes to the success of system safety activities. The article addresses the basic requirements of configuration and data management generally based on NASA configuration and data management policies and practices, although the concepts are likely to represent processes of any public or private organization's well-designed configuration and data management program.
Shivers, Charles Herbert↗
Space Station Freedom (SSF) Data Management System (DMS) performance model data base
The purpose of this document was originally to be a working document summarizing Space Station Freedom (SSF) Data Management System (DMS) hardware and software design, configuration, performance and estimated loading data from a myriad of source documents such that the parameters provided could be used to build a dynamic performance model of the DMS. The document is published at this time as a close-out of the DMS performance modeling effort resulting from the Clinton Administration mandated Space Station Redesign. The DMS as documented in this report is no longer a part of the redesigned Space Station. The performance modeling effort was a joint undertaking between the National Aeronautics and Space Administration (NASA) Johnson Space Center (JSC) Flight Data Systems Division (FDSD) and the NASA Ames Research Center (ARC) Spacecraft Data Systems Research Branch. The scope of this document is limited to the DMS core network through the Man Tended Configuration (MTC) as it existed prior to the 1993 Clinton Administration mandated Space Station Redesign. Data is provided for the Standard Data Processors (SDP's), Multiplexer/Demultiplexers (MDM's) and Mass Storage Units (MSU's). Planned future releases would have added the additional hardware and software descriptions needed to describe the complete DMS. Performance and loading data through the Permanent Manned Configuration (PMC) was to have been included as it became available. No future releases of this document are presently planned pending completion of the present Space Station Redesign activities and task reassessment.
Stovall, John R.↗
Data Management Technology Survey and Recommendation
The Data Management Plan (DMP) document already released describes the architecture and plan for developing the data management framework needed by the Carbon Capture Simulation Initiative (CCSI) toolset. The CCSI toolset includes: experimental data, physical property methods and parameters, empirical correlations, validation data set, models, simulation inputs and outputs, reduced-order models, cost models, risk models, uncertainty estimation, etc. Each tool in the toolset requires and generates data, and the data management system organizes and stores the data. The data management framework will be driven by end-users and interact with CCSI workflow components such as Turbine. This document reports on the technology survey completed as the first step in the Data Management Plan. It also provides recommendations for a path forward based on the survey results.
97 MATHEMATICS AND COMPUTING↗
Y-12 Groundwater Protection Program Data Management Plan
This Data Management Plan (DMP) describes the processes in place to ensure the integrity of groundwater monitoring information collected by the U.S. Department of Energy (DOE), National Nuclear Security Administration (NNSA), Y-12 National Security Complex (Y-12), Groundwater Protection Program (GWPP). This information includes program plans, reports, and computer systems used to capture monitoring station information and analytical data. The primary computer system used by the GWPP is the Groundwater Information Management System (GIMS). Procedures used to ensure the integrity of the data are included in this document by reference.
54 ENVIRONMENTAL SCIENCES↗
The 1970/71 spectral data management programs
The data management programs used by the Stanford Remote Sensing Laboratory to access, modify, and reduce the data obtained from both the NASA IR airborne spectrometer, and Stanford's SG-4 field spectrometer are reported. Many details covered in previous reports are not repeated. References are provided. These programs are written in FORTRAN 4 and S/360 Assembler Language, and are currently running on a S/360 model 67 (operating under OS/MFT) at the Stanford Computation Center Campus Facility.
Marshall, A. A.↗
Performance Understanding and Analysis for Exascale Data Management Workflows
The goal of the Exascale Data Management Workflows project is to create tools to support techniques for in-situ data analysis and data management. Online data management co-running with simulations accelerates the scientific processes being carried out, provides rapid and timely scientific insights, and can help avoid unnecessary and scientifically invalid simulation computations, particularly when combined with or able to utilize data from experimental instrument and/or from past simulation runs. The University of Oregon team is contributing to the performance instrumentation and analysis aspect of this project. Our focus has been on efficient performance monitoring of data management at scale. The general approach of the MONA project is depicted in Figure 1 below. The figure shows performance monitoring applied to an I/O workflow associated with a scientific simulation, with online measurements captured from this workflow informing methods for workflow reconfiguration and dynamic adjustment. The goal is to maintain suitable levels of Quality of Service for workflow execution, by understanding the under lying causes of workflow performance and behavior. One outcome is workflow performance models able to characterize realistic workflows. Another outcome is performance ’mini-apps’ implementing such workflow behavior. Out of scope for this project are advanced methods for online workflow control.
97 MATHEMATICS AND COMPUTING↗
A guide to onboard checkout. Volume 5: Data management
The baseline data management subsystem for a space station is discussed. The subsystem consists of equipment necessary to transfer, store, and process data to and from users and subsystems. It acquires and conditions a wide variety of input data from experiments, vehicle subsystems sensors, uplinked ground communications, and astronaut-activated controls. Computer techniques for failure analysis, reliability, and maintenance checkout onboard the space station are considered.
Source record↗
FRIEDA: Flexible Robust Intelligent Elastic Data Management Framework
Scientific applications are increasingly using cloud resources for their data analysis workflows. However, managing data effectively and efficiently over these cloud resources is challenging due to the myriad storage choices with different performance, cost trade-offs, complex application choices and complexity associated with elasticity, failure rates in these environments. The different data access patterns for data-intensive scientific applications require a more flexible and robust data management solution than the ones currently in existence. FRIEDA is a Flexible Robust Intelligent Elastic Data Management framework that employs a range of data management strategies in cloud environments. FRIEDA can manage storage and data lifecycle of applications in cloud environments. There are four different stages in the data management lifecycle of FRIEDA – (i) storage planning, (ii) provisioning and preparation, (iii) data placement, and (iv) execution. FRIEDA defines a data control plane and an execution plane. The data control plane defines the data partition and distribution strategy, whereas the execution plane manages the execution of the application using a master-worker paradigm. FRIEDA also provides different data management strategies, either to partition the data in real-time, or predetermine the data partitions prior to application execution.
97 MATHEMATICS AND COMPUTING↗
Langley applications experiments data management system study
A data management system study is presented that defines, in functional terms, the most cost effective ground data management system to support Advanced Technology Laboratory (ATL) flights of the space shuttle. Results from each subtask performed and the recommended system configuration for reformatting the experiment instrumentation tapes to computer compatible tape are examined. Included are cost factors for development of a mini control center for real-time support of the ATL flights.
Lanham, C. C., Jr.↗
Redundant data management system
Redundant data management system solves problem of operating redundant equipment in real time environment where failures are detected, isolated, and switched in simple manner. System consists of quadruply-redundant computer, input/output control units, and data buses. System inherently contains failure detection, isolation, and switching function.
Hall, J. R.↗
Modeling of the Space Station Freedom data management system
The data management system (DMS) is the information and communications system onboard Space Station Freedom. Extensive modeling of the DMS is being conducted throughout NASA to aid in the design and development of this vital system. Activities to model the DMS network infrastructure are described, focusing on modeling of the fiber distributed data interface (FDDI) token-ring protocol and experimental testbedding of networking aspects of the DMS.
Johnson, Marjory J.↗
Modeling of the Space Station Freedom data management system
The Data Management System (DMS) is the information and communications system onboard Space Station Freedom (SSF). Extensive modeling of the DMS is being conducted throughout NASA to aid in the design and development of this vital system. Activities discussed at NASA Ames Research Center to model the DMS network infrastructure are discussed with focus on the modeling of the Fiber Distributed Data Interface (FDDI) token-ring protocol and experimental testbedding of networking aspects of the DMS.
Johnson, Marjory J.↗
Central data system concepts for spacecraft data management.
Spacecraft central data system for deep space solar probe data management
Bello, L. M.↗
Data management support for selected climate data sets using the climate data access system
The functional capabilities of the Goddard Space Flight Center (GSFC) Climate Data Access System (CDAS), an interactive data storage and retrieval system, and the archival data sets which this system manages are discussed. The CDAS manages several climate-related data sets, such as the First Global Atmospheric Research Program (GARP) Global Experiment (FGGE) Level 2-b and Level 3-a data tapes. CDAS data management support consists of three basic functions: (1) an inventory capability which allows users to search or update a disk-resident inventory describing the contents of each tape in a data set, (2) a capability to depict graphically the spatial coverage of a tape in a data set, and (3) a data set selection capability which allows users to extract portions of a data set using criteria such as time, location, and data source/parameter and output the data to tape, user terminal, or system printer. This report includes figures that illustrate menu displays and output listings for each CDAS function.
Reph, M. G.↗
Big-data Efficient and Automated Science Transfer (BEAST): An Open-Source Software Architecture for Arc Jet Data Management, Modeling, and Automation
Big-data Efficient and Automated Science Transfer (BEAST) is a facility data management application developed for the NASA Ames arc jet facilities. The current decentralized data management practices limit statistical tracking, synchronization between video/time series, search capability, data throughput, and data processing speed/efficiency. Consequently, BEAST was developed to provide a new data infrastructure with streamlined data collection, processing, transfer, and analysis. This new framework also seeks to implement the FAIR principles of data stewardship: Findable, Accessible, Interoperable, and Reusable. The BEAST framework is based on a combination of the Python Django web framework and the Python data stack to provide a monolithic, open-source platform for data management, automation, and machine learning. This architecture was chosen for maintainability and scalability for a small, in-house development team. This paper will describe the application framework, deployment, and discuss the benefits and future plans for the system.
Data management↗