SEARCH · Engineering Papers
Results for “data services”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Telecommunication service markets through the year 2000 in relation to millimeter wave satellite systems
NASA is currently conducting a series of millimeter wave satellite system and market studies to develop 30/20 GHz satellite system concepts that have commercial potential for the period 1980-2000. The results of the market studies to-date focusing on the overall demand forecasts and distributions by geographic location, distance, and user category are discussed. Tables are presented indicating baseline market forecast voice and video services, data service category, impacted baseline forecast, and traffic/distance distribution voice services. It is concluded that the total market and system activity will be influential in determining the potential role of millimeter wave systems in the overall transmission needs of the nation, and the amount of the total forecasted traffic suitable for millimeter wave systems.
Aeronautical satellite system test and implementation
This contribution reports on various aspects of the test and implementation of the new worldwide aeronautical satellite system. The system will be implemented in 1990 following several years of system design and equipment development. The full range of services and equipment will not be available immediately, but rather there will be a progressive phase-in over the first two years of service. Data services using low gain aircraft antennas are planned to be introduced first. Voice service, requiring high gain antennas is expected to begin on a full scale basis about May/June 1990. This contribution explains Inmarsat's approach to testing and authorization of equipment intended to make use of its satellites in this evolving situation. The approach is designed to permit progressive implementation of services while avoiding the need for large scale retrofitting of equipment which has already been introduced into service.
Transitioning Earth Remote Sensing Data to Benefit Society: A Paradigm for a Center of Excellence
Over the past decade there has been a substantial increase in the number of Earth remote sensing satellites launched for research and operational usage and numerous others planned by the international community. These satellites have been used to varying degrees by their supporting agencies for weather and environmental monitoring, climate studies, disaster monitoring and response, and other humanitarian activities. While there are success stories on useful applications of remote sensing data, the broader use of these satellite assets by other organizations and entities has been limited for a number of reasons including lack of data services, data dissemination issues, and a general failure to engage the broader end user community with useful data access and knowledge of how to use the data and products. This paper describes some of these current limitations on the broader use of Earth remote sensing data by the international community and describes the concept of a general "Center of Excellence" to facilitate the development, transition, and utilization of these Earth remote sensing observations by the broader international community.
Carbon Cycle Science Data and Services at the Goddard Earth Sciences Data Information and Services Center (GES DISC)
The Goddard Earth Sciences Data Information and Services Center (GES DISC) archives and distributes a number of observational and model carbon cycle science data sets. We also provide services that facilitate data discovery, intercomparison, and visualization of these heterogeneous datasets for both research and applications users, such as subsetting, format conversion, How-To documentation, and the Help Desk.
Data Access Services that Make Remote Sensing Data Easier to Use
This slide presentation reviews some of the processes that NASA uses to make the remote sensing data easy to use over the World Wide Web. This work involves much research into data formats, geolocation structures and quality indicators, often to be followed by coding a preprocessing program. Only then are the data usable within the analysis tool of choice. The Goddard Earth Sciences Data and Information Services Center is deploying a variety of data access services that are designed to dramatically shorten the time consumed in the data preparation step. On-the-fly conversion to the standard network Common Data Form (netCDF) format with Climate-Forecast (CF) conventions imposes a standard coordinate system framework that makes data instantly readable through several tools, such as the Integrated Data Viewer, Gridded Analysis and Display System, Panoply and Ferret. A similar benefit is achieved by serving data through the Open Source Project for a Network Data Access Protocol (OPeNDAP), which also provides subsetting. The Data Quality Screening Service goes a step further in filtering out data points based on quality control flags, based on science team recommendations or user-specified criteria. Further still is the Giovanni online analysis system which goes beyond handling formatting and quality to provide visualization and basic statistics of the data. This general approach of automating the preparation steps has the important added benefit of enabling use of the data by non-human users (i.e., computer programs), which often make sub-optimal use of the available data due to the need to hard-code data preparation on the client side.
TagIt: An Integrated Indexing and Search Service for File Systems
Data services such as search, discovery, and management in scalable distributed environments have traditionally been decoupled from the underlying file systems, and are often deployed using external databases and indexing services. However, modern data production rates, looming data movement costs, and the lack of metadata, entail revisiting the decoupled file system-data services design philosophy.In this paper, we present TagIt, a scalable data management service framework aimed at scientific datasets, which is tightly integrated into a shared-nothing distributed file system. A key feature of TagIt is a scalable, distributed metadata indexing framework, using which we implement a flexible tagging capability to support data discovery. The tags can also be associated with an active operator, for pre-processing, filtering, or automatic metadata extraction, which we seamlessly offload to file servers in a load-aware fashion. Our evaluation shows that TagIt can expedite data search by up to 10X over the extant decoupled approach.
The network data delivery service: A real-time data connectivity system
A network data-sharing system, the Network Data Delivery Service (NDDS), is discussed. The NDDS system relies on a bipartite model consisting of the following: information producers (sources) and information consumers (sinks). The example provided by a dual-arm robotic system is examined.
Obtaining and Managing Answer Quality for Online Data-Intensive Services
Online data-intensive (OLDI) services use anytime algorithms to compute over large amounts of data and respond quickly. Interactive response times are a priority, so OLDI services parallelize query execution across distributed software components and return best effort answers based on the data so far processed. Omitted data from slow components could lead to better answers, but tracing online how much better the answers could be is difficult. Here, we introduce Ubora, a design method to measure the effect of slow-running components on the quality of answers. Ubora randomly samples online queries and executes them a second time. The first online execution omits data from slow components and provides interactive answers. The second execution uses mature results from intermediate components completed after the online execution finishes. Ubora uses memoization to speed up mature executions by replaying network messages exchanged between components. Our systems-level implementation works for a wide range of services, including Hadoop/Yarn, Apache Lucene, the EasyRec Recommendation Engine, and the OpenEphyra question-answering system. Ubora computes answer quality with more mature executions per second than competing approaches that do not use memoization. With Ubora, we illustrate that answer quality is effective at guiding online admission control. While achieving the same answer quality on high-priority queries, our adaptive controller had 55% higher peak throughput on low-priority queries than a competing controller guided by the rate of timeouts.
Virtual Collections: An Earth Science Data Curation Service
The role of Earth science data centers has traditionally been to maintain central archives that serve openly available Earth observation data. However, in order to ensure data are as useful as possible to a diverse user community, Earth science data centers must move beyond simply serving as an archive to offering innovative data services to user communities. A virtual collection, the end product of a curation activity that searches, selects, and synthesizes diffuse data and information resources around a specific topic or event, is a data curation service that improves the discoverability, accessibility, and usability of Earth science data and also supports the needs of unanticipated users. Virtual collections minimize the amount of the time and effort needed to begin research by maximizing certainty of reward and by providing a trustworthy source of data for unanticipated users. This presentation will define a virtual collection in the context of an Earth science data center and will highlight a virtual collection case study created at the Global Hydrology Resource Center data center.
The User Community and a Multi-Mission Data Project: Services, Experiences and Directions of the Space Physics Data Facility
From a user's perspective, the multi-mission data and orbit services of NASA's Space Physics Data Facility (SPDF) project offer a unique range of important data and services highly complementary to other services presently available or now evolving in the international heliophysics data environment. The VSP (Virtual Space Physics Observatory) service is an active portal to a wide range of distributed data sources. CDAWeb (Coordinate Data Analysis Web) enables plots, listings and file downloads for current data cross the boundaries of missions and instrument types (and now including data from THEMIS and STEREO). SSCWeb, Helioweb and our 3D Animated Orbit Viewer (TIPSOD) provide position data and query logic for most missions currently important to heliophysics science. OMNIWeb with its new extension to 1- and 5-minute resolution provides interplanetary parameters at the Earth's bow shock as a unique value-added data product. SPDF also maintains NASA's CDF (common Data Format) standard and a range of associated tools including translation services. These capabilities are all now available through webservices-based APIs as well as through our direct user interfaces. In this paper, we will demonstrate the latest data and capabilities now supported in these multi-mission services, review the lessons we continue to learn in what science users need and value in this class of services, and discuss out current thinking to the future role and appropriate focus of the SPDF effort in the evolving and increasingly distributed heliophysics data environment.
GES DISC Long-Term Data Analysis Services Using AIRS and CMS Methane Data as an Example
NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) archives and distributes rich collections of data on atmospheric greenhouse gases from multiple satellite missions and model results. Among those greenhouse gases, atmospheric methane is a powerful greenhouse gas contributing ~0.5 (W/m^2) to total radiative forcing, and its concentration has increased by about 150% since 1750. Observations or estimates of methane emissions typically have sparse spatial and temporal coverage. The lack of comprehensive spatial and temporal coverage of methane source and sink observations has made analyzing atmospheric methane trends challenging. In this study the GES DISC aims to provide the community with the resources to better understand changes in atmospheric methane concentrations and the underlying causes. We will utilize methane datasets from Atmospheric Infrared Sounder (AIRS) retrieved methane concentration and three Carbon Monitoring System (CMS) methane emission datasets (in regions of North America, Canada, and Mexico) to compare AIRS methane growth with corresponding CMS regional methane emissions. Comparisons of AIRS methane growth rates and CMS methane emissions suggests wetland emissions may impact methane growth rate trends over North America. As the record for CMS methane data is extended, both datasets can be used in conjunction to better understand impacts on atmospheric methane trends. GES DISCs new anomaly tool can also be used on select datasets to further quantify trends in atmospheric greenhouse gases.
Software Framework for Peer Data-Management Services
Object Oriented Data Technology (OODT) is a software framework for creating a Web-based system for exchange of scientific data that are stored in diverse formats on computers at different sites under the management of scientific peers. OODT software consists of a set of cooperating, distributed peer components that provide distributed peer-to-peer (P2P) services that enable one peer to search and retrieve data managed by another peer. In effect, computers running OODT software at different locations become parts of an integrated data-management system.
OSTA/ADS standards development process
A phased approach to data systems standards was developed. The standards survey, user requirements, methodology survey, and evaluation criteria were completed. Remaining to be done are data system planning interim standards, a concept for implementation of a core applications data service, a data systems policy definition, and full capability data services definition.
An Integrated Indexing and Search Service for Distributed File Systems
Data services such as search, discovery, and management in scalable distributed environments have traditionally been decoupled from the underlying file systems, and are often deployed using external databases and indexing services. However, modern data production rates, looming data movement costs, and the lack of metadata, entail revisiting the decoupled file system-data services design philosophy. In this article, we present TagIt, a scalable data management service framework aimed at scientific datasets, which can be integrated into prevalent distributed file system architectures. A key feature of TagIt is a scalable, distributed metadata indexing framework, which facilitates a flexible tagging capability to support data discovery. Furthermore, the tags can also be associated with an active operator, for pre-processing, filtering, or automatic metadata extraction, which we seamlessly offload to file servers in a load-aware fashion. We have integrated TagIt into two popular distributed file systems, i.e., GlusterFS and CephFS. Our evaluation demonstrates that TagIt can expedite data search operation by up to 10× over the extant decoupled approach.
DIP Architecture and Data Integration Services
This workshop will cover DIP architecture and data integration services. Participants will get a look at how the DIP architecture is set-up as well as how data integration services are planned to be hosted on the platform. The DIP architecture review is intended to cover how DIP was envisioned and how DIP is being developed to address data needs across the industry. Participants will have a chance to provide feedback on the DIP architecture and gain insight into how one might interface with the DIP to send or receive data. The data integration services portion is intended to cover DIP’s technical approach to data integration. As an example implementation, there will be a first look at possible data fusion on the platform, including utilizing NASA’s Fuser, and tailoring for industry data consumers. Descriptions, at a high-level, of input to and output of the Fuser will also be discussed.
Progress and Plans in Support of the Polar Community
Feedback provided by the Antarctic community has proven instrumental in positively influencing the direction of the GCMD's development. For example, in response to requests for a stand alone metadata authoring tool, a new shareable software package called docBUILDER solo will be released to the public in March 2006. This tool permits researchers to document their data during experiments and observational periods in the field. The international polar community has also played a key role in encouraging support for the foreign language character set in the metadata display and tools (10% of the records in the AMD hold foreign characters). In the upcoming release, the full ISO character set, which also includes mathematical symbols, will be supported. Additional upgrades include the ability for users to search for data sets based on pre-selected temporal and spatial resolution ranges. Data providers are strongly encouraged to populate the resolution fields for their data sets, although these fields are not currently required. In prior versions, browser incompatibilities often resulted in unreliable performance for users attempting to initiate a spatial search using a map based on Java applet technology. The GCMD will offer an integrated Google map and date search, replacing the applet technology and enhancing the geospatial and temporal searches. It is estimated that 30% of the records in the AMD have direct access to data. A growing number of these records can be accessed through data service links. Related data services are therefore becoming valuable assets in facilitating the use and visualization of data. Users will gain the ability to refine services using the same options as those available for data set searches. Data providers are encouraged to describe available data-related services through the directory. Future plans include offering web services through a SOAP interface and extending semantic queries for the polar regions through the use of ontologies. The Open Archives Initiative's (OAI) Protocol for Metadata Harvesting (PMH) has been successfully tested with several organizations and appears to be a prime candidate for sharing metadata within the community. The GCMD anticipates contributing to the design of the data management system for the International Polar Year and to the ongoing efforts in the years to come. Further enhancements will be discussed at the meeting.
Recap of DIP Workshop Series: #1 DIP Architecture and Data Integrations Services
This workshop will cover DIP architecture and data integration services to obtain feedback from America for Airlines (A4A) Air Traffic Management Council (ATMC). Participants will get a look at how the DIP architecture is set-up as well as how data integration services are planned to be hosted on the platform. The DIP architecture review is intended to cover how DIP was envisioned and how DIP is being developed to address data needs across the industry. Participants will have a chance to provide feedback on the DIP architecture and gain insight into how one might interface with the DIP to send or receive data. The data integration services portion is intended to cover DIP’s technical approach to data integration. As an example implementation, there will be a first look at possible data fusion on the platform, including utilizing NASA’s Fuser, and tailoring for industry data consumers. Descriptions, at a high-level, of input to and output of the Fuser will also be discussed.