Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution Service”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Data Information for Global Change Studies: NASA's Distributed Active Archive Centers and Cooperating Data Centers

The Earth Observing System (EOS) is an integral part of the National Aeronautics and Space Administration's (NASA's) Earth Science Enterprise (ESE). ESE is a long-term global change research program designed to improve our understanding of the Earth's interrelated processes involving the atmosphere, oceans, land surfaces, and polar regions. Data from EOS instruments and other Earth science measurement systems are useful in understanding the causes and processes of global climate change and the consequences of human activities. The EOS Data and Information System (EOSDIS) provides a structure for data management and user services for products derived from EOS satellite instruments and other NASA Earth science data. Within the EOSDIS framework, the Distributed Active Archive Centers (DAACs) have been established to provide expertise in one or more Earth science disciplines. The DAACs and cooperating data centers provide data and information services to support the global change research community. Much of the development of the DAACs has been in anticipation of the enormous amount of data expected from EOS instruments to be launched within the next two decades. Terra, the EOS flagship launched in December 1999, is the first of a series of EOS satellites to carry several instruments with multispectral capabilities. Some data products from these instruments are now available from several of the DAACs. These and other data products can be ordered through the EOS Data Gateway (EDG) and DAAC-specific online ordering systems.

Source record↗

Tracking-Data-Conversion Tool

Object Oriented Data Technology (OODT) is a software framework for creating a Web-based system for exchange of scientific data that are stored in diverse formats on computers at different sites under the management of scientific peers. OODT software consists of a set of cooperating, distributed peer components that provide distributed peer-topeer (P2P) services that enable one peer to search and retrieve data managed by another peer. In effect, computers running OODT software at different locations become parts of an integrated data-management system.

Flora-Adams, Dana↗

NASA Earth Sciences Data Support System and Services for the Northern Eurasia Earth Science Partnership Initiative

The presentation describes data management of NASA remote sensing data for Northern Eurasia Earth Science Partnership Initiative (NEESPI). Many types of ground and integrative (e.g., satellite, GIs) data will be needed and many models must be applied, adapted or developed for properly understanding the functioning of Northern Eurasia cold and diverse regional system. Mechanisms for obtaining the requisite data sets and models and sharing them among the participating scientists are essential. The proposed project targets integration of remote sensing data from AVHRR, MODIS, and other NASA instruments on board US- satellites (with potential expansion to data from non-US satellites), customized data products from climatology data sets (e.g., ISCCP, ISLSCP) and model data (e.g., NCEPNCAR) into a single, well-architected data management system. It will utilize two existing components developed by the Goddard Earth Sciences Data & Information Services Center (GES DISC) at the NASA Goddard Space Flight Center: (1) online archiving and distribution system, that allows collection, processing and ingest of data from various sources into the online archive, and (2) user-friendly intelligent web-based online visualization and analysis system, also known as Giovanni. The former includes various kinds of data preparation for seamless interoperability between measurements by different instruments. The latter provides convenient access to various geophysical parameters measured in the Northern Eurasia region without any need to learn complicated remote sensing data formats, or retrieve and process large volumes of NASA data. Initial implementation of this data management system will concentrate on atmospheric data and surface data aggregated to coarse resolution to support collaborative environment and climate change studies and modeling, while at later stages, data from NASA and non-NASA satellites at higher resolution will be integrated into the system.

Leptoukh, Gregory↗

NASA Earth Sciences Data Support System and Services for the Northern Eurasia Earth Science Partnership Initiative

The presentation describes the recently awarded ACCESS project to provide data management of NASA remote sensing data for the Northern Eurasia Earth Science Partnership Initiative (NEESPI). The project targets integration of remote sensing data from MODIS, and other NASA instruments on board US-satellites (with potential expansion to data from non-US satellites), customized data products from climatology data sets (e.g., ISCCP, ISLSCP) and model data (e.g., NCEP/NCAR) into a single, well-architected data management system. It will utilize two existing components developed by the Goddard Earth Sciences Data & Information Services Center (GES DISC) at the NASA Goddard Space Flight Center: (1) online archiving and distribution system, that allows collection, processing and ingest of data from various sources into the online archive, and (2) user-friendly intelligent web-based online visualization and analysis system, also known as Giovanni. The former includes various kinds of data preparation for seamless interoperability between measurements by different instruments. The latter provides convenient access to various geophysical parameters measured in the Northern Eurasia region without any need to learn complicated remote sensing data formats, or retrieve and process large volumes of NASA data. Initial implementation of this data management system will concentrate on atmospheric data and surface data aggregated to coarse resolution to support collaborative environment and climate change studies and modeling, while at later stages, data from NASA and non-NASA satellites at higher resolution will be integrated into the system.

Leptoukh, Gregory↗

Production Operations Management System

The Production Operations Management System (POMS) is a set of software tools which allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs. POMS provides a web service interface that enables automated jobs submission on distributed resources according to customers’ requests and subsequent monitoring and recovery of failed submissions, debugging and record keeping. POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub, dCache, SAM, and FIFEmon, and in combination with them handles the creation and tracking of unique filenames for multistage campaigns. A flexible, interactive GUI interface exists as part of the system to visualize campaign stages, parallelization tracks and data flow. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign. Future releases of POMS will interface with Rucio for file movement.

97 MATHEMATICS AND COMPUTING↗

Lightweight Distributed Metric Service (LDMS) v. 4.0

LDMS is a framework for collection and transport of system monitoring data from computational clusters. It utilizes existing data sources on the cluster (e.g., temperature sensors, network traffic counters). The collection and transport mechanisms of LDMS are lightweight and do not significantly adversely impact the performance of concurrently running applications.

Gentile, Ann↗

The ILRS: Approaching 20 Years and Planning for the Future

The International Laser Ranging Service (ILRS) was established by the International Association of Geodesy (IAG) in 1998 to support programs in geodesy, geophysics, fundamental constants and lunar research, and to provide the International Earth Rotation Service with data products that are essential to the maintenance and improvement in the International Terrestrial Reference Frame (ITRF), the basis for metric measurements of changes in the Earth and Earth–Moon system. Other scientific products derived from laser ranging include precise geocentric positions and motions of ground stations, satellite orbits, components of Earth’s gravity field and their temporal variations, Earth Orientation Parameters, precise lunar ephemerides and information about the internal structure of the Moon. Laser ranging systems are already measuring the one-way distance to remote optical receivers in space and are performing very accurate time transfer between remote sites in the Earth and in Space. The ILRS works closely with the IAG’s Global Geodetic Observing System. The ILRS develops (1) the standards and specifications necessary for product consistency, and (2) the priorities and tracking strategies required to maximize network efficiency. The service collects, merges, analyzes, archives and distributes satellite and lunar laser ranging data to satisfy a variety of scientific, engineering, and operational needs and encourages the application of new technologies to enhance the quality, quantity, and cost effectiveness of its data products. The ILRS works with (1) new satellite missions in the design and building of retroreflector targets to maximize data quality and quantity, and (2) science programs to optimize scientific data yield. Since its inception, the ILRS has grown to include forty laser ranging stations distributed around the world. The ILRS stations track more than ninety satellites from low Earth orbit (LEO) to the geosynchronous orbit altitude as well as retroreflector arrays on the surface of the Moon. Applications have been expanded to include time transfer, asynchronous ranging for targets at extended ranges, free space quantum telecommunications, and the tracking of space debris. Laser ranging technology is moving to lower energy, higher repetition rates (kHz), single-photon-sensitive detectors, shorter pulse widths, shorter normal point intervals for faster data acquisition, and increased pass interleaving, automated to autonomous operation with remote access, and embedded software for real-time updates and decision making. An example of pass interleaving is presented for the Yarragadee station (see Fig. 4); tracking of LEO satellites is often accommodated during break in LEO and GNSS passes. New satellites arrays provide more compact targets and work continues on the development of lighter less expensive arrays for satellites and the moon. The service now provides operational ITRF products including daily/ weekly station positions and daily resolution Earth orientation products; the flow of weekly combination of satellite orbit files for LAGEOS/Etalon-1 and -2 has recently been established. New products are under testing through a pilot project on systematic error monitoring currently underway. The article will give an overview of activities underway within the service, paths forward presently envisioned, and current issues and challenges.

Laser retroreflectors↗

Data management in NOAA

NOAA has 11 terabytes of digital data stored on 240,000 computer tapes. There are an additional 100 terabytes (TB) of geostationary satellite data stored in digital form on specially configured SONY U-Matic video tapes at the University of Wisconsin. There are over 90,000,000 non-digital form records in manuscript, film, printed, and chart form which are not easily accessible. The three NOAA Data Centers service 6,000 requests per year and publish 5,000 bulletins which are distributed to 40,000 subscribers. Seventeen CD-ROM's have been produced. Thirty thousand computer tapes containing polar satellite data are being copied to 12 inch WORM optical disks for research applications. The present annual data accumulation rate of 10 TB will grow to 30 TB in 1994 and to 100 TB by the year 2000. The present storage and distribution technologies with their attendant support systems will be overwhelmed by these increases if not improved. Increased user sophistication coupled with more precise measurement technologies will demand better quality control mechanisms, especially for those data maintained in an indefinite archive. There is optimism that the future will offer improved media technologies to accommodate the volumes of data. With the advanced technologies, storage and performance monitoring tools will be pivotal to the successful long-term management of data and information.

Callicott, William M.↗

Joint aircraft loading/structure response statistics of time to service crack initiation

A reliability analysis for predicting the statistical distribution of time to fatigue crack initiation for aircraft structures in service is presented. The present analysis utilizes the statistical data of the specimen fatigue tests, the full-scale structure tests, and the statistical dispersion of aircraft service loads. The statistical distribution of the time to fatigue crack initiation of the full-scale structure under laboratory loading spectrum is assumed to be Weibull. The service loads for gust turbulences are modeled as Poisson processes for transport-type aircraft, while the maneuver loads are modeled as compound Poisson processes for fighter and training aircraft. It is found that the statistical distribution of time to fatigue crack initiation for aircraft structures in service is not Weibull and that the prediction on the basis of the Weibull distribution is unconservative, in particular in the early service time.

Yang, J.-N.↗

Simple, Script-Based Science Processing Archive

The Simple, Scalable, Script-based Science Processing (S4P) Archive (S4PA) is a disk-based archival system for remote sensing data. It is based on the data-driven framework of S4P and is used for data transfer, data preprocessing, metadata generation, data archive, and data distribution. New data are automatically detected by the system. S4P provides services such as data access control, data subscription, metadata publication, data replication, and data recovery. It comprises scripts that control the data flow. The system detects the availability of data on an FTP (file transfer protocol) server, initiates data transfer, preprocesses data if necessary, and archives it on readily available disk drives with FTP and HTTP (Hypertext Transfer Protocol) access, allowing instantaneous data access. There are options for plug-ins for data preprocessing before storage. Publication of metadata to external applications such as the Earth Observing System Clearinghouse (ECHO) is also supported. S4PA includes a graphical user interface for monitoring the system operation and a tool for deploying the system. To ensure reliability, S4P continuously checks stored data for integrity, Further reliability is provided by tape backups of disks made once a disk partition is full and closed. The system is designed for low maintenance, requiring minimal operator oversight.

Lynnes, Christopher↗

Explore Air Quality from NASA Satellite Data

Space-borne earth observation has been important to monitor the earth condition and played acritical role in validating other instruments or modeling's outputs. However, the data from satellite earth observation are usually very complex in terms of science contents, formats, and spatiotemporal granularities, making them difficult to use from many aspects. NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), one of the 12 official NASA data centers, archives and distributes rich collections of data from multiple satellite missions and model results. The GES DISC is also the official archive center for data from the Ozone Monitoring Instrument (OMI) aboard NASA's Aura mission since 2004. Recently, the GES DISChas been evolving and improving its data management and services in order to promote NASA data to be easily discovered and accessed, as well as to facilitate interoperability. We'll show in this presentation how to explore and analyze NASA earth observation data for air quality through a suite of user-friendly tools - from Giovanni to ArcGIS, demonstrating in using this set of tools prepares us to serve the Sentinel 5P TROPOMI to the community.

Wei, J.↗

Exploring Synergistic Tools from NASA Satellite Data for Air Quality

Space-borne earth observation has been important to monitor the earth condition and played a critical role in validating other instruments or modeling's outputs. However, the data from satellite earth observation are usually very complex in terms of science contents, formats, and spatiotemporal granularities, making them difficult to use from many aspects. NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), one of the 12 official NASA data centers, archives and distributes rich collections of data from multiple satellite missions and model results. The GES DISC is also the official archive center for data from the Ozone Monitoring Instrument (OMI) aboard NASA's Aura mission since 2004. Recently, the GES DISC has been evolving and improving its data management and services in order to promote NASA data to be easily discovered and accessed, as well as to facilitate interoperability. We'll show in this presentation how to explore and analyze NASA earth observation data for air quality through a suite of user-friendly tools - from Worldview to Giovanni, demonstrating in using this set of tools prepares us to serve the Sentinel 5P TROPOMI to the community.

air quality↗

Measurement and Data Distribution for Microgravity Accelerations on the International Space Station

Two accelerometer systems will be available on the International Space Station to support microgravity payloads with information about the quasi-steady and vibratory acceleration environment of the research facilities. The Microgravity Acceleration Measurement System will record contributions to the quasi-steady microgravity environment, including the influences of aerodynamic drag, vehicle rotation, and venting effects. The Space Acceleration Measurement System-II will measure vibratory disturbances on-board due to vehicle, crew, and equipment disturbances. Due to the dynamic nature of the microgravity environment and its potential to influence sensitive experiments, NASA's Principal Investigator Microgravity Services project has initiated a plan through which the data from these instruments will be distributed to researchers in a timely and meaningful fashion. Beyond the obvious benefit of correlation between accelerations and the scientific phenomena being studied, such information is also useful for hardware developers who can gain qualitative and quantitative feedback about their facility acceleration output to station.

McPherson, Kevin↗

NASA GES DISC support of CO2 Data from OCO-2, ACOS, and AIRS

NASA Goddard Earth Sciences Data and Information Services Centers (GES DISC) is the data center assigned to archive and distribute current AIRS, ACOS data and data from the upcoming OCO-2 mission. The GES DISC archives and supports data containing information on CO2 as well as other atmospheric composition, atmospheric dynamics, modeling and precipitation. Along with the data stewardship, an important mission of GES DISC is to facilitate access to and enhance the usability of data as well as to broaden the user base. GES DISC strives to promote the awareness of science content and novelty of the data by working with Science Team members and releasing news articles as appropriate. Analysis of events that are of interest to the general public, and that help in understanding the goals of NASA Earth Observing missions, have been among most popular practices.Users have unrestricted access to a user-friendly search interface, Mirador, that allows temporal, spatial, keyword and event searches, as well as an ontology-driven drill down. Variable subsetting, format conversion, quality screening, and quick browse, are among the services available in Mirador. The majority of the GES DISC data are also accessible through OPeNDAP (Open-source Project for a Network Data Access Protocol) and WMS (Web Map Service). These services add more options for specialized subsetting, format conversion, image viewing and contributing to data interoperability.

Wei, Jennifer C↗

Low Latency Flux and Concentration Datasets in Support of Greenhouse Gas Monitoring Based on NASA's GEOS Modeling and Data Assimilation System

We present efforts to develop space-based greenhouse gas monitoring systems that can provide low latency information and traceability to independent observations. Through support from its Carbon Monitoring System program, NASA has developed the capability to assimilate XCO2 retrievals from the Orbiting Carbon Observatory, 2 (OCO-2) into the Goddard Earth Observing System (GEOS) Constituent Data Assimilation System (CoDAS) to create gap-filled, three-dimensional (3D) estimates of CO2 mixing ratio. When OCO-2 data are not available, concentration fields are further informed by a bottom-up flux package based on remotely sensed fire radiative power, nighttime lights, and vegetation reflectance combined with estimates of atmospheric growth rate based on surface in situ data. The 3D nature of this dataset supports evaluation with independent aircraft data, helping to ensure transparency of remotely sensed data products. These quasi-operational data are currently produced 2-3 months behind real time and are distributed via NASA and international dashboard services to a variety of end users. In this presentation, we provide an overview of the system as well as remaining data gaps and modeling challenges. We also highlight the application of this dataset for detecting emissions anomalies associated with COVID-19 and comparing against independent emissions estimates. Finally, we highlight a new NASA initiative called the Earth Information System (EIS), which aims to support open science and applications by leveraging emerging cloud computing capabilities to increase access to NASA’s greenhouse gas datasets, opportunities for co-development, and transparency in methods for analysis and flux attribution.

Lesley Ott↗

Assimilated Hydrological Data at NASA GES DISC with Examples of Extreme Events

Extreme weather and climate events, such as heavy rainfall, heatwave, floods and droughts, and strong wind, can have devastating impacts on society. NASA and NOAA, based on independent analyses, recently announced that global surface temperatures in 2018 are the fourth warmest since 1880, behind only those of 2016, 2017, and 2015 (nasa.gov). Also in 2018, the United States experienced 14 billion-dollar disasters, ranking as the fourth highest total number of such events, behind only the years 2017, 2011, and 2016 (climate.gov). Many research studies have focused on acquiring observational and modeling data, to reveal linkages between increasing extreme events, global water and energy cycle, and global climate change. However, draw conclusions is still a challenge. NASA Goddard Earth Sciences Data and Information Services Center is one of twelve NASA Earth Observing System (EOS) data centers that process, archive, document, and distribute data from Earth science missions and related projects. The GES DISC hosts a wide range of remotely-sensed and model data and provides reliable and robust data access and services to users worldwide. This presentation provides a few examples of extreme event study that use Land Surface Model (LSM) assimilated, quality-controlled, and spatially and temporally consistent, hydrological data from the GES DISC. Also provided is a summary table for the hydrological data holdings, along with discussions of recent updates to data and data services.

Rui, Hualan↗

Data-Driven Linear Parameter-Varying Modeling and Control of Flexible Loads for Grid Services: Preprint

Flexible loads have great potential to improve the power grid's flexibility and stability. To effectively control large ensembles of heterogeneous loads, reliable models thereof are required. The paper presents a data-driven modeling and control approach to manage flexible loads for providing grid services. We leverage a linear parameter-varying autoregressive moving average (LPV-ARMA) model to describe the aggregate load response, where the parameters in the model are used to capture external environment impacts (e.g., weather). A gain-scheduling feedback controller is then developed to adapt to environmental variations. This data-driven approach can be easily applied to different types of loads in various environmental conditions. In addition to the ensemble controller, distributed load controllers are designed to deliver grid services, while maintaining the quality of service of inherent load tasks. We demonstrate the work on the IEEE 37-node distribution system for real-time power regulation services through control of thermostatically controlled loads.

control↗