Use of HDF and HDF-EOS in MISR summary data products and ancillary data sets
Explore the source record for details and available documents.
HDF HDF-EOS hierarchical data format scientific da↗
SEARCH · Engineering Papers
Results for “data products”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Continuity of MODIS and VIIRS Snow Cover Extent Data Products for Development of an Earth Science Data Record
An Earth Observing System global snow cover extent data products record at moderate spatial resolution (375–500 m) began in February 2000 with the Moderate-resolution Imaging Spectroradiometer (MODIS) instrument onboard the Terra satellite. The record continued with the Aqua MODIS in July 2002, the Suomi-National Polar Platform (S-NPP) Visible Infrared Imaging Radiometer Suite (VIIRS) in January 2012 and continues with the Joint Polar Satellite System-1 (JPSS-1) VIIRS, launched in November of 2017. The objective of this work is to develop a snow cover extent Earth Science Data Record (ESDR) using different satellites, sensors and algorithms. There are many issues to understand when data from different algorithms and sensors are used over a decade-scale time period to create a continuous dataset. Issues may also arise with sensor degradation and even differences in sensor band locations. In this paper we describe development of an ESDR derived from existing MODIS and VIIRS data products and demonstrate continuity among the products. The MODIS and VIIRS snow cover detection algorithms produce very similar daily snow cover maps, with 90–97% agreement in snow cover extent (SCE) in different landscapes. Differences in SCE between products ranged from 2–15% and are attributable to convolved factors of viewing geometry, pixel spread across a scan and time of observation. Compared at a common grid size of 1 km, there is a mean of 95% agreement in SCE and a difference range of 1–10% between the MODIS and VIIRS SCE maps. Mapping sensor observations to a coarser resolution grid reduces the effect of the factors convolved in the 500 m tile to tile comparisons. We conclude that the MODIS and VIIRS SCE data products are reliable constituents of a moderate-resolution ESDR.
snow cover extent↗
Hierarchical Data Format for Earth Observing System Data Product Developer's Guide
The "Hierarchical Data Format for Earth Observing System" talk will address the best practices for creating ESDIS data products. The work presented is done in support of Data Product Developers Guide Working Group with mission "to help data product developers make data usable for end users". During the presentation, we will use some examples of NASA data products and show how to modify them to make data more usable.
Data usability↗
MINERvA s Open Data Product: A First for Neutrino Data Preservation
Access to information on neutrino nucleus interactions is critical to the success of all neutrino oscillation experiments. MINERvA's rich dataset covers a range of energies and nuclei unique amongst experiments, and as such is critical to the community in building the important shared knowledge needed to unravel the mysteries of the neutrino. In particular, its dataset provides the greatest statistical coverage in in the range of neutrino energies pertinent for DUNE until DUNE's near detector begins operation. Historically, such significant datasets in neutrino physics have been preserved primarily through their published results. While meaningful and useful, this limits the ability to explore the data to its fullest extent as new perspectives continue to form. MINERvA has undertaken a major effort to break this trend and preserve its data in a format to be as analyzable as possible from outside the collaboration. This has culminated in the officially-released MINERvA Open Data Product for the community to take advantage of and utilize. Maintaining direct access to the dataset in an analyzable form will allow new insights to continue to be extracted indefinitely. This talk will cover the contents of this product, the information included (and excluded), the tools provided to utilize the product effectively, the support MINERvA intends to provide in its use, and some lessons learned through the process.
Last, David [Rochester U.] (ORCID:0000000245147183↗
Data Product Development Guide for Data Producers
Explore the source record for details and available documents.
Remote Sensing; Data Systems; Airborne Data; Data ↗
Preservation of Provenance and Context to Ensure Future Understandability of Airborne Earth Observations and Derived Data Products
Open-source science goes beyond making data from scientific projects (e.g., on-orbit/satellite missions, airborne and field investigations, and other data producing activities) openly available after they are generated, but involves and open sharing of information throughout the project lifecycle. Preservation of the data and associated information required for understanding and reusing the data well after the scientific projects is a contributor to open-source science as well. Considering the high investment in the on-orbit/satellite missions, we had developed a document titled “NASA Earth Science Data Preservation Content Specification (PCS)” in 2011. This document has been used as a requirement for recent on-orbit/satellite missions by NASA. Recently it became clear that the specifications should be applied to other scientific projects as well. Therefore, the document was revised to cover other types of projects, and a Preservation Content Implementation Guidance (PCIG) document was also developed. The revised PCS, and the PCIG, were published in 2022. The purpose of this presentation is to highlight the contents of these documents as they apply to suborbital/airborne investigations. The PCS calls for content preservation in eight general categories - Measuring Instrument/Platform Description, Instrument and Science Data Products and Metadata, Science Raw Data, Product and Algorithm Documentation, Instrument Calibration, Science Algorithm Software, Science Data Product Algorithm Inputs, Science Data Product Validation, and Science Data Access and Analysis Tools. While all these categories apply to various types of projects, a few clarifying sentences have been added to the descriptions of contents in each of the categories to show which categories are especially important to airborne and field investigations and where some contents are not applicable (or difficult to obtain). The PCIG document provides some general guidance applicable to all types of projects and specific guidance in a separate section for airborne and field investigations. This section calls out typical artifacts produced during such investigations that can meet the spirit of the various PCS categories.
remote sensing↗
Bridging the SAGE Data Gap: Toward a Climate Data Product with Ozone and Water Vapor Data from NASA SAGE and Aura Missions and NASA Reanalyses
A climate data product with ozone and water vapor data from NASA SAGE and Aura missions and NASA re-analyses.
SAGE↗
Relating Downlink Data Products to Uplink Commands
An improved data-labeling system provides for automatic association of data products of an exploratory robot (downlink information) with previously transmitted commands (uplink information) that caused the robot to gather the data. Such association is essential to correct and timely analysis of the data products -- including, for example, association of the data with the correct targets. The system was developed for use on Mars Rover missions during the next few years. The system could also be adapted to terrestrial exploratory telerobots for which delays between commands and data returns are long enough to give rise to questions as to which commands resulted in which data returns. The main advantage of this system over prior data-labeling systems is that given a downlink data product, the uplink command and sequence hierarchy that produced it are automatically provided, and given an uplink sequence and command, the downlink data products that it produced are automatically provided.
Backes, Paul↗
User Guide for TROPICS Data Products
This document provides information for using the data products available from the “Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats” (TROPICS) mission. The TROPICS mission will produce a range of data products that will be available at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). The data products will be produced at the TROPICS Data Processing Center (UW-M SSEC), and consist of Level-1 radiances (antenna and brightness temperatures), Level-2a unified resolution radiance, Level-2b Atmospheric Vertical Temperature Profiles (AVTP), Level-2b Atmospheric Vertical Moisture Profiles (AVMP), Level-2b Instantaneous Surface Rain Rate (ISRR), and Level-2b Tropical Cyclone (TC) intensity algorithms to estimate two primary variables: Minimum Sea Level Pressure (MSLP) and Maximum Sustained Winds (MSW). Two independent intensity estimation methods are included: 1) the Tropical Cyclone Intensity Estimate algorithm (TCIE) developed at the University of Wisconsin/CIMSS using native microwave brightness temperatures and 2) the Hurricane Intensity and Structure Algorithm (HISA) developed at Colorado State University/CIRA using microwave retrievals of temperature, moisture, and integrated quantities. In addition to MSW and MSLP, HISA also provides estimates of surface wind radii and 2D winds at standard pressure levels. TROPICS is adapting the NOAA STAR Microwave Integrated Retrieval System (MIRS) to retrieve the AVTP and AVMP data products. The ISRR algorithm uses the NASA Goddard Precipitation Retrieval and Profiling Scheme (PRPS).
TROPICS↗
Cloud - Aerosol LIDAR Infrared Pathfinder Satellite Observations (CALIPSO) - Data Management System: Data Products Catalog V4.95
The CALIPSO V4.51 Lidar Level 1 and Level 2 data product is an updated version of an already order-able dataset. The changes were signed off by the CALIPSO Configuration Control Board, versioned, and the code uploaded to a code repository. There is no ITAR/SBU data or code associated with this product. Data will be publicly order-able at the NASA LaRC Atmospheric Sciences Data Center (ASDC). All documentation and web sites will be made public once the data product is released. The data is in HDF4 format and will be generated for majority of the mission (June 2006 - August 2023). The attached Data Products Catalog (v4.95) describes the content of these new data products.
Mark Vaughan↗
Calipso Data Product Status
In this poster we review the recent data releases by the CALIPSO project since the last CALIPSO/CloudSat science team meeting and near-term data products scheduled to be publicly available in the coming months. The recent releases include a full suite of new V4.51 Lidar Level 2 data products (June 2023) and corresponding browse images, as well as V4.51 IIR Level 2 (October 2023) data products. Two new Lidar Level 0 data products and both an updated (V2-Antartica) and new (V1-Greenland) version of the Lidar Level 2 Blowing Snow products are scheduled in the fall. A new Lidar Level 2 Ocean product, which provides global observations of subsurface properties, is scheduled for release in the winter. In addition, with the end of the CALIPSO science operations that occurred on August 1, 2023, we will present the last planned efforts for the next two years and summarize the final planned data releases.
Brian Getzewich↗
The GLAS Standard Data Products Specification-Level 1, Version 9
The Geoscience Laser Altimeter System (GLAS) is the primary instrument for the ICESat (Ice, Cloud and Land Elevation Satellite) laser altimetry mission. ICESat was the benchmark Earth Observing System (EOS) mission for measuring ice sheet mass balance, cloud and aerosol heights, as well as land topography and vegetation characteristics. From 2003 to 2009, the ICESat mission provided multi-year elevation data needed to determine ice sheet mass balance as well as cloud property information, especially for stratospheric clouds common over polar areas. It also provided topography and vegetation data around the globe, in addition to the polar-specific coverage over the Greenland and Antarctic ice sheets.This document defines the Level-1 GLAS standard data products. This document addresses the data flow, interfaces, record and data formats associated with the GLAS Level 1 standard data products. GLAS Level 1 standard data products are composed of Level 1A and Level 1B data products. The term standard data products refers to those EOS instrument data that are routinely generated for public distribution. The National Snow and Ice Data Center (NSDIC) distribute these products. Each data product has a unique Product Identification code assigned by the Senior Project Scientist. GLAS Level 1A and Level 1B Data Products are composed from those Level 0 data that have been reformatted or transformed to corrected and calibrated data in physical units at the full instrument rate and resolution.
Lee, Jeffrey E.↗
The GLAS Standard Data Products Specification--Level 2, Version 9
The Geoscience Laser Altimeter System (GLAS) is the primary instrument for the ICESat (Ice, Cloud and Land Elevation Satellite) laser altimetry mission. ICESat was the benchmark Earth Observing System (EOS) mission for measuring ice sheet mass balance, cloud and aerosol heights, as well as land topography and vegetation characteristics. From 2003 to 2009, the ICESat mission provided multi-year elevation data needed to determine ice sheet mass balance as well as cloud property information, especially for stratospheric clouds common over polar areas. It also provided topography and vegetation data around the globe, in addition to the polar-specific coverage over the Greenland and Antarctic ice sheets.This document defines the Level-2 GLAS standard data products. This document addresses the data flow, interfaces, record and data formats associated with the GLAS Level 2 standard data products. The term standard data products refers to those EOS instrument data that are routinely generated for public distribution. The National Snow and Ice Data Center (NSDIC) distribute these products. Each data product has a unique Product Identification code assigned by the Senior Project Scientist. The Level 2 Standard Data Products specifically include those derived geophysical data values (i.e., ice sheet elevation, cloud height, vegetation height, etc.). Additionally, the appropriate correction elements used to transform the Level 1A and Level 1B Data Products into Level 2 Data Products are included. The data are packaged with time tags, precision orbit location coordinates, and data quality and usage flags.
Lee, Jeffrey E.↗
CERES FLASHFlux: Low Latency Data Product for Education and Applied Science Uses
The Fast Longwave and Shortwave Radiative Flux (FLASHFlux) data product was developed to provide a rapid release version of the CERES results, which are made available to the GLOBE (Global Learning and Observations to Benefit the Environment) program and the applied science research communities involving in the renewable energy and agricultural sectors within a week of the satellite observations by exchanging some accuracy for speed. FLASHFlux provides two data products: 1) an hourly Level 2 Single Scanner Footprint (SSF) data separately for Terra, Aqua, and NOAA-20 observations, and 2) a daily Level 3 Time Interpolated and Spatially Averaged (TISA) 1-degree equal angle gridded data the combines Terra and Aqua observations. However, since both Terra and Aqua satellites are nearing end of life, the FLASHFlux data product will begin to transition to utilizing NOAA-20 observation in the TISA data product. The Visible Infrared Imaging Radiometer Suite (VIIRS) on board the NOAA-20 and the Moderate Resolution Imaging Spectroradiometer (MODIS) on board the Aqua satellites have different optics and spectral channels. We quantify the differences in the Level 2 SSF data products between the two satellites over a few sample months for cloud and radiative flux quantities for both the shortwave (solar wavelengths) and longwave (thermal infrared wavelengths) at TOA and surface. In addition, we also assess the impact of using NOAA-20 in place of Aqua in the Level 3 FLASHFlux TISA daily product on the TOA and surface radiative fluxes. Additionally, we highlight use case of FLASHFlux data product in combination with CERES EBAF to assess the Earth’s Radiation Budget, the accuracy of FLASHFlux data product compares to Surface sites measurement, and users of the FLASHFlux data through the POWER (Prediction of Worldwide Energy Resources) program.
PC Sawaengphokhai↗
Ascent/descent ancillary data production user's guide
The Ascent/Descent Ancillary Data Product, also called the A/D BET because it contains a Best Estimate of the Trajectory (BET), is a collection of trajectory, attitude, and atmospheric related parameters computed for the ascent and descent phases of each Shuttle Mission. These computations are executed shortly after the event in a post-flight environment. A collection of several routines including some stand-alone routines constitute what is called the Ascent/Descent Ancillary Data Production Program. A User's Guide for that program is given. It is intended to provide the reader with all the information necessary to generate an Ascent or a Descent Ancillary Data Product. It includes descriptions of the input data and output data for each routine, and contains explicit instructions on how to run each routine. A description of the final output product is given.
Brans, H. R.↗
What You Need to Know About the OMI NO2 Data Product for Air Quality Studies
The standard nitrogen dioxide (NO2) data product, produced from measurements by the Ozone Monitoring Instrument (OMI), are publicly available online from the NASA GESDISC facility. Important data fields include total and tropospheric column densities, as well as collocated data for cloud fraction and cloud top height, surface albedo and snow/ice coverage, at the resolution of the OMI instrument (12 km x 26 km, at nadir). The retrieved NO2 data have been validated, principally under clear-sky conditions. The first public-release version has been available since September 2006. An improved version of the data product, which includes a number of new data fields, and improved estimates of the retrieval uncertainties will be released by the end of 2007. This talk will describe the standard NO2 data product, including details that are essential for the use of the data for air quality studies. We will also describe the principal improvements with the new version of the data product.
Celarier, E. A.↗
An Oveview of TROPESS Data Products and Services at the NASA GES DISC
The TRopospheric Ozone and Precursors from Earth System Sounding (TROPESS) project generates Earth System Data Records (ESDRs) of ozone, and other atmospheric constituents (CH4,CO, H2O, HDO, NH3, PAN and temperature) by processing data from multiple satellites through a common retrieval algorithm and ground data system. Satellite Level-1B input data used in generating the TROPESS L2 data products include CrIS NOAA-20 (JPSS-1), CrIS SNPP, AIRS Aqua, OMI Aura, and TROPOMI S5P. The common retrieval framework is known as the MUlti-SpEctra, MUlti-SpEcies, Multi-SEnsors (MUSES) science data processing system (MUSES-SDPS). Several of the TROPESS data products are now available from the NASA Goddard Earth Sciences Data and Information Service Center (GES DISC) for users to download. In this presentation we provide an overview of the various TROPESS data products. These data products can be divided into the following Forward Stream types: Standard Products, Summary Products, and Full-Archival Products. Standard Products are for users that are doing full analysis with avenging kernel and covariance corresponding to retrieved vertical profiles. Summary products have a smaller file size and are more convenient for first-look and rapid analysis, include total and partial columns, as well as column averaging kernels. The Full-Archival Products will contain all information used in creating the data. TROPESS also creates Special Products, provided on an as-needed and as-available basis to support NASA field missions and individual-investigator requests over specific regions. Eventually, TROPESS will also produce and deliver a set of Reanalysis Stream products. Data at the GES DISC are being transitioned into the "Cloud". This will allow users with "Cloud” access to perform data analysis directly on the data without downloading the data to their system. Services, such as subsetting and data visualization, will also be provided for TROPESS data products at the GES DISC.
James Johnson↗
The ICESat-2 Mission: Land, Ocean, and Inland Water Data Products for Middle and Low Latitude Science and Applications
NASA’s Ice, Cloud, and Land Elevation Satellite (ICESat-2) is a polar orbiting mission, launched on September 15, 2018, with over two years of nearly continuous observations. The sole instrument onboard is the Advanced Topographic Laser Altimeter System (ATLAS), a micropulse, high repetition rate, six-beam, 532 nm Lidar with photon-counting technology. Although designed primarily for detecting height changes in ice caps and sea ice in the high latitudes, it continuously observes all terrain in its track including middle and low latitude regions as well, during approximately 15 orbits per day. The official ICESat-2 products include not only cryosphere data but also global high resolution parameters associated with tree canopies, land surface, oceans, and over 1.5 million inland water bodies consisting of lakes, rivers and coastal waters. This presentation provides an overview and the status of the ICESat-2 mission including: i) a summary of the salient technological features and orbit design, ii) the official ICESat-2 science data products for ice, vegetation canopy, ocean sea level, and inland water including several examples in the middle and low latitudes, iii) a list of NASA sponsored software tools for globally browsing the two year archive and for processing both the raw data and the official ICESat-2 geophysical data products, and iv) avenues for interested users to connect with the ICESat-2 Applications Program for answering questions and assistance in possibly using ICESat-2 data in your particular science or application. The overall goal is to facilitate the use of ICESat-2 data not only for science investigations but also for improved decision support applications with societal benefit. Additional ICESat-2 information, documentation and data products are publicly available at https://nsidc.org/data/icesat-2
ICESat-2↗