Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “derived data products”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Recommendations for developing, documenting, and distributing data products derived from NEON data

The National Ecological Observatory Network (NEON) provides over 180 distinct data products from 81 sites (47 terrestrial and 34 freshwater aquatic sites) within the United States and Puerto Rico. These data products include both field and remote sensing data collected using standardized protocols and sampling schema, with centralized quality assurance and quality control (QA/QC) provided by NEON staff. Such breadth of data creates opportunities for the research community to extend basic and applied research while also extending the impact and reach of NEON data through the creation of derived data products—higher level data products derived by the user community from NEON data. Derived data products are curated, documented, reproducibly-generated datasets created by applying various processing steps to one or more lower level data products—including interpolation, extrapolation, integration, statistical analysis, modeling, or transformations. Derived data products directly benefit the research community and increase the impact of NEON data by broadening the size and diversity of the user base, decreasing the time and effort needed for working with NEON data, providing primary research foci through the development via the derivation process, and helping users address multidisciplinary questions. Creating derived data products also promotes personal career advancement to those involved through publications, citations, and future grant proposals. However, the creation of derived data products is a nontrivial task. Here we provide an overview of the process of creating derived data products while outlining the advantages, challenges, and major considerations.

54 ENVIRONMENTAL SCIENCES↗

Using Social Media and Mobile Devices to Discover and Share Disaster Data Products Derived From Satellites

Data products derived from Earth observing satellites are difficult to find and share without specialized software and often times a highly paid and specialized staff. For our research effort, we endeavored to prototype a distributed architecture that depends on a standardized communication protocol and applications program interface (API) that makes it easy for anyone to discover and access disaster related data. Providers can easily supply the public with their disaster related products by building an adapter for our API. Users can use the API to browse and find products that relate to the disaster at hand, without a centralized catalogue, for example floods, and then are able to share that data via social media. Furthermore, a longerterm goal for this architecture is to enable other users who see the shared disaster product to be able to generate the same product for other areas of interest via simple point and click actions on the API on their mobile device. Furthermore, the user will be able to edit the data with on the ground local observations and return the updated information to the original repository of this information if configured for this function. This architecture leverages SensorWeb functionality [1] presented at previous IGARSS conferences. The architecture is divided into two pieces, the frontend, which is the GeoSocial API, and the backend, which is a standardized disaster node that knows how to talk to other disaster nodes, and also can communicate with the GeoSocial API. The GeoSocial API, along with the disaster node basic functionality enables crowdsourcing and thus can leverage insitu observations by people external to a group to perform tasks such as improving water reference maps, which are maps of existing water before floods. This can lower the cost of generating precision water maps. Keywords-Data Discovery, Disaster Decision Support, Disaster Management, Interoperability, CEOS WGISS Disaster Architecture

Digital overlaying of the universal transverse Mercator grid with LANDSAT data derived products

Picture elements of data from the LANDSAT multispectral scanner are correlated with the universal tranverse Mercator grid. In the procedure, a series of computer modules was used to make approximations of universal transverse Mercator grid locations for all picture elements from the grid locations of a limited number of known control points and to provide display and digital storage of the data. The software has been written in FORTRAN 4 language for a Varian 70-series computer.

Graham, M. H.↗

Assessment and Applications of NASA Ozone Data Products Derived from Aura OMI-MLS Satellite Measurements in Context of the GMI Chemical Transport Model

Measurements from the Ozone Monitoring Instrument (OMI) and Microwave Limb Sounder (MLS), both onboard the Aura spacecraft, have been used to produce daily global maps of column and profile ozone since August 2004. Here we compare and evaluate three strategies to obtain daily maps of tropospheric and stratospheric ozone from OMI and MLS measurements: trajectory mapping, direct profile retrieval, and data assimilation. Evaluation is based upon an assessment that includes validation using ozonesondes and comparisons with the Global Modeling Initiative (GMI) chemical transport model (CTM). We investigate applications of the three ozone data products from near-decadal and inter-annual timescales to day-to-day case studies. Zonally averaged inter-annual changes in tropospheric ozone from all of the products in any latitude range are of the order 1-2 Dobson Units while changes (increases) over the 8-year Aura record investigated http://eospso.gsfc.nasa.gov/atbd-category/49 vary approximately 2-4 Dobson Units. It is demonstrated that all of the ozone products can measure and monitor exceptional tropospheric ozone events including major forest fire and pollution transport events. Stratospheric ozone during the Aura record has several anomalous inter-annual events including stratospheric warming split events in the Northern Hemisphere extra-tropics that are well captured using the data assimilation ozone profile product. Data assimilation with continuous daily global coverage and vertical ozone profile information is the best of the three strategies at generating a global tropospheric and stratospheric ozone product for science applications.

GMI↗

Advanced Precipitation and Boundary Layer Data Products Derived from ARM Radar Wind Profilers

This research project was successful in delivering on four main objectives. First, software was developed to accurately calculate 915-MHz radar wind profiler (RWP) spectrum moments from the recorded Doppler velocity power spectra. Second, software was developed to calibrate the RWP reflectivity factor using collocated surface disdrometer observations. Third, the Python processing code was documented and given to the ARM Infrastructure to produce ARM ‘b level’ calibrated RWP products. Fourth, calibrated RWP products were uploaded to the ARM Archive as PI Products for 10 years of SGP RWP observations and for GoAmazon and TRACER field campaign RWP observations. In addition to working with RWP observations, this research project also worked with KAZR observations to distinguish insects from boundary layer clouds to help improve the ARSCL cloud mask product. The PI worked with senior and early career ARM funded scientists at BNL exploring how to include calibrated RWP moments into future versions of the ARSCL product.

54 ENVIRONMENTAL SCIENCES↗

Preservation of Provenance and Context to Ensure Future Understandability of Airborne Earth Observations and Derived Data Products

Open-source science goes beyond making data from scientific projects (e.g., on-orbit/satellite missions, airborne and field investigations, and other data producing activities) openly available after they are generated, but involves and open sharing of information throughout the project lifecycle. Preservation of the data and associated information required for understanding and reusing the data well after the scientific projects is a contributor to open-source science as well. Considering the high investment in the on-orbit/satellite missions, we had developed a document titled “NASA Earth Science Data Preservation Content Specification (PCS)” in 2011. This document has been used as a requirement for recent on-orbit/satellite missions by NASA. Recently it became clear that the specifications should be applied to other scientific projects as well. Therefore, the document was revised to cover other types of projects, and a Preservation Content Implementation Guidance (PCIG) document was also developed. The revised PCS, and the PCIG, were published in 2022. The purpose of this presentation is to highlight the contents of these documents as they apply to suborbital/airborne investigations. The PCS calls for content preservation in eight general categories - Measuring Instrument/Platform Description, Instrument and Science Data Products and Metadata, Science Raw Data, Product and Algorithm Documentation, Instrument Calibration, Science Algorithm Software, Science Data Product Algorithm Inputs, Science Data Product Validation, and Science Data Access and Analysis Tools. While all these categories apply to various types of projects, a few clarifying sentences have been added to the descriptions of contents in each of the categories to show which categories are especially important to airborne and field investigations and where some contents are not applicable (or difficult to obtain). The PCIG document provides some general guidance applicable to all types of projects and specific guidance in a separate section for airborne and field investigations. This section calls out typical artifacts produced during such investigations that can meet the spirit of the various PCS categories.

remote sensing↗

GEONEX Data Products: Geostationary Satellite Derived Land Surface and Atmospheric Public Data Products

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GEONEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GEONEX pipeline will begin to produce provisional data products to be consumed by external collaborators and the academic community. In order to better inform and introduce the GEONEX products to the science community, the provisional products shall be distributed from the NAS data portal, located at data.nas.nasa.gov, and simple webpage at www.nasa.gov/geonex has been deployed, which describes any algorithms used in deriving the products, user manuals and data file information. We will also update the status of the data processing, on the website and provide links to the latest datasets, and use a geonex mailing list, using lists.nasa.gov.

Wang, Weile↗

Towards a Preservation Content Standard for Earth Observation Data

Information from Earth observing missions (remote sensing with airborne and spaceborne instruments, and in situ measurements such as those from field campaigns) is proliferating in the world. Many agencies across the globe are generating important datasets by collecting measurements from instruments on board aircraft and spacecraft, globally and constantly. The data resulting from such measurements are a valuable resource that needs to be preserved for the benefit of future generations. These observations are the primary record of the Earths environment and therefore are the key to understanding how conditions in the future will compare to conditions today. Earth science observational data, derived products and models are used to answer key questions of global significance. In the near-term, as long as the missions data are being used actively for scientific research, it continues to be important to provide easy access to the data and services commensurate with current information technology. For the longer term, when the focus of the research community shifts toward new missions and observations, it is essential to preserve the previous mission data and associated information. This will enable a new user in the future to understand how the data were used for deriving information, knowledge and policy recommendations and to repeat the experiment to ascertain the validity and possible limitations of conclusions reached in the past and to provide confidence in long term trends that depended on data from multiple missions. Organizations that collect, process, and utilize Earth observation data today have a responsibility to ensure that the data and associated content continue to be preserved by them or are gathered and handed off to other organizations for preservation for the benefit of future generations. In order to ensure preservation of complete content necessary for understanding and reusing the data and derived digital products from todays missions, it is necessary to develop a specification of such preservation content. While there are existing standards that address archival and preservation in general, there are no existing international standards or specifications today to address what content should be preserved. The purpose of this paper is to outline briefly the existing standards that apply to preservation, describe a recent effort in getting an international standard in place for specifying preservation content for Earth observation data and derived digital data products and the remaining work needed to arrive at a standard.

ISO Standards↗

CHESS 2025: Crown polygons and extracted reflectance for field sampling sites

This dataset contains (1) crown polygons for each tree, meadow, and shrub site sampled in the 2025 Colorado Headwaters Ecological Spectroscopy Study (CHESS) campaign (in geojson format, .geojson) and (2) extracted reflectance, uncertainty, and shade estimates for each crown polygon from the 2018 National Ecological Observatory Network (NEON) and 2025 CHESS campaigns. (in CSV format, .csv). Additional metadata are provided in a data dictionary describing column names and definitions (dd.csv), and in a file-level metadata file (flmd.csv). Crown polygons were manually delineated for each site in the 2025 campaign using a combination of field-collected GPS data (doi:10.15485/3022418), RGB (red, green, blue) and false color reflectance mosaics (doi:10.15485/3013535), and LiDAR-derived (Light Detection and Ranging) canopy height (CHM) and digital surface (DSM) models (DOI and citation to be added upon publication). Where there was misalignment between the spectrometer- and LiDAR-derived data products, polygons prioritized alignment with the spectrometer-derived data products. Polygons were delineated conservatively to only select pixels representative of vegetation samples collected in the field. Crown polygons for 2018 are published at (doi:10.15485/1618130) and were developed using the same protocol. For each polygon, all pixels from all flightlines were extracted where the pixel centroid was contained within the polygon. For each pixel, we extracted the surface reflectance, uncertainty, and shade estimates. Details on the extracted datasets are available at (doi:10.15485/3013527, doi:10.15485/3013535). CHESS Project Description: The Colorado Headwaters Ecological Spectroscopy Study (CHESS) comprised a multi-week airborne remote sensing and field observation campaign in the Upper Gunnison Basin, Colorado, conducted in June and July of 2025. Airborne remote sensing was conducted by the National Ecological Observatory Network Airborne Observation Platform (NEON AOP), concurrent with a field campaign run by the Rocky Mountain Biological Laboratory (RMBL), the Lawrence Berkeley National Laboratory (LBNL) and SLAC National Accelerator Laboratory Watershed Function Science Focus Area (SFA), and NASA-JPL (Jet Propulsion Laboratory) Earth Surface Mineral Dust Source Investigation (EMIT) program. Between June 10 and July 18, 2025, the NEON AOP flight team collected high-resolution aerial imaging spectroscopy and Light Detection and Ranging (LiDAR) data over three domains: the Upper East River (CRBU), Almont Triangle (ALMO), and the Upper Taylor Basin (UPTA). In coordination with the flights, a field campaign acquired ground-truth observations, including observations of vegetation composition, foliar traits, forest demography, and subsurface properties in 18 core sampling areas within the domains. Additional surface water observations were taken at over 380 point locations. All CHESS campaign datasets can be found within the CHESS ESS-DIVE data portal: https://data.ess-dive.lbl.gov/portals/chess. Funding Acknowledgment: This research was carried out at the Jet Propulsion Laboratory, California Institute of Technology, under a contract with the National Aeronautics and Space Administration (80NM0018D0004) and was funded by EMIT Extended Mission Phase E Science.

2018 NEON and 2025 CHESS Campaigns↗

Automated Production of Movies on a Cluster of Computers

A method of accelerating and facilitating production of video and film motion-picture products, and software and generic designs of computer hardware to implement the method, are undergoing development. The method provides for automation of most of the tedious and repetitive tasks involved in editing and otherwise processing raw digitized imagery into final motion-picture products. The method was conceived to satisfy requirements, in industrial and scientific testing, for rapid processing of multiple streams of simultaneously captured raw video imagery into documentation in the form of edited video imagery and video derived data products for technical review and analysis. In the production of such video technical documentation, unlike in production of motion-picture products for entertainment, (1) it is often necessary to produce multiple video derived data products, (2) there are usually no second chances to repeat acquisition of raw imagery, (3) it is often desired to produce final products within minutes rather than hours, days, or months, and (4) consistency and quality, rather than aesthetics, are the primary criteria for judging the products. In the present method, the workflow has both serial and parallel aspects: processing can begin before all the raw imagery has been acquired, each video stream can be subjected to different stages of processing simultaneously on different computers that may be grouped into one or more cluster(s), and the final product may consist of multiple video streams. Results of processing on different computers are shared, so that workers can collaborate effectively.

Nail, Jasper↗

NASA Giovanni: A Tool for Visualizing, Analyzing, and Inter-Comparing Soil Moisture Data

There are many existing satellite soil moisture algorithms and their derived data products, but there is no simple way for a user to inter-compare the products or analyze them together with other related data (e.g., precipitation). An environment that facilitates such inter-comparison and analysis would be useful for validation of satellite soil moisture retrievals against in situ data and for determining the relationships between different soil moisture products. The latter relationships are particularly important for applications users, for whom the continuity of soil moisture data, from whatever source, is critical. A recent example was provided by the sudden demise of EOS Aqua AMSR-E and the end of its soil moisture data production, as well as the end of other soil moisture products that had used the AMSR-E brightness temperature data. The purpose of the current effort is to create an environment, as part of the NASA Giovanni family of portals, that facilitates inter-comparisons of soil moisture algorithms and their derived data products.

Teng, William↗

SeaWiFS calibration and validation plan, volume 3

The Sea-viewing Wide Field-of-view Sensor (SeaWiFS) will be the first ocean-color satellite since the Nimbus-7 Coastal Zone Color Scanner (CZCS), which ceased operation in 1986. Unlike the CZCS, which was designed as a proof-of-concept experiment, SeaWiFS will provide routine global coverage every 2 days and is designed to provide estimates of photosynthetic concentrations of sufficient accuracy for use in quantitative studies of the ocean's primary productivity and biogeochemistry. A review of the CZCS mission is included that describes that data set's limitations and provides justification for a comprehensive SeaWiFS calibration and validation program. To accomplish the SeaWiFS scientific objectives, the sensor's calibration must be constantly monitored, and robust atmospheric corrections and bio-optical algorithms must be developed. The plan incorporates a multi-faceted approach to sensor calibration using a combination of vicarious (based on in situ observations) and onboard calibration techniques. Because of budget constraints and the limited availability of ship resources, the development of the operational algorithms (atmospheric and bio-optical) will rely heavily on collaborations with the Earth Observing System (EOS), the Moderate Resolution Imaging Spectrometer (MODIS) oceans team, and projects sponsored by other agencies, e.g., the U.S. Navy and the National Science Foundation (NSF). Other elements of the plan include the routine quality control of input ancillary data (e.g., surface wind, surface pressure, ozone concentration, etc.) used in the processing and verification of the level-0 (raw) data to level-1 (calibrated radiances), level-2 (derived products), and level-3 (gridded and averaged derived data) products.

Hooker, Stanford B.↗

High Resolution Digital Elevation Models of Pristine Explosion Craters

In order to effectively capture a realistic terrain applicable to studies of cratering processes and landing hazards on Mars, we have obtained high resolution digital elevation models of several pristine explosion craters at the Nevada Test Site. We used the Airborne Terrain Mapper (ATM), operated by NASA's Wallops Flight Facility to obtain DEMs with 1 m spacing and 10 cm vertical errors of 4 main craters and many other craters and collapse pits. The main craters that were mapped are Sedan, Scooter, Schooner, and Danny Boy. The 370 m diameter Sedan crater, located on Yucca Flat, is the largest and freshest explosion crater on Earth that was formed under conditions similar to hypervelocity impact cratering. As such, it is effectively pristine, having been formed in 1962 as a result of a controlled detonation of a 100 kiloton thermonuclear device, buried at the appropriate equivalent depth of burst required to make a simple crater. Sedan was formed in alluvium of mixed lithology and subsequently studied using a variety of field-based methods. Nearby secondary craters were also formed at the time and were also mapped by ATM. Adjacent to Sedan and also in alluvium is Scooter, about 90 m in diameter and formed by a high-explosive event. Schooner (240 m) and Danny Boy (80 m) craters were also important targets for ATM as they were excavated in hard basalt and therefore have much rougher ejecta. This will allow study of ejecta patterns in hard rock as well as engineering tests of crater and rock avoidance and rover trafficability. In addition to the high resolution DEMs, crater geometric characteristics, RMS roughness maps, and other higher-order derived data products will be generated using these data. These will provide constraints for models of landing hazards on Mars and for rover trafficability. Other planned studies will include ejecta size-frequency distribution at the resolution of the DEM and at finer resolution through air photography and field measurements, correlation of ejecta size and composition with radar and visible-thermal IR remote sensing signatures, and comparison of these results with similar measurements of Mars. The final DEMs, ancillary data sets, and derived data products will be made available to the community.

T G Farr↗

Direct Aerosol Radiative Effect Derived From CERES Data Products

The CERES team uses MODIS and VIIRS derived aerosol optical thickness to compute surface and in atmosphere irradiances. In producing the data products, aerosol optical thicknesses derived by Dark Target and Deep Blue algorithms are assimilated in an aerosol transport model. In addition, the aerosol transport model provides aerosol optical thicknesses under cloudy conditions and aerosol optical thicknesses over polar regions. These aerosol optical thicknesses are used for hourly irradiance computations in 11 grids. Global mean top-of-atmosphere direct aerosol radiative effects are -5.2 Wm-2 and -2.2 Wm-2 for, respectively, clear-sky and all-sky conditions. Spatial pattern of the trend of the computed clear-sky direct aerosol radiative effect agrees with that derived from CERES observations. In this presentation, the importance of seamless transition of aerosol optical thicknesses derived from MODIS to those derived from VIIRS is emphasized. Currently, the CERES team is working with MODIS dark target and deep blue teams to achieve the seamless transition in producing CERES Edition 4 data products.

Seiji Kato↗

New Earth Science Data and Access Methods

NASA's Earth Science Enterprise, working with its domestic and international partners, provides scientific data and analysis to improve life here on Earth. NASA provides science data products that cover a wide range of physical, geophysical, biochemical and other parameters, as well as services for interdisciplinary Earth science studies. Management and distribution of these products is administered through the Earth Observing System Data and Information System (EOSDIS) Distributed Active Archive Centers (DAACs), which all hold data within a different Earth science discipline. This paper will highlight selected EOS datasets and will focus on how these observations contribute to the improvement of essential services such as weather forecasting, climate prediction, air quality, and agricultural efficiency. Emphasis will be placed on new data products derived from instruments on board Terra, Aqua and ICESat as well as new regional data products and field campaigns. A variety of data tools and services are available to the user community. This paper will introduce primary and specialized DAAC-specific methods for finding, ordering and using these data products. Special sections will focus on orienting users unfamiliar with DAAC resources, HDF-EOS formatted data and the use of desktop research and application tools.

Moses, John F.↗