Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data product”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

LITE data processing

The Lidar In-space Technology Experiment (LITE) was a payload onboard the Space Shuttle Discovery as part of the September 1994 STS-64 mission. LITE successfully made both atmospheric and surface measurements at the 355 nm, 532 nm, and 1064 nm wavelengths [Winker et al., 1996]. At mission completion, nearly 45 Gbytes of data had been obtained. As the data were collected they were organized into three data sets. The largest of these data sets contained the single-shot full resolution digitized lidar signals for all three wavelengths. The other two data sets contained the instrument status data block (ISDB) and the quick look science data (QLSD). ISDB information was generated once per second and contained timing parameters and engineering data related to the health, status, and configuration of the instrument. The QLSD are 100shot averages of the 355 nm and 532 nm lidar signals and were generated at ten second intervals. As the LITE data were generated, they were output to low-rate and high-rate telemetry streams. The low-rate data contained the ISDB and QLSD. The lowrate data were transmitted to the ground by the Shuttle S-band system through the Tracking and Data Relay Satellite System (TDRSS). The high-rate data contained the full resolution digitized lidar signals for all three wavelengths, the ISDB, and QLSD. The high-rate data were transmitted in real time by the Ku-band system through TDRSS downlink to the LITE operations center at the Johnson Space Center (JSC). High-rate data were only obtained when the orbiter and TDRSS telemetry link coincided with the real-time operations of LITE. The low-rate data were backed up by a Shuttle recorder during periods when the telemetry link was unavailable, and the entire lowrate data stream was transferred to the ground over the course of the mission. A total of 53 hours of lowrate data and 45.5 hours of high-rate data were acquired. All of the LITE raw telemetry data have been archived at the NASA Langley Research Center (LaRC), and the LITE high-rate data have been processed to the level 1 data product. This paper describes the data processing steps required to convert the LITE raw, high-rate telemetry data to the LITE level 1 data product.

Powell, Kathleen A.↗

Cloud Detection from Satellite Imagery: A Comparison of Expert-Generated and Automatically-Generated Decision Trees

Automated cloud detection and tracking is an important step in assessing global climate change via remote sensing. Cloud masks, which indicate whether individual pixels depict clouds, are included in many of the data products that are based on data acquired on- board earth satellites. Many cloud-mask algorithms have the form of decision trees, which employ sequential tests that scientists designed based on empirical astrophysics studies and astrophysics simulations. Limitations of existing cloud masks restrict our ability to accurately track changes in cloud patterns over time. In this study we explored the potential benefits of automatically-learned decision trees for detecting clouds from images acquired using the Advanced Very High Resolution Radiometer (AVHRR) instrument on board the NOAA-14 weather satellite of the National Oceanic and Atmospheric Administration. We constructed three decision trees for a sample of 8km-daily AVHRR data from 2000 using a decision-tree learning procedure provided within MATLAB(R), and compared the accuracy of the decision trees to the accuracy of the cloud mask. We used ground observations collected by the National Aeronautics and Space Administration Clouds and the Earth s Radiant Energy Systems S COOL project as the gold standard. For the sample data, the accuracy of automatically learned decision trees was greater than the accuracy of the cloud masks included in the AVHRR data product.

Shiffman, Smadar↗

A Comprehensive Plan for the Long-Term Calibration and Validation of Oceanic Biogeochemical Satellite Data

The primary objective of this planning document is to establish a long-term capability and validating oceanic biogeochemical satellite data. It is a pragmatic solution to a practical problem based primarily o the lessons learned from prior satellite missions. All of the plan's elements are seen to be interdependent, so a horizontal organizational scheme is anticipated wherein the overall leadership comes from the NASA Ocean Biology and Biogeochemistry (OBB) Program Manager and the entire enterprise is split into two components of equal sature: calibration and validation plus satellite data processing. The detailed elements of the activity are based on the basic tasks of the two main components plus the current objectives of the Carbon Cycle and Ecosystems Roadmap. The former is distinguished by an internal core set of responsibilities and the latter is facilitated through an external connecting-core ring of competed or contracted activities. The core elements for the calibration and validation component include a) publish protocols and performance metrics; b) verify uncertainty budgets; c) manage the development and evaluation of instrumentation; and d) coordinate international partnerships. The core elements for the satellite data processing component are e) process and reprocess multisensor data; f) acquire, distribute, and archive data products; and g) implement new data products. Both components have shared responsibilities for initializing and temporally monitoring satellite calibration. Connecting-core elements include (but are not restricted to) atmospheric correction and characterization, standards and traceability, instrument and analysis round robins, field campaigns and vicarious calibration sites, in situ database, bio-optical algorithm (and product) validation, satellite characterization and vicarious calibration, and image processing software. The plan also includes an accountability process, creating a Calibration and Validation Team (to help manage the activity), and a discussion of issues associated with the plan's scientific focus.

Hooker, Stanford B.↗

Earth Science Data Archive and Access at the NASA/Goddard Space Flight Center Distributed Active Archive Center (DAAC)

The Goddard Distributed Active Archive Center (DAAC), as an integral part of the Earth Observing System Data and Information System (EOSDIS), is the official source of data for several important earth remote sensing missions. These include the Sea-viewing Wide-Field-of-view Sensor (SeaWiFS) launched in August 1997, the Tropical Rainfall Measuring Mission (TRMM) launched in November 1997, and the Moderate Resolution Imaging Spectroradiometer (MODIS) scheduled for launch in mid 1999 as part of the EOS AM-1 instrumentation package. The data generated from these missions supports a host of users in the hydrological, land biosphere and oceanographic research and applications communities. The volume and nature of the data present unique challenges to an Earth science data archive and distribution system such as the DAAC. The DAAC system receives, archives and distributes a large number of standard data products on a daily basis, including data files that have been reprocessed with updated calibration data or improved analytical algorithms. A World Wide Web interface is provided allowing interactive data selection and automatic data subscriptions as distribution options. The DAAC also creates customized and value-added data products, which allow additional user flexibility and reduced data volume. Another significant part of our overall mission is to provide ancillary data support services and archive support for worldwide field campaigns designed to validate the results from the various satellite-derived measurements. In addition to direct data services, accompanying documentation, WWW links to related resources, support for EOSDIS data formats, and informed response to inquiries are routinely provided to users. The current GDAAC WWW search and order system is being restructured to provide users with a simplified, hierarchical access to data. Data Browsers have been developed for several data sets to aid users in ordering data. These Browsers allow users to specify spatial, temporal, and other parameter criteria in searching for and previewing data.

Leptoukh, Gregory↗

A Machine Learning Approach to Determine Surface Radiative Fluxes based on CERES Observations

The Clouds and Earth’s Radiant Energy System (CERES) projects provides satellite-based observations of the radiative fluxes and clouds systems. CERES climate quality data products typically take several months of calibration and validation before release to the public. An alternative data product, Fast Longwave and Shortwave radiative Flux (FLASHFlux), was created to provide data to the applied sciences and educational users. FLASHFlux provides Top-of-Atmosphere radiative fluxes, Clouds properties, and parameterized surface radiative fluxes within four days for footprint (Level 2) data. We investigate the use of Artificial Neural Network (ANN) using MODerate resolution Imaging Spectroradiometer (MODIS) derived clouds properties and meteorology from the Global Assimilation and Meteorology Office (GMAO) scaled to the CERES footprint from the CERES Clouds Radiative Swath (CRS) data product to compute surface radiative fluxes. We test ANN produce fluxes against surface fluxes produced from the Fu-Liou model used in CRS and the Langley Parameterized Shortwave Algorithm (LPSA) and Langley Parameterized Longwave Algorithm (LPLA) used in FLASHFlux. We also validated each model with ground-based observations. Furthermore, we investigate Leave-One-Feature-Out Importance (LOFO) to evaluate the significance of each feature in our training and provide insight for future models. Advances in machine learning, along with increases in computational capabilities and available data allow us to estimate effects of unresolved processes in our climate without direct modeling. This work evaluates the ability to create accurate data-driven models to supplement or replace current models that estimate surface radiative fluxes.

Climatology↗

New Ways of Facilitating Improved Data Discovery and Access for NASA's Suborbital Earth Science Observations

NASA conducts field research in various Earth Science disciplines utilizing airborne and other non-satellite platforms to acquire in situ and remotely sensed observations indicative of physical processes across a range of scales. Field efforts are key in the development and validation of instruments and satellite algorithm refinements. The heterogeneous data, with a range of file formats, scales, and acquisition methods, support research in several science areas. NASA’s archive process assigns data products to discipline-oriented Distributed Active Archive Centers (DAACs) for stewardship. Over time, individual DAACs have developed tools for data browsing and serving disparate user bases. As science becomes more interdisciplinary, researchers need to incorporate observations from multiple campaigns, and multiple DAACs, into their work. Motivated in part by this shifting paradigm of needs, the Catalog of Archived Suborbital Earth Science Investigations (CASEI) was created. CASEI provides a single starting point to browse, search, and discover airborne and field data. Contextual metadata are organized and inter-linked allowing intuitive, integrated exploration across all NASA DAACs. Campaign science objectives, platform and instrument configurations, geographical details, geophysical concepts, and more are tracked in CASEI’s database, facilitating multi-parameter search, browse, and discovery of relevant data products. Researchers are able to directly access associated data products, via DOI links, regardless of the DAAC where they reside. Significant events, key time periods of high science interest within the longer-duration campaign effort, are also indicated and allow for a more efficient identification of critical data subsets. This presentation describes CASEI’s development, intensive metadata curation process, and demonstrates the web interface experience. Initial content metrics and plans for continued maintenance will also be discussed.

metadata↗

Complex Network Analysis and Intelligent Monitoring Platform

Data Products has particular interest in developing an efficient network analysis and monitoring system that utilizes advanced machine learning methods to mine complex network data of the type generated within large data centers, with an objective to provide tangible business-usable intelligence. The Laboratory is currently the lead institution for a U.S. Department of Energy Office of Science (DOE/SC) network research project called BigData Express (BDE). The project seeks to provide an orchestration service for high-performance data movement of data sets for large-scale science. This collaboration is believed to potentially be a highly symbiotic one, with Data Products platform development benefiting from the rich sets of network data available in the BDE development environment, and BDE benefiting from the Data Products machine learning analysis of BDE-generated data movement.

97 MATHEMATICS AND COMPUTING↗

Online Rapid Analysis of Laser Heterodyne Radiometer (LHR) Data Using the Planetary Spectrum Generator (PSG)

One of the biggest challenges in developing scientific instruments is not just the build and testing of an instrument, but the method for processing the data and producing a consistent, well characterized data product that can be confidently used by the public and scientific community. Raw data products are frequently an array of numbers that are a read-out of voltages. The challenge is to convert these arrays into meaningful information as well as remove noise and interferences. Because this can be a tedious and time-consuming, the goal is to automate the process so that data ca be processed rapidly and be available in real-time for event monitoring. Here we present a rapid analysis method for Laser Heterodyne Radiometer (LHR) data that can be used to analyze data taken from a range of LHR observation modes (column, limb, etc.). This online tool uses the versatile Planetary Spectrum Generator (PSG) and allows LHR users to quickly analyze their own data using a NASA Goddard Space Flight Center (GSFC) monitored capability to ensure quality and reproducibility in the data products. Background: Development of a miniaturized LHR (mini-LHR) as a ground instrument for measuring carbon dioxide (CO 2 ) and methane (CH 4 ) in the atmospheric column started in 2009 with the commercial availability of distributive feedback lasers (DFB) in wavelengths that could measure absorption of gases in the near-IR. As new DFB lasers, detectors and hardware emerged at different wavelengths, additional gases were added to the capability. The mini-LHR was adapted into an occultation-viewing CubeSat with Lawrence Livermore National Laboratory (LLNL) for observing CO 2 , CH 4 , and H 2 O in the limb and was launched in 2019. Other versions of the LHR technology have been designed for observation of water vapor in the lunar exosphere as well as observations of trace gases in planetary atmospheres and plumes from icy moons. The PSG is an online tool developed at GSFC that can be used for synthesizing Earth and planetary spectra (atmospheres and surfaces) over a broad range of wavelengths (0.1 μm to 100 mm) for any observatory, orbiter or lander. Spectra are simulated by combining several state-of-the-art radiative transfer models, spectroscopic databases, planetary databases, as well as modern-era retrospective analysis for research and applications, version 2 (MERRA-2) data set which provides meteorological inputs such as modeled surface pressure for calculating dry-air columns.

Emily Wilson↗

NGEE Arctic Integrated Modeling (IM3): Improved snow-vegetation interaction

This data product represents the integration of new code capability for arctic tundra snow-vegetation-terrain interactions into the Energy Exascale Earth System Model (E3SM), through the E3SM Land Model (ELM) component. This code integration is the result of collaborative effort between the NGEE Arctic project and the E3SM project. The NGEE Arctic project developed a total of six Integrated Modeling (IM) modules informed by observations and experiments. New ELM capability represented by this data product (IM3) falls into three categories: 1) Downscaling from gridcell to topographic unit level when working through the existing coupler bypass code. 2) Four new parameters (taper, stocking, bendresist, and vegshape) have been added to ELM to allow for flexible definition of snow-vegetation interactions. 3) Vegshape and bendresist parameters are used to calculate the fraction of leaf area and/or stem area buried by snow for a given snow depth. This data record consists of a single document (pdf format) that describes the theoretical basis for the snow-vegetation-terrain interactions added to ELM, and describes the modifications made to the ELM code. The Methods section of this metadata record includes a link to the public E3SM code repository where the exact code modifications as integrated in E3SM can be accessed. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

Thornton, Peter E [ORNL] (ORCID:0000000247595158)↗

IGS Directory

The International GPS (Global Positioning System) Service for Geodynamics (IGS) supports and helps coordinate GPS data production and parameters useful for generating more accurate data products. The IGS has operated a GPS tracking system for several years. It contains more than 100 stations worldwide and has produced a combined GPS ephemeris that has become the standard for geodesists and geophysicists worldwide. IGS data and products are freely available to all, thanks to the cooperation and participation of all the IGS members. This directory provides data on the stations and provides names and contact information with personnel involved with the IGS.

Source record↗

Enabling modern data discovery for atmospheric measurements

The Atmospheric Radiation Measurement (ARM) user facility is a US Department of Energy Office of Science user facility that is managed and operated through a collaborative effort led by nine US Department of Energy national laboratories. The ARM Data Center, located at Oak Ridge National Laboratory, is responsible for the timely collection, processing, and delivery of data products to the scientific community. The ARM Data Center holds more than 11,000 data products, including metadata collected from field campaigns, instruments, value-added products, and principal investigator–contributed data. These data sets are checked for successful transfer (for most data, this transfer is carried out automatically via the network; however, some of the largest data sets and some of the most remote sites require manual shipping of hard disks) and both the data and metadata are processed to a standard format, which is an ARM-standardized structure, via the Network Common Data Form. The Network Common Data Form is a self-describing binary format with many compatible software tools. Once processed, the data are cataloged, stored in the ARM Data Archive, and made discoverable through association with an array of metadata-characterizing information, such as location and measurement classification. These metadata enable powerful search capabilities through the ARM Data Center Data Discovery interface. This paper discusses the workflow of how the new discovery system has been redesigned from user requirements and how the data are distributed to the scientific community.

54 ENVIRONMENTAL SCIENCES↗

Geodetic Strain Analysis Tool

A geodetic software analysis tool enables the user to analyze 2D crustal strain from geodetic ground motion, and create models of crustal deformation using a graphical interface. Users can use any geodetic measurements of ground motion and derive the 2D crustal strain interactively. This software also provides a forward-modeling tool that calculates a geodetic velocity and strain field for a given fault model, and lets the user compare the modeled strain field with the strain field obtained from the user s data. Users may change parameters on-the-fly and obtain a real-time recalculation of the resulting strain field. Four data products are computed: maximum shear, dilatation, shear angle, and principal components. The current view and data dependencies are processed first. The remaining data products and views are then computed in a round-robin fashion to anticipate view changes. When an analysis or display parameter is changed, the affected data products and views are invalidated and progressively re-displayed as available. This software is designed to facilitate the derivation of the strain fields from the GPS and strain meter data that sample it to facilitate the understanding of the strengths and weaknesses of the strain field derivation from continuous GPS (CGPS) and other geodetic data from a variety of tectonic settings, to converge on the "best practices" strain derivation strategy for the Solid Earth Science ESDR System (SESES) project given the CGPS station distribution in the western U.S., and to provide SESES users with a scientific and educational tool to explore the strain field on their own with user-defined parameters.

Kedar, Sharon↗

Strategizing Earth Science Data Development

Developing Earth science data products that meet the needs of diverse users is a challenging task for both data producers and service providers, as user requirements can vary significantly and evolve over time. In this comment, we discuss several strategies to improve Earth science data products that everyone can use.

Earth science↗

Recent Progress in the International Laser Ranging Service (ILRS)

The International Laser Ranging Service (ILRS) provides Satellite Laser Ranging (SLR) and Lunar Laser Ranging (LLR) observations and data products with a focus on Earth and Lunar science and engineering applications. The basic observables are the precise two-way time-of-flight of ultra-short laser pulses from ground stations to retroreflector arrays on satellites and the Moon and the one-way time-of-flight measurements to space-borne receivers (transponders). SLR is one of the four space geodetic techniques (along with VLBI, GNSS, and DORIS). The International Terrestrial Reference Frame (ITRF) development, maintained by IERS, is based on these geodetic observations. Fundamental data products include accurate satellite ephemerides, Earth orientation parameters, three dimensional coordinates and velocities of the ILRS tracking stations, time-varying geocenter coordinates, static and time-varying coefficients of the Earth’s gravity field, fundamental physical constants, lunar ephemerides and librations, and lunar orientation parameters. The ILRS continues to expand spatial and temporal coverage of SLR observations. New stations with new technologies are being deployed; existing stations are being upgraded. Some of these stations are multi-technique Core Sites. New satellites are expanding applications and strengthening the ILRS contribution to the reference frame. New analysis, modeling, and data processing techniques are improving data products. New campaigns are expanding our applications into relativity and the study of non-gravitational forces. New activities are underway on Lunar Laser Ranging, Time Transfer, and Space Debris Tracking, helping to expand laser ranging applications. This talk will give an update on the current ILRS activities and their impact on ILRS data products.

Report on the ILRS activities↗

Assessing the Uncertainty Impact of CERES Fast Longwave and SHortwave Radiative Flux (FLASHFlux) Level 3 Product With and Without Terra Observations

The Clouds and Earth’s Radiant Energy System (CERES) project provides satellite-based observations of how Earth’s energy flows are varying in time and space and how clouds and aerosols are affecting the Earth’s radiation budget. Nominally, CERES data products require months of validation and calibration before releasing a climate quality data. The Fast Longwave And SHortwave radiative Flux (FLASHFlux) data product was developed to provide data for applied science research involving the renewable energy and agricultural sectors within a week of observation. FLASHFlux achieves this by using simplified calibration, an operational meteorological product from Global Monitoring and Assimilation Office (GMAO), and a surface parameterizations model. The CERES FLASHFlux provides two data products: 1) an hourly Level 2 Single Scanner Footprint (SSF) data separately for Terra and NOAA-20 observations. 2) a daily Level 3 Time Interpolated and Spatially Averaged (TISA) gridded data that combines NOAA-20 and Terra observations on a one-degree equal angle grid. FLASHFlux TISA data product interpolate on a diurnal model that assumes a satellite equilateral crossing time of 10:30 AM and 1:30 PM from Terra and Aqua, respectively. Aqua was replaced by NOAA-20 starting on September 2022. Terra is planned to be replace by the Satellite ClOud and Radiation Property retrieval System (SatCORPS) soon. We are currently using the Terra observations as it continues to drift. We assess the impact of FLASHFlux TISA data when Terra is removed. An uncertainty estimate of the Top-Of-Atmosphere (TOA) fluxes are given of FLASHFlux Version4A (before Terra drift) and Version4B (current), and Version4B (no Terra) in comparison to the CERES EBAF and SYN1deg. In addition, we compare FLASHFlux Version4B and Version4B (no Terra) surface radiative fluxes to ground base measurements to determine the impact of running without Terra data.

PC Sawaengphokhai↗

Tethered Balloon System Ozone Profiles during CoURAGE Summer Intensive Operational Period Field Campaign Report

During the summer IOP, the small ARM field campaign CRGTBSO3 collected measurements to gain an improved understanding of differences between the atmospheric composition in and just above the marine layer at the CoURAGE TBS site near the eastern shore of Chesapeake Bay. CRGTBSO3 included guest instrumentation with ozone (O 3 ) profile measurements on the TBS and surface O3 and meteorological measurements at the TBS site. An En-Sci 2Z electrochemical cell (ECC) ozonesonde (Komhyr 1969, 1986, Witte et al. 2018) was included on the TBS. The ozonesonde was connected to an InterMet iMet-4RSB radiosonde, and the overall data collected included vertical profiles of ozone, relative humidity, temperature, pressure, and altitude. The CRGTBSO3 iMet-4 radiosonde data is identical to that of the iMet in the Tethered Balloon System Merged Data Product (TBSMERGED; Gaustad and Dexheimer 2025). The TBSMERGED data product also includes meteorological data from a different sensor, the iMet XQ2. In some cases, the iMet XQ2 relative humidity (RH) data may be more accurate than the iMet-4, such as for some instances when the iMet-4 RH data stays at 100% for an extended period throughout a profile.

54 ENVIRONMENTAL SCIENCES↗

Measurement of Thematic Mapper data quality

Thematic Mapper data from Landsat-4 and Landsat-5 were examined for band-to-band registration, absolute geodetic registration, periodic noise and spatial resolution. Between focal planes, appreciable misregistrations existed in early data products but were corrected in later data products. The analysis of absolute geodetic registration used only system-corrected data because ground control point-corrected data were unavailable. Geodetic registration errors averaged only 9.7 pixels, less than expected for system-corrected data. Periodic noise at four spatial frequencies was observed in Landsat-5 Thematic Mapper data by using Fourier analysis on small areas over water. Magnitudes of periodic noise components were consistent within a scene. The modulation transfer function was determined for two Landsat-4 scenes. The effective instantaneous field of view was 40.8 meters in one case, and 48.6 meters in the other.

Wrigley, R. C.↗

sfccldgrid2longstation

The site data in a station data product format used to produce the gridded cloud grid data product, sfccldgrid2caracena.

54 ENVIRONMENTAL SCIENCES↗