Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data product”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

NWB Sensors Infrared Cloud Imager Data Products from SGP

NWB Sensors is a company which has developed a commercially available Infrared Cloud Imager (ICI). For more information, consult the company's webpage, https://www.nwbsensors.com/infrared-cloud-imager. To validate the radiometric accuracy of the ICI, NWB Sensors deployed it to the ARM SGP User Facility in 2023. The primary motivation of this deployment was to perform an intercomparison between the ICI and the Atmospheric Emitted Radiance Interferometer (AERI). The AERI spectral radiance data product can be integrated across the response function of the ICI and directly compared to the zenith radiance observed by the ICI. In addition, the ICI uses proprietary models of the downwelling clear-sky radiance in its cloud processing algorithms. They are based on surface meteorology and precipitable water vapor (PWV). These models were validated by comparing their predicted radiances to those derived from radiative transfer models of the ARM radiosondes. Finally, PWV observations derived from the ICI's onboard GNSS-based PWV retrieval system were compared against those from the microwave radiometer. This dataset contains the ICI radiance and cloud data products.

Atmosphere↗

Moderate Resolution Imaging Spectrometer (MODIS) design evolution and associated development and verification of data product efforts

The Moderate Resolution Imaging Spectrometer (MODIS) is a key observing facility to be flown on the Earth Observing System (EOS). The facility is composed of two instruments called MODIS-N (nadir) and MODIS-T (tilt). The MODIS-N is being built under contract to NASA by the Santa Barbara Research Center. The MODIS-T is being fabricated by the Engineering Directorate at the Goddard Space Flight Center. The MODIS Science Team has defined nearly 40 biogeophysical data products for studies of the ocean and land surface and properties of the atmosphere including clouds that can be expected to be produced from the MODIS instruments shortly after the launch of EOS. The ocean, land, atmosphere, and calibration groups of the MODIS Science Team are now proceeding to plan and implement the operations and facilities involving the analysis of data from existing spaceborne, airborne, and in-situ sensors required to develop and validate the algorithms that will produce the geophysical data products. These algorithm development and validation efforts will be accomplished wherever possible within the context of existing or planned national and international experiments or programs such as those in the World Climate Research Program.

Salomonson, Vincent V.↗

Solutions Network Formulation Report. Visible/Infrared Imager/Radiometer Suite and Advanced Microwave Scanning Radiometer Data Products for National Drought Monitor Decision Support

Drought effects are either direct or indirect depending on location, population, and regional economic vitality. Common direct effects of drought are reduced crop, rangeland, and forest productivity; increased fire hazard; reduced water levels; increased livestock and wildlife mortality rates; and damage to wildlife and fish habitat. Indirect impacts follow on the heels of direct impacts. For example, a reduction in crop, rangeland, and forest productivity may result in reduced income for farmers and agribusiness, increased prices for food and timber, unemployment, reduced tax revenues, increased crime, foreclosures on bank loans to farmers and businesses, migration, and disaster relief programs. In the United States alone, drought is estimated to result in annual losses of between $6 - 8 billion. Recent sustained drought in the United States has made decision-makers aware of the impacts of climate change on society and environment. The eight major droughts that occurred in the United States between 1980 and 1999 accounted for the largest percentage of weather-related monetary losses. Monitoring drought and its impact that occurs at a variety of scales is an important government activity -- not only nationally but internationally as well. The NDMC (National Drought Mitigation Center) and the USDA (U.S. Department of Agriculture) RMA (Risk Management Agency) have partnered together to develop a DM-DSS (Drought Monitoring Decision Support System). This monitoring system will be an interactive portal that will provide users the ability to visualize and assess drought at all levels. This candidate solution incorporates atmospherically corrected VIIRS data products, such as NDVI (Normalized Difference Vegetation Index) and Ocean SST (sea surface temperature), and AMSR-E soil moisture data products into two NDMC vegetation indices -- VegDRI (Vegetation Drought Response Index) and VegOUT (Vegetation Outlook) -- which are then input into the DM-DSS.

Estep, Leland↗

On Simulating the Impacts of Open Water Bodies on the SMAP Passive Soil Moisture Data Product

The Soil Moisture Active and Passive (SMAP) mission is a NASA earth science mission aiming at improving our understanding of the dynamics of the cycles of energy, water, and carbon at global scales. The mission features two complementary sensors on the same low-Earth orbiting platform: an L-band synthetic aperture radar (SAR) operating at 1.26 GHz and an L-band radiometer operating at 1.41 GHz. Together these instruments will provide global mapping of soil moisture and freeze/thaw states in 2-3 days, with a tentative launch date in 2014. The work reported in this study focuses primarily on the development of the SMAP radiometer-only soil moisture data product. For passive soil moisture retrieval at satellite footprint scales, one way to improve retrieval accuracy is to correct for the microwave emission from open water bodies prior to retrieval. The accuracy of this correction will depend on not only the locations of these water bodies, but also the geolocation accuracy of the instrument. As perfect knowledge is never attainable in practice, it is important to assess the impacts of these uncertainties on the SMAP radiometer observations and hence the passive soil moisture retrieval accuracy. In this presentation, we present the results of our preliminary assessment on the impacts of these uncertainties. Our study consists of two parts: (1) a sensitivity analysis on the SMAP radiometer observations due to uncertainties in water-body classification, and (2) realistic global simulations that take into account of additional uncertainties (e.g., geolocation and ancillary data) and SMAP-specific instrument characteristics (e.g., orbit sampling and antenna pattern). The results will provide valuable prelaunch guidance to the SMAP team in identifying different error sources and their relative impacts on the passive soil moisture data product.

Chan, Steven↗

STAR Data Production Workflow on HPC: Lessons Learned & Best Practices

The Solenoidal Tracker at RHIC (STAR) is a multi-national supported experiment located at Brookhaven National Lab. The raw physics data captured from the detector is on the order of tens of PBytes per data acquisition campaign, which makes STAR fit well within the definition of a big data science experiment. The production of the data has typically run on standard nodes or on standard Grid computing environments. All embedding simulations (complex workflow mixing real and simulated events) have been run on standard Linux resources at the National Energy Research Scientific Computing Center (NERSC) aka PDSF. However, HPC resources such as Cori have become available for STAR's data production as well as embedding, and STAR has been the very first experiment to show feasibility of running a sustainable data production campaign on this computing resource. The use of Docker containers with Shifter is required to run on HPC @ NERSC - this approach encapsulates the environment in which a standard STAR workflow runs. From the deployment of a tailored Scientific Linux environment (requiring many of its own libraries and special configurations required to run) to the deployment of third-party software and the STAR specific software stack, it has become impractical to rely on a set of containers containing each specific software release. To this extent, solutions based on the CERN VM File System (CVMFS) for the deployment of software and services have been employed in HENP, but one needs to make careful scalability considerations when using a resource like Cori, such as not allowing all software to be deployed in containers or bare node. Additionally, CVMFS clients are not compatible on Cori nodes and one needs to rely on an indirect NFS/DVS mount scheme. In our contribution, we will discuss our strategies from the past and our current solution based on CVMFS. Furthermore, running on HPC is not a simple task as each aspect of the workflow must be enabled to scale, run efficiently, and the workflow needs to fit within the boundaries of the provided queue system (SLURM in this case). Lastly, we will also discuss what we have learned so far about what is the best method for grouping jobs to maximize a single 48 core HPC node within a specific time frame and maximize our workflow efficiency.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Augmenting Landsat time series with Harmonized Landsat Sentinel-2 data products: Assessment of spectral correspondence

An increase in the temporal revisit of satellite data is often sought to increase the likelihood of obtaining cloud- and shadow-free observations as well as to improve mapping of rapidly- or seasonally-changing features. Currently, as a tandem, Landsat-7 Enhanced Thematic Mapper Plus (ETM+) and −8 Operational Land Imager (OLI) provide an acquisition opportunity on an 8-day revisit interval. Sentinel-2A and -2B MultiSpectral Instrument (MSI), with a wider swath, have a 5-day revisit interval at the equator. Due to robust pre- and post-launch cross-calibration, it has been possible for NASA to produce the Harmonized Landsat Sentinel-2 (HLS) data product from Landsat-8 OLI and Sentinel-2 MSI: L30 and S30, respectively. Knowledge of the agreement of HLS outputs (especially S30) with historic Landsat surface reflectance products will inform the ability to integrate historic time-series information with new and more frequent measures as delivered by HLS. In this research, we control for acquisition date and data source to cross-compare the HLS data (L30, S30) with established Landsat-8 OLI surface-reflectance measures as delivered by the USGS (hereafter BAP, Best Available Pixel). S30 and L30 were found to have high agreement (R = 0.87–0.96) for spectral channels and an r = 0.99 for Normalized Burn Ratio (NBR) with low relative root-mean-square difference values (1.7%–3.3%). Agreement between L30 and BAP was lower, with R values ranging from 0.85 to 0.92 for spectral channels and R = 0.94 for NBR. S30 and BAP had the lowest agreement, with R values ranging from 0.71 to 0.85 for spectral channels and r = 0.90 for NBR. Comparisons indicated a stronger agreement at latitudes above 55° N. Some dependency between spectral agreement and land cover was found, with stronger correspondence for non-vegetated cover types. The level of agreement between S30 and BAP reported herein would enable integration of HLS outputs with historic Landsat data. The resulting increased temporal frequency of data allows for improvements to current cloud screening practices and increases data density and the likelihood of temporal proximity to target date for pixel compositing approaches. Furthermore, additional within-year observations will enable change products with a higher temporal fidelity and allow for the incorporation of phenological trends into land cover classification algorithms.

Michael A. Wulder↗

Planetary Boundary Layer Height from AIRS, MERRA-2, and GPS Radio Occultation Data Products at NASA GES DISC, and Insights from Their Profiles Intercomparison

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provides archive and distribution services for several data products in the Planetary Boundary Layer (PBL) category. As a new variable added to the Atmospheric Infrared Sounder (AIRS) Version 6 support product, the PBL height from AIRS is derived based on the gradients of the retrieved relative humidity profile, and provides the atmospheric pressure at the top of the PBL over the ocean. The GES DISC also hosts the Modern-Era Retrospective analysis for Research and Applications-2 (MERRA-2) product generated by the Goddard Earth Observing System Model Version 5 (GEOS-5) data assimilation system. The PBL height from MERRA-2 is based on the total eddy diffusion coefficient of heat. The monthly PBL height has been made available in the Giovanni system (Giovanni is a Web-based application developed by the GES DISC providing a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data). Recently, the GES DISC began serving the global PBL height climatology product derived from the COSMIC/FORMOSAT-3 and TerraSAR-X Global Positioning System (GPS) radio occultation (RO) measurements from June 2006 to December 2015. In a previous study, we presented the monthly PBL height data from AIRS and MERRA-2 and demonstrated the GES DISC services which support data intercomparison, such as access, plotting, sub-setting, regridding, and generation of a multi-year monthly mean. We also provided intercomparison results, and found that different PBL height definitions contributed to significant differences of PBL height values between AIRS and MERRA-2. In this work, we present the 10-year seasonal climatologies from the AIRS, MERRA-2 and GPS-RO. We also used the cross section and vertical profile services in Giovanni to display and analyze the vertical atmosphere structure over regions where the PBL height derived from the AIRS and MERRA-2 are quite different. The examination of the AIRS and MERRA-2 three-dimensional data found that the relative humidity profiles had larger differences than the temperature profiles. The MERRA-2 gives more details than the AIRS for the vertical distribution of the humidity.

Ding, Feng↗

Performance Metrics for the Assessment of Satellite Data Products: An Ocean Color Case Study

Performance assessment of ocean color satellite data has generally relied on statistical metrics chosen for their common usage and the rationale for selecting certain metrics is infrequently explained. Commonly reported statistics based on mean squared errors, such as the coefficient of determination (r2), root mean square error, and regression slopes, are most appropriate for Gaussian distributions without outliers and, therefore, are often not ideal for ocean color algorithm performance assessment, which is often limited by sample availability. In contrast, metrics based on simple deviations, such as bias and mean absolute error, as well as pair-wise comparisons, often provide more robust and straightforward quantities for evaluating ocean color algorithms with non-Gaussian distributions and outliers. This study uses a SeaWiFS chlorophyll-a validation data set to demonstrate a framework for satellite data product assessment and recommends a multimetric and user-dependent approach that can be applied within science, modeling, and resource management communities.

remote sensing↗

Changes in the TRMM Version 7 Space/Time Averaged Level 3 Data Products Based on GPROF TMI Swath-Based Precipitation Retrievals

TRMM has three level 3 (space/time averaged) data products that aggregate level 2 TRMM Microwave Imager (TMI) GPROF precipitation retrievals. These three products are TRMM 3A12, which is a monthly accumulation of 2A12 the GPROF swath retrieval product; TRMM 3B31, which is a monthly accumulation of 2A12 and 2B31 the combined retrieval product that uses both Precipitation Radar (PR) and TMI data; and 3G68 and its variants, which provide hourly retrievals for TMI, PR and combined. The 3G68 products are packaged as daily files but provide hourly information at 0.5 deg x 0.5 deg resolution globally, 0.25 deg x 0.25 deg globally, or 0.1 deg x 0.1 deg over Africa, Australia and South America. This paper will present early information of the changes in the v7 TMI GPROF level 2 retrievals that have an impact on the level 3 accumulations. This paper provides an analysis of the effect the 2A12 GPROF changes have on 3G68 products. In addition, it provides a comparison between the TRMM level 3 products that use the TMI GPROF swath retrievals.

Stocker, Erich↗

The high level trigger and express data production at STAR

To meet the demands of the Beam Energy Scan phase-II (BES-II) program, the STAR experiment at the Relativistic Heavy Ion Collider (RHIC) developed a dual real-time framework consisting of a High Level Trigger (HLT) and an Express Data Production system (xProduction). The HLT operates online within the Data Acquisition (DAQ) chain on a dedicated multi-core CPU cluster with the option to offload compute-intensive kernels to Xeon Phi coprocessors. It uses parallelized algorithms, such as the Cellular Automaton (CA) Track Finder, to perform rapid tracking, vertexing, and event filtering. This allows it to select events of interest in real time and provide immediate feedback on detector and beam conditions. In contrast, the xProduction workflow runs concurrently and independently of the DAQ loop. It applies near offline-quality calibration and reconstruction within hours of data collection. The xProduction input is the express data stream, whose content can be enriched by HLT trigger/priority selections under DAQ/HLT resource constraints, and it uses the STAR calibration/conditions framework, incorporating online calibration/QA information when available. This enables early preliminary physics analysis, including the reconstruction of rare signals, such as hyperons and hypernuclei. It also provides collaboration-wide access to analysis-ready datasets. Together, the HLT and xProduction systems form a complementary architecture: the HLT performs online event selection while the xProduction chain delivers high-quality results within a short amount of time. This integrated framework has enabled the prompt reconstruction of the $^5_Λ$ He hypernucleus with high statistical significance and the efficient processing of hundreds of millions of heavy-ion collision events. In conclusion, its demonstrated scalability and robustness establish a model for future high-luminosity experiments requiring both online event filtering and rapid access to analysis-quality data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗