Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

MODIS and VIIRS Calibration and Characterization in Support of Producing Long-Term High-Quality Data Products

Terra and Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) have successfully operated since their launches in 1999 and 2002, respectively, and generated various data products to support the Earth remote sensing disciplines and users worldwide for their research activities and applications, including studies of the Earth system, and its changes over time and geographic regions. The MODIS data have also significantly contributed to the continuity of multi-decadal satellite data records and led to major advances in the Earth remote sensing field. The long-term data records from MODIS observations have been and will continue to be extended by the Visible Infrared Imaging Radiometer Suite (VIIRS) instruments, currently operated aboard the Suomi-National Polar-Orbiting Partnership (NPP) and NOAA-20 satellites. The data quality of satellite instruments strongly depends on their calibration accuracy and stability. In order to help scientists and users gain a better understanding of MODIS and VIIRS data quality, this paper provides an overview of their on-orbit calibration methodologies, approaches, and results derived from instrument on-board calibrators and lunar observations, as well as select Earth view targets. What is also discussed is the calibration consistency between MODIS and VIIRS and its potential impact on producing multi-sensor long-term data records. As illustrated, the overall performance of both MODIS and VIIRS continues to meet their design requirements.

MODIS↗
NASA NTRS1981

Data Quality: 1979 Southeastern Virginia Urban Plume Study (SEV-UPS): Surface and Airborne studies

The SEV-UPS field study conducted during August 1979 involved the coordinated air quality data collection efforts of three different organizations operating a total of four aircraft and 12 ground stations. Incorporated into plans for that program were numerous quality assurance activities designed to identify potential hazards for data quality in time for their correction and to take data to allow assessment of the consistency of the data from different stations. The purpose of this study was to document QA procedures that were performed by participating agencies and revise data from all platforms for mutual compatibility. For the latter effort, cases were identified on 21 occasions on seven different days where two or more monitoring systems were operating in the same location at nearly the same time. Data from the systems involved were tabulated in 200 m altitude segments, averaged and compared to detect any bias between measurements made from different systems. The results of these comparisons along with the results of independent performance audits are presented.

White, J. H.↗
NASA NTRS2013

A Signal Detection Theory Approach to Evaluating Oculometer Data Quality

Currently, data quality is described in terms of spatial and temporal accuracy and precision [Holmqvist et al. in press]. While this approach provides precise errors in pixels, or visual angle, often experiments are more concerned with whether subjects'points of gaze can be said to be reliable with respect to experimentally-relevant areas of interest. This paper proposes a method to characterize oculometer data quality using Signal Detection Theory (SDT) [Marcum 1947]. SDT classification results in four cases: Hit (correct report of a signal), Miss (failure to report a ), False Alarm (a signal falsely reported), Correct Reject (absence of a signal correctly reported). A technique is proposed where subjects' are directed to look at points in and outside of an AOI, and the resulting Points of Gaze (POG) are classified as Hits (points known to be internal to an AOI are classified as such), Misses (AOI points are not indicated as such), False Alarms (points external to AOIs are indicated as in the AOI), or Correct Rejects (points external to the AOI are indicated as such). SDT metrics describe performance in terms of discriminability, sensitivity, and specificity. This paper presentation will provide the procedure for conducting this assessment and an example of data collected for AOIs in a simulated flightdeck environment.

Latorella, Kara↗
NASA NTRS1978

Process air quality data

Air quality sampling was conducted. Data for air quality parameters, recorded on written forms, punched cards or magnetic tape, are available for 1972 through 1975. Computer software was developed to (1) calculate several daily statistical measures of location, (2) plot time histories of data or the calculated daily statistics, (3) calculate simple correlation coefficients, and (4) plot scatter diagrams. Computer software was developed for processing air quality data to include time series analysis and goodness of fit tests. Computer software was developed to (1) calculate a larger number of daily statistical measures of location, and a number of daily monthly and yearly measures of location, dispersion, skewness and kurtosis, (2) decompose the extended time series model and (3) perform some goodness of fit tests. The computer program is described, documented and illustrated by examples. Recommendations are made for continuation of the development of research on processing air quality data.

Butler, C. M.↗
NASA NTRSDate not supplied

Data Quality Challenges for Analysis Ready Data (ARD)

Data quality plays a critical role in research and applications. The Earth Science Information Partners (ESIP) Information Quality Cluster (IQC) defines four aspects of information quality: Science, Product, Stewardship, and Services. The ESIP IQC has become internationally recognized as an authoritative and responsive resource of information and guidance to data producers and distributors on how to implement data quality standards and best practices for their science data systems, datasets, and data/metadata dissemination services. In recent years, cloud computing environments have provided scale-up capabilities such as data archives and services, enabling interdisciplinary science and applications. More value-added products are expected from data service providers, including Analysis Ready Data (ARD). ARD refers to data that has been preprocessed into a form that allows immediate analysis by the end user, processed to a minimum set of requirements and provides interoperability over time and across multiple datasets. Once a dataset has been developed from its original form to produce ARD, what quality characteristics should the derived dataset or ARD possess? Also, is it safe to assume that the quality of the ARD is consistent with the quality of the source data, or are there special attributes to an ARD that would warrant a secondary, independent quality assessment? What provenance (also called “data lineage”) information needs to be included in ARD? It is important to answer these questions, especially given the ease of use of ARD, and the consequent temptation by users to trust ARD without understanding the limitations or possible variations in quality compared to the source data. In this presentation, we will discuss data quality challenges for ARD products and services and introduce IQC for participation.

data quality↗
NASA NTRS2016

International Metadata Standards and Enterprise Data Quality Metadata Systems

Well-documented data quality is critical in situations where scientists and decision-makers need to combine multiple datasets from different disciplines and collection systems to address scientific questions or difficult decisions. Standardized data quality metadata could be very helpful in these situations. Many efforts at developing data quality standards falter because of the diversity of approaches to measuring and reporting data quality. The one size fits all paradigm does not generally work well in this situation. I will describe these and other capabilities of ISO 19157 with examples of how they are being used to describe data quality across the NASA EOS Enterprise and also compare these approaches with other standards.

data quality↗
NASA NTRS1974

Systematic monitoring and evaluation of M7 scanner performance and data quality

An investigation was conducted to provide the information required to maintain data quality of the Michigan M7 Multispectral scanner by systematic checks on specific system performance characteristics. Data processing techniques which use calibration data gathered routinely every mission have been developed to assess current data quality. Significant changes from past data quality are thus identified and attempts made to discover their causes. Procedures for systematic monitoring of scanner data quality are discussed. In the solar reflective region, calculations of Noise Equivalent Change in Radiance on a permission basis are compared to theoretical tape-recorder limits to provide an estimate of overall scanner performance. M7 signal/noise characteristics are examined.

Stewart, S.↗
NASA NTRS1984

Preliminary Evaluation of Thematic Mapper Image Data Quality

Thematic Mapper (TM) data from Mississippi County, Arkansas, and Webster County, Iowa, were examined for the purpose of evaluating the image data quality of the TM which was launched on board the LANDSAT-4 spacecraft. Preliminary clustering and principal component analysis indicates that the middle infrared and thermal infrared data of TM appear to add significant information over that of the near IR and visible bands of the multispectral scanner data. Moreover, the higher spatial resolution of TM appears to provide better definition of the edges and the within variability of agricultural fields. The geometric performance of TM data, without ground control correction, was found to exceed expectations. The modulation transfer function for the 1.65 m band was found to agree with prelaunch specifications when the effects of the GSFC cubic convolution and the atmosphere were removed. The band to band registration for the bands within the noncooled focal plane was found to be better than specified. However, the middle infrared and thermal infrared, which are on a separate cooled focal plane were found to be misregistered and were significantly worse than prelaunch specifications.

Macdonald, R. B.↗
NASA NTRS1984

Evaluation of Landsat-4 Thematic Mapper and multispectral scanner data quality

Landsat-4 image data quality was evaluated for test sites in Iowa and Illinois. Radiometric and geometric quality was tested and an applications evaluation was carried out using a cooling-pond thermal-mapping example. Geometric quality was found to be generally very good. Small errors were found in registration of the middle IR bands of the TM and the thermal IR band was found to be misregistered by one 120-meter pixel. Radiometric quality of the TM is excellent with only minor striping effects.

Bartolucci, L. A.↗
NASA NTRSDate not supplied

NASA GLOBE CLOUD GAZE: Creating Data Quality Flags for Citizen Science Cloud Observations Matched to NASA Satellite Data

The GLOBE Program, NASA’s largest and longest lasting citizen science program about the Earth, has been collecting cloud observations matched to multiple satellite data daily. The program’s cloud protocol is historically the most popular protocol as your eyes are the only instruments you need to collect observations of the sky. This dataset includes over 3,300,000 cloud observations with variables like total cloud cover, cloud type and opacity that are collocated to the nearest overpass times of geostationary satellites (GOES-15, GOES-16, GOES-17, Meteosat-8, Meteosat-11, or Himawari-8), or to Clouds and the Earth’s Radiant Energy System (CERES) instruments onboard Aqua and Terra, or the Cloud–Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) satellite. In order to increase the usability of this dataset, the Community science project Leveraging Online and User Data through GLOBE And Zooniverse Engagement (CLOUD GAZE) has been developed to generate data quality flags of these ground-up and top-down perspectives of sky and clouds. Recently funded through NASA’s Citizen Science for Earth Systems Program, CLOUD GAZE has partnered with the Zooniverse online platform to obtain reference data and image tagging of sky photographs collected through The GLOBE Program’s clouds protocol. This paper will present the GLOBE Clouds dataset matched to NASA satellite data, integration of CLOUD GAZE to develop data quality flags, and research applications of the dataset (includes ground-up and top-down perspective comparisons, ground observations of dust storms and smoke plumes, and cloud observations in polar regions). The paper will also present on techniques and recommendations for classroom use and for community engagement, particularly for those looking to online resources.

Marilé Colón Robles↗
NASA NTRS2000

Evaluation of Various Radar Data Quality Control Algorithms Based on Accumulated Radar Rainfall Statistics

The primary function of the TRMM Ground Validation (GV) Program is to create GV rainfall products that provide basic validation of satellite-derived precipitation measurements for select primary sites. A fundamental and extremely important step in creating high-quality GV products is radar data quality control. Quality control (QC) processing of TRMM GV radar data is based on some automated procedures, but the current QC algorithm is not fully operational and requires significant human interaction to assure satisfactory results. Moreover, the TRMM GV QC algorithm, even with continuous manual tuning, still can not completely remove all types of spurious echoes. In an attempt to improve the current operational radar data QC procedures of the TRMM GV effort, an intercomparison of several QC algorithms has been conducted. This presentation will demonstrate how various radar data QC algorithms affect accumulated radar rainfall products. In all, six different QC algorithms will be applied to two months of WSR-88D radar data from Melbourne, Florida. Daily, five-day, and monthly accumulated radar rainfall maps will be produced for each quality-controlled data set. The QC algorithms will be evaluated and compared based on their ability to remove spurious echoes without removing significant precipitation. Strengths and weaknesses of each algorithm will be assessed based on, their abilit to mitigate both erroneous additions and reductions in rainfall accumulation from spurious echo contamination and true precipitation removal, respectively. Contamination from individual spurious echo categories will be quantified to further diagnose the abilities of each radar QC algorithm. Finally, a cost-benefit analysis will be conducted to determine if a more automated QC algorithm is a viable alternative to the current, labor-intensive QC algorithm employed by TRMM GV.

Robinson, Michael↗
NASA NTRS1984

LANDAT-4/5 image data quality analysis

LANDSAT-4/5 data quality analysis was covered. Focus was on estimation of two-dimensional point-spread function estimation. A brief description is included.

Anuta, P. E.↗
NASA NTRS2013

Data Quality Screening Service

A report describes the Data Quality Screening Service (DQSS), which is designed to help automate the filtering of remote sensing data on behalf of science users. Whereas this process often involves much research through quality documents followed by laborious coding, the DQSS is a Web Service that provides data users with data pre-filtered to their particular criteria, while at the same time guiding the user with filtering recommendations of the cognizant data experts. The DQSS design is based on a formal semantic Web ontology that describes data fields and the quality fields for applying quality control within a data product. The accompanying code base handles several remote sensing datasets and quality control schemes for data products stored in Hierarchical Data Format (HDF), a common format for NASA remote sensing data. Together, the ontology and code support a variety of quality control schemes through the implementation of the Boolean expression with simple, reusable conditional expressions as operands. Additional datasets are added to the DQSS simply by registering instances in the ontology if they follow a quality scheme that is already modeled in the ontology. New quality schemes are added by extending the ontology and adding code for each new scheme.

Strub, Richard↗
NASA NTRS2003

Analysis of ETMS Data Quality for Traffic Flow Management Decisions

The data needed for air traffic flow management decision support tools is provided by the Enhanced Traffic Management System (ETMS). This includes both the tools that are in current use and the ones being developed for future deployment. Since the quality of decision support provided by all these tools will be influenced by the quality of the input ETMS data, an assessment of ETMS data quality is needed. Motivated by this desire, ETMS data quality is examined in this paper in terms of the unavailability of flight plans, deviation from the filed flight plans, departure delays, altitude errors and track data drops. Although many of these data quality issues are not new, little is known about their extent. A goal of this paper is to document the magnitude of data quality issues supported by numerical analysis of ETMS data. Guided by this goal, ETMS data for a 24-hour period were processed to determine the number of aircraft with missing flight plan messages at any given instant of time. Results are presented for aircraft above 18,000 feet altitude and also at all altitudes. Since deviation from filed flight plan is also a major cause of trajectory-modeling errors, statistics of deviations are presented. Errors in proposed departure times and ETMS-generated vertical profiles are also shown. A method for conditioning the vertical profiles for improving demand prediction accuracy is described. Graphs of actual sector counts obtained using these vertical profiles are compared with those obtained using the Host data for sectors in the Fort Worth Center to demonstrate the benefit of preprocessing. Finally, results are presented to quantify the extent of data drops. A method for propagating track positions during ETMS data drops is also described.

Chatterji, Gano B.↗
NASA NTRS2011

A Satellite-Derived Climate-Quality Data Record of the Clear-Sky Surface Temperature of the Greenland Ice Sheet

We have developed a climate-quality data record of the clear-sky surface temperature of the Greenland Ice Sheet using the Moderate-Resolution Imaging Spectroradiometer (MODIS) Terra ice-surface temperature (1ST) algorithm. A climate-data record (CDR) is a time series of measurements of sufficient length, consistency, and continuity to determine climate variability and change. We present daily and monthly Terra MODIS ISTs of the Greenland Ice Sheet beginning on 1 March 2000 and continuing through 31 December 2010 at 6.25-km spatial resolution on a polar stereographic grid within +/-3 hours of 17:00Z or 2:00 PM Local Solar Time. Preliminary validation of the ISTs at Summit Camp, Greenland, during the 2008-09 winter, shows that there is a cold bias using the MODIS IST which underestimates the measured surface temperature by approximately 3 C when temperatures range from approximately -50 C to approximately -35 C. The ultimate goal is to develop a CDR that starts in 1981 with the Advanced Very High Resolution (AVHRR) Polar Pathfinder (APP) dataset and continues with MODIS data from 2000 to the present. Differences in the APP and MODIS cloud masks have so far precluded the current IST records from spanning both the APP and MODIS IST time series in a seamless manner though this will be revisited when the APP dataset has been reprocessed. The Greenland IST climate-quality data record is suitable for continuation using future Visible Infrared Imager Radiometer Suite (VIIRS) data and will be elevated in status to a CDR when at least 9 more years of climate-quality data become available either from MODIS Terra or Aqua, or from the VIIRS. The complete MODIS IST data record will be available online in the summer of 2011.

Hall, Dorothy K.↗
NASA NTRS1975

Strain gaged struts and data reduction techniques to maximize quality data from spacecraft flight measurements

The flight instrumentation for the Viking project was established to obtain environmental data, and maximize the data obtainable from the limited number of telemetry channels. To achieve these objectives, a set of six struts were strain gaged and calibrated as load cells to obtain a complete force-time history across an interface. The force-time history can be used with an analytical model to calculate the response of any part of the structure above the instrumented interface. Special matched filters were required to reduce the flight data and derive the phase correlated loads. Flight data results from the Viking Dynamic Simulator flown in February 1974 are described in addition to ground test results used to verify the data reduction process.

Day, F. D., III↗