Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Data Quality Screening Service

A report describes the Data Quality Screening Service (DQSS), which is designed to help automate the filtering of remote sensing data on behalf of science users. Whereas this process often involves much research through quality documents followed by laborious coding, the DQSS is a Web Service that provides data users with data pre-filtered to their particular criteria, while at the same time guiding the user with filtering recommendations of the cognizant data experts. The DQSS design is based on a formal semantic Web ontology that describes data fields and the quality fields for applying quality control within a data product. The accompanying code base handles several remote sensing datasets and quality control schemes for data products stored in Hierarchical Data Format (HDF), a common format for NASA remote sensing data. Together, the ontology and code support a variety of quality control schemes through the implementation of the Boolean expression with simple, reusable conditional expressions as operands. Additional datasets are added to the DQSS simply by registering instances in the ontology if they follow a quality scheme that is already modeled in the ontology. New quality schemes are added by extending the ontology and adding code for each new scheme.

Strub, Richard↗
NASA NTRS2003

Analysis of ETMS Data Quality for Traffic Flow Management Decisions

The data needed for air traffic flow management decision support tools is provided by the Enhanced Traffic Management System (ETMS). This includes both the tools that are in current use and the ones being developed for future deployment. Since the quality of decision support provided by all these tools will be influenced by the quality of the input ETMS data, an assessment of ETMS data quality is needed. Motivated by this desire, ETMS data quality is examined in this paper in terms of the unavailability of flight plans, deviation from the filed flight plans, departure delays, altitude errors and track data drops. Although many of these data quality issues are not new, little is known about their extent. A goal of this paper is to document the magnitude of data quality issues supported by numerical analysis of ETMS data. Guided by this goal, ETMS data for a 24-hour period were processed to determine the number of aircraft with missing flight plan messages at any given instant of time. Results are presented for aircraft above 18,000 feet altitude and also at all altitudes. Since deviation from filed flight plan is also a major cause of trajectory-modeling errors, statistics of deviations are presented. Errors in proposed departure times and ETMS-generated vertical profiles are also shown. A method for conditioning the vertical profiles for improving demand prediction accuracy is described. Graphs of actual sector counts obtained using these vertical profiles are compared with those obtained using the Host data for sectors in the Fort Worth Center to demonstrate the benefit of preprocessing. Finally, results are presented to quantify the extent of data drops. A method for propagating track positions during ETMS data drops is also described.

Chatterji, Gano B.↗
DOE OSTI2025

Data Quality Assessment of Optiwatt Vehicle Telematics Data

In October 2024, the Idaho National Laboratory (INL) received data from Optiwatt (Compass Global, Inc.) describing the driving and charging behavior of electric vehicle (EV) drivers. The data shared had been collected from approximately 10,000 vehicles and included vehicle specifications, driving information like odometer readings at the beginning and end of origin-destination pairs (i.e., trips with identification of home for trip start and end for Tesla vehicles), and charging information such as charging energy consumed per charge session and if the charge occurred at home. The vehicle data were provided from 9 EV makes and 18 EV models, with production years ranging from 2012–2024, but more than 9,500 of the vehicles were Tesla EVs. The data includes more than six million trips and more than three million charging events that occurred between June 2023 to Aug 2024 and collected from California and the Eastern United States. The purpose of this report is to review the quality of the data received from Optiwatt and the feedback INL received from Optiwatt after data concerns were shared with them.

33 - ADVANCED PROPULSION SYSTEMS↗
NASA NTRS2011

A Satellite-Derived Climate-Quality Data Record of the Clear-Sky Surface Temperature of the Greenland Ice Sheet

We have developed a climate-quality data record of the clear-sky surface temperature of the Greenland Ice Sheet using the Moderate-Resolution Imaging Spectroradiometer (MODIS) Terra ice-surface temperature (1ST) algorithm. A climate-data record (CDR) is a time series of measurements of sufficient length, consistency, and continuity to determine climate variability and change. We present daily and monthly Terra MODIS ISTs of the Greenland Ice Sheet beginning on 1 March 2000 and continuing through 31 December 2010 at 6.25-km spatial resolution on a polar stereographic grid within +/-3 hours of 17:00Z or 2:00 PM Local Solar Time. Preliminary validation of the ISTs at Summit Camp, Greenland, during the 2008-09 winter, shows that there is a cold bias using the MODIS IST which underestimates the measured surface temperature by approximately 3 C when temperatures range from approximately -50 C to approximately -35 C. The ultimate goal is to develop a CDR that starts in 1981 with the Advanced Very High Resolution (AVHRR) Polar Pathfinder (APP) dataset and continues with MODIS data from 2000 to the present. Differences in the APP and MODIS cloud masks have so far precluded the current IST records from spanning both the APP and MODIS IST time series in a seamless manner though this will be revisited when the APP dataset has been reprocessed. The Greenland IST climate-quality data record is suitable for continuation using future Visible Infrared Imager Radiometer Suite (VIIRS) data and will be elevated in status to a CDR when at least 9 more years of climate-quality data become available either from MODIS Terra or Aqua, or from the VIIRS. The complete MODIS IST data record will be available online in the summer of 2011.

Hall, Dorothy K.↗
NASA NTRS1975

Strain gaged struts and data reduction techniques to maximize quality data from spacecraft flight measurements

The flight instrumentation for the Viking project was established to obtain environmental data, and maximize the data obtainable from the limited number of telemetry channels. To achieve these objectives, a set of six struts were strain gaged and calibrated as load cells to obtain a complete force-time history across an interface. The force-time history can be used with an analytical model to calculate the response of any part of the structure above the instrumented interface. Special matched filters were required to reduce the flight data and derive the phase correlated loads. Flight data results from the Viking Dynamic Simulator flown in February 1974 are described in addition to ground test results used to verify the data reduction process.

Day, F. D., III↗
NASA NTRS2006

Telemetry Metrics: Monitoring Data Quality in the Spacecraft Ground Data System

During the launch of Mars Odyssey, ground data system (GDS) engineers experienced a glitch in the ground data system that caused us to re-evaluate how we looked at spacecraft telemetry, particularly during the spacecraft development period and for critical spacecraft events in flight. Spacecraft telemetry told the subsystem and instrument engineers about the health and status of the spacecraft, but there was surprisingly little information about how well the ground data system was doing in getting information from the spacecraft to the engineers.The problem for the Mars Odyssey launch was with a single channel not updating as often as expected. Spacecraft engineers considered calling off the Launch but eventually decided that this particular channel did not provide information that was crucial for launch. It was only after the post launch acquisition of the Odyssey signal that ground data system engineers heard there had been a concern about the channel....

Mars↗
NASA NTRS1987

Recent data quality and earth science results from the Landsat thematic mapper

The results of the NASA Landsat Image Data Quality Analysis (LIDQA) program are reviewed. Landsat-4 and Landsat-5 TM data quality with regard to image geometry and radiometry are discussed. The results indicate that the TM provides excellent imagery that can be used in the form of satellite image maps meeting cartographic standards at scales of 1:100,000 or smaller. These data can be used to locate features or guide the revision or updating of maps for scales up to 1:24,000. The TM sensor is also providing data of good radiometric quality and stability, with radiometric uncertainties of 1 percent or smaller. The temperature dependence in the absolute radiometry is on the order of 1 to 5 percent of full scale. In terms of bidirectional reflectance estimated at the satellite, the error is estimated at under 6 percent and commonly 3 percent. Preliminary results also corroborate the utility of the TM data for geological or geographical studies.

Salomonson, Vincent V.↗
NASA NTRS1985

Measurement of Thematic Mapper data quality

Thematic Mapper data from Landsat-4 and Landsat-5 were examined for band-to-band registration, absolute geodetic registration, periodic noise and spatial resolution. Between focal planes, appreciable misregistrations existed in early data products but were corrected in later data products. The analysis of absolute geodetic registration used only system-corrected data because ground control point-corrected data were unavailable. Geodetic registration errors averaged only 9.7 pixels, less than expected for system-corrected data. Periodic noise at four spatial frequencies was observed in Landsat-5 Thematic Mapper data by using Fourier analysis on small areas over water. Magnitudes of periodic noise components were consistent within a scene. The modulation transfer function was determined for two Landsat-4 scenes. The effective instantaneous field of view was 40.8 meters in one case, and 48.6 meters in the other.

Wrigley, R. C.↗
NASA NTRS2016

A New Look at Data Usage by Using Metadata Attributes as Indicators of Data Quality

This study reviews the key metrics (users, distributed volume, and files) in multiple ways to gain an understanding of the significance of the metadata. Characterizing the usability of data by key metadata elements, such as discipline and study area, will assist in understanding how the user needs have evolved over time. The data usage pattern based on product level provides insight into the level of data quality. In addition, the data metrics by various services, such as the Open-source Project for a Network Data Access Protocol (OPeNDAP) and subsets, address how these services have extended the usage of data. Over-all, this study presents the usage of data and metadata by metrics analyses, which may assist data centers in better supporting the needs of the users.

metadata↗
NASA NTRS2021

Integrating Inland and Coastal Water Quality Data for Actionable Knowledge

Water quality measures for inland and coastal waters are available as discrete samples from professional and volunteer water quality monitoring programs and higher-frequency, near-continuous data from automated in situ sensors. Water quality parameters also are estimated from model outputs and remote sensing. The integration of these data, via data assimilation, can result in a more holistic characterization of these highly dynamic ecosystems, and consequently improve water resource management. It is becoming common to see combinations of these data applied to answer relevant scientific questions. Yet, methods for scaling water quality data across regions and beyond, to provide actionable knowledge for stakeholders, have emerged only recently, particularly with the availability of satellite data now providing global coverage at high spatial resolution. In this paper, data sources and existing data integration frameworks are reviewed to give an overview of the present status and identify the gaps in existing frameworks. We propose an integration framework to provide information to user communities through the the Group on Earth Observations (GEO) AquaWatch Initiative. This aims to develop and build the global capacity and utility of water quality data, products, and information to support equitable and inclusive access for water resource management, policy and decision making.

Ghada Y.H. El Serafy↗
NASA NTRS2015

Online Tools for Uncovering Data Quality (DQ) Issues in Satellite-Based Global Precipitation Products

Data quality (DQ) has many attributes or facets (i.e., errors, biases, systematic differences, uncertainties, benchmark, false trends, false alarm ratio, etc.)Sources can be complicated (measurements, environmental conditions, surface types, algorithms, etc.) and difficult to be identified especially for multi-sensor and multi-satellite products with bias correction (TMPA, IMERG, etc.) How to obtain DQ info fast and easily, especially quantified info in ROI Existing parameters (random error), literature, DIY, etc.How to apply the knowledge in research and applications.Here, we focus on online systems for integration of products and parameters, visualization and analysis as well as investigation and extraction of DQ information.

precipitation↗
NASA NTRS1984

LANDSAT-4 MSS and Thematic Mapper data quality and information content analysis

LANDSAT-4 thematic mapper (TM) and multispectral scanner (MSS) data were analyzed to obtain information on data quality and information content. Geometric evaluations were performed to test band-to-band registration accuracy. Thematic mapper overall system resolution was evaluated using scene objects which demonstrated sharp high contrast edge responses. Radiometric evaluation included detector relative calibration, effects of resampling, and coherent noise effects. Information content evaluation was carried out using clustering, principal components, transformed divergence separability measure, and supervised classifiers on test data. A detailed spectral class analysis (multispectral classification) was carried out to compare the information content of the MSS and TM for a large number of scene classes. A temperature-mapping experiment was carried out for a cooling pond to test the quality of thermal-band calibration. Overall TM data quality is very good. The MSS data are noisier than previous LANDSAT results.

Anuta, P.↗
NASA NTRS1985

Landsat image data quality studies

Preliminary results of the Landsat-4 Image Data Quality Analysis (LIDQA) program to characterize the data obtained using the Thematic Mapper (TM) instrument on board the Landsat-4 and Landsat-5 satellites are reported. TM design specifications were compared to the obtained data with respect to four criteria, including spatial resolution; geometric fidelity; information content; and image relativity to Multispectral Scanner (MSS) data. The overall performance of the TM was rated excellent despite minor instabilities and radiometric anomalies in the data. Spatial performance of the TM exceeded design specifications in terms of both image sharpness and geometric accuracy, and the image utility of the TM data was at least twice as high as MSS data. The separability of alfalfa and sugar beet fields in a TM image is demonstrated.

Schueler, C. F.↗
NASA NTRS1980

The use of thematic mapper simulator calibration data for assessment of data quality

In flight calibration data collected from the thematic mapper simulator (TMS) were used to assess the quality of Earth scan data. The following results are indicated: (1) based on limited samples, individual TMS channels have noise which varies from channel to channel, but remains constant within a channel; (2) short term variations of more than 5% in the average values of calibration source responses indicate problems; and (3) absolute radiometric calibration is unlikely to be meaningful in a temporal sense due to single point calibration methods used.

Forman, M. L.↗
NASA NTRS1990

Data quality analysis at the National Transonic Facility

The data quality analysis program that was developed at Langley Research Center's National Transonic Facility is described. The program provides a computer driven systematic analysis of data taken during calibrations of the high speed digital data acquisition system. Five distinct checks that are performed on the calibration data are outlined. The five checks are for non-linearity, noise, short term drift, long term drift, and the proper functioning of the calibrator. The program has established a standard set of evaluation guidelines.

Stewart, Pamela N.↗
NASA NTRS1988

AVIRIS data quality for coniferous canopy chemistry

An assessment of AVIRIS data quality for studying coniferous canopy chemistry was made. Seven flightlines of AVIRIS data were acquired over a transect of coniferous forest sites in central Oregon. Both geometric and radiometric properties of the data were examined including: pixel size, swath width, spectral position and signal-to-noise ratio. A flat-field correction was applied to AVIRIS data from a coniferous forest site. Future work with this data set will exclude data from spectrometers C and D due to low signal-to-noise ratios. Data from spectrometers A and B will be used to examine the relationship between the canopy chemical composition of the forest sites and AVIRIS spectral response.

Swanberg, Nancy A.↗
DOE OSTI2024

Review of Technical Photovoltaic Key Performance Indicators and the Importance of Data Quality Routines

Technical key performance indicators (KPIs) are important metrics used to assess and quantitatively summarize various aspects of photovoltaic (PV) systems, including long-term performance, economic viability, and carbon footprint. Herein, a group of experts of the International Energy Agency's Photovoltaic Power Systems Programme Task 13 collect and describ the most important technical KPIs used in the industry. Thereby, a set of best practices for reliably handling PV system data is presented and the impact of data quality and climatic variability on KPI calculation is investigated. Further, the effective use of technical KPIs allows triggering data-driven and informed decisions to optimize PV systems and providing a comprehensive overview of how PV systems operate across different conditions and climates. With the worldwide growth of the PV industry, more companies operate/own PV systems in different regions, where the climatic and seasonal profiles differ. This requires context-aware evaluation of KPIs, or the judicious application of multiple KPIs, to ensure that each asset is evaluated correctly. Beyond that, there is untapped potential in the utilization of KPIs through geospatial mapping and extrapolation of fleet KPIs. This study demonstrates that the uncertainty in KPI estimation is not well understood and depends on data quality, climatic variability, and system configuration.

14 SOLAR ENERGY↗