Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS1985

Thematic Mapper Data Quality and Performance Assessment in Renewable Resources/agriculture/remote Sensing

Analysis of the early thematic mapper (TM) data indicate the TM sensor and associated ground processing are performing equal to the high expectations and within advertised specifications. The overall TM system with improved resolution, together with additional and more optimumly placed spectral bands shows much promise for benefits in future analysis activities. By selecting man-made features of known dimensions (e.g., highways, airfields, buildings, and isolated water bodies), an assessment was made of the TM performance relative to the specified 30-meter (98-foot) resolution. The increase of spatial resolution of TM (30 m) over MSS (80 M) appears to be significant not only in resolving spectrally distinct classes that were previously undefinable but also in distinguishing within-field variability. An Important result of the early TM evaluation and pre-TM analyses was the development of an integrated system to receive LANDSAT-4 TM (as well as MSS) data and analyze the data via various approaches.

Bizzell, R. M.↗
NASA NTRS2011

Application of ESE Data and Tools to Air Quality Management: Services for Helping the Air Quality Community use ESE Data (SHAirED)

The goal of this REASoN applications and technology project is to deliver and use Earth Science Enterprise (ESE) data and tools in support of air quality management. Its scope falls within the domain of air quality management and aims to develop a federated air quality information sharing network that includes data from NASA, EPA, US States and others. Project goals were achieved through a access of satellite and ground observation data, web services information technology, interoperability standards, and air quality community collaboration. In contributing to a network of NASA ESE data in support of particulate air quality management, the project will develop access to distributed data, build Web infrastructure, and create tools for data processing and analysis. The key technologies used in the project include emerging web services for developing self describing and modular data access and processing tools, and service oriented architecture for chaining web services together to assemble customized air quality management applications. The technology and tools required for this project were developed within DataFed.net, a shared infrastructure that supports collaborative atmospheric data sharing and processing web services. Much of the collaboration was facilitated through community interactions through the Federation of Earth Science Information Partners (ESIP) Air Quality Workgroup. The main activities during the project that successfully advanced DataFed, enabled air quality applications and established community-oriented infrastructures were: develop access to distributed data (surface and satellite), build Web infrastructure to support data access, processing and analysis create tools for data processing and analysis foster air quality community collaboration and interoperability.

Falke, Stefan↗
NASA NTRS2014

An Analysis of the Side Slither On-Orbit Calibration Technique Using the DIRSIG Model

Pushbroom-style imaging systems exhibit several advantages over line scanners when used on space-borne platforms as they typically achieve higher signal-to-noise and reduce the need for moving parts. Pushbroom sensors contain thousands of detectors, each having a unique radiometric response, which will inevitably lead to streaking and banding in the raw data. To take full advantage of the potential exhibited by push broom sensors, a relative radiometric correction must be performed to eliminate pixel-to-pixel non-uniformities in the raw data. Side slither is an on-orbit calibration technique where a 90-degree yaw maneuver is performed over an invariant site to flatten the data. While this technique has been utilized with moderate success for the QuickBird satellite and the RapidEye constellation, further analysis is required to enable its implementation for the Landsat 8 sensors, which have a 15-degree field-of-view and a 0.5% pixel-to-pixel uniformity requirement. This work uses the DIRSIG model to analyze the side slither maneuver as applicable to the Landsat sensor. A description of favorable sites, how to adjust the maneuver to compensate for the curvature of "linear" arrays, how to efficiently process the data, and an analysis to assess the quality of the side slither data, are presented.

Side slither↗
DOE OSTI2021

Field Data Analysis and Modeling of Drillstring Vibrations to Identify Inefficiency in Deep Geothermal Drilling

One challenge that hinders efficient drilling and causes downhole tool failures is severe drillstring vibrations. The objective of this paper is to identify the root cause of drillstring vibrations in deep geothermal wells and investigate their effect on drilling performance using data analytics and vibration modeling. A near-bit sub was utilized to collect vibration data, where the burst data was used to obtain the drillstring torsional natural frequency. The data showed that the highest lateral acceleration and stick-slip severities (SSS) occur at the higher mechanical specific energy (MSE) range, while the low vibration levels were encountered in the optimum range of the MSE curve. The elevated SSS levels consistently occur at the low to mid-range of applied RPM and the highest sonic velocity. Additionally, the lateral acceleration levels are higher at the low to mid-range of the applied RPM. The effect of drillstring vibration on drilling performance was recognized by the presented MSE analysis.

15 GEOTHERMAL ENERGY↗
NASA NTRS2012

Development of a Dual-Pump CARS System for Measurements in a Supersonic Combusting Free Jet

This work describes the development of a dual-pump CARS system for simultaneous measurements of temperature and absolute mole fraction of N2, O2 and H2 in a laboratory scale supersonic combusting free jet. Changes to the experimental set-up and the data analysis to improve the quality of the measurements in this turbulent, high-temperature reacting flow are described. The accuracy and precision of the instrument have been determined using data collected in a Hencken burner flame. For temperature above 800 K, errors in absolute mole fraction are within 1.5, 0.5, and 1% of the total composition for N2, O2 and H2, respectively. Estimated standard deviations based on 500 single shots are between 10 and 65 K for the temperature, between 0.5 and 1.7% of the total composition for O2, and between 1.5 and 3.4% for N2. The standard deviation of H2 is ~10% of the average measured mole fraction. Results obtained in the jet with and without combustion are illustrated, and the capabilities and limitations of the dual-pump CARS instrument discussed.

Magnotti, Gaetano↗
NASA NTRS2022

A New Machine Learning Based Analysis for Improving Satellite Retrieved Atmospheric Composition Data: OMI SO2 as an Example

Despite recent progress, satellite retrievals of anthropogenic SO2 still suffer from relatively low signal-tonoise ratios. In this study, we demonstrate a new machine learning data analysis method to improve the quality of satellite SO2 products. In the absence of large ground-truth datasets for SO2, we start from SO2 slant column densities (SCDs) retrieved from the Ozone Monitoring Instrument (OMI) using a data-driven, physically based algorithm and calculate the ratio between the SCD and the root mean square (rms) of the fitting residuals for each pixel. To build the training data, we select presumably clean pixels with small SCD / rms ratios (SRRs) and set their target SCDs to zero. For polluted pixels with relatively large SRRs, we set the target to the original retrieved SCDs. We then train neural networks (NNs) to reproduce the target SCDs using predictors including SRRs for individual pixels, solar zenith, viewing zenith and phase angles, scene reflectivity, and O3 column amounts, as well as the monthly mean SRRs. For data analysis, we employ two NNs: (1) one trained daily to produce analyzed SO2 SCDs for polluted pixels each day and (2) the other trained once every month to produce analyzed SCDs for less polluted pixels for the entire month. Test results for 2005 show that our method can significantly reduce noise and artifacts over background regions. Over polluted areas, the monthly mean NN-analyzed and original SCDs generally agree to within ±15 %, indicating that our method can retain SO2 signals in the original retrievals except for large volcanic eruptions. This is further confirmed by running both the NN-analyzed and original SCDs through a topdown emission algorithm to estimate the annual SO2 emissions for ∼ 500 anthropogenic sources, with the two datasets yielding similar results. We also explore two alternative approaches to the NN-based analysis method. In one, we employ a simple linear interpolation model to analyze the original SCD retrievals. In the other, we develop a PCA–NN algorithm that uses OMI measured radiances, transformed and dimension-reduced with a principal component analysis (PCA) technique, as inputs to NNs for SO2 SCD retrievals. While the linear model and the PCA–NN algorithm can reduce retrieval noise, they both underestimate SO2 over polluted areas. Overall, the results presented here demonstrate that our new data analysis method can significantly improve the quality of existing OMI SO2 retrievals. The method can potentially be adapted for other sensors and/or species and enhance the value of satellite data in air quality research and applications.

Can Li↗
NASA NTRS1994

Data assimilation and model evaluation experiment datasets

The Institute for Naval Oceanography, in cooperation with Naval Research Laboratories and universities, executed the Data Assimilation and Model Evaluation Experiment (DAMEE) for the Gulf Stream region during fiscal years 1991-1993. Enormous effort has gone into the preparation of several high-quality and consistent datasets for model initialization and verification. This paper describes the preparation process, the temporal and spatial scopes, the contents, the structure, etc., of these datasets. The goal of DAMEE and the need of data for the four phases of experiment are briefly stated. The preparation of DAMEE datasets consisted of a series of processes: (1) collection of observational data; (2) analysis and interpretation; (3) interpolation using the Optimum Thermal Interpolation System package; (4) quality control and re-analysis; and (5) data archiving and software documentation. The data products from these processes included a time series of 3D fields of temperature and salinity, 2D fields of surface dynamic height and mixed-layer depth, analysis of the Gulf Stream and rings system, and bathythermograph profiles. To date, these are the most detailed and high-quality data for mesoscale ocean modeling, data assimilation, and forecasting research. Feedback from ocean modeling groups who tested this data was incorporated into its refinement. Suggestions for DAMEE data usages include (1) ocean modeling and data assimilation studies, (2) diagnosis and theoretical studies, and (3) comparisons with locally detailed observations.

Lai, Chung-Cheng A.↗
DOE OSTI2024

Comparative Performance of Three Eye-Tracking Devices in Detection of Mild Traumatic Brain Injury in Acute Versus Chronic Subject Populations

ABSTRACT Introduction Presently, traumatic brain injury (TBI) triage in field settings relies on symptom-based screening tools such as the updated Military Acute Concussion Evaluation. Objective eye-tracking may provide an alternative means of neurotrauma screening due to sensitivity to neurotrauma brain-health changes. Previously, the US Army Medical Research and Development Command Non-Invasive NeuroAssessment Devices (NINAD) Integrated Product Team identified 3 commercially available eye-tracking devices (SyncThink EYE-SYNC, Oculogica EyeBOX, NeuroKinetics IPAS) as meeting criteria toward being operationally effective in the detection of TBI in service members. We compared these devices to assess their relative performance in the classification of mild traumatic brain injury (mTBI) subjects versus normal healthy controls. Materials and Methods Participants 18 to 45 years of age were assigned to Acute mTBI, Chronic mTBI, or Control group per study criteria. Each completed a TBI assessment protocol with all 3 devices counterbalanced across participants. Acute mTBI participants were tested within 72 hours following injury whereas time since last injury for the Chronic mTBI group ranged from months to years. Discriminant analysis was undertaken to determine device classification performance in separating TBI subjects from controls. Area Under the Curves (AUCs) were calculated and used to compare the accuracy of device performance. Device-related factors including data quality, the need to repeat tests, and technical issues experienced were aggregated for reporting. Results A total of 63 participants were recruited as Acute mTBI subjects, 34 as Chronic mTBI subjects, and 119 participants without history of TBI as controls. To maximize outcomes, poorer quality data were excluded from analysis using specific criteria where possible. Final analysis utilized 49 (43 male/6 female, mean [x̅] age = 24.3 years, SD [s] = 5.1) Acute mTBI subjects, and 34 (33 male/1 female, x̅ age = 38.8 years, s = 3.9) Chronic mTBI subjects were age- and gender-matched as closely as possible with Control subjects. AUCs obtained with 80% of total dataset ranged from 0.690 to 0.950 for the Acute Group and from 0.753 to 0.811 for the Chronic mTBI group. Validation with the remaining 20% of dataset produced AUCs ranging from 0.600 to 0.750 for Acute mTBI group and 0.490 to 0.571 for the Chronic mTBI group. Conclusions Potential eye-tracking detection of mTBI, per training model outcomes, ranged from acceptable to excellent for the Acute mTBI group; however, it was less consistent for the Chronic mTBI group. The self-imposed targeted performance (AUC of 0.850) appears achievable, but further device improvements and research are necessary. Discriminant analysis models differed for the Acute versus Chronic mTBI groups, suggesting performance differences in eye-tracking. Although eye-tracking demonstrated sensitivity in the Chronic group, a more rigorous and/or longitudinal study design is required to evaluate this observation. mTBI injuries were not controlled for this study, potentially reducing eye-tracking assessment sensitivity. Overall, these findings indicate that while eye-tracking remains a viable means of mTBI screening, device-specific variability in data quality, length of testing, and ease of use must be addressed to achieve NINAD objectives and DoD implementation.

General & Internal Medicine↗
NASA NTRS1986

Maximum normalized acceleration as a flying qualities parameter

In 1984, Maximum Normalized Rate (MNR) was presented as a Flying Qualities parameter. Subsequent analysis of data from ground based simulation and flight test revealed the utility of a companion parameter, Maximum Normalized Acceleration (MNA). MNR and MNA profiles reveal the presence of both continuous and pulsed compensation strategies during discrete attitude tracking. In addition, MNR appears to be a suitable metric for pilot opinion in the LATHOS data base, while the MNR/MNA relationship is sensitive to pilot-induced-oscillation (PIO) and roll ratcheting problems. As part of an investigation of this problem, Northrop has developed an analysis technique known as the Step Target Method. The Step Target method is essentially a one degree-of-freedom simulation, where an attitude command in the form of a step function is presented to a closed-loop pilot/aircraft model. The two parameters MNR and MNA were shown to be useful in Flying Qualities analysis. MNR was shown to correlate with Pilot Opinion Rating in the LATHOS data base, while MNA reflects PIO and roll ratcheting. Profiles of MNR versus MNA reveal the presence of pulsed compensation strategies in both ground based and in-flight simulation. Furthermore, comparison of continuous and discrete attitude tracking simulation data reveals that these two tracking tasks exhibit independent sensitivities to aircraft characteristics.

Warner, J. S.↗
NASA NTRS1989

Methods for trend analysis: Examples with problem/failure data

Statistics are emphasized as an important role in quality control and reliability. Consequently, Trend Analysis Techniques recommended a variety of statistical methodologies that could be applied to time series data. The major goal of the working handbook, using data from the MSFC Problem Assessment System, is to illustrate some of the techniques in the NASA standard, some different techniques, and to notice patterns of data. Techniques for trend estimation used are: regression (exponential, power, reciprocal, straight line) and Kendall's rank correlation coefficient. The important details of a statistical strategy for estimating a trend component are covered in the examples. However, careful analysis and interpretation is necessary because of small samples and frequent zero problem reports in a given time period. Further investigations to deal with these issues are being conducted.

Church, Curtis K.↗
NASA NTRS1983

Center of Excellence for Applied Mathematical and Statistical Research in support of development of multicrop production monitoring capability

Efforts in support of the development of multicrop production monitoring capability are reported. In particular, segment level proportion estimation techniques based upon a mixture model were investigated. Efforts have dealt primarily with evaluation of current techniques and development of alternative ones. A comparison of techniques is provided on both simulated and LANDSAT data along with an analysis of the quality of profile variables obtained from LANDSAT data.

Woodward, W. A.↗
DOE OSTI2021

A coupled hydrodynamic (HEC-RAS 2D) and water quality model (WASP) for simulating flood-induced soil, sediment, and contaminant transport

Increased intensity and frequency of floods raise concerns about the release and transport of contaminated soil and sediment to and from rivers and streams. To model these processes during flooding events, we developed an External Coupler in Python to link the Hydrologic Engineering Center-River Analysis System (HEC-RAS) 2D hydrodynamic model to the Water Quality Analysis Simulation Program (WASP). Accurate data transfer from a hydrodynamic model to a water quality model is critical. Our test results showed the External Coupler successfully linked HEC-RAS and WASP and addressed technical challenges in aggregating flow data and conserving mass during the flood event. We ran the coupled models for a 100-year flood event to calculate flood-induced transport of sediment-associated arsenic in Woodbridge Creek, NJ. Change in surface sediment and arsenic at the end of 48-h flood simulation ranged from a net loss of 13.5 cm to a net gain of 11.6 cm, and 16.2 to 2.9 mg/kg, respectively, per model segment, which demonstrates the capability of the coupled model for simulating sediment and contaminant transport in flood.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Automated Extraction of Energy Systems Information from Remotely Sensed Data: A Review and Analysis

We report high quality energy systems information is a crucial input to energy systems research, modeling, and decision-making. Unfortunately, actionable information about energy systems is often of limited availability, incomplete, or only accessible for a substantial fee or through a non-disclosure agreement. Recently, remotely sensed data (e.g., satellite imagery, aerial photography) have emerged as a potentially rich source of energy systems information. However, the use of these data is frequently challenged by its sheer volume and complexity, precluding manual analysis. Recent breakthroughs in machine learning have enabled automated and rapid extraction of useful information from remotely sensed data, facilitating large-scale acquisition of critical energy system variables. Here we present a systematic review of the literature on this emerging topic, providing an in-depth survey and review of papers published within the past two decades. We first taxonomize the existing literature into ten major areas, spanning the energy value chain. Within each research area, we distill and critically discuss major features that are relevant to energy researchers, including, for example, key challenges regarding the accessibility and reliability of the methods. We then synthesize our findings to identify limitations and trends in the literature as a whole, and discuss opportunities for innovation. These include the opportunity to extend the methods beyond electricity to broader energy systems and wider geographic areas; and the ability to expand the use of these methods in research and decision making as satellite data become cheaper and easier to access. We also find that there are persistent challenges: limited standardization and rigor of performance assessments; limited sharing of code, which would improve replicability; and a limited consideration of the ethics and privacy of data.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1997

Precise Point Positioning for the Efficient and Robust Analysis of GPS Data From Large Networks

Networks of dozens to hundreds of permanently operating precision Global Positioning System (GPS) receivers are emerging at spatial scales that range from 10(exp 0) to 10(exp 3) km. To keep the computational burden associated with the analysis of such data economically feasible, one approach is to first determine precise GPS satellite positions and clock corrections from a globally distributed network of GPS receivers. Then, data from the local network are analyzed by estimating receiver specific parameters with receiver-specific data; satellite parameters are held fixed at their values determined in the global solution. This "precise point positioning" allows analysis of data from hundreds to thousands of sites every day with 40 Mflop computers, with results comparable in quality to the simultaneous analysis of all data. The reference frames for the global and network solutions can be free of distortion imposed by erroneous fiducial constraints on any sites.

Zumberge, J. F.↗
NASA NTRS1997

Precise Point Positioning for the Efficient and Robust Analysis of GPS Data from Large Networks

Networks of dozens to hundreds of permanently operating precision Global Positioning System (GPS) receivers are emerging at spatial scales that range from 10(exp 0) to 10(exp 3) km. To keep the computational burden associated with the analysis of such data economically feasible, one approach is to first determine precise GPS satellite positions and clock corrections from a globally distributed network of GPS receivers. Their, data from the local network are analyzed by estimating receiver- specific parameters with receiver-specific data satellite parameters are held fixed at their values determined in the global solution. This "precise point positioning" allows analysis of data from hundreds to thousands of sites every (lay with 40-Mflop computers, with results comparable in quality to the simultaneous analysis of all data. The reference frames for the global and network solutions can be free of distortion imposed by erroneous fiducial constraints on any sites.

Zumberge, J. F.↗
DOE OSTI2020

PV Fleet Performance Data Initiative (March 2020 Methodology Report)

Data for thousands of systems by multiple sources were transmitted to NREL for evaluation. Initial automated data quality assurance (QA) checks identified hundreds of systems (QA Tier 1) with high-quality meteorological and AC production data and hundreds of QA Tier 2 systems with adequate data quality. A standard RdTools analysis was conducted for these systems, evaluating performance loss on an annualized basis. To date with the systems evaluated so far, we find a median performance loss rate (aka Rd or degradation rates) for the entire fleet of -0.72%/year based on individual inverter data, which is in line with historical degradation rates previously published for modules and systems (-0.5% to -0.9% / yr, Jordan et al. 2016). A fleet-scale distribution based on revenue-grade meter data rather than inverter AC (alternating current) data yields a slightly different result. We are working to understand the difference between this result and the inverter-based result of -0.72%/year.

14 SOLAR ENERGY↗
NASA NTRS1984

A modeling analysis program for the JPL table mountain Io sodium cloud

A data quality review for the entire set of the 1981 Region B/C images has been completed and is presented. The review indicates that almost all images are of sufficient quality to be valuable in our analysis of this data set. Five data-correlation studies for the same data set have also been completed and are useful in classifying and studying the sodium cloud morphology and its interactions with solar radiation pressure and the plasma torus. Additional progress in developing new image processing techniques and in improving the Io sodium cloud model is also discussed.

Smyth, W. H.↗
NASA NTRS2019

Uncertainty Analysis of the CE-22 Advanced Nozzle Test Facility

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the Advanced Nozzle Test Facility, CE-22, located at the NASA Glenn Research Center. Results for the uncertainty in thrust and flow coefficients, in addition to other variables of interest, are provided. Results are presented separately as random uncertainty (characterizing errors inherent to instrument or measurement environment, impacting repeatability), systematic uncertainty (capturing inaccuracies due to measurement process, calibration, installation effects or other sources which may introduce bias), and total combined uncertainty. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The analysis tool MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation system uncertainty, and statistical analysis and engineering judgment were used to quantify other random and systematic uncertainty sources. The Monte Carlo method was used to propagate systematic and random elemental uncertainties to determine the uncertainties of various calculated variables of interest.

data quality↗