Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
NASA NTRS2023

Floating Potential Measurement Unit (FPMU) Data Processing Algorithm Development and Analysis Assessment

The NASA Engineering and Safety Center (NESC) was requested to provide space plasma instrumentation data analysis expertise in support of Floating Potential Measurement Unit (FPMU) data analysis and data processing algorithm development. Subject matter expertise was requested to support modification of FPMU data processing algorithms to account for aging of the FPMU instrument suite, improve the science quality of the FPMU data sets that are made available to the science community, and provide analysis of FPMU data for complex spacecraft orientation and geophysical situations. This document contains the results of the NESC assessment.

Floating Potential Measurement Unit↗
DOE OSTI2023

Design, execution, and interpretation of plant RNA-seq analyses

Genomics has transformed our understanding of the genetic architecture of traits and the genetic variation present in plants. Here, we present a review of how RNA-seq can be performed to tackle research challenges addressed by plant sciences. We discuss the importance of experimental design in RNA-seq, including considerations for sampling and replication, to avoid pitfalls and wasted resources. Approaches for processing RNA-seq data include quality control and counting features, and we describe common approaches and variations. Though differential gene expression analysis is the most common analysis of RNA-seq data, we review multiple methods for assessing gene expression, including detecting allele-specific gene expression and building co-expression networks. With the production of more RNA-seq data, strategies for integrating these data into genetic mapping pipelines is of increased interest. Finally, special considerations for RNA-seq analysis and interpretation in plants are needed, due to the high genome complexity common across plants. By incorporating informed decisions throughout an RNA-seq experiment, we can increase the knowledge gained.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1991

A review of ice accretion data from a model rotor icing test and comparison with theory

An experiment was conducted by the Helicopter Icing Consortium (HIC) in the NASA Lewis Icing Research Tunnel (IRT) in which a 1/6 scale fuselage model of a UH-60A Black Hawk helicopter with a generic rotor was subjected to a wide range of icing conditions. The HIC consists of members from NASA, Bell Helicopter, Boeing Helicopter, McDonnell Douglas Helicopters, Sikorsky Aircraft, and Texas A&M University. Data was taken in the form of rotor torque, internal force balance measurements, blade strain gage loading, and two dimensional ice shape tracings. A review of the ice shape data is performed with special attention given to repeatability and correctness of trends in terms of radial variation, rotational speed, icing time, temperature, liquid water content, and volumetric median droplet size. Moreover, an indepth comparison between the experimental data and the analysis of NASA's ice accretion code LEWICE is given. Finally, conclusions are drawn as to the quality of the ice accretion data and the predictability of the data base as a whole. Recommendations are also given for improving data taking technique as well as potential future work.

Britton, Randall K.↗
NASA NTRS1991

A review of ice accretion data from a model rotor icing test and comparison with theory

An experiment was conducted by the Helicopter Icing Consortium (HIC) in the NASA Lewis Icing Research Tunnel (IRT) in which a 1/6 scale fuselage model of a UH-60A Black Hawk helicopter with a generic rotor was subjected to a wide range of icing conditions. The HIC consists of members from NASA, Bell Helicopter, Boeing Helicopter, McDonnell Douglas Helicopters, Sikorsky Aircraft, and Texas A&M University. Data was taken in the form of rotor torque, internal force balance measurements, blade strain gage loading, and two dimensional ice shape tracings. A review of the ice shape data is performed with special attention given to repeatability and correctness of trends in terms of radial variation, rotational speed, icing time, temperature, liquid water content, and volumetric median droplet size. Moreover, an indepth comparison between the experimental data and the analysis of NASA's ice accretion code LEWICE is given. Finally, conclusions are shown as to the quality of the ice accretion data and the predictability of the data base as a whole. Recommendations are also given for improving data taking technique as well as potential future work.

Britton, Randall K.↗
DOE OSTI2024

Enhancing Data Quality Monitoring at CMS with Interactive Visualization Tools and Automated Reference Run Selection

Current data quality monitoring (DQM) tools at CMS offer granularity limited to per-run analysis. Consequently, issues manifesting at the per-lumisection level can go unnoticed or, even if detectable, often lead to the classification of the whole run as bad, resulting in unnecessary data loss. Additionally, shifters have to evaluate a large set of monitoring elements during their long shifts, increasing the probability of human errors or overlooked problems. In this contribution, we present ongoing work on the development of tools that will provide shifters with an accessible, granularity-enhanced view of DQM data through interactive and dynamic visualizations. Furthermore, we introduce a reference run selection tool currently under development, which will automate the selection based on data-taking conditions and will offer a curated set of training data for machine learning models that will be used for the partial automation of the offline data certification process. These endeavors will be integrated into the DIALS website, enabling enhancements in data certification accuracy and improving the accessibility of DQM at CMS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2015

Conflict Detection Performance Analysis for Function Allocation Using Time-Shifted Recorded Traffic Data

The performance of the conflict detection function in a separation assurance system is dependent on the content and quality of the data available to perform that function. Specifically, data quality and data content available to the conflict detection function have a direct impact on the accuracy of the prediction of an aircraft's future state or trajectory, which, in turn, impacts the ability to successfully anticipate potential losses of separation (detect future conflicts). Consequently, other separation assurance functions that rely on the conflict detection function - namely, conflict resolution - are prone to negative performance impacts. The many possible allocations and implementations of the conflict detection function between centralized and distributed systems drive the need to understand the key relationships that impact conflict detection performance, with respect to differences in data available. This paper presents the preliminary results of an analysis technique developed to investigate the impacts of data quality and data content on conflict detection performance. Flight track data recorded from a day of the National Airspace System is time-shifted to create conflicts not present in the un-shifted data. A methodology is used to smooth and filter the recorded data to eliminate sensor fusion noise, data drop-outs and other anomalies in the data. The metrics used to characterize conflict detection performance are presented and a set of preliminary results is discussed.

Guerreiro, Nelson M.↗
DOE OSTI2020

Clustering Analysis of Commercial Vehicles Using Automatically Extracted Features from Time Series Data

Standard of practice approaches to time series cluster analysis involve careful feature engineering, often utilizing expert input to tune and select features by hand. In many cases, expert input may not be readily available, or there may not yet exist a community consensus on the ideal features for a given application. This paper compares the results of several cluster analysis methods, using both hand selected features and those extracted automatically, when applied to large geospatial time series telematics data from commercial trucking fleets. The impacts of feature selection, dimensionality reduction, and choice of clustering algorithm on the quality of clustering results are explored. Results from this analysis confirm prior results that domain agnostic features are competitive with the hand engineered features with respect to clustering quality metrics. These results also provide new insight into the most successful strategies for identifying structure in large unstructured vehicle telematics data, and suggest that time series clustering using automatic feature extraction can be an effective approach to extract structure from large scale geospatial time series data in cases when hand selected features are not available.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Two decades of fumigation data from the Soybean Free Air Concentration Enrichment facility

Abstract The Soybean Free Air Concentration Enrichment (SoyFACE) facility is the longest running open-air carbon dioxide and ozone enrichment facility in the world. For over two decades, soybean, maize, and other crops have been exposed to the elevated carbon dioxide and ozone concentrations anticipated for late this century. The facility, located in East Central Illinois, USA, exposes crops to different atmospheric concentrations in replicated octagonal ~280 m 2 Free Air Concentration Enrichment (FACE) treatment plots. Each FACE plot is paired with an untreated control (ambient) plot. The experiment provides important ground truth data for predicting future crop productivity. Fumigation data from SoyFACE were collected every four seconds throughout each growing season for over two decades. Here, we organize, quality control, and collate 20 years of data to facilitate trend analysis and crop modeling efforts. This paper provides the rationale for and a description of the SoyFACE experiments, along with a summary of the fumigation data and collation process, weather and ambient data collection procedures, and explanations of air pollution metrics and calculations.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Data Mining of Polymer Phase Transitions upon Temperature Changes by Small and Wide-Angle X-ray Scattering Combined with Raman Spectroscopy

The complex physical transformations of polymers upon external thermodynamic changes are related to the molecular length of the polymer and its associated multifaceted energetic balance. The understanding of subtle transitions or multistep phase transformation requires real-time phenomenological studies using a multi-technique approach that covers several length-scales and chemical states. A combination of X-ray scattering techniques with Raman spectroscopy and Differential Scanning Calorimetry was conducted to correlate the structural changes from the conformational chain to the polymer crystal and mesoscale organization. Current research applications and the experimental combination of Raman spectroscopy with simultaneous SAXS/WAXS measurements coupled to a DSC is discussed. In particular, we show that in order to obtain the maximum benefit from simultaneously obtained high-quality data sets from different techniques, one should look beyond traditional analysis techniques and instead apply multivariate analysis. Data mining strategies can be applied to develop methods to control polymer processing in an industrial context. Crystallization studies of a PVDF blend with a fluoroelastomer, known to feature complex phase transitions, were used to validate the combined approach and further analyzed by MVA.

36 MATERIALS SCIENCE↗
NASA NTRS1974

Image data processing of earth resources management

The Earth Resources Technology Satellite (ERTS-1) was launched on July 23, 1972. Since that date, the vehicle has been acquiring and transmitting to earth a vast amount of information relating to the earth's resources. Scientific investigators throughout the world have been analyzing photographic products produced from this data with significant results. Recently, there has been a major shift of emphasis from the visual analysis of photo products to the use of sophisticated digital information extraction techniques. Specialized equipment, such as the GE IMAGE 100 System, has been developed that operates directly from Computer Compatible Tapes, (CCT’s), which contain preprocessed digital data acquired from the ERTS spacecraft. Analysis of CCT data avoids the losses in image resolution and quality which are inherent to all photo processing techniques, thereby greatly increasing the utility of ERTS data. Future ground processing systems will turn out fully corrected (radiometric and geometric) digital tapes which will further increase the utility of ERTS data. This paper is presented in two parts: the first part deals with the subject of present and future generations of image processing and information extraction systems under development at the General Electric Company; the second part describes in more detail the design and operation of GE1s interactive multispectral information extraction systems, IMAGE 100, and discusses results of analyses of ERTS data over a number of U.S. sites.

A W DeSio↗
NASA NTRS1997

Remote Sensing of Aircraft Contrails Using a Field Portable Digital Array Scanned Interferometer

With a Digital Array Scanned Interferometer (DASI), we have obtained proof-of-concept observations with which we demonstrate DASI capabilities for the determination of contrail properties. These include the measurement of the cloud and soot microphysical parameters, as well, the abundances of specific pollutant species such as SO(sub x) or NO(sub x). From high quality hyperspectral data and using radiative transfer methods and atmospheric chemistry analysis in the data reduction and interpretation, powerful inferences concerning cloud formation, evolution and dissipation can be made. Under this sub-topic, we will integrate DASI with computer controlled scanning of the field-of-view to direct the sensor towards contrails and exhaust plumes for tracking the emitting vehicles. The optimum DASI wavelength sensitivity range for sensing contrails is 0.35 - 2.5 micron. DASI deploys on the ground or from aircraft to observe contrails in the vicinity. This enables rapid, accurate measurement of the temporal, spatial, and chemical evolution of contrails (or other plumes or exhaust sources) with a low cost, efficient sensor.

Smith, William Hayden↗
NASA NTRS2008

Provenance in Data Interoperability for Multi-Sensor Intercomparison

As our inventory of Earth science data sets grows, the ability to compare, merge and fuse multiple datasets grows in importance. This requires a deeper data interoperability than we have now. Efforts such as Open Geospatial Consortium and OPeNDAP (Open-source Project for a Network Data Access Protocol) have broken down format barriers to interoperability; the next challenge is the semantic aspects of the data. Consider the issues when satellite data are merged, cross-calibrated, validated, inter-compared and fused. We must match up data sets that are related, yet different in significant ways: the phenomenon being measured, measurement technique, location in space-time or quality of the measurements. If subtle distinctions between similar measurements are not clear to the user, results can be meaningless or lead to an incorrect interpretation of the data. Most of these distinctions trace to how the data came to be: sensors, processing and quality assessment. For example, monthly averages of satellite-based aerosol measurements often show significant discrepancies, which might be due to differences in spatio- temporal aggregation, sampling issues, sensor biases, algorithm differences or calibration issues. Provenance information must be captured in a semantic framework that allows data inter-use tools to incorporate it and aid in the intervention of comparison or merged products. Semantic web technology allows us to encode our knowledge of measurement characteristics, phenomena measured, space-time representation, and data quality attributes in a well-structured, machine-readable ontology and rulesets. An analysis tool can use this knowledge to show users the provenance-related distrintions between two variables, advising on options for further data processing and analysis. An additional problem for workflows distributed across heterogeneous systems is retrieval and transport of provenance. Provenance may be either embedded within the data payload, or transmitted from server to client in an out-of-band mechanism. The out of band mechanism is more flexible in the richness of provenance information that can be accomodated, but it relies on a persistent framework and can be difficult for legacy clients to use. We are prototyping the embedded model, incorporating provenance within metadata objects in the data payload. Thus, it always remains with the data. The downside is a limit to the size of provenance metadata that we can include, an issue that will eventually need resolution to encompass the richness of provenance information required for daata intercomparison and merging.

Lynnes, Chris↗
NASA NTRS2006

Marsviewer

Marsviewer is a multi-platform application designed to aid in quality control, browsing, and analysis of original science product images (Experiment Data Records, or EDRs) and derived image data products (Reduced Data Records, or RDRs) returned by the Mars Explorer Rover (MER) mission. Marsviewer offers an abstraction of the products organization via a file finder. For example, the application understands the file structure and filename conventions of the MER Operational Storage Server, helping the user to navigate this complex file system to find desired images. Marsviewer also works with a flat file system, remote-operations file systems, image-archive file systems, and others. All EDRs found for a given solar day (Sol) are displayed in a list, optionally with thumbnail images. Once the user selects an image from the list, a tabbed pane conveniently displays the original source image and all associated RDRs. Marsviewer provides the option of overlaying derived images upon the source image, resulting in an easier-to-interpret color representation of the data. Display manipulations such as zoom, data range adjustment, contrast enhancement, and contour control are available. Image metadata (labels) from the current image can be displayed and searched. The architecture of the program is extensible: new types of RDRs can be installed and new file finders can be added to adapt the program to different file structures and different filename conventions. This keeps the application flexible and provides an opportunity for reuse with future rover missions.

Toole, Nicholas↗
DOE OSTI2021

Electrical Energy Storage Data Submission Guidelines, Version 2

Energy storage technologies are positioned to play a substantial role in power delivery systems. They have the potential to serve as an effective new resource to maintain reliability and allow for increased penetration of renewable energy. However, because of their relative infancy, there is a lack of knowledge about how these resources truly operate over time. A data analysis can help ascertain the operational and performance characteristics of these emerging technologies. Rigorous testing and a data analysis are important for all stakeholders to ensure a safe, reliable system that performs predictably on a macro level. Standardizing testing and analysis approaches to verify the performance of energy storage devices, equipment, and systems when integrating them into the grid will improve the understanding and benefit of energy storage over time from technical and economic vantage points. Demonstrating the life-cycle value and capabilities of energy storage systems begins with the data that the provider supplies for the analysis. After a review of energy storage data received from several providers, some of these data have clearly shown to be inconsistent and incomplete, raising the question of their efficacy for a robust analysis. This report reviews and proposes general guidelines, such as sampling rates and data points, that providers must supply for a robust data analysis to take place. Consistent guidelines are the basis of a proper protocol and ensuing standards to (1) reduce the time that it takes for data to reach those who are providing the analysis; (2) allow them to better understand the energy storage installations; and (3) enable them to provide a high-quality analysis of the installations. The report is intended to serve as a starting point for what data points should be provided when monitoring. Readers are encouraged to use the guidance in the report to develop specifications for new systems, as well as enhance current efforts to ensure optimal storage performance. As battery technologies continue to advance and the industry expands, the report will be updated to remain current.

25 ENERGY STORAGE↗
NASA NTRS2004

Low-Cost, User-Friendly, Rapid Analysis of Dynamic Data System Established

An issue of primary importance to the development of new jet and certain other airbreathing combined-cycle powered aircraft is the advancement of airframe-integrated propulsion technologies. Namely, engine inlets and their systems and subsystems are required to capture, convert, and deliver the atmospheric airflow demanded by such engines across their operating envelope in a form that can be used to provide efficient, stable thrust. This must be done while also minimizing aircraft drag and weight. Revolutionary inlet designs aided by new technologies are needed to enable new missions. An unwanted byproduct of pursuing these inlet technologies is increased time-variant airflow distortion. Such distortions reduce propulsion system stability, performance, operability, and life. To countermand these limitations and fully evaluate the resulting configurations, best practices dictate that this distortion be experimentally measured at large scale and analyzed. The required measurements consist of those made by an array of high-response pressure transducers located in the flow field at the aerodynamic interface plane (AIP) between the inlet and engine. Although the acquisition of the necessary pitot-pressure time histories is relatively straight-forward, until recent years, the analysis has proved to be very time-consuming, tedious, and expensive. To transform the analysis of these data into a tractable and timely proposition, researchers at the NASA Glenn Research Center created and established the Rapid Analysis of Dynamic Data (RADD) system. The system provides complete, near real-time analysis of time-varying inlet airflow distortion datasets with report quality output. This fully digital approach employs Institute of Electrical and Electronics Engineers (IEEE) binary data file format standardization to establish data-acquisition-system-independent processing on low cost personal computers. Features include invalid instrumentation code-out, logging, and multiple replacement schemes as needed for each channel of instrumentation. The AIP pressure distribution can be interpolated to simulate measurements by alternate AIP probe arrays, if desired. In addition, the RADD system provides for the application of filters that can be used to focus the analysis on the frequency range of interest.

Arend, David J.↗
DOE OSTI2024

Measurement of Stark-split beam and carbon charge exchange emissions for simultaneous B-field and temperature/rotation analysis at DIII-D

A set of two newly designed, single-channel Czerny–Turner spectrometers has been deployed at the DIII-D tokamak for measurements of the motional Stark effect (MSE) split beam emission and the C6+ (CVI) carbon charge exchange recombination (CER) emission at high spectral (δλ = 0.13 nm) and temporal (1–5 kHz) resolution. High throughput optics (f/# = 2.8) allow for good signal-to-noise at high time resolution using fast EMCCD detectors. The MSE emission allows for spectral fitting of the magnitude and direction of the local B-field, while the carbon emission yields local ion temperature and toroidal rotation information. To reduce so-called Doppler broadening of the MSE emission, a new channel-specific variable lens-masking approach has been developed. Experimental data collected from the 2023 DIII-D experimental campaign demonstrate the signal quality and instrument fidelity for both diagnostic measurements. Moreover, initial CER data analysis shows a clear evolution of the toroidal rotation during edge localized modes. Initial progress on the advanced MSE model, including a new validated ray-trace model of the DIII-D collection optics, is shown via sensitivity analysis.

Instruments & Instrumentation↗
NASA NTRS2018

Systems and Methods for Advanced Rapid Imaging and Analysis for Earthquakes

Many embodiments provide a hybrid data processing system (HySDS) of an end-to-end geodetic imaging data system enabling near-real-time science, assessment, response, and rapid recovery. The HySDS may be an operation data processing system that integrates data from many different geodetic data sources and/or sensors, including interferometric synthetic aperture radar (InSAR), GPS, pixel tracking, seismology, and/or modeling, and processes the data to generate actionable high quality science data products. The HySDS may provide for an automated imaging and analysis capabilities that is able to handle the imminent increases in raw data from new and existing geodetic monitoring sensor systems.

Owen, Susan Ethel↗