Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

Microarray Data Analysis of Space Grown Arabidopsis Leaves for Genes Important in Vascular Patterning

Venation patterning in leaves is a major determinant of photosynthesis efficiency because of its dependency on vascular transport of photoassimilates, water, and minerals. Arabidopsis thaliana grown in microgravity show delayed growth and leaf maturation. Gene expression data from the roots, hypocotyl, and leaves of A. thaliana grown during spaceflight vs. ground control analyzed by Affymetrix microarray are available through NASAs GeneLab (GLDS-7). We analyzed the data for differential expression of genes in leaves resulting from the effects of spaceflight on vascular patterning. Two genes were found by preliminary analysis to be upregulated during spaceflight that may be related to vascular formation. The genes are responsible for coding an ARGOS like protein (potentially affecting cell elongation in the leaves), and an F-boxkelch-repeat protein (possibly contributing to protoxylem specification). Further analysis that will focus on raw data quality assessment and a moderated t-test may further confirm upregulation of the two genes and/or identify other gene candidates. Plants defective in these genes will then be assessed for phenotype by the mapping and quantification of leaf vascular patterning by NASAs VESsel GENeration (VESGEN) software to model specific vascular differences of plants grown in spaceflight.

Weitzeal, A. J.↗
NASA NTRS2016

Microarray Data Analysis of Space Grown Arabidopsis Leaves for Genes Important in Vascular Patterning

Venation patterning in leaves is a major determinant of photosynthesis efficiency because of its dependency on vascular transport of photoassimilates, water, and minerals. Arabidopsis thaliana grown in microgravity show delayed growth and leaf maturation. Gene expression data from the roots, hypocotyl, and leaves of A. thaliana grown during spaceflight vs. ground control analyzed by Affymetrix microarray are available through NASA's GeneLab (GLDS-7). We analyzed the data for differential expression of genes in leaves resulting from the effects of spaceflight on vascular patterning. Two genes were found by preliminary analysis to be upregulated during spaceflight that may be related to vascular formation. The genes are responsible for coding an ARGOS like protein (potentially affecting cell elongation in the leaves), and an F-box/kelch-repeat protein (possibly contributing to protoxylem specification). Further analysis that will focus on raw data quality assessment and a moderated t-test may further confirm upregulation of the two genes and/or identify other gene candidates. Plants defective in these genes will then be assessed for phenotype by the mapping and quantification of leaf vascular patterning by NASA's VESsel GENeration (VESGEN) software to model specific vascular differences of plants grown in spaceflight.

Weitzeal, A. J.↗
NASA NTRS2020

TPSAS-NF1676L-36113-DND

Concerns about the effects of extreme heat and poor air quality are increasing in North America’s largest urban centers. In Philadelphia, environmental and public health groups are concerned about how these phenomena disproportionality affect marginalized communities and populations, which often have extensive impervious surfaces and little access to green space. In order to address these concerns, the Philadelphia Department of Public Health and the Office of Sustainability seek to effectively prioritize cooling initiatives to reduce urban heat and decrease air pollutants. We evaluated land surface temperature (LST) and the Normalized Difference Vegetation Index (NDVI), as a measure of overall greenness, obtained from NASA Earth observations Aqua and Terra Moderate Resolution Imaging Spectroradiometer (MODIS), and the Ecosystem Spaceborne Thermal Radiometer Experiment on Space Station (ECOSTRESS). These analyses we recombined with local tree inventory, air quality, and socioeconomic data through a multivariate analysis to identify areas where new trees or cooling adaptations are most needed. The results and data of this project can be used by our partners to inform both short-term heat relief planning and a long-term, multi-agency heat response.

Spencer Nelson↗
NASA NTRS1995

High Reynolds Number Effects on Multi-Hole Probes and Hot Wire Anemometers

The paper reports on the results from an experimental investigation of the response of multi-hole and hot wire probes at high flow Reynolds numbers (Re approx. 10(exp 6)). The limited results available in literature for 5-hole probes are restricted to Re approx. 10(exp 4). The experiment aims to investigate the probe response (in terms of dimensionless pressure ratios, characterizing pitch, and yaw angles and the total and static pressures) at high Re values and to gauge their effect on the calculated velocity vector. Hot wire calibrations were also undertaken with a parametric variation of the flow pressure, velocity and temperature. Different correction and calibration schemes are sought to be tested against the acquired data set. The data is in the analysis stage at the present time. The test provided good benchmark quality data that can be used to test future calibration and testing methods.

Ramachandran, N.↗
NASA NTRSDate not supplied

A Framework for Assessing Earth Observation Metadata Quality: Implications for Data Discovery and Open Science

The Common Metadata Repository (CMR) contains metadata records describing NASA’s collection of over 8,000 Earth observation data products. The Analysis and Review of CMR (ARC) Team at Marshall Space Flight Center assesses the quality of these metadata records. Metadata, rather than the data itself, is indexed for search in both discipline-specific datacenters and global or aggregated catalogs (such as Earth data Search), making it essential for determining whether a data product is appropriate for a given research question or application need. Since metadata connects users to data, it should be as accurate and complete as possible in addition to meeting minimum database requirements. The ARC team has developed a metadata quality framework by which to assess quality. The framework consists of a set of quality criteria that converge around the dimensions of correctness, completeness, and consistency, with the goal of improving the discoverability, accessibility, and usability of NASA’s Earth Observation data. The application of the framework has resulted in a measurable improvement in NASA’s metadata quality. Key aspects of the framework’s success are the ability to systematically evaluate metadata and provide actionable quality improvement recommendations. Lessons learned from the project will be shared along with implementation details which may be relevant to other science disciplines. By aiming to make data more discoverable and accessible to a broad user community, the ARC metadata quality framework helps contribute to NASA’s commitment to open science.

Jeanne Le Roux↗
NASA NTRS1984

Characterization of LANDSAT-4 TM and MSS Image Quality for Interpretation of Agricultural and Forest Resources

Systematic analysis of both image and numeric data shows that the overall spectral, spatial, and radiometric quality of the TM data are excellent. Spectral variations in fallow fields are due to the vaiability in soil moisture and surface roughness resulting from the various stages of field preparation for small grains production. Spectrally, the addition of the first TM short wave infrared band (Band 5) significantly enhanced ability to discriminate different crop types. Bands 1, 5, and 6 contain saturated pixels due to high albedo effects, low moisture conditions, and high radiant temperatures of granite and dry, bare soil on south facing slopes, respectively. Spatially, the two fold decrease in interpixel distance and four fold decrease in area per pixel between the TM and MSS allow for improved discrimination of small fields, boundary conditions, road and stream networks in rough terrain, and small forest clearings resulting from various forest management practices.

Degloria, S. D.↗
NASA NTRS2015

KSC 50-MHz Doppler Radar Wind Profiler (DRWP) Operational Acceptance Test (OAT) Report

This report documents analysis results of the Kennedy Space Center updated 50-MHz Doppler Radar Wind Profiler (DRWP) Operational Acceptance Test (OAT). This test was designed to demonstrate that the new DRWP operates in a similar manner to the previous DRWP for use as a situational awareness asset for mission operations at the Eastern Range to identify rapid changes in the wind environment that weather balloons cannot depict. Data examination and two analyses showed that the updated DRWP meets the specifications in the OAT test plan and performs at least as well as the previous DRWP. Data examination verified that the DRWP provides complete profiles every five minutes from 1.8-19.5 km in vertical increments of 150 m. Analysis of 5,426 wind component reports from 49 concurrent DRWP and balloon profiles presented root mean square (RMS) wind component differences around 2.0 m/s. The DRWP's effective vertical resolution (EVR) was found to be 300 m for both the westerly and southerly wind component, which the best EVR possible given the DRWP's vertical sampling interval. A third analysis quantified the sensitivity to rejecting data that do not have adequate signal by assessing the number of first-guess propagations at each altitude. This report documents the data, quality control procedures, methodology, and results of each analysis. It also shows that analysis of the updated DRWP produced results that were at least as good as the previous DRWP with proper rationale. The report recommends acceptance of the updated DRWP for situational awareness usage as per the OAT's intent.

Profiler↗
NASA NTRS2001

DAO's Next Generation Physical-Space/Finite-Volume Data Assimilation System: Formulation and Initial Evaluation

The Physical-space/Finite-volume Data Assimilation System (fvDAS) is the next generation global atmospheric data assimilation system in development at the Data Assimilation Office at NASA's Goddard Space Flight Center. It is based on a new finite-volume general circulation model jointly developed by NASA and NCAR, and on the Physical-Space Statistical Analysis System (PSAS) developed at the DAO. In this talk we will describe the general system formulation, the adaptive quality control and general aspects of the error covariance modeling. The NASA-NCAR GCM is a completely new model which replaces the CEOs GCM used in the previous GEOS-1/2/3 Data Assimilation systems. A particular configuration of adaptive Statistical Quality Control and the Physical-space Statistical Analysis System (PSAS) are currently implemented in DAO's operational Data Assimilation System. However, the unique finite-volume formulation of the NASA-NCAR GCM, combined with the generality of the observation-space formulation of PSAS, provides for a very simple and accurate model-analysis interface. The system assimilates a variety of conventional and satellite observations. In particular, TOVS Level 1B radiances are assimilated using a 1-D variational scheme, both in clear sky and cloudy conditions. Computationally, the fvDAS runs approximately 10 times faster than the operational GEOS-Terra system. We will show that the next-generation fvDAS has much improved observation-minus-6hr forecast (O-F) statistics, as well as 5-day forecast skills. Top of the atmosphere radiation fields are in closer agreement with CERES measurements, with realistic precipitation and moisture fields. We will also show that the finite-volume formulation of the fvDAS produce assimilated fields which are more suitable for driving constituent transport models.

daSilva, A.↗
NASA NTRS1975

Assessment of NDE reliability data

Twenty sets of relevant nondestructive test (NDT) reliability data were identified, collected, compiled, and categorized. A criterion for the selection of data for statistical analysis considerations was formulated, and a model to grade the quality and validity of the data sets was developed. Data input formats, which record the pertinent parameters of the defect/specimen and inspection procedures, were formulated for each NDE method. A comprehensive computer program was written and debugged to calculate the probability of flaw detection at several confidence limits by the binomial distribution. This program also selects the desired data sets for pooling and tests the statistical pooling criteria before calculating the composite detection reliability. An example of the calculated reliability of crack detection in bolt holes by an automatic eddy current method is presented.

Yee, B. G. W.↗
NASA NTRS1976

Assessment of NDE Reliability Data

Twenty sets of relevant Nondestructive Evaluation (NDE) reliability data have been identified, collected, compiled, and categorized. A criterion for the selection of data for statistical analysis considerations has been formulated. A model to grade the quality and validity of the data sets has been developed. Data input formats, which record the pertinent parameters of the defect/specimen and inspection procedures, have been formulated for each NDE method. A comprehensive computer program has been written to calculate the probability of flaw detection at several confidence levels by the binomial distribution. This program also selects the desired data sets for pooling and tests the statistical pooling criteria before calculating the composite detection reliability. Probability of detection curves at 95 and 50 percent confidence levels have been plotted for individual sets of relevant data as well as for several sets of merged data with common sets of NDE parameters.

Yee, B. G. W.↗
NASA NTRS2013

File Specification for GEOS-5 FP (Forward Processing)

The GEOS-5 FP Atmospheric Data Assimilation System (GEOS-5 ADAS) uses an analysis developed jointly with NOAA's National Centers for Environmental Prediction (NCEP), which allows the Global Modeling and Assimilation Office (GMAO) to take advantage of the developments at NCEP and the Joint Center for Satellite Data Assimilation (JCSDA). The GEOS-5 AGCM uses the finite-volume dynamics (Lin, 2004) integrated with various physics packages (e.g, Bacmeister et al., 2006), under the Earth System Modeling Framework (ESMF) including the Catchment Land Surface Model (CLSM) (e.g., Koster et al., 2000). The GSI analysis is a three-dimensional variational (3DVar) analysis applied in grid-point space to facilitate the implementation of anisotropic, inhomogeneous covariances (e.g., Wu et al., 2002; Derber et al., 2003). The GSI implementation for GEOS-5 FP incorporates a set of recursive filters that produce approximately Gaussian smoothing kernels and isotropic correlation functions. The GEOS-5 ADAS is documented in Rienecker et al. (2008). More recent updates to the model are presented in Molod et al. (2011). The GEOS-5 system actively assimilates roughly 2 × 10(exp 6) observations for each analysis, including about 7.5 × 10(exp 5) AIRS radiance data. The input stream is roughly twice this volume, but because of the large volume, the data are thinned commensurate with the analysis grid to reduce the computational burden. Data are also rejected from the analysis through quality control procedures designed to detect, for example, the presence of cloud. To minimize the spurious periodic perturbations of the analysis, GEOS-5 FP uses the Incremental Analysis Update (IAU) technique developed by Bloom et al. (1996). More details of this procedure are given in Appendix A. The assimilation is performed at a horizontal resolution of 0.3125-degree longitude by 0.25- degree latitude and at 72 levels, extending to 0.01 hPa. All products are generated at the native resolution of the horizontal grid. The majority of data products are time-averaged, but four instantaneous products are also available. Hourly data intervals are used for two-dimensional products, while 3-hourly intervals are used for three-dimensional products. These may be on the model's native 72-layer vertical grid or at 42 pressure surfaces extending to 0.1 hPa. This document describes the gridded output files produced by the GMAO near real-time operational FP, using the most recent version of the GEOS-5 assimilation system. Additional details about variables listed in this file specification can be found in a separate document, the GEOS-5 File Specification Variable Definition Glossary. Documentation about the current access methods for products described in this document can be found on the GMAO products page: http://gmao.gsfc.nasa.gov/products/.

GSI↗
NASA NTRS2013

File Specification for GEOS-5 FP-IT (Forward Processing for Instrument Teams)

The GEOS-5 FP-IT Atmospheric Data Assimilation System (GEOS-5 ADAS) uses an analysis developed jointly with NOAA's National Centers for Environmental Prediction (NCEP), which allows the Global Modeling and Assimilation Office (GMAO) to take advantage of the developments at NCEP and the Joint Center for Satellite Data Assimilation (JCSDA). The GEOS-5 AGCM uses the finite-volume dynamics (Lin, 2004) integrated with various physics packages (e.g, Bacmeister et al., 2006), under the Earth System Modeling Framework (ESMF) including the Catchment Land Surface Model (CLSM) (e.g., Koster et al., 2000). The GSI analysis is a three-dimensional variational (3DVar) analysis applied in grid-point space to facilitate the implementation of anisotropic, inhomogeneous covariances (e.g., Wu et al., 2002; Derber et al., 2003). The GSI implementation for GEOS-5 FP-IT incorporates a set of recursive filters that produce approximately Gaussian smoothing kernels and isotropic correlation functions. The GEOS-5 ADAS is documented in Rienecker et al. (2008). More recent updates to the model are presented in Molod et al. (2011). The GEOS-5 system actively assimilates roughly 2 × 10(exp 6) observations for each analysis, including about 7.5 × 10(exp 5) AIRS radiance data. The input stream is roughly twice this volume, but because of the large volume, the data are thinned commensurate with the analysis grid to reduce the computational burden. Data are also rejected from the analysis through quality control procedures designed to detect, for example, the presence of cloud. To minimize the spurious periodic perturbations of the analysis, GEOS-5 FP-IT uses the Incremental Analysis Update (IAU) technique developed by Bloom et al. (1996). More details of this procedure are given in Appendix A. The analysis is performed at a horizontal resolution of 0.625-degree longitude by 0.5-degree latitude and at 72 levels, extending to 0.01 hPa. All products are generated at the native resolution of the horizontal grid. The majority of data products are time-averaged, but four instantaneous products are also available. Hourly data intervals are used for two-dimensional products, while 3-hourly intervals are used for three-dimensional products. These may be on the model's native 72-layer vertical grid or at 42 pressure surfaces extending to 0.1 hPa. This document describes the gridded output files produced by the GMAO near real-time operational GEOS-5 FP-IT processing in support of the EOS instrument teams. Additional details about variables listed in this file specification can be found in a separate document, the GEOS-5 File Specification Variable Definition Glossary.

3D Var↗
NASA NTRS1982

Kerr Reservoir LANDSAT experiment analysis for November 1980

An experiment was conducted on the waters of Kerr Reservoir to determine if reliable algorithms could be developed that relate water quality parameters to remotely sensed data. LANDSAT radiance data was used in the analysis since it is readily available and covers the area of interest on a regular basis. By properly designing the experiment, many of the unwanted variations due to atmosphere, solar, and hydraulic changes were minimized. The algorithms developed were constrained to satisfy rigorous statistical criteria before they could be considered dependable in predicting water quality parameters. A complete mix of different types of algorithms using the LANDSAT bands was generated to provide a thorough understanding of the relationships among the data involved. The study demonstrated that for the ranges measured, the algorithms that satisfactorily represented the data are mostly linear and only require a maximum of one or two LANDSAT bands. Rationing techniques did not improve the results since the initial design of the experiment minimized the errors that this procedure is effective against. Good correlations were established for inorganic suspended solids, iron, turbidity, and secchi depth.

Lecroy, S. R.↗
NASA NTRS2016

Results of the NASA Kennedy Space Center 50-MHz Doppler Radar Wind Profiler Operational Acceptance Test

This paper presents results of the new Kennedy Space Center (KSC) 50-MHz Doppler Radar Wind Profiler (DRWP) Operational Acceptance Test (OAT). The goal of the OAT was to verify the data quality of the new DRWP against the performance of the previous DRWP in order to use wind data derived by the new DRWP for space launch vehicle operations support at the Eastern Range. The previous DRWP was used as a situational awareness asset for mission operations to identify rapid changes in the wind environment that weather balloons cannot depict. The Marshall Space Flight Center's Natural Environments Branch assessed data from the new DRWP collected during Jan-Feb 2015 against a specified set of test criteria. Data examination verified that the DRWP provides complete profiles every five minutes from 1.8-19.5 km in vertical increments of 150 m. Analysis of 49 concurrent DRWP and balloon profiles presented root mean square wind component differences around 2.0 m/s. Evaluation of the DRWP's coherence between five-minute wind pairs found the effective vertical resolution to be Nyquist-limited at 300 m for both wind components. In addition, the sensitivity to rejecting data that do not have adequate signal was quantified. This paper documents the data, quality control procedures, methodology, and results of each analysis.

Barbre', Robert E., Jr.↗
NASA NTRS2008

Data Assimilation Cycling for Weather Analysis

This software package runs the atmospheric model MM5 in data assimilation cycling mode to produce an optimized weather analysis, including the ability to insert or adjust a hurricane vortex. The program runs MM5 through a cycle of short forecasts every three hours where the vortex is adjusted to match the observed hurricane location and storm intensity. This technique adjusts the surrounding environment so that the proper steering current and environmental shear are achieved. MM5cycle uses a Cressman analysis to blend observation into model fields to get a more accurate weather analysis. Quality control of observations is also done in every cycle to remove bad data that may contaminate the analysis. This technique can assimilate and propagate data in time from intermittent and infrequent observations while maintaining the atmospheric field in a dynamically balanced state. The software consists of a C-shell script (MM5cycle.driver) and three FORTRAN programs (splitMM5files.F, comRegrid.F, and insert_vortex.F), and are contained in the pre-processor component of MM5 called "Regridder." The model is first initialized with data from a global model such as the Global Forecast System (GFS), which also provides lateral boundary conditions. These data are separated into single-time files using splitMM5.F. The hurricane vortex is then bogussed in the correct location and with the correct wind field using insert_vortex.F. The modified initial and boundary conditions are then recombined into the model fields using comRegrid.F. The model then makes a three-hour forecast. The three-hour forecast data from MM5 now become the analysis for the next short forecast run, where the vortex will again be adjusted. The process repeats itself until the desired time of analysis is achieved. This code can also assimilate observations if desired.

Tran, Nam↗
NASA NTRS2006

Effects of data selection on the assimilation of AIRS data

The Atmospheric InfraRed Sounder (AIRS), flying aboard NASA's Earth Observing System (EOS) Aqua satellite with the Advanced Microwave Sounding Unit-A (AMSU-A), has been providing data for use in numerical weather prediction (NWP) and data assimilation systems (DAS) for over three years. The full AIRS data set is currently not transmitted in near-real-time (NRT) to the NWP centers. Instead, data sets with reduced spatial and spectral information are produced and made available in NRT. In this paper, we evaluate the use of different channel selections and error specifications. We achieved significant positive impact from the Aqua AIRS/AMSU-A combination in both hemispheres during our experimental time period of January 2003. The best results were obtained using a set of 156 channels that did not include any in the 6.7micron water vapor band. The latter have a large influence on both temperature and humidity analyses. If observation and background errors are not properly specified, the partitioning of temperature and humidity information from these channels will not be correct, and this can lead to a degradation in forecast skill. We found that changing the specified channel errors had a significant effect on the amount of data that entered into the analysis as a result of quality control thresholds that are related to the errors. However, changing the channel errors within a relatively small window did not significantly impact forecast skill with the 155 channel set. We also examined the effects of different types of spatial data reduction on assimilated data sets and NWP forecast skill. Whether we picked the center or the warmest AIRS pixel in a 3x3 array affected the amount of data ingested by the analysis but had a negligible impact on the forecast skill.

Joiner, Joanna↗
NASA NTRS2009

Application of a Self-Similar Pressure Profile to Sunyaev-Zeldovich Effect Data from Galaxy Clusters

We investigate the utility of a new, self-similar pressure profile for fitting Sunyaev-Zel'dovich (SZ) effect observations of galaxy clusters. Current SZ imaging instruments-such as the Sunyaev-Zel'dovich Array (SZA)- are capable of probing clusters over a large range in a physical scale. A model is therefore required that can accurately describe a cluster's pressure profile over a broad range of radii from the core of the cluster out to a significant fraction of the virial radius. In the analysis presented here, we fit a radial pressure profile derived from simulations and detailed X-ray analysis of relaxed clusters to SZA observations of three clusters with exceptionally high-quality X-ray data: A1835, A1914, and CL J1226.9+3332. From the joint analysis of the SZ and X-ray data, we derive physical properties such as gas mass, total mass, gas fraction and the intrinsic, integrated Compton y-parameter. We find that parameters derived from the joint fit to the SZ and X-ray data agree well with a detailed, independent X-ray-only analysis of the same clusters. In particular, we find that, when combined with X-ray imaging data, this new pressure profile yields an independent electron radial temperature profile that is in good agreement with spectroscopic X-ray measurements.

Mroczkowski, Tony↗
NASA NTRS2022

An Advanced Open-Source Platform for Air Quality Analysis, Visualization, and Prediction

Ambient air pollution is the largest environmental health risk factor, leading to several million premature deaths globally per year. The challenge of combating poor air quality is exacerbated by growing urban populations, changing emissions, and a warming climate. While there have been many advances monitoring and modeling of atmospheric composition, reflected in the dramatic increase in archived Earth Observations, there is no single measurement or method that alone can provide an accurate depiction of the entire atmosphere. The rapidly growing collections of observational and modeling data require us to be smarter about what data to include, and how such data is used. In recent years, NASA has invested significantly in advancing the concepts for Analytics Collaborative Framework (ACF) [5] and New Observing Strategies (NOS) [4] to tackle our software infrastructure need for harmonized data management and dynamic acquisition of diverse measurements for on-demand, interactive, multivariate analysis, and access [3]. It is not enough to have a big data, standalone analytics solution; it is critical that we start integrating data from remote sensing, modeling, and in-situ networks in a harmonized manner that enables timely and data-driven decision-making for air quality management. This work presents the design and development of an Air Quality Analytics Collaborative Framework (AQ ACF), as part of NASA’s Advanced Information Systems Technology (AIST) effort, to establish a data, machine-learning, and numerically driven platform for air quality analysis, visualization, and prediction.

Liu, Qian↗