SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

NASA NTRS1998

Incorporating Parallel Computing into the Goddard Earth Observing System Data Assimilation System (GEOS DAS)

Atmospheric data assimilation is a method of combining actual observations with model forecasts to produce a more accurate description of the earth system than the observations or forecast alone can provide. The output of data assimilation, sometimes called the analysis, are regular, gridded datasets of observed and unobserved variables. Analysis plays a key role in numerical weather prediction and is becoming increasingly important for climate research. These applications, and the need for timely validation of scientific enhancements to the data assimilation system pose computational demands that are best met by distributed parallel software. The mission of the NASA Data Assimilation Office (DAO) is to provide datasets for climate research and to support NASA satellite and aircraft missions. The system used to create these datasets is the Goddard Earth Observing System Data Assimilation System (GEOS DAS). The core components of the the GEOS DAS are: the GEOS General Circulation Model (GCM), the Physical-space Statistical Analysis System (PSAS), the Observer, the on-line Quality Control (QC) system, the Coupler (which feeds analysis increments back to the GCM), and an I/O package for processing the large amounts of data the system produces (which will be described in another presentation in this session). The discussion will center on the following issues: the computational complexity for the whole GEOS DAS, assessment of the performance of the individual elements of GEOS DAS, and parallelization strategy for some of the components of the system.

Larson, Jay W.↗

NASA NTRS2004

Precipitation Analysis at Fine Time Scales Using Multiple Satellites: Real-time and Research Products and Applications

Quasi-global precipitation analyses at fine time scales (3-hr) are described. TRMM observations (radar and passive microwave) are used to calibrate polar-orbit microwave observations from SSM/I (and other satellites instruments, including AMSR and AMSU) and geosynchronous IR observations. The individual data sets are then merged using a priority order based on quality to form the Multi-satellite Precipitation Analysis (MPA). Raingauge information is used to help constrain the satellite-based estimates over land. The TRMM standard research product (Version 6 3B-42 of the TRMM products) will be available for the entire TRMM period (January 1998-present) in 2004. The real-time version of this merged product has been produced over the past two years and is available on the U.S. TRMM web site (trmm.gsfc.nasa.gov) at 0.25" latitude-longitude resolution over the latitude range from 5O"N-5O0S. Validation of daily totals indicates good results, with limitations noted in mid-latitude winter over land and regions of shallow, orographic precipitation. Various applications of these estimates are described, including: 1) detecting potential floods in near real-time; 2) analyzing Indian Ocean precipitation variations related to the initiation of El Nino; 3) determining characteristics of the African monsoon; and 4) analysis of diurnal variations.

Adler, Robert↗

NASA NTRS1997

Constructing Space-Time Views from Fixed Size Statistical Data: Getting the Best of both Worlds

Many performance monitoring tools are currently available to the super-computing community. The performance data gathered and analyzed by these tools fall under two categories: statistics and event traces. Statistical data is much more compact but lacks the probative power event traces offer. Event traces, on the other hand, can easily fill up the entire file system during execution such that the instrumented execution may have to be terminated half way through. In this paper, we propose an innovative methodology for performance data gathering and representation that offers a middle ground. The user can trade-off tracing overhead, trace data size vs. data quality incrementally. In other words, the user will be able to limit the amount of trace collected and, at the same time, carry out some of the analysis event traces offer using space-time views for the entire execution. Two basic ideas arc employed: the use of averages to replace recording data for each instance and formulae to represent sequences associated with communication and control flow. With the help of a few simple examples, we illustrate the use of these techniques in performance tuning and compare the quality of the traces we collected vs. event traces. We found that the trace files thus obtained are, in deed, small, bounded and predictable before program execution and that the quality of the space time views generated from these statistical data are excellent. Furthermore, experimental results showed that the formulae proposed were able to capture 100% of all the sequences associated with 11 of the 15 applications tested. The performance of the formulae can be incrementally improved by allocating more memory at run-time to learn longer sequences.

Schmidt, Melisa↗

NASA NTRS1980

Evaluation of SLAR and thematic mapper MSS data for forest cover mapping using computer-aided analysis techniques

Several possibilities were considered for defining the data set in which the same test areas could be used for each of the four different spatial resolutions being evaluated. The LARSYS CLUSTER was used to sort the vectors into spectral classes to reduce the within-spectral class variability in an effort to develop training statistics. A data quality test was written to determine the basic signal to noise characteristics within the data set being used. Because preliminary analysis of the LANDSAT MSS data revealed the presence of high cirrus clouds, other data sets are being sought.

Hoffer, R. M.↗

NASA NTRS1992

SkICAT: A cataloging and analysis tool for wide field imaging surveys

We describe an integrated system, SkICAT (Sky Image Cataloging and Analysis Tool), for the automated reduction and analysis of the Palomar Observatory-ST ScI Digitized Sky Survey. The Survey will consist of the complete digitization of the photographic Second Palomar Observatory Sky Survey (POSS-II) in three bands, comprising nearly three Terabytes of pixel data. SkICAT applies a combination of existing packages, including FOCAS for basic image detection and measurement and SAS for database management, as well as custom software, to the task of managing this wealth of data. One of the most novel aspects of the system is its method of object classification. Using state-of-theart machine learning classification techniques (GID3* and O-BTree), we have developed a powerful method for automatically distinguishing point sources from non-point sources and artifacts, achieving comparably accurate discrimination a full magnitude fainter than in previous Schmidt plate surveys. The learning algorithms produce decision trees for classification by examining instances of objects classified by eye on both plate and higher quality CCD data. The same techniques will be applied to perform higher-level object classification (e.g., of galaxy morphology) in the near future. Another key feature of the system is the facility to integrate the catalogs from multiple plates (and portions thereof) to construct a single catalog of uniform calibration and quality down to the faintest limits of the survey. SkICAT also provides a variety of data analysis and exploration tools for the scientific utilization of the resulting catalogs. We include initial results of applying this system to measure the counts and distribution of galaxies in two bands down to Bj is approximately 21 mag over an approximate 70 square degree multi-plate field from POSS-II. SkICAT is constructed in a modular and general fashion and should be readily adaptable to other large-scale imaging surveys.

Weir, N.↗

NASA NTRS2019

Analysis Ready Data in Analytics Optimized Data Stores for Analysis of Big Earth Data in the Cloud

Cloud computing offers the possibility of making the analysis of Big Data approachable for a wider community due to affordable access to computing power, an ecosystem of usable tools for parallel processing, and migration of many large datasets to archives in the cloud, allowing data-proximal computing. Generally, data analysis acceleration in the cloud comes from running multiple nodes in a split-combine-apply strategy. Data systems such as the Earth Observing System Data and Information System are in a position to "pre-split" the data by storing them in a data store that is optimized for data parallel computing, i.e., an Analytics-Optimized Data Store (AODS). A variety of approaches to AODS are possible, from highly scalable databases to scalable filesystems to data formats optimized for cloud access (e.g., zarr and cloud-optimized datasets), with the optimal choice dependent on both the types of analysis and the geospatial structure of the data. A key question is how much preprocessing of the data to do, both before splitting and as the first part of the apply step. Again, the geospatial structure of the data and the analysis type influence the decision, with the added complexity of the user type. Trans-disciplinary users who are not well-versed in the nuances of quality-filtering and georeferencing of remote sensing orbit/swath/scene data tend to ask for more highly processed data, relying on the data provider to make sensible decisions on preprocessing parameters. (This accounts for the popularity of "Level 3" gridded data, despite the lower spatial resolution it provides.) In this case, data can be preprocessed before the split, resulting in higher performance in the rest of the "apply" step, which can be transformative for use cases such as interactive data exploration at scale. Discipline researchers who are experienced with remote sensing data often prefer more flexibility in customizing the preprocessing data into Analysis Ready Data, resulting in more need for on-the-fly preprocessing.

Lynnes, Christopher↗

NASA NTRS1974

Use of Whatman-41 filters in air quality sampling networks (with applications to elemental analysis)

The operation of a 16-site parallel high volume air sampling network with glass fiber filters on one unit and Whatman-41 filters on the other is reported. The network data and data from several other experiments indicate that (1) Sampler-to-sampler and filter-to-filter variabilities are small; (2) hygroscopic affinity of Whatman-41 filters need not introduce errors; and (3) suspended particulate samples from glass fiber filters averaged slightly, but not statistically significantly, higher than from Whatman-41-filters. The results obtained demonstrate the practicability of Whatman-41 filters for air quality monitoring and elemental analysis.

Neustadter, H. E.↗

NASA NTRS1983

A modal analysis of flexible aircraft dynamics with handling qualities implications

A multivariable modal analysis technique is presented for evaluating flexible aircraft dynamics, focusing on meaningful vehicle responses to pilot inputs and atmospheric turbulence. Although modal analysis is the tool, vehicle time response is emphasized, and the analysis is performed on the linear, time-domain vehicle model. In evaluating previously obtained experimental pitch tracking data for a family of vehicle dynamic models, it is shown that flexible aeroelastic effects can significantly affect pitch attitude handling qualities. Consideration of the eigenvalues alone, of both rigid-body and aeroelastic modes, does not explain the simulation results. Modal analysis revealed, however, that although the lowest aeroelastic mode frequency was still three times greater than the short-period frequency, the rigid-body attitude response was dominated by this aeroelastic mode. This dominance was defined in terms of the relative magnitudes of the modal residues in selected vehicle responses.

Schmidt, D. K.↗

NASA NTRS1986

OSAC analysis of the Far Ultraviolet Spectroscopic Explorer (FUSE) telescope

An investigation is made of the sensitivity of the image quality for the proposed FUSE telescope to mirror misalignments and a wide spatial frequency range of figure errors. Representative figure error data was obtained for the analysis from measurements made on the SEUTS (Solar Extreme Ultraviolet Telescope Spectrograph) telescope mirrors. The tolerancing analysis was carried out with the aid of the Optical Surface Analysis Code (OSAC) program.

Saha, Timo T.↗

NASA NTRS1988

Boundary layer dynamics in the description of magnetospheric substorms

This paper presents an analysis of eleven magnetospheric substorm events for which good-quality ground-based magnetometer data and ISEE satellite data were both available. It is shown that the magnetotail particle and field observations associated with a substorm expansive phase can be explained through the spatial movement of the boundary layers and central plasma sheet in the magnetotail. The sweeping of these regions past the satellite, even in the absence of temporal variations within the various regions, can lead to a set of plasma flow observations typical of what is observed in the magnetotail during substorm activity.

Eastman, T. E.↗

NASA NTRS1991

Magellan - Mission summary

The Magellan radar mapping mission is in the process of producing a global, high-resolution image and altimetry data set of Venus. Despite initial communications problems, few data gaps have occurred. Analysis of Magellan data is in the initial stages. The radar system data are of high quality, and the planned performance is being achieved in terms of spatial resolution and geometric and radiometric accuracy. Image performance exceeds expectations, and the image quality and mosaickability are extremely good. Future plans for the mission include obtaining gravity data, filling gaps in the initial map, and conducting special studies with the radar.

Saunders, R. Stephen↗

NASA NTRS1992

OCEAN-PC and a distributed network for ocean data

The Intergovernmental Oceanographic Commission (IOC) wishes to develop an integrated software package for oceanographic data entry and access in developing countries. The software, called 'OCEAN-PC', would run on low cost PC microcomputers and would encourage and standardize: (1) entry of local ocean observations; (2) quality control of the local data; (3) merging local data with historical data; (4) improved display and analysis of the merged data; and (5) international data exchange. OCEAN-PC will link existing MS-DOS oceanographic programs and data sets with table-driven format conversions. Since many ocean data sets are now being distributed on optical discs (Compact Discs - Read Only Memory, CD-ROM, Mass et al. 1987), OCEAN-PC will emphasize access to CD-ROMs.

Mclain, Douglas R.↗

NASA NTRS2006

Autonomous Detection of Dust Devils and Clouds on Mars

Acquisition of science in space applications is shifting from teleoperated gathering to an automated on-board analysis with improvements in the use of on-board memory, CPU, bandwidth and data quality. In this paper, we describe algorithms to autonomously detect dust devils and clouds from a rover and summarize the results. These algorithms meet high hit-to-miss ratios and satisfy strict requirements of CPU, memory usage and bandwidth. The detectors have been scheduled for upload to the Mars Exploration Rovers (MER) in 2006. These are the first autonomous science processes in the rovers.

onboard science↗

NASA NTRS1996

An Optimal Deconvolution Method for Reconstructing Pneumatically Distorted Near-Field Sonic Boom Pressure Measurements

In-flight measurements of the SR-71 near-field sonic boom were obtained by an F-16XL airplane at flightpath separation distances from 40 to 740 ft. Twenty-two signatures were obtained from Mach 1.60 to Mach 1.84 and altitudes from 47,600 to 49,150 ft. The shock wave signatures were measured by the total and static sensors on the F-16XL noseboo. These near-field signature measurements were distorted by pneumatic attenuation in the pitot-static sensors and accounting for their effects using optimal deconvolution. Measurement system magnitude and phase characteristics were determined from ground-based step-response tests and extrapolated to flight conditions using analytical models. Deconvolution was implemented using Fourier transform methods. Comparisons of the shock wave signatures reconstructed from the total and static pressure data are presented. The good agreement achieved gives confidence of the quality of the reconstruction analysis. although originally developed to reconstruct the sonic boom signatures from SR-71 sonic boom flight tests, the methods presented here generally apply to other types of highly attenuated or distorted pneumatic measurements.

Whitmore, Stephen A.↗

NASA NTRS2016

The XXL Survey I. Scientific Motivations - Xmm-Newton Observing Plan - Follow-up Observations and Simulation Programme

The quest for the cosmological parameters that describe our universe continues to motivate the scientific community to undertake very large survey initiatives across the electromagnetic spectrum. Over the past two decades, the Chandra and XMM-Newton observatories have supported numerous studies of X-ray-selected clusters of galaxies, active galactic nuclei (AGNs), and the X-ray background. The present paper is the first in a series reporting results of the XXL-XMM survey; it comes at a time when the Planck mission results are being finalized. Aims. We present the XXL Survey, the largest XMM programme totaling some 6.9 Ms to date and involving an international consortium of roughly 100 members. The XXL Survey covers two extragalactic areas of 25 deg2 each at a point-source sensitivity of approx. 5 x 10(exp 15) erg/s/sq cm in the [0.5-2] keV band (completeness limit). The surveys main goals are to provide constraints on the dark energy equation of state from the space-time-distribution of clusters of galaxies and to serve as a pathfinder for future, wide-area X-ray missions. We review science objectives, including cluster studies, AGN evolution, and large-scale structure, that are being conducted with the support of approximately 30 follow-up programs. Methods. We describe the 542 XMM observations along with the associated multi- and numerical simulation programmes. We give a detailed account of the X-ray processing steps and describe innovative tools being developed for the cosmological analysis. Results. The paper provides a thorough evaluation of the X-ray data, including quality controls, photon statistics, exposure and background maps, and sky coverage. Source catalogue construction and multi-associations are briefly described. This material will be the basis for the calculation of the cluster and AGN selection functions, critical elements of the cosmological and science analyses. Conclusions. The XXL multi- data set will have a unique lasting legacy value for cosmological and extragalactic studies and will serve asa calibration resource for future dark energy studies with clusters and other X-ray selected sources. With the present article, we release the XMM XXL photon and smoothed images along with the corresponding exposure maps.

X-rays: general â€“ large-scale structure of Unive↗

NASA NTRSDate not supplied

Disorder to Order in Interface Patterns: Thermal Noise to Limit Cycle Transition in Dendrite Sidebranch Formation

Thin sample directional solidification experiments have been carried out in the model succinonitrile-camphor system to examine the origin of secondary branches in dendrite morphologies. Thermal noise at the dendrite tip creates interface instabilities which amplify to form sidebranches. This is accepted as the primary mode of sidebranching in dendritic growth from an undercooled melt and occurs in directional solidification of dendrites. The proposed limit cycle couples the growth of the tip with the initiation of the sidebranch. Directional solidification of curved interfaces is a driven dissipative system with the potential to form a limit cycle. Two sets of experiments were performed, the first holding velocity constant and evolving the gradient and the second imposing oscillating velocities around the natural period of sidebranching. Both experimental methods were found to characterize a transition from disordered sidebranching induced by thermal noise to ordered sidebranching produced by the limit cycle mechanisms. This is the first quantitative measurement of previously hypothesized limit cycle growth. These experiment sets have been quantitatively analyzed for dynamic behavior seen in limit cycles. High-quality data sets of the tip and instability enable the measurement of the FFT and analysis through a power spectrum. At low gradients, the sidebranches are found to be excited by thermal noise far away from the tip. As the gradient increases and velocity is held constant, the distance between the instability and tip decreases until limit cycle growth is found between the tip of the primary dendrite and the first forming sidebranch. An alternative to the deterministic limit cycles seen in experiments of gradient evolution is a limit cycle actively driven through the square wave oscillation of velocity. Crucial observations of the solidified microstructure conclude that this produced periodic interconnected bridges between the primary dendrites. This is a finding with potentially significant implications for commercial applications.

Trevor Lyons↗

NASA NTRS2013

The Influence of Observation Errors on Analysis Error and Forecast Skill Investigated with an Observing System Simulation Experiment

The Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework is used to explore the response of analysis error and forecast skill to observation quality. In an OSSE, synthetic observations may be created that have much smaller error than real observations, and precisely quantified error may be applied to these synthetic observations. Three experiments are performed in which synthetic observations with magnitudes of applied observation error that vary from zero to twice the estimated realistic error are ingested into the Goddard Earth Observing System Model (GEOS-5) with Gridpoint Statistical Interpolation (GSI) data assimilation for a one-month period representing July. The analysis increment and observation innovation are strongly impacted by observation error, with much larger variances for increased observation error. The analysis quality is degraded by increased observation error, but the change in root-mean-square error of the analysis state is small relative to the total analysis error. Surprisingly, in the 120 hour forecast increased observation error only yields a slight decline in forecast skill in the extratropics, and no discernable degradation of forecast skill in the tropics.

Observation Error↗

NASA NTRS2004

Precipitation Analysis at Fine Time Scales using TRMM and Other Satellites: Realtime and Research Products and Applications

Quasi-global precipitation analyses at fine time scales (3-hr) are described. TRMM observations (radar and passive microwave) are used to calibrate polar-orbit microwave observations from SSM/I (and other satellites instruments, including AMSR and AMSU) and geosynchronous IR observations. The individual data sets are then merged using a priority order based on quality to form the TRMM Multi-satellite Precipitation Analysis (MPA). Raingauge information is used to help constrain the satellite-based estimates over land. The TRMM standard research product (Version 6 3B-42 of the TRMM products) will be available for the entire TRMM period (January 1998-present) by the end of 2004. The real-time version of this merged product has been produced over the past two years and is available on the U.S. TRMM web site (trmm.gsfc.nasa.gov) at 0.25 deg latitude-longitude resolution over the latitude range from 50 deg N-50 deg S. Validation of daily totals indicates good results, with limitations noted in mid-latitude winter over land and regions of shallow, orographic precipitation. Various applications of these estimates are described, including: 1) detecting potential floods in near real-time; 2) analyzing Indian Ocean precipitation variations related to the initiation of El Nino; 3) determining characteristics of the African monsoon; and 4) analysis of diurnal variations.

Adler, Robert↗