Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1986

Spectral characteristics and the extent of paleosols of the Palouse formation

Spectral relationships were investigated for several bare soil fields which were in summer fallow rotation on the date of the imagery. Printouts of each band were examined and compared to aerial photography. Bands with dissimilar reflectance patterns for known areas were then combined using ratio techniques which were proven useful in other studies (Williams, 1983). Selected ratios were Thematic Mapper (TM) 1/TM4, TM3/TM4, and TM5/TM4. Cluster analyses and Baysian and Fastclass classifier images were produced using the three ratio images. Plots of cluster analysis outputs revealed distinct groupings of reflectance data representing green crops, ripened crops, soil and green plants, and bare soil. Bare soil was represented by a line of clusters on plots of the ratios TM5/TM4 and TM3/TM4. The soil line was investigated further to determine factors involved in the distributin of clusters alone the line. The clusters representing the bare soil line were also studied by plotting the Tm5/TM4, TM1/TM4 dimension. A total of 76 soil samples were gathered and analyzed for organic carbon.

Frazier, B. E.↗
NASA NTRS2013

Hadoop for High-Performance Climate Analytics: Use Cases and Lessons Learned

Scientific data services are a critical aspect of the NASA Center for Climate Simulations mission (NCCS). Hadoop, via MapReduce, provides an approach to high-performance analytics that is proving to be useful to data intensive problems in climate research. It offers an analysis paradigm that uses clusters of computers and combines distributed storage of large data sets with parallel computation. The NCCS is particularly interested in the potential of Hadoop to speed up basic operations common to a wide range of analyses. In order to evaluate this potential, we prototyped a series of canonical MapReduce operations over a test suite of observational and climate simulation datasets. The initial focus was on averaging operations over arbitrary spatial and temporal extents within Modern Era Retrospective- Analysis for Research and Applications (MERRA) data. After preliminary results suggested that this approach improves efficiencies within data intensive analytic workflows, we invested in building a cyber infrastructure resource for developing a new generation of climate data analysis capabilities using Hadoop. This resource is focused on reducing the time spent in the preparation of reanalysis data used in data-model inter-comparison, a long sought goal of the climate community. This paper summarizes the related use cases and lessons learned.

analytics↗
NASA NTRS2012

Preliminary Evaluation of MapReduce for High-Performance Climate Data Analysis

MapReduce is an approach to high-performance analytics that may be useful to data intensive problems in climate research. It offers an analysis paradigm that uses clusters of computers and combines distributed storage of large data sets with parallel computation. We are particularly interested in the potential of MapReduce to speed up basic operations common to a wide range of analyses. In order to evaluate this potential, we are prototyping a series of canonical MapReduce operations over a test suite of observational and climate simulation datasets. Our initial focus has been on averaging operations over arbitrary spatial and temporal extents within Modern Era Retrospective- Analysis for Research and Applications (MERRA) data. Preliminary results suggest this approach can improve efficiencies within data intensive analytic workflows.

Duffy, Daniel Q.↗
NASA NTRS2000

The Distance and Mass of the Galaxy Cluster Abell 1995 Derived from Sunyaev-Zeldovich Effect and X-Ray Measurements

We present multiwavelength observations of the Abell 1995 galaxy cluster. From an analysis of X-ray spectroscopy and imaging data, we derive the electron temperature, cluster core radius, and central electron number density. Using optical spectroscopy of 15 cluster members, we derive an accurate cluster redshift and velocity dispersion. Finally, the interferometric imaging of the Sunyaev-Zeldovich effect toward Abell 1995 at 28.5 GHz provides a measure of the integrated pressure through the cluster. The X-ray and Sunyaev-Zeldovich effect observations are combined to determine the angular diameter distance to the cluster of D(sub A) = 1294(sup +294 +438, sub -283 -458) Mpc (Statistical followed by systematic uncertainty), implying a Hubble constant of H(sub 0) = 52.2(sup +11.4 +18.5, sub -11.9 -17.7) km/s.Mpc for Omega(sub M) = 0.3 and Omega(sub lambda) = 0.7. We find a best-fit H(sub 0) of 46 km/s.Mpc for the Omega(sub M) = 1 and Omega(sub lambda) = 0 cosmology, and 48 km/s.Mpc for Omega(sub M) = 0.3 and Omega(sub lambda) = 0.0. The X-ray data are also used to derive a total cluster mass of M(sup HSE, sub tot)(r(sub 500)) = 5.18(sup +0.62, sub -0.48) x 10(exp 14)/h solar mass; the optical velocity dispersion yields an independent and consistent estimate of M(sup virial, sub tot)(r(sub 500)) = 6.35(sup +1.51, sub -1.19) X 10(exp 14) /h solar mass. Both of the total mass estimates are evaluated at a fiducial radius, r(sub 500) = 830 /h kpc, where the overdensity is 500 times the critical density. The total cluster mass is then combined with gas mass measurements to determine a cluster gas mass fraction of F(sub g) = 0.056(sup +0.010, sub -0.013) /h(sup 3/2) in combination with recent baryon density constraints, the measured gas mass fraction yields an upper limit on the mass density parameter of Omega(sub M) h(sup 1/2) <= 0.34(sup +/0.06, sub 0.05.

Patel, Sandeep K.↗
NASA NTRS1988

Einstein Observatory solid state detector observations of cooling flows in clusters of galaxies

Einstein Observatory (EO) solid state spectrometer results for the cooling flows in nine clusters of galaxies are discussed. An analysis of the data using three separate models provides strong evidence for the existence of cool components in the centers of these clusters. The obtained distribution of emission versus temperature for M87 is found to agree well with that determined from data obtained by the EO focal Plane Crystal Spectrometer.

Mushotzky, R. F.↗
NASA NTRS2003

Gyrophase-bunched Electrons: Cluster Observations and Simulations

The interaction of the solar wind with the Earth's bow shock is responsible for a number of phenomena both upstream and downstream. One of the least understood and studied of these is the generation of gyrophase-bunched electrons. We will describe initial work searching for and analyzing such events in (Plasma Electron And Current Experiment (PEACE) data from CLUSTER. Plasma simulations will complement the data analysis. Recent analyses suggest that gyrophase-bunched electrons are present rather frequently in the upstream region, due either to energization in the reflection off the shock front or, more likely, to phase trapping in locally produced whistler wave fields.

Gurgiolo, C.↗
NASA NTRS2019

An Evolutionary System of Mineralogy: Proposal for A Classification of Planetary Materials Based on Natural Kind Clustering

Minerals reveal the nature of the co-evolving geosphere and biosphere through billions of years of Earth history. Mineral classification systems have the potential to elucidate this rich evolutionary story; however, the present mineral taxonomy, based as it is on idealized major element chemistry and crystal structure, lacks a temporal aspect, and thus cannot reflect planetary evolution. A complementary evolutionary system of mineralogy based on the quantitative recognition of “natural kind clustering” for a wide range of condensed planetary materials with different paragenetic origins has the potential to amplify, though not supersede, the present classification system.

Philosophy of mineralogy↗
NASA NTRS2005

Testing the Archivas Cluster (Arc) for Ozone Monitoring Instrument (OMI) Scientific Data Storage

The Ozone Monitoring Instrument (OMI) launched on NASA's Aura Spacecraft, the third of the major platforms of the EOS program on July 15,2004. In addition to the long term archive and distribution of the data from OM1 through the Goddard Earth Science Distributed Active Archive Center (GESDAAC), we are evaluating other archive mechanisms that can archive the data in a more immediately available method where it can be used for futher data production and analysis. In 2004, Archivas, Inc. was selected by NASA s Small Business Innovative Research (SBIR) program for the development of their Archivas Cluster (ArC) product. Arc is an online disk based system utilizing self-management and automation on a Linux cluster. Its goal is to produce a low cost solution coupled with the ease of management. The OM1 project is an application partner of the SBIR program, and has deployed a small cluster (5TB) based on the beta Archwas software. We performed extensive testing of the unit using production OM1 data since launch. In 2005, Archivas, Inc. was funded in SBIR Phase II for further development, which will include testing scalability with the deployment of a larger (35TB) cluster at Goddard. We plan to include Arc in the OM1 Team Leader Computing Facility (TLCF) hosting OM1 data for direct access and analysis by the OMI Science Team. This presentation will include a brief technical description of the Archivas Cluster, a summary of the SBIR Phase I beta testing results, and an overview of the OMI ground data processing architecture including its interaction with the Phase II Archivas Cluster and hosting of OMI data for the scientists.

Tilmes, Curt↗
NASA NTRS2003

Cluster Masses Derived from X-ray and Sunyaev-Zeldovich Effect Measurements

We infer the gas mass and total gravitational mass of 11 clusters using two different methods; analysis of X-ray data from the Chandra X-ray Observatory and analysis of centimeter-wave Sunyaev-Zel'dovich Effect (SZE) data from the BIMA and OVRO interferometers. This flux-limited sample of clusters from the BCS cluster catalogue was chosen so as to be well above the surface brightness limit of the ROSAT All Sky Survey; this is therefore an orientation unbiased sample. The gas mass fraction, f_g, is calculated for each cluster using both X-ray and SZE data, and the results are compared at a fiducial radius of r_500. Comparison of the X-ray and SZE results for this orientation unbiased sample allows us to constrain cluster systematics, such as clumping of the intracluster medium. We derive an upper limit on Omega_M assuming that the mass composition of clusters within r_500 reflects the universal mass composition Omega_M h_100 is greater than Omega _B / f-g. We also demonstrate how the mean f_g derived from the sample can be used to estimate the masses of clusters discovered by upcoming deep SZE surveys.

Laroque, S.↗
NASA NTRS2010

Mimas: Preliminary Evidence For Amorphous Water Ice from VIMS

We have conducted a statistical clustering analysis (1,2) on a mosaic of VIMS data cubes obtained on February 13, 2010, for Saturn s satellite Mimas. Seven VIMS cubes were geometrically projected and re-sampled to a common spatial resolution. The clustering technique consists of a partitioning algorithm coupled to a criterion that prevents sub-optimal solutions and tests for the influence of random noise in the measurements. The clustering technique is agnostic about the meaning of the clusters, and scientific interpretation requires their a posteriori evaluation. The preliminary results yielded five clusters, demonstrating that spectral variability across Mimas surface is statistically significant. The ratios of the means calculated for each of the clusters show structure within the 1.6- micron water ice band, as well as the shape and the central wavelength of the strong ice band at 2 micron, that map spatially in patterns apparently related to the topography of Mimas, in particular certain regions in and around Herschel crater. The mean spectra of the five clusters, show similarities with laboratory spectra of amorphous and crystalline H2O ice (3) that are suggestive of the presence of an amorphous ice component in certain regions of Mimas, notably on the central peak of Herschel, on the crater floor, and in faults surrounding the crater. This may represent a mixture of both ice phases, or perhaps a layer of amorphous ice on a base of crystalline ice. Another possible occurrence of amorphous ice appears southwest of Herschel, close to the south pole.

Cruikshank, Dale P.↗
NASA NTRS1985

Space station ECLSS integration analysis: Simplified General Cluster Systems Model, ECLS System Assessment Program enhancements

The data base verification of the ECLS Systems Assessment Program (ESAP) was documented and changes made to enhance the flexibility of the water recovery subsystem simulations are given. All changes which were made to the data base values are described and the software enhancements performed. The refined model documented herein constitutes the submittal of the General Cluster Systems Model. A source listing of the current version of ESAP is provided in Appendix A.

Ferguson, R. E.↗
NASA NTRS2004

Determination of Cluster Distances from Chandra Imaging Spectroscopy and Sunyaev-Zeldovich Effect Measurements: Analysis Methods and Initial Results - I

X-ray and Sunyaev-Zeldovich Effect data ca,n be combined to determine the distance to galaxy clusters. High-resolution X-ray data are now available from the Chandra Observatory, which provides both spatial and spectral information, and interferometric radio measurements of the Sunyam-Zeldovich Effect are available from the BIMA and 0VR.O arrays. We introduce a Monte Carlo Markov chain procedure for the joint analysis of X-ray and Sunyaev-Zeldovich Effect data. The advantages of this method are the high computational efficiency and the ability to measure the full probability distribution of all parameters of interest, such as the spatial and spectral properties of the cluster gas and the cluster distance. We apply this technique to the Chandra X-ray data and the OVRO radio data for the galaxy cluster Abell 611. Comparisons with traditional likelihood-ratio methods reveal the robustness of the method. This method will be used in a follow-up paper to determine the distance of a large sample of galaxy clusters for which high-resolution Chandra X-ray and BIMA/OVRO radio data are available.

Bonamente, Massimiliano↗
NASA NTRS1974

Satellite detection of air pollutants

NASA's ERTS-1 satellite, with its high resolution and multispectral capabilities, has been found useful in the detection and analysis of smoke from large point sources (power plants, steel mills, etc.), and widespread atmospheric turbidity associated with atmospheric stagnations. Smoke plumes from the Chicago-Northern Indiana industrial complex have been tracked over Lake Michigan for over 100 km. Experience has shown that smoke plumes are relatively easy to detect over water (in the 0.6-0.7 micrometer band) but much more difficult over land surfaces. Pattern recognition techniques (cluster analysis) were applied to the digital ERTS data, and it was found that the smoke plumes indeed had a unique spectral signature. Studies are currently underway to use measured plume geometries to obtain quantitative estimates of diffusion over water surfaces.

Lyons, W. A.↗
NASA NTRS1976

Stratification of Landsat data by clustering

Full realization of the potential advantages of the synoptic coverage provided by Landsat will require the development and use of data analysis techniques which take into account the large variation and diversity of patterns found over many Landsat scenes. Stratification of the scene into units which are internally homogeneous is recommended as a first step in the analysis of data for whole or multiple frames of Landsat data. The use of clustering as an objective and efficient method of dividing scenes into areas which are spectrally similar (strata) is discussed and initial results, including classification performances and comparisons of spectral strata with major physical factors, are presented.

Bauer, M. E.↗
NASA NTRS1976

A computer analysis of ERTS data of the Lake Gregory area of South Australia with particular emphasis on its role in terrain classification for engineering

A digital computer and multivariate statistical techniques were used to analyze 4-band multispectral data. A representation of the original data for each of the four bands allows a certain degree of terrain interpretation; however, variations in appearance of sites within and between bands, without additional criteria for deciding which representation should be preferred, create difficulties for classification. Investigation of the video data groups produced by principal components analysis and cluster analysis techniques shows that effective correlations with classifications of terrain produced by conventional methods could be carried out. The analyses also highlighted underlying relationships between the various elements. The approach used allows large areas (185 cm by 185 cm) to be classified into fundamental units within a matter of hours and can be applied to those parts of the Earth where facilities for conventional studies are poor or lacking.

Lodwick, G. D.↗
NASA NTRS1973

Thermal-bremsstrahlung interpretation of cluster X-ray sources.

Analysis of the X-ray data for the extended sources in Coma, Perseus, and Virgo in terms of an isothermal gas-sphere model emitting thermal-bremsstrahlung radiation. It is found that the gas distribution is somewhat less centrally condensed than the galaxies, and that the gas mass is generally a small fraction of the binding mass of each cluster. In the case of the Coma cluster, approximately one-eighth of the binding mass (with an uncertainty of about 50%) may be in the form of hot gas at 100,000,000 K if H sub zero = 50 km/sec/Mpc.

Lea, S. M.↗
NASA NTRS2021

PIXLISE-C: Exploring The Data Analysis Needs of NASA Scientists for Mineral Identification

NASA JPL scientists working on the micro x-ray fluorescence (microXRF) spectroscopy data collected from Mars surface perform data analysis to look for signs of past microbial life on Mars. Their data analysis workflow mainly involves identifying mineral com- pounds through the element abundance in spatially distributed data points. Working with the NASA JPL team, we identified pain points and needs to further develop their existing data visualization and analysis tool. Specifically, the team desired improvements for the process of creating and interpreting mineral composition groups. To address this problem, we developed an interactive tool that enables scientists to (1) cluster the data using either manual lasso-tool selection or through various machine learning clustering algorithms, and (2) compare the clusters and individual data points to make informed decisions about mineral compositions. Our preliminary tool supports a hybrid data analysis workflow where the user can manually refine the machine-generated clusters.

Davidoff, Scott↗