Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Disentangling Structures in the Cluster of Galaxies Abell 133

A dynamical analysis of the structure of the cluster of galaxies Abell 133 will be presented using multi-wavelength data combined from multiple space and earth based observations. New and familiar statistical clustering techniques are used in combination in an attempt to gain a fully consistent picture of this interesting nearby cluster of galaxies. The type of analysis presented should be typical of cluster studies in the future, especially those to come from the surveys like the Sloan Digital Sky Survey and the 2DF.

Way, Michael J.↗

The JSC clustering program ISOCLS and its applications

The clustering program ISOCLS developed at the Johnson Space Center, Houston, Texas, has been extensively used in the pattern analysis and classification of remote sensor data collected by aircraft and by the Earth Resources Technology Satellite ERTS-1. This paper discusses the theory behind this clustering algorithm. Several new ideas that have been incorporated in ISOCLS are discussed. Among these are the novel philosophy of operation behind the procedure, which assumes that a population (i.e., a class or a cluster) can be treated as the union of an appropriate number of subpopulations, and the termination of the clustering program by a 'chaining algorithm.' Finally, this paper reports the results of the application of ISOCLS to an investigation on rangeland vegetation mapping using ERTS-1 data.

Kan, E. P.↗

Land Analysis System (LAS)

Version 4.1 of LAS provides flexible framework for algorithm development and processing and analysis of image data. Over 500,000 lines of code enable image repair, clustering, classification, film processing, geometric registration, radiometric correction, and manipulation of image statistics.

Pease, P. B.↗

Confirmation of dust clusters in the coma of Comet Halley

Measurements from the Ducma dust counter and mass analyzer on the Vega spacecraft are compared with those from the SP-1 sensor on the same spacecraft. It is shown that the sequence of pulses recorded by the SP-1 instruments show deviations from a random distribution. Some of the nonrandom sequences observed by SP-1 are in the same time intervals as the clusters observed by the Ducma instrument. The results support the analysis of Ducma data which showed highly structured variations of dust intensity through the coma and large fluxes of low mass particles extending to great distances beyond the coma (Simpson et al., 1986).

Simpson, J. A.↗

The hot interstellar medium in NGC 1399

The first two high signal-to-noise, broad bandpass x-ray spectra of elliptical galaxies were obtained with the Broad Band X-ray Telescope (BBXRT) as part of the December 1990 Astro mission. These observations provided unprecedented information on the thermal and metallicity structure of the hot interstellar media in two ellipticals: NGC 1399, the central galaxy in the Fornax cluster, and NGC 4472, the brightest galaxy in the Virgo cluster. The finalized analysis and interpretation of the approximately 4000 sec of BBXRT data on NGC 1399 is reported.

Loewenstein, Michael↗

The X-ray spectrum of Abell 665

The X-ray spectrum of the Abell 665 cluster of galaxies has been determined by the Ginga satellite. The spectrum can be well fitted by an isothermal model with kT = 8.26(+0.95; -0.81) keV and metal abundance 0.49 +/- 0.16. Joint analysis with lower energy spectral data from the Einstein Observatory is used to constrain the temperature distribution in the cluster. For a particular form of the polytropic temperature model we find the best fit to be the isothermal case, and we set an upper limit on the polytropic index of 1.35 (99-percent confidence). The virial mass of the cluster has been determined from both the X-ray data and the galaxy velocity dispersion. The mass estimates from the optical and X-ray analyses are fully consistent with each other. Abell 665 is found to be 0.82(+0.41; -0.26) times as massive as Coma if the two clusters are assumed to have the same spatial distribution of virial mass.

Hughes, John P.↗

Aerodynamic Reconstruction Applied to Parachute Test Vehicle Flight Data Analysis

The aerodynamics, both static and dynamic, of a test vehicle are critical to determining the performance of the parachute cluster in a drop test and for conducting a successful test. The Capsule Parachute Assembly System (CPAS) project is conducting tests of NASA's Orion Multi-Purpose Crew Vehicle (MPCV) parachutes at the Army Yuma Proving Ground utilizing the Parachute Test Vehicle (PTV). The PTV shape is based on the MPCV, but the height has been reduced in order to fit within the C-17 aircraft for extraction. Therefore, the aerodynamics of the PTV are similar, but not the same as, the MPCV. A small series of wind tunnel tests and computational fluid dynamics cases were run to modify the MPCV aerodynamic database for the PTV, but aerodynamic reconstruction of the flights has proven an effective source for further improvements to the database. The acceleration and rotational rates measured during free flight, before parachute inflation but during deployment, were used to con rm vehicle static aerodynamics. A multibody simulation is utilized to reconstruct the parachute portions of the flight. Aerodynamic or parachute parameters are adjusted in the simulation until the prediction reasonably matches the flight trajectory. Knowledge of the static aerodynamics is critical in the CPAS project because the parachute riser load measurements are scaled based on forebody drag. PTV dynamic damping is critical because the vehicle has no reaction control system to maintain attitude - the vehicle dynamics must be understood and modeled correctly before flight. It will be shown here that aerodynamic reconstruction has successfully contributed to the CPAS project.

Cassady, Leonard D.↗

System and Method for Outlier Detection via Estimating Clusters

An efficient method and system for real-time or offline analysis of multivariate sensor data for use in anomaly detection, fault detection, and system health monitoring is provided. Models automatically derived from training data, typically nominal system data acquired from sensors in normally operating conditions or from detailed simulations, are used to identify unusual, out of family data samples (outliers) that indicate possible system failure or degradation. Outliers are determined through analyzing a degree of deviation of current system behavior from the models formed from the nominal system data. The deviation of current system behavior is presented as an easy to interpret numerical score along with a measure of the relative contribution of each system parameter to any off-nominal deviation. The techniques described herein may also be used to "clean" the training data.

Iverson, David J.↗

Fast Image Texture Classification Using Decision Trees

Texture analysis would permit improved autonomous, onboard science data interpretation for adaptive navigation, sampling, and downlink decisions. These analyses would assist with terrain analysis and instrument placement in both macroscopic and microscopic image data products. Unfortunately, most state-of-the-art texture analysis demands computationally expensive convolutions of filters involving many floating-point operations. This makes them infeasible for radiation- hardened computers and spaceflight hardware. A new method approximates traditional texture classification of each image pixel with a fast decision-tree classifier. The classifier uses image features derived from simple filtering operations involving integer arithmetic. The texture analysis method is therefore amenable to implementation on FPGA (field-programmable gate array) hardware. Image features based on the "integral image" transform produce descriptive and efficient texture descriptors. Training the decision tree on a set of training data yields a classification scheme that produces reasonable approximations of optimal "texton" analysis at a fraction of the computational cost. A decision-tree learning algorithm employing the traditional k-means criterion of inter-cluster variance is used to learn tree structure from training data. The result is an efficient and accurate summary of surface morphology in images. This work is an evolutionary advance that unites several previous algorithms (k-means clustering, integral images, decision trees) and applies them to a new problem domain (morphology analysis for autonomous science during remote exploration). Advantages include order-of-magnitude improvements in runtime, feasibility for FPGA hardware, and significant improvements in texture classification accuracy.

Thompson, David R.↗

Lightning Contribution to Improvement of Passive Microwave Vertical Structure and Rainfall Estimation

Joint observations from the TRMM mission are used to examine the contribution which lightning observations can make towards estimation of vertical structure and rainfall from passive microwave data. Passive microwave (TMI) observations are binned into distinct vertical structure categories based on cluster analysis of radar (PR) vertical profiles and convective/stratiform (C/S) classifiers. TMI rain estimates are high-biased relative to radar for stratiform and mixed convective/stratiform vertical structures and low-biased relative to radar for convective structures. Significant ambiguity exists in the TMI brightness temperature space between midlevel stratiform and convective profile types which are primary contributors to tropical rainfall. The ambiguity is worst for convective profile types with radar echo tops within and just above the mixed-phase region. The ability of TMI data (including all low and high frequency polarized brightness temperatures; 19V, 19H, 21V, 37V, 37H, 85V, 85H) to predict vertical structure is assessed. The incremental benefit of including TMI convective/stratiform (C/S) classifiers (both 85 GHz polarization and 19, 37 and 85 GHz texture-based) and LZS lightning observations is then considered. The use of all parameters (brightness temperatures, TMI C/S classifiers, lightning data, predicted vertical structure) to reduce TMI/PR rainfall estimate scatter is demonstrated. For both vertical structure and rainfall estimation, inclusion of C/S classifiers and lightning observations provide statistical skill improvements but do not completely alleviate critical midlevel profile C/S ambiguity and related rain estimate errors.

Boccippio, Dennis↗

Data Quality Challenges for Analysis Ready Data (ARD)

Data quality plays a critical role in research and applications. The Earth Science Information Partners (ESIP) Information Quality Cluster (IQC) defines four aspects of information quality: Science, Product, Stewardship, and Services. The ESIP IQC has become internationally recognized as an authoritative and responsive resource of information and guidance to data producers and distributors on how to implement data quality standards and best practices for their science data systems, datasets, and data/metadata dissemination services. In recent years, cloud computing environments have provided scale-up capabilities such as data archives and services, enabling interdisciplinary science and applications. More value-added products are expected from data service providers, including Analysis Ready Data (ARD). ARD refers to data that has been preprocessed into a form that allows immediate analysis by the end user, processed to a minimum set of requirements and provides interoperability over time and across multiple datasets. Once a dataset has been developed from its original form to produce ARD, what quality characteristics should the derived dataset or ARD possess? Also, is it safe to assume that the quality of the ARD is consistent with the quality of the source data, or are there special attributes to an ARD that would warrant a secondary, independent quality assessment? What provenance (also called “data lineage”) information needs to be included in ARD? It is important to answer these questions, especially given the ease of use of ARD, and the consequent temptation by users to trust ARD without understanding the limitations or possible variations in quality compared to the source data. In this presentation, we will discuss data quality challenges for ARD products and services and introduce IQC for participation.

data quality↗

The X-Ray Core of the Low-Luminosity Radio Galaxy 3C346 and ASCA Spectroscopy to Test BL LAC/Radio Galaxy Unification

Radio galaxies are relatively faint sources for Advanced Spacecraft for Cosmology Astrophysics (ASCA), and so in order to get the best possible results from the observations two things have been necessary, both of which delayed the fast preparation of papers. Firstly, the best possible data screening and background subtraction were necessary to improve the signal-to-noise, and all our several initial analysis trials were discarded in favor of using FTOOLS versions 4.1 and above. Secondly, we found that the ASCA spectra were statistically too poor to discriminate well between non-thermal and thermal models, never mind the mixture of the two which we expected on the basis of our ROSAT spatial separation of components in radio galaxies. This means that in each case we have needed to combine the ASCA spectroscopy with analysis of data from other X-ray or radio observations in order to exploit the ASCA data to the full. Our analysis for 3C 346 has yielded the cleanest final result. This powerful radio galaxy at a redshift of 0.161, lies in a poor cluster, which we have separated well from the dominant X-ray component of unresolved emission using a spatial analysis of archival ROSAT data. We were then able to fix the thermal component in our ASCA spectral analysis, and have found evidence that the unresolved emission varied by 32 +/- 13% over the 18 months between the ROSAT and ASCA observations. The unresolved X-ray emission does not suffer from intrinsic absorption, and we have related it to radio structures on both milliarcsecond scales and the arcsecond scales which Chandra can resolve. The source is a target of a Chandra AO2 proposal which we have recently submitted to follow up on our ASCA (and ROSAT) work. 3C 346's orientation to the line of sight is uncertain. However, the absence of X-ray absorption, and the radio/optical/X-ray colors, when combined with with previous radio evidence that the source is a foreshortened radio galaxy of the FRII class, suggest that the radio jets are seen at an angle to the line of sight of about 30 deg, intermediate between the radio-galaxy and quasar classes. The relatively hard ASCA response has allowed us to place an upper limit of 5.6 x 10(exp 43) ergs/ s on the 2-10 keV luminosity of any central X-ray component absorbed bN, gas which might be obscuring the broad-line emission region. Attached to this report is an almost final draft of a paper which we have prepared for submission to the Astrophysical Journal. Our combined ASCA and ROSAT results for NGC 6251 rule out our previously preferred flat-spectrum model and inverse-Compton interpretation for the source based on ROSAT data alone, but a softer X-ray spectrum and moderate absorption bring all the available data (including our early VLA HI measurements) into consistency, and we are reasonably confident that we understand the processes responsible for the X-ray emission. We have made some more sensitive HI absorption measurements which are currently being analyzed, and our plans are to publish our ASCA analysis in conjunction with the new HI results. The ASCA data for NGC 4261 have been difficult to interpret. A re-analysis of our ROSAT data with a wider range of physical parameters brings the ROSAT and ASCA results into reasonable agreement only if the emission from hot gas dominates more than suggested by our earlier work, which is itself unexpected since the radio core is bright and a large jet-related X-ray component would bring the source into agreement with results for others of its type. However, we have recently received our Chandra A01 data for this source, with the spatial resolution which allows us to separate thermal and non-thermal emission components. Our ASCA results will be re-interpreted once the analysis of our Chandra data is complete. The interpretation of the ASCA data for BL Lac object 3C 371 is ongoing, in conjunction with analysis of archival multifrequency data. Radio galaxies are complex in their X-ray properties, and hindsight has shown that the spatial resolution of ASCA is too poor for a reliable interpretation of the data without drawing on other observations. However, the ASCA spectra have made a useful contribution to the interpretation of these sources, and the groundwork is now there for more sensitive work using Chandra and XMM-Newton.

Worrall, Diana↗

Parallel NPARC: Implementation and Performance

Version 3 of the NPARC Navier-Stokes code includes support for large-grain (block level) parallelism using explicit message passing between a heterogeneous collection of computers. This capability has the potential for significant performance gains, depending upon the block data distribution. The parallel implementation uses a master/worker arrangement of processes. The master process assigns blocks to workers, controls worker actions, and provides remote file access for the workers. The processes communicate via explicit message passing using an interface library which provides portability to a number of message passing libraries, such as PVM (Parallel Virtual Machine). A Bourne shell script is used to simplify the task of selecting hosts, starting processes, retrieving remote files, and terminating a computation. This script also provides a simple form of fault tolerance. An analysis of the computational performance of NPARC is presented, using data sets from an F/A-18 inlet study and a Rocket Based Combined Cycle Engine analysis. Parallel speedup and overall computational efficiency were obtained for various NPARC run parameters on a cluster of IBM RS6000 workstations. The data show that although NPARC performance compares favorably with the estimated potential parallelism, typical data sets used with previous versions of NPARC will often need to be reblocked for optimum parallel performance. In one of the cases studied, reblocking increased peak parallel speedup from 3.2 to 11.8.

Townsend, S. E.↗

An Objective Classification of Saturn Cloud Features from Cassini ISS Images

A k -means clustering algorithm is applied to Cassini Imaging Science Subsystem continuum and methane band images of Saturn's northern hemisphere to objectively classify regional albedo features and aid in their dynamical interpretation. The procedure is based on a technique applied previously to visible- infrared images of Earth. It provides a new perspective on giant planet cloud morphology and its relationship to the dynamics and a meteorological context for the analysis of other types of simultaneous Saturn observations. The method identifies 6 clusters that exhibit distinct morphology, vertical structure, and preferred latitudes of occurrence. These correspond to areas dominated by deep convective cells; low contrast areas, some including thinner and thicker clouds possibly associated with baroclinic instability; regions with possible isolated thin cirrus clouds; darker areas due to thinner low level clouds or clearer skies due to downwelling, or due to absorbing particles; and fields of relatively shallow cumulus clouds. The spatial associations among these cloud types suggest that dynamically, there are three distinct types of latitude bands on Saturn: deep convectively disturbed latitudes in cyclonic shear regions poleward of the eastward jets; convectively suppressed regions near and surrounding the westward jets; and baro-clinically unstable latitudes near eastward jet cores and in the anti-cyclonic regions equatorward of them. These are roughly analogous to some of the features of Earth's tropics, subtropics, and midlatitudes, respectively. This classification may be more useful for dynamics purposes than the traditional belt-zone partitioning. Temporal variations of feature contrast and cluster occurrence suggest that the upper tropospheric haze in the northern hemisphere may have thickened by 2014. The results suggest that routine use of clustering may be a worthwhile complement to many different types of planetary atmospheric data analysis.

atmosphere dynamics↗

Improve Data Mining and Knowledge Discovery Through the Use of MatLab

Data mining is widely used to mine business, engineering, and scientific data. Data mining uses pattern based queries, searches, or other analyses of one or more electronic databases/datasets in order to discover or locate a predictive pattern or anomaly indicative of system failure, criminal or terrorist activity, etc. There are various algorithms, techniques and methods used to mine data; including neural networks, genetic algorithms, decision trees, nearest neighbor method, rule induction association analysis, slice and dice, segmentation, and clustering. These algorithms, techniques and methods used to detect patterns in a dataset, have been used in the development of numerous open source and commercially available products and technology for data mining. Data mining is best realized when latent information in a large quantity of data stored is discovered. No one technique solves all data mining problems; challenges are to select algorithms or methods appropriate to strengthen data/text mining and trending within given datasets. In recent years, throughout industry, academia and government agencies, thousands of data systems have been designed and tailored to serve specific engineering and business needs. Many of these systems use databases with relational algebra and structured query language to categorize and retrieve data. In these systems, data analyses are limited and require prior explicit knowledge of metadata and database relations; lacking exploratory data mining and discoveries of latent information. This presentation introduces MatLab(R) (MATrix LABoratory), an engineering and scientific data analyses tool to perform data mining. MatLab was originally intended to perform purely numerical calculations (a glorified calculator). Now, in addition to having hundreds of mathematical functions, it is a programming language with hundreds built in standard functions and numerous available toolboxes. MatLab's ease of data processing, visualization and its enormous availability of built in functionalities and toolboxes make it suitable to perform numerical computations and simulations as well as a data mining tool. Engineers and scientists can take advantage of the readily available functions/toolboxes to gain wider insight in their perspective data mining experiments.

Shaykhian, Gholam Ali↗

Improve Data Mining and Knowledge Discovery through the use of MatLab

Data mining is widely used to mine business, engineering, and scientific data. Data mining uses pattern based queries, searches, or other analyses of one or more electronic databases/datasets in order to discover or locate a predictive pattern or anomaly indicative of system failure, criminal or terrorist activity, etc. There are various algorithms, techniques and methods used to mine data; including neural networks, genetic algorithms, decision trees, nearest neighbor method, rule induction association analysis, slice and dice, segmentation, and clustering. These algorithms, techniques and methods used to detect patterns in a dataset, have been used in the development of numerous open source and commercially available products and technology for data mining. Data mining is best realized when latent information in a large quantity of data stored is discovered. No one technique solves all data mining problems; challenges are to select algorithms or methods appropriate to strengthen data/text mining and trending within given datasets. In recent years, throughout industry, academia and government agencies, thousands of data systems have been designed and tailored to serve specific engineering and business needs. Many of these systems use databases with relational algebra and structured query language to categorize and retrieve data. In these systems, data analyses are limited and require prior explicit knowledge of metadata and database relations; lacking exploratory data mining and discoveries of latent information. This presentation introduces MatLab(TradeMark)(MATrix LABoratory), an engineering and scientific data analyses tool to perform data mining. MatLab was originally intended to perform purely numerical calculations (a glorified calculator). Now, in addition to having hundreds of mathematical functions, it is a programming language with hundreds built in standard functions and numerous available toolboxes. MatLab's ease of data processing, visualization and its enormous availability of built in functionalities and toolboxes make it suitable to perform numerical computations and simulations as well as a data mining tool. Engineers and scientists can take advantage of the readily available functions/toolboxes to gain wider insight in their perspective data mining experiments.

Shaykahian, Gholan Ali↗

LANDSAT-4 MSS and Thematic Mapper data quality and information content analysis

LANDSAT-4 thematic mapper (TM) and multispectral scanner (MSS) data were analyzed to obtain information on data quality and information content. Geometric evaluations were performed to test band-to-band registration accuracy. Thematic mapper overall system resolution was evaluated using scene objects which demonstrated sharp high contrast edge responses. Radiometric evaluation included detector relative calibration, effects of resampling, and coherent noise effects. Information content evaluation was carried out using clustering, principal components, transformed divergence separability measure, and supervised classifiers on test data. A detailed spectral class analysis (multispectral classification) was carried out to compare the information content of the MSS and TM for a large number of scene classes. A temperature-mapping experiment was carried out for a cooling pond to test the quality of thermal-band calibration. Overall TM data quality is very good. The MSS data are noisier than previous LANDSAT results.

Anuta, P.↗