Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Adaptive fuzzy system for 3-D vision

An adaptive fuzzy system using the concept of the Adaptive Resonance Theory (ART) type neural network architecture and incorporating fuzzy c-means (FCM) system equations for reclassification of cluster centers was developed. The Adaptive Fuzzy Leader Clustering (AFLC) architecture is a hybrid neural-fuzzy system which learns on-line in a stable and efficient manner. The system uses a control structure similar to that found in the Adaptive Resonance Theory (ART-1) network to identify the cluster centers initially. The initial classification of an input takes place in a two stage process; a simple competitive stage and a distance metric comparison stage. The cluster prototypes are then incrementally updated by relocating the centroid positions from Fuzzy c-Means (FCM) system equations for the centroids and the membership values. The operational characteristics of AFLC and the critical parameters involved in its operation are discussed. The performance of the AFLC algorithm is presented through application of the algorithm to the Anderson Iris data, and laser-luminescent fingerprint image data. The AFLC algorithm successfully classifies features extracted from real data, discrete or continuous, indicating the potential strength of this new clustering algorithm in analyzing complex data sets. The hybrid neuro-fuzzy AFLC algorithm will enhance analysis of a number of difficult recognition and control problems involved with Tethered Satellite Systems and on-orbit space shuttle attitude controller.

Mitra, Sunanda↗

Geospatial Cluster Analysis of the State, Duration and Severity of Drought Over Paraíba State, Northeastern Brazil

Droughts threaten water resources, agriculture, socio-economic activities and the population at the global and regional level, so identifying areas with homogeneous drought behaviors is an important consideration in improving the management of water resources. The objective of this study is to identify homogenous zones over Paraíba State in relation to the state, duration and severity of droughts that have occurred over the last 20 years (1998–2017) using hierarchical cluster analysis based on both gauge-measured and Tropical Rainfall Measuring Mission (TRMM) estimated rainfall data (TMPA 3B42). The drought series were calculated using the Standardized Precipitation Index (SPI) based on eight time scales and were grouped according to drought state, duration and severity time series. The integrated results of state, duration and severity of droughts indicate that there is a basis for dividing Paraíba State into two major regions (a) Zone I, formed by Mata Paraibana and Agreste Paraibano, and (b) Zone II, composed by Borborema and Sertão Paraibano. This division is evident when assessing short-term droughts, but in the case of long-term droughts, Paraíba State has a high similarity in terms of drought state, duration, and severity. Factors such as proximity to the ocean, active climatic systems, and the local relief configuration were identified as influencing the drought regime. Finally, it is concluded that TMPA rainfall estimates represent a valuable source of data to regionalize and identify drought patterns over this part of Brazil and that other studies of this type should be carried out to monitor these phenomena based on other satellite-based rainfall data, including the Global Precipitation Mission (GPM).

SPI↗

Significant techniques in the processing and interpretation of ERTS-1 data

The discipline oriented investigations underway at the Johnson Space Center (JSC) using ERTS-1 data provide an appropriate framework for the systematic evaluation of the various elements comprising a prototype multispectral data processing and analysis system. In particular such a system may be thought of as the integration of: (1) a preprocessing subsystem; (2) a spectral clustering subsystem, (3) a correlation and classification subsystem; (4) mensuration subsystem; and (5) an information management subsystem. Specific elements of this system are already operational at JSC. It is in the context of this system that technique development and application is being pursued at JSC. Aircraft, ERTS and EREP data will be utilized to refine the subsystem elements for each of the data acquisition systems or system combinations that are optimally suited for a specific Earth Resources application. The techniques reported are those that have been developed to date during the utilization of ERTS-1 data in this processing and analysis system.

Cousin, S. B.↗

Mapping of terrain by computer clustering techniques using multispectral scanner data and using color aerial film

Two clustering techniques were used for terrain mapping by computer of test sites in Yellowstone National Park. One test was made with multispectral scanner data using a composite technique which consists of (1) a strictly sequential statistical clustering which is a sequential variance analysis, and (2) a generalized K-means clustering. In this composite technique, the output of (1) is a first approximation of the cluster centers. This is the input to (2) which consists of steps to improve the determination of cluster centers by iterative procedures. Another test was made using the three emulsion layers of color-infrared aerial film as a three-band spectrometer. Relative film densities were analyzed using a simple clustering technique in three-color space. Important advantages of the clustering technique over conventional supervised computer programs are (1) human intervention, preparation time, and manipulation of data are reduced, (2) the computer map, gives unbiased indication of where best to select the reference ground control data, (3) use of easy to obtain inexpensive film, and (4) the geometric distortions can be easily rectified by simple standard photogrammetric techniques.

Smedes, H. W.↗

Reducing the Volume of NASA Earth-Science Data

A computer program reduces data generated by NASA Earth-science missions into representative clusters characterized by centroids and membership information, thereby reducing the large volume of data to a level more amenable to analysis. The program effects an autonomous data-reduction/clustering process to produce a representative distribution and joint relationships of the data, without assuming a specific type of distribution and relationship and without resorting to domain-specific knowledge about the data. The program implements a combination of a data-reduction algorithm known as the entropy-constrained vector quantization (ECVQ) and an optimization algorithm known as the differential evolution (DE). The combination of algorithms generates the Pareto front of clustering solutions that presents the compromise between the quality of the reduced data and the degree of reduction. Similar prior data-reduction computer programs utilize only a clustering algorithm, the parameters of which are tuned manually by users. In the present program, autonomous optimization of the parameters by means of the DE supplants the manual tuning of the parameters. Thus, the program determines the best set of clustering solutions without human intervention.

Lee, Seungwon↗

An interactive Barnes objective map analysis scheme for use with satellite and conventional data

The Barnes (1973) objective map analysis scheme is employed to develop an interactive analysis package for assessing the impact of satellite-derived data on analyses of conventional meteorological data sets. The method permits modification of the values of input parameters in the objective analysis within objectively determined, internally set limits. The effects of the manipulations are rapidly displayed, and methods are included for assimilating the spatially clustered characteristics of satellite data and the various horizontal resolutions of the data types. Data sets from the SESAME rawinsonde wind data with uniform spatial distribution, with the same data set plus satellite cloud motion data, and a data set from the atmospheric sounder radiometer on the GOES satellite were analyzed as examples. The scheme is demonstrated to recover details after two iterations through the data.

Koch, S. E.↗

Analysis of Crystallization Kinetics

A realistic computer model for polymorphic crystallization (i.e., initial and final phases with identical compositions), which includes time-dependent nucleation and cluster-size-dependent growth rates, is developed and tested by fits to experimental data. Model calculations are used to assess the validity of two of the more common approaches for the analysis of crystallization data. The effects of particle size on transformation kinetics, important for the crystallization of many systems of limited dimension including thin films, fine powders, and nanoparticles, are examined.

Kelton, Kenneth F.↗

Multivariate statistical analysis software technologies for astrophysical research involving large data bases

We developed a package to process and analyze the data from the digital version of the Second Palomar Sky Survey. This system, called SKICAT, incorporates the latest in machine learning and expert systems software technology, in order to classify the detected objects objectively and uniformly, and facilitate handling of the enormous data sets from digital sky surveys and other sources. The system provides a powerful, integrated environment for the manipulation and scientific investigation of catalogs from virtually any source. It serves three principal functions: image catalog construction, catalog management, and catalog analysis. Through use of the GID3* Decision Tree artificial induction software, SKICAT automates the process of classifying objects within CCD and digitized plate images. To exploit these catalogs, the system also provides tools to merge them into a large, complete database which may be easily queried and modified when new data or better methods of calibrating or classifying become available. The most innovative feature of SKICAT is the facility it provides to experiment with and apply the latest in machine learning technology to the tasks of catalog construction and analysis. SKICAT provides a unique environment for implementing these tools for any number of future scientific purposes. Initial scientific verification and performance tests have been made using galaxy counts and measurements of galaxy clustering from small subsets of the survey data, and a search for very high redshift quasars. All of the tests were successful, and produced new and interesting scientific results. Attachments to this report give detailed accounts of the technical aspects for multivariate statistical analysis of small and moderate-size data sets, called STATPROG. The package was tested extensively on a number of real scientific applications, and has produced real, published results.

Djorgovski, S. George↗

Solar microwave millisecond spike at 2.84 GHz

Using the high time resolution of 1 ms, the data of solar microwave millisecond spike (MMS) event was recorded more than two hundred times at the frequency of 2.84 GHz at Beijing (Peking) Observatory since May 1981. A preliminary analysis was made. It can be seen from the data that the MMS-events have a variety of the fast activities such as the dispersed and isolated spikes, the clusters of the crowded spikes, the weak spikes superimposed on the noise background, and the phenomena of absorption. The marked differences from that observed with lower time resolution are presented. Using the data, a valuable statistical analysis was made. There are close correlations between MMS-events and hard X-ray bursts, and fast drifting bursts. The MMS events are highly dependent on the type of active regions and the magnetic field configuration. It seems to be crucial to find out the accurate positions on the active region where the MMS-events happen and to make co-operative observations at different bands during the special period when specific active regions appear on the solar disk.

Fu, Qi-Jun↗

CFD Based Computations of Flexible Helicopter Blades for Stability Analysis

As a collaborative effort among government aerospace research laboratories an advanced version of a widely used computational fluid dynamics code, OVERFLOW, was recently released. This latest version includes additions to model flexible rotating multiple blades. In this paper, the OVERFLOW code is applied to improve the accuracy of airload computations from the linear lifting line theory that uses displacements from beam model. Data transfers required at every revolution are managed through a Unix based script that runs jobs on large super-cluster computers. Results are demonstrated for the 4-bladed UH-60A helicopter. Deviations of computed data from flight data are evaluated. Fourier analysis post-processing that is suitable for aeroelastic stability computations are performed.

Guruswamy, Guru P.↗

Evaluation of SLAR and thematic mapper MSS data for forest cover mapping using computer-aided analysis techniques

Several possibilities were considered for defining the data set in which the same test areas could be used for each of the four different spatial resolutions being evaluated. The LARSYS CLUSTER was used to sort the vectors into spectral classes to reduce the within-spectral class variability in an effort to develop training statistics. A data quality test was written to determine the basic signal to noise characteristics within the data set being used. Because preliminary analysis of the LANDSAT MSS data revealed the presence of high cirrus clouds, other data sets are being sought.

Hoffer, R. M.↗

Data processing 1: Advancements in machine analysis of multispectral data

Multispectral data processing procedures are outlined beginning with the data display process used to accomplish data editing and proceeding through clustering, feature selection criterion for error probability estimation, and sample clustering and sample classification. The effective utilization of large quantities of remote sensing data by formulating a three stage sampling model for evaluation of crop acreage estimates represents an improvement in determining the cost benefit relationship associated with remote sensing technology.

Swain, P. H.↗

Notes for the improvement of the spatial and spectral data classification method

This report examines the spatial and spectral clustering technique for the unsupervised automatic classification and mapping of earth resources satellite data, and makes theoretical analysis of the decision rules and tests in order to suggest how the method might best be applied to other flight data such as Skylab and Spacelab.

Dalton, C. C.↗

Detection of soil erosion with Thematic Mapper (TM) satellite data within Pinyon-Juniper woodlands

Pinyon-Juniper woodlands dominate approximately 24.3 million hectares (60 million acres) in the western United States. The overall objective was to test the sensitivity of the LANDSAT Thematic Mapper (TM) spectral data for detecting varying degrees of soil erosion within the Pinyon-Juniper woodlands. A second objective was to assess the potential of the spectral data for assigning the Universal Soil Loss Equation (USLE) crop management (C) factor values to varying cover types within the woodland. Thematic Mapper digital data for June 2, 1984 on channels 2, 3, 4, and 5 were used. Digital data analysis was performed using the ELAS software package. Best results were achieved using CLUS, an unsupervised clustering algorithm. Fifteen of the 40 Pinyon-Juniper signatures were identified as being relatively pure Pinyon-Juniper woodland. Final analysis resulted in the grouping of the 15 signatures into three major groups. Ten study sites were selected from each of the three groups and located on the ground. At each site the following field measurements were taken: percent tree canopy and percent understory cover, soil texture, total soil loss, and soil erosion rate estimates. A technique for measuring soil erosion within Pinyon-Juniper woodlands was developed. A theoretical model of site degradation after Pinyon-Juniper invasion is presented.

Price, Kevin Paul↗

Gamma Ray Emission from Chaotic Winds of Massive Stars

The purpose of this proposal was to search for gamma-ray emission from the winds of hot, massive stars. According to our theoretical calculations, shocks in the winds of massive stars accelerate particles to high energies. The high-energy particles emit synchrotron radio emission (observed by ground-based radio telescopes) and high-energy gamma-ray emission that we predicted should be detectable by the EGRET instrument on the Compton Gamma Ray Observatory between 100 MeV and a few GeV. We obtained EGRET from phases 1, 2, and 3 of the Cygnus OB2 association, a cluster of massive, young stars, to search for this gamma-ray emission. The data products and analysis show a source consistent with the position of Cyg OB2 with approximately the predicted count rate and spectrum.

White, Richard L.↗

Scraping Unstructured Data to Explore the Relationship between Rainfall Anomalies and Vector-Borne Disease Outbreaks

According to the World Health Organization (WHO), vector-borne diseases such as malaria and dengue account for 17% of all infectious disease cases and lead to more than 700,000 deaths per year. Tracking and predicting the spread of vector-borne diseases is a vital task that could save hundreds of thousands of lives annually. Oftentimes, the first reports of vector-borne disease outbreaks occur through emails and online reporting systems long before they are officially documented. Tracking and predicting the emergence and spread of vector-borne disease outbreaks requires extracting data from these unstructured sources in combination with historical weather and climate data to understand the underlying background triggers and disease dynamics. In this work, we develop a data extraction pipeline for the online outbreak reporting website ProMED-mail that utilizes a web scraper, transformer neural network summarizer, and named entity recognizer to obtain a dataset of malaria, dengue, zika, and chikungunya outbreaks over the last 30 years. This scraped dataset was further analyzed in association with global rainfall anomalies derived from NASA’s Integrated Multi-satellitE Retrievals for GPM [Global Precipitation Mission] (IMERG) dataset. This preliminary analysis was to understand the effect of global rainfall patterns on the spread of vector-borne diseases. Analysis of the ProMED-mail and GPM data shows that vector-borne disease outbreaks are clustered towards the tropics and outbreaks are often amplified during the rainy seasons. Our scraped dataset can be a valuable tool in creating comprehensive georeferenced disease records for modeling and predicting future outbreaks.

Web scraping↗

Lightning Strike Distance Distribution Beyond a Preexisting Lightning Area

The 45th Weather Squadron (45 WS) asked the Applied Meteorology Unit (AMU) to review the 30-year-old, lightning stand-off distances of 5 nautical miles (nmi) for applicability to today's operations. This was based on the realization that previous lightning strike distance studies did not match how 45 WS issues lightning warnings (Roeder, 2008). The previous lightning distance studies were from the point of origin of the lightning or the average starting location that would tend to be in the core of the thunderstorm. However, the 45 WS issues lightning warnings based on the edge of a preexisting lightning area. Before beginning the AMU project, it took several years to develop a method to calculate a distance distribution beyond a preexisting area (Roeder, 2015). The AMU pulled Lightning Detection and Ranging (LDAR) sensor data from 1/1/2013 to 12/31/2013. This dataset consisted of 37 million individual source data points from the LDAR sensors. Only sources within 50 km north, south, east or west of the LDAR grid center were included in the dataset. This limited the use of LDAR data to that with the greatest accuracy of source detection and increased data processing. Points were grouped into flashes based on spatial and temporal criteria. Based on the sensitivity analysis the AMU performed on the flash clustering algorithm, a time value of 0.3 seconds was found to model flashes adequately. Distance parameters were tested from 1,500 to 7,500 meters (m) in 500 m increments. Distance parameters of both 3,000 m and 4,000 m produced results in the plotting tool that were most representative of the physical behavior of lightning. Thus statistics were gathered for the most representative of these spatial and temporal criteria on the flash size and the polygon expansion distance in order to find the correct data distributions. The best fit curves for the LDAR polygon expansion frequency vs. distances for both the 3 kilometer (km) and 4 km distance threshold values were exponential decay functions and had R2 values of > 0.998, indicating good model fits. The equations of the best fit curves were then used to calculate a desired safety radius of 4 nmi for either 3 km or 4 km distance threshold criteria. The AMU analysis concludes the safe reduction of the 5 nmi lightning warning circles to 4 nmi should improve the operational impact by 36% if based on distance from the center of the property area being protected. If based on the edge of the property being protected, then the reduction is 4.5 nmi to 4 nmi and the operational impact is decreased by 21%. For the 6 nmi lightning warning circles, the recommended 4 nmi stand-off distance will result in a safe reduction of operational impact of 31% if based on the center of the area being protected, or 16% if based on the edge of the property.

Flash clustering algorithm↗

Analysis of data on absorption in the northern part of the milky way

The values of absorption for different galactic longitudes are obtained on the basis of star cluster data. It is found that the distance up to the point, where the straightening of the absorption distribution curve begins, depends on the limiting magnitude of the catalogue and the density of absorbing matter near the sun. The picture of absorbing matter distribution in the northern part of the Milky Way is given.

Polishchuk, E. P.↗