SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

NASA NTRS2004

Using Fuzzy Clustering for Real-time Space Flight Safety

To ensure space flight safety, it is necessary to monitor myriad sensor readings on the ground and in flight. Since a space shuttle has many sensors, monitoring data and drawing conclusions from information contained within the data in real time is challenging. The nature of the information can be critical to the success of the mission and safety of the crew and therefore, must be processed with minimal data-processing time. Data analysis algorithms could be used to synthesize sensor readings and compare data associated with normal operation with the data obtained that contain fault patterns to draw conclusions. Detecting abnormal operation during early stages in the transition from safe to unsafe operation requires a large amount of historical data that can be categorized into different classes (non-risk, risk). Even though the 40 years of shuttle flight program has accumulated volumes of historical data, these data don t comprehensively represent all possible fault patterns since fault patterns are usually unknown before the fault occurs. This paper presents a method that uses a similarity measure between fuzzy clusters to detect possible faults in real time. A clustering technique based on a fuzzy equivalence relation is used to characterize temporal data. Data collected during an initial time period are separated into clusters. These clusters are characterized by their centroids. Clusters formed during subsequent time periods are either merged with an existing cluster or added to the cluster list. The resulting list of cluster centroids, called a cluster group, characterizes the behavior of a particular set of temporal data. The degree to which new clusters formed in a subsequent time period are similar to the cluster group is characterized by a similarity measure, q. This method is applied to downlink data from Columbia flights. The results show that this technique can detect an unexpected fault that has not been present in the training data set.

Lee, Charles↗

NASA NTRS1974

Cluster analysis based on dimensional information with applications to feature selection and classification

A new clustering algorithm is presented that is based on dimensional information. The algorithm includes an inherent feature selection criterion, which is discussed. Further, a heuristic method for choosing the proper number of intervals for a frequency distribution histogram, a feature necessary for the algorithm, is presented. The algorithm, although usable as a stand-alone clustering technique, is then utilized as a global approximator. Local clustering techniques and configuration of a global-local scheme are discussed, and finally the complete global-local and feature selector configuration is shown in application to a real-time adaptive classification scheme for the analysis of remote sensed multispectral scanner data.

Eigen, D. J.↗

NASA NTRS1981

Raingage network sampling statistics

Sampling problems raise large difficulties for the precipitation measurements from space. In the tropics rainfall processes are organized in scales which are hardly resolved by the microwave radiometers on board of satellites. Even in the cloud clusters, which mark significant, large extended signals in the visible and infrared images, the precipitation areas cover only a small region. Our analysis of the cloud clusters over the W Pacific Ocean revealed that more than 50% of the area of a typical Western Pacific cluster are without rain. The radar observations during GATE generally confirmed those results. The rainfall was calculated from Nimbus V microwave data at 19.35 GHz and the results were compared with the GATE radar rainfall. The results are improved if the rain areas within the field of view are determined by additional observations and lead to a correction of the microwave brightness temperature.

Vogel, J. L.↗

NASA NTRS2000

Real Time Intelligent Target Detection and Analysis with Machine Vision

We present an algorithm for detecting a specified set of targets for an Automatic Target Recognition (ATR) application. ATR involves processing images for detecting, classifying, and tracking targets embedded in a background scene. We address the problem of discriminating between targets and nontarget objects in a scene by evaluating 40x40 image blocks belonging to an image. Each image block is first projected onto a set of templates specifically designed to separate images of targets embedded in a typical background scene from those background images without targets. These filters are found using directed principal component analysis which maximally separates the two groups. The projected images are then clustered into one of n classes based on a minimum distance to a set of n cluster prototypes. These cluster prototypes have previously been identified using a modified clustering algorithm based on prior sensed data. Each projected image pattern is then fed into the associated cluster's trained neural network for classification. A detailed description of our algorithm will be given in this paper. We outline our methodology for designing the templates, describe our modified clustering algorithm, and provide details on the neural network classifiers. Evaluation of the overall algorithm demonstrates that our detection rates approach 96% with a false positive rate of less than 0.03%.

Howard, Ayanna↗

NASA NTRS2021

A Multiwavelength Dynamical State Analysis of ACT-CLJ0019.6+0336

In our study, we show a multiwavelength view of ACT-CL J0019.6+0336 (which hosts aradio halo), to investigate the cluster dynamics, morphology, and ICM. We use a combination ofXMM-Newton images, Dark Energy Survey (DES) imaging and photometry, SDSS spectroscopicinformation, and 1.16 GHz MeerKAT data to study the cluster properties. Various X-ray and opticalmorphology parameters are calculated to investigate the level of disturbance. We find disturbancesin two X-ray parameters and the optical density map shows elongated and axisymmetric structureswith the main cluster component southeast of the cluster centre and another component northwest ofthe cluster centre. We also find a BCG offset of∼950 km/s from the mean velocity of the cluster, anda discrepancy between the SZ mass, X-ray mass, and dynamical mass (MX,500andMSZ,500lies>3σaway fromMdyn,500), showing that J0019 is a merging cluster and probably in a post-merging phase.

Denisha S Pillay↗

NASA NTRSDate not supplied

NASA’s Prototype Spectral Water Inversion Processor and Emulator (SWIPE): Towards Global Coastal and Inland Water Quality and Algal Biodiversity Monitoring

Degradation of Earth’s inland water resources due to anthropogenic perturbations and climate anomalies at both local and global scales continues to place human health at substantial risk. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will provide updates on NASA’s prototype open-source aquatic modeling platform, Spectral Water Inversion Processor and Emulator (SWIPE), which is a comprehensive, multi-faceted modeling platform for both forward and inverse modeling of diverse aquatic ecosystems from the benthos to top-of-atmosphere (TOA). SWIPE provides a cohesive application which leverages recent advancements in particle modeling, Big Data analytics, and machine learning to develop a high-fidelity synthetic training ground for sensitivity studies and algorithm development for multispectral or upcoming hyperspectral missions. Some of the prominent features of SWIPE to be discussed include: 1. Advanced hyperspectral modeling of globally diverse algal and non-algal particles using a novel two-layer coated sphere scattering model and radiative transfer modeling, 2. Massive, highly detailed synthetic spectral libraries of Analysis-Ready-Data (ARD) which include spectral libraries of particle microphysics, water biogeophysical and optical properties, as well as surface and TOA reflectances at 1 nm resolution, 3. An ensemble of pre-built analytic, machine learning, and deep learning inversion algorithms for various water quality and biodiversity related retrieval parameters and uncertainty quantification, 4. Sensor-agnostic water quality inversion at wide ranging spatial and spectral resolutions including a codebase for seamless application in the Google Earth Engine and NASA Earth Exchange (NEX) for planetary scale analysis. SWIPE will be a fully open-source platform based in python with comprehensive documentation, tutorials, and options for distributed computing on high performance computing clusters or on single, local machines. Further, we will discuss how we envision SWIPE contributing towards a global analysis of coastal and inland water quality dynamics.

top-of-atmosphere (TOA)↗

NASA NTRS2003

Karhunen-Loeve Estimation of the Power Spectrum Parameters from the Angular Distribution of Galaxies in Early Sloan Digital Sky Survey Data

We present measurements of parameters of the three-dimensional power spectrum of galaxy clustering from 222 square degrees of early imaging data in the Sloan Digital Sky Survey (SDSS). The projected galaxy distribution on the sky is expanded over a set of Karhunen-Loeve (KL) eigenfunctions, which optimize the signal-to-noise ratio in our analysis. A maximum likelihood analysis is used to estimate parameters that set the shape and amplitude of the three-dimensional power spectrum of galaxies in the SDSS magnitude-limited sample with r* less than 21. Our best estimates are gamma = 0.188 +/- 0.04 and sigma(sub 8L) = 0.915 +/- 0.06 (statistical errors only), for a flat universe with a cosmological constant. We demonstrate that our measurements contain signal from scales at or beyond the peak of the three-dimensional power spectrum. We discuss how the results scale with systematic uncertainties, like the radial selection function. We find that the central values satisfy the analytically estimated scaling relation. We have also explored the effects of evolutionary corrections, various truncations of the KL basis, seeing, sample size, and limiting magnitude. We find that the impact of most of these uncertainties stay within the 2 sigma uncertainties of our fiducial result.

Szalay, Alexander S.↗

NASA NTRS2020

The Next Generation of L Band Radiometry: User’s Requirements and Technical Solutions

After almost 10 years in operation (SMOS- Aquarius - SMAP) the very high potential of L band radiometry is clearly demonstrated. Several applications are already operational (assimilation at ECMWF, for hurricanes, for sea ice etc.) so it is crucial to maintain such measurements. To do so while satisfying the current missions specifications is also of prime importance. Degrading spatial resolution is thus a significant step back which will impact science and applications). These missions are now getting older and the goal of the study presented in this paper is to assess which planned mission could fulfill the requirements to ensure data continuity. For this purpose, an extensive users’ requirements study was performed in 2018-2019 assessing what would be required in the near future as well as when L band radiometry was absolutely necessary to satisfy the requirements. From the gathered results a cluster analysis was performed and the only.

Yann H Kerr↗

NASA NTRS2014

Acoustic Data Processing and Transient Signal Analysis for the Hybrid Wing Body 14- by 22-Foot Subsonic Wind Tunnel Test

An advanced vehicle concept, the HWB N2A-EXTE aircraft design, was tested in NASA Langley's 14- by 22-Foot Subsonic Wind Tunnel to study its acoustic characteristics for var- ious propulsion system installation and airframe con gurations. A signi cant upgrade to existing data processing systems was implemented, with a focus on portability and a re- duction in turnaround time. These requirements were met by updating codes originally written for a cluster environment and transferring them to a local workstation while en- abling GPU computing. Post-test, additional processing of the time series was required to remove transient hydrodynamic gusts from some of the microphone time series. A novel automated procedure was developed to analyze and reject contaminated blocks of data, under the assumption that the desired acoustic signal of interest was a band-limited sta- tionary random process, and of lower variance than the hydrodynamic contamination. The procedure is shown to successfully identify and remove contaminated blocks of data and retain the desired acoustic signal. Additional corrections to the data, mainly background subtraction, shear layer refraction calculations, atmospheric attenuation and microphone directivity corrections, were all necessary for initial analysis and noise assessments. These were implemented for the post-processing of spectral data, and are shown to behave as expected.

Bahr, Christopher J.↗

NASA NTRS1999

Dependence of Cumulus Anvil Radiative Properties on Environmental Conditions in the Tropical West Pacific

Areally extensive, optically thick anvil clouds associated with mesoscale convective clusters dominate the shortwave cloud forcing in the tropics and provide longwave forcing comparable to that of thin cirrus. Changes in the cover and optical thickness of tropical anvils as climate warms can regulate the sign of cloud feedback. As a prelude to the study of MMCR data from the ARM TWP sites, we analyze ISCCP-derived radiative characteristics of anvils observed in the tropical west Pacific during the TOGA-COARE IOP. Anvils with radius greater than 100 km were identified and tracked from inception to decay using the Machado-Rossow algorithm. Corresponding environmental conditions just prior to the start of the convectove event were diagnosed using the Lin-Johnson objective analysis product. Small clusters (100-200 km radius) are observed to have a broad range of optical thicknesses (10-50), while intermediate optical thickness clusters are observed to range in size from 100 km to almost 1000 km. Large-size clusters appear to be favored by strong pre-storm large scale upward motion throughout the troposphere, moist low-to-midlevel relative humidities, environments with slightly higher CAPE than those for smaller clusters, and strong front-to-rear flow. Optically thick anvils are favored in situations of strong low-level moisture convergence and strong upper-level shear.

Ye, B.↗

NASA NTRS2017

Classification of Meteorological Influences Surrounding Extreme Precipitation Events in the United States using the MERRA-2 Reanalysis

Extreme precipitation events can have a large impact on society through flooding that can result in property destruction, crop losses, economic losses, the spread of water-borne diseases, and fatalities. Observations indicate there has been a statistically significant increase in extreme precipitation events over the past 15 years in the Northeastern United States and other localized regions of the country have become crippled with record flooding events, for example, the flooding that occurred in the Southeast United States associated with Hurricane Matthew in October 2016. Extreme precipitation events in the United States can be caused by various meteorological influences such as extratropical cyclones, tropical cyclones, mesoscale convective complexes, general air mass thunderstorms, upslope flow, fronts, and the North American Monsoon. Reanalyses, such as the Modern Era Retrospective Analysis for Research and Applications, version 2 (MERRA-2), have become a pivotal tool to study the meteorology surrounding extreme precipitation events. Using days classified as an extreme precipitation events based on a combination of observational gauge and radar data, two techniques for the classification of these events are used to gather additional information that can be used to determine how events have changed over time using atmospheric data from MERRA-2. The first is self organizing maps, which is an artificial neural network that uses unsupervised learning to cluster like patterns and the second is an automated detection technique that searches for characteristics in the atmosphere that define a meteorological phenomena. For example, the automated detection for tropical cycles searches for a defined area of suppressed sea level pressure, alongside thickness anomalies aloft, indicating the presence of a warm core. These techniques are employed for extreme precipitation events in preselected regions that were chosen based an analysis of the climatology of precipitation.

Monsoon↗

NASA NTRS2004

More Far-Side Deep Moonquake Nests Discovered

As reported last year, we started to reanalyze the seismic data acquired from 1969 to 1977 with a network of stations established on the Moon during the Apollo mission. The reason for the reanalysis was because recent advances in computer technology make it possible to employ much more sophisticated analysis techniques than was possible previously. The primary objective of the reanalysis was to search for deep moonquakes on the far side of the Moon and, if found, to use them to infer the structure of the Moon's deep interior, including a possible central core. The first step was to identify any new deep moonquakes that escaped our earlier search by applying a combination of waveform cross-correlation and single-link cluster analysis, and then to see if any of them are from previously unknown nests of deep moonquakes. We positively identified 7245 deep moonquakes, more than a five-fold increase from the previous 1360. We also found at least 88 previously unknown deep-moonquake nests. The question was whether any of these newly discovered nets were on the far side of the Moon, and we now report that our analysis of the data indicates that some of them are indeed on the far side.

Nakamura, Y.↗

NASA NTRS1983

Image processing in remote sensing data analysis - The state of the art

Image analysis techniques applicable to remote sensing data and covering image models, feature detection, segmentation and classification, texture analysis, and matching are studied. Model types for characterizing images examined include random-field, mosaic, and facet models. Edge and corner detection as well as global extraction of linear features are discussed. Pixel clustering and classification are covered in addition to the regional approach to segmentation. Autocorrelation, second-order gray level probability density, and the use of primitive element statistics are discussed in relation to texture analysis. Finally, reducing the cost of (sub)imaging matching methods (e.g., pixelwise comparison of gray levels and normalized cross-correlation between two images) as well as improving match sharpness is considered.

Rosenfeld, A.↗

NASA NTRS1991

Fusion of monocular cues to detect man-made structures in aerial imagery

The extraction of buildings from aerial imagery is a complex problem for automated computer vision. It requires locating regions in a scene that possess properties distinguishing them as man-made objects as opposed to naturally occurring terrain features. It is reasonable to assume that no single detection method can correctly delineate or verify buildings in every scene. A cooperative-methods paradigm is useful in approaching the building extraction problem. Using this paradigm, each extraction technique provides information which can be added or assimilated into an overall interpretation of the scene. Thus, the main objective is to explore the development of computer vision system that integrates the results of various scene analysis techniques into an accurate and robust interpretation of the underlying three dimensional scene. The problem of building hypothesis fusion in aerial imagery is discussed. Building extraction techniques are briefly surveyed, including four building extraction, verification, and clustering systems. A method for fusing the symbolic data generated by these systems is described, and applied to monocular image and stereo image data sets. Evaluation methods for the fusion results are described, and the fusion results are analyzed using these methods.

Shufelt, Jefferey↗

NASA NTRS1993

Automatic definition of spectral units in the equatorial regions of Mars

ISM was the first instrument that acquired spectra of small areas (25x25 sq km) on a planetary surface. The data set consists mainly in images made up of about 3000 such pixels, each one corresponding to a near-infrared spectrum (0.76 to 3.15 microns in 128 spectral channels) with high signal-to-noise ratio. These data were used to define spectral units and to constrain the mineralogy of surface materials in the equatorial regions of the planet. Future spaceborne imaging spectrometers (e.g. OMEGA on board the Mars-94 Russian spacecraft) are expected to provide several hundred times as much data as ISM, so there's a strong need for fast and reliable processing methods. The present work is an attempt to define spectral units in the region of Syrtis Major-Isidis Planitia by means of G-mode analysis. The method allows to cluster the spectra according to their similarities; different levels of classification can be achieved by tuning a threshold of confidence.

Erard, Stephane↗

NASA NTRS2006

Hera - The HEASARC's New Data Analysis Service

Hera is the new computer service provided by the HEASARC at the NASA Goddard Space Flight Center that enables qualified student and professional astronomical researchers to immediately begin analyzing scientific data from high-energy astrophysics missions. All the necessary resources needed to do the data analysis are freely provided by Hera, including: * the latest version of the hundreds of scientific analysis programs in the HEASARC's HEASOFT package, as well as most of the programs in the Chandra CIAO package and the XMM-Newton SAS package. * high speed access to the terabytes of data in the HEASARC's high energy astrophysics Browse data archive. * a cluster of fast Linw workstations to run the software * ample local disk space to temporarily store the data and results. Some of the many features and different modes of using Hera are illustrated in this poster presentation.

Pence, William↗

NASA NTRS2006

Image-Subtraction Photometry of Variable Stars in the Globular Clusters NGC 6388 and NGC 6441

We have applied Alard's image subtraction method (ISIS v2.1) to the observations of the globular clusters NGC 6388 and NGC 6441 previously analyzed using standard photometric techniques (DAOPHOT, ALLFRAME). In this reanalysis of observations obtained at CTIO, besides recovering the variables previously detected on the basis of our ground-based images, we have also been able to recover most of the RR Lyrae variables previously detected only in the analysis of Hubble Space Telescope WFPC2 observations of the inner region of NGC 6441. In addition, we report five possible new variables not found in the analysis of the EST observations of NGC 6441. This dramatically illustrates the capabilities of image subtraction techniques applied to ground-based data to recover variables in extremely crowded fields. We have also detected twelve new variables and six possible variables in NGC 6388 not found in our previous groundbased studies. Revised mean periods for RRab stars in NGC 6388 and NGC 6441 are 0.676 day and 0.756 day, respectively. These values are among the largest known for any galactic globular cluster. Additional probable type II Cepheids were identified in NGC 6388, confirming its status as a metal-rich globular cluster rich in Cepheids.

Corwin, Michael T.↗

NASA NTRS1987

Evaluation of several classification schemes for mapping forest cover types in Michigan

Landsat MSS data were evaluated for mapping forest cover types in the northern Lower Peninsula of Michigan. The study examined seasonal variations, interpretation procedures and vegetation composition/distribution and their effect on overall classification accuracy and ability to identify individual pine species. Photographic images were used for visual interpretations while digital analysis was performed using a common (ERDAS) microcomputer image processing system. The classification schemes were evaluated using contingency tables and were ranked using the KAPPA statistic. The various classification schemes were ranked differentially according to study site location. Visual interpretation procedures ranked best, or least accurate, depending on the spatial distribution and complexity of the forest cover. Supervised classification techniques were more accurate than unsupervised clustering over all sites and seasons. Maximum likelihood classification of June data was superior to any digital classification technique of February data. The study indicates that classification accuracy is more dependent on the composition and distribution of forests in the northern lower Peninsula of Michigan than on the selection of a particular classification scheme.

Hudson, W. D.↗