Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “unsupervised classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS2005

Techniques for Producing Coastal Land Water Masks from Landsat and Other Multispectral Satellite Data

Coastal erosion and land loss continue to threaten many areas in the United States. Landsat data has been used to monitor regional coastal change since the 1970s. Many techniques can be used to produce coastal land water masks, including image classification and density slicing of individual bands or of band ratios. Band ratios used in land water detection include several variations of the Normalized Difference Water Index (NDWI). This poster discusses a study that compares land water masks computed from unsupervised Landsat image classification with masks from density-sliced band ratios and from the Landsat TM band 5. The greater New Orleans area is employed in this study, due to its abundance of coastal habitats and its vulnerability to coastal land loss. Image classification produced the best results based on visual comparison to higher resolution satellite and aerial image displays. However, density sliced NDWI imagery from either near infrared (NIR) and blue bands or from NIR and green bands also produced more effective land water masks than imagery from the density-sliced Landsat TM band 5. NDWI based on NIR and green bands is noteworthy because it allows land water masks to be generated from multispectral satellite sensors without a blue band (e.g., ASTER and Landsat MSS). NDWI techniques also have potential for producing land water masks from coarser scaled satellite data, such as MODIS.

Spruce, Joseph P.↗
NASA NTRS2005

Techniques for Producing Coastal Land Water Masks from Landsat and Other Multispectral Satellite Data

Coastal erosion and land loss continue to threaten many areas in the United States. Landsat data has been used to monitor regional coastal change since the 1970's. Many techniques can be used to produce coastal land water masks, including image classification and density slicing of individual bands or of band ratios. Band ratios used in land water detection include several variations of the Normalized Difference Water Index (NDWI). This poster discusses a study that compares land water masks computed from unsupervised Landsat image classification with masks from density-sliced band ratios and from the Landsat TM band 5. The greater New Orleans area is imployed in this study, due to its abundance of coastal habitats and ist vulnerability to coastal land loss. Image classification produced the best results based on visual comparison to higher resolution satellite and aerial image displays. However, density-sliced NDWI imagery from either near infrared (NIR) and blue bands or from NIR and green bands also produced more effective land water masks than imagery from the density-sliced Landsat TM band 5. NDWI based on NIR and green bands is noteworthy because it allows land water masks to be generated form multispectral satellite sensors without a blue band (e.g., ASTER and Landsat MSS). NDWI techniques also have potential for producing land water masks from coarser scaled satellite data, such as MODIS.

Spruce, Joe↗
NASA NTRS2011

Clonal Selection Based Artificial Immune System for Generalized Pattern Recognition

The last two decades has seen a rapid increase in the application of AIS (Artificial Immune Systems) modeled after the human immune system to a wide range of areas including network intrusion detection, job shop scheduling, classification, pattern recognition, and robot control. JPL (Jet Propulsion Laboratory) has developed an integrated pattern recognition/classification system called AISLE (Artificial Immune System for Learning and Exploration) based on biologically inspired models of B-cell dynamics in the immune system. When used for unsupervised or supervised classification, the method scales linearly with the number of dimensions, has performance that is relatively independent of the total size of the dataset, and has been shown to perform as well as traditional clustering methods. When used for pattern recognition, the method efficiently isolates the appropriate matches in the data set. The paper presents the underlying structure of AISLE and the results from a number of experimental studies.

pattern recognition↗
NASA NTRS1981

Multiresource analysis and information system concepts for incorporating LANDSAT and GIS technology into large area forest surveys

A method of relating different classifications at each stage of a multistage, multiresource inventory using remotely sensed imagery is discussed. A class transformation matrix allowing the conversion of a set of proportions at one stage, to a set of proportions at the subsequent stage through use of a linear model, is described. The technique was tested by applying it to Kershaw County, South Carolina. Unsupervised LANDSAT spectral classifications were correlated with interpretations of land use aerial photography, the correlations employed to estimate land use classifications using the linear model, and the land use proportions used to stratify current annual increment (CAI) field plot data to obtain a total CAI for the county. The estimate differed by 1% from the published figure for land use. Potential sediment loss and a variety of land use classifications were also obtained.

Langley, P. G.↗
DOE OSTI2024

Identifying Climate Patterns Using Clustering Autoencoder Techniques

Abstract The complexity of growing spatiotemporal resolution of climate simulations produces a variety of climate patterns under different projection scenarios. This paper proposes a new data-driven climate classification workflow via an unsupervised deep learning technique that can dimensionally reduce the vast volume of spatiotemporal numerical climate projection data into a compact representation. We aim to identify distinct zones that capture multiple climate variables as well as their future changes under different climate change scenarios. Our approach leverages convolutional autoencoders combined with k -means clustering (standard autoencoder) and online clustering based on the Sinkhorn–Knopp algorithm (clustering autoencoder) across the conterminous United States (CONUS) to capture unique climate patterns in a data-driven fashion from the Geophysical Fluid Dynamics Laboratory Earth System Model with GOLD component (GFDL-ESM2G). The developed approach compresses 70 years of GFDL-ESM2G simulation at 0.125° spatial resolution across the CONUS under multiple warming scenarios to a lower-dimensional space by a factor of 660 000 and then tested on 150 years of GFDL-ESM2G simulation data. The results show that five climate clusters capture physically reasonable and spatially stable climatological patterns matched to known climate classes defined by human experts. Results also show that using a clustering autoencoder can reduce the computational time for clustering by up to 9.2 times when compared to using a standard autoencoder. Our five unique climate patterns resulting from the deep learning–based clustering of the lower-dimensional space thereby enable us to provide insights on hydrometeorology and its spatial heterogeneity across the conterminous United States immediately without downloading large climate datasets. Significance Statement This paper presents a data-driven climate classification approach using unsupervised deep learning to dimensionally reduce climate model outputs and to identify distinct climate regions for their future changes. Our approach compresses climate information for 70 years of Geophysical Fluid Dynamics Laboratory Earth System Model data across the conterminous United States (CONUS) at 0.125° spatial resolution. The results reveal that five climate clusters capture reasonable and stable climatological patterns matched to known climate patterns. The embedded clustering process in deep learning provides ×9.2 times faster execution than the k -means clustering technique. These results give us insight about climate spatial patterns and heterogeneity of hydrological patterns across the conterminous United States without downloading large climate datasets.

Kurihana, Takuya↗
DOE OSTI2020

Advancing Fusion with Machine Learning Research Needs Workshop Report

Abstract Machine learning and artificial intelligence (ML/AI) methods have been used successfully in recent years to solve problems in many areas, including image recognition, unsupervised and supervised classification, game-playing, system identification and prediction, and autonomous vehicle control. Data-driven machine learning methods have also been applied to fusion energy research for over 2 decades, including significant advances in the areas of disruption prediction, surrogate model generation, and experimental planning. The advent of powerful and dedicated computers specialized for large-scale parallel computation, as well as advances in statistical inference algorithms, have greatly enhanced the capabilities of these computational approaches to extract scientific knowledge and bridge gaps between theoretical models and practical implementations. Large-scale commercial success of various ML/AI applications in recent years, including robotics, industrial processes, online image recognition, financial system prediction, and autonomous vehicles, have further demonstrated the potential for data-driven methods to produce dramatic transformations in many fields. These advances, along with the urgency of need to bridge key gaps in knowledge for design and operation of reactors such as ITER, have driven planned expansion of efforts in ML/AI within the US government and around the world. The Department of Energy (DOE) Office of Science programs in Fusion Energy Sciences (FES) and Advanced Scientific Computing Research (ASCR) have organized several activities to identify best strategies and approaches for applying ML/AI methods to fusion energy research. This paper describes the results of a joint FES/ASCR DOE-sponsored Research Needs Workshop on Advancing Fusion with Machine Learning, held April 30–May 2, 2019, in Gaithersburg, MD (full report available at https://science.osti.gov/-/media/fes/pdf/workshop-reports/FES_ASCR_Machine_Learning_Report.pdf ). The workshop drew on broad representation from both FES and ASCR scientific communities, and identified seven Priority Research Opportunities (PRO’s) with high potential for advancing fusion energy. In addition to the PRO topics themselves, the workshop identified research guidelines to maximize the effectiveness of ML/AI methods in fusion energy science, which include focusing on uncertainty quantification, methods for quantifying regions of validity of models and algorithms, and applying highly integrated teams of ML/AI mathematicians, computer scientists, and fusion energy scientists with domain expertise in the relevant areas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1972

Investigation using data in Alabama from ERTS-A

There are no author-identified significant results in this report. Brief summaries are presented of accomplishments by the state of Alabama in the areas of: (1) investigation of environmental factors; (2) land use compilation; (3) data processing for land use compilation; (4) photo-reproduction and unsupervised land use classification from digital tape; (5) data collection buoys; and (6) activities of the Geological Survey of Alabama.

Henry, H. R.↗
NASA NTRS1982

Classification of simulated and actual NOAA-6 AVHRR data for hydrologic land-surface feature definition

An examination of the possibilities of using Landsat data to simulate NOAA-6 Advanced Very High Resolution Radiometer (AVHRR) data on two channels, as well as using actual NOAA-6 imagery, for large-scale hydrological studies is presented. A running average was obtained of 18 consecutive pixels of 1 km resolution taken by the Landsat scanners were scaled up to 8-bit data and investigated for different gray levels. AVHRR data comprising five channels of 10-bit, band-interleaved information covering 10 deg latitude were analyzed and a suitable pixel grid was chosen for comparison with the Landsat data in a supervised classification format, an unsupervised mode, and with ground truth. Landcover delineation was explored by removing snow, water, and cloud features from the cluster analysis, and resulted in less than 10% difference. Low resolution large-scale data was determined useful for characterizing some landcover features if weekly and/or monthly updates are maintained.

Ormsby, J. P.↗
NASA NTRS1981

Monitoring land conversions from forest/wetland to agriculture

The utility of LANDSAT data in monitoring largescale land clearance and drainage activities in a forest/wetland environment in northern Minnesota was investigated. LANDSAT tapes from 1973, 1978 and 1980 were used in a multitemporal unsupervised land cover classification of the 9 x 15 mile site. Results show quite clearly and in a cost-effective manner, where the greatest activity occurred. It was also possible to integrate the LANDSAT data with other data available through the Land Management Information Center's geographic information system.

Dudding, M. L.↗
NASA NTRS1981

Mapping sand and gravel pits in the Patuxent River watershed

LANDSAT data from July 1973 and June 1978 for the Patuxent River Watershed of Maryland were processed in an effort to devise an economical method of monitoring the reclamation of sand and gravel pits. ASTEP-II and IDIMS software were utilized to derive signatures for sand and gravel pits and other land use/land cover types. Both unsupervised and supervised classifications of the two data sets were produced. Resultant statistics and color output products were compared in order to determine the extent of reclamation and expansion of sand and gravel pits over the five-year time span and to check the locations of more recent sand and gravel pits. Preliminary results indicate that, for a selected northern sub-acre, signatures derived for sand and gravel pits were nearly 90 percent accurate.

Schmidt, T. J.↗
NASA NTRS1988

Cloud classification from satellite data using a fuzzy sets algorithm: A polar example

Where spatial boundaries between phenomena are diffuse, classification methods which construct mutually exclusive clusters seem inappropriate. The Fuzzy c-means (FCM) algorithm assigns each observation to all clusters, with membership values as a function of distance to the cluster center. The FCM algorithm is applied to AVHRR data for the purpose of classifying polar clouds and surfaces. Careful analysis of the fuzzy sets can provide information on which spectral channels are best suited to the classification of particular features, and can help determine likely areas of misclassification. General agreement in the resulting classes and cloud fraction was found between the FCM algorithm, a manual classification, and an unsupervised maximum likelihood classifier.

Key, J. R.↗
NASA NTRS1989

Cloud classification from satellite data using a fuzzy sets algorithm - A polar example

Where spatial boundaries between phenomena are diffuse, classification methods which construct mutually exclusive clusters seem inappropriate. The Fuzzy c-means (FCM) algorithm assigns each observation to all clusters, with membership values as a function of distance to the cluster center. The FCM algorithm is applied to AVHRR data for the purpose of classifying polar clouds and surfaces. Careful analysis of the fuzzy sets can provide information on which spectral channels are best suited to the classification of particular features, and can help determine like areas of misclassification. General agreement in the resulting classes and cloud fraction was found between the FCM algorithm, a manual classification, and an unsupervised maximum likelihood classifier.

Key, J. R.↗
DOE OSTI2022

Classification of Photovoltaic Failures with Hidden Markov Modeling, an Unsupervised Statistical Approach

Failure detection methods are of significant interest for photovoltaic (PV) site operators to help reduce gaps between expected and observed energy generation. Current approaches for field-based fault detection, however, rely on multiple data inputs and can suffer from interpretability issues. In contrast, this work offers an unsupervised statistical approach that leverages hidden Markov models (HMM) to identify failures occurring at PV sites. Using performance index data from 104 sites across the United States, individual PV-HMM models are trained and evaluated for failure detection and transition probabilities. This analysis indicates that the trained PV-HMM models have the highest probability of remaining in their current state (87.1% to 93.5%), whereas the transition probability from normal to failure (6.5%) is lower than the transition from failure to normal (12.9%) states. A comparison of these patterns using both threshold levels and operations and maintenance (O&M) tickets indicate high precision rates of PV-HMMs (median = 82.4%) across all of the sites. Although additional work is needed to assess sensitivities, the PV-HMM methodology demonstrates significant potential for real-time failure detection as well as extensions into predictive maintenance capabilities for PV.

classification↗
NASA NTRS1987

Evaluation of several classification schemes for mapping forest cover types in Michigan

Landsat MSS data were evaluated for mapping forest cover types in the northern Lower Peninsula of Michigan. The study examined seasonal variations, interpretation procedures and vegetation composition/distribution and their effect on overall classification accuracy and ability to identify individual pine species. Photographic images were used for visual interpretations while digital analysis was performed using a common (ERDAS) microcomputer image processing system. The classification schemes were evaluated using contingency tables and were ranked using the KAPPA statistic. The various classification schemes were ranked differentially according to study site location. Visual interpretation procedures ranked best, or least accurate, depending on the spatial distribution and complexity of the forest cover. Supervised classification techniques were more accurate than unsupervised clustering over all sites and seasons. Maximum likelihood classification of June data was superior to any digital classification technique of February data. The study indicates that classification accuracy is more dependent on the composition and distribution of forests in the northern lower Peninsula of Michigan than on the selection of a particular classification scheme.

Hudson, W. D.↗
DOE OSTI2024

Convolutional Variational Autoencoder-based Unsupervised Learning for Power Systems Faults

Classification of power system event data is a growing need, particularly where non-protective relaying-based sensors are used to monitor grid performance. Given the high burden of obtaining event data with appropriate labeling, an unsupervised approach is highly valuable. This approach enables using event data without labeling, which is far easier to obtain. This paper presents an unsupervised learning method to classify and label transients observed in the distribution grid. A Convolutional Variational Autoencoder (CVAE) was developed for this purpose. We demonstrate the efficacy of our approach using the transient data generated from the simulations. The simulation data is used to train the CVAE that identifies different faults as different clusters in the latent space. The clusters are then used as the foundation model to categorize the real-world data.

Alam, Maksudul↗
NASA NTRS1977

Remote sensing of environmental impact of land use activities

The capability to monitor land cover, associated in the past with aerial film cameras and radar systems, was discussed in regard to aircraft and spacecraft multispectral scanning sensors. A proposed thematic mapper with greater spectral and spatial resolutions for the fourth LANDSAT is expected to usher in new environmental monitoring capability. In addition, continuing improvements in image classification by supervised and unsupervised computer techniques are being operationally verified for discriminating environmental impacts of human activities on the land. The benefits of employing remote sensing for this discrimination was shown to far outweigh the incremental costs of converting to an aircraft-satellite multistage system.

Paul, C. K.↗
NASA NTRS1986

The effect of Thematic Mapper spectral properties on land cover mapping for hydrologic modeling

The accuracy of unsupervised land-cover classification from all seven Landsat TM bands and from six combinations of three or four bands is evaluated using images of the Clinton River Basin, a suburban watershed near Detroit. Data from aerial TMS photography, USGS topographic maps, and ground surveys are employed to determine the classification accuracy. The mapping accuracy of all seven bands is found to be significantly better (6 percent overall, 12 percent for residential areas, and 13 percent for commercial districts) than that with bands 2, 3, and 4; but almost the same accuracy is obtained by including at least one band from each major spectral region (visible, NIR, and mid-IR).

Gervin, J. C.↗