Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
NASA NTRS1976

Digital preprocessing and classification of multispectral earth observation data

The development of airborne and satellite multispectral image scanning sensors has generated wide-spread interest in application of these sensors to earth resource mapping. These point scanning sensors permit scenes to be imaged in a large number of electromagnetic energy bands between .3 and 15 micrometers. The energy sensed in each band can be used as a feature in a computer based multi-dimensional pattern recognition process to aid in interpreting the nature of elements in the scene. Images from each band can also be interpreted visually. Visual interpretation of five or ten multispectral images simultaneously becomes impractical especially as area studied increases; hence, great emphasis has been placed on machine (computer) techniques for aiding in the interpretation process. This paper describes a computer software system concept called LARSYS for analysis of multivariate image data and presents some examples of its application.

Anuta, P. E.↗
DOE OSTI2021

Pushing automated morphological classifications to their limits with the Dark Energy Survey

ABSTRACT We present morphological classifications of ∼27 million galaxies from the Dark Energy Survey (DES) Data Release 1 (DR1) using a supervised deep learning algorithm. The classification scheme separates: (a) early-type galaxies (ETGs) from late-type galaxies (LTGs); and (b) face-on galaxies from edge-on. Our convolutional neural networks (CNNs) are trained on a small subset of DES objects with previously known classifications. These typically have mr ≲ 17.7 mag; we model fainter objects to mr < 21.5 mag by simulating what the brighter objects with well-determined classifications would look like if they were at higher redshifts. The CNNs reach 97 per cent accuracy to mr < 21.5 on their training sets, suggesting that they are able to recover features more accurately than the human eye. We then used the trained CNNs to classify the vast majority of the other DES images. The final catalogue comprises five independent CNN predictions for each classification scheme, helping to determine if the CNN predictions are robust or not. We obtain secure classifications for ∼87 per cent and 73 per cent of the catalogue for the ETG versus LTG and edge-on versus face-on models, respectively. Combining the two classifications (a) and (b) helps to increase the purity of the ETG sample and to identify edge-on lenticular galaxies (as ETGs with high ellipticity). Where a comparison is possible, our classifications correlate very well with Sérsic index (n), ellipticity (ϵ), and spectral type, even for the fainter galaxies. This is the largest multiband catalogue of automated galaxy morphologies to date.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1982

Geologic interpretation of texture in Seasat and SIR-A radar images

Geological information in radar images of heavily vegetated areas is contained mainly in the depiction of topography as image texture. This paper describes three techniques for the analysis of texture in radar images: the split-spectrum technique, Fourier transforms of subareas, and spatial frequency bandpass classification. These techniques were applied to a heavily vegetated area of Belize in Central America in order to evaluate their utility for geological mapping; Seasat and Shuttle Imaging Radar (SIR-A) images were considered.

Farr, T. G.↗
NASA NTRS1987

Overview of Austrian Airborne Imaging Spectrometer (AIS) programme and first results

Airborne Imaging Spectrometer (AIS) data collected from eight test areas in Austria were evaluated for their usefulness in forest damage assessment, geobotany, alpine vegetation mapping, and land use classification. Difficulties encountered in installing the SPAM spectral analysis software for use on the image display system and the necessity to adapt existing programs for this task impeded and delayed the analysis of the AIS data. Spectral reflectance curves obtained from a geobotanical test site show a marked increase in reflectance across most of the measured spectrum for metal stressed spruce trees compared with nonstressed spruce trees.

Banninger, C.↗
NASA NTRS2014

A Framework for Land Cover Classification Using Discrete Return LiDAR Data: Adopting Pseudo-Waveform and Hierarchical Segmentation

Acquiring current, accurate land-use information is critical for monitoring and understanding the impact of anthropogenic activities on natural environments.Remote sensing technologies are of increasing importance because of their capability to acquire information for large areas in a timely manner, enabling decision makers to be more effective in complex environments. Although optical imagery has demonstrated to be successful for land cover classification, active sensors, such as light detection and ranging (LiDAR), have distinct capabilities that can be exploited to improve classification results. However, utilization of LiDAR data for land cover classification has not been fully exploited. Moreover, spatial-spectral classification has recently gained significant attention since classification accuracy can be improved by extracting additional information from the neighboring pixels. Although spatial information has been widely used for spectral data, less attention has been given to LiDARdata. In this work, a new framework for land cover classification using discrete return LiDAR data is proposed. Pseudo-waveforms are generated from the LiDAR data and processed by hierarchical segmentation. Spatial featuresare extracted in a region-based way using a new unsupervised strategy for multiple pruning of the segmentation hierarchy. The proposed framework is validated experimentally on a real dataset acquired in an urban area. Better classification results are exhibited by the proposed framework compared to the cases in which basic LiDAR products such as digital surface model and intensity image are used. Moreover, the proposed region-based feature extraction strategy results in improved classification accuracies in comparison with a more traditional window-based approach.

Light Detection & Ranging (LIDAR)↗
DOE OSTI2022

Classification of Cloud Particle Imagery from Aircraft Platforms Using Convolutional Neural Networks

Abstract A vast amount of ice crystal imagery exists from a variety of field campaign initiatives that can be utilized for cloud microphysical research. Here, nine convolutional neural networks are used to classify particles into nine regimes on over 10 million images from the Cloud Particle Imager probe, including liquid and frozen states and particles with evidence of riming. A transfer learning approach proves that the Visual Geometry Group (VGG-16) network best classifies imagery with respect to multiple performance metrics. Classification accuracies on a validation dataset reach 97% and surpass traditional automated classification. Furthermore, after initial model training and preprocessing, 10 000 images can be classified in approximately 35 s using 20 central processing unit cores and two graphics processing units, which reaches real-time classification capabilities. Statistical analysis of the classified images indicates that a large portion (57%) of the dataset is unusable, meaning the images are too blurry or represent indistinguishable small fragments. In addition, 19% of the dataset is classified as liquid drops. After removal of fragments, blurry images, and cloud drops, 38% of the remaining ice particles are largely intersecting the image border (≥10% cutoff) and therefore are considered unusable because of the inability to properly classify and dimensionalize. After this filtering, an unprecedented database of 1 560 364 images across all campaigns is available for parameter extraction and bulk statistics on specific particle types in a wide variety of storm systems, which can act to improve the current state of microphysical parameterizations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Analysis of Defects in Metal Additive Manufacturing with Augmented Data Generation

Laser powder bed fusion (LPBF) is a method of additive manufacturing (AM) that selectively melts and fuses together microscopic metallic powder. LPBF offers the benefit of producing custom structures out of high strength metals that can be difficult to fabricate with conventional methods. The challenge of LPBF is that 3D printed structures often have internal pores due to process flaws. Pulsed thermal tomography (PTT) is a method for reconstructing the depth profile of materials, allowing the visualization internal voids in solids. In prior work, we developed a convolutional neural network (CNN) which, having been trained on simulated 2D PTT images of subsurface elliptical defects, was able to classify the semi-major radii, semi-minor radii, and angular orientation of the best-fit ellipses in previously unseen PTT images. The unseen PTT images contained subsurface irregular defect shapes imported from scanning electron microscopy (SEM) images of metallic LPBF-printed specimens. Training the CNN on irregular defect shapes instead of on elliptical shapes would make the resulting classifications more descriptive of actual defect shapes. However, this requires a much higher volume of SEM images of material defects, which are difficult to obtain because of random occurrence of defects in LPBF. To address this challenge, we developed a generative adversarial network (GAN) to augment the existing dataset of SEM defect images. The GAN model is demonstrated to create novel yet realistic defect shapes that can be used as input for simulated PTT images to train CNN.

36 MATERIALS SCIENCE↗
NASA NTRS1977

Resampling study

The author has identified the following significant results. The nearest neighbor and cubic convolution resampling algorithms were applied to a variety of images extracted from LANDSAT MSS data. A comparison of the results demonstrated that (1) cubic convolution can cause spreading of small features and can introduce noticeable overshoot (ringing) into the data; (2) cubic convolution attenuates the high spatial frequencies compared to the original and nearest neighbor resampled data; and (3) cubic convolution generally produces photographic products of superior visual quality. The effects of the resampling algorithms on multispectral classification were not conclusively determined due to the small number of images tested.

Ferneyhough, D. G.↗
NASA NTRS2000

Effects of Digitization and JPEG Compression on Land Cover Classification Using Astronaut-Acquired Orbital Photographs

Studies that utilize astronaut-acquired orbital photographs for visual or digital classification require high-quality data to ensure accuracy. The majority of images available must be digitized from film and electronically transferred to scientific users. This study examined the effect of scanning spatial resolution (1200, 2400 pixels per inch [21.2 and 10.6 microns/pixel]), scanning density range option (Auto, Full) and compression ratio (non-lossy [TIFF], and lossy JPEG 10:1, 46:1, 83:1) on digital classification results of an orbital photograph from the NASA - Johnson Space Center archive. Qualitative results suggested that 1200 ppi was acceptable for visual interpretive uses for major land cover types. Moreover, Auto scanning density range was superior to Full density range. Quantitative assessment of the processing steps indicated that, while 2400 ppi scanning spatial resolution resulted in more classified polygons as well as a substantially greater proportion of polygons < 0.2 ha, overall agreement between 1200 ppi and 2400 ppi was quite high. JPEG compression up to approximately 46:1 also did not appear to have a major impact on quantitative classification characteristics. We conclude that both 1200 and 2400 ppi scanning resolutions are acceptable options for this level of land cover classification, as well as a compression ratio at or below approximately 46:1. Auto range density should always be used during scanning because it acquires more of the information from the film. The particular combination of scanning spatial resolution and compression level will require a case-by-case decision and will depend upon memory capabilities, analytical objectives and the spatial properties of the objects in the image.

Robinson, Julie A.↗
NASA NTRS1973

Image analysis techniques associated with automatic data base generation.

This paper considers some basic problems relating to automatic data base generation from imagery, the primary emphasis being on fast and efficient automatic extraction of relevant pictorial information. Among the techniques discussed are recursive implementations of some particular types of filters which are much faster than FFT implementations, a 'sequential similarity detection' technique of implementing matched filters, and sequential linear classification of multispectral imagery. Several applications of the above techniques are presented including enhancement of underwater, aerial and radiographic imagery, detection and reconstruction of particular types of features in images, automatic picture registration and classification of multiband aerial photographs to generate thematic land use maps.

Bond, A. D.↗
NASA NTRS1992

A system for verifying models and classification maps by extraction of information from a variety of data sources

Recent updates to a geographical information system (GIS) called VICAR (Video Image Communication and Retrieval)/IBIS are described. The system is designed to handle data from many different formats (vector, raster, tabular) and many different sources (models, radar images, ground truth surveys, optical images). All the data are referenced to a single georeference plane, and average or typical values for parameters defined within a polygonal region are stored in a tabular file, called an info file. The info file format allows tracking of data in time, maintenance of links between component data sets and the georeference image, conversion of pixel values to `actual' values (e.g., radar cross-section, luminance, temperature), graph plotting, data manipulation, generation of training vectors for classification algorithms, and comparison between actual measurements and model predictions (with ground truth data as input).

Norikane, L.↗
NASA NTRS2022

Lower Illinois River Valley Ecological Forecasting: Inundation Mapping of the Lower Illinois River Valley Using Synthetic Aperture Radar and Optical Satellite Imagery for Wetland Conservation and Restoration Prioritization Efforts

The Lower Illinois River Valley (LIRV) is home to some of the richest agricultural lands in the United States and its wetlands provide key ecosystem services like clean water and flood reduction. It has also experienced extensive degradation due to development and urban pollution. The Great Rivers Land Trust (GRLT), the National Great Rivers Research & Education Center, Principia College, and the American Geophysical Union’s (AGU) Thriving Earth Exchange sought to incorporate inundation and surface water extent layers into their geodatabases to more accurately identify priority areas for wetland restoration. This project aimed to determine the feasibility of detecting inundation extent and duration along the valley using remotely sensed data. We used Sentinel-1 C-band Synthetic Aperture Radar (SAR) data to classify open water and inundated vegetation within the study site. The open water classification was compared to Dynamic Surface Water Extent(DSWE) derived from Landsat 8 Operational Land Imager. We successfully created layers of inundation minimum and maximum extent, as well as inundation duration across the study area for 2019 and 2020. The open water classification resulted in an overall accuracy of 86% when validated against DSWE classifications. These analyses will help end users to identify high priority areas along the LIRV best suited for land conversion projects in the future.

Vanessa Machuca↗
DOE OSTI2023

Finding simplicity: unsupervised discovery of features, patterns, and order parameters via shift-invariant variational autoencoders *

Abstract Recent advances in scanning tunneling and transmission electron microscopies (STM and STEM) have allowed routine generation of large volumes of imaging data containing information on the structure and functionality of materials. The experimental data sets contain signatures of long-range phenomena such as physical order parameter fields, polarization, and strain gradients in STEM, or standing electronic waves and carrier-mediated exchange interactions in STM, all superimposed onto scanning system distortions and gradual changes of contrast due to drift and/or mis-tilt effects. Correspondingly, while the human eye can readily identify certain patterns in the images such as lattice periodicities, repeating structural elements, or microstructures, their automatic extraction and classification are highly non-trivial and universal pathways to accomplish such analyses are absent. We pose that the most distinctive elements of the patterns observed in STM and (S)TEM images are similarity and (almost-) periodicity, behaviors stemming directly from the parsimony of elementary atomic structures, superimposed on the gradual changes reflective of order parameter distributions. However, the discovery of these elements via global Fourier methods is non-trivial due to variability and lack of ideal discrete translation symmetry. To address this problem, we explore the shift-invariant variational autoencoders (shift-VAEs) that allow disentangling characteristic repeating features in the images, their variations, and shifts that inevitably occur when randomly sampling the image space. Shift-VAEs balance the uncertainty in the position of the object of interest with the uncertainty in shape reconstruction. This approach is illustrated for model 1D data, and further extended to synthetic and experimental STM and STEM 2D data. We further introduce an approach for training shift-VAEs that allows finding the latent variables that comport to known physical behavior. In this specific case, the condition is that the latent variable maps should be smooth on the length scale of the atomic lattice (as expected for physical order parameters), but other conditions can be imposed. The opportunities and limitations of the shift VAE analysis for pattern discovery are elucidated.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Toward The Development of Hailstorm Climatologies Derived From Reanalyses and Infared/Passive Microwave Satellite Imagers

Geostationary satellite imagers, such as those of the Geostationary Operational Environmental Satellite (GOES) and Meteosat series, provide both historical and near-real-time observations of cloud top patterns that are commonly associated with severe convection. Environmental conditions favorable for severe weather are thought to be represented well by reanalyses. Predicting exactly where convection and costly storm hazards like hail will occur using models or satellite imagery alone, however, is extremely challenging. The multivariate combination of satellite-observed cloud patterns with reanalysis environmental parameters, linked to United States Next Generation Weather Radar- (NEXRAD-) estimated Maximum Expected Size of Hail (MESH) using a deep neural network (DNN), enables estimation of potentially severe hail likelihood for any observed storm cell. These estimates are specifically designed to make hail likelihood distinctions based on satellite-indicated points of deep convection within environments favorable for storm development. We seek an approach that can be used to estimate climatological hailstorm frequency and risk throughout the historical satellite data record. This presentation demonstrates that statistical distributions of convective parameters from satellite and reanalysis show separation between non-severe/severe hailstorm classes for predictors including overshooting cloud top temperature and area characteristics, convective available potential energy, vertical wind shear, 500 hPa temperature, mid-level lapse rate, precipitable water, and convective inhibition. These complex, multivariate predictor relationships are exploited within a DNN to produce a hail likelihood metric with a critical success index of 0.504 and Heidke skill score of 0.403, which is exceptional among recent analogous hail studies. Furthermore, applications of the DNN to select case studies demonstrate good qualitative agreement between hail likelihood and MESH. These hail classifications are aggregated across an 11-year GOES-12/13 image database to derive a hail frequency and severity climatology, which denotes the Central Plains, the Midwest, and northwestern Mexico as being the most hail-prone regions within the domain studied. Opportunities for training and applying DNN-based hailstorm predictions to recently developed GOES-8/10/12/13/16 and Meteosat Second Generation convective storm detection and characterization climatologies over South America and South Africa, respectively, will also be presented.

Kristopher Bedka↗
NASA NTRS2002

NASA Remote Sensing Research as Applied to Archaeology

The use of remotely sensed images is not new to archaeology. Ever since balloons and airplanes first flew cameras over archaeological sites, researchers have taken advantage of the elevated observation platforms to understand sites better. When viewed from above, crop marks, soil anomalies and buried features revealed new information that was not readily visible from ground level. Since 1974 and initially under the leadership of Dr. Tom Sever, NASA's Stennis Space Center, located on the Mississippi Gulf Coast, pioneered and expanded the application of remote sensing to archaeological topics, including cultural resource management. Building on remote sensing activities initiated by the National Park Service, archaeologists increasingly used this technology to study the past in greater depth. By the early 1980s, there were sufficient accomplishments in the application of remote sensing to anthropology and archaeology that a chapter on the subject was included in fundamental remote sensing references. Remote sensing technology and image analysis are currently undergoing a profound shift in emphasis from broad classification to detection, identification and condition of specific materials, both organic and inorganic. In the last few years, remote sensing platforms have grown increasingly capable and sophisticated. Sensors currently in use, or nearing deployment, offer significantly finer spatial and spectral resolutions than were previously available. Paired with new techniques of image analysis, this technology may make the direct detection of archaeological sites a realistic goal.

Giardino, Marco J.↗
DOE OSTI2025

Machine learning models for segmentation and classification of cyanobacterial cells

Abstract Timelapse microscopy has recently been employed to study the metabolism and physiology of cyanobacteria at the single-cell level. However, the identification of individual cells in brightfield images remains a significant challenge. Traditional intensity-based segmentation algorithms perform poorly when identifying individual cells in dense colonies due to a lack of contrast between neighboring cells. Here, we describe a newly developed software package called Cypose which uses machine learning (ML) models to solve two specific tasks: segmentation of individual cyanobacterial cells, and classification of cellular phenotypes. The segmentation models are based on the Cellpose framework, while classification is performed using a convolutional neural network named Cyclass. To our knowledge, these are the first developed ML-based models for cyanobacteria segmentation and classification. When compared to other methods, our segmentation models showed improved performance and were able to segment cells with varied morphological phenotypes, as well as differentiate between live and lysed cells. We also found that our models were robust to imaging artifacts, such as dust and cell debris. Additionally, the classification model was able to identify different cellular phenotypes using only images as input. Together, these models improve cell segmentation accuracy and enable high-throughput analysis of dense cyanobacterial colonies and filamentous cyanobacteria.

Huffine, Clair A.↗
NASA NTRSDate not supplied

Lower Illinois River Valley Ecological Forecasting: Inundation Mapping of the Lower Illinois River Valley Using Synthetic Aperture Radar and Optical Satellite Imagery for Wetland Conservation and Restoration Prioritization Efforts

The Lower Illinois River Valley (LIRV) is home to some of the richest agricultural lands in the United States and its wetlands provide key ecosystem services like clean water and flood reduction. It has also experienced extensive degradation due to development and urban pollution. The Great Rivers Land Trust (GRLT), the National Great Rivers Research & Education Center, Principia College, and the American Geophysical Union’s (AGU) Thriving Earth Exchange sought to incorporate inundation and surface water extent layers into their geodatabases to more accurately identify priority areas for wetland restoration. This project aimed to determine the feasibility of detecting inundation extent and duration along the valley using remotely sensed data. The team used Sentinel-1 C-band Synthetic Aperture Radar (SAR) data to classify open water and inundated vegetation within the study site. The open water classification was compared to Dynamic Surface Water Extent (DSWE) derived from Landsat 8 Operational Land Imager. The team successfully created layers of inundation minimum and maximum extent, as well as inundation duration across the study area for 2019 and 2020. The open water classification resulted in an overall accuracy of 86% when validated against DSWE classifications. These analyses will help end users to identify high priority areas along the LIRV best suited for land conversion projects in the future.

Vanessa Machuca↗
NASA NTRS2012

Contribution of National near Real Time MODIS Forest Maximum Percentage NDVI Change Products to the U.S. ForWarn System

This presentation reviews the development, integration, and testing of Near Real Time (NRT) MODIS forest % maximum NDVI change products resident to the USDA Forest Service (USFS) ForWarn System. ForWarn is an Early Warning System (EWS) tool for detection and tracking of regionally evident forest change, which includes the U.S. Forest Change Assessment Viewer (FCAV) (a publically available on-line geospatial data viewer for visualizing and assessing the context of this apparent forest change). NASA Stennis Space Center (SSC) is working collaboratively with the USFS, ORNL, and USGS to contribute MODIS forest change products to ForWarn. These change products compare current NDVI derived from expedited eMODIS data, to historical NDVI products derived from MODIS MOD13 data. A new suite of forest change products are computed every 8 days and posted to the ForWarn system; this includes three different forest change products computed using three different historical baselines: 1) previous year; 2) previous three years; and 3) all previous years in the MODIS record going back to 2000. The change product inputs are maximum value NDVI that are composited across a 24 day interval and refreshed every 8 days so that resulting images for the conterminous U.S. are predominantly cloud-free yet still retain temporally relevant fresh information on changes in forest canopy greenness. These forest change products are computed at the native nominal resolution of the input reflectance bands at 231.66 meters, which equates to approx 5.4 hectares or 13.3 acres per pixel. The Time Series Product Tool, a MATLAB-based software package developed at NASA SSC, is used to temporally process, fuse, reduce noise, interpolate data voids, and re-aggregate the historical NDVI into 24 day composites, and then custom MATLAB scripts are used to temporally process the eMODIS NDVIs so that they are in synch with the historical NDVI products. Prior to posting, an in-house snow mask classification product is computed for the current compositing period and integrated into the change images to account for snow related NDVI drops. The supplemental snow classification product was needed because other available QA cloud/snow mask typically underestimates snow cover. MODIS true and false color composites were also computed from eMODIS reflectance data and the true color RGBs are also posted on ForWarn?s FCAV; this data is used for assessing apparent occasional quality issues on the change products due to residual unmasked cloud cover. New forest change products are posted with typical latencies of 1-2 days after the last input eMODIS data collection date for a given 24 day compositing period.

Spruce, Joseph P.↗