Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

A Dynamic Reduction Network for Point Clouds

Classifying whole images is a classic problem in machine learning, and graph neural networks are a powerful methodology to learn highly irregular geometries. It is often the case that certain parts of a point cloud are more important than others when determining overall classification. On graph structures this started by pooling information at the end of convolutional filters, and has evolved to a variety of staged pooling techniques on static graphs. In this paper, a dynamic graph formulation of pooling is introduced that removes the need for predetermined graph structure. It achieves this by dynamically learning the most important relationships between data via an intermediate clustering. The network architecture yields interesting results considering representation size and efficiency. It also adapts easily to a large number of tasks from image classification to energy regression in high energy particle physics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Design of partially supervised classifiers for multispectral image data

A partially supervised classification problem is addressed, especially when the class definition and corresponding training samples are provided a priori only for just one particular class. In practical applications of pattern classification techniques, a frequently observed characteristic is the heavy, often nearly impossible requirements on representative prior statistical class characteristics of all classes in a given data set. Considering the effort in both time and man-power required to have a well-defined, exhaustive list of classes with a corresponding representative set of training samples, this 'partially' supervised capability would be very desirable, assuming adequate classifier performance can be obtained. Two different classification algorithms are developed to achieve simplicity in classifier design by reducing the requirement of prior statistical information without sacrificing significant classifying capability. The first one is based on optimal significance testing, where the optimal acceptance probability is estimated directly from the data set. In the second approach, the partially supervised classification is considered as a problem of unsupervised clustering with initially one known cluster or class. A weighted unsupervised clustering procedure is developed to automatically define other classes and estimate their class statistics. The operational simplicity thus realized should make these partially supervised classification schemes very viable tools in pattern classification.

Jeon, Byeungwoo↗

Imaging Systems for Size Measurements of Debrisat Fragments

The overall objective of the DebriSat project is to provide data to update existing standard spacecraft breakup models. One of the key sets of parameters used in these models is the physical dimensions of the fragments (i.e., length, average-cross sectional area, and volume). For the DebriSat project, only fragments with at least one dimension greater than 2 mm are collected and processed. Additionally, a significant portion of the fragments recovered from the impact test are needle-like and/or flat plate-like fragments where their heights are almost negligible in comparison to their other dimensions. As a result, two fragment size categories were defined: 2D objects and 3D objects. While measurement systems are commercially available, factors such as measurement rates, system adaptability, size characterization limitations and equipment costs presented significant challenges to the project and a decision was made to develop our own size characterization systems. The size characterization systems consist of two automated image systems, one referred to as the 3D imaging system and the other as the 2D imaging system. Which imaging system to use depends on the classification of the fragment being measured. Both imaging systems utilize point-and-shoot cameras for object image acquisition and create representative point clouds of the fragments. The 3D imaging system utilizes a space-carving algorithm to generate a 3D point cloud, while the 2D imaging system utilizes an edge detection algorithm to generate a 2D point cloud. From the point clouds, the three largest orthogonal dimensions are determined using a convex hull algorithm. For 3D objects, in addition to the three largest orthogonal dimensions, the volume is computed via an alpha-shape algorithm applied to the point clouds. The average cross-sectional area is also computed for 3D objects. Both imaging systems have automated size measurements (image acquisition and image processing) driven by the need to quickly and accurately measure tens of thousands of debris fragments. Moreover, the automated size measurement reduces potential fragment damage/mishandling and ability for accuracy and repeatability. As the fragment characterization progressed, it became evident that the imaging systems had to be revised. For example, an additional view was added to the 2D imaging system to capture the height of the 2D object. This paper presents the DebriSat project's imaging systems and calculation techniques in detail; from design and development to maturation. The experiences and challenges are also shared.

Shiotani, B.↗

Scaling Resolution of Gigapixel Whole Slide Images Using Spatial Decomposition on Convolutional Neural Networks

Gigapixel images are prevalent in scientific domains ranging from remote sensing, and satellite imagery to microscopy, etc. However, training a deep learning model at the natural resolution of those images has been a challenge in terms of both, overcoming the resource limit (e.g. HBM memory constraints), as well as scaling up to a large number of GPUs. In this paper, we trained Residual neural Networks (ResNet) on 22,528 x 22,528-pixel size images using a distributed spatial decomposition method on 2,304 GPUs on the Summit Supercomputer. We applied our method on a Whole Slide Imaging (WSI) dataset from The Cancer Genome Atlas (TCGA) database. WSI images can be in the size of 100,000 x 100,000 pixels or even larger, and in this work we studied the effect of image resolution on a classification task, while achieving state-of-the-art AUC scores. Moreover, our approach doesn't need pixel-level labels, since we're avoiding patching from the WSI images completely, while adding the capability of training arbitrary large-size images. This is achieved through a distributed spatial decomposition method, by leveraging the non-block fat-tree interconnect network of the Summit architecture, which enabled GPU-to-GPU direct communication. Finally, detailed performance analysis results are shown, as well as a comparison with a data-parallel approach when possible.

Tsaris, Aristeidis (aris)↗

Texture transforms of remote sensing data

Tone and texture are fundamental interrelated visual concepts. The concepts are used for the digital analysis of remotely sensed image data. The reported investigation had the objective to develop software for the quantification of image texture and to apply the texture information to both image enhancement and thematic classification of remotely sensed data. The quantitative texture information was applied to the analysis of Landsat-2 Multispectral Scanner Subsystem (MSS) data. Attention is given to the characterization of image texture, textured transformations, the subtext program, and a description of methods and results. It is pointed out that the inability to use the texture transforms of the Landsat MSS data for the thematic mapping of the study area's land cover contrasts sharply with the reported results of the textural analysis of digitized aerial photography by Hsu (1978).

Irons, J. R.↗

Real-time biomass feedstock particle quality detection using image analysis and machine vision

Abstract A common and costly challenge in the nascent biorefinery industry is the consistent handling and conveyance of biomass feedstock materials, which can vary widely in their chemical, physical, and mechanical properties. Solutions to cope with varying feedstock qualities will be required, including advanced process controls to adjust equipment and reject feedstocks that do not meet a quality standard. In this work, we present and evaluate methods to autonomously assess corn stover feedstock quality in real time and provide data to process controls with low-cost camera hardware. We explore the use of neural networks to classify feedstocks based on actual processing behavior and pixel matrix feature parameterization to further assess particle attributes that may explain the variable processing behavior. We used the pretrained ResNet neural network coupled with a gated recurrent unit (GRU) time-series classifier trained on our image data, resulting in binary classification of feedstock anomalies with favorable performance. The textural aspects of the image data were statistically analyzed to determine if the textural features were predictive of operational disruptions. The significant textural features were angular second moment, prominence, mean height of surface profile, mean resultant vector, shade, skewness, variation of the polar facet orientation, and direction of azimuthal facets. Expansion of these models is recommended across a wider variety of labeled feedstock images of different qualities and species to develop a more robust tool that may be deployed using low-cost cameras within biorefineries.

09 BIOMASS FUELS↗

Land use mapping using edge density texture measures on Thematic Mapper simulator data

Texture analysis was performed as part of an investigation of the information content of Thematic Mapper (TM) imagery. High altitude aircraft scanner imagery from the Airborne Thematic Mapper (ATM) instrument was acquired over central California and used to simulate TM data. Edge density texture images were constructed by computation of proportions of edge pixels in a 31 x 31 moving window on a near infrared ATM band. A training technique was employed to select computational parameters to maximize the difference between edge density measurements in urban and in rural areas. The results of classification of the texture images showed that urban and rural areas could be distinguished with texture alone, indicating that inclusion of texture in automated classification procedures could significantly improve their accuracy.

Hlavka, C. A.↗

Data Fusion of Very High Resolution Hyperspectral and Polarimetric SAR Imagery for Terrain Classification

Performing terrain classification with data from heterogeneous imaging modalities is a very challenging problem. The challenge is further compounded by very high spatial resolution. (In this paper we consider very high spatial resolution to be much less than a meter.) At very high resolution many additional complications arise, such as geometric differences in imaging modalities and heightened pixel-by-pixel variability due to inhomogeneity within terrain classes. In this paper we consider the fusion of very high resolution hyperspectral imaging (HSI) and polarimetric synthetic aperture radar (PolSAR) data. We introduce a framework that utilizes the probabilistic feature fusion (PFF) one-class classifier for data fusion and demonstrate the effect of making pixelwise, superpixel, and pixelwise voting (within a superpixel) terrain classification decisions. We show that fusing imaging modality data sets, combined with pixelwise voting within the spatial extent of superpixels, gives a robust terrain classification framework that gives a good balance between quantitative and qualitative results.

47 OTHER INSTRUMENTATION↗

Effects of forest degradation classification on the uncertainty of aboveground carbon estimates in the Amazon

Tropical forests are critical for the global carbon budget, yet they have been threatened by deforestation and forest degradation by fire, selective logging, and fragmentation. Existing uncertainties on land cover classification and in biomass estimates hinder accurate attribution of carbon emissions to specific forest classes. In this study, we used textural metrics derived from PlanetScope images to implement a probabilistic classification framework to identify intact, logged and burned forests in three Amazonian sites. We also estimated biomass for these forest classes using airborne lidar and compared biomass uncertainties using the lidar-derived estimates only to biomass uncertainties considering the forest degradation classification as well. Our classification approach reached overall accuracy of 0.86, with accuracy at individual sites varying from 0.69 to 0.93. Logged forests showed variable biomass changes, while burned forests showed an average carbon loss of 35%. We found that including uncertainty in forest degradation classification significantly increased uncertainty and decreased estimates of mean carbon density in two of the three test sites. Our findings indicate that the attribution of biomass changes to forest degradation classes needs to account for the uncertainty in forest degradation classification. By combining very high-resolution images with lidar data, we could attribute carbon stock changes to specific pathways of forest degradation. This approach also allows quantifying uncertainties of carbon emissions associated with forest degradation through logging and fire. Both the attribution and uncertainty quantification provide critical information for national greenhouse gas inventories.

54 ENVIRONMENTAL SCIENCES↗

Land Classification of South-Central Iowa from Computer Enhanced Images

The author has identified the following significant results. Two CCT (computer compatible tapes) scenes were digitally enhanced. The IMAGE 100 system was utilized for image processing. The real time ability of this machine allowed large scale viewing of several selected areas on both CCT's.

Taranik, J. V.↗

Land Classification of South-central Iowa from Computer Enhanced Images

The author has identified the following significant results. Two enhanced false color negatives from multispectral scanner scenes, dated 15 April 1974 and 29 August 1972, were printed at a scale of 1:125,000 to form the basis for land use interpretations in the Wapello County, Iowa test site. The use of geomorphic principles proved valuable in the interpretation of the April scene to form valuable generalizations for planning purposes on soil associations, topography, alluvial valleys, and agricultural land use. The August scene was superior in providing information on urban extent, transportation networks, forest cover, and water bodies.

Lucas, J. R.↗

Macro-physical Properties of Shallow Cumulus from Integrated ARM Observations (Final Report)

Fair-weather shallow cumuli (ShCu) play an important role in many climate-related processes. Irregular geometry of ShCu and their strong temporal and spatial variability make it challenging to observe ShCu holistically and to represent them correctly in climate models. To improve ShCu parameterizations, information on both vertically and horizontally resolved cloud properties is required. Commonly, the vertically resolved cloud properties are provided by zenith pointing lidar-radar observations with a very narrow field of view (FOV). Thus, these “pencil-beam” properties may not be representative of a larger surrounding area. Limited number of areal-averaged cloud properties, such as fractional sky cover (FSC), are offered typically by wide-FOV observations. The main goal of our project was to integrate advantages of the narrow-FOV (vertical structure of clouds) and wide-FOV (spatial arrangement of clouds) observations for an improved characterization of single-layer ShCu observed at the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site for an 18-yr period (2000-2017). There are four major accomplishments of our project, First, an updated operational cloud classification for days with ShCu has been suggested and evaluated through a detailed comparison with the manually curated records. Our classification extends successfully the latest ARM cloud type Value Added Product (VAP) based on the Active Remote Sensing of Clouds (ARSCL) cloud product by incorporating both cloud fraction (CF) provided by narrow-FOV ceilometer data and FSC from wide-FOV images offered by a Total Sky Imager (TSI). Moreover, our classification allows one to identify impact of instrumentation changes at the SGP site, namely the transition to KAZRARSCL with the updated cloud radar, on the identification of periods with single-layer ShCu. Second, a new approach that resolves cloud area distributions for a given region (up to 4x4 km 2 ) has been suggested and cloud equivalent diameters (CEDs) have been estimated for the first time. These estimations have been performed over a wide range of cloud sizes (about 0.01–3.5 km) with high temporal resolution (30s) using wide-FOV TSI images and cloud base height (CBH) provided by complementary narrow-FOV lidar measurements. Our simple and computationally inexpensive approach offers a previously unavailable dataset for process studies in the convective boundary layer and evaluation of ShCu parameterizations in cloud-resolving models. Third, a long-term integrated record of ShCu macrophysical properties has been developed. The developed record represents the longest available compilation of events with ShCu and includes (i) a novel visualization of the spatial variability in cloud cover both along- and across-wind directions, (ii) updated estimates of narrow-FOV CF and wide-FOV FSC, (iii) updated narrow-FOV CBH, and (iv) complementary data, such as wind speed and direction from the 915-MHz Radar Wind Profiler (RWP) data. The developed record has been used successfully to assess conventional observational estimates of cloud cover and their sensitivity to the following two factors: (i) instrument-dependent cloud detection and data merging criteria and (ii) FOV configuration. Fourth, co-variability of the ShCu macrophysical properties and environmental parameters has been analyzed for a 3-yr period (2016-2018). Our initial analysis includes diurnal changes of FSCs obtained for clouds with small, moderate and large CEDs and several environmental parameters, such as lifted condensation level (LCL) and mixed layer height (zi). Preliminary results of our analysis suggest that the horizontal extent of ShCu is controlled substantially by the sign and magnitude of difference between these two parameters (zi-LCL): the CED tends to grow with increase of this difference (zi exceeds LCL). We have initiated relationships between the ShCu and key atmospheric parameters that control both the development and evolution of ShCu using our new data product, which combines effectively the advantages of narrow-FOV data offered by zenith pointing cloud radars and lidars and wide-FOV TSI images. While the latest instrumentation at the ARM sites may address these challenging relationships in the future, we believe that the historical ARM data at the SGP site has not yet been fully utilized. Overall, our data product can be used by researchers working on a wide range of climate-related projects. These projects may include (i) a comprehensive evaluation of outputs from the Large-Eddy Simulation (LES) and single-column models for their future improvement, (ii) the representativeness of “short-period” results obtained from the previous model and observational studies and (iii) the planning of future field campaigns with focus on improved understanding of the diurnal cycle of cumulus convection.

54 ENVIRONMENTAL SCIENCES↗

Cluster Method Analysis of K. S. C. Image

Information obtained from satellite-based systems has moved to the forefront as a method in the identification of many land cover types. Identification of different land features through remote sensing is an effective tool for regional and global assessment of geometric characteristics. Classification data acquired from remote sensing images have a wide variety of applications. In particular, analysis of remote sensing images have special applications in the classification of various types of vegetation. Results obtained from classification studies of a particular area or region serve towards a greater understanding of what parameters (ecological, temporal, etc.) affect the region being analyzed. In this paper, we make a distinction between both types of classification approaches although, focus is given to the unsupervised classification method using 1987 Thematic Mapped (TM) images of Kennedy Space Center.

Rodriguez, Joe, Jr.↗

Rock type discrimination techniques using Landsat and Seasat image data

Results of a sedimentary rock type discrimination project using Seasat radar and Landsat multispectral image data of the San Rafael Swell, in eastern Utah, are presented, which has the goal of determining the potential contribution of radar image data to Landsat image data for rock type discrimination, particularly when the images are coregistered. The procedure employs several images processing techniques using the Landsat and Seasat data independently, and then both data sets are coregistered. The images are evaluated according to the ease with which contacts can be located and rock units (not just stratigraphically adjacent ones) separated. Results show that of the Landsat images evaluated, the image using a supervised classification scheme is the best for sedimentary rock type discrimination. Of less value, in decreasing order, are color ratio composites, principal components, and the standard color composite. In addition, for rock type discrimination, the black and white Seasat image is less useful than any of the Landsat color images by itself. However, it is found that the incorporation of the surface textural measures made from the Seasat image provides a considerable and worthwhile improvement in rock type discrimination.

Blom, R.↗