Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

A scene-analysis approach to remote sensing

The author has identified the following significant results. Geometric correspondance between a sensed image and a symbolic map is established in an initial stage of processing by adjusting parameters of a sensed model so that the image features predicted from the map optimally match corresponding features extracted from the sensed image. Information in the map is then used to constrain where to look in an image, what to look for, and how to interpret what is seen. For simple monitoring tasks involving multispectral classification, these constraints significantly reduce computation, simplify interpretation, and improve the utility of the resulting information. Previously intractable tasks requiring spatial and textural analysis may become straightforward in the context established by the map knowledge. The use of map-guided image analysis in monitoring the volume of water in a reservoir, the number of boxcars in a railyard, and the number of ships in a harbor is demonstrated.

Tenenbaum, J. M.↗

Vegetation species composition and canopy architecture information expressed in leaf water absorption measured in the 1000 nm and 2200 spectral region by an imaging spectrometer

Plant species composition and plant architectural attributes are critical parameters required for the measuring, monitoring, and modeling of terrestrial ecosystems. Remote sensing is commonly cited as an important tool for deriving vegetation properties at an appropriate scale for ecosystem studies, ranging from local to regional and even synoptic scales. Classical approaches rely on vegetation indices such as the normalized difference vegetation index (NDVI) to estimate biophysical parameters such as leaf area index or intercepted photosynthetically active radiation (IPAR). Another approach is to apply a variety of classification schemes to map vegetation and thus extrapolate fine-scale information about specific sites to larger areas of similar composition. Imaging spectrometry provides additional information that is not obtainable through broad-band sensors and that may provide improved inputs both to direct biophysical estimates as well as classification schemes. Some of this capability has been demonstrated through improved discrimination of vegetation, estimates of canopy biochemistry, and liquid water estimates from vegetation. We investigate further the potential of leaf water absorption estimated from Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) data as a means for discriminating vegetation types and deriving canopy architectural information. We expand our analysis to incorporate liquid water estimates from two spectral regions, the 1000-nm region and the 2200-nm region. The study was conducted in the vicinity of Jasper Ridge, California, which is located on the San Francisco peninsula to the west of the Stanford University campus. AVIRIS data were acquired over Jasper Ridge, CA, on June 2, 1992, at 19:31 UTC. Spectra from three sites in this image were analyzed. These data are from an area of healthy grass, oak woodland, and redwood forest, respectively. For these analyses, the AVIRIS-measured upwelling radiance spectra for the entire Jasper Ridge scene were transformed to apparent surface reflectance using a radiative transfer code-based inversion algorithm.

Green, Robert O.↗

Pre-training Vision Models for the Classification of Alerts from Wide-field Time-domain Surveys

Modern wide-field time-domain surveys facilitate the study of transient, variable and moving phenomena by conducting image differencing and relaying alerts to their communities. Machine learning tools have been used on data from these surveys and their precursors for more than a decade, and convolutional neural networks (CNNs), which make predictions directly from input images, saw particularly broad adoption through the 2010s. Since then, continually rapid advances in computer vision have transformed the standard practices around using such models. It is now commonplace to use standardized architectures pre-trained on large corpora of everyday images (e.g., ImageNet). In contrast, time-domain astronomy studies still typically design custom CNN architectures and train them from scratch. Here, we explore the effects of adopting various pre-training regimens and standardized model architectures on the performance of alert classification. We find that the resulting models match or outperform a custom, specialized CNN like what is typically used for filtering alerts. Moreover, our results show that pre-training on galaxy images from Galaxy Zoo tends to yield better performance than pre-training on ImageNet or training from scratch. We observe that the design of standardized architectures are much better optimized than the custom CNN baseline, requiring significantly less time and memory for inference despite having more trainable parameters. On the eve of the Legacy Survey of Space and Time and other image-differencing surveys, these findings advocate for a paradigm shift in the creation of vision models for alerts, demonstrating that greater performance and efficiency, in time and in data, can be achieved by adopting the latest practices from the computer vision field.

79 ASTRONOMY AND ASTROPHYSICS↗

Using dark current data to estimate AVIRIS noise covariance and improve spectral analyses

Starting in 1994, all AVIRIS data distributions include a new product useful for quantification and modeling of the noise in the reported radiance data. The 'postcal' file contains approximately 100 lines of dark current data collected at the end of each data acquisition run. In essence this is a regular spectral-image cube, with 614 samples, 100 lines and 224 channels, collected with a closed shutter. Since there is no incident radiance signal, the recorded DN measure only the DC signal level and the noise in the system. Similar dark current measurements, made at the end of each line are used, with a 100 line moving average, to remove the DC signal offset. Therefore, the pixel-by-pixel fluctuations about the mean of this dark current image provide an excellent model for the additive noise that is present in AVIRIS reported radiance data. The 61,400 dark current spectra can be used to calculate the noise levels in each channel and the noise covariance matrix. Both of these noise parameters should be used to improve spectral processing techniques. Some processing techniques, such as spectral curve fitting, will benefit from a robust estimate of the channel-dependent noise levels. Other techniques, such as automated unmixing and classification, will be improved by the stable and scene-independence noise covariance estimate. Future imaging spectrometry systems should have a similar ability to record dark current data, permitting this noise characterization and modeling.

Boardman, Joseph W.↗

Image-driven discriminative and generative machine learning algorithms for establishing microstructure–processing relationships

We investigate methods of microstructure representation for the purpose of predicting processing condition from microstructure image data. A binary alloy that is currently under development as a nuclear fuel was studied for the purpose of developing an improved machine learning approach to image recognition, characterization, and building predictive capabilities linking microstructure to processing conditions. Here, we test different microstructure representations and evaluate model performance based on classification accuracy. A classification accuracy of 95.8% was achieved fordistinguishing between micrographs corresponding to ten different thermo-mechanical material processing conditions.We find that our newly developed microstructure representation describes image data well, and the traditional approachof utilizing area fractions of different phases is insufficient for distinguishing between multiple classes using a relativelysmall, imbalanced original data set of 272 images. To explore the applicability of generative methods for supplementing such limited data sets, generative adversarial networks were trained to generate artificial microstructure images. Two different generative networks were trained and tested to assess performance. Challenges and best practices associated with applying machine learning to limited microstructure image data sets is also discussed. Our work has implications for quantitative microstructure analysis, and development of microstructure-processing relationships in limited data sets typical of metallurgical process design studies.

36 MATERIALS SCIENCE↗

Image applications for coastal resource planning: Elkhorn Slough Pilot Project

The purpose of this project has been to evaluate the utility of digital spectral imagery at two levels of resolution for large scale, accurate, auto-classification of land cover along the Central California Coast. Although remote sensing technology offers obvious advantages over on-the-ground mapping, there are substantial trade-offs that must be made between resolving power and costs. Higher resolution images can theoretically be used to identify smaller habitat patches, but they usually require more scenes to cover a given area and processing these images is computationally intense requiring much more computer time and memory. Lower resolution images can cover much larger areas, are less costly to store, process, and manipulate, but due to their larger pixel size can lack the resolving power of the denser images. This lack of resolving power can be critical in regions such as the Central California Coast where important habitat change often occurs on a scale of 10 meters. Our approach has been to compare vegetation and habitat classification results from two aircraft-based spectral scenes covering the same study area but at different levels of resolution with a previously produced ground-truthed land cover base map of the area. Both of the spectral images used for this project were of significantly higher resolution than the satellite-based LandSat scenes used in the C-CAP program. The lower reaches of the Elkhorn Slough watershed was chosen as an ideal study site because it encompasses a suite of important vegetation types and habitat loss processes characteristic of the central coast region. Dramatic habitat alterations have and are occurring within the Elkhorn Slough drainage area, including erosion and sedimentation, land use conversion, wetland loss, and incremental loss due to development and encroachnnent by agriculture. Additonally, much attention has already been focused on the Elkhorn Slough due to its status as a National Marine Education and Research Reserve and as part of the Monterey Bay National Marine Sanctuary. These destinations have resulted in a rich collection of prior spatial and temporal habitat data.

Kvitek, Rikk G.↗

A spectral-knowledge-based approach for urban land-cover discrimination

A prototype expert system was developed to demonstrate the feasibility of classifying multispectral remotely sensed data on the basis of spectral knowledge. The spectral expert was developed and tested with Thematic Mapper Simulator (TMS) data having eight spectral bands and a spatial resolution of 5 m. A knowledge base was developed that describes the target categories in terms of characteristic spectral relationships. The knowledge base was developed under the following assumptions: the data are calibrated to ground reflectance, the area is well illuminated, the pixels are dominated by a single category, and the target categories can be recognized without the use of spatial knowledge. Classification decisions are made on the basis of convergent evidence as derived from applying the spectral rules to a multiple spatial resolution representation of the image. The spectral expert achieved an accuracy of 80-percent correct or higher in recognizing 11 spectral categories in TMS data for the washington, DC, area. Classification performance can be expected to decrease for data that do not satisfy the above assumptions as illustrated by the 63-percent accuracy for 30-m resolution Thematic Mapper data.

Wharton, Stephen W.↗

AVIRIS Land-Surface Mapping in Support of the Boreal Ecosystem-Atmosphere Study (BOREAS)

A key scientific objective of the original Boreal Ecosystem-Atmospheric Study (BOREAS) field campaign (1993-1996) was to obtain the baseline data required for modeling and predicting fluxes of energy, mass, and trace gases in the boreal forest biome. These data sets are necessary to determine the sensitivity of the boreal forest biome to potential climatic changes and potential biophysical feedbacks on climate. A considerable volume of remotely-sensed and supporting field data were acquired by numerous researchers to meet this objective. By design, remote sensing and modeling were considered critical components for scaling efforts, extending point measurements from flux towers and field sites over larger spatial and longer temporal scales. A major focus of the BOREAS follow-on program is concerned with integrating the diverse remotely sensed and ground-based data sets to address specific questions such as carbon dynamics at local to regional scales. The Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) has the potential of contributing to BOREAS through: (1) accurate retrieved apparent surface reflectance; (2) improved landcover classification; and (3) direct assessment of biochemical/biophysical information such as canopy liquid water and chlorophyll concentration through pigment fits. In this paper, we present initial products for major flux tower sites including: (1) surface reflectance of dominant cover types; (2) a land-cover classification developed using spectral mixture analysis (SMA) and Multiple Endmember Spectral Mixture Analysis (MESMA); and (3) liquid water maps. Our goal is to compare these land-cover maps to existing maps and to incorporate AVIRIS image products into models of photosynthetic flux.

Roberts, Dar A.↗

The Land Use and Land Cover Dichotomy: A Comparison of Two Land Classification Systems in Support of Urban Earth Science Applications

One is likely to read the terms 'land use' and 'land cover' in the same sentence, yet these concepts have different origins and different applications. Land cover is typically analyzed by earth scientists working with remotely sensed images. Land use is typically studied by urban planners who must prescribe solutions that could prevent future problems. This apparent dichotomy has led to different classification systems for land-based data. The works of earth scientists and urban planning practitioners are beginning to come together in the field of spatial analysis and in their common use of new spatial analysis technology. In this context, the technology can stimulate a common 'language' that allows a broader sharing of ideas. The increasing amount of land use and land cover change challenges the various efforts to classify in ways that are efficient, effective, and agreeable to all groups of users. If land cover and land uses can be identified by remote methods using aerial photography and satellites, then these ways are more efficient than field surveys of the same area. New technology, such as high-resolution satellite sensors, and new methods, such as more refined algorithms for image interpretation, are providing refined data to better identify the actual cover and apparent use of land, thus effectiveness is improved. However, the closer together and the more vertical the land uses are, the more difficult the task of identification is, and the greater is the need to supplement remotely sensed data with field study (in situ). Thus, a number of land classification methods were developed in order to organize the greatly expanding volume of data on land characteristics in ways useful to different groups. This paper distinguishes two land based classification systems, one developed primarily for remotely sensed data, and the other, a more comprehensive system requiring in situ collection methods. The intent is to look at how the two systems developed and how they can work together so that land based information can be shared among different users and compared over time.

McAllister, William K.↗

Cric searchable image database as a public platform for conventional pap smear cytology data

Amidst the current health crisis and social distancing, telemedicine has become an important part of mainstream of healthcare, and building and deploying computational tools to support screening more efficiently is an increasing medical priority. The early identification of cervical cancer precursor lesions by Pap smear test can identify candidates for subsequent treatment. However, one of the main challenges is the accuracy of the conventional method, often subject to high rates of false negative. While machine learning has been highlighted to reduce the limitations of the test, the absence of high-quality curated datasets has prevented strategies development to improve cervical cancer screening. The Center for Recognition and Inspection of Cells (CRIC) platform enables the creation of CRIC Cervix collection, currently with 400 images (1,376 × 1,020 pixels) curated from conventional Pap smears, with manual classification of 11,534 cells. This collection has the potential to advance current efforts in training and testing machine learning algorithms for the automation of tasks as part of the cytopathological analysis in the routine work of laboratories.

59 BASIC BIOLOGICAL SCIENCES↗

gp_blendclass_singleband

The code used for the data preprocessing, image simulation, and model training and analysis reported in the paper "Gaussian Process Classification for Galaxy Blend Identification in LSST" (arXiv:2107.09246).

Buchanan, JamesJ.↗

Identification, definition and mapping of terrestrial ecosystems in interior Alaska

The author has identified the following significant results. The vegetation map in preparation at the time of the last report was refined and labeled. This map is presented as an indication of the spatial and classificatory detail possible from interpretations of enlarged ERTS-1 color photographs. Using this map, areas covered by the several vegetation types characterized by white spruce were determined by planimetry. A 1:63,360 scale land use map of the Juneau area was drawn. This map incorporates the land use classification system now under development by the U.S. Geological Survey. The ERTS-1 images used in making the Juneau map were used to determine changes in surface area of the terminal zones of advancing and receding glaciers, the Taku, Norris, and Mendenhall. A new 1:63,360 scale land use map of the Bonanza Creek Experimental Forest and vicinity was drawn. Several excellent new sciences of test areas were received from NASA in color-infrared transparency format. These are being used for making photographic prints for analysis and mapping according to procedures outlined in this report.

Anderson, J. H.↗

On vegetation mapping in Alaska using LANDSAT imagery with primary concerns for method and purpose in satellite image-based vegetation and land-use mapping and the visual interpretation of imagery in photographic format

The author has identified the following significant results. A simulated color infrared LANDSAT image covering the western Seward Peninsula was used for identifying and mapping vegetation by direct visual examination. The 1:1,083,400 scale print used was prepared by a color additive process using positive transparencies from MSS bands 4, 5, and 7. Seven color classes were recognized. A vegetation map of 3200 sq km area just west of Fairbanks, Alaska was made. Five colors were recognized on the image and identified to vegetation types roughly equivalent to formations in the UNESCO classification: orange - broadleaf deciduous forest; gray - needleleaf evergreen forest; light violet - subarctic alpine tundra vegetation; violet - broadleaf deciduous shrub thicket; and dull violet - bog vegetation.

Anderson, J. H.↗

Multiple directed graph large-class multi-spectral processor

Numerical analysis techniques for the interpretation of high-resolution imaging-spectrometer data are described and demonstrated. The method proposed involves the use of (1) a hierarchical classifier with a tree structure generated automatically by a Fisher linear-discriminant-function algorithm and (2) a novel multiple-directed-graph scheme which reduces the local maxima and the number of perturbations required. Results for a 500-class test problem involving simulated imaging-spectrometer data are presented in tables and graphs; 100-percent-correct classification is achieved with an improvement factor of 5.

Casasent, David↗

An Automated Mapping Processor using C-Band Interferometric SAR Data

We describe a processor which has been implemented to generate map products starting from C-band interferometric data. The first stage of the processor consists of the conventional interferometric synthetic aperture radar (SAR) processing producing a digital elevation model (DEM) and a SAR brightness image in sensor coordinates. In the second stage of processing, a land use classification map is obtained by using the DEM, brightness, and interferometric correlation layers. Auxiliary layers which include a drainage layer, a height gradient layer, a height error layer, an estimated penetration layer, and a shaded relief layer are also computed. In the final step, all UTM collocated layers are combined in a geographical information system (GIS) which allows for both hard copy map products and digital applications.

Rodriguez, E.↗

An Automated Mapping Processor Using C-Band Interferometric SAR Data

We present the description of a processor which has been implemented to generate map products starting from C-band interferometric data. The first stage of the processor consists of the conventional interferometric SAR processing producing a Digital Elevation Model (DEMs) and a SAR brightness image in sensor coordinates. In the second stage of processing, a land use classification map is obtained by using the DEM, brightness, and interferometric correlation layers. Auxiliary layers which include a drainage layer, a height gradient layer, a height error layer, an estimated penetration layer, and a shaded relief layer are also computed. In the final step, all UTM collocated layers are combined in a GIS system which allows for both hard copy map products and for digital applications.

Rodriguez, E.↗

Neural Network Based Sensory Fusion for Landmark Detection

NASA is planning to send numerous unmanned planetary missions to explore the space. This requires autonomous robotic vehicles which can navigate in an unstructured, unknown, and uncertain environment. Landmark based navigation is a new area of research which differs from the traditional goal-oriented navigation, where a mobile robot starts from an initial point and reaches a destination in accordance with a pre-planned path. The landmark based navigation has the advantage of allowing the robot to find its way without communication with the mission control station and without exact knowledge of its coordinates. Current algorithms based on landmark navigation however pose several constraints. First, they require large memories to store the images. Second, the task of comparing the images using traditional methods is computationally intensive and consequently real-time implementation is difficult. The method proposed here consists of three stages, First stage utilizes a heuristic-based algorithm to identify significant objects. The second stage utilizes a neural network (NN) to efficiently classify images of the identified objects. The third stage combines distance information with the classification results of neural networks for efficient and intelligent navigation.

Kumbla, Kishan -K.↗

Assessment of ICESat-2 Sea Ice Surface Classification with Sentinel-2 Imagery: Implications for Freeboard and New Estimates of Lead and Floe Geometry

NASA's Ice, Cloud, and Land Elevation Satellite-2 (ICESat-2) mission launched in September 2018 and is now providing high-resolution surface elevation profiling across the entire globe, including the sea ice cover of the Arctic and Southern Oceans. For sea ice applications, successfully discriminating returns between sea ice and open water is key for accurately determining freeboard (the extension of sea ice above local sea level) and new information regarding the geometry of sea ice floes and leads. We take advantage of near-coincident optical imagery obtained from the European Space Agency (ESA) Sentinel-2 (S-2) satellite over the Western Weddell Sea of the Southern Ocean in March 2019 and the Lincoln Sea of the Arctic Ocean in May 2019 to evaluate the surface classification scheme in the ICESat-2 ATL07 and ATL10 sea ice products. We find a high level of agreement between the ATL07 (specular) lead classification and visible leads in the S-2 imagery in these two coincident images across all six ICESat-2 beams, increasing our confidence in the freeboard products and deriving new estimates of the sea ice state. The S-2 overlays provide additional, albeit limited, evidence of the misclassification of dark leads due to clouds. Dark leads are no longer used to derive sea surface and thus freeboard as of the third release (r003) of the ICESat-2 sea ice products. We show estimates of lead fraction and more preliminary estimates of chord length (a proxy for floe size) using two metrics for classifying sea surface (lead) segments across both the Arctic and Southern Ocean for the first winter season of data collection.

A. A. Petty↗