Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Classification of the LCVF AVIRIS test site with a Kohonen artificial neural network

We present a classification of an AVIRIS spectral image of the Lunar Crater Volcanic Field (LCVF). Geologic mapping from such data is made possible by distinctive mineral signatures: absorption features and the shape of the spectral continuum. The subtle spectral shape differences between some of the geological units in this scene along with the high dimensionality of the spectral presents a challenging pattern recognition task. We found an artificial neural network powerful in separating 13 geological units based on the full spectral resolution. The LCVF, in northern Nye County, Nevada, was the primary focus of the NASA-sponsored Geologic Remote Sensing Field Experiment in the summer of 1989. It consists of over 100 square miles of Quaternary basaltic pyroclastic and flow deposits. These deposits lie atop ignimbrites and silicic lava flows of Tertiary age and in turn are overlain by Quaternary alluvial and playa deposits. This AVIRIS image was collected on September 29, 1989 at 11:44 at 11:44 PDT. The 256-by-256 pixel subsection in this study contains oxidized basaltic cinder deposits, the southern half of the Lunar Lake playa, and outcrops of the Rhyollite of Big Sand Spring Valley. Vegetation in LCVF is sparse, but locally abundant within washes and near springs.

Merenyi, Erzsebet↗

Remote Sensing Information Science Research

This document is the final report summarizing research conducted by the Remote Sensing Research Unit, Department of Geography, University of California, Santa Barbara under National Aeronautics and Space Administration Research Grant NAG5-10457. This document describes work performed during the period of 1 March 2001 thorough 30 September 2002. This report includes a survey of research proposed and performed within RSRU and the UCSB Geography Department during the past 25 years. A broad suite of RSRU research conducted under NAG5-10457 is also described under themes of Applied Research Activities and Information Science Research. This research includes: 1. NASA ESA Research Grant Performance Metrics Reporting. 2. Global Data Set Thematic Accuracy Analysis. 3. ISCGM/Global Map Project Support. 4. Cooperative International Activities. 5. User Model Study of Global Environmental Data Sets. 6. Global Spatial Data Infrastructure. 7. CIESIN Collaboration. 8. On the Value of Coordinating Landsat Operations. 10. The California Marine Protected Areas Database: Compilation and Accuracy Issues. 11. Assessing Landslide Hazard Over a 130-Year Period for La Conchita, California Remote Sensing and Spatial Metrics for Applied Urban Area Analysis, including: (1) IKONOS Data Processing for Urban Analysis. (2) Image Segmentation and Object Oriented Classification. (3) Spectral Properties of Urban Materials. (4) Spatial Scale in Urban Mapping. (5) Variable Scale Spatial and Temporal Urban Growth Signatures. (6) Interpretation and Verification of SLEUTH Modeling Results. (7) Spatial Land Cover Pattern Analysis for Representing Urban Land Use and Socioeconomic Structures. 12. Colorado River Flood Plain Remote Sensing Study Support. 13. African Rainfall Modeling and Assessment. 14. Remote Sensing and GIS Integration.

Clarke, Keith C.↗

Terrain-Moisture Classification Using GPS Surface-Reflected Signals

In this study we present a novel method of land surface classification using surface-reflected GPS signals in combination with digital imagery. Two GPS-derived classification features are merged with visible image data to create terrain-moisture (TM) classes, defined here as visibly identifiable terrain or landcover classes containing a surface/soil moisture component. As compared to using surface imagery alone, classification accuracy is significantly improved for a number of visible classes when adding the GPS-based signal features. Since the strength of the reflected GPS signal is proportional to the amount of moisture in the surface, use of these GPS features provides information about the surface that is not obtainable using visible wavelengths alone. Application areas include hydrology, precision agriculture, and wetlands mapping.

Grant, Michael S.↗

Mars Exploration Rovers Entry, Descent, and Landing Trajectory Analysis

In this study we present a novel method of land surface classification using surface-reflected GPS signals in combination with digital imagery. Two GPS-derived classification features are merged with visible image data to create terrain-moisture (TM) classes, defined here as visibly identifiable terrain or landcover classes containing a surface/soil moisture component. As compared to using surface imagery alone, classification accuracy is significantly improved for a number of visible classes when adding the GPS-based signal features. Since the strength of the reflected GPS signal is proportional to the amount of moisture in the surface, use of these GPS features provides information about the surface that is not obtainable using visible wavelengths alone. Application areas include hydrology, precision agriculture, and wetlands mapping.

Desai, Prasun N.↗

Alaska: Glaciers of Kenai Fjords National Park and Katmai and Lake Clark National Parks and Preserve

There are hundreds of glaciers in Kenai Fjords National Park (KEFJ) and Katmai National Park and Preserve (KATM) covering over 2276 sq km of park land (circa 2000). There are two primary glacierized areas in KEFJ -- the Harding Icefield and the Grewingk-Yalik Glacier Complex, and three primary glacierized areas in KATM - the Mt. Douglas area, the Kukak Volcano to Mt. Katmai area and the Mt. Martin area. Most glaciers in these parks terminate on land, though a few terminate in lakes. Only KEFJ has tidewater glaciers, which terminate in the ocean. Glacier mapping and analysis of the change in glacier extent has been accomplished on a decadal scale using satellite imagery, primarily Landsat data from the 1970s, 1980s, and from 2000. Landsat Multispectral Scanner (MSS), Thematic Mapper (TM) and Enhanced Thematic Mapper Plus (ETM+) imagery was used to map glacier extent on a park-wide basis. Classification of glacier ice using image processing software, along with extensive manual editing, was employed to create Geographic Information System (GIS) outlines of the glacier extent for each park. Many glaciers that originate in KEFJ but terminate outside the park boundaries were also mapped. Results of the analysis show that there has been a reduction in the amount of glacier ice cover in the two parks over the study period. Our measurements show a reduction of approximately 21 sq km, or -1.5% (from 1986 to 2000), and 76 sq km, or -7.7% (from 1986/87 to 2000), in KEFJ and KATM, respectively. This work represents the first comprehensive study of glaciers of KATM. Issues that complicate the mapping of glacier extent include: debris-cover (moraine and volcanic ash), shadows, clouds, fresh snow, lingering snow from the previous season, and differences in spatial resolution between the MSS and TM or ETM+ sensors. Similar glacier mapping efforts in western Canada estimate mapping errors of 3-4%. Measurements were also collected from a suite of glaciers in KEFJ and KATM detailing terminus positions and rates of recession using datasets including the 15-minute USGS quadrangle maps (1950/1951), Landsat imagery (1986/1987, 2000, 2006) and 2005 Ikonos imagery (KEFJ only).

Giffen, bruce A.↗

Contextual Segmentation of Fire Spotting Regions Through Satellite-Augmented Autonomous Modular Sensor Image

Globally, forest fires remain a significant threat to human and environmental wellbeing. Towards mitigating the impacts of forest fires, it is critical that accurate and updated information regarding not only the fire line, but also nearby human settlements, vegetation, and water sources is reported quickly to emergency services. However, while existing UAS-based fire detection methods are effective, they largely do not report the contextual environmental information necessary to best serve nearby communities in disaster response. Additionally, modern advancements in deep learning offer new approaches for image segmentation which may improve classification accuracy beyond current pixel-wise indices. In this work, we benchmark the performance of these modern segmentation techniques in locating both fire lines and environmental features in historical Autonomous Modular Sensor imagery. Furthermore, we augment these outputs with satellite imagery segmentation towards developing a robust contextual mapping tool for rapid emergency fire response and decision making.

Nikhil Behari↗

Michel Electron Selection with SPINE for DUNE Far Detector Simulation

Michel electrons are a valuable input for particle detector calibration due to their consistent kinetic energy distribution. This report details the evaluation of a Michel electron identification method's application to simulated data from the DUNE (Deep Underground Neutrino Experiment) far detector. This method, which relies on the neural network-based particle classification software SPINE (Scalable Particle Imaging with Neural Embeddings), was developed and calibrated using simulated data for the SBND (Short-Baseline Neutrino Detector) experiment before being applied to simulated DUNE data from a 1x2x6 subset of far detector modules.

Wilson, Dante [Colorado State U.]↗

Grassmannian Diffusion Maps--Based Dimension Reduction and Classification for High-Dimensional Data

This work introduces the Grassmannian diffusion maps (GDMaps), a novel nonlinear dimensionality reduction technique that defines the affinity between points through their representation as low-dimensional subspaces corresponding to points on the Grassmann manifold. Here, the method is designed for applications, such as image recognition and data-based classification of constrained high-dimensional data where each data point itself is a high-dimensional object (i.e., a large matrix) that can be compactly represented in a lower-dimensional subspace. The GDMaps is composed of two stages. The first is a pointwise linear dimensionality reduction wherein each high-dimensional object is mapped onto the Grassmann manifold representing the low-dimensional subspace on which it resides. The second stage is a multipoint nonlinear kernel-based dimension reduction using diffusion maps to identify the subspace structure of the points on the Grassmann manifold. To this end, an appropriate Grassmannian kernel is used to construct the transition matrix of a random walk on a graph connecting points on the Grassmann manifold. Spectral analysis of the transition matrix yields low-dimensional Grassmannian diffusion coordinates embedding the data into a low-dimensional reproducing kernel Hilbert space. Further, a novel data classification/recognition technique is developed based on the construction of an overcomplete dictionary of reduced dimension whose atoms are given by the Grassmannian diffusion coordinates. Three examples are considered. First, a "toy" example shows that the GDMaps can identify an appropriate parametrization of structured points on the unit sphere. The second example demonstrates the ability of the GDMaps to revealing the intrinsic subspace structure of high-dimensional random field data. In the last ex- ample, a face recognition problem is solved considering face images subject to varying illumination conditions, changes in face expressions, and occurrence of occlusions. The technique presented high recognition rates (i.e., 95% in the best case) using a fraction of the data required by conventional methods.

42 ENGINEERING↗

Technical Performance and Cost Optimization of Unobtrusive Multi-static Serial LiDAR Imager (UMSLI) for Wide-area Surveillance and Identification of Marine Life at Marine Energy Installations

Florida Atlantic University developed an underwater optical monitoring system prototype - Unobtrusive Multi-static Serial LiDAR Imager (UMSLI) - suitable for marine energy full project lifecycle observation (baseline, commissioning, and decommissioning), with an automated real-time classification of marine animals. With precursor 2014 DOE funding (award DE-EE0006787), a prototype UMSLI was demonstrated in a controlled laboratory environment and achieved a TRL 6. This EERE DE-EE0007828 award aimed to both increase the TRL of the UMSLI by improving the technology performance (e.g., increase distance of marine animal target detection capability, add additional species classification capabilities, improve the system performance during the day, etc.) and reduce the cost. The UMSLI presents a novel application of underwater distributed Light Detection And Ranging (LiDAR), an advanced remote sensing method that uses light in the form of laser pulses for an application, this paired with an algorithm provides 360 degrees underwater detection, imaging, and classification of marine life. This solution for underwater monitoring of biota preserves the advantages of traditional optical and acoustic solutions while overcoming many associated disadvantages for marine energy site environmental monitoring, such as difficulties in species detection and classification in low light or night and turbid environments. This new approach is a purposefully designed, reconfigurable adaptation of an existing class 3B laser technology into one UMSLI instrument that can be easily mounted on or around different classes of marine energy equipment, such as devices to capture ocean current energy or wave energy. The system uses relatively low average power, utilizes far-red (> 635nm) laser illumination to be invisible and eye-safe to marine animals, is compact, and cost-effective. The equipment is designed for long-term, maintenance-free operations (i.e., current design is targeting more than 7 days continuous operation), to inherently generate a sparse primary dataset that only includes detected anomalies, and to allow robust real-time automated animal classification and identification with a low data bandwidth requirement. The technology’s overarching goal for application, is a system that can be deployed to collect pre-installation baseline species observations at a proposed marine energy deployment site with minimal post-processing overhead. The envisioned system will also produce high-resolution imagery of marine animals through a wide range of conditions and support automated tracking and notification of the presence of managed animals within established perimeters of marine energy equipment to satisfy deployed marine energy projects’ endangered and threatened species monitoring requirements. Through the current project, we demonstrated the UMSLI prototype in an operational environment and increased the UMSLI’s Technology Readiness Level from 6 to 7. The project resulted in many novel technologies, including: 1) an eye-safe red laser based, low-cost LiDAR system that can detect targets up to 10 meters distance; 2) the GAN-based machine learning underwater LiDAR image enhancement technique (this is the first known application of GAN technique in underwater LiDAR); 3) LiDAR-based real-time automated detection capabilities; and 4) a template matching based automated classification tool. These technologies build a solid foundation for future efforts to develop an extended range electro-optical monitoring system suitable for marine energy deployments. In addition to technology development, a key lesson learned is that addressing regulatory and safety requirements must be front and center in any marine energy monitoring applications.

16 TIDAL AND WAVE POWER↗

A Multi‐Probe Automated Classification of Ice Crystal Habits During the IMPACTS Campaign

Although all ice crystals are unique, many can be grouped together by shape or habit, with members of a habit class sharing similar representations of properties such as fall velocity and growth rate. A decision tree algorithm designed to be adaptable to any particle imaging probe, thus enabling the creation of habit size distributions over a size range larger than that of any probe on its own, is used to classify ice crystals imaged by three airborne cloud probes in mid-latitude winter cyclones during the Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS) field campaign. Crystals are sorted into seven habit classes based on their morphological properties: sphere, column/needle, plate, graupel, dendrite, aggregate, and irregular. Although adaptability was its primary goal, the algorithm was found to be moderately skillful for identifying idealized habit images. Quantitative tests of the algorithm’s adaptability displayed mixed results, as Two-Dimensional Stereo Probe (2DS) classifications showed moderate correlation with Particle Habit Imaging and Polar Scattering Probe (PHIPS) classifications, but only weak correlation with High Volume Precipitation Spectrometer (HVPS) classifications. The algorithm was applied to random sets of images from each probe in a case study of a mesoscale snow band sampled on 7 February 2020. In the case study, qualitative analysis of particle images revealed general agreement on classifications among the probes, supporting the algorithm’s applicability to multiple cloud probes. Most classifications appeared correct upon manual inspection, suggesting that in practical use, the algorithm is reasonably able to classify non-idealized images.

Julian Schima↗

The use of spatial characteristics for the improvement of multispectral classification of remotely sensed data

Two techniques for the classification of multispectral remotely sensed data - the image processing technique of texture features, which is modeled after the human visual system, and the ECHO (Extraction and Classification of Homogeneous Objects) numerical technique - are examined. These two spatial analysis techniques are compared using Landsat imagery of an area of Indiana as an example, and it is found that the numerical approach is superior in classification accuracy and more efficient computationally.

Wiersma, D. J.↗

FPGA-accelerated SpeckleNN with SNL for real-time X-ray single-particle imaging

We present the implementation of a specialized version of our previously published unified embedding model, SpeckleNN, for real-time speckle pattern classification in X-ray Single-Particle Imaging (SPI), using the SLAC Neural Network Library (SNL) on an FPGA platform. This hardware realization transitions SpeckleNN from a prototypic model into a practical edge solution, optimized for running inference near the detector in high-throughput X-ray free-electron laser (XFEL) facilities, such as those found at the Linac Coherent Light Source (LCLS). To address the resource constraints inherent in FPGAs, we developed a more specialized version of SpeckleNN. The original model, which was designed for broader classification across multiple biological samples, comprised ~5.6 million parameters. The new implementation, while reducing the parameter count to 64.6K (a 98.8% reduction), focuses on maintaining the model's essential functionality for real-time operation, achieving an accuracy of 90%. Furthermore, we compressed the latent space from 128 to 50 dimensions. This implementation was demonstrated on the KCU1500 FPGA board, utilizing 71% of available DSPs, 75% of LUTs, and 48% of FFs, with an average power consumption of 9.4W according to the Vivado post-implementation report. The FPGA performed inference on a single image with a latency of 45.015 microseconds at a 200 MHz clock rate. In comparison, running the same inference on an NVIDIA A100 GPU resulted in an average power consumption of ~73W and an image processing latency of around 400 microseconds. Our FPGA-accelerated version of SpeckleNN demonstrated significant improvements, achieving an 8.9 × speedup and a 7.8 × reduction in power consumption compared to the GPU implementation. Key advancements include model specialization and dynamic weight loading through SNL, which eliminates the need for time-consuming FPGA design re-synthesis, allowing fast and continuous deployment of models (re)trained online. These innovations enable real-time adaptive classification and efficient vetoing of speckle patterns, making SpeckleNN more suited for deployment in XFEL facilities. This implementation has the potential to significantly accelerate SPI experiments and enhance adaptability to evolving experimental conditions.

47 OTHER INSTRUMENTATION↗

User oriented ERTS-1 images

Photographic reproduction of ERTS-1 images are capable of displaying only a portion of the total information available from the multispectral scanner. Methods are being developed to generate ERTS-1 images oriented towards special users such as agriculturists, foresters, and hydrologists by applying image enhancement techniques and interactive statistical classification schemes. Spatial boundaries and linear features can be emphasized and delineated using simple filters. Linear and nonlinear transformations can be applied to the spectral data to emphasize certain ground information. An automatic classification scheme was developed to identify particular ground cover classes such as fallow, grain, rape seed or various vegetation covers. The scheme applies the maximum likelihood decision rule to the spectral information and classifies the ERTS-1 image on a pixel by pixel basis. Preliminary results indicate that the classifier has limited success in distinguishing crops, but is well adapted for identifying different types of vegetation.

Shlien, S.↗

Vulnerability of Wetlands Due to Projected Sea-Level Rise in the Coastal Plains of the South and Southeast United States

Coastal wetlands are vulnerable to accelerated sea-level rise, yet knowledge about their extent and distribution is often limited. We developed a land cover classification of wetlands in the coastal plains of the southern United States along the Gulf of Mexico (Texas, Louisiana, Mississippi, Alabama, and Florida) using 6161 very-high (2 m per pixel) resolution WorldView-2 and WorldView-3 satellite images from 2012 to 2015. Area extent estimations were obtained for the following vegetated classes: marsh, scrub, grass, forested upland, and forested wetland, located in elevation brackets between 0 and 10 m above sea level at 0.1 m intervals. Sea-level trends were estimated for each coastal state using tide gauge data collected over the period 1983–2021 and projected for 2100 using the trend estimated over that period. These trends were considered conservative, as sea level rise in the region accelerated between 2010 and 2021. Estimated losses in vegetation area due to sea level rise by 2100 are projected to be at least 12,587 km 2 , of which 3224 km 2 would be coastal wetlands. Louisiana is expected to suffer the largest losses in vegetation (80%) and coastal wetlands (75%) by 2100. Such high-resolution coastal mapping products help to guide adaptation plans in the region, including planning for wetland conservation and coastal development.

54 ENVIRONMENTAL SCIENCES↗

Automated thematic mapping and change detection of ERTS-A images

The author has identified the following significant results. For the exploitation of the ERTS-1 images, both multispectral and spatial pattern recognition techniques are important. A multispectral recognition software program was successfully tested. A technique for the generation of resource boundaries has been successfully combined with terrain recognition software resulting in a regionalized terrain classification system. Digital registration of multispectral images has been achieved. Also, photointerpretation results from one test site are reported and the development of spatial terrain signatures from optical diffraction patterns is described.

Gramenopoulos, N.↗

Land Cover/Land Use Classification and Change Detection Analysis with Astronaut Photography and Geographic Object-Based Image Analysis

For over fifty years, NASA astronauts have taken exceptional photographs of the Earth from the unique vantage point of low Earth orbit (as well as from lunar orbit and surface of the Moon). The Crew Earth Observations (CEO) Facility is the NASA ISS payload supporting astronaut photography of the Earth surface and atmosphere. From aurora to mountain ranges, deltas, and cities, there are over two million images of the Earth's surface dating back to the Mercury missions in the early 1960s. The Gateway to Astronaut Photography of Earth website (eol.jsc.nasa.gov) provides a publically accessible platform to query and download these images at a variety of spatial resolutions and perform scientific research at no cost to the end user. As a demonstration to the science, application, and education user communities we examine astronaut photography of the Washington D.C. metropolitan area for three time steps between 1998 and 2016 using Geographic Object-Based Image Analysis (GEOBIA) to classify and quantify land cover/land use and provide a template for future change detection studies with astronaut photography.

Hollier, Andi B.↗

Nuclear Canister Corrosion Detection

The software titled "nccd" is used for running residual neural networks (ResNets) on images of nuclear canisters. The software provides only the code for the implementation (based on the fastai library), but it does not share the image data. The compute code allows the use of residual nets (and more generally of other deep learning models) for classifying images from nuclear canisters as corroded. or intact. An image is considered to be corroded if it contains pitting or stress corrosion cracks. The code trains ResNets on image tiles extracted from original images from nuclear canisters, and then implements a classification rule, which can be applied to a validation set to decide if each original image is corroded or intact. The software automates the process of using images taken from nuclear canisters to detect corrosion. It provides also scope for future research directions on the basis of the existing research and code.

Papamarkou, Theodore↗