Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Sea ice feature and type identification in merged ERS-1 SAR and LANDSAT Thematic Mapper imagery

LANDSAT Thematic Mapper (TM) and ERS-1 SAR (Synthetic Aperture Radar) C band images were acquired for the same area in the Beaufort Sea, 18 Apr. 1992. The two images were co-located to the same grid (25 m resolution) and supervised classification was performed on the TM channel 3 scene in order to classify open water, nilas, grey ice, first year ice, and multiyear ice. Comparison of the LANDSAT classification and the corresponding dB values from the SAR scene showed that, under the given circumstances (high surface winds), open water/nilas/grey ice as defined by a single ice category by the SAR classifier could not be distinguished from first year ice. Surface roughening due to wind appears to be a major problem for the SAR classifier, as the range of the dB values is large enough to overlap all the other ice categories. Additional information, such as surface wind speed is necessary to overcome part of this problem.

Steffen, K.↗

Estimating dry grass residues using landscape integration analysis

The acreage of grassland and grassland-savannah is extensive in California, making direct measurement and assessment logistically impossible. Grasslands cover the entire Central Valley up to about 1200 m elevation in the Coast Range and Sierra Nevada Range. Kuchler's map shows 5.35 M ha grassland with an additional 3.87 M ha in Oak savannah. The goal of this study was to examine the use of high spectral resolution sensors to distinguish between dry grass and soil in remotely sensed images. Spectral features that distinguish soils and dry plant material in the shortwave infrared (SWIR) region are thought to be primarily caused by cellulose and lignin, biochemicals which are absent from soils or occur as breakdown products in humid substances that lack the narrow-band features. We have used spectral mixing analysis (SMA) combined with Geographic Information Systems (GIS) analysis to characterize plant communities and dry grass biomass. The GIS was used to overlay elevation maps, and vegetation maps, with the SMA results. The advantage of non-image data is that it provides an independent source of information for the community classification.

Hart, Quinn J.↗

Real Time Intelligent Target Detection and Analysis with Machine Vision

We present an algorithm for detecting a specified set of targets for an Automatic Target Recognition (ATR) application. ATR involves processing images for detecting, classifying, and tracking targets embedded in a background scene. We address the problem of discriminating between targets and nontarget objects in a scene by evaluating 40x40 image blocks belonging to an image. Each image block is first projected onto a set of templates specifically designed to separate images of targets embedded in a typical background scene from those background images without targets. These filters are found using directed principal component analysis which maximally separates the two groups. The projected images are then clustered into one of n classes based on a minimum distance to a set of n cluster prototypes. These cluster prototypes have previously been identified using a modified clustering algorithm based on prior sensed data. Each projected image pattern is then fed into the associated cluster's trained neural network for classification. A detailed description of our algorithm will be given in this paper. We outline our methodology for designing the templates, describe our modified clustering algorithm, and provide details on the neural network classifiers. Evaluation of the overall algorithm demonstrates that our detection rates approach 96% with a false positive rate of less than 0.03%.

Howard, Ayanna↗

Finite Element Modeling Used to Study Stress Distribution on the Foot

A method to study the stress distribution inside the forefoot during walking was developed at the Cleveland Clinic Foundation by a researcher from the NASA Glenn Research Center. In this method, a semiautomated process was outlined to create a three-dimensional, patient-specific, finite element model (FEM) of the forefoot using magnetic resonance images (MRI). The images were processed in Matlab using the k-nearest neighbor (k-NN) classification algorithm and Sobel edge detection to separate the different tissue types: bone, skin, fat, and muscle. This information was used to create curves and surfaces that were exported to an FEM preprocessor known as Truegrid. In Truegrid, eight-noded or brick elements were created by using surface mapping. The FEM was processed and postprocessed in Abaqus. Material properties of the models were obtained from past experiments such as fat pad confined compression, skin axial and biaxial tests, muscle in vivo compressive tests, and reference literature (bone properties). Nonlinear (hyperelastic) material models were used for the skin (epidermis and dermis), fat, and muscles; and a linear elastic model was used for the bones. Muscle activation during walking yielded uncertainties in the muscle material model since contracted muscles are stiffer than relaxed muscles. These uncertainties were resolved by performing a sensitivity analysis of the muscle material properties. The original properties were multiplied by arbitrary factors of 2, 3, 0.5, and 0.33. The strain and stress distributions, as well as the locations of peak values, were similar in all cases. The peak contact pressure P obtained for each case varied with respect to the applied factor f as follows:

Morales, Nelson↗

ELM: Europa Luminescence Microscope

The Europa Luminescence Microscope (ELM) is an automated fluorescence and bright-field microscope designed to meet key objectives defined in the 2016 NASA Europa Lander Study Report, including the identification and characterization of morphological biosignatures. ELM’s heritage stems from a 2U cubesat fluorescence microscope, the Fluorescence Analysis for In situ Research imager, designed and built at NASA Ames Research Center, for the autonomous study of microbial biology in low Earth orbit. For ELM implementation, a sample is autonomously manipulated with a microfluidic system using in-line 10, 1.0, and 0.2 μm pore-size filters to capture successively smaller particles for imaging. For bright-field imaging, ELM uses deep-ultraviolet, ultraviolet and visible light to image organic and inorganic structures with submicron resolution. The ability to detect biosignatures as small as 0.2 μm in size is achieved by imaging native fluorescence and using fluorescence microscopy stains to identify key structural and functional indicators of microbial life (proteins, lipids, nucleic acids). For fluorescence imaging, ELM uses 265, 370, 470, and 530 nm LEDs with five emission bands. The use of multiple excitation and emission wavelengths for native fluorescence imaging enables the detection of a wide range of molecular species and their rough classification. Excitation at 265 nm allows for the detection of smaller polycyclic aromatic hydrocarbons (PAH), aromatic amino acids, and proteins with little to no interference from mineral fluorescence, given proper emission band selection. 370 and 470 nm light excites increasingly larger PAH structures and larger aromatic biomolecules that may be present (e.g., protective pigments). Similarly, inorganic fluorescence can be characterized and separated from organic fluorescence, allowing the recognition and in some cases classification, of minerals and other abiotic particles. ELM is based upon work supported by the NASA COLDTech and ICEE-2 programs.

Richard C Quinn↗

Europa Luminescence Microscope

The Europa Luminescence Microscope (ELM) is an automated fluorescence and dark-field mi-croscope designed to meet key objectives defined in the NASA Europa Lander Study Report, includ-ing the identification and characterization of morphological biosignatures. ELM’s heritage stems from a 2U cubesat fluorescence microscope, the Fluorescence Analysis for In-situ Research (FLAIR) im-ager, designed and built at NASA Ames Research Center, for the autonomous study of microbial bi-ology in low Earth orbit. For the ELM implementation, a sample is autonomously manipulated with a microfluidic system using in-line filter sets to capture successively smaller particles on 10, 1.0, and 0.1 µm pore-size filters for imaging. For darkfield imaging, ELM uses ultraviolet and visible light to image organic and inorganic structures with submicron resolution. The ability to detect structural and chemical biosignatures as small as 0.2 µm in size is achieved by imaging native fluorescence and us-ing fluorescence microscopy stains to identify key molecular and structural indicators of microbial life (proteins, lipids, nucleic acids). To excite fluorescence, ELM uses LEDs with wavelengths centered near 265, 370, 470, and 530 nm and five emission bands. The use of multiple excitation and emission wavelengths for native fluorescence imaging not only enables the detection of different molecular species, but also their rough classification. Excitation at 265 nm allows for the detection of smaller polyaromatic hydrocarbons (PAHs; 1-5 rings), aromatic amino acids, and proteins with little to no interference from mineral fluorescence, given proper emission band selection. 370 and 470 nm light excites increasingly larger PAH structures (e.g., coronene) and larger aromatic biomolecules that may be present (e.g., protective pigments). Similarly, inorganic fluorescence can be characterized and sep-arated from organic fluorescence, allowing the recognition and in some cases classification, of miner-als and other abiotic particles. ELM is based upon work supported by the NASA COLDTech and ICEE-2 programs.

Microscope↗

An information theory characterization of radar images and a new definition for radiometric resolution

The noise properties of the radar image formation process are used in the present modeling of a communication channel in which the desired target properties are the information transmitted, and the final image represents the received signal. The average information rate over this communication channel is calculated together with appropriate bounds and approximations, and is found to be small on a per-sample basis. As a result, many samples must be averaged to allow for the discrimination, or classification, of several levels of target reflectivity. These information rate properties are consistent with known results concerning target detection and image quality in speckle, and the rate is applicable to the definition of radar image radiometric resolution. Radiometric resolution is functionally related to the degree of noncoherent averaging performed by the sensor.

Frost, V. S.↗

Land use mapping and modelling for the Phoenix Quadrangle

The author has identified the following significant results. The land use of the Phoenix Quadrangle in Arizona had been mapped previously from aerial photographs and recorded in a computer data bank. During the ERTS-1 experiment, changes in land use were detected using only the ERTS-1 images. The I2S color additive viewer was used as the principal image enhancement tool, operated in a multispectral mode. Hard copy color composite images of the best multiband combinations from ERTS-1 were made by photographic and diazo processes. The I2S viewer was also used to enhance changes between successive images by quick flip techniques or by registering with different color filters. More recently, a Bausch and Lomb zoom transferscope has been used for the same purpose. Improved interpretation of land use change resulted, and a map of changes within the Phoenix Quadrangle was compiled. The first level of a proposed standard land use classification system was sucessfully used. ERTS-1 underflight photography was used to check the accuracy of the ERTS-1 image interpretation. It was found that the total areas of change detected in the photos were comparable with the total areas of change detected in the ERTS-1 images.

Place, J. L.↗

SDSS-IV MaNGA: Unveiling Galaxy Interaction by Merger Stages with Machine Learning

We use machine-learning techniques to classify galaxy merger stages, which can unveil physical processes that drive the star formation and active galactic nucleus (AGN) activities during galaxy interaction. The sample contains 4690 galaxies from the integral field spectroscopy survey SDSS-IV MaNGA and can be separated into 1060 merging galaxies and 3630 nonmerging or unclassified galaxies. For the merger sample, there are 468, 125, 293, and 174 galaxies (1) in the incoming pair phase, (2) in the first pericentric passage phase, (3) approaching or just passing the apocenter, and (4) in the final coalescence phase or post-mergers. With the information of projected separation, line-of-sight velocity difference, Sloan Digital Sky Survey (SDSS) gri images, and MaNGA Hα velocity map, we are able to classify the mergers and their stages with good precision, which is the most important score to identify interacting galaxies. For the two-phase classification (binary; nonmerger and merger), the performance can be high (precision > 0.90) with LGBMClassifier . We find that sample size can be increased by rotation, so the five-phase classification (nonmerger, and merger stages 1, 2, 3, and 4) can also be good (precision > 0.85). The most important features come from SDSS gri images. The contribution from the MaNGA Hα velocity map, projected separation, and line-of-sight velocity difference can further improve the performance by 0%–20%. In other words, the image and the velocity information are sufficient to capture important features of galaxy interactions, and our results can apply to all the MaNGA data, as well as future all-sky surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Predicting U 3 O 8 powder processing conditions: An AI/ML approach analyzing deep learning embeddings of SEM micrographs

High-resolution SEM images of uranium-oxide powders encode micro- and nanoscale clues to their synthesis route and calcination temperature. We trained a ResNet-50 model on 11 commercial-scale U₃O₈ classes, ammonium diuranate (ADU) or uranyl peroxide (H₂O₂) precursors calcined at temperatures ranging from 400 to 750 °C and added a 256-D projection head before the classifier to analyze the learned representation. The best of eight seeds reached 92.4 % accuracy on reserved testing data, but our focus is the structure of the embedding space rather than the accuracy and labels. We quantify class relatedness in the original 256-D space using centroid similarity and distributional distances, and we use Uniform Manifold Approximation Projection (UMAP) for visualization. ‘Unknown’ images from different preparation methods, SEM operators, and from the literature localized near the expected classes under a nearest-centroid analysis without retraining, as well as clustered in similar UMAP space. In conclusion, this embedding-centered workflow complements black-box classification by providing quantitative, similarity-based comparisons of U₃O₈ morphologies and reduces storage space by up to 98 % for image data used in millisecond vector search comparisons.

36 MATERIALS SCIENCE↗

Multitemporal Snow Cover Mapping in Mountainous Terrain for Landsat Climate Data Record Development

A multitemporal method to map snow cover in mountainous terrain is proposed to guide Landsat climate data record (CDR) development. The Landsat image archive including MSS, TM, and ETM+ imagery was used to construct a prototype Landsat snow cover CDR for the interior northwestern United States. Landsat snow cover CDRs are designed to capture snow-covered area (SCA) variability at discrete bi-monthly intervals that correspond to ground-based snow telemetry (SNOTEL) snow-water-equivalent (SWE) measurements. The June 1 bi-monthly interval was selected for initial CDR development, and was based on peak snowmelt timing for this mountainous region. Fifty-four Landsat images from 1975 to 2011 were preprocessed that included image registration, top-of-the-atmosphere (TOA) reflectance conversion, cloud and shadow masking, and topographic normalization. Snow covered pixels were retrieved using the normalized difference snow index (NDSI) and unsupervised classification, and pixels having greater (less) than 50% snow cover were classified presence (absence). A normalized SCA equation was derived to independently estimate SCA given missing image coverage and cloud-shadow contamination. Relative frequency maps of missing pixels were assembled to assess whether systematic biases were embedded within this Landsat CDR. Our results suggest that it is possible to confidently estimate historical bi-monthly SCA from partially cloudy Landsat images. This multitemporal method is intended to guide Landsat CDR development for freshwaterscarce regions of the western US to monitor climate-driven changes in mountain snowpack extent.

Landsat↗

When Spectral Modeling Meets Convolutional Networks: A Method for Discovering Reionization-era Lensed Quasars in Multiband Imaging Data

Over the last two decades, around 300 quasars have been discovered at z ≳ 6, yet only one has been identified as being strongly gravitationally lensed. We explore a new approach—enlarging the permitted spectral parameter space, while introducing a new spatial geometry veto criterion—which is implemented via image-based deep learning. We first apply this approach to a systematic search for reionization-era lensed quasars, using data from the Dark Energy Survey, the Visible and Infrared Survey Telescope for Astronomy Hemisphere Survey, and the Wide-field Infrared Survey Explorer. Our search method consists of two main parts: (i) the preselection of the candidates, based on their spectral energy distributions (SEDs), using catalog-level photometry; and (ii) relative probability calculations of the candidates being a lens or some contaminant, utilizing a convolutional neural network (CNN) classification. The training data sets are constructed by painting deflected point-source lights over actual galaxy images, to generate realistic galaxy–quasar lens models, optimized to find systems with small image separations, i.e., Einstein radii of θ E ≤ 1''. Visual inspection is then performed for sources with CNN scores of P lens > 0.1, which leads us to obtain 36 newly selected lens candidates, which are awaiting spectroscopic confirmation. These findings show that automated SED modeling and deep learning pipelines, supported by modest human input, are a promising route for detecting strong lenses from large catalogs, which can overcome the veto limitations of primarily dropout-based SED selection approaches.

High-redshift galaxies↗

High-Resolution Image Products Acquired from Mid-Sized Uncrewed Aerial Systems for Land–Atmosphere Studies

We assess the viability of deploying commercially available multispectral and thermal imagers designed for integration on small uncrewed aerial systems (sUASs, <25 kg) on a mid-size Group-3-classification UAS (weight: 25–600 kg, maximum altitude: 5486 m MSL, maximum speed: 128 m/s) for the purpose of collecting a higher spatial resolution dataset that can be used for evaluating the surface energy budget and effects of surface heterogeneity on atmospheric processes than those datasets traditionally collected by instrumentation deployed on satellites and eddy covariance towers. A MicaSense Altum multispectral imager was deployed on two very similar mid-sized UASs operated by the Atmospheric Radiation Measurement (ARM) Aviation Facility. This paper evaluates the effects of flight on imaging systems mounted on UASs flying at higher altitudes and faster speeds for extended durations. We assess optimal calibration methods, acquisition rates, and flight plans for maximizing land surface area measurements. We developed, in-house, an automated workflow to correct the raw image frames and produce final data products, which we assess against known spectral ground targets and independent sources. We intend this manuscript to be used as a reference for collecting similar datasets in the future and for the datasets described within this manuscript to be used as launching points for future research.

47 OTHER INSTRUMENTATION↗

Elliptically-Contoured Tensor-variate Distributions with Application to Image Learning

Statistical analysis of tensor-valued data has largely used the tensor-variate normal (TVN) distribution that may be inadequate for data arising from distributions with heavier or lighter tails. We study a general family of elliptically contoured (EC) TV distributions and derive its characterizations, moments, marginal, and conditional distributions. We describe procedures for maximum likelihood estimation from data that are (1) uncorrelated draws from an EC distribution, (2) from a scale mixture of the TVN distribution, and (3) from an underlying but unknown EC distribution, for which we extend Tyler’s robust estimator. A detailed simulation study highlights the benefits of choosing an EC distribution over the TVN for heavier-tailed data. We develop TV classification rules using discriminant analysis and EC errors and show that they better predict cats and dogs from images in the Animal Faces-HQ dataset than the TVN-based rules. A novel tensor-on-tensor regression and TV analysis of variance (TANOVA) framework under EC errors is also demonstrated to better characterize gender, age, and ethnic origin than the usual TVN-based TANOVA in the celebrated labeled faces of the wild dataset.

97 MATHEMATICS AND COMPUTING↗

Landsat-D thematic mapper simulation in an urban area using aircraft multispectral scanner data

A simulation of imagery from the Landsat-D thematic mapper was conducted in order to determine its usefulness for urban land-use classification. Aircraft 24-channel multispectral scanner imagery of the Los Angeles area at 7.5-m resolution was processed digitally by means of matrix averaging and image smoothing techniques to simulate the 30-m resolution of the thematic mapper. Mean and standard deviation statistics of training sites for resolutions of 7.5, 15, 30 and 60 m were used to generate final classification maps. Plots of relative standard deviation showed that for larger training sites, as the resolution decreased, the distribution range of density values also decreased, while plots of relative classification accuracies showed that as resolution decreased, classification accuracies for three levels of standard deviation increased. A point of diminishing returns was indicated, however, confirming the utility of the resolution intended for Landsat-D.

Clark, J.↗

A Heterogeneous System for Eagle Detection, Deterrent, and Wildlife Collision Detection for Wind Turbines (Final Technical Report)

This report summarizes the design, implementation, and test of an integrated system for automated detection and deterrence of eagles, with included wind turbine blade strike detection and imaging functionality. A machine learning approach was used in conjunction with a 360° camera system for automated detection and classification of golden eagles. This was developed using footage obtained from trained golden eagles and other raptors, in collaboration with wildlife biologists and professional bird handlers. Oregon State University developed a visual deterrent system, which uses inflatable anthropomorphic sculptures with random, kinetic motion to deter eagles, and conducted limited field testing on live eagles; the deterrent can be triggered by the visual detection of eagles using the vision system. Finally, a multi-sensor module was developed that is mounted at the turbine blade root. This module measures vibration and other motions to detect blade strikes, and an integrated on-blade camera captures an image of any impacting objects. Long-term, this blade strike detection system is intended to support an automatic monitoring and certification system for the eagle detection and deterent system. Independent field testing of each system component is described. Testing of the integrated system on an operational wind turbine was conducted across three separate field tests. This includes multi-day fields tests on a General Electric 1.5MW wind turbine at the National Renewable Energy Laboratory (NREL) National Wind Technology Center (NWTC) in Boulder, CO in October 2018 and July 2019; installation procedures, test procedures, and a summary of collected data are presented. A third multi-day on-turbine field test is also presented, which was performed using a General Electric 1.5MW wind turbine at the North American Wind Research and Training Center (NAWRTC) at Mesalands Community College, Tucumcari, NM in April 2019. Across these field tests, the vision system was demonstrated using unmanned aerial vehicles (UAV), and the eagle classification algorithm was not tested; the visual deterrent system was demonstrated, including automatic, remote deployment following surrogate visual detections; and, multi-sensor on-blade data was recorded across multiple wind turbine operational conditions and through more than 100 surrogate blade strikes using soft projectiles, including the successful demonstration of automatic image capture of striking objects. This data set was also used for offline development and validation of enhanced collision detection algorithms. As summarized in this report, the development and field validation of an integrated detection, deterrent, and blade collision detection system represents a critical proof of concept for future technology development of related detection and deterrent technologies, where both deterrent as well as collision detection recording devices are needed for future siting, monitoring, and operation of wind turbine installations, both onshore and offshore.

17 WIND ENERGY↗

Implementation of ILLIAC 4 algorithms for multispectral image interpretation

Research has focused on the design and partial implementation of a comprehensive ILLIAC software system for computer-assisted interpretation of multispectral earth resources data such as that now collected by the Earth Resources Technology Satellite. Research suggests generally that the ILLIAC 4 should be as much as two orders of magnitude more cost effective than serial processing computers for digital interpretation of ERTS imagery via multivariate statistical classification techniques. The potential of the ARPA Network as a mechanism for interfacing geographically-dispersed users to an ILLIAC 4 image processing facility is discussed.

Ray, R. M.↗

A study to analyze six band multispectral images and fabricate a Fourier transform detector

An automatic Fourier transform diffraction pattern sampling system, used to investigate techniques for forestry classification of six band multispectral aerial photography is presented. Photographs and diagrams of the design, development and fabrication of a hybrid optical-digital Fourier transform detector are shown. The detector was designed around a concentric ring fiber optic array. This array was formed from many optical fibers which were sorted into concentric rings about a single fiber. All the fibers in each ring were collected into a bundle and terminated into a single photodetector. An optical/digital interface unit consisting of a high level multiplexer, and an analog-to-digital amplifier was also constructed and is described.

Shackelford, R. G.↗