Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image identification and recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2020

Assessment of holographic microscopy for quantifying marine particle size and concentration

Holographic microscopy has emerged as a tool for in situ imaging of microscopic organisms and other particles in the marine environment: appealing because of the relatively larger sampling volume and simpler optical configuration compared to other imaging systems. However, its quantitative capabilities have so far remained uncertain, in part because hologram reconstruction and image recognition have required manual operation. Here, we assess the quantitative skill of our automated hologram processing pipeline (CCV Pipeline), to evaluate the size and concentration measurements of environmental and cultured assemblages of marine plankton particles, and microspheres. Over 1 million particles, ranging from 10 to 200 μm in equivalent spherical diameter, imaged by the 4‐Deep HoloSea digital inline holographic microscope (DIHM) are analyzed. These measurements were collected in parallel with a FlowCam (FC), Imaging FlowCytobot (IFCB), and manual microscope identification. Once corrections for particle location and nonuniform illumination were developed and applied, the DIHM showed an underestimate in ESD of about 3% to 10%, but successfully reproduced the size spectral slope from environmental samples, and the size distribution of cultures (Dunaliella tertiolecta, Heterosigma akashiwo, and Prorocentrum micans) and microspheres. DIHM concentrations (order 1 to 1000 particles ml(exp −1)) showed a linear agreement (r(exp 2) = 0.73) with the other instruments, but individual comparisons at times had large uncertainty. Overall, we found the DIHM and the CCV Pipeline required extensive manual correction, but once corrected, provided concentration and size estimates comparable to the other imaging systems assessed in this study. Holographic cameras are mechanically simple, autonomous, can operate at very high pressures, and provide a larger sampling volume than comparable lens‐based tools. Thus, we anticipate that these characterization efforts will be rewarded with novel discovery in new oceanic environments.

Noah L. Walcutt↗
NASA NTRS1974

New theoretical models and ratio imaging techniques associated with the NASA earth resources spectral information system

Four independent investigations are reported; in general these are concerned with improving and utilizing the correlation between the physical properties of natural materials as evidenced in laboratory spectra and spectral data collected by multispectral scanners. In one investigation, two theoretical models were devised that permit the calculation of spectral emittance spectra for rock and mineral surfaces of various particle sizes. The simpler of the two models can be used to qualitatively predict the effect of texture on the spectral emittance of rocks and minerals; it is also potentially useful as an aid in predicting the identification of natural atmospheric aerosol constituents. The second investigation determined, via an infrared ratio imaging technique, the best pair of infrared filters for silicate rock-type discrimination. In a third investigation, laboratory spectra of natural materials were compressed into 11-digit ratio codes for use in feature selection, in searches for false alarm candidates, and eventually for use as training sets in completely automatic data processors. In the fourth investigation, general outlines of a ratio preprocessor and an automatic recognition map processor are developed for on-board data processing in the space shuttle era.

Vincent, R. K.↗
NASA NTRS1973

Management of natural resources through automatic cartographic inventory

The author has identified the following significant results. Over those parts of the ARNICA test site where ERTS-1 data were available, the search for correspondences between images and ground truth acquired by the vegetation and geology maps was quite positive. The probability of recognition of soil use types can be estimated at: (1) 100% for water plans, rivers, canals, swamplands, and wetlands; (2) 80%-100% for the major types of forestry, farmland zones, moorlands and pasturelands, and urbanization; (3) 20%-50% for communication lines; (4) 60%-80% for forestry species and organization of agricultural areas; (5) 40%-60% for finer discrimination between forest types and more accurate identification of cultivations; (6) 60%-90% for major geological features. These percentages will be improved upon as soon as it is possible to use the repetitive imagery. An early use of automatic cartography using ERTS-1 imagery was made possible for pine forests in the Central Pyrenees, the densitometric signature of which were particularly significant. Important observations were made in related fields of water resources, snow survey, estuary dynamics, and meteorology.

Rey, P.↗
NASA NTRS1995

Laser Opto-Electronic Correlator for Robotic Vision Automated Pattern Recognition

A compact laser opto-electronic correlator for pattern recognition has been designed, fabricated, and tested. Specifically it is a translation sensitivity adjustable compact optical correlator (TSACOC) utilizing convergent laser beams for the holographic filter. Its properties and performance, including the location of the correlation peak and the effects of lateral and longitudinal displacements for both filters and input images, are systematically analyzed based on the nonparaxial approximation for the reference beam. The theoretical analyses have been verified in experiments. In applying the TSACOC to important practical problems including fingerprint identification, we have found that the tolerance of the system to the input lateral displacement can be conveniently increased by changing a geometric factor of the system. The system can be compactly packaged using the miniature laser diode sources and can be used in space by the National Aeronautics and Space Administration (NASA) and ground commercial applications which include robotic vision, and industrial inspection of automated quality control operations. The personnel of Standard International will work closely with the Jet Propulsion Laboratory (JPL) to transfer the technology to the commercial market. Prototype systems will be fabricated to test the market and perfect the product. Large production will follow after successful results are achieved.

Laser Opto-Electronic↗
NASA NTRS1971

Techniques for generation of control and guidance signals derived from optical fields, part 2

The development is reported of a high resolution technique for the detection and identification of landmarks from spacecraft optical fields. By making use of nonlinear regression analysis, a method is presented whereby a sequence of synthetic images produced by a digital computer can be automatically adjusted to provide a least squares approximation to a real image. The convergence of the method is demonstrated by means of a computer simulation for both elliptical and rectangular patterns. Statistical simulation studies with elliptical and rectangular patterns show that the computational techniques developed are able to at least match human pattern recognition capabilities, even in the presence of large amounts of noise. Unlike most pattern recognition techniques, this ability is unaffected by arbitrary pattern rotation, translation, and scale change. Further development of the basic approach may eventually allow a spacecraft or robot vehicle to be provided with an ability to very accurately determine its spatial relationship to arbitrary known objects within its optical field of view.

Hemami, H.↗
NASA NTRS1994

Neural networks: Alternatives to conventional techniques for automatic docking

Automatic docking of orbiting spacecraft is a crucial operation involving the identification of vehicle orientation as well as complex approach dynamics. The chaser spacecraft must be able to recognize the target spacecraft within a scene and achieve accurate closing maneuvers. In a video-based system, a target scene must be captured and transformed into a pattern of pixels. Successful recognition lies in the interpretation of this pattern. Due to their powerful pattern recognition capabilities, artificial neural networks offer a potential role in interpretation and automatic docking processes. Neural networks can reduce the computational time required by existing image processing and control software. In addition, neural networks are capable of recognizing and adapting to changes in their dynamic environment, enabling enhanced performance, redundancy, and fault tolerance. Most neural networks are robust to failure, capable of continued operation with a slight degradation in performance after minor failures. This paper discusses the particular automatic docking tasks neural networks can perform as viable alternatives to conventional techniques.

Vinz, Bradley L.↗
NASA NTRS1997

A Scalable Distributed Approach to Mobile Robot Vision

This paper documents our progress during the first year of work on our original proposal entitled 'A Scalable Distributed Approach to Mobile Robot Vision'. We are pursuing a strategy for real-time visual identification and tracking of complex objects which does not rely on specialized image-processing hardware. In this system perceptual schemas represent objects as a graph of primitive features. Distributed software agents identify and track these features, using variable-geometry image subwindows of limited size. Active control of imaging parameters and selective processing makes simultaneous real-time tracking of many primitive features tractable. Perceptual schemas operate independently from the tracking of primitive features, so that real-time tracking of a set of image features is not hurt by latency in recognition of the object that those features make up. The architecture allows semantically significant features to be tracked with limited expenditure of computational resources, and allows the visual computation to be distributed across a network of processors. Early experiments are described which demonstrate the usefulness of this formulation, followed by a brief overview of our more recent progress (after the first year).

Kuipers, Benjamin↗
NASA NTRS1974

The utility of ERTS-1 data for applications in land use classification

A comprehensive study has been undertaken to determine the extent to which conventional image interpretation and computer-aided (spectral pattern recognition) analysis techniques using ERTS-1 data could be used to detect, identify (classify), locate, and measure current land use over large geographic areas. It can be concluded that most of the level 1 and 2 categories in the USGS Circular no. 671 can be detected in the Houston-Gulf Coast area using a combination of both techniques for analysis. These capabilities could be exercised over larger geographic areas, however, certain factors such as different vegetative cover, topography, etc. may have to be considered in other geographic regions. The best results in identification (classification), location, and measurement of level 1 and 2 type categories appear to be obtainable through automatic data processing of multispectral scanner computer compatible tapes.

Dornbach, J. E.↗
NASA NTRS1978

Discrimination of rock classes and alteration products in southwestern Saudi Arabia with computer-enhanced LANDSAT data

Digital LANDSAT MSS data for an area in the southwestern Arabian Shield were computer-enhanced to improve discrimination of rock classes, and recognition of gossans associated with massive sulphide deposits. The test area is underlain by metamorphic rocks that are locally intruded by granites; these are partly overlain by sandstones. The test area further includes the Wadi Wassat and Wadi Qatan massive sulphide deposits, which are commonly capped by gossans of ferric oxides, silica, and carbonates. Color patterns and boundaries on contrast-stretched ratio color composite imagery, and on complementary images constructed using principal component and canonical analyses transformations, correspond exceptionally well to 1:100,000 scale field maps. A qualitative visual comparison of information content showed that the ratio enhancement provided the best overall image for identification of rock type and alteration products.

Blodget, H. W.↗
NASA NTRS1990

Rapid traversal of an image database using binary synthetic discriminant filters

Pattern recognition invariant to image rotations of up to 75 deg, using a single filter, has been demonstrated for binary synthetic discriminant function (BSDF) optical filters, suggesting their use in directed graph-arranged data bases which can be rapidly traversed by means of a filter-plane programmable spatial light modulator (SLM). The filter data base is arranged as a tree structure in which the root node filters are invariant to over 60 deg rotation, while the leaves are 5-deg invariant. Results are presented from experiments with BSDFs designed to recognize in-plane-rotated views of a Space Shuttle Orbiter. Using a magnetooptic SLM that is driven at 350 Hz in the filter plane, orientation identifications requiring less than 30 msec have been achieved after sequencing through only 10 BSDFs.

Reid, Max B.↗
NASA NTRS1991

Intelligent systems technology infrastructure for integrated systems

A system infrastructure must be properly designed and integrated from the conceptual development phase to accommodate evolutionary intelligent technologies. Several technology development activities were identified that may have application to rendezvous and capture systems. Optical correlators in conjunction with fuzzy logic control might be used for the identification, tracking, and capture of either cooperative or non-cooperative targets without the intensive computational requirements associated with vision processing. A hybrid digital/analog system was developed and tested with a robotic arm. An aircraft refueling application demonstration is planned within two years. Initially this demonstration will be ground based with a follow-on air based demonstration. System dependability measurement and modeling techniques are being developed for fault management applications. This involves usage of incremental solution/evaluation techniques and modularized systems to facilitate reuse and to take advantage of natural partitions in system models. Though not yet commercially available and currently subject to accuracy limitations, technology is being developed to perform optical matrix operations to enhance computational speed. Optical terrain recognition using camera image sequencing processed with optical correlators is being developed to determine position and velocity in support of lander guidance. The system is planned for testing in conjunction with Dryden Flight Research Facility. Advanced architecture technology is defining open architecture design constraints, test bed concepts (processors, multiple hardware/software and multi-dimensional user support, knowledge/tool sharing infrastructure), and software engineering interface issues.

Lum, Henry↗
NASA NTRS2009

Neural Network Target Identification System for False Alarm Reduction

A multi-stage automated target recognition (ATR) system has been designed to perform computer vision tasks with adequate proficiency in mimicking human vision. The system is able to detect, identify, and track targets of interest. Potential regions of interest (ROIs) are first identified by the detection stage using an Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filter combined with a wavelet transform. False positives are then eliminated by the verification stage using feature extraction methods in conjunction with neural networks. Feature extraction transforms the ROIs using filtering and binning algorithms to create feature vectors. A feed forward back propagation neural network (NN) is then trained to classify each feature vector and remove false positives. This paper discusses the test of the system performance and parameter optimizations process which adapts the system to various targets and datasets. The test results show that the system was successful in substantially reducing the false positive rate when tested on a sonar image dataset.

ATR↗
NASA NTRS2021

Demonstrations of System-Level Autonomy for Spacecraft

System-level autonomy refers to autonomously meeting the crosscutting needs of a system through awareness and coordinated control spanning the system's breadth of capabilities. In contrast to function-level autonomy, which focuses on capabilities required to achieve a specific function such as surface navigation or image recognition, system-level autonomy addresses the needs to coordinate and manage activities and resources, and estimate the state, across subsystems. This paper describes demonstrations that were conducted on a spacecraft workstation testbed. The autonomy was provided by system-level planning and execution integrated with system-level estimators of orbit knowledge and spacecraft hardware health. These components are embedded in a system-level framework defining how goals are formed and executed, which elements exist, and how control authority is distributed among components. The planning and execution system at the heart of the framework has the capability to schedule, execute and monitor completion of tasks, as well as plan around unexpected events including new science opportunities and anomalies. The planning and scheduling system is the Multi-mission EXECutive (MEXEC), supported by the system-level health state estimator Model-Based Off-Nominal State Identification and Detection (MONSID), and Autonomous Navigation (AutoNav) algorithms, which determine the orbital system state based on optical observation of other targets. These components are applicable to many kinds of missions on different platforms. These demonstrations were elaborations of earlier experiments conducted on the ASTERIA (Arcsecond Space Telescope Enabling Research In Astrophysics) CubeSat, described in a companion submission [1]. The spacecraft’s extended mission served as an in-flight test platform, during which some individual autonomous capabilities were flown successfully. The autonomy experiments described here were performed on the ASTERIA workstation testbed.

Prather, Maurice↗
NASA NTRS2006

Grayscale Optical Correlator Workbench

Grayscale Optical Correlator Workbench (GOCWB) is a computer program for use in automatic target recognition (ATR). GOCWB performs ATR with an accurate simulation of a hardware grayscale optical correlator (GOC). This simulation is performed to test filters that are created in GOCWB. Thus, GOCWB can be used as a stand-alone ATR software tool or in combination with GOC hardware for building (target training), testing, and optimization of filters. The software is divided into three main parts, denoted filter, testing, and training. The training part is used for assembling training images as input to a filter. The filter part is used for combining training images into a filter and optimizing that filter. The testing part is used for testing new filters and for general simulation of GOC output. The current version of GOCWB relies on the mathematical software tools from MATLAB binaries for performing matrix operations and fast Fourier transforms. Optimization of filters is based on an algorithm, known as OT-MACH, in which variables specified by the user are parameterized and the best filter is selected on the basis of an average result for correct identification of targets in multiple test images.

Hanan, Jay↗
NASA NTRSDate not supplied

Machine-learning Solution for Automatic Spacesuit Motion Recognition and Measurement from Conventional Video

Extravehicular Activity (EVA) spacesuits exhibit unique movement patterns due to their design characteristics. Mobility assessments using traditional motion capture systems are cost prohibitive and not feasible for some training conditions (e.g., simulated lunar outdoor terrain). This paper aims to present the ongoing development of machine learning solutions to quantify suit motions from conventional videos without special sensors or hardware. Given the fast growth in deep/machine learning technologies, external expertise was sought from open-source communities. This was expected to accelerate development and provide more cost-effective, time-saving solutions. This work was selected for a NASA Crowdsourcing project through an agency-wide solicitation. Partnerships were formed with the NASA JSC Center of Excellence for Collaborative Innovation and an execution crowdsourcing platform partner to solicit framework developments from external contenders. NASA provided contenders with video clips of spacesuits and simultaneously measured motion capture data during EVA simulation tasks. The contenders used this data to train and develop generalized algorithms to predict motions. At the end of the crowdsourcing event, five solutions were selected from 250 submissions. Each submission was tested and scored using video clips not previously disclosed to the contenders. The scoring metrics measured how well the algorithm detected the suit shape, the 2D suit joint detection accuracy, and 3D joint detection accuracy. The winning solution was able to achieve roughly 85% prediction accuracy (weighted combination of scoring metrics). Overall, the algorithms could efficiently detect various types of spacesuits and motions across different EVA simulation environments such as the Neutral Buoyancy Lab (NBL). However, 3D joint identification is less reliable when parts of the suit were obstructed in the image. After continued improvements and validation, the fully developed system will enable EVA stakeholders to quantify suit kinematic patterns, which can help optimize suit, hardware, and task designs.

Linh Vu↗
NASA NTRS2004

Passive IFF: Autonomous Nonintrusive Rapid Identification of Friendly Assets

A proposed optoelectronic instrument would identify targets rapidly, without need to radiate an interrogating signal, apply identifying marks to the targets, or equip the targets with transponders. The instrument was conceived as an identification, friend or foe (IFF) system in a battlefield setting, where it would be part of a targeting system for weapons, by providing rapid identification for aimed weapons to help in deciding whether and when to trigger them. The instrument could also be adapted to law-enforcement and industrial applications in which it is necessary to rapidly identify objects in view. The instrument would comprise mainly an optical correlator and a neural processor (see figure). The inherent parallel-processing speed and capability of the optical correlator would be exploited to obtain rapid identification of a set of probable targets within a scene of interest and to define regions within the scene for the neural processor to analyze. The neural processor would then concentrate on each region selected by the optical correlator in an effort to identify the target. Depending on whether or not a target was recognized by comparison of its image data with data in an internal database on which the neural processor was trained, the processor would generate an identifying signal (typically, friend or foe ). The time taken for this identification process would be less than the time needed by a human or robotic gunner to acquire a view of, and aim at, a target. An optical correlator that has been under development for several years and that has been demonstrated to be capable of tracking a cruise missile might be considered a prototype of the optical correlator in the proposed IFF instrument. This optical correlator features a 512-by-512-pixel input image frame and operates at an input frame rate of 60 Hz. It includes a spatial light modulator (SLM) for video-to-optical image conversion, a pair of precise lenses to effect Fourier transforms, a filter SLM for digital-to-optical correlation-filter data conversion, and a charge-coupled device (CCD) for detection of correlation peaks. In operation, the input scene grabbed by a video sensor is streamed into the input SLM. Precomputed correlation-filter data files representative of known targets are then downloaded and sequenced into the filter SLM at a rate of 1,000 Hz. When there occurs a match between the input target data and one of the known-target data files, the CCD detects a correlation peak at the location of the target. Distortion- invariant correlation filters from a bank of such filters are then sequenced through the optical correlator for each input frame. The net result is the rapid preliminary recognition of one or a few targets.

Moynihan, Philip↗
NASA NTRSDate not supplied

ELM: Europa Luminescence Microscope

The Europa Luminescence Microscope (ELM) is an automated fluorescence and bright-field microscope designed to meet key objectives defined in the 2016 NASA Europa Lander Study Report, including the identification and characterization of morphological biosignatures. ELM’s heritage stems from a 2U cubesat fluorescence microscope, the Fluorescence Analysis for In situ Research imager, designed and built at NASA Ames Research Center, for the autonomous study of microbial biology in low Earth orbit. For ELM implementation, a sample is autonomously manipulated with a microfluidic system using in-line 10, 1.0, and 0.2 μm pore-size filters to capture successively smaller particles for imaging. For bright-field imaging, ELM uses deep-ultraviolet, ultraviolet and visible light to image organic and inorganic structures with submicron resolution. The ability to detect biosignatures as small as 0.2 μm in size is achieved by imaging native fluorescence and using fluorescence microscopy stains to identify key structural and functional indicators of microbial life (proteins, lipids, nucleic acids). For fluorescence imaging, ELM uses 265, 370, 470, and 530 nm LEDs with five emission bands. The use of multiple excitation and emission wavelengths for native fluorescence imaging enables the detection of a wide range of molecular species and their rough classification. Excitation at 265 nm allows for the detection of smaller polycyclic aromatic hydrocarbons (PAH), aromatic amino acids, and proteins with little to no interference from mineral fluorescence, given proper emission band selection. 370 and 470 nm light excites increasingly larger PAH structures and larger aromatic biomolecules that may be present (e.g., protective pigments). Similarly, inorganic fluorescence can be characterized and separated from organic fluorescence, allowing the recognition and in some cases classification, of minerals and other abiotic particles. ELM is based upon work supported by the NASA COLDTech and ICEE-2 programs.

Richard C Quinn↗
NASA NTRSDate not supplied

Europa Luminescence Microscope

The Europa Luminescence Microscope (ELM) is an automated fluorescence and dark-field mi-croscope designed to meet key objectives defined in the NASA Europa Lander Study Report, includ-ing the identification and characterization of morphological biosignatures. ELM’s heritage stems from a 2U cubesat fluorescence microscope, the Fluorescence Analysis for In-situ Research (FLAIR) im-ager, designed and built at NASA Ames Research Center, for the autonomous study of microbial bi-ology in low Earth orbit. For the ELM implementation, a sample is autonomously manipulated with a microfluidic system using in-line filter sets to capture successively smaller particles on 10, 1.0, and 0.1 µm pore-size filters for imaging. For darkfield imaging, ELM uses ultraviolet and visible light to image organic and inorganic structures with submicron resolution. The ability to detect structural and chemical biosignatures as small as 0.2 µm in size is achieved by imaging native fluorescence and us-ing fluorescence microscopy stains to identify key molecular and structural indicators of microbial life (proteins, lipids, nucleic acids). To excite fluorescence, ELM uses LEDs with wavelengths centered near 265, 370, 470, and 530 nm and five emission bands. The use of multiple excitation and emission wavelengths for native fluorescence imaging not only enables the detection of different molecular species, but also their rough classification. Excitation at 265 nm allows for the detection of smaller polyaromatic hydrocarbons (PAHs; 1-5 rings), aromatic amino acids, and proteins with little to no interference from mineral fluorescence, given proper emission band selection. 370 and 470 nm light excites increasingly larger PAH structures (e.g., coronene) and larger aromatic biomolecules that may be present (e.g., protective pigments). Similarly, inorganic fluorescence can be characterized and sep-arated from organic fluorescence, allowing the recognition and in some cases classification, of miner-als and other abiotic particles. ELM is based upon work supported by the NASA COLDTech and ICEE-2 programs.

Microscope↗