Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image registration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Processing and analysis of radiometer measurements for airborne reconnaissance

This paper describes selected results of airborne, radiometric imaging measurements at 90 GHz and 140 GHz relevant for the application in reconnaissance. Using a temperature resolution below 0.5 K and an angular resolution of about 1-degree high-quality images show the capability of discriminating between many brightness temperature classes within our natural environment and man-made objects. Measurement examples are given for cloud and fog penetration at 90 GHz, for the detection of vehicles on roads, and for the detection and classification of airports and airplanes. The application of different contour enhancement methods (Marr-Hildreth and Canny) shows the possibility of extracting lines and shapes precisely in order to improve automatic target recognition. The registration of the passive images with corresponding X-band synthetic aperture images from the same area is carried out and the high degree of correlation is discussed.

Suess, Helmut↗

Chromatic Modulator for a High-Resolution CCD or APS

A chromatic modulator has been proposed to enable the separate detection of the red, green, and blue (RGB) color components of the same scene by a single charge-coupled device (CCD), active-pixel sensor (APS), or similar electronic image detector. Traditionally, the RGB color-separation problem in an electronic camera has been solved by use of either (1) fixed color filters over three separate image detectors; (2) a filter wheel that repeatedly imposes a red, then a green, then a blue filter over a single image detector; or (3) different fixed color filters over adjacent pixels. The use of separate image detectors necessitates precise registration of the detectors and the use of complicated optics; filter wheels are expensive and add considerably to the bulk of the camera; and fixed pixelated color filters reduce spatial resolution and introduce color-aliasing effects. The proposed chromatic modulator would not exhibit any of these shortcomings. The proposed chromatic modulator would be an electromechanical device fabricated by micromachining. It would include a filter having a spatially periodic pattern of RGB strips at a pitch equal to that of the pixels of the image detector. The filter would be placed in front of the image detector, supported at its periphery by a spring suspension and electrostatic comb drive. The spring suspension would bias the filter toward a middle position in which each filter strip would be registered with a row of pixels of the image detector. Hard stops would limit the excursion of the spring suspension to precisely one pixel row above and one pixel row below the middle position. In operation, the electrostatic comb drive would be actuated to repeatedly snap the filter to the upper extreme, middle, and lower extreme positions. This action would repeatedly place a succession of the differently colored filter strips in front of each pixel of the image detector. To simplify the processing, it would be desirable to encode information on the color of the filter strip over each row (or at least over some representative rows) of pixels at a given instant of time in synchronism with the pixel output at that instant.

Hartley, Frank↗

Space based topographic mapping experiment using Seasat synthetic aperture radar and LANDSAT 3 return beam vidicon imagery

A technique for producing topographic information is described which is based on same side/same time viewing using a dissimilar combination of radar imagery and photographic images. Common geographic areas viewed from similar space reference locations produce scene elevation displacements in opposite direction and proper use of this characteristic can yield the perspective information necessary for determination of base to height ratios. These base to height ratios can in turn be used to produce a topographic map. A test area covering the Harrisburg, Pennsylvania region was observed by synthetic aperture radar on the Seasat satellite and by return beam vidicon on by the LANDSAT - 3 satellite. The techniques developed for the scaling re-orientation and common registration of the two images are presented along with the topographic determination data. Topographic determination based exclusively on the images content is compared to the map information which is used as a performance calibration base.

Mader, G. L.↗

MISR Instrument Data Visualization

The MISR Interactive eXplorer (MINX) software functions both as a general-purpose tool to visualize Multiangle Imaging SpectroRadiometer (MISR) instrument data, and as a specialized tool to analyze properties of smoke, dust, and volcanic plumes. It includes high-level options to create map views of MISR orbit locations; scrollable, single-camera RGB (red-greenblue) images of MISR level 1B2 (L1B2) radiance data; and animations of the nine MISR camera images that provide a 3D perspective of the scenes that MISR has acquired. NASA Tech Briefs, September 2008 55 The plume height capability provides an accurate estimate of the injection height of plumes that is needed by air quality and climate modelers. MISR provides global high-quality stereo height information, and this program uses that information to perform detailed height retrievals of aerosol plumes. Users can interactively digitize smoke, dust, or volcanic plumes and automatically retrieve heights and winds, and can also archive MISR albedos and aerosol properties, as well as fire power and brightness temperatures associated with smoke plumes derived from Moderate Resolution Imaging Spectroradiometer (MODIS) data. Some of the specialized options in MINX enable the user to do other tasks. Users can display plots of top-of-atmosphere bidirectional reflectance factors (BRFs) versus camera-angle for selected pixels. Images and animations can be saved to disk in various formats. Also, users can apply a geometric registration correction to warp camera images when the standard processing correction is inadequate. It is possible to difference the images of two MISR orbits that share a path (identical ground track), as well as to construct pseudo-color images by assigning different combinations of MISR channels (angle or spectral band) to the RGB display channels. This software is an interactive application written in IDL and compiled into an IDL Virtual Machine (VM) ".sav" file.

Nelson, David↗

Chromatic Modulator for High Resolution CCD or APS Devices

A system for providing high-resolution color separation in electronic imaging. Comb drives controllably oscillate a red-green-blue (RGB) color strip filter system (or otherwise) over an electronic imaging system such as a charge-coupled device (CCD) or active pixel sensor (APS). The color filter is modulated over the imaging array at a rate three or more times the frame rate of the imaging array. In so doing, the underlying active imaging elements are then able to detect separate color-separated images, which are then combined to provide a color-accurate frame which is then recorded as the representation of the recorded image. High pixel resolution is maintained. Registration is obtained between the color strip filter and the underlying imaging array through the use of electrostatic comb drives in conjunction with a spring suspension system.

Frank T Hartley↗

Observation of asymmetric explosive density evolution in the deflagration-to-detonation transition for porous explosives

We report deflagration-to-detonation transition phenomena in cylindrical columns of porous explosives based on octahydro-1,3,5,7-tetranitro-1,3,5,7-tetrazocine (HMX). The HMX powder and LX-14 (95.5 wt. % HMX and 4.5 wt. % estane polyurethane) prills were observed with high-speed cameras and flash x rays under conditions that allow for precise scaling and registration of the recorded images. These experimental results test the conventional assumption of axisymmetric, effective one-dimensional burning. Polycarbonate confinement tubes allowed this direct imaging with steel spheres employed as radio-opaque fiducials. Spheres embedded in the explosive column revealed the displacement of the explosive prior to deflagration. X-ray and fast camera images show that a dense plug of compact explosive develops ahead of the deflagration front. The internal fiducials register both internal changes in the plug and changes in the position between successive x-ray images. Tantalum witness strips placed on the inner wall of the explosive channel revealed radial expansion of the tube bore at successive x-ray exposures, indicating the internal pressure of about 100 MPa just before detonation. Images indicate that the deflagration is not only asymmetric but also involves newly observed transient phenomena just before detonation. Furthermore, we typically see a brief but continuous increase in deflagration speed and the formation of a deflagration channel that bypasses the plug just prior to detonation. We hypothesize that these phenomena play an important role in the deflagration-to-detonation transition itself.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluation of LANDSAT multispectral scanner images for mapping altered rocks in the east Tintic Mountains, Utah

The author has identified the following significant results. Positive findings of earlier evaluations of the color-ratio compositing technique for mapping limonitic altered rocks in south-central Nevada are confirmed, but important limitations in the approach used are pointed out. These limitations arise from environmental, geologic, and image processing factors. The greater vegetation density in the East Tintic Mountains required several modifications in procedures to improve the overall mapping accuracy of the CRC approach. Large format ratio images provide better internal registration of the diazo films and avoids the problems associated with magnifications required in the original procedure. Use of the Linoscan 204 color recognition scanner permits accurate consistent extraction of the green pixels representing limonitic bedrock maps that can be used for mapping at large scales as well as for small scale reconnaissance.

Rowan, L. C.↗

Registration workshop report

The state-of-the-art in registration and rectification of image data for terrestrial applications is examined and recommendations for further research in these areas are made.

Ramapriyan, H. K.↗

Thematic Mapper Image Processing System - Geometric correction performance for Landsat-5

Geometric correction performance data are presented for the Landsat-5 Thematic Mapper and the Thematic Mapper Image Processing System. Temporal registration and geodetic rectification results are displayed in the form of 90 percent errors. Both error estimation and direct measurements demonstrate that the instrument and system meet performance requirements.

Brooks, J.↗

Self calibrating autoTRAC

The work reported here demonstrates how to automatically compute the position and attitude of a targeting reflective alignment concept (TRAC) camera relative to the robot end effector. In the robotics literature this is known as the sensor registration problem. The registration problem is important to solve if TRAC images need to be related to robot position. Previously, when TRAC operated on the end of a robot arm, the camera had to be precisely located at the correct orientation and position. If this location is in error, then the robot may not be able to grapple an object even though the TRAC sensor indicates it should. In addition, if the camera is significantly far from the alignment it is expected to be at, TRAC may give incorrect feedback for the control of the robot. A simple example is if the robot operator thinks the camera is right side up but the camera is actually upside down, the camera feedback will tell the operator to move in an incorrect direction. The automatic calibration algorithm requires the operator to translate and rotate the robot arbitrary amounts along (about) two coordinate directions. After the motion, the algorithm determines the transformation matrix from the robot end effector to the camera image plane. This report discusses the TRAC sensor registration problem.

Everett, Louis J.↗

Real-time Enhancement, Registration, and Fusion for a Multi-Sensor Enhanced Vision System

Over the last few years NASA Langley Research Center (LaRC) has been developing an Enhanced Vision System (EVS) to aid pilots while flying in poor visibility conditions. The EVS captures imagery using two infrared video cameras. The cameras are placed in an enclosure that is mounted and flown forward-looking underneath the NASA LaRC ARIES 757 aircraft. The data streams from the cameras are processed in real-time and displayed on monitors on-board the aircraft. With proper processing the camera system can provide better-than- human-observed imagery particularly during poor visibility conditions. However, to obtain this goal requires several different stages of processing including enhancement, registration, and fusion, and specialized processing hardware for real-time performance. We are using a real-time implementation of the Retinex algorithm for image enhancement, affine transformations for registration, and weighted sums to perform fusion. All of the algorithms are executed on a single TI DM642 digital signal processor (DSP) clocked at 720 MHz. The image processing components were added to the EVS system, tested, and demonstrated during flight tests in August and September of 2005. In this paper we briefly discuss the EVS image processing hardware and algorithms. We then discuss implementation issues and show examples of the results obtained during flight tests. Keywords: enhanced vision system, image enhancement, retinex, digital signal processing, sensor fusion

Hines, Glenn D.↗

Real-time Enhancement, Registration, and Fusion for an Enhanced Vision System

Over the last few years NASA Langley Research Center (LaRC) has been developing an Enhanced Vision System (EVS) to aid pilots while flying in poor visibility conditions. The EVS captures imagery using two infrared video cameras. The cameras are placed in an enclosure that is mounted and flown forward-looking underneath the NASA LaRC ARIES 757 aircraft. The data streams from the cameras are processed in real-time and displayed on monitors on-board the aircraft. With proper processing the camera system can provide better-than-human-observed imagery particularly during poor visibility conditions. However, to obtain this goal requires several different stages of processing including enhancement, registration, and fusion, and specialized processing hardware for real-time performance. We are using a real-time implementation of the Retinex algorithm for image enhancement, affine transformations for registration, and weighted sums to perform fusion. All of the algorithms are executed on a single TI DM642 digital signal processor (DSP) clocked at 720 MHz. The image processing components were added to the EVS system, tested, and demonstrated during flight tests in August and September of 2005. In this paper we briefly discuss the EVS image processing hardware and algorithms. We then discuss implementation issues and show examples of the results obtained during flight tests.

Hines, Glenn D.↗

Multimodal imaging and machine learning to enhance microscope images of shale

A machine learning based image processing workflow is presented to enhance shale source rock microscopic images obtained using diverse imaging platforms. Images were acquired from a 30 μm diameter cylindrical Vaca Muerta shale sample using both nondestructive Transmission X-Ray Microscopy (TXM, alternately referred to as nano computed tomography) and destructive Focused Ion Beam-Scanning Electron Microscopy (FIB-SEM). Output cross-sectional images from each modality were aligned using a combination of manual and automated registration techniques to create a registered image dataset. We then apply this dataset for two image processing tasks: prediction of image cross sections with SEM-like resolution from nondestructive TXM data and repair of charged region artifacts (localized accumulation of electrons) within SEM images. The image processing algorithms for both tasks use deep learning models, specifically image-to-image Convolutional Neural Networks (CNNs) and conditional Generative Adversarial Networks (cGANs). In the image enhancement tasks, we are able to achieve significant qualitative and quantitative improvement in TXM images. Here, the best model reaches an average Peak Signal to Noise Ratio (PSNR) of 15.8 dB. Conditioning on TXM data is also shown to reduce artifacts from SEM charging, achieving an average PSNR of 25.8 dB. Furthermore, our results suggest that properly trained and validated networks are capable of significant enhancement of images obtained using nondestructive techniques, thereby improving interpretation of two- and three-dimensional images while preserving samples for future use.

58 GEOSCIENCES↗

Computer techniques used for some enhancements of ERTS images

The JPL VICAR image processing system has been used for the enhancement of images received from the ERTS for the Arizona geology mapping experiment. This system contains flexible capabilities for reading and repairing MSS digital tape images, for geometric corrections and interpicture registration, for various enhancements and analyses of the data, and for display of the images in black and white and color.

Billingsley, F. C.↗

In-Situ Process Monitoring, Synchronization, and Mapping Laser Powder Bed Fusion Builds of Ti6Al4V

The use of in-situ process monitoring is of interest to lower the cost of inspection for the qualification of laser powder bed fusion (LPBF) parts. Precise monitoring of the LPBF-AM build process constitutes a multi-scale and multi-discipline task. There are several significant challenges to the in-situ approach: the synchronization of sensor signals to process steps, the physical interpretation and classification of sensor signals, managing very large datasets, and comparing the inputs with the observed monitoring signals. At NASA Langley Research Center, a configurable architecture additive testbed has been developed to monitor the build process with synchronized sensors. The philosophy and method adopted for the synchronization of the cameras with laser power & position Ti-6Al-4V LPBF are described. The synchronized in-situ monitoring signals are compared with ex-situ nondestructive inspection and optical microscopy observations. Such comparisons permit a better understanding of how the sequential process actions of LPBF-AM can affect build quality.

Laser Powder Bed Fusion↗

Powder Bed Fusion Laser Beam Metals Additive Manufacturing: Process Monitoring Approaches for Qualification and Certification

The use of in-situ process monitoring is of interest to lower the cost of inspection for the qualification of powder bed fusion laser beam metal (PBF-LB/M) additively manufactured (AM) parts. Precise monitoring of the PBF-LB/M AM build process constitutes a multi-scale and multi-discipline task. There are several significant challenges to the in-situ approach: the synchronization of sensor signals to process steps; the physical interpretation and classification of sensor signals; managing very large datasets; and comparing the inputs with the observed monitoring signals. At NASA Langley Research Center, a configurable architecture additive testbed has been developed to monitor the build process with synchronized sensors. The philosophy and method adopted for the synchronization of the cameras with laser power and position throughout a complex PBF-LB/M AM build will be described. The synchronized in-situ monitoring signals are compared with ex-situ nondestructive inspection, x-ray computed tomography (XCT). Such comparisons permit a better understanding of how the sequential process actions of LPBF-AM can affect build quality. The multi-scale and complex process of printing additively manufactured (AM) parts can have unexpected, but predictable, build conditions that result in material microstructure variability. This presentation will describe an additive manufacturing model-based process metric (AM-PM) computational method that is a fully parallel reduced order modeling approach developed to evaluate the evolution of AM processes. This method couples the known sequence of the AM process with a physically informed nearest neighbors’ calculation to map the conditions of a part-scale build. The result is a map of the build that is derived directly from build files or in-situ process monitoring sensors. The methodology of the approach will be described and mapped to the porosity observed from XCT for a complex PBF-LB/M build. Such comparative results develop understanding of how the sequential process actions can affect the PBF-LB/M AM build quality and microstructure variability.

Laser Powder Bed Fusion↗

Application of digital image processing techniques to faint solar flare phenomena

Digital image processing of eight solar flare events was performed using the Video Information Communication and Retrieval language in order to study moving emission fronts, flare halos, and Moreton waves. The techniques used include contrast enhancement, isointensity contouring, the differencing of images, spatial filtering, and geometrical registration. The spatial extent and temporal behavior of the faint phenomena is examined along with the relation of the three types of phenomena to one another. The image processing techniques make possible the detailed study of the history of the phenomena and provide clues to their physical nature.

Glackin, D. L.↗