Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image registration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Registration Of SAR Images With Multisensor Images

Semiautomated technique intended primarily to facilitate registration of polarimetric synthetic-aperture-radar (SAR) images with other images of same or partly overlapping terrain while preserving polarization information conveyed by SAR data. Technique generally applicable in sense one or both of images to be registered with each other generated by polarimetric or nonpolarimetric SAR, infrared radiometry, conventional photography, or any other applicable sensing method.

Evans, Diane L.↗

Machine Vision for Relative Spacecraft Navigation During Approach to Docking

This paper describes a machine vision system for relative spacecraft navigation during the terminal phase of approach to docking that: 1) matches high contrast image features of the target vehicle, as seen by a camera that is bore-sighted to the docking adapter on the chase vehicle, to the corresponding features in a 3d model of the docking adapter on the target vehicle and 2) is robust to on-orbit lighting. An implementation is provided for the case of the Space Shuttle Orbiter docking to the International Space Station (ISS) with quantitative test results using a full scale, medium fidelity mock-up of the ISS docking adapter mounted on a 6-DOF motion platform at the NASA Marshall Spaceflight Center Flight Robotics Laboratory and qualitative test results using recorded video from the Orbiter Docking System Camera (ODSC) during multiple orbiter to ISS docking missions. The Natural Feature Image Registration (NFIR) system consists of two modules: 1) Tracking which tracks the target object from image to image and estimates the position and orientation (pose) of the docking camera relative to the target object and 2) Acquisition which recognizes the target object if it is in the docking camera Field-of-View and provides an approximate pose that is used to initialize tracking. Detected image edges are matched to the 3d model edges whose predicted location, based on the pose estimate and its first time derivative from the previous frame, is closest to the detected edge1 . Mismatches are eliminated using a rigid motion constraint. The remaining 2d image to 3d model matches are used to make a least squares estimate of the change in relative pose from the previous image to the current image. The changes in position and in attitude are used as data for two Kalman filters whose outputs are smoothed estimate of position and velocity plus attitude and attitude rate that are then used to predict the location of the 3d model features in the next image.

Chien, Chiun-Hong↗

Effect of GOES-R Image Navigation and Registration Errors on Atmospheric Motion Vectors

High temporal frequency imagery from geostationary satellites allows for the continuous monitoring of rapidly changing atmospheric constituents such as smoke, dust, water vapor and clouds. The image sequences are often used to quantify the displacement of image features such as water vapor and clouds to produce atmospheric motion vectors (AMVs) which are used as diagnostic tools and also assimilated into numerical weather forecast models. The basic principle behind the determination of AMVs is the calculation of the physical displacement of features from one image (time) to the next. This process assumes that the features being tracked do not change as a function of time, usually requiring the use of short time interval imagery to minimize substantial change in size and shape of the features being tracked. High spatial resolution imagery also is required for reliable feature identification. While these image resolution and temporal sampling requirements often provide major drivers for space-based instrument design requirements, accurate image navigation and registration, INn (between a sequence of images), is also critical to the derivation of useful AMVs. In this paper and poster to be presented at the conference, the image navigation and registration (INR) accuracy expected for the Advanced Baseline Imager (ABI) on the GOES-R series of satellites will be discussed in light of its impact on AMV accuracy. Significant satellite platform and modeling enhancements are planned which should significantly improve INn performance of the GOES-R instruments. Some of these improvements have been demonstrated for the GOES-13 satellite which was launched in summer of 2006. An analysis of GOES-13 INR data, from the special satellite check out period, will be used in the assessment.

Jedlovec, Gary↗

Orbit/attitude estimation for the GOES spacecraft using VAS landmark data

A software system is described which provides for batch least squares estimation of spacecraft orbit, attitude, and camera bias parameters using image data from the Geostationary Operational Environmental Satellites (GOES). The image data are obtained by the Visible and Infrared Spin Scan Radiometer (VISSR) Atmospheric Sounder (VAS). The resulting estimated parameters are used for absolute image registration. Operating in the Digital Equipment Corporation (DEC) PDP-11/70 computer, the FORTRAN system also includes the capabilities of image display and manipulations. An overview of the system is presented as well as some numerical results obtained from observations taken by the SMS-2 satellite over a 3 day interval in August 1975.

Sielski, H.↗

Image correlation and sampling study

The development of analytical approaches for solving image correlation and image sampling of multispectral data is discussed. Relevant multispectral image statistics which are applicable to image correlation and sampling are identified. The general image statistics include intensity mean, variance, amplitude histogram, power spectral density function, and autocorrelation function. The translation problem associated with digital image registration and the analytical means for comparing commonly used correlation techniques are considered. General expressions for determining the reconstruction error for specific image sampling strategies are developed.

Popp, D. J.↗

SP mountain data analysis

An analysis of synthetic aperture radar data of SP Mountain was undertaken to demonstrate the use of digital image processing techniques to aid in geologic interpretation of SAR data. These data were collected with the ERIM X- and L-band airborne SAR using like- and cross-polarizations. The resulting signal films were used to produce computer compatible tapes, from which four-channel imagery was generated. Slant range-to-ground range and range-azimuth-scale corrections were made in order to facilitate image registration; intensity corrections were also made. Manual interpretation of the imagery showed that L-band represented the geology of the area better than X-band. Several differences between the various images were also noted. Further digital analysis of the corrected data was done for enhancement purposes. This analysis included application of an MSS differencing routine and development of a routine for removal of relief displacement. It was found that accurate registration of the SAR channels is critical to the effectiveness of the differencing routine. Use of the relief displacement algorithm on the SP Mountain data demonstrated the feasibility of the technique.

Rawson, R. F.↗

Recovery of motion parameters from distortions in scanned images

Scanned images, such as those produced by the scanning-laser ophthalmoscope (SLO), show distortions when there is target motion. This is because pixels corresponding to different image regions are acquired sequentially, and so, in essence, are slices of different snapshots. While these distortions create problems for image registration algorithms, they are potentially useful for recovering target motion parameters at temporal frequencies above the frame rate. Stetter, Sendtner and Timberlake measured large distortions in SLO images to recover the time course of rapid horizontal saccadic eye movements. Here, this work is extended with the goal of automatically recovering small eye movements in two dimensions. Eye position during the frame interval is modeled using a low dimensional parametric description, which in turn is used to generate predicted distortions of a reference template. The input image is then registered to the distorted template using normalized cross correlation. The motion parameters are then varied, and the correlation recomputed, to find the motion which maximizes the peak value of the correlation. The location and value of the correlation maximum are determined with sub-pixel precision using biquadratic interpolation, yielding eye position resolution better than 1 arc minute. This method of motion parameter estimation is tested using actual SLO images as well as simulated images. Motion parameter estimation might also be applied to individual video lines in order to reduce pipeline delays for a near real-time system.

Mulligan, Jeffrey B.↗

A concept for a future ground control data set for image correction

Strips of ground control can be established with current and future satellite sensors. These can provide precise and reliable geometric references for locating and correcting satellite image data and to support temporal image registration. This paper briefly describes the concept and approach for implementing this data base called a Ground Control Strip, and recommends additional work. The advent of new solid state imaging systems, in particular the linear array detectors (pushbroom sensors), make this new concept particularly attractive and practical.

Bernstein, R.↗

Visual Target Tracking in the Presence of Unknown Observer Motion

Much attention has been given to the visual tracking problem due to its obvious uses in military surveillance. However, visual tracking is complicated by the presence of motion of the observer in addition to the target motion, especially when the image changes caused by the observer motion are large compared to those caused by the target motion. Techniques for estimating the motion of the observer based on image registration techniques and Kalman filtering are presented and simulated. With the effects of the observer motion removed, an additional phase is implemented to track individual targets. This tracking method is demonstrated on an image stream from a buoy-mounted or periscope-mounted camera, where large inter-frame displacements are present due to the wave action on the camera. This system has been shown to be effective at tracking and predicting the global position of a planar vehicle (boat) being observed from a single, out-of-plane camera. Finally, the tracking system has been extended to a multi-target scenario.

image mosaic↗

The Use of Principal Components for Creating Improved Imagery for Geometric Control Point Selection

A directed principal component (PC) analysis and its transformation was applied to 7-channel thematic mapper simulator (TMS) data and 4-channel LANDSAT multispectral scanner system (MSS) data collected over the city of Lancaster, Pennsylvania, to create improved imagery for geometric control point selection for image to image registration. Nineteen temporally stable geometric control points, such as road interactions and bridges, were selected for a 236 sq km area. The control points were visible on both the TMS and MSS imagery. On the first attempt the corresponding image control points were selected on both data sets without using the principal components transformation. Many of the road intersection locations were visible but the actual road crossings could not be distinguished. As a result, mensuration errors using raw data exceeded the equivalent of two (79 x 79 m) pixels. The application of a guided principal components transformation yielded TMS and MSS single band images showing improved detail in the scene's urban and residential infrastructure. The PC transformed data sets were then utilized for the reselection of geometric control points. By shown greater detail, control points on both the TMS and MSS imagery could be located with greater precision using the PC transformed data.

Imhoff, M. L.↗

A Quantum Annealing Computer Team Addresses Climate Change Predictability

The near confluence of the successful launch of the Orbiting Carbon Observatory2 on July 2, 2014 and the acceptance on August 20, 2015 by Google, NASA Ames Research Center and USRA of a 1152 qubit D-Wave 2X Quantum Annealing Computer (QAC), offered an exceptional opportunity to explore the potential of this technology to address the scientific prediction of global annual carbon uptake by land surface processes. At UMBC,we have collected and processed 20 months of global Level 2 light CO2 data as well as fluorescence data. In addition we have collected ARM data at 2sites in the US and Ameriflux data at more than 20 stations. J. Dorband has developed and implemented a multi-hidden layer Boltzmann Machine (BM) algorithm on the QAC. Employing the BM, we are calculating CO2 fluxes by training collocated OCO-2 level 2 CO2 data with ARM ground station tower data to infer to infer measured CO2 flux data. We generate CO2 fluxes with a regression analysis using these BM derived weights on the level 2 CO2 data for three Ameriflux sites distinct from the ARM stations. P. Gentine has negotiated for the access of K34 Ameriflux data in the Amazon and is applying a neural net to infer the CO2 fluxes. N. Talik validated the accuracy of the BM performance on the QAC against a restricted BM implementation on the IBM Softlayer Cloud with the Nvidia co-processors utilizing the same data sets. G. Nearing and K. Harrison have extended the GSFC LIS model with the NCAR Noah photosynthetic parameterization and have run a 10 year global prediction of the net ecosystem exchange. C. Pellisier is preparing a BM implementation of the Kalman filter data assimilation of CO2 fluxes. At UMBC, R. Prouty is conducting OSSE experiments with the LISNoah model on the IBM iDataPlex to simulate the impact of CO2 fluxes to improve the prediction of global annual carbon uptake. J. LeMoigne and D. Simpson have developed a neural net image registration system that will be used for MODIS ENVI and will be converted to a BM algorithm implementation on the QAC. The first integer adder has been implemented on the D-Wave 2X by A. Shehab that will perform HAAR wavelets for image compression of MODIS scenes. Finally, based on the next generations of QACs, we are preparing a 5-year performance road map on the scalability of the current QAC algorithms.

Science Data Processing↗

NASA Tech Briefs, March 2011

Topics covered include: Optimal Tuner Selection for Kalman-Filter-Based Aircraft Engine Performance Estimation; Airborne Radar Interferometric Repeat-Pass Processing; Plug-and-Play Environmental Monitoring Spacecraft Subsystem; Power-Combined GaN Amplifier with 2.28-W Output Power at 87 GHz; Wallops Ship Surveillance System; Source Lines Counter (SLiC) Version 4.0; Guidance, Navigation, and Control Program; Single-Frame Terrain Mapping Software for Robotic Vehicles; Auto Draw from Excel Input Files; Observation Scheduling System; CFDP for Interplanetary Overlay Network; X-Windows Widget for Image Display; Binary-Signal Recovery; Volumetric 3D Display System with Static Screen; MMIC Replacement for Gunn Diode Oscillators; Feature Acquisition with Imbalanced Training Data; Mount Protects Thin-Walled Glass or Ceramic Tubes from Large Thermal and Vibration Loads; Carbon Nanotube-Based Structural Health Monitoring Sensors; Wireless Inductive Power Device Suppresses Blade Vibrations; Safe, Advanced, Adaptable Isolation System Eliminates the Need for Critical Lifts; Anti-Rotation Device Releasable by Insertion of a Tool; A Magnetically Coupled Cryogenic Pump; Single Piezo-Actuator Rotary-Hammering Drill; Fire-Retardant Polymeric Additives; Catalytic Generation of Lift Gases for Balloons; Ionic Liquids to Replace Hydrazine; Variable Emittance Electrochromics Using Ionic Electrolytes and Low Solar Absorptance Coatings; Spacecraft Radiator Freeze Protection Using a Regenerative Heat Exchanger; Multi-Mission Power Analysis Tool; Correction for Self-Heating When Using Thermometers as Heaters in Precision Control Applications; Gravitational Wave Detection with Single-Laser Atom Interferometers; Titanium Alloy Strong Back for IXO Mirror Segments; Improved Ambient Pressure Pyroelectric Ion Source; Multi-Modal Image Registration and Matching for Localization of a Balloon on Titan; Entanglement in Quantum-Classical Hybrid; Algorithm for Autonomous Landing; Quantum-Classical Hybrid for Information Processing; Small-Scale Dissipation in Binary-Species Transitional Mixing Layers; Superpixel-Augmented Endmember Detection for Hyperspectral Images; Coding for Parallel Links to Maximize the Expected Value of Decodable Messages; and Microwave Tissue Soldering for Immediate Wound Closure.

Source record↗

Advanced data visualization and sensor fusion: Conversion of techniques from medical imaging to Earth science

Hughes Aircraft Company and the University of Chicago propose to transfer existing medical imaging registration algorithms to the area of multi-sensor data fusion. The University of Chicago's algorithms have been successfully demonstrated to provide pixel by pixel comparison capability for medical sensors with different characteristics. The research will attempt to fuse GOES (Geostationary Operational Environmental Satellite), AVHRR (Advanced Very High Resolution Radiometer), and SSM/I (Special Sensor Microwave Imager) sensor data which will benefit a wide range of researchers. The algorithms will utilize data visualization and algorithm development tools created by Hughes in its EOSDIS (Earth Observation SystemData/Information System) prototyping. This will maximize the work on the fusion algorithms since support software (e.g. input/output routines) will already exist. The research will produce a portable software library with documentation for use by other researchers.

Savage, Richard C.↗

Multitemporal Snow Cover Mapping in Mountainous Terrain for Landsat Climate Data Record Development

A multitemporal method to map snow cover in mountainous terrain is proposed to guide Landsat climate data record (CDR) development. The Landsat image archive including MSS, TM, and ETM+ imagery was used to construct a prototype Landsat snow cover CDR for the interior northwestern United States. Landsat snow cover CDRs are designed to capture snow-covered area (SCA) variability at discrete bi-monthly intervals that correspond to ground-based snow telemetry (SNOTEL) snow-water-equivalent (SWE) measurements. The June 1 bi-monthly interval was selected for initial CDR development, and was based on peak snowmelt timing for this mountainous region. Fifty-four Landsat images from 1975 to 2011 were preprocessed that included image registration, top-of-the-atmosphere (TOA) reflectance conversion, cloud and shadow masking, and topographic normalization. Snow covered pixels were retrieved using the normalized difference snow index (NDSI) and unsupervised classification, and pixels having greater (less) than 50% snow cover were classified presence (absence). A normalized SCA equation was derived to independently estimate SCA given missing image coverage and cloud-shadow contamination. Relative frequency maps of missing pixels were assembled to assess whether systematic biases were embedded within this Landsat CDR. Our results suggest that it is possible to confidently estimate historical bi-monthly SCA from partially cloudy Landsat images. This multitemporal method is intended to guide Landsat CDR development for freshwaterscarce regions of the western US to monitor climate-driven changes in mountain snowpack extent.

Landsat↗

Recent Advances in Registration, Integration and Fusion of Remotely Sensed Data: Redundant Representations and Frames

In recent years, sophisticated mathematical techniques have been successfully applied to the field of remote sensing to produce significant advances in applications such as registration, integration and fusion of remotely sensed data. Registration, integration and fusion of multiple source imagery are the most important issues when dealing with Earth Science remote sensing data where information from multiple sensors, exhibiting various resolutions, must be integrated. Issues ranging from different sensor geometries, different spectral responses, differing illumination conditions, different seasons, and various amounts of noise need to be dealt with when designing an image registration, integration or fusion method. This tutorial will first define the problems and challenges associated with these applications and then will review some mathematical techniques that have been successfully utilized to solve them. In particular, we will cover topics on geometric multiscale representations, redundant representations and fusion frames, graph operators, diffusion wavelets, as well as spatial-spectral and operator-based data fusion. All the algorithms will be illustrated using remotely sensed data, with an emphasis on current and operational instruments.

Fusion↗

Automation of Geometric Accuracy Assessment Algorithm

When end-users are using multiple satellite images for a study the first step is often the assessment and rectification of geolocation offsets. We have developed an automated algorithm to calculate the geometric offsets between two satellite images. It splits both images into subset images (chips) and resamples them to a common resolution. Offsets are imposed on matching chips and the Pearson Cross Correlation (PCC) value calculated for each offset, where the best PCC gives the true offsets. With the true offsets corrected for, a quality of image registration is calculated, measurement uncertainty (MU). The MU threshold value is non-uniform across sensors because it depends on spectral characteristics of each sensor. Previously, the MU threshold was determined by manual inspection for each new sensor assessed. In this study, we automated MU threshold determination. 1/MU vs calculated offset approximates a Gaussian function in shape, see abstract image. A Gaussian function is fit to this dataset, and the root of the third derivative is calculated and applied as a quality threshold, removing the data of lower quality from the final assessment of image offsets. We apply this algorithm to commercial satellite data for proof of concept.

Alana Semple↗

Digital image correlation techniques applied to LANDSAT multispectral imagery

The author has identified the following significant results. Automatic image registration and resampling techniques applied to LANDSAT data achieved accuracies, resulting in mean radial displacement errors of less than 0.2 pixel. The process method utilized recursive computational techniques and line-by-line updating on the basis of feedback error signals. Goodness of local feature matching was evaluated through the implementation of a correlation algorithm. An automatic restart allowed the system to derive control point coordinates over a portion of the image and to restart the process, utilizing this new control point information as initial estimates.

Bonrud, L. O.↗

Registration of Heat Capacity Mapping Mission day and night images

Neither iterative registration, using drainage intersection maps for control, nor cross correlation techniques were satisfactory in registering day and night HCMM imagery. A procedure was developed which registers the image pairs by selecting control points and mapping the night thermal image to the daytime thermal and reflectance images using an affine transformation on a 1300 by 1100 pixel image. The resulting image registration is accurate to better than two pixels (RMS) and does not exhibit the significant misregistration that was noted in the temperature-difference and thermal-inertia products supplied by NASA. The affine transformation was determined using simple matrix arithmetic, a step that can be performed rapidly on a minicomputer.

Watson, K.↗