Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image registration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Method for error correction in scanning probe microscopy

Disclosed here is a scanning probe microscope system and method for operating the same for producing scanning probe microscope images at fast scan rates and reducing oscillation artifacts. In some embodiments, an inverse consistent image registration method is used to align forward and backward scan traces for each line of the scanning microscope image. In some embodiments, the aligned forward and backward scan traces are combined using a weighting factor favoring the scan trace with higher smoothness. In some embodiments, the scanning probe microscope image is a potentiometry map and a method is provided to extract from the potentiometry map a conductivity map.

47 OTHER INSTRUMENTATION↗

Effect of GOES-R Image Navigation and Registration Errors on Atmospheric Motion Vectors

High temporal frequency imagery from geostationary satellites allows for the continuous monitoring of rapidly changing atmospheric constituents such as smoke, dust, water vapor and clouds. The image sequences are often used to quantify the displacement of image features such as water vapor and clouds to produce atmospheric motion vectors (AMVs) which are used as diagnostic tools and also assimilated into numerical weather forecast models. The basic principle behind the determination of AMVs is the calculation of the physical displacement of features from one image (time) to the next. This process assumes that the features being tracked do not change as a function of time, usually requiring the use of short time interval imagery to minimize substantial change in size and shape of the features being tracked. High spatial resolution imagery also is required for reliable feature identification. While these image resolution and temporal sampling requirements often provide major drivers for space-based instrument design requirements, accurate image navigation and registration, INn (between a sequence of images), is also critical to the derivation of useful AMVs. In this paper and poster to be presented at the conference, the image navigation and registration (INR) accuracy expected for the Advanced Baseline Imager (ABI) on the GOES-R series of satellites will be discussed in light of its impact on AMV accuracy. Significant satellite platform and modeling enhancements are planned which should significantly improve INn performance of the GOES-R instruments. Some of these improvements have been demonstrated for the GOES-13 satellite which was launched in summer of 2006. An analysis of GOES-13 INR data, from the special satellite check out period, will be used in the assessment.

Jedlovec, Gary↗

Reconstruction of concrete microstructure using complementarity of X-ray and neutron tomography

The concrete microstructure was successfully reconstructed using the complementarity of X-ray and neutron computed tomography (CT). Neither tomogram alone was found to be suitable to properly describe the microstructure of concrete under this study. However, by merging the information revealed by the two modalities, and using image segmentation, noise reduction, and image registration techniques we reconstruct the concrete microstructure. Void, aggregate, and cement paste phases are successfully captured down to the images' spatial resolution, even though the aggregate consists of multiple minerals. The coarse-aggregate volume fraction of the reconstructed microstructure was similar to that of the mixing proportions. Furthermore, image-based finite element analysis is performed to demonstrate the effects of microstructure on stress concentration and strain localization.

36 MATERIALS SCIENCE↗

Orbit/attitude estimation for the GOES spacecraft using VAS landmark data

A software system is described which provides for batch least squares estimation of spacecraft orbit, attitude, and camera bias parameters using image data from the Geostationary Operational Environmental Satellites (GOES). The image data are obtained by the Visible and Infrared Spin Scan Radiometer (VISSR) Atmospheric Sounder (VAS). The resulting estimated parameters are used for absolute image registration. Operating in the Digital Equipment Corporation (DEC) PDP-11/70 computer, the FORTRAN system also includes the capabilities of image display and manipulations. An overview of the system is presented as well as some numerical results obtained from observations taken by the SMS-2 satellite over a 3 day interval in August 1975.

Sielski, H.↗

Image correlation and sampling study

The development of analytical approaches for solving image correlation and image sampling of multispectral data is discussed. Relevant multispectral image statistics which are applicable to image correlation and sampling are identified. The general image statistics include intensity mean, variance, amplitude histogram, power spectral density function, and autocorrelation function. The translation problem associated with digital image registration and the analytical means for comparing commonly used correlation techniques are considered. General expressions for determining the reconstruction error for specific image sampling strategies are developed.

Popp, D. J.↗

Statistical characterization of experimental magnetized liner inertial fusion stagnation images using deep-learning-based fuel–background segmentation

Significant variety is observed in spherical crystal x-ray imager (SCXI) data for the stagnated fuel–liner system created in Magnetized Liner Inertial Fusion (MagLIF) experiments conducted at the Sandia National Laboratories Z-facility. As a result, image analysis tasks involving, e.g., region-of-interest selection (i.e. segmentation), background subtraction and image registration have generally required tedious manual treatment leading to increased risk of irreproducibility, lack of uncertainty quantification and smaller-scale studies using only a fraction of available data. We present a convolutional neural network (CNN)-based pipeline to automate much of the image processing workflow. This tool enabled batch preprocessing of an ensemble of N scans = 139 SCXI images across N exp = 67 different experiments for subsequent study. The pipeline begins by segmenting images into the stagnated fuel and background using a CNN trained on synthetic images generated from a geometric model of a physical three-dimensional plasma. The resulting segmentation allows for a rules-based registration. Our approach flexibly handles rarely occurring artifacts through minimal user input and avoids the need for extensive hand labelling and augmentation of our experimental dataset that would be needed to train an end-to-end pipeline. Here we also fit background pixels using low-degree polynomials, and perform a statistical assessment of the background and noise properties over the entire image database. Our results provide a guide for choices made in statistical inference models using stagnation image data and can be applied in the generation of synthetic datasets with realistic choices of noise statistics and background models used for machine learning tasks in MagLIF data analysis. We anticipate that the method may be readily extended to automate other MagLIF stagnation imaging applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

SP mountain data analysis

An analysis of synthetic aperture radar data of SP Mountain was undertaken to demonstrate the use of digital image processing techniques to aid in geologic interpretation of SAR data. These data were collected with the ERIM X- and L-band airborne SAR using like- and cross-polarizations. The resulting signal films were used to produce computer compatible tapes, from which four-channel imagery was generated. Slant range-to-ground range and range-azimuth-scale corrections were made in order to facilitate image registration; intensity corrections were also made. Manual interpretation of the imagery showed that L-band represented the geology of the area better than X-band. Several differences between the various images were also noted. Further digital analysis of the corrected data was done for enhancement purposes. This analysis included application of an MSS differencing routine and development of a routine for removal of relief displacement. It was found that accurate registration of the SAR channels is critical to the effectiveness of the differencing routine. Use of the relief displacement algorithm on the SP Mountain data demonstrated the feasibility of the technique.

Rawson, R. F.↗

Recovery of motion parameters from distortions in scanned images

Scanned images, such as those produced by the scanning-laser ophthalmoscope (SLO), show distortions when there is target motion. This is because pixels corresponding to different image regions are acquired sequentially, and so, in essence, are slices of different snapshots. While these distortions create problems for image registration algorithms, they are potentially useful for recovering target motion parameters at temporal frequencies above the frame rate. Stetter, Sendtner and Timberlake measured large distortions in SLO images to recover the time course of rapid horizontal saccadic eye movements. Here, this work is extended with the goal of automatically recovering small eye movements in two dimensions. Eye position during the frame interval is modeled using a low dimensional parametric description, which in turn is used to generate predicted distortions of a reference template. The input image is then registered to the distorted template using normalized cross correlation. The motion parameters are then varied, and the correlation recomputed, to find the motion which maximizes the peak value of the correlation. The location and value of the correlation maximum are determined with sub-pixel precision using biquadratic interpolation, yielding eye position resolution better than 1 arc minute. This method of motion parameter estimation is tested using actual SLO images as well as simulated images. Motion parameter estimation might also be applied to individual video lines in order to reduce pipeline delays for a near real-time system.

Mulligan, Jeffrey B.↗

Accurate surface estimation from high-resolution 3D microwave images

Active millimeter and microwave imaging techniques can be used to create a high-resolution 3D image volume of a target’s reflectivity. Millimeter-wave imaging is commonly used for personnel security screening and numerous other applications. Backprojection based image reconstruction techniques form a 3D complex-valued volume. The complex-valued volume is commonly reduced to a real-valued volume by taking the magnitude. For anomaly detection and cross image registration of an object it is beneficial to generate an accurate representation of an object’s surface. Extracting a smooth and accurate surface from a magnitude only image is challenging. One difficulty is the magnitude image has limited resolution in the depth direction which normally limits precision to a moderate fraction of the depth resolution. Another difficulty is that the magnitude of the image depends heavily on the geometry and orientation of the object being imaged. The phase information in a complex-valued image volume provides a means to decouple the magnitude of the image from the geometry of an object and provide precision much finer than the depth resolution would indicate. This enables the generation of a smooth and accurate point cloud representation of the surface of an imaged object. A method to extract a point cloud from the phase information in a 3D complex-valued millimeter-wave image volume is developed and results with simulated and experimental data are presented.

Clark, Richard T.↗

A concept for a future ground control data set for image correction

Strips of ground control can be established with current and future satellite sensors. These can provide precise and reliable geometric references for locating and correcting satellite image data and to support temporal image registration. This paper briefly describes the concept and approach for implementing this data base called a Ground Control Strip, and recommends additional work. The advent of new solid state imaging systems, in particular the linear array detectors (pushbroom sensors), make this new concept particularly attractive and practical.

Bernstein, R.↗

Visual Target Tracking in the Presence of Unknown Observer Motion

Much attention has been given to the visual tracking problem due to its obvious uses in military surveillance. However, visual tracking is complicated by the presence of motion of the observer in addition to the target motion, especially when the image changes caused by the observer motion are large compared to those caused by the target motion. Techniques for estimating the motion of the observer based on image registration techniques and Kalman filtering are presented and simulated. With the effects of the observer motion removed, an additional phase is implemented to track individual targets. This tracking method is demonstrated on an image stream from a buoy-mounted or periscope-mounted camera, where large inter-frame displacements are present due to the wave action on the camera. This system has been shown to be effective at tracking and predicting the global position of a planar vehicle (boat) being observed from a single, out-of-plane camera. Finally, the tracking system has been extended to a multi-target scenario.

image mosaic↗

The Use of Principal Components for Creating Improved Imagery for Geometric Control Point Selection

A directed principal component (PC) analysis and its transformation was applied to 7-channel thematic mapper simulator (TMS) data and 4-channel LANDSAT multispectral scanner system (MSS) data collected over the city of Lancaster, Pennsylvania, to create improved imagery for geometric control point selection for image to image registration. Nineteen temporally stable geometric control points, such as road interactions and bridges, were selected for a 236 sq km area. The control points were visible on both the TMS and MSS imagery. On the first attempt the corresponding image control points were selected on both data sets without using the principal components transformation. Many of the road intersection locations were visible but the actual road crossings could not be distinguished. As a result, mensuration errors using raw data exceeded the equivalent of two (79 x 79 m) pixels. The application of a guided principal components transformation yielded TMS and MSS single band images showing improved detail in the scene's urban and residential infrastructure. The PC transformed data sets were then utilized for the reselection of geometric control points. By shown greater detail, control points on both the TMS and MSS imagery could be located with greater precision using the PC transformed data.

Imhoff, M. L.↗

A Quantum Annealing Computer Team Addresses Climate Change Predictability

The near confluence of the successful launch of the Orbiting Carbon Observatory2 on July 2, 2014 and the acceptance on August 20, 2015 by Google, NASA Ames Research Center and USRA of a 1152 qubit D-Wave 2X Quantum Annealing Computer (QAC), offered an exceptional opportunity to explore the potential of this technology to address the scientific prediction of global annual carbon uptake by land surface processes. At UMBC,we have collected and processed 20 months of global Level 2 light CO2 data as well as fluorescence data. In addition we have collected ARM data at 2sites in the US and Ameriflux data at more than 20 stations. J. Dorband has developed and implemented a multi-hidden layer Boltzmann Machine (BM) algorithm on the QAC. Employing the BM, we are calculating CO2 fluxes by training collocated OCO-2 level 2 CO2 data with ARM ground station tower data to infer to infer measured CO2 flux data. We generate CO2 fluxes with a regression analysis using these BM derived weights on the level 2 CO2 data for three Ameriflux sites distinct from the ARM stations. P. Gentine has negotiated for the access of K34 Ameriflux data in the Amazon and is applying a neural net to infer the CO2 fluxes. N. Talik validated the accuracy of the BM performance on the QAC against a restricted BM implementation on the IBM Softlayer Cloud with the Nvidia co-processors utilizing the same data sets. G. Nearing and K. Harrison have extended the GSFC LIS model with the NCAR Noah photosynthetic parameterization and have run a 10 year global prediction of the net ecosystem exchange. C. Pellisier is preparing a BM implementation of the Kalman filter data assimilation of CO2 fluxes. At UMBC, R. Prouty is conducting OSSE experiments with the LISNoah model on the IBM iDataPlex to simulate the impact of CO2 fluxes to improve the prediction of global annual carbon uptake. J. LeMoigne and D. Simpson have developed a neural net image registration system that will be used for MODIS ENVI and will be converted to a BM algorithm implementation on the QAC. The first integer adder has been implemented on the D-Wave 2X by A. Shehab that will perform HAAR wavelets for image compression of MODIS scenes. Finally, based on the next generations of QACs, we are preparing a 5-year performance road map on the scalability of the current QAC algorithms.

Science Data Processing↗

NASA Tech Briefs, March 2011

Topics covered include: Optimal Tuner Selection for Kalman-Filter-Based Aircraft Engine Performance Estimation; Airborne Radar Interferometric Repeat-Pass Processing; Plug-and-Play Environmental Monitoring Spacecraft Subsystem; Power-Combined GaN Amplifier with 2.28-W Output Power at 87 GHz; Wallops Ship Surveillance System; Source Lines Counter (SLiC) Version 4.0; Guidance, Navigation, and Control Program; Single-Frame Terrain Mapping Software for Robotic Vehicles; Auto Draw from Excel Input Files; Observation Scheduling System; CFDP for Interplanetary Overlay Network; X-Windows Widget for Image Display; Binary-Signal Recovery; Volumetric 3D Display System with Static Screen; MMIC Replacement for Gunn Diode Oscillators; Feature Acquisition with Imbalanced Training Data; Mount Protects Thin-Walled Glass or Ceramic Tubes from Large Thermal and Vibration Loads; Carbon Nanotube-Based Structural Health Monitoring Sensors; Wireless Inductive Power Device Suppresses Blade Vibrations; Safe, Advanced, Adaptable Isolation System Eliminates the Need for Critical Lifts; Anti-Rotation Device Releasable by Insertion of a Tool; A Magnetically Coupled Cryogenic Pump; Single Piezo-Actuator Rotary-Hammering Drill; Fire-Retardant Polymeric Additives; Catalytic Generation of Lift Gases for Balloons; Ionic Liquids to Replace Hydrazine; Variable Emittance Electrochromics Using Ionic Electrolytes and Low Solar Absorptance Coatings; Spacecraft Radiator Freeze Protection Using a Regenerative Heat Exchanger; Multi-Mission Power Analysis Tool; Correction for Self-Heating When Using Thermometers as Heaters in Precision Control Applications; Gravitational Wave Detection with Single-Laser Atom Interferometers; Titanium Alloy Strong Back for IXO Mirror Segments; Improved Ambient Pressure Pyroelectric Ion Source; Multi-Modal Image Registration and Matching for Localization of a Balloon on Titan; Entanglement in Quantum-Classical Hybrid; Algorithm for Autonomous Landing; Quantum-Classical Hybrid for Information Processing; Small-Scale Dissipation in Binary-Species Transitional Mixing Layers; Superpixel-Augmented Endmember Detection for Hyperspectral Images; Coding for Parallel Links to Maximize the Expected Value of Decodable Messages; and Microwave Tissue Soldering for Immediate Wound Closure.

Source record↗

Advanced data visualization and sensor fusion: Conversion of techniques from medical imaging to Earth science

Hughes Aircraft Company and the University of Chicago propose to transfer existing medical imaging registration algorithms to the area of multi-sensor data fusion. The University of Chicago's algorithms have been successfully demonstrated to provide pixel by pixel comparison capability for medical sensors with different characteristics. The research will attempt to fuse GOES (Geostationary Operational Environmental Satellite), AVHRR (Advanced Very High Resolution Radiometer), and SSM/I (Special Sensor Microwave Imager) sensor data which will benefit a wide range of researchers. The algorithms will utilize data visualization and algorithm development tools created by Hughes in its EOSDIS (Earth Observation SystemData/Information System) prototyping. This will maximize the work on the fusion algorithms since support software (e.g. input/output routines) will already exist. The research will produce a portable software library with documentation for use by other researchers.

Savage, Richard C.↗

Multitemporal Snow Cover Mapping in Mountainous Terrain for Landsat Climate Data Record Development

A multitemporal method to map snow cover in mountainous terrain is proposed to guide Landsat climate data record (CDR) development. The Landsat image archive including MSS, TM, and ETM+ imagery was used to construct a prototype Landsat snow cover CDR for the interior northwestern United States. Landsat snow cover CDRs are designed to capture snow-covered area (SCA) variability at discrete bi-monthly intervals that correspond to ground-based snow telemetry (SNOTEL) snow-water-equivalent (SWE) measurements. The June 1 bi-monthly interval was selected for initial CDR development, and was based on peak snowmelt timing for this mountainous region. Fifty-four Landsat images from 1975 to 2011 were preprocessed that included image registration, top-of-the-atmosphere (TOA) reflectance conversion, cloud and shadow masking, and topographic normalization. Snow covered pixels were retrieved using the normalized difference snow index (NDSI) and unsupervised classification, and pixels having greater (less) than 50% snow cover were classified presence (absence). A normalized SCA equation was derived to independently estimate SCA given missing image coverage and cloud-shadow contamination. Relative frequency maps of missing pixels were assembled to assess whether systematic biases were embedded within this Landsat CDR. Our results suggest that it is possible to confidently estimate historical bi-monthly SCA from partially cloudy Landsat images. This multitemporal method is intended to guide Landsat CDR development for freshwaterscarce regions of the western US to monitor climate-driven changes in mountain snowpack extent.

Landsat↗

Recent Advances in Registration, Integration and Fusion of Remotely Sensed Data: Redundant Representations and Frames

In recent years, sophisticated mathematical techniques have been successfully applied to the field of remote sensing to produce significant advances in applications such as registration, integration and fusion of remotely sensed data. Registration, integration and fusion of multiple source imagery are the most important issues when dealing with Earth Science remote sensing data where information from multiple sensors, exhibiting various resolutions, must be integrated. Issues ranging from different sensor geometries, different spectral responses, differing illumination conditions, different seasons, and various amounts of noise need to be dealt with when designing an image registration, integration or fusion method. This tutorial will first define the problems and challenges associated with these applications and then will review some mathematical techniques that have been successfully utilized to solve them. In particular, we will cover topics on geometric multiscale representations, redundant representations and fusion frames, graph operators, diffusion wavelets, as well as spatial-spectral and operator-based data fusion. All the algorithms will be illustrated using remotely sensed data, with an emphasis on current and operational instruments.

Fusion↗

Automation of Geometric Accuracy Assessment Algorithm

When end-users are using multiple satellite images for a study the first step is often the assessment and rectification of geolocation offsets. We have developed an automated algorithm to calculate the geometric offsets between two satellite images. It splits both images into subset images (chips) and resamples them to a common resolution. Offsets are imposed on matching chips and the Pearson Cross Correlation (PCC) value calculated for each offset, where the best PCC gives the true offsets. With the true offsets corrected for, a quality of image registration is calculated, measurement uncertainty (MU). The MU threshold value is non-uniform across sensors because it depends on spectral characteristics of each sensor. Previously, the MU threshold was determined by manual inspection for each new sensor assessed. In this study, we automated MU threshold determination. 1/MU vs calculated offset approximates a Gaussian function in shape, see abstract image. A Gaussian function is fit to this dataset, and the root of the third derivative is calculated and applied as a quality threshold, removing the data of lower quality from the final assessment of image offsets. We apply this algorithm to commercial satellite data for proof of concept.

Alana Semple↗