Image motion stabilization requirements for dynamic visual tasks in space
Image motion stabilization for dynamic visual task by astronauts on future space missions
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Image motion stabilization for dynamic visual task by astronauts on future space missions
Image segmentation involves labelling pixels according to their membership in image regions. This requires the understanding of what a region is. Using supervised pixel classification, the paper investigates how groups of pixels labelled manually according to perceived image semantics map onto the feature space created by an Artificial Visual System. Multiscale structure of regions are investigated and it is shown that pixels form clusters based on their geometric roles in the image intensity function, not by image semantics. A tentative abstract definition of a 'region' is proposed based on this behavior.
Recorded color images differ from direct human viewing by the lack of dynamic range compression and color constancy. Research is summarized which develops the center/surround retinex concept originated by Edwin Land through a single scale design to a multi-scale design with color restoration (MSRCR). The MSRCR synthesizes dynamic range compression, color constancy, and color rendition and, thereby, approaches fidelity to direct observation.
Shannon's theory of information is used to optimize the optical design of sensor-array imaging systems which use neighborhood image-plane signal processing for enhancing edges and compressing dynamic range during image formation. The resultant edge-enhancement, or band-pass-filter, response is found to be very similar to that of human vision. Comparisons of traits in human vision with results from information theory suggest that: (1) Image-plane processing, like preprocessing in human vision, can improve visual information acquisition for pattern recognition when resolving power, sensitivity, and dynamic range are constrained. Improvements include reduced sensitivity to changes in lighter levels, reduced signal dynamic range, reduced data transmission and processing, and reduced aliasing and photosensor noise degradation. (2) Information content can be an appropriate figure of merit for optimizing the optical design of imaging systems when visual information is acquired for pattern recognition. The design trade-offs involve spatial response, sensitivity, and sampling interval.
Abstract Visualizing surface-supported and buried planar mesoscale structures, such as nanoelectronics, ultrathin-film quantum dots, photovoltaics, and heterogeneous catalysts, often requires high-resolution X-ray imaging and scattering. Here, we discovered that multibeam scattering in grazing-incident reflection geometry is sensitive to three-dimensional (3D) structures in a single view, which is difficult in conventional scattering or imaging approaches. We developed a 3D finite-element-based multibeam-scattering analysis to decode the heterogeneous electric-field distribution and to faithfully reproduce the complex scattering and surface features. This approach further leads to the demonstration of hard-X-ray Lloyd’s mirror interference of scattering waves, resembling dark-field, high-contrast surface holography under the grazing-angle scattering conditions. A first-principles calculation of the single-view holographic images resolves the surface patterns’ 3D morphology with nanometer resolutions, which is critical for ultrafine nanocircuit metrology. The holographic method and simulations pave the way for single-shot structural characterization for visualizing irreversible and morphology-transforming physical and chemical processes in situ or operando .
A mobile pill transmitter system moves through, or adjacent to, one or more organs in an animal or human body, while transmitting signals from its present location and/or present angular orientation. The system also provides signals from which the present roll angle of the pill, about a selected axis, can be determined. When the location coordinates angular orientation and the roll angle of the pill are within selected ranges, an aperture on the pill container releases a selected chemical into, or onto, the body. Optionally, the pill, as it moves, provides a sequence of visually perceptible images. The times for image formation may correspond to times at which the pill transmitter system location or image satisfies one of at least four criteria. This invention provides and supplies an algorithm for exact determination of location coordinates and angular orientation coordinates for a mobile pill transmitter (PT), or other similar device that is introduced into, and moves within, a GI tract of a human or animal body. A set of as many as eight nonlinear equations has been developed and applied, relating propagation of a wireless signal between either two, three, or more transmitting antennas located on the PT, to four or more non-coplanar receiving antennas located on a signal receiver appliance worn by the user. The equations are solved exactly, without approximations or iterations, and are applied in several environments: (1) association of a visual image, transmitted by the PT at each of a second sequence of times, with a PT location and PT angular orientation at that time; (2) determination of a position within the body at which a drug or chemical substance or other treatment is to be delivered to a selected portion of the body; (3) monitoring, after delivery, of the effect(s) of administration of the treatment; and (4) determination of one or more positions within the body where provision and examination of a finer-scale image is warranted.
This presentation describes how a vision model incorporating contrast sensitivity, contrast masking, and light adaptation is used to design visually optimal quantization matrices for Discrete Cosine Transform image compression. The Discrete Cosine Transform (DCT) underlies several image compression standards (JPEG, MPEG, H.261). The DCT is applied to 8x8 pixel blocks, and the resulting coefficients are quantized by division and rounding. The 8x8 'quantization matrix' of divisors determines the visual quality of the reconstructed image; the design of this matrix is left to the user. Since each DCT coefficient corresponds to a particular spatial frequency in a particular image region, each quantization error consists of a local increment or decrement in a particular frequency. After adjustments for contrast sensitivity, local light adaptation, and local contrast masking, this coefficient error can be converted to a just-noticeable-difference (jnd). The jnd's for different frequencies and image blocks can be pooled to yield a global perceptual error metric. With this metric, we can compute for each image the quantization matrix that minimizes the bit-rate for a given perceptual error, or perceptual error for a given bit-rate. Implementation of this system demonstrates its advantages over existing techniques. A unique feature of this scheme is that the quantization matrix is optimized for each individual image. This is compatible with the JPEG standard, which requires transmission of the quantization matrix.
We present the first results of the Palomar Adaptive Optics observations taken during the Deep Impact encounter with 9P/Tempel 1 in July 2005. We have combined the Palomar near-IR imaging data with our visual wavelength images obtained simultaneously at JPL's Table Mountain Observatory to cover the total wavelength range from 0.4 to 2.3 micrometers in the B, V, R, I, J, H, and K filter bands, spanning the dates from 2005 July 03-07.We also include in our overall analysis images taken on the pre-encounter dates of June 1 and June 15, 2005. The broad wavelength range of our observations, along with high temporal resolution, near-IR sensitivity, and spatial resolution of our imaging, have enabled us to place constraints on the temperature of the impact flash and incandescent plume of greater than 700 K, and to provide mean dust velocities of order 197 +/- 16 m/s approximately 1.25 h after impact derived from our 1.64 micro observations. Our ejected dust mass estimates, as derived from our near-IR observations, are an order of magnitude less than those previously reported for visual wavelength observations.
An image data visual browse facility is developed for a UNIX platform using the X Windows 11 system. It allows one to visually examine reduced resolution image data to determine which data are applicable for further research. Links with a relational data base manager then allow one to extract not only the full resolution image data, but any other ancillary data related to the case study. Various techniques are examined for compression of the image data in order to reduce data storage requirements and time necessary to transmit the data on the internet. Data used were from the WetNet project.
In order to further the state-of-the-art in computational aerosciences (CAS) technology, researchers must be able to gather and understand existing work in the field. One aspect of this information gathering is studying published work available in scientific journals and conference proceedings. However, current scientific publications are very limited in the type and amount of information that they can disseminate. Information is typically restricted to text, a few images, and a bibliography list. Additional information that might be useful to the researcher, such as additional visual results, referenced papers, and datasets, are not available. New forms of electronic publication, such as the World Wide Web (WWW), limit publication size only by available disk space and data transmission bandwidth, both of which are improving rapidly. The Numerical Aerodynamic Simulation (NAS) Systems Division at NASA Ames Research Center is in the process of creating an archive of CAS information on the WWW. This archive will be based on the large amount of information produced by researchers associated with the NAS facility. The archive will contain technical summaries and reports of research performed on NAS supercomputers, visual results (images, animations, visualization system scripts), datasets, and any other supporting meta-information. This information will be available via the WWW through the NAS homepage, located at http://www.nas.nasa.gov/, fully indexed for searching. The main components of the archive are technical summaries and reports, visual results, and datasets. Technical summaries are gathered every year by researchers who have been allotted resources on NAS supercomputers. These summaries, together with supporting visual results and references, are browsable by interested researchers. Referenced papers made available by researchers can be accessed through hypertext links. Technical reports are in-depth accounts of tools and applications research projects performed by NAS staff members and collaborators. Visual results, which may be available in the form of images, animations, and/or visualization scripts, are generated by researchers with respect to a certain research project, depicting dataset features that were determined important by the investigating researcher. For example, script files for visualization systems (e.g. FAST, PLOT3D, AVS) are provided to create visualizations on the user's local workstation to elucidate the key points of the numerical study. Users can then interact with the data starting where the investigator left off. Datasets are intended to give researchers an opportunity to understand previous work, 'mine' solutions for new information (for example, have you ever read a paper thinking "I wonder what the helicity density looks like?"), compare new techniques with older results, collaborate with remote colleagues, and perform validation. Supporting meta-information associated with the research projects is also important to provide additional context for research projects. This may include information such as the software used in the simulation (e.g. grid generators, flow solvers, visualization). In addition to serving the CAS research community, the information archive will also be helpful to students, visualization system developers and researchers, and management. Students (of any age) can use the data to study fluid dynamics, compare results from different flow solvers, learn about meshing techniques, etc., leading to better informed individuals. For these users it is particularly important that visualization be integrated into dataset archives. Visualization researchers can use dataset archives to test algorithms and techniques, leading to better visualization systems, Management can use the data to figure what is really going on behind the viewgraphs. All users will benefit from fast, easy, and convenient access to CFD datasets. The CAS information archive hopes to serve as a useful resource to those interested in computational sciences. At present, only information that may be distributed internationally is made available via the archive. Studies are underway to determine security requirements and solutions to make additional information available. By providing access to the archive via the WWW, the process of information gathering can be more productive and fruitful due to ease of access and ability to manage many different types of information. As the archive grows, additional resources from outside NAS will be added, providing a dynamic source of research results.
In the past we have used thermal imaging techniques to visualize the cryocooling processes of macromolecular crystals. From these images it was clear that a cold wave progresses through a crystal starting at the face closest to the origin of the cold stream and ending at the point furthest away. During these studies we used large volume crystals, which were clearly distinguished from the loop holding them. These large crystals, originally grown for neutron diffraction studies, were chosen deliberately to enhance the imaging. As an extension to this work, we used thermal imaging to study small crystals, held in a cryo- loop, in the presence of vitrified mother liquor. The different infrared transmission and reflectance properties of the crystal in comparison to the mother liquor surrounding it are thought to be the parameter that produces the contrast that makes the crystal visible. An application of this technology may be the determination of the exact location of small crystals in a cryo-loop. Data from initial tests in support of application development was recorded for lysozyme crystals and for bFGF/dna complex crystals, which were cryo-cooled and imaged in large loops, both with visible light and with infrared radiation. The crystals were clearly distinguished from the vitrified solution in the infrared spectrum, while in the case of the bFGF/dna complex the illumination had to be carefully manipulated to make the crystal visible in the visible spectrum. These results suggest that the thermal imaging may be more sensitive than visual imaging for automated location of small crystals. However, further work on small crystals robotically mounted at SSRL did not clearly visualize those crystals. The depth of field of the camera proved to be limiting and a different cooling geometry was used, compared to the previous, successful experiments. Analysis to exploit multiple images to improve depth of field and experimental work to understand cooling geometry effects is ongoing. These results will be presented along with advantages and disadvantages of the technique and a discussion of how it might be applied .
In the past we have used thermal imaging techniques to visualize the cryocooling processes of macromolecular crystals. From these images it was clear that a cold wave progresses through a crystal starting at the face closest to the origin of the cold stream and ending at the point furthest away. During these studies we used large volume crystals, which were clearly distinguished from the loop holding them. These large crystals, originally grown for neutron diffraction studies, were chosen deliberately to enhance the imaging. As an extension to this work, we present used thermal imaging to study small crystals, held in a cryo-loop, in the presence of vitrified mother liquor. The different infrared transmission and reflectance properties of the crystal in comparison to the mother liquor surrounding it are thought to be the parameter that produces the contrast that makes the crystal visible. An application of this technology may be the determination of the exact location of small crystals in a cryo-loop. Data from initial tests in support of application development was recorded for lysozyme crystals and for bFGF/dna complex crystals, which were cryo-cooled and imaged in large loops, both with visible light and with infrared radiation. The crystals were clearly distinguished from the vitrified solution in the infrared spectrum, while in the case of the bFGF/dna complex the illumination had to be carefully manipulated to make the crystal visible in the visible spectrum. These results suggest that the thermal imaging may be more sensitive than visual imaging for automated location of small crystals. However, further work on small crystals robotically mounted at SSRL did not clearly visualize those crystals. The depth of field of the camera proved to be limiting and a different cooling geometry was used, compared to the previous, successful experiments. Analysis to exploit multiple images to improve depth of field and experimental work to understand cooling geometry effects is ongoing. These results will be presented along with advantages and disadvantages of the technique and a discussion of how it might be applied.
In the past we have used thermal imaging techniques to visualize the cryocooling processes of macromolecular crystals. From these images it was clear that a cold wave progresses through a crystal starting at the face closest to the origin of the cold stream and ending at the point furthest away. During these studies we used large volume crystals, which were clearly distinguished fiom the loop holding them. These large crystals, originally grown for neutron diffiaction studies, were chosen deliberately to enhance the imaging. As an extension to this work, we present used thermal imaging to study small crystals, held in a cryo-loop, in the presence of vitrified mother liquor. The different d a r e d transmission and reflectance properties of the crystal in comparison to the mother liquor surrounding it are thought to be the parameter that produces the contrast that makes the crystal visible. An application of this technology may be the determination of the exact location of small crystals in a cryo-loop. Data fkom initial tests in support of application development was recorded for lysozyme crystals and for bFGF/dna complex crystals, which were cryocooled and imaged in large loops, both with visible light mad with h i k e d rdi&tion. The crystals were clearly distinguished from the vitrified solution in the infiared spectrum, while in the case of the bFGF/dna complex the illumination had to be carefully manipulated to make the crystal visible in the visible spectrum. These results suggest that the thermal imaging may be more sensitive than visual imaging for automated location of small crystals. However, further work on small crystals robotically mounted at SSRL did not clearly visualize those crystals. The depth of field of the camera proved to be limiting and a different cooling geometry was used, compared to the previous, successful experiments. Analysis to exploit multiple images to improve depth of field and experimental work to understand cooling geometry effects is ongoing. These results will be presented along with advantages and disadvantages of the technique and a discussion of how it might be applied.
Viewing terrain data from various remote sensors in three dimensions has proven to be a valuable tool for scientists in understanding a variety of problems. A technique is presented for using image pyramids in such visualization of large terrain data sets, providing up to two orders of magnitude performance enhancement over simpler techniques, while at the same time eliminating false high-frequency information, which causes animations to sparkle.
Results of a defect visualization process based on pulse infrared thermography are presented. Algorithms have been developed to reduce the amount of operator participation required in the process of interpreting thermographic images. The algorithms determine the defect's depth and size from the temporal and spatial thermal distributions that exist on the surface of the investigated object following thermal excitation. A comparison of the results from thermal contrast, time derivative, and phase analysis methods for defect visualization are presented. These comparisons are based on three dimensional simulations of a test case representing a plate with multiple delaminations. Comparisons are also based on experimental data obtained from a specimen with flat bottom holes and a composite panel with delaminations.
The volume of data acquired by synthetic aperture radar (SAR) missions motivates the development of a technique that will provide investigators with timely access to image data, and the capability to visually inspect images to determine various characteristics of the data collected, as well as the extent of the data coverage. A system was designed for accessing and browsing an on-line archive of NASA Airborne SAR (AIRSAR) imagery and is being developed as an extension to the SAR Data Catalog System (SDCS). The AIRSAR browse system consists of three elements: (1) an on-line, compressed imagery archive; (2) a user interface for selecting and accessing the on-line images; and (3) a software application program for reconstructuring and displaying the images. Details of these elements are described. The goals are to maximize the utilization of the AIRSAR data set, and to demonstrate the image browse concept for SAR data so that baseline catalog systems supporting SIR-C and future SAR missions will feature this capability.
We have used thermal imaging techniques to visualize the cryocooling processes of macromolecular crystals. Cryocooling is a common technique used for structural data collection to reduce radiation damage in intense X-ray beams and decrease the thermal motion of the atoms. From the thermal images it was clear that during cryocooling a cold wave progresses through a crystal starting at the face closest to the origin of the cold stream and ending at the point furthest away. As an extension to this work, we used thermal imaging to study small crystals, held in a cryo-loop, in the presence of vitrified mother liquor. The different infrared transmission and reflectance properties of the crystal in comparison to the mother liquor surrounding it are thought to be the parameter that produces the contrast that makes the crystal visible. An application of this technology may be the determination of the exact location of small crystals in a cryo-loop for automated structural genomics studies. Data from initial tests in support of application development was recorded for lysozyme crystals and for bFGF/dna complex crystals, which were cryocooled and imaged in large loops, both with visible light and with infrared radiation. The crystals were clearly distinguished from the vitrified solution in the infrared spectrum, while in the case of the bFGF/dna complex the illumination had to be carefully manipulated to make the crystal visible in the visible spectrum. These results suggest that the thermal imaging may be more sensitive than visual imaging for automated location of small crystals. However, further work on small crystals robotically mounted at SSRL did not clearly visualize those crystals. The depth of field of the camera proved to be limiting and a different cooling geometry was used, compared to the previous, successful experiments. Analysis to exploit multiple images to improve depth of field and experimental work to understand cooling geometry effects is ongoing. These results will be presented along with advantages and disadvantages of the technique and a discussion of how it might be applied.
A method is investigated for optimizing the end-to-end performance of image gathering and restoration for visual quality. To achieve this objective, one must inevitably confront the problems that the visual quality of restored images depends on perceptual rather than mathematical considerations and that these considerations vary with the target, the application, and the observer. The method adopted in this paper is to optimize image gathering informationally and to restore images interactively to obtain the visually preferred trade-off among fidelity resolution, sharpness, and clarity. The results demonstrate that this method leads to significant improvements in the visual quality obtained by the traditional digital processing methods. These traditional methods allow a significant loss of visual quality to occur because they treat the design of the image-gathering system and the formulation of the image-restoration algorithm as two separate tasks and fail to account for the transformations between the continuous and the discrete representations in image gathering and reconstruction.