Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging and visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Image management research

Two types of research issues are involved in image management systems with space station applications: image processing research and image perception research. The image processing issues are the traditional ones of digitizing, coding, compressing, storing, analyzing, and displaying, but with a new emphasis on the constraints imposed by the human perceiver. Two image coding algorithms have been developed that may increase the efficiency of image management systems (IMS). Image perception research involves a study of the theoretical and practical aspects of visual perception of electronically displayed images. Issues include how rapidly a user can search through a library of images, how to make this search more efficient, and how to present images in terms of resolution and split screens. Other issues include optimal interface to an IMS and how to code images in a way that is optimal for the human perceiver. A test-bed within which such issues can be addressed has been designed.

Watson, Andrew B.↗

The Spectral Image Processing System (SIPS): Software for integrated analysis of AVIRIS data

The Spectral Image Processing System (SIPS) is a software package developed by the Center for the Study of Earth from Space (CSES) at the University of Colorado, Boulder, in response to a perceived need to provide integrated tools for analysis of imaging spectrometer data both spectrally and spatially. SIPS was specifically designed to deal with data from the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) and the High Resolution Imaging Spectrometer (HIRIS), but was tested with other datasets including the Geophysical and Environmental Research Imaging Spectrometer (GERIS), GEOSCAN images, and Landsat TM. SIPS was developed using the 'Interactive Data Language' (IDL). It takes advantage of high speed disk access and fast processors running under the UNIX operating system to provide rapid analysis of entire imaging spectrometer datasets. SIPS allows analysis of single or multiple imaging spectrometer data segments at full spatial and spectral resolution. It also allows visualization and interactive analysis of image cubes derived from quantitative analysis procedures such as absorption band characterization and spectral unmixing. SIPS consists of three modules: SIPS Utilities, SIPS_View, and SIPS Analysis. SIPS version 1.1 is described below.

Kruse, F. A.↗

Restoration and reconstruction from overlapping images

This paper describes a technique for restoring and reconstructing a scene from overlapping images. In situations where there are multiple, overlapping images of the same scene, it may be desirable to create a single image that most closely approximates the scene, based on all of the data in the available images. For example, successive swaths acquired by NASA's planned Moderate Imaging Spectrometer (MODIS) will overlap, particularly at wide scan angles, creating a severe visual artifact in the output image. Resampling the overlapping swaths to produce a more accurate image on a uniform grid requires restoration and reconstruction. The one-pass restoration and reconstruction technique developed in this paper yields mean-square-optimal resampling, based on a comprehensive end-to-end system model that accounts for image overlap, and subject to user-defined and data-availability constraints on the spatial support of the filter.

Reichenbach, Stephen E.↗

The Impact History of Vesta: New Views from the Dawn Mission

The Dawn mission has completed its Survey and High-Altitude Mapping Orbit (HAMO) phases at Vesta, resulting in 60-70 meter per pixel imaging, high-resolution image-derived topography, and visual and infrared spectral data covering up to approx.50 degrees north latitude (the north pole was in shadow during these mission phases). These data have provided unprecedented views of the south polar impact structure first detected in HST imaging [1], now named Rheasilvia, and in addition hint at the existence of a population of ancient basins. Smaller craters are seen at all stages from fresh to highly-eroded, with some exposing atypically bright or dark material. The morphology of some craters has been strongly influenced by regional slope. Detailed studies of crater morphology are underway. We have begun making crater counts to constrain the relative ages of different regions of the surface, and are working towards developing an absolute cratering chronology for Vesta's surface.

OBrien, D. P.↗

Ultraviolet-excess selection of the counterpart to a globular cluster X-ray burster - Hubble Space Telescope images of the core of NGC 6712

Using the Planetary Camera on the Hubble Space Telescope, we have obtained high spatial resolution, multicolor images and photometry of the core of the globular cluster NGC 6712. A comparison of our blue and ultraviolet images unambiguously reveals a faint (B = 21), UV-excess object, 'star S', within the Einstein error box for the bursting X-ray source X1850-086. The unusual color of star S is immediately apparent even in a cursory visual comparison of the images, and is more quantitatively (U-B of about -1) confirmed via photometry. A variety of different candidate optical counterparts to the X-ray source have previously been suggested from ground-based work, but our images indicate that star S is almost certainly the only viable candidate brighter than U = 21. Compared with the mean values for low mass X-ray binaries in the field, star S has a typical (U-B) color, and a moderate-to-high X-ray-to-optical luminosity ratio, but its luminosity (MB = 5) is about 4 mag fainter than average.

Anderson, Scott F.↗

Visualization techniques to aid in the analysis of multi-spectral astrophysical data sets

The goal of this project was to support the scientific analysis of multi-spectral astrophysical data by means of scientific visualization. Scientific visualization offers its greatest value if it is not used as a method separate or alternative to other data analysis methods but rather in addition to these methods. Together with quantitative analysis of data, such as offered by statistical analysis, image or signal processing, visualization attempts to explore all information inherent in astrophysical data in the most effective way. Data visualization is one aspect of data analysis. Our taxonomy as developed in Section 2 includes identification and access to existing information, preprocessing and quantitative analysis of data, visual representation and the user interface as major components to the software environment of astrophysical data analysis. In pursuing our goal to provide methods and tools for scientific visualization of multi-spectral astrophysical data, we therefore looked at scientific data analysis as one whole process, adding visualization tools to an already existing environment and integrating the various components that define a scientific data analysis environment. As long as the software development process of each component is separate from all other components, users of data analysis software are constantly interrupted in their scientific work in order to convert from one data format to another, or to move from one storage medium to another, or to switch from one user interface to another. We also took an in-depth look at scientific visualization and its underlying concepts, current visualization systems, their contributions, and their shortcomings. The role of data visualization is to stimulate mental processes different from quantitative data analysis, such as the perception of spatial relationships or the discovery of patterns or anomalies while browsing through large data sets. Visualization often leads to an intuitive understanding of the meaning of data values and their relationships by sacrificing accuracy in interpreting the data values. In order to be accurate in the interpretation, data values need to be measured, computed on, and compared to theoretical or empirical models (quantitative analysis). If visualization software hampers quantitative analysis (which happens with some commercial visualization products), its use is greatly diminished for astrophysical data analysis. The software system STAR (Scientific Toolkit for Astrophysical Research) was developed as a prototype during the course of the project to better understand the pragmatic concerns raised in the project. STAR led to a better understanding on the importance of collaboration between astrophysicists and computer scientists.

Brugel, Edward W.↗

Visualization techniques to aid in the analysis of multispectral astrophysical data sets

The goal of this project was to support the scientific analysis of multi-spectral astrophysical data by means of scientific visualization. Scientific visualization offers its greatest value if it is not used as a method separate or alternative to other data analysis methods but rather in addition to these methods. Together with quantitative analysis of data, such as offered by statistical analysis, image or signal processing, visualization attempts to explore all information inherent in astrophysical data in the most effective way. Data visualization is one aspect of data analysis. Our taxonomy as developed in Section 2 includes identification and access to existing information, preprocessing and quantitative analysis of data, visual representation and the user interface as major components to the software environment of astrophysical data analysis. In pursuing our goal to provide methods and tools for scientific visualization of multi-spectral astrophysical data, we therefore looked at scientific data analysis as one whole process, adding visualization tools to an already existing environment and integrating the various components that define a scientific data analysis environment. As long as the software development process of each component is separate from all other components, users of data analysis software are constantly interrupted in their scientific work in order to convert from one data format to another, or to move from one storage medium to another, or to switch from one user interface to another. We also took an in-depth look at scientific visualization and its underlying concepts, current visualization systems, their contributions and their shortcomings. The role of data visualization is to stimulate mental processes different from quantitative data analysis, such as the perception of spatial relationships or the discovery of patterns or anomalies while browsing through large data sets. Visualization often leads to an intuitive understanding of the meaning of data values and their relationships by sacrificing accuracy in interpreting the data values. In order to be accurate in the interpretation, data values need to be measured, computed on, and compared to theoretical or empirical models (quantitative analysis). If visualization software hampers quantitative analysis (which happens with some commercial visualization products), its use is greatly diminished for astrophysical data analysis. The software system STAR (Scientific Toolkit for Astrophysical Research) was developed as a prototype during the course of the project to better understand the pragmatic concerns raised in the project. STAR led to a better understanding on the importance of collaboration between astrophysicists and computer scientists. Twenty-one examples of the use of visualization for astrophysical data are included with this report. Sixteen publications related to efforts performed during or initiated through work on this project are listed at the end of this report.

Brugel, E. W.↗

Pyramid image codes

All vision systems, both human and machine, transform the spatial image into a coded representation. Particular codes may be optimized for efficiency or to extract useful image features. Researchers explored image codes based on primary visual cortex in man and other primates. Understanding these codes will advance the art in image coding, autonomous vision, and computational human factors. In cortex, imagery is coded by features that vary in size, orientation, and position. Researchers have devised a mathematical model of this transformation, called the Hexagonal oriented Orthogonal quadrature Pyramid (HOP). In a pyramid code, features are segregated by size into layers, with fewer features in the layers devoted to large features. Pyramid schemes provide scale invariance, and are useful for coarse-to-fine searching and for progressive transmission of images. The HOP Pyramid is novel in three respects: (1) it uses a hexagonal pixel lattice, (2) it uses oriented features, and (3) it accurately models most of the prominent aspects of primary visual cortex. The transform uses seven basic features (kernels), which may be regarded as three oriented edges, three oriented bars, and one non-oriented blob. Application of these kernels to non-overlapping seven-pixel neighborhoods yields six oriented, high-pass pyramid layers, and one low-pass (blob) layer.

Watson, Andrew B.↗

A survey of multispectral remote sensing techniques for earth resources applications.

Remote sensing for earth resources applications has as its objective the collection and interpretation of information on all environmentally significant features of the atmosphere, oceans, and land surfaces. This information is most effectively gathered by airborne and satellite borne imaging systems. These systems operate at a variety of wavelengths extending from the visual spectrum, through the infrared and into the centimeter wavelengths of the microwave band. A comparison is made of the signal characteristics at these spectrum regions. In particular, the ability of microwave radiometric imaging to augment visual and infrared imaging is discussed. Recent developments in electronically scanned microwave radiometric sensors are described, together with methods of optimizing microwave data display. Results achieved with integrated display systems for both microwave and optical data are presented, together with projections for future applications.-

Pascalar, H. G.↗

Real-Time Visualization of Tissue Ischemia

A real-time display of tissue ischemia which comprises three CCD video cameras, each with a narrow bandwidth filter at the correct wavelength is discussed. The cameras simultaneously view an area of tissue suspected of having ischemic areas through beamsplitters. The output from each camera is adjusted to give the correct signal intensity for combining with, the others into an image for display. If necessary a digital signal processor (DSP) can implement algorithms for image enhancement prior to display. Current DSP engines are fast enough to give real-time display. Measurement at three, wavelengths, combined into a real-time Red-Green-Blue (RGB) video display with a digital signal processing (DSP) board to implement image algorithms, provides direct visualization of ischemic areas.

Bearman, Gregory H.↗

Multiresolution image gathering and restoration

In this paper we integrate multiresolution decomposition with image gathering and restoration. This integration leads to a Wiener-matrix filter that accounts for the aliasing, blurring, and noise in image gathering, together with the digital filtering and decimation in signal decomposition. Moreover, as implemented here, the Wiener-matrix filter completely suppresses the blurring and raster effects of the image-display device. We demonstrate that this filter can significantly improve the fidelity and visual quality produced by conventional image reconstruction. The extent of this improvement, in turn, depends on the design of the image-gathering device.

Fales, Carl L.↗

High spectral resolution remote sensing of the earth

Early results of a major advance in remote sensing called imaging spectrometry (IS), the simultaneous acquisition of images in many narrow contiguous spectral bands throughout the visible and solar-reflected infrared portions of the spectrum, are discussed. The motivation for IS is reviewed, and the performance of IS is examined, describing prototype sensors. The analysis of IS data is addressed, including the problem of visual interaction with hyperspectral images and their statistical properties, and the effect of data dimensionality on multispectral scene classification. A test of the capability of imaging spectrometry to identify minerals is reported.

Vane, G.↗

Virtual Sensors Determined Through Machine Learning

We propose a method that increases the capability of a conventional sensor, transforming it into an enhanced virtual sensor. This paper focuses on a virtual thermal Infrared Radiation (IR) sensor based on a conventional visual (RGB) sensor. The estimation of thermal IR images can enhance the ability of terrain classification, which is crucial for autonomous navigation of rovers. The estimate in IR from visual band has inherent limitations, as these are different bands, yet correlations between visual RGB and thermal IR images exist, as different terrains, which visually may appear different, also have different thermal inertia. This paper describes the developed deep learning-based algorithm that estimates thermal IR images from RGB images of terrains, providing the feasibility of the idea with average 1.21 error [degree Celsius].

Torresen, Jim↗

Correlation Between Bulk Material Defects and Spectroscopic Response in Cadmium Zinc Telluride Detectors

One of the critical challenges for large area cadmium zinc telluride (CdZnTe) detector arrays is obtaining material capable of uniform imaging and spectroscopic response. Two complementary nondestructive techniques for characterizing bulk CdZnTe have been developed to identify material with a uniform response. The first technique, infrared transmission imaging, allows for rapid visualization of bulk defects. The second technique, x-ray spectral mapping, provides a map of the material spectroscopic response when it is configured as a planar detector. The two techniques have been used to develop a correlation between bulk defect type and detector performance. The correlation allows for the use of infrared imaging to rapidly develop wafer mining maps. The mining of material free of detrimental defects has the potential to dramatically increase the yield and quality of large area CdZnTe detector arrays.

Parker, Bradford H.↗

Three-dimensional organization of vestibular related eye movements to rotational motion in pigeons

During rotational motions, compensatory eye movement adjustments must continually occur in order to maintain objects of visual interest as stable images on the retina. In the present study, the three-dimensional organization of the vestibulo-ocular reflex in pigeons was quantitatively examined. Rotations about different head axes produced horizontal, vertical, and torsional eye movements, whose component magnitude was dependent upon the cosine of the stimulus axis relative to the animal's visual axis. Thus, the three-dimensional organization of the VOR in pigeons appears to be compensatory for any direction of head rotation. Frequency responses of the horizontal, vertical, and torsional slow phase components exhibited high pass filter properties with dominant time constants of approximately 3 s.

NASA Discipline Neuroscience↗

On-board Absolute Localization Based on Orbital Imagery for a Future Mars Science Helicopter

Future Mars Rotorcraft require advanced navigationcapabilities to enable all terrain access over long distance flightsthat are executed fully autonomously. A critical component toenable precision navigation during long traverses is the abilityto perform on-board absolute localization to eliminate drift inposition estimates of the on-board odometry algorithm. Inthis paper, we present an approach for on-board map-basedlocalization to provide global reference position based on orbitalor aerial image maps. Our approach builds on a vision-basedlocalization method to localize against a map derived fromHiRISE image products – an ortho-projected image (orthoimage) and a corresponding digital elevation map. The mapis pre-computed using a feature-based approach. Features arestored with their 3D world coordinates, and a descriptor to codethe local image intensity information in the vicinity of the featurelocation. An on-board matching algorithm uses this informationto match visual features in a query image acquired during flight,guided by a pose prior from the on-board range-visual-inertialstate estimator (Range-VIO). Valid matches are then used bya perspective-n-point (PnP) algorithm to estimate the absolutepose of the vehicle in a global frame. We demonstrate andevaluate our approach on simulated data, and data from UASflights.

Balaram, J. Bob↗

Visibility of wavelet quantization noise

The discrete wavelet transform (DWT) decomposes an image into bands that vary in spatial frequency and orientation. It is widely used for image compression. Measures of the visibility of DWT quantization errors are required to achieve optimal compression. Uniform quantization of a single band of coefficients results in an artifact that we call DWT uniform quantization noise; it is the sum of a lattice of random amplitude basis functions of the corresponding DWT synthesis filter. We measured visual detection thresholds for samples of DWT uniform quantization noise in Y, Cb, and Cr color channels. The spatial frequency of a wavelet is r 2-lambda, where r is display visual resolution in pixels/degree, and lambda is the wavelet level. Thresholds increase rapidly with wavelet spatial frequency. Thresholds also increase from Y to Cr to Cb, and with orientation from lowpass to horizontal/vertical to diagonal. We construct a mathematical model for DWT noise detection thresholds that is a function of level, orientation, and display visual resolution. This allows calculation of a "perceptually lossless" quantization matrix for which all errors are in theory below the visual threshold. The model may also be used as the basis for adaptive quantization schemes.

NASA Center ARC↗

Digital preprocessing and classification of multispectral earth observation data

The development of airborne and satellite multispectral image scanning sensors has generated wide-spread interest in application of these sensors to earth resource mapping. These point scanning sensors permit scenes to be imaged in a large number of electromagnetic energy bands between .3 and 15 micrometers. The energy sensed in each band can be used as a feature in a computer based multi-dimensional pattern recognition process to aid in interpreting the nature of elements in the scene. Images from each band can also be interpreted visually. Visual interpretation of five or ten multispectral images simultaneously becomes impractical especially as area studied increases; hence, great emphasis has been placed on machine (computer) techniques for aiding in the interpretation process. This paper describes a computer software system concept called LARSYS for analysis of multivariate image data and presents some examples of its application.

Anuta, P. E.↗