Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Development and Application of Non-Linear Image Enhancement and Multi-Sensor Fusion Techniques for Hazy and Dark Imaging

The purpose of this research was to develop enhancement and multi-sensor fusion algorithms and techniques to make it safer for the pilot to fly in what would normally be considered Instrument Flight Rules (IFR) conditions, where pilot visibility is severely restricted due to fog, haze or other weather phenomenon. We proposed to use the non-linear Multiscale Retinex (MSR) as the basic driver for developing an integrated enhancement and fusion engine. When we started this research, the MSR was being applied primarily to grayscale imagery such as medical images, or to three-band color imagery, such as that produced in consumer photography: it was not, however, being applied to other imagery such as that produced by infrared image sources. However, we felt that it was possible by using the MSR algorithm in conjunction with multiple imaging modalities such as long-wave infrared (LWIR), short-wave infrared (SWIR), and visible spectrum (VIS), we could substantially improve over the then state-of-the-art enhancement algorithms, especially in poor visibility conditions. We proposed the following tasks: 1) Investigate the effects of applying the MSR to LWIR and SWIR images. This consisted of optimizing the algorithm in terms of surround scales, and weights for these spectral bands; 2) Fusing the LWIR and SWIR images with the VIS images using the MSR framework to determine the best possible representation of the desired features; 3) Evaluating different mixes of LWIR, SWIR and VIS bands for maximum fog and haze reduction, and low light level compensation; 4) Modifying the existing algorithms to work with video sequences. Over the course of the 3 year research period, we were able to accomplish these tasks and report on them at various internal presentations at NASA Langley Research Center, and in presentations and publications elsewhere. A description of the work performed under the tasks is provided in Section 2. The complete list of relevant publications during the research periods is provided in Section 5. This research also resulted in the generation of intellectual property.

Rahman, Zia-ur↗

DSP Implementation of the Multiscale Retinex Image Enhancement Algorithm

The Retinex is a general-purpose image enhancement algorithm that is used to produce good visual representations of scenes. It performs a non-linear spatial/ spectral transform that synthesizes strong local contrast enhancement and color constancy. A real-time, video frame rate implementation of the Retinex is required to meet the needs of various potential users. Retinex processing contains a relatively large number of complex computations, thus to achieve real-time performance using current technologies requires specialized hardware and software. In this paper we discuss the design and development of a digital signal processor (DSP) implementation of the Retinex. The target processor is a Texas Instruments TMS320C6711 floating point DSP. NTSC video is captured using a dedicated frame grabber card, Retinex processed, and displayed on a standard monitor. We discuss the optimizations used to achieve real-time performance of the Retinex and also describe our future plans on using alternative architectures.

Hines, Glenn D.↗

CERES Top-of-atmosphere and Surface fluxes in the Arctic: A comparison with ARISE and MOSAiC measurements

Uncertainty in the NASA Clouds and the Earth’s Radiant Energy System (CERES)-derived irradiances is larger over sea ice than any other surface type and comes from several sources. This presentation summarizes results from comparisons of CERES data with the year-long Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition in the central Arctic and the Arctic Radiation and Icebridge Sea ice Experiment (ARISE). The CERES Synoptic 1degree (SYN1deg) product overestimates the downwelling shortwave flux by 11.40 Wm–2 and underestimates the upwelling shortwave flux by –15.70 Wm–2 and downwelling longwave fluxes by –12.58 Wm–2 at the surface during summer. In addition, large differences are found in the upwelling longwave flux when the surface approaches the melting point (approximately 0C). The large negative bias in upwelling shortwave flux can be attributed in large part to lower surface albedo (–0.15) in satellite footprint relative to surface sensors. The CERES-MOSAiC broadband albedo differences (approximately 20 Wm–2) explain a larger portion of the upwelling shortwave flux difference than the spectral albedo shape differences (approximately 3 Wm–2). The ARISE results indicate the some of these differences in the SW are due to the scene identification and representation of anisotropy in partly cloud scenes. Switching from imager-based to passive microwave-based sea ice data in the CERES inversion process reduces the differences in the grid box average fluxes and in the sea ice partly cloudy scene anisotropy in the instantaneously-matched footprints. Our analysis indicates that calibration and sampling uncertainty limit the ability to place strong constraints (<7%) on CERES TOA fluxes with aircraft measurements. The results indicate that improvements in the surface albedo and cloud data would substantially reduce the uncertainty in the Arctic surface radiation budget derived from CERES data products.

Patrick C Taylor↗

Discriminating semiarid vegetation using airborne imaging spectrometer data - A preliminary assessment

A preliminary assessment was made of Airborne Imaging Spectrometer (AIS) data for discriminating and characterizing vegetation in a semiarid environment. May and October AIS data sets were acquired over a large alluvial fan in eastern California, on which were found Great Basin desert shrub communities. Maximum likelihood classification of a principal components representation of the May AIS data enabled discrimination of subtle spatial detail in images relating to vegetation and soil characteristics. The spatial patterns in the May AIS classification were, however, too detailed for complete interpretation with existing ground data. A similar analysis of the October AIS data yielded poor results. Comparison of AIS results with a similar analysis of May Landsat Thematic Mapper data showed that the May AIS data contained approximately three to four times as much spectrally coherent information. When only two shortwave infrared TM bands were used, results were similar to those from AIS data acquired in October.

Thomas, Randall W.↗

Model-based orientation-independent 3-D machine vision techniques

Orientation-dependent techniques for the identification of a three-dimensional object by a machine vision system are represented in parts. In the first part, the data consist of intensity images of polyhedral objects obtained by a single camera, while in the second part, the data consist of range images of curved objects obtained by a laser scanner. In both cases, the attributed graphic representation of the object surface is used to drive the respective algorithm. In this representation, a graph node represents a surface patch and a link represents the adjacency between two patches. The attributes assigned to nodes are moment invariants of the corresponding face for polyhedral objects. For range images, the Gaussian curvature is used as a segmentation criterion for providing symbolic shape attributes. Identification is achieved by an efficient graph-matching algorithm used to match the graph obtained from the data to a subgraph of one of the model graphs stored in the commputer memory.

De Figueiredo, R. J. P.↗

Image-gathering system design for information and fidelity

Image gathering and processing are assessed in terms of information and fidelity, and the relationship between these two figures of merit is examined. It is assumed that the system is linear and isoplanatic and that the signal and noise amplitudes are Gaussian, wide-sense stationary, and statistically independent. Within these constraints, it is found that the combined process of image gathering and reconstruction (which is intended to reproduce the output of the image-gathering system) behaves as optical, or photographic, image formation in that the informationally optimized design of the image-gathering system ordinarily does not maximize the fidelity of the reconstructed image. The combined process of image gathering and restoration (which is intended to reproduce the input of the image-gathering system) behaves more as a communication channel in that the informationally optimized design of the image-gathering system tends to maximize the fidelity of optimally restored representations of the input.

Huck, Friedrich O.↗

Designing a training tool for imaging mental models

The training process can be conceptualized as the student acquiring an evolutionary sequence of classification-problem solving mental models. For example a physician learns (1) classification systems for patient symptoms, diagnostic procedures, diseases, and therapeutic interventions and (2) interrelationships among these classifications (e.g., how to use diagnostic procedures to collect data about a patient's symptoms in order to identify the disease so that therapeutic measures can be taken. This project developed functional specifications for a computer-based tool, Mental Link, that allows the evaluative imaging of such mental models. The fundamental design approach underlying this representational medium is traversal of virtual cognition space. Typically intangible cognitive entities and links among them are visible as a three-dimensional web that represents a knowledge structure. The tool has a high degree of flexibility and customizability to allow extension to other types of uses, such a front-end to an intelligent tutoring system, knowledge base, hypermedia system, or semantic network.

Dede, Christopher J.↗

Image analysis by integration of disparate information

Image analysis often starts with some preliminary segmentation which provides a representation of the scene needed for further interpretation. Segmentation can be performed in several ways, which are categorized as pixel based, edge-based, and region-based. Each of these approaches are affected differently by various factors, and the final result may be improved by integrating several or all of these methods, thus taking advantage of their complementary nature. In this paper, we propose an approach that integrates pixel-based and edge-based results by utilizing an iterative relaxation technique. This approach has been implemented on a massively parallel computer and tested on some remotely sensed imagery from the Landsat-Thematic Mapper (TM) sensor.

Lemoigne, Jacqueline↗

Recognizing Chromospheric Objects via Markov Chain Monte Carlo

The solar chromosphere consists of three classes which contribute differentially to ultraviolet radiation reaching the earth. We describe a data set of solar images, means of segmenting the images into the constituent classes, and a novel high-level representation for compact objects based on a triangulated spatial membership function.

Markov Chain Monte Carlo Solar↗

Evalution of a DE-Identification Process for Ocular Imaging

Medical privacy of NASA astronauts requires an organized and comprehensive approach when data are being made available outside NASA systems. A combination of factors, including the uniquely small patient population, the extensive medical testing done on these individuals, and the relative cultural popularity of the astronauts puts them at a far greater risk to potential exposure of personal information than the general public. Therefore, care must be taken to ensure that the astronauts' identities are concealed. Magnetic Resonance Imaging (MRI) medical data is a recent source of interest to researchers concerned with the development of Visual Impairment due to Intracranial Pressure (VIIP) in the astronaut population. Each vision MRI scan of an astronaut includes 176 separate sagittal images that are saved as an "image series" for clinical use. In addition to the medical information these image sets provide, they also inherently contain a substantial amount of non-medical personally identifiable information (PII) such as-name, date of birth, and date of exam. We have shown that an image set of this type can be rendered, using free software, to give an accurate representation of the patient's face. This currently restricts NASA from dispensing MRI data to researchers in a deidentified format. Automated software programs, such as the Brain Extraction Tool, are available to researchers who wish to de-identify MRI sagittal brain images by "erasing" identifying characteristics such as the nose and jaw on the image sets. However, this software is not useful to NASA for vision research because it removes the portion of the images around the eye orbits, which is the main area of interest to researchers studying the VIIP syndrome. The Lifetime Surveillance of Astronaut Health program has resolved this issue by developing a protocol to de-identify MRI sagittal brain images using Showcase Premier, a DICOM (Digital Imaging and Communications in Medicine) software package. The software allows manual editing of one image from a patient's image set to be automatically applied to the entire image series. This new approach would allow a new level of access to untapped medical imaging data relating to VIIP that can be utilized by researchers while protecting the privacy of the astronauts. In the next step toward finalizing this technique, NASA clinical radiology consultants will test the images to verify removal of all metadata and PII.

LaPelusa, Michael B.↗

Automatic photointerpretation via texture and morphology analysis

Computer-based techniques for automatic photointerpretation based upon information derived from texture and morphology analysis of images are discussed. By automatic photointerpretation, is meant the determination of semantic descriptions of the content of the images by computer. To perform semantic analysis of morphology, a heirarchical structure of knowledge representation was developed. The simplest elements in a morphology are strokes, which are used to form alphabets. The alphabets are the elements for generating words, which are used to describe the function or property of an object or a region. The words are the elements for constructing sentences, which are used for semantic description of the content of the image. Photointerpretation based upon morphology is then augmented by textural information. Textural analysis is performed using a pixel-vector approach.

Tou, J. T.↗

An Imaging System for Satellite Hypervelocity Impact Debris Characterization

This paper discusses the design of an automated imaging system for size characterization of debris produced by the DebriSat hypervelocity impact test. The goal of the DebriSat project is to update satellite breakup models. A representative LEO satellite, DebriSat, was constructed and subjected to a hypervelocity impact test. The impact produced an estimated 85,000 debris fragments. The size distribution of these fragments is required to update the current satellite breakup models. An automated imaging system was developed for the size characterization of the debris fragments. The system uses images taken from various azimuth and elevation angles around the object to produce a 3D representation of the fragment via a space carving algorithm. The system consists of N point-and-shoot cameras attached to a rigid support structure that defines the elevation angle for each camera. The debris fragment is placed on a turntable that is incrementally rotated to desired azimuth angles. The number of images acquired can be varied based on the desired resolution. Appropriate background and lighting is used for ease of object detection. The system calibration and image acquisition process are automated to result in push-button operations. However, for quality assurance reasons, the system is semi-autonomous by design to ensure operator involvement. This paper describes the imaging system setup, calibration procedure, repeatability analysis, and the results of the debris characterization.

Moraguez, Matthew↗

Detecting Edges in Images by Use of Fuzzy Reasoning

A method of processing digital image data to detect edges includes the use of fuzzy reasoning. The method is completely adaptive and does not require any advance knowledge of an image. During initial processing of image data at a low level of abstraction, the nature of the data is indeterminate. Fuzzy reasoning is used in the present method because it affords an ability to construct useful abstractions from approximate, incomplete, and otherwise imperfect sets of data. Humans are able to make some sense of even unfamiliar objects that have imperfect high-level representations. It appears that to perceive unfamiliar objects or to perceive familiar objects in imperfect images, humans apply heuristic algorithms to understand the images

Dominguez, Jesus A.↗

A tesselated probabilistic representation for spatial robot perception and navigation

The ability to recover robust spatial descriptions from sensory information and to efficiently utilize these descriptions in appropriate planning and problem-solving activities are crucial requirements for the development of more powerful robotic systems. Traditional approaches to sensor interpretation, with their emphasis on geometric models, are of limited use for autonomous mobile robots operating in and exploring unknown and unstructured environments. Here, researchers present a new approach to robot perception that addresses such scenarios using a probabilistic tesselated representation of spatial information called the Occupancy Grid. The Occupancy Grid is a multi-dimensional random field that maintains stochastic estimates of the occupancy state of each cell in the grid. The cell estimates are obtained by interpreting incoming range readings using probabilistic models that capture the uncertainty in the spatial information provided by the sensor. A Bayesian estimation procedure allows the incremental updating of the map using readings taken from several sensors over multiple points of view. An overview of the Occupancy Grid framework is given, and its application to a number of problems in mobile robot mapping and navigation are illustrated. It is argued that a number of robotic problem-solving activities can be performed directly on the Occupancy Grid representation. Some parallels are drawn between operations on Occupancy Grids and related image processing operations.

Elfes, Alberto↗

Visual information processing; Proceedings of the Meeting, Orlando, FL, Apr. 20-22, 1992

Topics discussed in these proceedings include nonlinear processing and communications; feature extraction and recognition; image gathering, interpolation, and restoration; image coding; and wavelet transform. Papers are presented on noise reduction for signals from nonlinear systems; driving nonlinear systems with chaotic signals; edge detection and image segmentation of space scenes using fractal analyses; a vision system for telerobotic operation; a fidelity analysis of image gathering, interpolation, and restoration; restoration of images degraded by motion; and information, entropy, and fidelity in visual communication. Attention is also given to image coding methods and their assessment, hybrid JPEG/recursive block coding of images, modified wavelets that accommodate causality, modified wavelet transform for unbiased frequency representation, and continuous wavelet transform of one-dimensional signals by Fourier filtering.

Huck, Friedrich O.↗

SNPP VIIRS Spectral Bands Co-Registration and Spatial Response Characterization

The Visible Infrared Imager Radiometer Suite (VIIRS) instrument onboard the Suomi National Polar‐orbiting Partnership (SNPP) satellite was launched on 28 October 2011. The VIIRS has 5 imagery spectral bands (I-bands), 16 moderate resolution spectral bands (M-bands) and a panchromatic day/night band (DNB). Performance of the VIIRS spatial response and band-to-band co-registration (BBR) was measured through intensive pre-launch tests. These measurements were made in the non-aggregated zones near the start (or end) of scan for the I-bands and M-bands and for a limited number of aggregation modes for the DNB in order to test requirement compliance. This paper presents results based on a recently re-processed pre-launch test data. Sensor (detector) spatial impulse responses in the scan direction are parameterized in terms of ground dynamic field of view (GDFOV), horizontal spatial resolution (HSR), modulation transfer function (MTF), ensquared energy (EE) and integrated out-of-pixel (IOOP) spatial response. Results are presented for the non-aggregation, 2-sample and 3-sample aggregation zones for the I-bands and M-bands, and for a limited number of aggregation modes for the DNB. On-orbit GDFOVs measured for the 5 I-bands in the scan direction using a straight bridge are also presented. Band-to-band co-registration (BBR) is quantified using the prelaunch measured band-to-band offsets. These offsets may be expressed as fractions of horizontal sampling intervals (HSIs), detector spatial response parameters GDFOV or HSR. BBR bases on HSIs in the non-aggregation, 2-sample and 3-sample aggregation zones are presented. BBR matrices based on scan direction GDFOV and HSR are compared to the BBR matrix based on HSI in the non-aggregation zone. We demonstrate that BBR based on GDFOV is a better representation of footprint overlap and so this definition should be used in BBR requirement specifications. We propose that HSR not be used as the primary image quality indicator, since we show that it is neither an adequate representation of the size of sensor spatial response nor an adequate measure of imaging quality.

Suomi NPP VIIRS↗

Association Between Vascular Density and Loss of Protective RAS During Early NPDR by Fractal Dimension

Purpose: Our hypothesis predicts that blood vessels within the retina increase in density during early-stage nonproliferative diabetic retinopathy (NPDR), based on previous results of a small retrospective study. For the current prospective study, the remodeling of arteries and veins during progression of early NPDR is assessed by a repertoire of parameters that includes the fractal dimension (D(sub f) ). In complex structures such as branching vascular trees, D(sub f) is a sensitive measure of space-filing capacity. The renin-angiotensin system (RAS) is implicated in DR pathogenesis and the function of circulating angiogenic cells (CACs), a critical bone marrow-derived population instrumental in vascular repair. Methods: Arterial and venous branching patterns were extracted from images of 6 normal controls and 3 early NPDR subjects (2 moderate, 1 mild) acquired by Heidelberg Spectralis (Registered Trademark) OCT following fluorescein angiography (FA). The vascular branching patterns were analyzed by NASAs VESsel GENeration Analysis (VESGEN) software, in which skeletonized representations were generated automatically to yield D(sub f) by the box-counting method. For binary 2D images, D(sub f) varies between limiting Euclidean dimensions of 1 and 2. Peripheral blood of diabetics and controls was collected for CD34+ CAC isolation. The gene expression of RAS in CACs was assessed by qPCR for Mas receptor to Ang-(1-7). The vasoreparative function of the CACs was measured by migration ability toward CXCL12 (SDF-1). Results: By D(sub f), venous and arterial densities were 1.370 +/- 0.006 and 1.329 +/- 0.016 for early NPDR, compared to 1.318 +/- 0.012 and 1.320 +/- 0.036 for control. The space filling capacity in early NPDR measured by D(sub f), a sensitive parameter, therefore demonstrated a pronounced increase for veins, but not for arteries. Mas receptor mRNA in CACs was increased in diabetics without DR but reduced with onset of NPDR, indicating possible loss of compensation of protective RAS during early DR. Migratory dysfunction of CD34+ cells was further associated with DR. Conclusions: As assessed by the fractal dimension in our preliminary study, the space-filling capacity of veins, but not arteries, was greater in early NPDR than in control. Larger patient populations will be examined as we complete our ongoing longitudinal study. Results further suggest the protective RAS axis within diabetic CACs is lost early in DR and is associated with increased vascular remodeling as evidenced by VESGEN analysis.

vascular↗

Physics Based Modeling and Rendering of Vegetation in the Thermal Infrared

We outline a procedure for rendering physically-based thermal infrared images of simple vegetation scenes. Our approach incorporates the biophysical processes that affect the temperature distribution of the elements within a scene. Computer graphics plays a key role in two respects. First, in computing the distribution of scene shaded and sunlit facets and, second, in the final image rendering once the temperatures of all the elements in the scene have been computed. We illustrate our approach for a simple corn scene where the three-dimensional geometry is constructed based on measured morphological attributes of the row crop. Statistical methods are used to construct a representation of the scene in agreement with the measured characteristics. Our results are quite good. The rendered images exhibit realistic behavior in directional properties as a function of view and sun angle. The root-mean-square error in measured versus predicted brightness temperatures for the scene was 2.1 deg C.

Smith, J. A.↗