Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Gaussian Mixture Models for Temporal Depth Fusion

Sensing the 3D environment of a moving robot is essential for collision avoidance. Most 3D sensors produce dense depth maps, which are subject to imperfections due to various environmental factors. Temporal fusion of depth maps is crucial to overcome those. Temporal fusion is traditionally done in 3D space with voxel data structures, but it can be approached by temporal fusion in image space, with potential benefits in reduced memory and computational cost for applications like reactive collision avoidance for micro air vehicles. In this paper, we present an efficient Gaussian Mixture Models based depth map fusion approach, introducing an online update scheme for dense representations. The environment is modeled from an ego-centric point of view, where each pixel is represented by a mixture of Gaussian inverse-depth models. Consecutive frames are related to each other by transformations obtained from visual odometry. This approach achieves better accuracy than alternative image space depth map fusion techniques at lower computational cost.

Matthies, Larry↗

Machine parts recognition using a trinary associative memory

The convergence mechanism of vectors in Hopfield's neural network in relation to recognition of partially known patterns is studied in terms of both inner products and Hamming distance. It has been shown that Hamming distance should not always be used in determining the convergence of vectors. Instead, inner product weighting coefficients play a more dominant role in certain data representations for determining the convergence mechanism. A trinary neuron representation for associative memory is found to be more effective for associative recall. Applications of the trinary associative memory to reconstruct machine part images that are partially missing are demonstrated by means of computer simulation as examples of the usefulness of this approach.

Awwal, Abdul Ahad S.↗

Terrain mapping for a roving planetary explorer

A prototype legged vehicle is being developed for an exploratory mission on another planet, conceivably Mars, where it is to traverse uncharted areas and collect material samples. The rover can construct from range imagery a geometric terrain representation; i.e., elevation map that includes uncertainty, unknown areas, and local features. An algorithm for constructing an elevation map from a single range image is presented: by virtue of working in spherical-polar space, the algorithm is independent of the desired map resolution and the orientation of the sensor, unlike algorithms that work in Cartesian space. Also presented is a two-stage matching technique (feature matching followed by iconic matching) that identifies the transformation T corresponding to the vehicle displacement between two viewing positions. To support legged locomotion over rough terrain, methods for evaluating regions of the constructed elevation maps as footholds are developed.

Hebert, M.↗

Experiments in model-based matching using a relational pyramid representation

The relational pyramid representation is a hierarchical relational description of an object that can be used in recognition and pose estimation. In this representation, primitive features appear at the bottom of the pyramid, relations among primitives appear at level one, and, in general, relations among lower-level structures appear at the levels above the levels in which these structures were defined. A pose-estimation system is constructed that uses the relational pyramid representation for the view classes of a 3D object and for the description of the unknown view of an object extracted from an image. A previously described system uses summary information to rank and select view classes to which the unknown view is compared. This paper describes a best-first search procedure to find correspondences between the selected view class pyramid and the image pyramid.

Chu, Nancy T.↗

Registration of video sequences from multiple sensors

In this paper, we describe an approach for registration of video sequences from a suite of multiple sensors including television, infrared and radar. Video sequences generated by these sensors may contain abrupt changes in local contrast and inconsistent image features, which pose additional difficulties for registration. Our approach to registration addresses the difficulties caused by using multiple sensors. We use a representation for registration that is invariant to local contrast changes, followed by smoothing of the resulting error measure used for registration, for robust estimation of registration parameters. We use an iterative procedure to reduce the effect of inconsistent features. Finally, we describe a method that uses same-sensor registration to aide in performing registration of sequences of video frames across multiple sensors.

Sharma, Ravi K.↗

Deriving the Coronal Magnetic Field Using Parametric Transformation Analysis

When plasma-beta greater than 1 then the gas pressure dominates over the magnetic pressure. This ratio as a function along the coronal magnetic field lines varies from beta greater than 1 in the photosphere at the base of the field lines, to beta much less than 1 in the mid-corona, to beta greater than 1 in the upper corona. Almost all magnetic field extrapolations do not or cannot take into account the full range of beta. They essentially assume beta much less than 1, since the full boundary conditions do not exist in the beta greater than 1 regions. We use a basic parametric representation of the magnetic field lines such that the field lines can be manipulated to match linear features in the EUV and SXR coronal images in a least squares sense. This research employs free-form deformation mathematics to generate the associated coronal magnetic field. In our research program, the complex magnetic field topology uses Parametric Transformation Analysis (PTA) which is a new and innovative method to describe the coronal fields that we are developing. In this technique the field lines can be viewed as being embedded in a plastic medium, the frozen-in-field-line concept. As the medium is deformed the field lines are similarly deformed. However the advantage of the PTA method is that the field line movement represents a transformation of one magnetic field solution into another magnetic field solution. When fully implemented, this method will allow the resulting magnetic field solution to fully match the magnetic field lines with EUV/SXR coronal loops by minimizing the differences in direction and dispersion of a collection of PTA magnetic field lines and observed field lines. The derived magnetic field will then allow beta greater than 1 regions to be included, the electric currents to be calculated, and the Lorentz force to be determined. The advantage of this technique is that the solution is: (1) independent of the upper and side boundary conditions, (2) allows non-vanishing magnetic forces, and (3) provides a global magnetic field solution, which contains high- and low-beta regimes and maximizes the similarity between the field lines structure and all the coronal images of the region. The coronal image analysis is crucial to the investigation and for the first time these images can be exploited to derive the coronal magnetic field in a well-posed mathematical formulation. This program is an outgrowth of an investigation in which an extrapolated potential field was required to be "inflated" in order to have the field lines match the Yohkoh/SXT images. The field lines were radially stretched resulting in a better match to the coronal loops of an active region. The PTA method of radial and non-radial deformations of field lines to provide a match to the EUV/SXR images will be presented.

Gary, G. Allen↗

Vectorized Rebinning Algorithm for Fast Data Down-Sampling

A vectorized rebinning (down-sampling) algorithm, applicable to N-dimensional data sets, has been developed that offers a significant reduction in computer run time when compared to conventional rebinning algorithms. For clarity, a two-dimensional version of the algorithm is discussed to illustrate some specific details of the algorithm content, and using the language of image processing, 2D data will be referred to as "images," and each value in an image as a "pixel." The new approach is fully vectorized, i.e., the down-sampling procedure is done as a single step over all image rows, and then as a single step over all image columns. Data rebinning (or down-sampling) is a procedure that uses a discretely sampled N-dimensional data set to create a representation of the same data, but with fewer discrete samples. Such data down-sampling is fundamental to digital signal processing, e.g., for data compression applications.

Dean, Bruce↗

Statistical Challenges in Modern Astronomy II

Wavelets are the central idea of a broad framework for thinking about displaying, and analyzing data - not just a new specialized technique. They are localized basis functions that provide an extremely flexible and efficient representation of time series. Current developments in the theory and application of wavelets are yielding powerful multiresolution techniques for the analysis of time series and image data. Wavelet methods can effect noise removal. characterization of stochastic behavior, depiction of power spectrum time-variations, and data compression - for time series data, image data, and data of higher dimensions. I review published applications of wavelets in astronomy.

Scargle, Jeffrey D.↗

Linear State-Space Representation of the Dynamics of Relative Motion, Based on Restricted Three Body Dynamics

Precision Formation Flying is an enabling technology for a variety of proposed space- based observatories, including the Micro-Arcsecond X-ray Imaging Mission (MAXIM), Stellar Imager (SI) and the Terrestrial Planet Finder (TPF). An essential element of the technology is the control algorithm, requiring a clear understanding of the dynamics of relative motion. This paper examines the dynamics of relative motion in the context of the Restricted Three Body Problem (RTBP). The natural dynamics of relative motion are presented in their full nonlinear form. Motivated by the desire to apply linear control methods, the dynamics equations are linearized and presented in state-space form. The stability properties are explored for regions in proximity to each of the libration points in the Earth/Moon - Sun rotating frame. The dynamics of relative motion are presented in both the inertial and rotating coordinate frames.

Luquette, Richard J.↗

IMAGE Software Suite

The IMAGE Mission is generating a truely unique set of magnetospheric measurement through a first-of-its-kind complement of remote, global observations. These data are being distributed in the Universal Data Format (UDF), which consists of data, calibration, and documentation. This is an open dataset, available to all by request to the National Space Science Data Center (NSSDC) at NASA Goddard Space Flight Center. Browse data, which consists of summary observations, is also available through the NSSDC in the Common Data Format (CDF) and graphic representations of the browse data. Access to the browse data can be achieved through the NSSDC CDAWeb services or by use of NSSDC provided software tools. This presentation documents the software tools, being provided by the IMAGE team, for use in viewing and analyzing the UDF telemetry data. Like the IMAGE data, these tools are openly available. What these tools can do, how they can be obtained, and how they are expected to evolve will be discussed.

Gallagher, Dennis L.↗

A simplified Integer Cosine Transform and its application in image compression

A simplified version of the integer cosine transform (ICT) is described. For practical reasons, the transform is considered jointly with the quantization of its coefficients. It differs from conventional ICT algorithms in that the combined factors for normalization and quantization are approximated by powers of two. In conventional algorithms, the normalization/quantization stage typically requires as many integer divisions as the number of transform coefficients. By restricting the factors to powers of two, these divisions can be performed by variable shifts in the binary representation of the coefficients, with speed and cost advantages to the hardware implementation of the algorithm. The error introduced by the factor approximations is compensated for in the inverse ICT operation, executed with floating point precision. The simplified ICT algorithm has potential applications in image-compression systems with disparate cost and speed requirements in the encoder and decoder ends. For example, in deep space image telemetry, the image processors on board the spacecraft could take advantage of the simplified, faster encoding operation, which would be adjusted on the ground, with high-precision arithmetic. A dual application is found in compressed video broadcasting. Here, a fast, high-performance processor at the transmitter would precompensate for the factor approximations in the inverse ICT operation, to be performed in real time, at a large number of low-cost receivers.

Costa, M.↗

Linear State-Space Representation of the Dynamics of Relative Motion, Based on Restricted Three Body Dynamics

Precision Formation Flying is an enabling technology for a variety of proposed space-based observatories, including the Micro-Arcsecond X-ray Imaging Mission (MAXIM) , the associated MAXIM pathfinder mission, Stellar Imager (SI) and the Terrestrial Planet Finder (TPF). An essential element of the technology is the control algorithm, requiring a clear understanding of the dynamics of relative motion. This paper examines the dynamics of relative motion in the context of the Restricted Three Body Problem (RTBP). The natural dynamics of relative motion are presented in their full nonlinear form. Motivated by the desire to apply linear control methods, the dynamics equations are linearized and presented in state-space form. The stability properties are explored for regions in proximity to each of the libration points in the Earth/Moon - Sun rotating frame. The dynamics of relative motion are presented in both the inertial and rotating coordinate frames.

Luquette,Richard J.↗

Application of ecological, geological and oceanographic ERTS-1 imagery to Delaware's coastal resources planning

The author has identified the following significant results. Communities containing five different coastal vegetation species, developed marshlands, and fresh water impoundments have been identified in ERTS-1 images. Suspended sediment and circulation patterns in imagery from five ERTS-1 passes over Delaware Bay have been enhanced and correlated with predicted current patterns. Conclusions reached are: (1) ERTS-1 is suitable platform for observing suspended sediment patterns and water masses synoptically over large areas. (2) Suspended sediment acts as a natural tracer allowing photointerpreters to deduce gross current circulation patterns from ERTS-1 imagery. (3) Under atmospheric conditions encountered along the East Coast of the United States MSS band 5 seems to give the best representation of sediment load in upper one meter of water column. (4) In the ERTS-1 imagery the sediment patterns are delineated by three to four neighboring shades of grey. (5) Negative transparencies of the ERTS-1 images give better contrast whenever the suspended sediment tones fall within the first few steps of the grey scale. (6) Color density slicing helps delineate the suspended sediment patterns more clearly and differentiate turbidity levels.

Klemas, V.↗

Factors affecting the perception of transparent motion

It is possible to create a perception of transparency by combining patterns having different motions. Two particular combination rules, have specific interpretations in terms of physical phenomena: additive (specular reflection) and multiplicative (shadow illumination). Arbitrary combination rules applied to random patterns generate percepts in which the motions of the two patterns are visible, but have super-imposed noise. It is also possible to combine the patterns (using an exclusive-OR rule) so that only noise is visible. Within a one-dimensional family of combination rules which include addition and multiplication, there is a range where smooth motions are seen with no superimposed noise; this range is centered about the additive combination. This result suggests that the motion system deals with a linear representation of luminance, and is consistent with the analysis of motion by linear sensors. This research gives tentative validation the use in beam splitters (which combine images additively) in the construction of heads-up aviation displays. Further work is needed to determine if the superiority of additive combination generalizes to the case of full-color imagery (there are results in the literature suggesting that subtractive color mixture yields the best legibility of overlapping alphanumerics).

Mulligan, Jeffrey B.↗

Going through a quantum phase

Phase measurements on a single-mode radiation field are examined from a system-theoretic viewpoint. Quantum estimation theory is used to establish the primacy of the Susskind-Glogower (SG) phase operator; its phase eigenkets generate the probability operator measure (POM) for maximum likelihood phase estimation. A commuting observables description for the SG-POM on a signal x apparatus state space is derived. It is analogous to the signal-band x image-band formulation for optical heterodyne detection. Because heterodyning realizes the annihilation operator POM, this analogy may help realize the SG-POM. The wave function representation associated with the SG POM is then used to prove the duality between the phase measurement and the number operator measurement, from which a number-phase uncertainty principle is obtained, via Fourier theory, without recourse to linearization. Fourier theory is also employed to establish the principle of number-ket causality, leading to a Paley-Wiener condition that must be satisfied by the phase-measurement probability density function (PDF) for a single-mode field in an arbitrary quantum state. Finally, a two-mode phase measurement is shown to afford phase-conjugate quantum communication at zero error probability with finite average photon number. Application of this construct to interferometric precision measurements is briefly discussed.

Shapiro, Jeffrey H.↗

Recent Advances in Registration, Integration and Fusion of Remotely Sensed Data: Redundant Representations and Frames

In recent years, sophisticated mathematical techniques have been successfully applied to the field of remote sensing to produce significant advances in applications such as registration, integration and fusion of remotely sensed data. Registration, integration and fusion of multiple source imagery are the most important issues when dealing with Earth Science remote sensing data where information from multiple sensors, exhibiting various resolutions, must be integrated. Issues ranging from different sensor geometries, different spectral responses, differing illumination conditions, different seasons, and various amounts of noise need to be dealt with when designing an image registration, integration or fusion method. This tutorial will first define the problems and challenges associated with these applications and then will review some mathematical techniques that have been successfully utilized to solve them. In particular, we will cover topics on geometric multiscale representations, redundant representations and fusion frames, graph operators, diffusion wavelets, as well as spatial-spectral and operator-based data fusion. All the algorithms will be illustrated using remotely sensed data, with an emphasis on current and operational instruments.

Fusion↗

Machine Learning Explainability and Transferability for Path Navigation

Deep neural networks are powerful tools for machine perception. Unfortunately their decisions are difficult to explain due to the complexity and size of the networks. Previously we have alleviated this issue by using the representational portion of a deep neural network and combining it with a k-nearest neighbor (KNN) classifier. Through inspection of the decisions made by the KNN, we can directly see the training data responsible for the decisions, allowing us to determine the quality of the overall decision and the quality of the representational layer of the deep NN. While the technique worked well, it requires tens of thousands of latent vectors to be stored for classification. In addition, it lacks the ability to show how parts of an image influence the classification decision. Here we address these issues by 1) Using a radial basis function network (RBFN) in place of the KNN allowing far fewer images to be used in deployment and 2) Using an auto encoder network for explainability. In addition to these techniques, we examine the effects of transfer learning to determine that results are robust. All results are tested on a domain where an unmanned aerial vehicle (UAV) navigates a forest trail through a single camera.

explainable machine learning↗

Advanced imaging communication system

Key elements of system are imaging and nonimaging sensors, data compressor/decompressor, interleaved Reed-Solomon block coder, convolutional-encoded/Viterbi-decoded telemetry channel, and Reed-Solomon decoding. Data compression provides efficient representation of sensor data, and channel coding improves reliability of data transmission.

Hilbert, E. E.↗