Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Optical flow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Sensor fusion III: 3-D perception and recognition; Proceedings of the Meeting, Boston, MA, Nov. 5-8, 1990

The volume on data fusion from multiple sources discusses fusing multiple views, temporal analysis and 3D motion interpretation, sensor fusion and eye-to-hand coordination, and integration in human shape perception. Attention is given to surface reconstruction, statistical methods in sensor fusion, fusing sensor data with environmental knowledge, computational models for sensor fusion, and evaluation and selection of sensor fusion techniques. Topics addressed include the structure of a scene from two and three projections, optical flow techniques for moving target detection, tactical sensor-based exploration in a robotic environment, and the fusion of human and machine skills for remote robotic operations. Also discussed are K-nearest-neighbor concepts for sensor fusion, surface reconstruction with discontinuities, a sensor-knowledge-command fusion paradigm for man-machine systems, coordinating sensing and local navigation, and terrain map matching using multisensing techniques for applications to autonomous vehicle navigation.

Schenker, Paul S.↗

Energy functions for regularization algorithms

Regularization techniques are widely used for inverse problem solving in computer vision such as surface reconstruction, edge detection, or optical flow estimation. Energy functions used for regularization algorithms measure how smooth a curve or surface is, and to render acceptable solutions these energies must verify certain properties such as invariance with Euclidean transformations or invariance with parameterization. The notion of smoothness energy is extended here to the notion of a differential stabilizer, and it is shown that to void the systematic underestimation of undercurvature for planar curve fitting, it is necessary that circles be the curves of maximum smoothness. A set of stabilizers is proposed that meet this condition as well as invariance with rotation and parameterization.

Delingette, H.↗

The application of the reduced order model Kalman filter to motion estimation of degraded image sequences

Motion estimation is a field of great interest because of its many applications in areas such as robotics and image coding. The optic flow method is one such scheme which, although fairly accurate, is prone to error in the presence of noise. This thesis describes the use of the reduced order model Kalman filter (ROMKF) in reducing errors in displacement estimation due to degradation of the sequence. The implementation of filtering and motion estimation algorithms on the SUN workstation is also discussed. Results from preliminary testing were used to determine the degrees of freedom available for the ROMKF in the SUN software. The tests indicated that increasing the state to the left leads to slight improvement over the minimum state case. Therefore, the software uses the minimum model, with the option of adding states to the left only. The ROMKF was then used in conjunction with a hierarchical pel recursive motion estimation algorithm. Applying the ROMKF to the degraded displacements themselves generally yielded slight improvements in cases with noise degradation and noise plus blur. Filtering the images of the degraded sequence prior to motion estimation was less effective in these cases. Both methods performed badly in the case of blur alone, resulting in increased displacement errors. This is thought to be due in part to filter artifacts. Some improvements were obtained by varying the filter parameters when filtering the displacements directly. This result suggests that further study in varying filter parameters may lead to better results. The results of this thesis indicate that the ROMKF can play a part in reducing motion estimation errors from degraded sequences. However, more work needs to be done before the use of the ROMKF can be a practical solution.

Simpson, Elizabeth C.↗

Validation of vision-based range estimation algorithms using helicopter flight data

The objective of this research was to demonstrate the effectiveness of an optic flow method for passive range estimation using a Kalman-filter implementation with helicopter flight data. This paper is divided into the following areas: (1) ranging algorithm; (2) flight experiment; (3) analysis methodology; (4) results; and (5) concluding remarks. The discussion is presented in viewgraph format.

Smith, Phillip N.↗

Accurate estimation of object location in an image sequence using helicopter flight data

In autonomous navigation, it is essential to obtain a three-dimensional (3D) description of the static environment in which the vehicle is traveling. For a rotorcraft conducting low-latitude flight, this description is particularly useful for obstacle detection and avoidance. In this paper, we address the problem of 3D position estimation for static objects from a monocular sequence of images captured from a low-latitude flying helicopter. Since the environment is static, it is well known that the optical flow in the image will produce a radiating pattern from the focus of expansion. We propose a motion analysis system which utilizes the epipolar constraint to accurately estimate 3D positions of scene objects in a real world image sequence taken from a low-altitude flying helicopter. Results show that this approach gives good estimates of object positions near the rotorcraft's intended flight-path.

Tang, Yuan-Liang↗

The selective use of functional optical variables in the control of forward speed

Previous work on the perception and control of simulated vehicle speed has examined the contributions of optical flow rate (angular visual speed) and texture, or edge rate (frequency of passing terrain objects or markings) on the perception and control of forward speed. However, these studies have not examined the ability to selectively use edge rate or flow rate. The two studies presented here show that this ability is far greater for pilots than non-pilots, as would be expected since pilots must control vehicular speed over a variety of altitudes where flow rates change independently of forward speed. These studies also show that this ability to selectively use these variables is linked to the visual contextual information about the relative validity (linkage with speed) of the two variables. Subjective judgment data also indicated that awareness of altitude and ground texture density did not mediate ground speed awareness.

Johnson, Walter W.↗

Algorithms for detection of objects in image sequences captured from an airborne imaging system

This research was initiated as a part of the effort at the NASA Ames Research Center to design a computer vision based system that can enhance the safety of navigation by aiding the pilots in detecting various obstacles on the runway during critical section of the flight such as a landing maneuver. The primary goal is the development of algorithms for detection of moving objects from a sequence of images obtained from an on-board video camera. Image regions corresponding to the independently moving objects are segmented from the background by applying constraint filtering on the optical flow computed from the initial few frames of the sequence. These detected regions are tracked over subsequent frames using a model based tracking algorithm. Position and velocity of the moving objects in the world coordinate is estimated using an extended Kalman filter. The algorithms are tested using the NASA line image sequence with six static trucks and a simulated moving truck and experimental results are described. Various limitations of the currently implemented version of the above algorithm are identified and possible solutions to build a practical working system are investigated.

Kasturi, Rangachar↗

Tracking magnetogram proper motions by multiscale regularization

Long uninterrupted sequences of solar magnetograms from the global oscillations network group (GONG) network and from the solar and heliospheric observatory (SOHO) satellite will provide the opportunity to study the proper motions of magnetic features. The possible use of multiscale regularization, a scale-recursive estimation technique which begins with a prior model of how state variables and their statistical properties propagate over scale. Short magnetogram sequences are analyzed with the multiscale regularization algorithm as applied to optical flow. This algorithm is found to be efficient, provides results for all the spatial scales spanned by the data and provides error estimates for the solutions. It is found that the algorithm is less sensitive to evolutionary changes than correlation tracking.

Jones, Harrison P.↗

Microwave Treatment for Cardiac Arrhythmias

Method and apparatus are provided for propagating microwave energy into heart tissues to produce a desired temperature profile therein at tissue depths sufficient for thermally ablating arrhythmogenic cardiac tissue to treat ventricular tachycardia and other arrhythmias while preventing excessive heating of surrounding tissues, organs, and blood. A wide bandwidth double-disk antenna is effective for this purpose over a bandwidth of about six gigahertz. A computer simulation provides initial screening capabilities for an antenna such as antenna, frequency, power level, and power application duration. The simulation also allows optimization of techniques for specific patients or conditions. In operation, microwave energy between about 1 Gigahertz and 12 Gigahertz is applied to monopole microwave radiator having a surface wave limiter. A test setup provides physical testing of microwave radiators to determine the temperature profile created in actual heart tissue or ersatz heart tissue. Saline solution pumped over the heart tissue with a peristaltic pump simulates blood flow. Optical temperature sensors disposed at various tissue depths within the heart tissue detect the temperature profile without creating any electromagnetic interference. The method may be used to produce a desired temperature profile in other body tissues reachable by catheter such as tumors and the like.

Arndt, G. Dickey↗

Transcatheter Antenna For Microwave Treatment

Method and apparatus are provided for propagating microwave energy into heart tissues to produce a desired temperature profile therein at tissue depths sufficient for thermally ablating arrhythmogenic cardiac tissue to treat ventricular tachycardia and other arrhythmias while preventing excessive heating of surrounding tissues, organs, and blood. A wide bandwidth double-disk antenna is effective for this purpose over a bandwidth of about six gigahertz. A computer simulation provides initial screening capabilities for an antenna such as antenna, frequency, power level, and power application duration. The simulation also allows optimization of techniques for specific patients or conditions. In operation, microwave energy between about 1 Gigahertz and 12 Gigahertz is applied to monopole microwave radiation having a surface wave limiter. A test setup provides physical testing of microwave radiators to determine the temperature profile created in actual heart tissue or ersatz heart tissue. Saline solution pumped over the heart tissue with a peristaltic pump simulates blood flow. Optical temperature sensors disposed at various tissue depths within the heart tissue detect the temperature profile without creating any electromagnetic interference. The method may he used to produce a desired temperature profile in other body tissues reachable by catheter such as tumors and the like.

Arndt, G. Dickey↗

In Vivo Simulator for Microwave Treatment

Method and apparatus are provided for propagating microwave energy into heart tissues to produce a desired temperature profile therein at tissue depths sufficient for thermally ablating arrhythmogenic cardiac tissue to treat ventricular tachycardia and other arrhythmias while preventing excessive heating of surrounding tissues, organs, and blood. A wide bandwidth double-disk antenna is effective for this purpose over a bandwidth of about 6 GHz. A computer simulation provides initial screening capabilities for an antenna such as antenna. frequency, power level, and power application duration. The simulation also allows optimization of techniques for specific patients or conditions. In operation, microwave energy between about 1 GHz and 12 GHz is applied to monopole microwave radiator having a surface wave limiter. A test setup provides physical testing of microwave radiators to determine the temperature profile created in actual heart tissue or ersatz heart tissue. Saline solution pumped over the heart tissue with a peristaltic pump simulates blood flow. Optical temperature sensors disposed at various tissue depths within the heart tissue detect the temperature profile without creating any electromagnetic interference. The method may be used to produce a desired temperature profile in other body tissues reachable by catheter such as tumors and the like.

Arndt, G. Dickey↗

Selective Use of Optical Variables to Control Forward Speed

Previous work on the perception and control of simulated vehicle speed has examined the contributions of optical flow rate (angular visual speed) and texture, or edge rate (frequency of passing terrain objects or markings) on the perception and control of forward speed. However, these studies have not examined the ability to selectively use edge rate or flow rate. The two studies reported here show that subjects found it very difficult to arbitrarily direct attention to one or the other of these variables; but that the ability to selectively use these variables is linked to the visual contextual information about the relative validity (linkage with speed) of the two variables. The selectivity also resulted in different velocity adaptation levels for events in which flow rate and edge rate specified forward speed. Finally, the role of visual context in directing attention was further buttressed by the finding that the incorrect perception of changes in ground texture density tended to be coupled with incorrect perceptions of changes in forward speed.

Johnson, Walter W.↗

Translation and Rotation Trade Off in Human Visual Heading Estimation

We have previously shown that, during simulated curvilinear motion, humans can make reasonably accurate and precise heading judgments from optic flow without either oculomotor or static-depth cues about rotation. We now systematically investigate the effect of varying the parameters of self-motion. We visually simulated 400 ms of self-motion along curved paths (constant rotation and translation rates, fixed retinocentric heading) towards two planes of random dots at 10.3 m and 22.3 m at mid-trial. Retinocentric heading judgments of 4 observers (2 naive) were measured for 12 different combinations of translation (T between 4 and 16 m/s) and rotation (R either 8 or 16 deg/s). In the range tested, heading bias and uncertainty decrease quasilinearly with T/R, but the bias also appears to depend on R. If depth is held constant, the ratio T/R can account for much of the variation in the accuracy and precision of human visual heading estimation, although further experiments are needed to resolve whether absolute rotation rate, total flow rate, or some other factor can account for the observed -2 deg shift between the bias curves.

Stone, Leland S.↗

Quantitative Simulations of MST Visual Receptive Field Properties Using a Template Model of Heading Estimation

We previously developed a template model of primate visual self-motion processing that proposes a specific set of projections from MT-like local motion sensors onto output units to estimate heading and relative depth from optic flow. At the time, we showed that that the model output units have emergent properties similar to those of MSTd neurons, although there was little physiological evidence to test the model more directly. We have now systematically examined the properties of the model using stimulus paradigms used by others in recent single-unit studies of MST: 1) 2-D bell-shaped heading tuning. Most MSTd neurons and model output units show bell-shaped heading tuning. Furthermore, we found that most model output units and the finely-sampled example neuron in the Duffy-Wurtz study are well fit by a 2D gaussian (sigma approx. 35deg, r approx. 0.9). The bandwidth of model and real units can explain why Lappe et al. found apparent sigmoidal tuning using a restricted range of stimuli (+/-40deg). 2) Spiral Tuning and Invariance. Graziano et al. found that many MST neurons appear tuned to a specific combination of rotation and expansion (spiral flow) and that this tuning changes little for approx. 10deg shifts in stimulus placement. Simulations of model output units under the same conditions quantitatively replicate this result. We conclude that a template architecture may underlie MT inputs to MST.

Stone, Leland S.↗

Short-latency primate vestibuloocular responses during translation

Short-lasting, transient head displacements and near target fixation were used to measure the latency and early response gain of vestibularly evoked eye movements during lateral and fore-aft translations in rhesus monkeys. The latency of the horizontal eye movements elicited during lateral motion was 11.9 +/- 5.4 ms. Viewing distance-dependent behavior was seen as early as the beginning of the response profile. For fore-aft motion, latencies were different for forward and backward displacements. Latency averaged 7.1 +/- 9.3 ms during forward motion (same for both eyes) and 12.5 +/- 6.3 ms for the adducting eye (e.g., left eye during right fixation) during backward motion. Latencies during backward motion were significantly longer for the abducting eye (18.9 +/- 9.8 ms). Initial acceleration gains of the two eyes were generally larger than unity but asymmetric. Specifically, gains were consistently larger for abducting than adducting eye movements. The large initial acceleration gains tended to compensate for the response latencies such that the early eye movement response approached, albeit consistently incompletely, that required for maintaining visual acuity during the movement. These short-latency vestibuloocular responses could complement the visually generated optic flow responses that have been shown to exhibit much longer latencies.

Non-NASA Center↗

Visually induced adaptation in three-dimensional organization of primate vestibuloocular reflex

The adaptive plasticity of the spatial organization of the vestibuloocular reflex (VOR) has been investigated in intact and canal-plugged primates using 2-h exposure to conflicting visual (optokinetic, OKN) and vestibular rotational stimuli about mutually orthogonal axes (generating torsional VOR + vertical OKN, torsional VOR + horizontal OKN, vertical VOR + horizontal OKN, and horizontal VOR + vertical OKN). Adaptation protocols with 0.5-Hz (+/-18 degrees ) head movements about either an earth-vertical or an earth-horizontal axis induced orthogonal response components as high as 40-70% of those required for ideal adaptation. Orthogonal response gains were highest at the adapting frequency with phase leads present at lower and phase lags present at higher frequencies. Furthermore, the time course of adaptation, as well as orthogonal response dynamics were similar and relatively independent of the particular visual/vestibular stimulus combination. Low-frequency (0. 05 Hz, vestibular stimulus: +/-60 degrees ; optokinetic stimulus: +/-180 degrees ) adaptation protocols with head movements about an earth-vertical axis induced smaller orthogonal response components that did not exceed 20-40% of the head velocity stimulus (i.e., approximately 10% of that required for ideal adaptation). At the same frequency, adaptation with head movements about an earth-horizontal axis generated large orthogonal responses that reached values as high as 100-120% of head velocity after 2 h of adaptation (i.e., approximately 40% of ideal adaptation gains). The particular spatial and temporal response characteristics after low-frequency, earth-horizontal axis adaptation in both intact and canal-plugged animals strongly suggests that the orienting (and perhaps translational) but not inertial (velocity storage) components of the primate otolith-ocular system exhibit spatial adaptability. Due to the particular nested arrangement of the visual and vestibular stimuli, the optic flow pattern exhibited a significant component about the third spatial axis (i.e., orthogonal to the axes of rotation of the head and visual surround) at twice the oscillation frequency. Accordingly, the adapted VOR was characterized consistently by a third response component (orthogonal to both the axes of head and optokinetic drum rotation) at twice the oscillation frequency after earth-horizontal but not after earth-vertical axis 0.05-Hz adaptation. This suggests that the otolith-ocular (but not the semicircular canal-ocular) system can adaptively change its spatial organization at frequencies different from those of the head movement.

Non-NASA Center↗

Misperceptions of angular velocities influence the perception of rigidity in the kinetic depth effect

Accuracy in discriminating rigid from nonrigid motion was investigated for orthographic projections of three-dimension rotating objects. In 3 experiments the hypothesis that magnitudes of angular velocity are misperceived in the kinetic depth effect was tested, and in 4 other experiments the hypothesis that misperceiving angular velocities leads to misperceiving rigidity was tested. The principal findings were (a) the magnitude of perceived angular velocity is derived heuristically as a function of a property of the first-order optic flow called deformation and (b) perceptual performance in discriminating rigid from nonrigid motion is accurate in cases when the variability of the deformations of the individual triplets of points of the stimulus displays favors this interpretation and not accurate in other cases.

NASA Center ARC↗

The Interplay Between Strategic And Adaptive Control Mechanisms In Plastic Recalibration Of Locomotor Function

We have previously shown that viewing simulated rotary self-motion during treadmill locomotion causes immediate strategic modifications (Richards et al. 2004) as well as an after effect reflecting adaptive modification of the control of position and trajectory during over-ground locomotion (Mulavara et al. 2005). The process of sensorimotor adaptation is comprised of both strategic and adaptive control mechanisms. Strategic control involves cognitive, on-line corrections to limb movements once one is aware of a sensory discordance. Over an extended period of exposure to the sensory discordance, new strategic sensorimotor coordination patterns are reinforced until they become more automatic, and therefore adaptive, in nature. The objective of this study was to investigate how strategic changes in trunk control during exposure to simulated rotary self-motion during treadmill walking influences adaptive modification of locomotor heading direction during over-ground stepping. Subjects (n = 10) walked on a motorized linear treadmill while viewing a wide field-of-view virtual scene for 24 minutes. The scene was static for the first 4 minutes and then, for the last 20 minutes, depicted constant rate self-motion equivalent to walking in a counter-clockwise, circular path around the perimeter of a room. Subjects performed five stepping trials both before and after the exposure period to assess after effects. Results from our previous study showed a significant change in heading direction (HD) during post-exposure step tests that was opposite the direction in which the scene rotated during the adaptation period. For the present study, we quantified strategic modifications in trunk movement control during scene exposure using normalized root mean square (R(sub p)) variation of the subject's 3D trunk positions and normalized sum of standard deviations (R(sub o)) variation of 3D trunk orientations during scene rotation relative to that during static scene presentation. Associated 95% confidence intervals, CI(sub P) and CI(sub O), were calculated to investigate the variation of strategic modifications during scene exposure. Repeated measures ANOVA and individual subject regression analyses showed that R(sub P) and R(sub O) (i.e. strategic modifications) for trunk fore/aft (X) and yaw movements, respectively, decreased significantly over the exposure period. Furthermore, we found a significant correlation between the magnitude change in HD and the rate at which the variation of strategic modifications in trunk X decreased. We also found evidence of a correlation between HD and the rate at which strategic modifications in trunk yaw decreased (p = .06). We infer that adaptive recalibration of locomotor trajectory using optic flow stimuli depends on the rate at which strategic intervention is reduced.

Richards, J. T.↗