Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Motion processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Experimental Modal Analysis Using Phase Quantities from Phase-Based Motion Processing and Motion Magnification

Phase-based motion processing and the associated Motion Magnification that it enables has become popular not only for the striking videos that it can produce of traditionally stiff structures visualized with very large deflections, but also for its ability to pull information out of the noise floor of images so that they can be processed with more traditional optical techniques such as digital image correlation or feature tracking. While the majority of papers in the literature have utilized the Phase-based Image Processing approach as a pre-processor for more quantitative analyses, the technique itself can be used directly to extract modal parameters from an image, noting that the extracted phases are proportional to displacements in the image. Therefore, once phases are extracted, they can be fit using traditional experimental modal analysis techniques. This produces a mode “shape” where the degrees of freedom are phases instead of physical motions. These phases can be scaled to produce on-image visualizations of the mode shapes, rather than operational shapes produced by bandpass filtering. Modal filtering techniques can also be used to visualize motions from an environment on an image using the modal phases as a basis for the expansion.

47 OTHER INSTRUMENTATION↗

Low-Dose Caffeine Administration During Acute Sleep Deprivation Eliminates Visual Motion Processing Impairment, but Does Not Improve Saccadic Rate

Oculomotor tracking performance changes according to time awake. A constant routine (CR) study demonstrated that increasing time awake 1) reduces the precision of visual motion processing, 2) decreases steady-state closed-loop pursuit performance and 3) decreases peak saccadic velocity. We aimed to determine the contribution of homeostatic sleep pressure on these oculometric changes by administering low-dose caffeine over one night of sleep deprivation. Participants completed two weeks of at-home 8.5 hours sleep per day, followed by an approximately 24-hour laboratory CR in semi-recumbent posture under less than 4 lux of light. The visual tracking task was performed every two hours after waking and hourly overnight. Low-dose caffeine of 0.3 milligrams per kilogram was administered hourly during the biological night. Nine participants (5F) completed the study. Caffeine dosing: 1) prevented the impairment of visual motion processing, 2) reduced by approximately half the impairment of closed-loop pursuit performance (gain, minus 0.47 percent per hour, significance of slope change: p (probability) less than 0.006; proportion smooth, minus 0.35 percent per hour, p less than 0.005), and 3) had an insignificant (p less than 0.39) effect on the impairment of saccadic peak velocity (slope, minus 1.13 percent per hour; intercept, minus 0.62 percent per hour). These results suggest that visual motion processing and some proportion of closed-loop pursuit performance are impaired due to homeostatic mechanisms during sleep deprivation.

Sleep↗

Oculometric Analysis of Saccadic Compensation for Visual Motion Processing Impairment due to Alcohol and Sleep Disruption

The Visuomotor Control Laboratory at Ames Research Center has developed a 5-minute ocular tracking test that computes 21 largely independent metrics of visuomotor performance, reflecting neural signal processing along a number of distinct pathways through cortex, brainstem, and cerebellum. Human sensorimotor performance is resilient to the challenges and stressors of many operational environments, in part, because overall performance is achieved through multiple parallel systems. Our multidimensional oculometrics allow us to examine impacts on these sub-components separately. To illustrate this, we contrasted the effects of two mild neural stressors, acute sleep-deprivation and low-dose alcohol. We have previously shown that, in both cases, oculometric analysis is a highly sensitive indicator of impairment. Here we quantified not only the observed impact on the performance of one sub-system, smooth pursuit, which uses high-level cortical processing of visual motion to track a moving object, but also the observed (partial) compensation by an evolutionarily older mid-brain and brainstem subsystem, saccades, which generates jumps in eye position to catch up with the target when smooth pursuit is inadequate. Specifically, we examined the dose-response (effect size vs. dose size) of the ground lost (pursuit deficit) and the ground recouped (saccadic compensation) across three separate studies – acute low-dose alcohol administration (16 subjects), acute sleep loss (12 subjects), and acute sleep loss with caffeine intervention (9 subjects). We computed the dose-response slopes using linear regression. The figure below shows that, in the case of acute sleep deprivation, the resulting slopes for ground lost and ground recouped (mean ± SE across subjects) were significantly different (paired t-test, t(11) = 5.17, p < 0.001), indicating poor saccadic compensation. However, when sleep loss was coupled with caffeine ingestion, ground lost was decreased and ground recouped increased such that the slopes were no longer different (t(8) = -0.05, p = 0.965). With alcohol, the two slopes were large albeit not significantly different (t(15) = 0.96, p = 0.351), indicating significant pursuit impairment but effective saccadic compensation. Our findings show that sleep deprivation and alcohol affect oculomotor performance differently. Low-dose alcohol effects appear predominantly cortical, with effective brainstem compensation. Sleep loss and circadian disruption however appears to affect both cortical and brainstem pathways with caffeine providing an effective countermeasure to both effects. Beyond the mere detection of impairment, our oculometric assessment allows us to characterize the nature of the deficit, to provide insight into the neural substrate, and to assess the effectiveness of countermeasures.

pursuit↗

Eye Movements Reveal Hierarchical Motion Processing

Purpose: In the analysis of visual motion, local features such as orientation are analyzed early in the cortical processing stream (V1), while integration across orientation and space is thought to occur in higher cortical areas such as MT, MST, etc. If all areas provide inputs to eye movement control centers, we would expect that local properties would drive eye movements with relatively short latencies, while global properties would require longer latencies. When such latencies are observed, they can provide information about when (and where?) various stimulus properties are analyzed. Methods: The stimulus employed was an elliptical Gabor patch with a drifting carrier, in which the orientations of the carrier grating and the contrast window were varied independently. We have previously demonstrated that the directional percepts evoked by this stimulus vary between the "grating direction" (the normal to the grating's orientation) and the "window direction", and that similar effects can be observed in reflexive eye movements. Subjects viewed such a stimulus while attempting to maintain steady fixation on the center of the pattern, and the small reflexive eye movements ("stare OKN") were recorded. In the middle of the trial, the orientation of either the grating or the window was rotated smoothly by 30 degrees. Results: Responses to the shift of both grating orientation and window orientation are seen in the average OKN slow phase velocity. Grating rotations produce a rapid OKN rotation to the grating direction (100 ms latency, 300 ms time constant), followed by a slower rebound to the steady state perceived direction midway between the grating and window directions. Window rotations, on the other hand, evoke a slower response (200 ms latency, 500 ms time constant). Conclusions: The results demonstrate multiple cortical inputs to eye movement control: a fast, early input driven by orientation, and a slower input from higher areas sensitive to global stimulus properties.

Mulligan, Jeffrey B.↗

Applications of Phase-Based Motion Processing

Image pyramids provide useful information in determining structural response at low cost using commercially available cameras. The current effort applies previous work on the complex steerable pyramid to analyze and identify imperceptible linear motions in video. Instead of implicitly computing motion spectra through phase analysis of the complex steerable pyramid and magnifying the associated motions, instead present a visual technique and the necessary software to display the phase changes of high frequency signals within video. The present technique quickly identifies regions of largest motion within a video with a single phase visualization and without the artifacts of motion magnification, but requires use of the computationally intensive Fourier transform. While Riesz pyramids present an alternative to the computationally intensive complex steerable pyramid for motion magnification, the Riesz formulation contains significant noise, and motion magnification still presents large amounts of data that cannot be quickly assessed by the human eye. Thus, user-friendly software is presented for quickly identifying structural response through optical flow and phase visualization in both Python and MATLAB.

Branch, Nicholas A.↗

Processing Motion Signals in Complex Environments

Motion information is critical for human locomotion and scene segmentation. Currently we have excellent neurophysiological models that are able to predict human detection and discrimination of local signals. Local motion signals are insufficient by themselves to guide human locomotion and to provide information about depth, object boundaries and surface structure. My research is aimed at understanding the mechanisms underlying the combination of motion signals across space and time. A target moving on an extended trajectory amidst noise dots in Brownian motion is much more detectable than the sum of signals generated by independent motion energy units responding to the trajectory segments. This result suggests that facilitation occurs between motion units tuned to similar directions, lying along the trajectory path. We investigated whether the interaction between local motion units along the motion direction is mediated by contrast. One possibility is that contrast-driven signals from motion units early in the trajectory sequence are added to signals in subsequent units. If this were the case, then units later in the sequence would have a larger signal than those earlier in the sequence. To test this possibility, we compared contrast discrimination thresholds for the first and third patches of a triplet of sequentially presented Gabor patches, aligned along the motion direction. According to this simple additive model, contrast increment thresholds for the third patch should be higher than thresholds for the first patch.The lack of a measurable effect on contrast thresholds for these various manipulations suggests that the pooling of signals along a trajectory is not mediated by contrast-driven signals. Instead, these results are consistent with models that propose that the facilitation of trajectory signals is achieved by a second-level network that chooses the strongest local motion signals and combines them if they occur in a spatio-temporal sequence consistent with a trajectory. These results parallel the lack of increased apparent contrast along a static contour made up of similarly oriented elements.

Verghese, Preeti↗

Off-line programming motion and process commands for robotic welding of Space Shuttle main engines

The off-line-programming software and hardware being developed for robotic welding of the Space Shuttle main engine are described and illustrated with diagrams, drawings, graphs, and photographs. The menu-driven workstation-based interactive programming system is designed to permit generation of both motion and process commands for the robotic workcell by weld engineers (with only limited knowledge of programming or CAD systems) on the production floor. Consideration is given to the user interface, geometric-sources interfaces, overall menu structure, weld-parameter data base, and displays of run time and archived data. Ongoing efforts to address limitations related to automatic-downhand-configuration coordinated motion, a lack of source codes for the motion-control software, CAD data incompatibility, interfacing with the robotic workcell, and definition of the welding data base are discussed.

Ruokangas, C. C.↗

Ames vision group research overview

A major goal of the reseach group is to develop mathematical and computational models of early human vision. These models are valuable in the prediction of human performance, in the design of visual coding schemes and displays, and in robotic vision. To date researchers have models of retinal sampling, spatial processing in visual cortex, contrast sensitivity, and motion processing. Based on their models of early human vision, researchers developed several schemes for efficient coding and compression of monochrome and color images. These are pyramid schemes that decompose the image into features that vary in location, size, orientation, and phase. To determine the perceptual fidelity of these codes, researchers developed novel human testing methods that have received considerable attention in the research community. Researchers constructed models of human visual motion processing based on physiological and psychophysical data, and have tested these models through simulation and human experiments. They also explored the application of these biological algorithms to applications in automated guidance of rotorcraft and autonomous landing of spacecraft. Researchers developed networks for inhomogeneous image sampling, for pyramid coding of images, for automatic geometrical correction of disordered samples, and for removal of motion artifacts from unstable cameras.

Watson, Andrew B.↗

The Barberplaid illusion: Even Perceived Plaid Motion is Biased by Asymmetric Apertures

Our results show that the perceived direction of motion of plaids windowed by asymmetric spatial Gaussians is biased toward the long axis of the window. The bias increases as the relative angle between the plaid motion and the window increases, peaks at a relative angle of about 40 degrees, and then decreases. The peak bias was 14 degrees for a spatial frequency of 0.6 cpd and a window aspect ratio of 4.0. The biases increase as the window is elongated and decrease as the component spatial frequency increases. We tested the predictions of several models of human motion processing (cross correlation, motion energy, intersection of constraints, and vector sum), and show that none of these can predict our data. These results suggest that spatial integration of motion signals plays a crucial role in the perception of plaid motion.

Beutter, Brent↗

Human motion perception and smooth eye movements show similar directional biases for elongated apertures

Although numerous studies have examined the relationship between smooth-pursuit eye movements and motion perception, it remains unresolved whether a common motion-processing system subserves both perception and pursuit. To address this question, we simultaneously recorded perceptual direction judgments and the concomitant smooth eye-movement response to a plaid stimulus that we have previously shown generates systematic perceptual errors. We measured the perceptual direction biases psychophysically and the smooth eye-movement direction biases using two methods (standard averaging and oculometric analysis). We found that the perceptual and oculomotor biases were nearly identical, suggesting that pursuit and perception share a critical motion processing stage, perhaps in area MT or MST of extrastriate visual cortex.

NASA Center ARC↗

Human Motion Perception and Smooth Eye Movements Show Similar Directional Biases for Elongated Apertures

Although numerous studies have examined the relationship between smooth-pursuit eye movements and motion perception, it remains unresolved whether a common motion-processing system subserves both perception and pursuit. To address this question, we simultaneously recorded perceptual direction judgments and the concomitant smooth eye movement response to a plaid stimulus that we have previously shown generates systematic perceptual errors. We measured the perceptual direction biases psychophysically and the smooth eye-movement direction biases using two methods (standard averaging and oculometric analysis). We found that the perceptual and oculomotor biases were nearly identical suggesting that pursuit and perception share a critical motion processing stage, perhaps in area MT or MST of extrastriate visual cortex.

Beutter, Brent R.↗

Saccade-Pursuit Coordination during Ocular Tracking across Different Impairment Sources

Purpose: Sleep loss and alcohol have been shown to impair smooth pursuit and its underlying visual motion processing in humans. This study examines the saccadic compensation for this poor pursuit. Methods: Using an established behavioral ocular-tracking paradigm (Liston & Stone, 2014, doi:10.1167/14.14.12), we examined the dose-response of ground lost (pursuit deficit integrated across our 300-ms steady-state tracking interval) and ground gained (increased saccadic response harnessed to compensate)across three separate studies – acute low-dose alcohol administration (LDA; n = 16 subjects), acute sleep loss(ASL; n = 12), and chronic sleep restriction (CSR; n = 12). We computed dose-responses as the linear regression slopes of ground lost and gained across treatment dose (% blood alcohol concentration [BAC] or hours awake). For the CSR study, we computed the mean effect for a single dose (5-hours nightly sleep for 1week). Results: For LDA, there was significantly increased ground lost (P < 0.001) and gained (P < 0.001) with increased %BAC. In addition, the dose-responses were not significantly different (P = 0.35), indicating effectively complete saccadic compensation due to significant increases in both saccadic rate (P < 0.05) and amplitude (P < 0.001). For ASL, there was significantly increased ground lost with time awake (P < 0.01),however ground gained was significantly lower (P < 0.001), indicating, at best, incomplete compensation due to a significant increase in saccadic rate (P < 0.001) but not amplitude (P = 0.10). With CSR, pursuit was again significantly impaired (P < 0.05), with saccadic rate significantly increased (P < 0.05) but, surprisingly, amplitude was significantly decreased (P < 0.05), effectively eliminating ground gained (P = 0.90). Conclusions: Our analyses show that LDA, ASL, and CSR affect tracking differently, suggesting the involvement of different brain pathways. With LDA, the effect appears largely due to the cortical impairment of visual motion processing with largely healthy brainstem and mid-brain responses (driving effective saccadic compensation). ASL and CSR however appear to affect both cortical and sub-cortical pathways, with at best partial saccadic compensation. Lastly, CSR is associated with an additional compromise due to a maladaptive decrease in saccade amplitude.

saccade↗

Effect of contrast on the perception of direction of a moving pattern

A series of experiments examining the effect of contrast on the perception of moving plaids was performed to test the hypothesis that the human visual system determines the direction of a moving plaid in a two-staged process: decomposition into component motion followed by application of the intersection-of-contraints rule. Although there is recent evidence that the first tenet of the hypothesis is correct, i.e., that plaid motion is initially decomposed into the motion of the individual grating components, the nature of the second-stage combination rule has not yet been established. It was found that when the gratings within the plaid are of different contrast the preceived direction is not predicted by the intersection-of-constraints rule. There is a strong (up to 20 deg) bias in the direction of the higher-constrast grating. A revised model, which incorporates a contrast-dependent weighting of perceived grating speed as observed for one-dimensional patterns, can quantitatively predict most of the results. The results are then discussed in the context of various models of human visual motion processing and of physiological responses of neurons in the primate visual system.

Stone, L. S.↗

Effect of contrast on the perceived direction of a moving plaid

A series of experiments examining the effect of contrast on the perception of moving plaids is performed. This was done to test the hypothesis put forth by Adelson and Movshon (1982) that the human visual system determines the direction of a moving plaid in a two-staged process: decomposition into component motion followed by application of the intersection of constraints rule. When the gratings within the plaid are of different contrast, the perceived direction is not predicted by the intersection of constraints rule. There is a strong (up to 20 deg) bias in the direction of the higher-contrast grating. A revised model, which incorporates a contrast-dependent weighting of perceived grating speed as observed for one-dimensional patterns (Thompson, 1982), can quantitatively predict most of the results. Results are discussed in the context of various models of human visual motion processing and of physiological responses of neurons in the primate visual system.

Stone, L. S.↗

Structural and functional analyses of human cerebral cortex using a surface-based atlas

We have analyzed the geometry, geography, and functional organization of human cerebral cortex using surface reconstructions and cortical flat maps of the left and right hemispheres generated from a digital atlas (the Visible Man). The total surface area of the reconstructed Visible Man neocortex is 1570 cm2 (both hemispheres), approximately 70% of which is buried in sulci. By linking the Visible Man cerebrum to the Talairach stereotaxic coordinate space, the locations of activation foci reported in neuroimaging studies can be readily visualized in relation to the cortical surface. The associated spatial uncertainty was empirically shown to have a radius in three dimensions of approximately 10 mm. Application of this approach to studies of visual cortex reveals the overall patterns of activation associated with different aspects of visual function and the relationship of these patterns to topographically organized visual areas. Our analysis supports a distinction between an anterior region in ventral occipito-temporal cortex that is selectively involved in form processing and a more posterior region (in or near areas VP and V4v) involved in both form and color processing. Foci associated with motion processing are mainly concentrated in a region along the occipito-temporal junction, the ventral portion of which overlaps with foci also implicated in form processing. Comparisons between flat maps of human and macaque monkey cerebral cortex indicate significant differences as well as many similarities in the relative sizes and positions of cortical regions known or suspected to be homologous in the two species.

NASA Discipline Neuroscience↗

The barberplaid illusion: plaid motion is biased by elongated apertures

The perceived direction of motion of plaids windowed by elongated spatial Gaussians is biased toward the window's long axis. The bias increases as the relative angle between the plaid motion and the long axis of the window increases, peaks at a relative angle of approximately 45 deg, and then decreases. The bias increases as the window is made narrower (at fixed height) and decreases as the component spatial frequency increases (at fixed aperture size). We examine several models of human motion processing (cross-correlation, motion-energy, intersection-of-constraints, and vector-sum), and show that none of these standard models can predict our data. We conclude that spatial integration of motion signals plays a crucial role in plaid motion perception and that current models must be explicitly expanded to include such spatial interactions.

NASA Center ARC↗

Dose-Dependent Sensorimotor Impairment in Human Ocular Tracking After Acute Low-Dose Alcohol Administration

Changes in oculomotor behaviours are often used as metrics of sensorimotor disruption due to ethanol (EtOH); however, previous studies have focused on deficits at blood-alcohol concentrations (BACs) above about 0.04%.We investigated the dose dependence of the impairment in oculomotor and ocular behaviours caused by EtOH administration across a range of ultra-low BACs (≤0.035%).We took repeated measures of oculomotor and ocular performance from sixteen participants, both pre- and post-EtOH administration. To assess the neurological impacts across a wide range of brain areas and pathways, our protocol measured 21 largely independent performance metrics extracted from a range of behavioural responses ranging from ocular tracking of radial step-ramp stimuli, to eccentric gaze holding, to pupillary responses evoked by light flashes. Our results show significant impairment of pursuit and visual motion processing at 0.015% BAC, reflecting degraded neural processing within extrastriate cortical pathways. However, catch-up saccades largely compensate for the tracking displacement shortfall caused by low pursuit gain, although there still is significant residual retinal slip and thus degraded dynamic acuity. Furthermore, although saccades are more frequent, their dynamics are more sluggish (i.e. show lower peak velocities) starting at BAC levels as low as 0.035%. Small effects in eccentric gaze holding and no effect in pupillary response dynamics were observed at levels below 0.07%, showing the higher sensitivity of the pursuit response to very low levels of blood alcohol, under the conditions of our study.

visual motion processing↗

A diffusion model for use with directional samplers

The paper presents a mathematical model for describing dispersion processes of airborne particles in the atmosphere. The process is described as a superposition of independent Brownian motion processes with drifts and a boundary at zero. It is assumed that the terrain is flat and of a homogeneous roughness. All sources are assumed to be point sources. The time dependencies of emission rates, wind speed, wind direction, and atmospheric conditions are taken into account.

Anbar, D.↗