Engineering Papers⌕ Search

Engineering topics

Stone, Leland S.

Publications and source records attributed to Stone, Leland S..

At least 37 records · Page 2

Analytic Guided-Search Model of Human Performance Accuracy in Target- Localization Search Tasks

Current models of human visual search have extended the traditional serial/parallel search dichotomy. Two successful models for predicting human visual search are the Guided Search model and the Signal Detection Theory model. Although these models are inherently different, it has been difficult to compare them because the Guided Search model is designed to predict response time, while Signal Detection Theory models are designed to predict performance accuracy. Moreover, current implementations of the Guided Search model require the use of Monte-Carlo simulations, a method that makes fitting the model's performance quantitatively to human data more computationally time consuming. We have extended the Guided Search model to predict human accuracy in target-localization search tasks. We have also developed analytic expressions that simplify simulation of the model to the evaluation of a small set of equations using only three free parameters. This new implementation and extension of the Guided Search model will enable direct quantitative comparisons with human performance in target-localization search experiments and with the predictions of Signal Detection Theory and other search accuracy models.

Eckstein, Miguel P.↗

Minimization of Retinal Slip Cannot Explain Human Smooth-Pursuit Eye Movements

Existing models assume that pursuit attempts a direct minimization of retinal image motion or "slip" (e.g. Robinson et al., 1986; Krauzlis & Weisberger, 1989). Using occluded line-figure stimuli, we have previously shown that humans can accurately pursue stimuli for which perfect tracking does not zero retinal slip (Neurologic ARCO). These findings are inconsistent with the standard control strategy of matching eye motion to a target-motion signal reconstructed by adding retinal slip and eye motion, but consistent with a visual front-end which estimates target motion via a global spatio-temporal integration for pursuit and perception. Another possible explanation is that pursuit simply attempts to minimize slip perpendicular to the segments (and neglects parallel "sliding" motion). To resolve this, 4 observers (3 naive) were asked to pursue the center of 2 types of stimuli with identical velocity-space descriptions and matched motion energy. The line-figure "diamond" stimulus was viewed through 2 invisible 3 deg-wide vertical apertures (38 cd/m2 equal to background) such that only the sinusoidal motion of 4 oblique line segments (44 cd/m2 was visible. The "cross" was identical except that the segments exchanged positions. Two trajectories (8's and infinity's) with 4 possible initial directions were randomly interleaved (1.25 cycles, 2.5s period, Ax = Ay = 1.4 deg). In 91% of trials, the diamond appeared rigid. Correspondingly, pursuit was vigorous (mean Again: 0.74) with a V/H aspect ratio approx. 1 (mean: 0.9). Despite a valid rigid solution, the cross however appeared rigid in 8% of trials. Correspondingly, pursuit was weaker (mean Hgain: 0.38) with an incorrect aspect ratio (mean: 1.5). If pursuit were just minimizing perpendicular slip, performance would be the same in both conditions.

Stone, Leland S.↗

Steady-State Pursuit Is Driven by Object Motion Rather Than the Vector Average of Local Motions

We have previously shown that humans can pursue the motion of objects whose trajectories can be recovered only by spatio-temporal integration of local motion signals. We now explore the integration rule used to derive the target-motion signal driving pursuit. We measured the pursuit response of 4 observers (2 naive) to the motion of a line-figure diamond viewed through two vertical bar apertures (0.2 cd/square m). The comers were always occluded so that only four line segments (93 cd/square m) were visible behind the occluding foreground (38 cd/square m). The diamond was flattened (40 & 140 degree vertex angles) such that vector averaging of the local normal motions and vertical integration (e.g. IOC) yield very I or different predictions, analogous to using a Type II plaid. The diamond moved along Lissajous-figure trajectories (Ax = Ay = 2 degrees; TFx = 0.8 Hz; TFy = 0.4 Hz). We presented only 1.25 cycles and used 6 different randomly interleaved initial relative phases to minimize the role of predictive strategies. Observers were instructed to track the diamond and reported that its motion was always coherent (unlike type II plaids). Saccade-free portions of the horizontal and vertical eye-position traces sampled at 240 Hz were fit by separate sinusoids. Pursuit gain with respect to the diamond averaged 0.7 across subjects and directions. The ratio of the mean vertical to horizontal amplitude of the pursuit response was 1.7 +/- 0.7 averaged across subjects (1SD). This is close to the prediction of 1.0 from vertical motion-integration rules, but far from 7.7 predicted by vector averaging and infinity predicted by segment- or terminator-tracking strategies. Because there is no retinal motion which directly corresponds to the diamond's motion, steady-state pursuit of our "virtual" diamond is not closed-loop in the traditional sense. Thus, accurate pursuit is unlikely to result simply from local retinal negative feedback. We conclude that the signal driving steady-state pursuit is not the vector average of local motion signals, but rather a more vertical estimate of object motion, derived in extrastriate cortical areas beyond V1, perhaps NIT or MST.

Stone, Leland S.↗

The Accuracy of Saccadic and Perceptual Decisions in Visual Search

Saccadic eye movements during search for a target embedded in noise are suboptimally guided by information about target location. Our goal is to compare the spatial information used to guide the saccades with that used for the perceptual decision. Three observers were asked to determine the location of a bright disk (diameter = 21 min) in white noise (signal-to-noise ratio = 4.2) from among 10 possible locations evenly spaced at 5.9 deg eccentricity. In the first of four conditions, observers used natural eye movements. In the three remaining conditions, observers fixated a central cross at all times. The fixation conditions consisted of three different presentation times (100, 200, 300 msec), each followed by a mask. Eye-position data were collected, with a resolution of (approximately) 0.2 deg. In the natural viewing condition, we measured. the accuracy with respect to the target and the latency of the first saccade. In the fixation conditions, we discarded trials in which observers broke fixation. Perceptual performance was computed for all conditions. Averaged across observers, the first saccade was correct (closest to the target location) for 56 +/- (SD) % of trials (chance = 10 %) and occurred after a latency of 313 +/- 56 msec. Perceptual performance averaged 53 +/- 4, 63 +/- 4, 65 +/- 2 % correct at 100, 200, and 300 msec, respectively. For the signal-to-noise ratio used, at the time of initiation of the first saccade, there is little difference between the amount of information about target location available to the perceptual and saccadic systems.

Eckstein, Miguel P.↗

Image Rotation Does Not Rotate Smooth Eye Movements

Subjects viewing a drifting noise pattern make reflexive smooth eye movements in the direction of motion, which follow rapid changes in movement direction. These responses are unaffected by rotations of the pattern, suggesting that there is no coupling between visually sensed rotation and the direction of ocular following.

Mulligan, Jeffrey B.↗

Human Motion Perception and Smooth Eye Movements Show Similar Directional Biases for Elongated Apertures

Although numerous studies have examined the relationship between smooth-pursuit eye movements and motion perception, it remains unresolved whether a common motion-processing system subserves both perception and pursuit. To address this question, we simultaneously recorded perceptual direction judgments and the concomitant smooth eye movement response to a plaid stimulus that we have previously shown generates systematic perceptual errors. We measured the perceptual direction biases psychophysically and the smooth eye-movement direction biases using two methods (standard averaging and oculometric analysis). We found that the perceptual and oculomotor biases were nearly identical suggesting that pursuit and perception share a critical motion processing stage, perhaps in area MT or MST of extrastriate visual cortex.

Beutter, Brent R.↗

Up-down Asymmetries in Speed Perception

We compared speed matches for pairs of stimuli that moved in opposite directions (upward and downward). Stimuli were elliptical patches (2 deg horizontally by 1 deg vertically) of horizontal sinusoidal gratings of spatial. frequency 2 cycles/deg. Two sequential 380 msec reveal presentations were compared. One of each pair of gratings (the standard) moved at 4 Hz (2 deg/sec), the other (the test) moved at a rate determined by a simple up-down staircase. The point of subjectively equal speed was calculated from the average of the last eight reversals. The task was to fixate a central point and to determine which one of the pair appeared to move faster. Eight of 10 observers perceived the upward drifting grating as moving faster than a grating moving downward but otherwise identical. on average (N = 10), when the standard moved downward, it was matched by a test moving upward at 94.7+/-1.7(SE)% of the standard speed, and when the standard moved upward it was matched by a test moving downward at 105.1+/-2.3(SE)% of the standard speed. Extending this paradigm over a range of spatial (1.5 to 13.5 c/d) and temporal (1.5 to 13.5 Hz) frequencies, preliminary results (N = 4) suggest that, under the conditions of our experiment, upward matter is seen as faster than downward for speeds greater than approx.1 deg/sec, but the effect appears to reverse at speeds below approx.1 deg/sec with downward motion perceived as faster. Given that an up-down asymmetry has been observed for the optokinetic response, both perceptual and oculomotor contributions to this phenomenon deserve exploration.

Thompson, Peter↗

Quantitative Simulations of MST Visual Receptive Field Properties Using a Template Model of Heading Estimation

We previously developed a template model of primate visual self-motion processing that proposes a specific set of projections from MT-like local motion sensors onto output units to estimate heading and relative depth from optic flow. At the time, we showed that that the model output units have emergent properties similar to those of MSTd neurons, although there was little physiological evidence to test the model more directly. We have now systematically examined the properties of the model using stimulus paradigms used by others in recent single-unit studies of MST: 1) 2-D bell-shaped heading tuning. Most MSTd neurons and model output units show bell-shaped heading tuning. Furthermore, we found that most model output units and the finely-sampled example neuron in the Duffy-Wurtz study are well fit by a 2D gaussian (sigma approx. 35deg, r approx. 0.9). The bandwidth of model and real units can explain why Lappe et al. found apparent sigmoidal tuning using a restricted range of stimuli (+/-40deg). 2) Spiral Tuning and Invariance. Graziano et al. found that many MST neurons appear tuned to a specific combination of rotation and expansion (spiral flow) and that this tuning changes little for approx. 10deg shifts in stimulus placement. Simulations of model output units under the same conditions quantitatively replicate this result. We conclude that a template architecture may underlie MT inputs to MST.

Stone, Leland S.↗

Emulating the Visual Receptive Field Properties of MST Neurons with a Template Model of Heading Estimation

We have previously proposed a computational neural-network model by which the complex patterns of retinal image motion generated during locomotion (optic flow) can be processed by specialized detectors acting as templates for specific instances of self-motion. The detectors in this template model respond to global optic flow by sampling image motion over a large portion of the visual field through networks of local motion sensors with properties similar to neurons found in the middle temporal (MT) area of primate extrastriate visual cortex. The model detectors were designed to extract self-translation (heading), self-rotation, as well as the scene layout (relative distances) ahead of a moving observer, and are arranged in cortical-like heading maps to perform this function. Heading estimation from optic flow has been postulated by some to be implemented within the medial superior temporal (MST) area. Others have questioned whether MST neurons can fulfill this role because some of their receptive-field properties appear inconsistent with a role in heading estimation. To resolve this issue, we systematically compared MST single-unit responses with the outputs of model detectors under matched stimulus conditions. We found that the basic physiological properties of MST neurons can be explained by the template model. We conclude that MST neurons are well suited to support heading estimation and that the template model provides an explicit set of testable hypotheses which can guide future exploration of MST and adjacent areas within the primate superior temporal sulcus.

Perrone, John A.↗

On the Visual Input Driving Human Smooth-Pursuit Eye Movements

Current computational models of smooth-pursuit eye movements assume that the primary visual input is local retinal-image motion (often referred to as retinal slip). However, we show that humans can pursue object motion with considerable accuracy, even in the presence of conflicting local image motion. This finding indicates that the visual cortical area(s) controlling pursuit must be able to perform a spatio-temporal integration of local image motion into a signal related to object motion. We also provide evidence that the object-motion signal that drives pursuit is related to the signal that supports perception. We conclude that current models of pursuit should be modified to include a visual input that encodes perceived object motion and not merely retinal image motion. Finally, our findings suggest that the measurement of eye movements can be used to monitor visual perception, with particular value in applied settings as this non-intrusive approach would not require interrupting ongoing work or training.

Stone, Leland S.↗

Translation and Rotation Trade Off in Human Visual Heading Estimation

We have previously shown that, during simulated curvilinear motion, humans can make reasonably accurate and precise heading judgments from optic flow without either oculomotor or static-depth cues about rotation. We now systematically investigate the effect of varying the parameters of self-motion. We visually simulated 400 ms of self-motion along curved paths (constant rotation and translation rates, fixed retinocentric heading) towards two planes of random dots at 10.3 m and 22.3 m at mid-trial. Retinocentric heading judgments of 4 observers (2 naive) were measured for 12 different combinations of translation (T between 4 and 16 m/s) and rotation (R either 8 or 16 deg/s). In the range tested, heading bias and uncertainty decrease quasilinearly with T/R, but the bias also appears to depend on R. If depth is held constant, the ratio T/R can account for much of the variation in the accuracy and precision of human visual heading estimation, although further experiments are needed to resolve whether absolute rotation rate, total flow rate, or some other factor can account for the observed -2 deg shift between the bias curves.

Stone, Leland S.↗

Tracking Virtual Trajectories

Current models of smooth pursuit eye movements assume that it is largely driven by retinal image motion. We tested this hypothesis by measuring pursuit of elliptical motion (3.2s, 0.9 Hz, 1.4 deg x 1.6 deg, 4 randomly interleaved phases) of either a small spot ("real" motion) or of a line-figure diamond viewed through apertures such that only the motion of four isolated oblique line segments was visible ("virtual" motion). Each segment moved sinusoidally along a linear trajectory yet subjects perceived a diamond moving along an elliptical path behind the aperture. We found, as expected, that real motion produced accurate tracking (N = 2) with mean gain (over horizontal and vertical) of 0.9, mean phase of -6 deg (lag), mean relative phase (H vs V) of 90 +/- 8 deg (RMS error). Virtual motion behind an X-shaped aperture (N= 4 with one naive) yielded a mean gain of 0.7, mean phase of -11 deg, mean relative phase of 87 +/- 15 deg. We also measured pursuit with the X-shaped aperture using a higher segment luminance which prevents the segments from being grouped into a coherently moving diamond while keeping the motion otherwise identical. In this incoherent case, the same four subjects no longer showed consistent elliptical tracking (RMS error in relative phase rose to 60 deg) suggesting that perceptual coherence is critical. Furthermore, to rule out tracking of the centroid, we also used vertical apertures so that all segment motion was vertical (N = 3). This stimulus still produced elliptical tracking (mean relative phase of 84 +/- 19 deg), albeit with a lower gain (0.6). These data show that humans can track moving objects reasonably accurately even when the trajectory can only be derived by spatial integration of motion signals. Models that merely seek to minimize retinal or local stimulus motion cannot explain these results.

Stone, Leland S.↗

Combining Speed Information Across Space

We used speed discrimination tasks to measure the ability of observers to combine speed information from multiple stimuli distributed across space. We compared speed discrimination thresholds in a classical discrimination paradigm to those in an uncertainty/search paradigm. Thresholds were measured using a temporal two-interval forced-choice design. In the discrimination paradigm, the n gratings in each interval all moved at the same speed and observers were asked to choose the interval with the faster gratings. Discrimination thresholds for this paradigm decreased as the number of gratings increased. This decrease was not due to increasing the effective stimulus area as a control experiment that increased the area of a single grating did not show a similar improvement in thresholds. Adding independent speed noise to each of the n gratings caused thresholds to decrease at a rate similar to the original no-noise case, consistent with observers combining an independent sample of speed from each grating in both the added- and no-noise cases. In the search paradigm, observers were asked to choose the interval in which one of the n gratings moved faster. Thresholds in this case increased with the number of gratings, behavior traditionally attributed to an input bottleneck. However, results from the discrimination paradigm showed that the increase was not due to observers' inability to process these gratings. We have also shown that the opposite trends of the data in the two paradigms can be predicted by a decision theory model that combines independent samples of speed information across space. This demonstrates that models typically used in classical detection and discrimination paradigms are also applicable to search paradigms. As our model does not distinguish between samples in space and time, it predicts that discrimination performance should be the same regardless of whether the gratings are presented in two spatial intervals or two temporal intervals. Our last experiment largely confirmed this prediction.

Verghese, Preeti↗

Combining Speed Information Across Space

We used speed discrimination tasks to measure the ability of observers to combine speed information from multiple stimuli distributed across space. We compared speed discrimination thresholds in a classical discrimination paradigm to those in an uncertainty/search paradigm. Thresholds were measured using a temporal two-interval forced-choice design. In the discrimination paradigm, the n gratings in each interval all moved at the same speed and observers were asked to choose the interval with the faster gratings. Discrimination thresholds for this paradigm decreased as the number of gratings increased. This decrease was not due to increasing the effective stimulus area as a control experiment that increased the area of a single grating did not show a similar improvement in thresholds. Adding independent speed noise to each of the n gratings caused thresholds to decrease at a rate similar to the original no-noise case, consistent with observers combining an independent sample of speed from each grating in both the added- and no-noise cases. In the search paradigm, observers were asked to choose the interval in which one of the n gratings moved faster. Thresholds in this case increased with the number of gratings, behavior traditionally attributed to an input bottleneck. However, results from the discrimination paradigm showed that the increase was not due to observers' inability to process these gratings. We have also shown that the opposite trends of the data in the two paradigms can be predicted by a decision theory model that combines independent samples of speed information across space. This demonstrates that models typically used in classical detection and discrimination paradigms are also applicable to search paradigms. As our model does not distinguish between samples in space and time, it predicts that discrimination performance should be the same regardless of whether the gratings are presented in two spatial intervals or two temporal intervals. Our last experiment largely confirmed this prediction.

Verghese, Preeti↗

Speed Discrimination: Multiple Stimuli Appear Better Than One

We reported that for a 21FC task with multiple moving grating patches (Gabors) in each interval, thresholds for speed discrimination decreased with the number of patches, while increasing the area of a single grating produced no such effect. Furthermore, this decrease occurred regardless of the spacing of the patches about a circle of eccentricity 4 degrees, i.e., whether they were maximally separated or almost touching. These results suggest that it is the multiple, discrete grating patches that cause thresholds to decrease, rather than the spatial arrangement. To test this hypothesis, we measured the effect of dividing a large grating into four quadrants, by superimposing a mean-luminance cross on it. The mean speed discrimination thresholds (Weber Fractions) for four observers were 19, 15, and 11 plus or minus 2%, for the single large grating, the grating with cross, and the 4 maximally-separated, small gratings, respectively. Thus, breaking up a single large grating into multiple parts caused thresholds to improve, despite the fact that less of the original patch was visible. To investigate the possible contribution of total bounding contour length, we measured the effect of coalescing three small grating patches into a single banana-shaped patch, while keeping the total contour length constant. These two conditions were compared to a single, circular Gabor patch of equivalent area that had (necessarily) a smaller contour length. Preliminary data from 3 of 4 observers were similar for the small-grating and banana configurations, but increased for the single, large grating, suggesting that contour length might play a role. We are also investigating the role of low-level factors pertinent to the large grating, such as the pooling of signals from motion units at different eccentricities, and the stimulation of extended inhibitory motion surrounds, as well as the possible contribution of topdown influences that segment the stimulus into distinct objects.

Verghese, Preeti↗

Accurate Visual Heading Estimation at High Rotation Rate Without Oculomotor or Static-Depth Cues

It has been claimed that either oculomotor or static depth cues provide the signals about self-rotation necessary approx.-1 deg/s. We tested this hypothesis by simulating self-motion along a curved path with the eyes fixed in the head (plus or minus 16 deg/s of rotation). Curvilinear motion offers two advantages: 1) heading remains constant in retinotopic coordinates, and 2) there is no visual-oculomotor conflict (both actual and simulated eye position remain stationary). We simulated 400 ms of rotation combined with 16 m/s of translation at fixed angles with respect to gaze towards two vertical planes of random dots initially 12 and 24 m away, with a field of view of 45 degrees. Four subjects were asked to fixate a central cross and to respond whether they were translating to the left or right of straight-ahead gaze. From the psychometric curves, heading bias (mean) and precision (semi-interquartile) were derived. The mean bias over 2-5 runs was 3.0, 4.0, -2.0, -0.4 deg for the first author and three naive subjects, respectively (positive indicating towards the rotation direction). The mean precision was 2.0, 1.9, 3.1, 1.6 deg. respectively. The ability of observers to make relatively accurate and precise heading judgments, despite the large rotational flow component, refutes the view that extra-flow-field information is necessary for human visual heading estimation at high rotation rates. Our results support models that process combined translational/rotational flow to estimate heading, but should not be construed to suggest that other cues do not play an important role when they are available to the observer.

Stone, Leland S.↗

Analysis of the Trial-By-Trial Correlation Between Eye Movement and Perceptual Responses to Moving Plaids

We have previously shown that windowing a drifting plaid with an asymmetric spatial Gaussian produces systematic biases of similar magnitude in both the perceived direction of motion and the direction of the eye movement response. To further investigate this, we simultaneously measured the pyschophysical and eye-movement responses (with an ISCAN RK426 IR tracker)to drifting plaids in a direction discrimination task. Three observers were instructed to track a plaid (Type I 90 deg.; TF = 4 Hz, SF = 0.6 c/d; windowed by a circular spatial gaussian) and to respond whether the motion was to the right or left of pure vertical. Three plaid directions were presented (-2, 0, 2 deg. with respect to straight down), so there was uncertainty in the perceptual judgements. This enabled us to examine the trial-by-trial relationship between the eye movements and psychophysical responses. The eye-movement direction was computed to be the slope of the best fitting line to the initial 300 ms of saccade-free tracking (near open-loop). Again, we found the mean psychophysical and oculomotor responses were correlated. The mean percentages of rightward responses were 6, 27, 87%, and the mean normalized eye-movement directions were -1.5, 0, and 1.0 deg. for the -2, 0, and 2 deg. stimuli respectively. We also computed the trial-by-trial correlation by performing an SOC analysis. The mean correlations were 0.52, 0.66, and 0.67 for our three observers. Because of eye-tracker measurement noise, the above results are lower limits on the actual correlation. These results support the view that the oculomotor and perceptual system share common motion inputs.

Beutter, Brent R.↗

The Barberplaid illusion: Even Perceived Plaid Motion is Biased by Asymmetric Apertures

Our results show that the perceived direction of motion of plaids windowed by asymmetric spatial Gaussians is biased toward the long axis of the window. The bias increases as the relative angle between the plaid motion and the window increases, peaks at a relative angle of about 40 degrees, and then decreases. The peak bias was 14 degrees for a spatial frequency of 0.6 cpd and a window aspect ratio of 4.0. The biases increase as the window is elongated and decrease as the component spatial frequency increases. We tested the predictions of several models of human motion processing (cross correlation, motion energy, intersection of constraints, and vector sum), and show that none of these can predict our data. These results suggest that spatial integration of motion signals plays a crucial role in the perception of plaid motion.

Beutter, Brent↗