Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “eye tracking experiment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Anticipatory Eye Movements in Interleaving Templates of Human Behavior

Performance modeling has been made easier by architectures which package psychological theory for reuse at useful levels of abstraction. CPM-GOMS uses templates of behavior to package at a task level (e.g., mouse move-click, typing) predictions of lower-level cognitive, perceptual, and motor resource use. CPM-GOMS also has a theory for interleaving resource use between templates. One example of interleaving is anticipatory eye movements. This paper describes the use of ACT-Stitch, a framework for translating CPM-GOMS templates and interleaving theory into ACT-R, to model anticipatory eye movements in skilled behavior. The anticipatory eye movements explain performance in a well-practiced perceptual/motor task, and the interleaving theory is supported with results from an eye-tracking experiment.

Matessa, Michael↗

Out of the Corner of My Eye: Foveal Semantic Load Modulates Parafoveal Processing in Reading.

In two experiments, we examined the impact of foveal semantic expectancy and congruity on parafoveal word processing during reading. Experiment 1 utilized an eye-tracking gaze contingent display change paradigm, and Experiment 2 measured event-related brain potentials (ERP) in a modified RSVP paradigm to track the time-course of foveal semantic influences on convert attentional allocation to parafoveal word processing. Furthermore, eye-tracking and ERP data converged to reveal graded effects of semantic foveal load on parafoveal processing.

97 MATHEMATICS AND COMPUTING↗

Quantifying Pilot Visual Attention in Low Visibility Terminal Operations

Quantifying pilot visual behavior allows researchers to determine not only where a pilot is looking and when, but holds implications for specific behavioral tracking when these data are coupled with flight technical performance. Remote eye tracking systems have been integrated into simulators at NASA Langley with effectively no impact on the pilot environment. This paper discusses the installation and use of a remote eye tracking system. The data collection techniques from a complex human-in-the-loop (HITL) research experiment are discussed; especially, the data reduction algorithms and logic to transform raw eye tracking data into quantified visual behavior metrics, and analysis methods to interpret visual behavior. The findings suggest superior performance for Head-Up Display (HUD) and improved attentional behavior for Head-Down Display (HDD) implementations of Synthetic Vision System (SVS) technologies for low visibility terminal area operations. Keywords: eye tracking, flight deck, NextGen, human machine interface, aviation

Ellis, Kyle K.↗

Predicting diagnostic error in radiology via eye-tracking and image analytics: Preliminary investigation in mammography

Purpose: The primary aim of the present study was to test the feasibility of predicting diagnostic errors in mammography by merging radiologists’ gaze behavior and image characteristics. A secondary aim was to investigate group-based and personalized predictive models for radiologists of variable experience levels.Methods: The study was performed for the clinical task of assessing the likelihood of malignancy of mammographic masses. Eye-tracking data and diagnostic decisions for 40 cases were acquired from four Radiology residents and two breast imaging experts as part of an IRB-approved pilot study. Gaze behavior features were extracted from the eye-tracking data. Computer-generated and BIRADS images features were extracted from the images. Finally, machine learning algorithms were used to merge gaze and image features for predicting human error. Feature selection was thoroughly explored to determine the relative contribution of the various features. Group-based and personalized user modeling was also investigated.Results: Machine learning can be used to predict diagnostic error by merging gaze behavior characteristics from the radiologist and textural characteristics from the image under review. Leveraging data collected from multiple readers produced a reasonable group model [area under the ROC curve (AUC) = 0.792 ± 0.030]. Personalized user modeling was far more accurate for the more experienced readers (AUC = 0.837 ± 0.029) than for the less experienced ones (AUC = 0.667 ± 0.099). The best performing group-based and personalized predictive models involved combinations of both gaze and image features.Conclusions: Diagnostic errors in mammography can be predicted to a good extent by leveraging the radiologists’ gaze behavior and image content.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Modeling sequential context effects in diagnostic interpretation of screening mammograms

Prior research has shown that physicians’ medical decisions can be influenced by sequential context, particularly in cases where successive stimuli exhibit similar characteristics when analyzing medical images. This type of systematic error is known to psychophysicists as sequential context effect as it indicates that judgments are influenced by features of and decisions about the preceding case in the sequence of examined cases, rather than being based solely on the peculiarities unique to the present case. We determine if radiologists experience some form of context bias, using screening mammography as the use case. To this end, we explore correlations between previous perceptual behavior and diagnostic decisions and current decisions. We hypothesize that a radiologist’s visual search pattern and diagnostic decisions in previous cases are predictive of the radiologist’s current diagnostic decisions. To test our hypothesis, we tasked 10 radiologists of varied experience to conduct blind reviews of 100 four-view screening mammograms. Eye-tracking data and diagnostic decisions were collected from each radiologist under conditions mimicking clinical practice. Perceptual behavior was quantified using the fractal dimension of gaze scanpath, which was computed using the Minkowski–Bouligand box-counting method. To test the effect of previous behavior and decisions, we conducted a multifactor fixed-effects ANOVA. Further, to examine the predictive value of previous perceptual behavior and decisions, we trained and evaluated a predictive model for radiologists’ current diagnostic decisions. ANOVA tests showed that previous visual behavior, characterized by fractal analysis, previous diagnostic decisions, and image characteristics of previous cases are significant predictors of current diagnostic decisions. Additionally, predictive modeling of diagnostic decisions showed an overall improvement in prediction error when the model is trained on additional information about previous perceptual behavior and diagnostic decisions.

60 APPLIED LIFE SCIENCES↗

Investigation of the use of an electronic multifunction display and an electromechanical horizontal situation indicator for guidance and control of powered-lift short-haul aircraft

The use which pilots make of a moving map display from en route through the terminal area and including the approach and go-around flight phases was investigated. The content and function of each of three primary STOLAND displays are reviewed from an operational point of view. The primary displays are the electronic attitude director indicator (EADI), the horizontal situation indicator (HSI), and the multifunction display (MFD). Manually controlled flight with both flight director guidance and raw situation data is examined in detail in a simulated flight experiment with emphasis on tracking reference flight plans and maintaining geographic orientation after missed approaches. Eye-point-of-regard and workload measurements, coupled with task performance measurements, pilot opinion ratings, and pilot comments are presented. The experimental program was designed to offer a systematic objective and subjective comparison of pilots' use of the moving map MFD in conjunction with the other displays.

Clement, W. F.↗

Use of Data Comm by Flight Crew in High-Density Terminal Areas

This paper describes a collaborative FAA and NASA experiment using 22 commercial airline pilots to determine the effect of using Datalink Communication (Data Comm) to issue messages in busy, terminal area operations. Four conditions were defined that span current day to future flight deck equipage levels (voice communication only, Data Comm only, Data Comm with Moving Map Display, Data Comm with Moving Map displaying taxi route), and each condition was used to create an arrival and a departure scenario at the Boston Logan Airport. These eight scenarios were repeated twice for a total of 16 scenarios for each of the eleven crews. Quantitative data was collected on subject reaction time and eye tracking information. Questionnaires collected subjective feedback on workload and acceptability to the flight crew for using Data Comm in a busy terminal area. 95% of the Data Comm messages were responded to by the flight crew within one minute; however, post experiment debrief comments revealed almost unanimous consensus that two minutes was a reasonable expectation for crew response. Eye tracking data indicated an insignificant decrease in head-up time for the Pilot Flying when Data Comm was introduced; however, the Pilot Monitoring had significantly less head-up time. Data Comm workload was rated as operationally acceptable by both crew members in all conditions in flight at any altitude above the Final Approach Fix in terms of response time and workload. Results also indicate the use of Data Comm during surface operations was acceptable, the exception being the simultaneous use of voice, Data Comm, and audio chime required for an aircraft to cross an active runway. Many crews reported they believed Data Comm messages would be acceptable after the Final Approach Fix or to cross a runway if the message was not accompanied by a chime and there was not a requirement to immediately respond to the uplink message.

Baxley, Brian T.↗

Vestibular and Non-vestibular Contributions to Eye Movements that Compensate for Head Rotations during Viewing of Near Targets

We studied horizontal eye movements induced by en-bloc yaw rotation, over a frequency range 0.2 - 2.8 Hz, in 10 normal human subjects as th ey monocularly viewed a target located at their near point of focus. We measured gain and phase relationships between eye-in-head velocity and head velocity when the near target was either earth-fixed or head-fixed. During viewing of the earth-fixed near target,median gain was 1.49 (range 1.24 - 1.87) at 0.2 Hz for the group of subjects, but decl ined at higher frequencies, so that at 2.8 Hz median gain was 1.08 (r ange 0.68 - 1.67). During viewing of the head-fixed near target, median gain was 0.03 (range 0.01 - 0.10) at 0.2 Hz for the group of subjec ts, but increased at higher frequencies, so that at 2.8 Hz median gai n was 0.71 (range 0.28 - 0.94). We estimated the vestibular contribution to these responses (vestibulo-ocular reflex gain, Gvor) by applyin g transient head perturbations (peak acceleration> 1,000 deg's(exp 2) ) during sinusoidal rotation under the two viewing conditions. Median Gvor, estimated < 70m after the onset of head perturbation, was 0.98 (range 0.39 - 1.42) while viewing the earth-fixed near target, and 0. 97 (range 0.37 - 1.33) while viewing the head-fixed near target. For the group of subjects, 9 out of 10 subjects showed no sigificant diff erence of Gvor between the two viewing conditions ( p > 0.053 ) at all test frequencies. Since Gvor accounted for only approximately 73% of the overall response gain during viewing of the earth-fixed target, we investigated the relative contributions of non-vestibular factors. When subjects viewed the earth-fixed target under strobe illumination , to eliminate retinal image slip information, the gain of compensato ry eye movements declined compared with viewing in ambient room light . During sum-of-sine head rotations, while viewing the earth-fixed target, to minimize contributions from predictive mechanisms, gain also declined Nonetheless, simple superposition of smooth-pursuit tracking of sinusoidal target motion could not fully account for the overall r esponse at higher frequencies, suggesting other non-vestibular contributions. During binocular viewing conditions when vergence angle was s ignificantly greater than monocular viewing (p < 0.001), this gain of compensatory eye movements did not show proportional change; indeed, gain could not be correlated with vergence angle during monocular or binocular viewing. We conclude that several separate factors contribute to generate eye rotations during sinusoidal yaw head rotations whi le viewing a near target; these include the VOR, visual-tracking eye movements that utilize retinal image motion, predictive eye movements and, possibly, other unidentified nonvestibular factors. For these experiments, vergence was not an important determinant of response gain .

Han, Yanning H.↗

Electromagnetic guided couch and multileaf collimator tracking on a TrueBeam accelerator

Purpose: Couch and MLC tracking are two promising methods for real-time motion compensation during radiation therapy. So far, couch and MLC tracking experiments have mainly been performed by different research groups, and no direct comparison of couch and MLC tracking of volumetric modulated arc therapy (VMAT) plans has been published. The Varian TrueBeam 2.0 accelerator includes a prototype tracking system with selectable couch or MLC compensation. This study provides a direct comparison of the two tracking types with an otherwise identical setup. Methods: Several experiments were performed to characterize the geometric and dosimetric performance of electromagnetic guided couch and MLC tracking on a TrueBeam accelerator equipped with a Millennium MLC. The tracking system latency was determined without motion prediction as the time lag between sinusoidal target motion and the compensating motion of the couch or MLC as recorded by continuous MV portal imaging. The geometric and dosimetric tracking accuracies were measured in tracking experiments with motion phantoms that reproduced four prostate and four lung tumor trajectories. The geometric tracking error in beam’s eye view was determined as the distance between an embedded gold marker and a circular MLC aperture in continuous MV images. The dosimetric tracking error was quantified as the measured 2%/2 mm gamma failure rate of a low and a high modulation VMAT plan delivered with the eight motion trajectories using a static dose distribution as reference. Results: The MLC tracking latency was approximately 146 ms for all sinusoidal period lengths while the couch tracking latency increased from 187 to 246 ms with decreasing period length due to limitations in the couch acceleration. The mean root-mean-square geometric error was 0.80 mm (couch tracking), 0.52 mm (MLC tracking), and 2.75 mm (no tracking) parallel to the MLC leaves and 0.66 mm (couch), 1.14 mm (MLC), and 2.41 mm (no tracking) perpendicular to the leaves. The motion-induced gamma failure rate was in mean 0.1% (couch tracking), 8.1% (MLC tracking), and 30.4% (no tracking) for prostate motion and 2.9% (couch), 2.4% (MLC), and 41.2% (no tracking) for lung tumor motion. The residual tracking errors were mainly caused by inadequate adaptation to fast lung tumor motion for couch tracking and to prostate motion perpendicular to the MLC leaves for MLC tracking. Conclusions: Couch and MLC tracking markedly improved the geometric and dosimetric accuracies of VMAT delivery. However, the two tracking types have different strengths and weaknesses. While couch tracking can correct perfectly for slowly moving targets such as the prostate, MLC tracking may have considerably larger dose errors for persistent target shift perpendicular to the MLC leaves. Advantages of MLC tracking include faster dynamics with better adaptation to fast moving targets, the avoidance of moving the patient, and the potential to track target rotations and deformations.

60 APPLIED LIFE SCIENCES↗

Vestibular and Non-vestibular Contributions to Eye Movements that Compensate for Head Rotations during Viewing of Near Targets

We studied horizontal eye movements induced by en-bloc yaw rotation, over a frequency range 0.2 - 2.8 Hz, in 10 normal human subjects as they monocularly viewed a target located at their near point of focus. We measured gain and phase relationships between eye-in-head velocity and head velocity when the near target was either earth-fixed or head-fixed. During viewing of the earth-fixed near target, median gain was 1.49 (range 1.24 - 1.87) at 0.2 Hz for the group of subjects, but declined at higher frequencies, so that at 2.8 Hz median gain was 1.08 (range 0.68 - 1.67). During viewing of the head-fixed near target , median gain was 0.03 (range 0.01 - 0.10) at 0.2 Hz for the group of subjects, but increased at higher frequencies, so that at 2.8 Hz median gain was 0.71 (range 0.28 - 0.94). We estimated the vestibular contribution to these responses vestibulo-ocular reflex gain (Gvor) by applying transient head perturbations (peak acceleration> 1,000 deg/s(exp 2)) during sinusoidal rotation under the two viewing conditions. Median Gvor, estimated < 70ms after the onset of head perturbation, was 0.98 (range 0.39 - 1.42) while viewing the earth-fixed near target, and 0.97 (range 0.37 - 1.33) while viewing the head-fixed near target. For the group of subjects, 9 out of 10 subjects showed no significant difference of Gvor between the two viewing conditions ( p > 0.053 ) at all test frequencies. Since Gvor accounted for only -73% of the overall response gain during viewing of the earth-fixed target, we investigated the relative contributions of non-vestibular factors. When subjects viewed the earth-fixed target under strobe illumination, to eliminate retinal image slip information, the gain of compensatory eye movements declined compared with viewing in ambient room light. During sum-of-sine head rotations, while viewing the earth-fixed target, to Han et al./VOR during near-viewing minimize contributions from predictive mechanisms, gain also declined Nonetheless, simple superposition of smooth-pursuit tracking of sinusoidal target motion could not fully account for the overall response at higher frequencies, suggesting other nonvestibular contributions. During binocular viewing conditions when vergence angle was significantly greater than monocular viewing (p < 0.00l), the gain of compensatory eye movements did not show proportional change; indeed, gain could not be correlated with vergence angle during monocular or binocular viewing. We conclude that several separate factors contribute to generate eye rotations during sinusoidal yaw head rotations while viewing a near target; these include the VOR, visual-tracking eye movements that utilize retinal image motion, predictive eye movements and, possibly, other unidentified non-vestibular factors. For these experiments, vergence was not an important determinant of response gam.

Han, Yanning H.↗

Dynamic tumor tracking using the Elekta Agility MLC

Purpose: To evaluate the performance of the Elekta Agility multileaf collimator (MLC) for dynamic real-time tumor tracking. Methods: The authors have developed a new control software which interfaces to the Agility MLC to dynamically program the movement of individual leaves, the dynamic leaf guides (DLGs), and the Y collimators (“jaws”) based on the actual target trajectory. A motion platform was used to perform dynamic tracking experiments with sinusoidal trajectories. The actual target positions reported by the motion platform at 20, 30, or 40 Hz were used as shift vectors for the MLC in beams-eye-view. The system latency of the MLC (i.e., the average latency comprising target device reporting latencies and MLC adjustment latency) and the geometric tracking accuracy were extracted from a sequence of MV portal images acquired during irradiation for the following treatment scenarios: leaf-only motion, jaw + leaf motion, and DLG + leaf motion. Results: The portal imager measurements indicated a clear dependence of the system latency on the target position reporting frequency. Deducting the effect of the target frequency, the leaf adjustment latency was measured to be 38 ± 3 ms for a maximum target speed v of 13 mm/s. The jaw + leaf adjustment latency was 53 ± 3 at a similar speed. The system latency at a target position frequency of 30 Hz was in the range of 56–61 ms for the leaves (v ≤ 31 mm/s), 71–78 ms for the jaw + leaf motion (v ≤ 25 mm/s), and 58–72 ms for the DLG + leaf motion (v ≤ 59 mm/s). The tracking accuracy showed a similar dependency on the target position frequency and the maximum target speed. For the leaves, the root-mean-squared error (RMSE) was between 0.6–1.5 mm depending on the maximum target speed. For the jaw + leaf (DLG + leaf) motion, the RMSE was between 0.7–1.5 mm (1.9–3.4 mm). Conclusions: The authors have measured the latency and geometric accuracy of the Agility MLC, facilitating its future use for clinical tracking applications.

60 APPLIED LIFE SCIENCES↗

Temporal Stability of Visual Search-Driven Biometrics

Previously, we have shown the potential of using an individual s visual search pattern as a possible biometric. That study focused on viewing images displaying dot-patterns with different spatial relationships to determine which pattern can be more effective in establishing the identity of an individual. In this follow-up study we investigated the temporal stability of this biometric. We performed an experiment with 16 individuals asked to search for a predetermined feature of a random-dot pattern as we tracked their eye movements. Each participant completed four testing sessions consisting of two dot patterns repeated twice. One dot pattern displayed concentric circles shifted to the left or right side of the screen overlaid with visual noise, and participants were asked which side the circles were centered on. The second dot-pattern displayed a number of circles (between 0 and 4) scattered on the screen overlaid with visual noise, and participants were asked how many circles they could identify. Each session contained 5 untracked tutorial questions and 50 tracked test questions (200 total tracked questions per participant). To create each participant s "fingerprint", we constructed a Hidden Markov Model (HMM) from the gaze data representing the underlying visual search and cognitive process. The accuracy of the derived HMM models was evaluated using cross-validation for various time-dependent train-test conditions. Subject identification accuracy ranged from 17.6% to 41.8% for all conditions, which is significantly higher than random guessing (1/16 = 6.25%). The results suggest that visual search pattern is a promising, fairly stable personalized fingerprint of perceptual organization.

eye tracking↗

Context-specific adaptation of pursuit initiation in humans

PURPOSE: To determine if multiple states for the initiation of pursuit, as assessed by acceleration in the "open-loop" period, can be learned and gated by context. METHODS: Four normal subjects were studied. A modified step-ramp paradigm for horizontal pursuit was used to induce adaptation. In an increasing paradigm, target velocity doubled 230 msec after onset; in a decreasing paradigm, it was halved. In the first experiment, vertical eye position (+/-5 degrees ) was used as the context cue, and the training paradigm (increasing or decreasing) changed with vertical eye position. In the second experiment, with vertical position constant, when the target was red, training was decreasing, and when green, increasing. The average eye acceleration in the first 100 msec of tracking was the index of open-loop pursuit performance. RESULTS: With vertical position as the cue, pursuit adaptation differed between up and down gaze. In some cases, the direction of adaptation was in exact accord with the training stimuli. In others, acceleration increased or decreased for both up and down gaze but always in correct relative proportion to the training stimuli. In contrast, multiple adaptive states were not induced with color as the cue. CONCLUSIONS: Multiple values for the relationship between the average eye acceleration during the initiation of pursuit and target velocity could be learned and gated by context. Vertical position was an effective contextual cue but not target color, implying that useful contextual cues must be similar to those occurring naturally, for example, orbital position with eye muscle weakness.

NASA Discipline Neuroscience↗

Event-related brain potentials reveal how multiple aspects of semantic processing unfold across parafoveal and foveal vision during sentence reading

Recent event–related brain potential (ERP) experiments have demonstrated parafoveal N400 expectancy and congruity effects, showing that semantic information can be accessed from words in parafoveal vision (a conclusion also supported by some eye–tracking work). At the same time, it is unclear how higher–order integrative aspects of language comprehension unfold across the visual field during reading. In the current study, we recorded ERPs in a parafoveal flanker paradigm, while readers were instructed to read passively for comprehension or to judge the plausibility of sentences in which target words varied in their semantic expectancy and congruity. We directly replicated prior work showing graded N400 effects for parafoveal viewing, which are then not duplicated when the target words are processed foveally. Critically, although N400 effects were not modulated by task goals, a posteriorly distributed late positive component thought to reflect semantic integration processes was observed to semantic incongruities only in the plausibility judgment task. Furthermore, this effect was observed at a considerable delay, appearing only after words had moved into foveal vision. Our findings thus suggest that semantic access can be initiated in parafoveal vision, whereas central foveal vision may be necessary to enact higher–order (and task–dependent) integrative processing.

60 APPLIED LIFE SCIENCES↗

Part-Task Simulation of Synthetic and Enhanced Vision Concepts for Lunar Landing

During Apollo, the constraints placed by the design of the Lunar Module (LM) window for crew visibility and landing trajectory were a major problem. Lunar landing trajectories were tailored to provide crew visibility using nearly 70 degrees look-down angle from the canted LM windows. Apollo landings were scheduled only at specific times and locations to provide optimal sunlight on the landing site. The complications of trajectory design and crew visibility are still a problem today. Practical vehicle designs for lunar lander missions using optimal or near-optimal fuel trajectories render the natural vision of the crew from windows inadequate for the approach and landing task. Further, the sun angles for the desirable landing areas in the lunar polar regions create visually powerful, season-long shadow effects. Fortunately, Synthetic and Enhanced Vision (S/EV) technologies, conceived and developed in the aviation domain, may provide solutions to this visibility problem and enable additional benefits for safer, more efficient lunar operations. Piloted simulation evaluations have been conducted to assess the handling qualities of the various lunar landing concepts, including the influence of cockpit displays and the informational data and formats. Evaluation pilots flew various landing scenarios with S/EV displays. For some of the evaluation trials, an eye glasses-mounted, monochrome monocular display, coupled with head tracking, was worn. The head-worn display scene consisted of S/EV fusion concepts. The results of this experiment showed that a head-worn system did not increase the pilot s workload when compared to using just the head-down displays. As expected, the head-worn system did not provide an increase in performance measures. Some pilots commented that the head-worn system provided greater situational awareness compared to just head-down displays.

Arthur, Jarvis J., III↗

Airborne Precision Spacing: A Trajectory-based Approach to Improve Terminal Area Operations

Airborne Precision Spacing has been developed by the National Aeronautics and Space Administration (NASA) over the past seven years as an attempt to benefit from the capabilities of the flight deck to precisely space their aircraft relative to another aircraft. This development has leveraged decades of work on improving terminal area operations, especially the arrival phase. With APS operations, the air traffic controller instructs the participating aircraft to achieve an assigned inter-arrival spacing interval at the runway threshold, relative to another aircraft. The flight crew then uses airborne automation to manage the aircraft s speed to achieve the goal. The spacing tool is designed to keep the speed within acceptable operational limits, promote system-wide stability, and meet the assigned goal. This reallocation of tasks with the controller issuing strategic goals and the flight crew managing the tactical achievement of those goals has been shown to be feasible through simulation and flight test. A precision of plus or minus 2-3 seconds is generally achievable. Simulations of long strings of arriving traffic show no signs of instabilities or compression waves. Subject pilots have rated the workload to be similar to current-day operations and eye-tracking data substantiate this result. This paper will present a high-level review of research results over the past seven years from a variety of tests and experiments. The results will focus on the precision and accuracy achievable, flow stability and some major sources of uncertainty. The paper also includes a summary of the flight crew s procedures and interface and a brief concept overview.

Barmore, Bryan↗