Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “visual tracking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Suppression of biodynamic interference in head-tracked teleoperation

The utility of helmet-tracked sights to provide pointing commands for teleoperation of cameras, lasers, or antennas in aircraft is degraded by the presence of uncommanded, involuntary heat motion, referred to as biodynamic interference. This interference limits the achievable precision required in pointing tasks. The noise contributions due to biodynamic interference consists of an additive component which is correlated with aircraft vibration and an uncorrelated, nonadditive component, referred to as remnant. An experimental simulation study is described which investigated the improvements achievable in pointing and tracking precision using dynamic display shifting in the helmet-mounted display. The experiment was conducted in a six degree of freedom motion base simulator with an emulated helmet-mounted display. Highly experienced pilot subjects performed precision head-pointing tasks while manually flying a visual flight-path tracking task. Four schemes using adaptive and low-pass filtering of the head motion were evaluated to determine their effects on task performance and pilot workload in the presence of whole-body vibration characteristic of helicopter flight. The results indicate that, for tracking tasks involving continuously moving targets, improvements of up to 70 percent can be achieved in percent on-target dwelling time and of up to 35 percent in rms tracking error, with the adaptive plus low-pass filter configuration. The results with the same filter configuration for the task of capturing randomly-positioned, stationary targets show an increase of up to 340 percent in the number of targets captured and an improvement of up to 24 percent in the average capture time. The adaptive plus low-pass filter combination was considered to exhibit the best overall display dynamics by each of the subjects.

Lifshitz, S.↗
NASA NTRS2015

Advanced Bayesian Method for Planetary Surface Navigation

Autonomous Exploration, Inc., has developed an advanced Bayesian statistical inference method that leverages current computing technology to produce a highly accurate surface navigation system. The method combines dense stereo vision and high-speed optical flow to implement visual odometry (VO) to track faster rover movements. The Bayesian VO technique improves performance by using all image information rather than corner features only. The method determines what can be learned from each image pixel and weighs the information accordingly. This capability improves performance in shadowed areas that yield only low-contrast images. The error characteristics of the visual processing are complementary to those of a low-cost inertial measurement unit (IMU), so the combination of the two capabilities provides highly accurate navigation. The method increases NASA mission productivity by enabling faster rover speed and accuracy. On Earth, the technology will permit operation of robots and autonomous vehicles in areas where the Global Positioning System (GPS) is degraded or unavailable.

Center, Julian↗
NASA NTRS2007

Determining Desirable Cursor Control Device Characteristics for NASA Exploration Missions

The Crew Exploration Vehicle (CEV) that will travel to the moon and Mars, and all future Exploration vehicles and habitats will be highly computerized, necessitating an accurate method of interaction with the computers. The design of a cursor control device will have to take into consideration g-forces, vibration, gloved operations, and the specific types of tasks to be performed. The study described here is being undertaken to begin identifying characteristics of cursor control devices that will work well for the unique Exploration mission environments. The objective of the study is not to identify a particular device, but to begin identifying design characteristics that are usable and desirable for space missions. Most cursor control devices have strengths and weaknesses; they are more appropriate for some tasks and less suitable for others. The purpose of this study is to collect some initial usability data on a large number of commercially available and proprietary cursor control devices. A software test battery was developed for this purpose. Once data has been collected using these low-level, basic point/click/drag tasks, higher fidelity, scenario-driven evaluations will be conducted with a reduced set of devices. The standard tasks used for testing cursor control devices are based on a model of human movement known as Fitts law. Fitts law predicts that the time to acquire a target is logarithmically related to the distance over the target size. To gather data for analysis with this law, fundamental, low-level tasks are used such as dragging or pointing at various targets of different sizes from various distances. The first four core tasks for the study were based on the ISO 9241-9:(2000) document from the International Organization for Standardization that contains the requirements for non-keyboard input devices. These include two pointing tasks, one dragging and one tracking task. The fifth task from ISO 9241-9, the circular tracking task was not used because it is a movement that is not applicable to most of the applications used on aviation displays. Additionally, we opted to add a multi-size and multi-distance pointing task, and two ecologically more valid tasks which included text selection, and interaction with drop down menus, sliders, and checkboxes. The Visual Basic test battery tracks the task and trial numbers, measures the pointing, tracking or dragging time, as well as the number and types of errors. The testing session includes a practice set for each input device, then the randomized 7 tasks, and finally a questionnaire about the device. This is repeated for all the devices tested within a session. The experiment is a within-subjects design, with participants returning for multiple sessions to test additional devices. The input devices will be compared based on objective performance data from the tasks, as well as subjective feedback and ratings on the questionnaire.

Aniko Sandor↗
NASA NTRS2016

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval. We present two methods for comparing sequences of this sort, one based on computing the time-varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions.We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of activities, each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates.We have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Haslbeck, Gontar Schubert, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

attention↗
NASA NTRS2016

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval. We present two methods for comparing sequences of this sort, one based on computing the time-varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions. We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of "activities," each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates. We have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Haslbeck, Gontar & Schubert, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

attention↗
NASA NTRS2015

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval.We present two methods for comparing sequences of this sort, one based on computing the time varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions.We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of activities, each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates. Using these criteria, we have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Gontar Hoermann, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

Mulligan, Jeffrey B.↗
NASA NTRS2014

Investigating Surveillance Performance for UAS Detect-and-Avoid Systems

Most unmanned aircraft systems will be required to be equipped with a detect-and-avoid system that is capable of maintaining appropriate separation from other aircraft. One of the critical components of detect-and-avoid systems is a surveillance system that identifies potential threat aircraft in real time and tracks these aircraft so that their future trajectories may be used to predict conflicts. The performance of the detect-and-avoid system generally depends on technical parameters of the surveillance system, such as the surveillance range. The quantitative requirements for detect-and-avoid systems will be determined to meet safety metrics for the operation of unmanned aircraft systems in the National Airspace System. This study employs a sensor model comprised of the surveillance range, and horizontal and vertical fields of regard that mainly characterize the overall performance of a surveillance system. In this study, potential metrics for evaluating the performance of a surveillance system were investigated through fast-time simulation with a traffic scenario that included both proposed unmanned aircraft flights and historical visual flight rule aircraft tracks. Using the simulation results, an overall analysis of encounter geometry highlights the encounter characteristics that relate surveillance parameters to safety metrics and detect-and-avoid system performance. Then, given several candidate surveillance volumes, performance and safety metrics are derived; these metrics include the ratio of undetected and late-detected violations and the time to violation at first detection. These example metrics demonstrate the utility of the database of encounters created in this work, a database which will be useful in the derivation of required detect-and-avoid surveillance system requirements.

Lee, Seung Man↗
NASA NTRS2007

Robotic Vision-Based Localization in an Urban Environment

A system of electronic hardware and software, now undergoing development, automatically estimates the location of a robotic land vehicle in an urban environment using a somewhat imprecise map, which has been generated in advance from aerial imagery. This system does not utilize the Global Positioning System and does not include any odometry, inertial measurement units, or any other sensors except a stereoscopic pair of black-and-white digital video cameras mounted on the vehicle. Of course, the system also includes a computer running software that processes the video image data. The software consists mostly of three components corresponding to the three major image-data-processing functions: Visual Odometry This component automatically tracks point features in the imagery and computes the relative motion of the cameras between sequential image frames. This component incorporates a modified version of a visual-odometry algorithm originally published in 1989. The algorithm selects point features, performs multiresolution area-correlation computations to match the features in stereoscopic images, tracks the features through the sequence of images, and uses the tracking results to estimate the six-degree-of-freedom motion of the camera between consecutive stereoscopic pairs of images (see figure). Urban Feature Detection and Ranging Using the same data as those processed by the visual-odometry component, this component strives to determine the three-dimensional (3D) coordinates of vertical and horizontal lines that are likely to be parts of, or close to, the exterior surfaces of buildings. The basic sequence of processes performed by this component is the following: 1. An edge-detection algorithm is applied, yielding a set of linked lists of edge pixels, a horizontal-gradient image, and a vertical-gradient image. 2. Straight-line segments of edges are extracted from the linked lists generated in step 1. Any straight-line segments longer than an arbitrary threshold (e.g., 30 pixels) are assumed to belong to buildings or other artificial objects. 3. A gradient-filter algorithm is used to test straight-line segments longer than the threshold to determine whether they represent edges of natural or artificial objects. In somewhat oversimplified terms, the test is based on the assumption that the gradient of image intensity varies little along a segment that represents the edge of an artificial object.

Mchenry, Michael↗
NASA NTRS1992

Comparison of Predictable Smooth Ocular and Combined Eye-Head Tracking Behaviour in Patients with Lesions Affecting the Brainstem and Cerebellum

We compared the ability of eight normal subjects and 15 patients with brainstem or cerebellar disease to follow a moving visual stimulus smoothly with either the eyes alone or with combined eye-head tracking. The visual stimulus was either a laser spot (horizontal and vertical planes) or a large rotating disc (torsional plane), which moved at one sinusoidal frequency for each subject. The visually enhanced Vestibulo-Ocular Reflex (VOR) was also measured in each plane. In the horizontal and vertical planes, we found that if tracking gain (gaze velocity/target velocity) for smooth pursuit was close to 1, the gain of combined eye-hand tracking was similar. If the tracking gain during smooth pursuit was less than about 0.7, combined eye-head tracking was usually superior. Most patients, irrespective of diagnosis, showed combined eye-head tracking that was superior to smooth pursuit; only two patients showed the converse. In the torsional plane, in which optokinetic responses were weak, combined eye-head tracking was much superior, and this was the case in both subjects and patients. We found that a linear model, in which an internal ocular tracking signal cancelled the VOR, could account for our findings in most normal subjects in the horizontal and vertical planes, but not in the torsional plane. The model failed to account for tracking behaviour in most patients in any plane, and suggested that the brain may use additional mechanisms to reduce the internal gain of the VOR during combined eye-head tracking. Our results confirm that certain patients who show impairment of smooth-pursuit eye movements preserve their ability to smoothly track a moving target with combined eye-head tracking.

Grant, Michael P.↗
NASA NTRS1973

Vibration

Man's reactions to vibration are emphasized rather than his reactions to the vibrational characteristics of vehicles. Vibrational effects studies include: performance effects reflected in tracking proficiency, reaction time, visual impairment, and other measures related to man's ability to control a system; physiological reactions; biodynamic responses; subjective reactions; and human tolerance limits. Technological refinements in shaker systems and improved experimental designs are used to validate the data.

Hornick, R. J.↗
NASA NTRS1975

Satellite animal tracking feasibility studies

A study was initiated in Tsavo National Park to determine movements and home ranges of individual elephants and their relations to overall distribution patterns and environmental factors such as rainfall. Methods used were radio tracking and observations of visually identifiable individuals. Aerial counts provided data on overall distribution. Two bulls and two cows were radio-tagged in Tsavo West and two bulls and four cows in Tsavo East, providing home range and movement data. The movements of individuals were useful in interpreting relatively major shifts in elephant distribution. Results point to the following preliminary conclusions: (1) elephants in the Tsavo area undertook long distance movements in fairly direct response to localized rainfall; (2) a subdivision of the overall population into locally distinct units may exist during the dry season but did not occur after significant rainfall; and (3) food appears to be the primary factor governing movements and distribution of elephants in the area.

Buechner, H. K.↗
NASA NTRS1994

Implementation of and measurement with the LIPA technique in a subsonic jet

LIPA (Laser Induced Photochemical Anemometry) was used to measure velocity, vorticity, Reynolds stress, and turbulent intensity distributions in a subsonic jet. The jet region of interest was the area close to the jet-orifice. The LIPA-technique is a nonintrusive quantitative flow visualization technique, consisting of tracking a phosphorescing grid of fluid particles, which is impressed by laser-beams directed into the flow. The phosphorescence of biacetyl gas was used to enable tracking of the impressed light grid. In order to perform measurements in a jet, LIPA was developed and implemented for the specific flow requirements. Nitrogen was used as the carrier gas to avoid quenching of the phosphorescent radiation of the tracer gas biacetyl by ambient oxygen. The use of sulfur dioxide to sensitize phosphorescent emission of biacetyl was examined. Preliminary data was used in a discussion of the potential of the LIPA technique.

Falco, R. E.↗
NASA NTRS2006

2D/3D Visual Tracker for Rover Mast

A visual-tracker computer program controls an articulated mast on a Mars rover to keep a designated feature (a target) in view while the rover drives toward the target, avoiding obstacles. Several prior visual-tracker programs have been tested on rover platforms; most require very small and well-estimated motion between consecutive image frames a requirement that is not realistic for a rover on rough terrain. The present visual-tracker program is designed to handle large image motions that lead to significant changes in feature geometry and photometry between frames. When a point is selected in one of the images acquired from stereoscopic cameras on the mast, a stereo triangulation algorithm computes a three-dimensional (3D) location for the target. As the rover moves, its body-mounted cameras feed images to a visual-odometry algorithm, which tracks two-dimensional (2D) corner features and computes their old and new 3D locations. The algorithm rejects points, the 3D motions of which are inconsistent with a rigid-world constraint, and then computes the apparent change in the rover pose (i.e., translation and rotation). The mast pan and tilt angles needed to keep the target centered in the field-of-view of the cameras (thereby minimizing the area over which the 2D-tracking algorithm must operate) are computed from the estimated change in the rover pose, the 3D position of the target feature, and a model of kinematics of the mast. If the motion between the consecutive frames is still large (i.e., 3D tracking was unsuccessful), an adaptive view-based matching technique is applied to the new image. This technique uses correlation-based template matching, in which a feature template is scaled by the ratio between the depth in the original template and the depth of pixels in the new image. This is repeated over the entire search window and the best correlation results indicate the appropriate match. The program could be a core for building application programs for systems that require coordination of vision and robotic motion.

Bajracharya, Max↗
NASA NTRS2011

Enabling Disabled Persons to Gain Access to Digital Media

A report describes the first phase in an effort to enhance the NaviGaze software to enable profoundly disabled persons to operate computers. (Running on a Windows-based computer equipped with a video camera aimed at the user s head, the original NaviGaze software processes the user's head movements and eye blinks into cursor movements and mouse clicks to enable hands-free control of the computer.) To accommodate large variations in movement capabilities among disabled individuals, one of the enhancements was the addition of a graphical user interface for selection of parameters that affect the way the software interacts with the computer and tracks the user s movements. Tracking algorithms were improved to reduce sensitivity to rotations and reduce the likelihood of tracking the wrong features. Visual feedback to the user was improved to provide an indication of the state of the computer system. It was found that users can quickly learn to use the enhanced software, performing single clicks, double clicks, and drags within minutes of first use. Available programs that could increase the usability of NaviGaze were identified. One of these enables entry of text by using NaviGaze as a mouse to select keys on a virtual keyboard.

Beach, Glenn↗
NASA NTRS1989

Scientific visualization in computational aerodynamics at NASA Ames Research Center

The visualization methods used in computational fluid dynamics research at the NASA-Ames Numerical Aerodynamic Simulation facility are examined, including postprocessing, tracking, and steering methods. The visualization requirements of the facility's three-dimensional graphical workstation are outlined and the types hardware and software used to meet these requirements are discussed. The main features of the facility's current and next-generation workstations are listed. Emphasis is given to postprocessing techniques, such as dynamic interactive viewing on the workstation and recording and playback on videodisk, tape, and 16-mm film. Postprocessing software packages are described, including a three-dimensional plotter, a surface modeler, a graphical animation system, a flow analysis software toolkit, and a real-time interactive particle-tracer.

Bancroft, Gordon V.↗
NASA NTRS1998

Pursuit Eye Movements

When viewing objects, primates use a combination of saccadic and pursuit eye movements to stabilize the retinal image of the object of regard within the high-acuity region near the fovea. Although these movements involve widespread regions of the nervous system, they mix seamlessly in normal behavior. Saccades are discrete movements that quickly direct the eyes toward a visual target, thereby translating the image of the target from an eccentric retinal location to the fovea. In contrast, pursuit is a continuous movement that slowly rotates the eyes to compensate for the motion of the visual target, minimizing the blur that can compromise visual acuity. While other mammalian species can generate smooth optokinetic eye movements - which track the motion of the entire visual surround - only primates can smoothly pursue a single small element within a complex visual scene, regardless of the motion elsewhere on the retina. This ability likely reflects the greater ability of primates to segment the visual scene, to identify individual visual objects, and to select a target of interest.

Krauzlis, Rich↗
NASA NTRS1990

Workload and strategic adaptation under transformations of visual-coordinative mappings

A study involving a bimanual pursuit-tracking task is conducted to examine strategic exploration of differing visual and motor coordination patterns emphasizing workload as an indicator of strategic behavior. The mappings are conducted for 16 possible variations of order, speed, and combination. Performance is assessed by means of the rms and percent time-on-target, and the NASA task-load index is used to classify subjective reports on workload. The results are broken down into four primary performance mappings and four hybrid mappings called contradictory conditions. The order of difficulty of the conditions is apparently determined by the workload, except that in the case of the three most difficult decoupled conditions some dissociation is reported.

Caird, J. K.↗