Engineering PapersSearch

Engineering topics

Stark, Lawrence

Publications and source records attributed to Stark, Lawrence.

At least 19 records

Three dimensional tracking with misalignment between display and control axes

Human operators confronted with misaligned display and control frames of reference performed three dimensional, pursuit tracking in virtual environment and virtual space simulations. Analysis of the components of the tracking errors in the perspective displays presenting virtual space showed that components of the error due to visual motor misalignment may be linearly separated from those associated with the mismatch between display and control coordinate systems. Tracking performance improved with several hours practice despite previous reports that such improvement did not take place.

Ellis, Stephen R.

Depth cue interaction in telepresence and simulated telemanipulation

We examined the contribution of two important depth cues, occlusion and disparity, on the performance of a simulated telerobotic task. We have simulated a three-axis tracking task that is viewed under four different levels of realism. We hoped to determine if the combined presentation of the depth cues has a more beneficial effect on performance than either depth cue presented singularly. Results showed similar performance improvements with the presentation of occlusion or disparity individually. When both cues were present together, a somewhat larger performance improvement was measured.

Liu, Andrew

Timing considerations of Helmet Mounted Display performance

The Helmet Mounted Display (HMD) system developed in our lab should be a useful teleoperator systems display if it increases operator performance of the desired task; it can, however, introduce degradation in performance due to display update rate constraints and communication delays. Display update rates are slowed by communication bandwidth and/or computational power limitations. We used simulated 3D tracking and pick-and-place tasks to characterize performance levels for a range of update rates. Initial experiments with 3D tracking indicate that performance levels plateau at an update rate between 10 and 20 Hz. We have found that using the HMD with delay decreases performance as delay increases.

Tharp, Gregory

Three-dimensional tracking with misalignment between display and control axes

Consideration is given to experiments for examining 3D pursuit tracking when operators of teleoperation simulations are faced with misalignment between the display and control frames of reference. It is concluded that manual 3D pursuit tracking errors produced by display-control rotational misalignments have two linearly separable components: a purely visual component and a visual-motor component. Both components may independently influence the tracking performance. Human subjects can simultaneously adapt to a variety of display-control misalignments if position control during pursuit tracking is used with a simulation update rate of at least 30 Hz. This capability will enable trained operators to quickly adapt to changes in the position and orientation of viewing cameras during teleoperation and telemanipulation.

Ellis, Stephen R.

The effect of monocular target blur on simulated telerobotic manipulation

A simulation involving three types of telerobotic tasks that require information about the spatial position of objects is reported. This is similar to the results of psychophysical experiments examining the effect of blur on stereoacuity. It is suggested that other psychophysical experimental results could be used to predict operator performance for other telerobotic tasks. It is demonstrated that refractive errors in the helmet-mounted stereo display system can affect performance in the three types of telerobotic tasks. The results of two sets of experiments indicate that monocular target blur of two diopters or more degrades stereo display performance to the level of monocular displays. This indicates that moderate levels of visual degradation that affect the operator's stereoacuity may eliminate the performance advantage of stereo displays.

Liu, Andrew

Development of visual 3D virtual environment for control software

Virtual environments for software visualization may enable complex programs to be created and maintained. A typical application might be for control of regional electric power systems. As these encompass broader computer networks than ever, construction of such systems becomes very difficult. Conventional text-oriented environments are useful in programming individual processors. However, they are obviously insufficient to program a large and complicated system, that includes large numbers of computers connected to each other; such programming is called 'programming in the large.' As a solution for this problem, the authors are developing a graphic programming environment wherein one can visualize complicated software in virtual 3D world. One of the major features of the environment is the 3D representation of concurrent process. 3D representation is used to supply both network-wide interprocess programming capability (capability for 'programming in the large') and real-time programming capability. The authors' idea is to fuse both the block diagram (which is useful to check relationship among large number of processes or processors) and the time chart (which is useful to check precise timing for synchronization) into a single 3D space. The 3D representation gives us a capability for direct and intuitive planning or understanding of complicated relationship among many concurrent processes. To realize the 3D representation, a technology to enable easy handling of virtual 3D object is a definite necessity. Using a stereo display system and a gesture input device (VPL DataGlove), our prototype of the virtual workstation has been implemented. The workstation can supply the 'sensation' of the virtual 3D space to a programmer. Software for the 3D programming environment is implemented on the workstation. According to preliminary assessments, a 50 percent reduction of programming effort is achieved by using the virtual 3D environment. The authors expect that the 3D environment has considerable potential in the field of software engineering.

Hirose, Michitaka

A helmet mounted display to adapt the telerobotic environment to human vision

A Helmet Mounted Display system has been developed. It provides the capability to display stereo images with the viewpoint tied to subjects' head orientation. The type of display might be useful in a telerobotic environment provided the correct operating parameters are known. The effects of update frequency were tested using a 3D tracking task. The effects of blur were tested using both tracking and pick-and-place tasks. For both, researchers found that operator performance can be degraded if the correct parameters are not used. Researchers are also using the display to explore the use of head movements as part of gaze as subjects search their visual field for target objects.

Tharp, Gregory

Instrumentation and robotic image processing using top-down model control

A top-down image processing scheme is described. A three-dimensional model of a robotic working environment, with robot manipulators, workpieces, cameras, and on-the-scene visual enhancements is employed to control and direct the image processing, so that rapid, robust algorithms act in an efficient manner to continually update the model. Only the model parameters are communicated, so that savings in bandwidth are achieved. This image compression by modeling is especially important for control of space telerobotics. The background for this scheme lies in an hypothesis of human vision put forward by the senior author and colleagues almost 20 years ago - the Scanpath Theory. Evidence was obtained that repetitive sequences of saccadic eye movements, the scanpath, acted as the checking phase of visual pattern recognition. Further evidence was obtained that the scanpaths were apparently generated by a cognitive model and not directly by the visual image. This top-down theory of human vision was generalized in some sense to the frame in artificial intelligence. Another source of the concept arose from bioengineering instrumentation for measuring the pupil and eye movements with infrared video cameras and special-purpose hardware.

Stark, Lawrence

Visual enhancements in pick-and-place tasks: Human operators controlling a simulated cylindrical manipulator

A teleoperation simulator was constructed with vector display system, joysticks, and a simulated cylindrical manipulator, in order to quantitatively evaluate various display conditions. The first of two experiments conducted investigated the effects of perspective parameter variations on human operators' pick-and-place performance, using a monoscopic perspective display. The second experiment involved visual enhancements of the monoscopic perspective display, by adding a grid and reference lines, by comparison with visual enhancements of a stereoscopic display; results indicate that stereoscopy generally permits superior pick-and-place performance, but that monoscopy nevertheless allows equivalent performance when defined with appropriate perspective parameter values and adequate visual enhancements.

Kim, Won S.

The 3D model control of image processing

Telerobotics studies remote control of distant robots by a human operator using supervisory or direct control. Even if the robot manipulators has vision or other senses, problems arise involving control, communications, and delay. The communication delays that may be expected with telerobots working in space stations while being controlled from an Earth lab have led to a number of experiments attempting to circumvent the problem. This delay in communication is a main motivating factor in moving from well understood instantaneous hands-on manual control to less well understood supervisory control; the ultimate step would be the realization of a fully autonomous robot. The 3-D model control plays a crucial role in resolving many conflicting image processing problems that are inherent in resolving in the bottom-up approach of most current machine vision processes. The 3-D model control approach is also capable of providing the necessary visual feedback information for both the control algorithms and for the human operator.

Nguyen, An H.

Telerobotics - Problems and research needs

With major emphasis on simulation, a university laboratory telerobotics facility permits problems to be approached by groups of graduate students. Helmet-mounded displays provide realism; the slaving of the display to the human operator's viewpoint gives a sense of 'telepresence' that may be useful for prolonged tasks. Using top-down three-dimensional model control of distant images allows distant images to be reduced to a few parameters to update the model used for display to the human operator in a preview mode to circumvent, in part, the communication delay. Also, the model can be used as a format for supervisory control and permit short-term local autonomous operations. Image processing algorithms can be made simpler and faster without trying to construct sensible images from the bottom. Control studies of telerobots lead to preferential manual control modes and basic paradigms for human motion and thence, perhaps, to redesign of robotic control, trajectory path planning, and rehabilitation prosthetics.

Stark, Lawrence

Telerobotics - Display, control, and communication problems

An experimental telerobotics simulation is described suitable for studying human operator (HO) performance. Simple manipulator pick-and-place and tracking tasks allowed quantitative comparison of a number of calligraphic display viewing conditions. An enhanced perspective display was effective with a reference line from target to base, with or without a complex three-dimensional grid framing the view. This was true especially if geometrical display parameters such as azimuth and elevation were arranged to be near optimal. Quantitative comparisons were made possible, utilizing control performance measures such as root mean square error. There was a distinct preference for controlling the manipulator in end-effector Cartesian space for the primitive pick-and-place task, rather than controlling joint angles and then, via direct kinematis, the end-effector position. An introduced communication delay was found to produce decrease in performance. In considerable part, this difficulty could be compensated for by preview control information. The fact that neurological control of normal human movement contains a sampled data period of 0.2 s may relate to this robustness of HO control to delay.

Stark, Lawrence

A new quantitative indicator of visual fatigue

Ocular-motor correlates of visual fatigue have remained elusive. Performance of ocular-motor tracking with a wide-band white noise input and the response of the dual-mode, smooth pursuit-saccadic eye movement system as output was used to test visual fatigue. A new visual fatigue indicator, VFI, was defined as the nonlinear remnant after subtracting an identified impulse response contribution to the output. Subjects were required to perform very fatiguing CRT screen reading tasks, and the VFI correlated well with the subjective reports of visual fatigue.

Goussard, Yves

A university teaching simulation facility

An experimental telerobotics (TR) simulation is described suitable for studying human operator (HO) performance. Simple manipulator pick-and-place and tracking tasks allowed quantitative comparison of a number of calligraphic display viewing conditions. A number of control modes could be compared in this TR simulation, including displacement, rate, and acceleratory control using position and force joysticks. A homeomorphic controller turned out to be no better than joysticks; the adaptive properties of the HO can apparently permit quite good control over a variety of controller configurations and control modes. Training by optimal control example seemed helpful in preliminary experiments.

Stark, Lawrence

Statistical dependency in visual scanning

A method to identify statistical dependencies in the positions of eye fixations is developed and applied to eye movement data from subjects who viewed dynamic displays of air traffic and judged future relative position of aircraft. Analysis of approximately 23,000 fixations on points of interest on the display identified statistical dependencies in scanning that were independent of the physical placement of the points of interest. Identification of these dependencies is inconsistent with random-sampling-based theories used to model visual search and information seeking.

Ellis, Stephen R.