Results for “teleoperations” — Page 15

NASA NTRS1992

A procedure for the frequency analysis of telerobotic tasks data

In the last few years, teleoperated tasks have been the subject of extensive research to determine the best combination of control modalities according to specific criteria. The operator's performance were compared on the basis of task completion time and of force and torque measurements during the tasks. This paper proposes a procedure for the spectral analysis of force and torque signals generated during teleoperation experiments. There are two main reasons for examining teleoperation data in the frequency domain: a spectral analysis of different tasks can validate the assumptions made in the design of the teleoperator, and a task's frequency signature can be a valuable measure of the operator's performance.

Fiorini, Paolo↗

NASA NTRS1991

Human factors requirements for telerobotic command and control: The European Space Agency experimental programme

Space Telerobotics research, performed under contract to the European Space Agency (ESA), concerning the execution of human factors experiments, and ultimately leading to the development of a telerobotics test bed, has been carried out since 1985 by a British Consortium consisting of British Aerospace, the United Kingdom Atomic Energy Authority and, more recently, the UK National Advanced Robotics Research Centre. The principal aim of the first study of the series was to derive preliminary requirements for a teleoperation servicing system, with reference to two mission model scenarios. The first scenario introduced the problem of communications time delays, and their likely effect on the ground-based operator in control of a manipulator system on board an unmanned servicing vehicle in Low Earth Orbit. In the second scenario, the operator was located on the NASA Orbiter aft flight deck, supervising the control of a prototype manipulator in the 'servicing' of an experimental payload in the cargo bay area. Human factors analyses centered on defining the requirements for the teleoperator workstation, such as identifying basic ergonomic requirements for workstation and panel layouts, defining teleoperation strategies, developing alphanumeric and graphic screen formats for the supervision or direct control of the manipulator, and the potential applications of expert system technology. The second study for ESA involved an experimental appraisal of some of the important issues highlighted in the first study, for which relevant human factors data did not exist. Of central importance during the second study was the issue of communications time delays and their effect on the manual control of a teleoperated manipulator from a ground-based command and control station.

Stone, Robert J.↗

NASA NTRS1997

Applying Space Technology to Enhance Control of an Artificial Arm

At the present time, myoelectric prostheses perform only one function of the hand: open and close with the thumb, index and middle finger coming together to grasp various shaped objects. To better understand the limitations of the current single-function prostheses and the needs of the individuals who use them, The Institute for Rehabilitation and Research (TIRR), sponsored by the National Institutes of Health (August 1992 - November 1994), surveyed approximately 2500 individuals with upper limb loss. When asked to identify specific features of their current electric prosthesis that needed improvement, the survey respondents overwhelmingly identified the lack of wrist and finger movement as well as poor control capability. Simply building a mechanism with individual finger and wrist motion is not enough. Individuals with upper limb loss tend to reject prostheses that require continuous visual monitoring and concentration to control. Robotics researchers at NASA's Johnson Space Center (JSC) and Rice University have made substantial progress in myoelectric teleoperation. A myoelectric teleoperation system translates signals generated by an able-bodied robot operator's muscles during hand motions into commands that drive a robot's hand through identical motions. Farry's early work in myoelectric teleoperation used variations over time in the myoelectric spectrum as inputs to neural networks to discriminate grasp types and thumb motions. The resulting schemes yielded up to 93% correct classification on thumb motions. More recently, Fernandez achieved 100% correct non-realtime classification of thumb abduction, extension, and flexion on the same myoelectric data. Fernandez used genetic programming to develop functions that discriminate between thumb motions using myoelectric signal parameters. Genetic programming (GP) is an evolutionary programming method where the computer can modify the discriminating functions' form to improve its performance, not just adjust numerical coefficients or weights. Although the function development may require much computational time and many training cases, the resulting discrimination functions can run in realtime on modest computers. These results suggest that myoelectric signals might be a feasible teleoperation medium, allowing an operator to use his or her own hand and arm as a master to intuitively control an anthropomorphic robot in a remote location such as outer space.

Atkins, Diane↗

NASA NTRS2014

Human-Robot Interaction Directed Research Project

Human-robot interaction (HRI) is a discipline investigating the factors affecting the interactions between humans and robots. It is important to evaluate how the design of interfaces and command modalities affect the human's ability to perform tasks accurately, efficiently, and effectively when working with a robot. By understanding the effects of interface design on human performance, workload, and situation awareness, interfaces can be developed to appropriately support the human in performing tasks with minimal errors and with appropriate interaction time and effort. Thus, the results of research on human-robot interfaces have direct implications for the design of robotic systems. This DRP concentrates on three areas associated with interfaces and command modalities in HRI which are applicable to NASA robot systems: 1) Video Overlays, 2) Camera Views, and 3) Command Modalities. The first study focused on video overlays that investigated how Augmented Reality (AR) symbology can be added to the human-robot interface to improve teleoperation performance. Three types of AR symbology were explored in this study, command guidance (CG), situation guidance (SG), and both (SCG). CG symbology gives operators explicit instructions on what commands to input, whereas SG symbology gives operators implicit cues so that operators can infer the input commands. The combination of CG and SG provided operators with explicit and implicit cues allowing the operator to choose which symbology to utilize. The objective of the study was to understand how AR symbology affects the human operator's ability to align a robot arm to a target using a flight stick and the ability to allocate attention between the symbology and external views of the world. The study evaluated the effects type of symbology (CG and SG) has on operator tasks performance and attention allocation during teleoperation of a robot arm. The second study expanded on the first study by evaluating the effects of the type of navigational guidance (CG and SG) on operator task performance and attention allocation during teleoperation of a robot arm through uplinked commands. Although this study complements the first study on navigational guidance with hand controllers, it is a separate investigation due to the distinction in intended operators (i.e., crewmembers versus ground-operators). A third study looked at superimposed and integrated overlays for teleoperation of a mobile robot using a hand controller. When AR is superimposed on the external world, it appears to be fixed onto the display and internal to the operators' workstation. Unlike superimposed overlays, integrated overlays often appear as three-dimensional objects and move as if part of the external world. Studies conducted in the aviation domain show that integrated overlays can improve situation awareness and reduce the amount of deviation from the optimal path. The purpose of the study was to investigate whether these results apply to HRI tasks, such as navigation with a mobile robot. HRP GAPS This HRI research contributes to closure of HRP gaps by providing information on how display and control characteristics - those related to guidance, feedback, and command modalities - affect operator performance. The overarching goals are to improve interface usability, reduce operator error, and develop candidate guidelines to design effective human-robot interfaces.

Sandor, Aniko↗

NASA NTRS2014

Human-Robot Interaction Directed Research Project

Human-robot interaction (HRI) is a discipline investigating the factors affecting the interactions between humans and robots. It is important to evaluate how the design of interfaces and command modalities affect the human's ability to perform tasks accurately, efficiently, and effectively when working with a robot. By understanding the effects of interface design on human performance, workload, and situation awareness, interfaces can be developed to appropriately support the human in performing tasks with minimal errors and with appropriate interaction time and effort. Thus, the results of research on human-robot interfaces have direct implications for the design of robotic systems. This DRP concentrates on three areas associated with interfaces and command modalities in HRI which are applicable to NASA robot systems: 1) Video Overlays, 2) Camera Views, and 3) Command Modalities. The first study focused on video overlays that investigated how Augmented Reality (AR) symbology can be added to the human-robot interface to improve teleoperation performance. Three types of AR symbology were explored in this study, command guidance (CG), situation guidance (SG), and both (SCG). CG symbology gives operators explicit instructions on what commands to input, whereas SG symbology gives operators implicit cues so that operators can infer the input commands. The combination of CG and SG provided operators with explicit and implicit cues allowing the operator to choose which symbology to utilize. The objective of the study was to understand how AR symbology affects the human operator's ability to align a robot arm to a target using a flight stick and the ability to allocate attention between the symbology and external views of the world. The study evaluated the effects type of symbology (CG and SG) has on operator tasks performance and attention allocation during teleoperation of a robot arm. The second study expanded on the first study by evaluating the effects of the type of navigational guidance (CG and SG) on operator task performance and attention allocation during teleoperation of a robot arm through uplinked commands. Although this study complements the first study on navigational guidance with hand controllers, it is a separate investigation due to the distinction in intended operators (i.e., crewmembers versus ground-operators). A third study looked at superimposed and integrated overlays for teleoperation of a mobile robot using a hand controller. When AR is superimposed on the external world, it appears to be fixed onto the display and internal to the operators' workstation. Unlike superimposed overlays, integrated overlays often appear as three-dimensional objects and move as if part of the external world. Studies conducted in the aviation domain show that integrated overlays can improve situation awareness and reduce the amount of deviation from the optimal path. The purpose of the study was to investigate whether these results apply to HRI tasks, such as navigation with a mobile robot.

Sandor, Aniko↗

NASA NTRS2015

Human-Robot Interaction

Human-robot interaction (HRI) is a discipline investigating the factors affecting the interactions between humans and robots. It is important to evaluate how the design of interfaces affect the human's ability to perform tasks effectively and efficiently when working with a robot. By understanding the effects of interface design on human performance, workload, and situation awareness, interfaces can be developed to appropriately support the human in performing tasks with minimal errors and with appropriate interaction time and effort. Thus, the results of research on human-robot interfaces have direct implications for the design of robotic systems. For efficient and effective remote navigation of a rover, a human operator needs to be aware of the robot's environment. However, during teleoperation, operators may get information about the environment only through a robot's front-mounted camera causing a keyhole effect. The keyhole effect reduces situation awareness which may manifest in navigation issues such as higher number of collisions, missing critical aspects of the environment, or reduced speed. One way to compensate for the keyhole effect and the ambiguities operators experience when they teleoperate a robot is adding multiple cameras and including the robot chassis in the camera view. Augmented reality, such as overlays, can also enhance the way a person sees objects in the environment or in camera views by making them more visible. Scenes can be augmented with integrated telemetry, procedures, or map information. Furthermore, the addition of an exocentric (i.e., third-person) field of view from a camera placed in the robot's environment may provide operators with the additional information needed to gain spatial awareness of the robot. Two research studies investigated possible mitigation approaches to address the keyhole effect: 1) combining the inclusion of the robot chassis in the camera view with augmented reality overlays, and 2) modifying the camera frame of reference. The first study investigated the effects of inclusion and exclusion of the robot chassis along with superimposing a simple arrow overlay onto the video feed of operator task performance during teleoperation of a mobile robot in a driving task. In this study, the front half of the robot chassis was made visible through the use of three cameras, two side-facing and one forward-facing. The purpose of the second study was to compare operator performance when teleoperating a robot from an egocentric-only and combined (egocentric plus exocentric camera) view. Camera view parameters that are found to be beneficial in these laboratory experiments can be implemented on NASA rovers and tested in a real-world driving and navigation scenario on-site at the Johnson Space Center.

Sandor, Aniko↗

NASA NTRS2022

Cockpit Interface for Locomotion and Manipulation Control of the NASA Valkyrie Humanoid in Virtual Reality (VR)

A virtual reality (VR) interface is presented for controlling NASA’s Valkyrie humanoid robot with flexible locomotion control options and intuitive teleoperation. Locomotion modes include navigating to a specified waypoint, sending desired velocities with a joystick, or manually placing a sequence of footsteps. On the other hand, teleoperation modes include voice commands to toggle relative whole-body tracking or high-level commandeering, and key bindings for common stored poses such as power grasps. The primary novelties of the interface are in the implementation of the cockpit mode and a floating augmented reality (AR) screen fixed with respect to the robot. The former enables embodied teleoperation and increased awareness during navigation in a mixed-reality setting. The latter preserves depth perception without the disparity clutter from a stereo point cloud. The interface is demonstrated on two real humanoids performing common explosive ordnance disposal (EOD) tasks such as door opening, vehicle inspection, and disruptor placement. Notably, the interface enables a single operator to control multiple humanoids. While the interface is motivated by EOD missions, the presented ideas are usable for other robots employing VR-based control.

Virtual-reality↗

NASA NTRS1973

Remotely manned systems: Exploration and operation in space; Proceedings of the First National Conference, California Institute of Technology, Pasadena, Calif., September 13-15, 1972.

Free-flying teleoperator systems are discussed, giving attention to earth-orbit mission considerations and Space Tug requirements, free-flying teleoperator requirements and conceptual design, system requirements for a free-flying teleoperator to despin, and the experimental evaluation of remote manipulator systems. Shuttle-Attached Manipulator Systems are considered, together with remote surface vehicle systems, manipulator systems technology, remote sensor and display technology, the man-machine interface, and control and machine intelligence. Nonspace applications are also explored, taking into account implications of nonspace applications, naval applications of remote manipulators, and hand tools and mechanical accessories for a deep submersible. Individual items are announced in this issue.

Heer, E.↗

NASA NTRS1975

Selected time delay data, phase 3

The results of a study on time delays in communication systems applicable to the teleoperator program are presented. Time delay data for 11 specific orbits of interest are shown. These data can be used in the MSFC teleoperator simulator to investigate the effect of time delays in the communications link on the teleoperator control functions.

Walsh, J. R.↗

NASA NTRS1989

Traction-drive force transmission for telerobotic joints

A mechanism which meets the requirements of a teleoperated manipulator and those of an autonomous robot is discussed. The mechanism is a traction-drive differential that uses variable preload mechanisms. The differential provides compact design, with dextrous motion range and torque density similar to geared systems. The traction drive offers high stiffness to backlash for good robotic performance. The variable-loading mechanism (VLM) minimizes the drive-train friction for improved teleoperation. This combination provides a mechanism to allow advanced manipulation with either teleoperated control or autonomous robotic operation. The design principles of both major components of the joint mechanism are described.

Williams, D. M.↗

NASA NTRS1987

Man-machine interface issues in space telerobotics: A JPL research and development program

Technology issues related to the use of robots as man-extension or telerobot systems in space are discussed and exemplified. General considerations are presentd on control and information problems in space teleoperation and on the characteristics of Earth orbital teleoperation. The JPL R and D work in the area of man-machine interface devices and techniques for sensing and computer-based control is briefly summarized. The thrust of this R and D effort is to render space teleoperation efficient and safe through the use of devices and techniques which will permit integrated and task-level (intelligent) two-way control communication between human operator and telerobot machine in Earth orbit. Specific control and information display devices and techniques are discussed and exemplified with development results obtained at JPL in recent years.

Bejczy, A. K.↗

NASA NTRS1987

MIT research in telerobotics

Ongoing MIT research in telerobotics (vehicles capable of some autonomous sensing and manipulating, having some remote supervisory control by people) and teleoperation (vehicles for sensing and manipulating which are fully controlled remotely by people) is discussed. The current efforts mix human and artificial intelligence/control. The idea of adjustable impedance at either end of pure master-slave teleoperation, and simultaneous coordinated control of teleoperator/telerobotic systems which have more than six degrees of freedom (e.g., a combined vehicle and arm, each with five or six DOF) are discussed. A new cable-controlled parallel link arm which offers many advantages over conventional arms for space is briefly described. Predictor displays to compensate for time delay in teleoperator loops, the use of state estimation to help human control decisions in space, and ongoing research in supervisory command language are covered. Finally, efforts to build a human flyable real-time dynamic computer-graphic telerobot simulator are described. These projects represent most, but not all, of the telerobotics research in our laboratory, supported by JPL, NASA Ames and NOAA.

Sheridan, T. B.↗

NASA NTRS1989

Telerobotic research for in-space structural assembly and servicing

The paper reviews Langley's Telerobotic Technology Program and the recent and planned research in automated space assembly. Research areas include multiple manipulator coordination and control, automatic modes, evaluation of control modalities for teleoperated tasks, active sensing for world modeling and control, and architectures for distributed telerobotic systems. Studies of master/slave teleoperators performing representative space tasks showed that current teleoperator systems can be used to accomplish remote space operations. These studies also identified that research is required to improve the systems to reduce operator workload and task completion time. Closed-loop noncontact and contact sensor based control for automatic acquisition, positioning, and active compliance have been developed. A control structure for multiple manipulator coordination and control with manual, shared, and automatic modes performing space type tasks is being evaluated.

Meintel, Alfred J., Jr.↗

NASA NTRS1989

Telepresence, time delay, and adaptation

Displays are now being used extensively throughout the society. More and more time is spent watching television, movies, computer screens, etc. Furthermore, in an increasing number of cases, the observer interacts with the display and plays the role of operator as well as observer. To a large extent, the normal behavior in the normal environment can also be thought of in these same terms. Taking liberties with Shakespeare, it might be said, all the world's a display and all the individuals in it are operators in and on the display. Within this general context of interactive display systems, a discussion is began with a conceptual overview of a particular class of such systems, namely, teleoperator systems. The notion is considered of telepresence and the factors that limit telepresence, including decorrelation between the: (1) motor output of the teleoperator as sensed directly via the kinesthetic/tactual system, and (2) the motor output of the teleoperator as sensed indirectly via feedback from the slave robot, i.e., via a visual display of the motor actions of the slave robot. Finally, the deleterious effect of time delay (a particular decorrelation) on sensory-motor adaptation (an important phenomenon related to telepresence) is examined.

Held, Richard↗

NASA NTRS1993

Comparison Of Telerobot Control Modes

Report presents evaluation of three different modes of telerobot control: teleoperation with position control only; teleoperation with force reflection; and teleoperation with shared control, in which operator controls some elements of task while autonomous system controls other elements of task. Evaluation involved experiments in which nine trained operators used telerobot system to perform tasks of increasing difficulty - removal and insertion of electrical connector, removal and insertion of orbital replacement unit, and removal and insertion of electronic-circuit board in electronic chassis.

Zimmerman, Wayne F.↗

NASA NTRS1992

Exoskeleton master controller with force-reflecting telepresence

A thorough understanding of the requirements for successful master-slave robotic systems is becoming increasingly desirable. Such systems can aid in the accomplishment of tasks that are hazardous or inaccessible to humans. Although a history of use has proven master-slave systems to be viable, system requirements and the impact of specifications on the human factors side of system performance are not well known. In support of the next phase of teleoperation research being conducted at the Armstrong Research Laboratory, a force-reflecting, seven degree of freedom exoskeleton for master-slave teleoperation has been concepted, and is presently being developed. The exoskeleton has a unique kinematic structure that complements the structure of the human arm. It provides a natural means for teleoperating a dexterous, possibly redundant manipulator. It allows ease of use without operator fatigue and faithfully follows human arm and wrist motions. Reflected forces and moments are remotely transmitted to the operator hand grip using a cable transmission scheme. This paper presents the exoskeleton concept and development results to date. Conceptual design, hardware, algorithms, computer architecture, and software are covered.

Burke, James B.↗

NASA NTRS1991

Fusing human and machine skills for remote robotic operations

The question of how computer assists can improve teleoperator trajectory tracking during both free and force-constrained motions is addressed. Computer graphics techniques which enable the human operator to both visualize and predict detailed 3D trajectories in real-time are reported. Man-machine interactive control procedures for better management of manipulator contact forces and positioning are also described. It is found that collectively, these novel advanced teleoperations techniques both enhance system performance and significantly reduce control problems long associated with teleoperations under time delay. Ongoing robotic simulations of the 1984 space shuttle Solar Maximum EVA Repair Mission are briefly described.

Schenker, Paul S.↗

NASA NTRS1993

International testing of a Mars rover prototype

Tests on a prototype engineering model of the Russian Mars 96 Rover were conducted by an international team in and near Death Valley in the United States in late May, 1992. These tests were part of a comprehensive design and testing program initiated by the three Russian groups responsible for the rover development. The specific objectives of the May tests were: (1) evaluate rover performance over different Mars-like terrains; (2) evaluate state-of-the-art teleoperation and autonomy development for Mars rover command, control and navigation; and (3) organize an international team to contribute expertise and capability on the rover development for the flight project. The range and performance that can be planned for the Mars mission is dependent on the degree of autonomy that will be possible to implement on the mission. Current plans are for limited autonomy, with Earth-based teleoperation for the nominal navigation system. Several types of television systems are being investigated for inclusion in the navigation system including panoramic camera, stereo, and framing cameras. The tests used each of these in teleoperation experiments. Experiments were included to consider use of such TV data in autonomy algorithms. Image processing and some aspects of closed-loop control software were also tested. A micro-rover was tested to help consider the value of such a device as a payload supplement to the main rover. The concept is for the micro-rover to serve like a mobile hand, with its own sensors including a television camera.

Kemurjian, Alexsandr Leonovich↗