Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Robonaut”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Development of Methodologies, Metrics, and Tools for Investigating Human-Robot Interaction in Space Robotics

Human-robot systems are expected to have a central role in future space exploration missions that extend beyond low-earth orbit [1]. As part of a directed research project funded by NASA s Human Research Program (HRP), researchers at the Johnson Space Center have started to use a variety of techniques, including literature reviews, case studies, knowledge capture, field studies, and experiments to understand critical human-robot interaction (HRI) variables for current and future systems. Activities accomplished to date include observations of the International Space Station s Special Purpose Dexterous Manipulator (SPDM), Robonaut, and Space Exploration Vehicle (SEV), as well as interviews with robotics trainers, robot operators, and developers of gesture interfaces. A survey of methods and metrics used in HRI was completed to identify those most applicable to space robotics. These methods and metrics included techniques and tools associated with task performance, the quantification of human-robot interactions and communication, usability, human workload, and situation awareness. The need for more research in areas such as natural interfaces, compensations for loss of signal and poor video quality, psycho-physiological feedback, and common HRI testbeds were identified. The initial findings from these activities and planned future research are discussed. Human-robot systems are expected to have a central role in future space exploration missions that extend beyond low-earth orbit [1]. As part of a directed research project funded by NASA s Human Research Program (HRP), researchers at the Johnson Space Center have started to use a variety of techniques, including literature reviews, case studies, knowledge capture, field studies, and experiments to understand critical human-robot interaction (HRI) variables for current and future systems. Activities accomplished to date include observations of the International Space Station s Special Purpose Dexterous Manipulator (SPDM), Robonaut, and Space Exploration Vehicle (SEV), as well as interviews with robotics trainers, robot operators, and developers of gesture interfaces. A survey of methods and metrics used in HRI was completed to identify those most applicable to space robotics. These methods and metrics included techniques and tools associated with task performance, the quantification of human-robot interactions and communication, usability, human workload, and situation awareness. The need for more research in areas such as natural interfaces, compensations for loss of signal and poor video quality, psycho-physiological feedback, and common HRI testbeds were identified. The initial findings from these activities and planned future research are discussed.

Ezer, Neta↗

Robots Spur Software That Lends a Hand

While building a robot to assist astronauts in space, Johnson Space Center worked with partners to develop robot reasoning and interaction technology. The partners created Robonaut 1, which led to Robonaut 2, and the work also led to patents now held by Universal Robotics in Nashville, Tennessee. The NASA-derived technology is available for use in warehousing, mining, and more.

Source record↗

Collaborative Autonomous Logistics

This video shows a demonstration of collaborative autonomous logistics. Turtlebot, a 1-g stand-in for Astrobee, carried REALM sensors around a mockup of ISS in ARGOS to autonomously survey for a cargo bag stowed in a drawer. It provided the location of the bag to Robonaut, which then autonomously climbed across the mockup to the drawer. Robonaut then used the Affordance Template manipulation framework to localize and open the drawer and then again localize and retrieve the cargo bag.

Badger, Julia M.↗

NASA Vision

Contents include the following: Administrator O'Keefe addresses NASA's return to flight. New independent engineering and safety center. Around the centers. NASA and your library: local libraries making room for space. Robonaut: the next generation. Inspiring the next generation ... of Hispanics. NASA and teachers focus on parks. GSFC director gives keynote address. Agency honor awards. Summer interns join the NASA team. Catching a comet's tail in Earth's atmosphere.

Fenton, Mary↗

Robot Behavior Acquisition Superposition and Composting of Behaviors Learned through Teleoperation

Superposition of a small set of behaviors, learned via teleoperation, can lead to robust completion of a simple articulated reach-and-grasp task. Results support the hypothesis that a set of learned behaviors can be combined to generate new behaviors of a similar type. This supports the hypothesis that a robot can learn to interact purposefully with its environment through a developmental acquisition of sensory-motor coordination. Teleoperation bootstraps the process by enabling the robot to observe its own sensory responses to actions that lead to specific outcomes. A reach-and-grasp task, learned by an articulated robot through a small number of teleoperated trials, can be performed autonomously with success in the face of significant variations in the environment and perturbations of the goal. Superpositioning was performed using the Verbs and Adverbs algorithm that was developed originally for the graphical animation of articulated characters. Work was performed on Robonaut at NASA-JSC.

Peters, Richard Alan, II↗

Human-Centric Teaming in a Multi-Agent EVA Assembly Task

NASA's Human Space Flight program depends heavily on spacewalks performed by pairs of suited human astronauts. These Extra-Vehicular Activities (EVAs) are severely restricted in both duration and scope by consumables and available manpower.An expanded multi-agent EVA team combining the information-gathering and problem-solving skills of human astronauts with the survivability and physical capabilities of highly dexterous space robots is proposed. A 1-g test featuring two NASA/DARPA Robonaut systems working side-by-side with a suited human subject is conducted to evaluate human-robot teaming strategies in the context of a simulated EVA assembly task based on the STS-61B ACCESS flight experiment.

Rehnmark, Fredrik↗

Mobile Autonomous Humanoid Assistant

A mobile autonomous humanoid robot is assisting human co-workers at the Johnson Space Center with tool handling tasks. This robot combines the upper body of the National Aeronautics and Space Administration (NASA)/Defense Advanced Research Projects Agency (DARPA) Robonaut system with a Segway(TradeMark) Robotic Mobility Platform yielding a dexterous, maneuverable humanoid perfect for aiding human co-workers in a range of environments. This system uses stereo vision to locate human team mates and tools and a navigation system that uses laser range and vision data to follow humans while avoiding obstacles. Tactile sensors provide information to grasping algorithms for efficient tool exchanges. The autonomous architecture utilizes these pre-programmed skills to form human assistant behaviors. The initial behavior demonstrates a robust capability to assist a human by acquiring a tool from a remotely located individual and then following the human in a cluttered environment with the tool for future use.

Diftler, M. A.↗

Modeling and Classifying Six-Dimensional Trajectories for Teleoperation Under a Time Delay

Within the context of teleoperating the JSC Robonaut humanoid robot under 2-10 second time delays, this paper explores the technical problem of modeling and classifying human motions represented as six-dimensional (position and orientation) trajectories. A dual path research agenda is reviewed which explored both deterministic approaches and stochastic approaches using Hidden Markov Models. Finally, recent results are shown from a new model which represents the fusion of these two research paths. Questions are also raised about the possibility of automatically generating autonomous actions by reusing the same predictive models of human behavior to be the source of autonomous control. This approach changes the role of teleoperation from being a stand-in for autonomy into the first data collection step for developing generative models capable of autonomous control of the robot.

SunSpiral, Vytas↗

UWB Technology and Applications on Space Exploration

Ultra-wideband (UWB), also known as impulse or carrier-free radio technology, is one promising new technology. In February 2002, the Federal Communications Commission (FCC) approved the deployment of this technology. It is increasingly recognized that UWB technology holds great potential to provide significant benefits in many terrestrial and space applications such as precise positioning/tracking and high data rate mobile wireless communications. This talk presents an introduction to UWB technology and some applications on space exploration. UWB is characterized by several uniquely attractive features, such as low impact on other RF systems due to its extremely low power spectral densities, immunity to interference from narrow band RF systems due to its ultra-wide bandwidth, multipath immunity to fading due to ample multipath diversity, capable of precise positioning due to fine time resolution, capable of high data rate multi-channel performance. The related FCC regulations, IEEE standardization efforts and industry activities also will be addressed in this talk. For space applications, some projects currently under development at NASA Johnson Space Center will be introduced. These include the UWB integrated communication and tracking system for Lunar/Mars rover and astronauts, UWB-RFID ISS inventory tracking, and UWB-TDOA close-in high resolution tracking for potential applications on robonaut.

Ngo, Phong↗

Humanoid Mobile Manipulation Using Controller Refinement

An important class of mobile manipulation problems are move-to-grasp problems where a mobile robot must navigate to and pick up an object. One of the distinguishing features of this class of tasks is its coarse-to-fine structure. Near the beginning of the task, the robot can only sense the target object coarsely or indirectly and make gross motion toward the object. However, after the robot has located and approached the object, the robot must finely control its grasping contacts using precise visual and haptic feedback. In this paper, it is proposed that move-to-grasp problems are naturally solved by a sequence of controllers that iteratively refines what ultimately becomes the final solution. This paper introduces the notion of a refining sequence of controllers and characterizes this type of solution. The approach is demonstrated in a move-to-grasp task where Robonaut, the NASA/JSC dexterous humanoid, is mounted on a mobile base and navigates to and picks up a geological sample box. In a series of tests, it is shown that a refining sequence of controllers decreases variance in robot configuration relative to the sample box until a successful grasp has been achieved.

Platt, Robert↗

Integrated Planning for Telepresence with Time Delays

Teleoperation of remote robotic systems over time delays in the range of 2-10 seconds poses a unique set of challenges. In the context of a supervisory control system for the JSC Robonaut humanoid robot, we have developed an 'intelligent assistant' that integrates an Artificial Intelligence planner (JSHOP2) with execution monitoring of the state of both the human supervisor and the remote robot. The assistant reasons simultaneously about the world state on both sides of the time delay, which represents a novel application of this technology. The purpose of the assistant is to provide advice to the human supervisor about current and future activities, derived from a sequence of high-level goals to be achieved. To do this, the assistant must simultaneously monitor and react to various data sources, including actions taken by the supervisor who is issuing commands to the robot (e.g. with a data glove), actions taken by the robot, and the environment of the robot, both as currently perceived over the time delay, along with the current sequence of goals. We have developed a 'leader/follower' software architecture to handle the dual time-shifted streams of execution feedback. In this paper we describe the integrated planner and its executive, and how it operates in normal and anomaly situations.

remote robotic systems↗

Integrated Planning for Telepresence with Time Delays

Integrated planning and execution of teleoperations in space with time delays is shown. The topics include: 1) The Problem; 2) Future Robot Surgery? 3) Approach Overview; 4) Robonaut; 5) Normal Planning and Execution; 6) Planner Context; 7) Implementation; 8) Use of JSHOP2; 9) Monitoring and Testing GUI; 10) Normal sequence: first the supervisor acts; 11) then the robot; 12) Robot might be late; 13) Supervisor can work ahead; 14) Deviations from Plan; 15) Robot State Change Example; 16) Accomplished goals skipped in replan; 17) Planning continuity; 18) Supervisor Deviation From Plan; 19) Intentional Deviation; and 20) Infeasible states.

teleoperation↗

Humanoid Mobile Manipulation Using Controller Refinement

An important class of mobile manipulation problems are move-to-grasp problems where a mobile robot must navigate to and pick up an object. One of the distinguishing features of this class of tasks is its coarse-to-fine structure. Near the beginning of the task, the robot can only sense the target object coarsely or indirectly and make gross motion toward the object. However, after the robot has located and approached the object, the robot must finely control its grasping contacts using precise visual and haptic feedback. This paper proposes that move-to-grasp problems are naturally solved by a sequence of controllers that iteratively refines what ultimately becomes the final solution. This paper introduces the notion of a refining sequence of controllers and characterizes this type of solution. The approach is demonstrated in a move-to-grasp task where Robonaut, the NASA/JSC dexterous humanoid, is mounted on a mobile base and navigates to and picks up a geological sample box. In a series of tests, it is shown that a refining sequence of controllers decreases variance in robot configuration relative to the sample box until a successful grasp has been achieved.

Platt, Robert↗

Robots in Space -Psychological Aspects

A viewgraph presentation on the psychological aspects of developing robots to perform routine operations associated with monitoring, inspection, maintenance and repair in space is shown. The topics include: 1) Purpose; 2) Vision; 3) Current Robots in Space; 4) Ground Based Robots; 5) AERCam; 6) Rotating Bladder Robot (ROBLR); 7) DART; 8) Robonaut; 9) Full Immersion Telepresence Testbed; 10) ERA; and 11) Psychological Aspects

Sipes, Walter E.↗

International Space Station Crew Restraint Design

With permanent human presence onboard the International Space Station (ISS), crews will be living and working in microgravity, dealing with the challenges of a weightless environment. In addition, the confined nature of the spacecraft environment results in ergonomic challenges such as limited visibility and access to the activity areas, as well as prolonged periods of unnatural postures. Without optimum restraints, crewmembers may be handicapped for performing some of the on-orbit tasks. Currently, many of the tasks on ISS are performed with the crew restrained merely by hooking their arms or toes around handrails to steady themselves. This is adequate for some tasks, but not all. There have been some reports of discomfort/calluses on the top of the toes. In addition, this type of restraint is simply insufficient for tasks that require a large degree of stability. Glovebox design is a good example of a confined workstation concept requiring stability for successful use. They are widely used in industry, university, and government laboratories, as well as in the space environment, and are known to cause postural limitations and visual restrictions. Although there are numerous guidelines pertaining to ventilation, seals, and glove attachment, most of the data have been gathered in a 1-g environment, or are from studies that were conducted prior to the early 1980 s. Little is known about how best to restrain a crewmember using a glovebox in microgravity. In 2004, The Usability Testing and Analysis Facility (UTAF) at the NASA Johnson Space Center completed development/evaluation of several design concepts for crew restraints to meet the various needs outlined above. Restraints were designed for general purpose use, for teleoperation (Robonaut) and for use with the Life Sciences Glovebox. All design efforts followed a human factors engineering design lifecycle, beginning with identification of requirements followed by an iterative prototype/test cycle. Anthropometric modeling was completed for the 5th percentile Asian female and the 95th percentile American male for all restraints. A series of three evaluations was performed onboard NASA's reduced gravity aircraft (KC-135). For all evaluations, participants performed representative tasks while being videotaped, and then completed a questionnaire following each flight day. The questionnaire included ratings scales and free format questions to assess topics such as comfort, stability provided, flexibility provided, etc. Results from the three flight evaluations are being used to develop the human factors design requirements for crew restraint concepts for 1) general purpose restraints, 2) teleoperation restraints and 3) glovebox restraints. The poster presentation will describe the detailed methodology used, results from each of the three evaluations, and the resulting human factors recommendations for the design of these restraints.

Whitmore, M.↗

Applied Joint-Space Torque and Stiffness Control of Tendon-Driven Fingers

Existing tendon-driven fingers have applied force control through independent tension controllers on each tendon, i.e. in the tendon-space. The coupled kinematics of the tendons, however, cause such controllers to exhibit a transient coupling in their response. This problem can be resolved by alternatively framing the controllers in the joint-space of the manipulator. This work presents a joint-space torque control law that demonstrates both a decoupled and significantly faster response than an equivalent tendon-space formulation. The law also demonstrates greater speed and robustness than comparable PI controllers. In addition, a tension distribution algorithm is presented here to allocate forces from the joints to the tendons. It allocates the tensions so that they satisfy both an upper and lower bound, and it does so without requiring linear programming or open-ended iterations. The control law and tension distribution algorithm are implemented on the robotic hand of Robonaut-2.

Abdallah, Muhammad E.↗

An Effective Division of Labor Between Human and Robotic Agents Performing a Cooperative Assembly Task

NASA's Human Space Flight program depends heavily on spacewalks performed by human astronauts. These so-called extra-vehicular activities (EVAs) are risky, expensive and complex. Work is underway to develop a robotic astronaut's assistant that can help reduce human EVA time and workload by delivering human-like dexterous manipulation capabilities to any EVA worksite. An experiment is conducted to evaluate human-robot teaming strategies in the context of a simplified EVA assembly task in which Robonaut, a collaborative effort with the Defense Advanced Research Projects Agency (DARPA), an anthropomorphic robot works side-by-side with a human subject. Team performance is studied in an effort to identify the strengths and weaknesses of each teaming configuration and to recommend an appropriate division of labor. A shared control approach is developed to take advantage of the complementary strengths of the human teleoperator and robot, even in the presence of significant time delay.

Rehnmark, Fredrik↗

Working and Learning with Knowledge in the Lobes of a Humanoid's Mind

Humanoid class robots must have sufficient dexterity to assist people and work in an environment designed for human comfort and productivity. This dexterity, in particular the ability to use tools, requires a cognitive understanding of self and the world that exceeds contemporary robotics. Our hypothesis is that the sense-think-act paradigm that has proven so successful for autonomous robots is missing one or more key elements that will be needed for humanoids to meet their full potential as autonomous human assistants. This key ingredient is knowledge. The presented work includes experiments conducted on the Robonaut system, a NASA and the Defense Advanced research Projects Agency (DARPA) joint project, and includes collaborative efforts with a DARPA Mobile Autonomous Robot Software technical program team of researchers at NASA, MIT, USC, NRL, UMass and Vanderbilt. The paper reports on results in the areas of human-robot interaction (human tracking, gesture recognition, natural language, supervised control), perception (stereo vision, object identification, object pose estimation), autonomous grasping (tactile sensing, grasp reflex, grasp stability) and learning (human instruction, task level sequences, and sensorimotor association).

Ambrose, Robert↗