Engineering PapersSearch

Engineering topics

Chang, Mai Lee

Publications and source records attributed to Chang, Mai Lee.

Human-Automation Allocations for Current Robotic Space Operations: Space Station Remote Manipulator System

NASA’s Human Research Program’s Risk of Inadequate Design of Human and Automation/Robotic Integration (HARI) delineates the uncertainty surrounding crew work with automation and robotics in spaceflight. HARI is concerned with detrimental effects of ineffective user interfaces, system designs and/or functional task allocation on crew performance, potentially compromising mission success and safety. This risk arises because of limited experience with complex automation and robotics in spaceflight. One key knowledge gap within the HARI risk is related to function allocation.

Chang, Mai Lee

Future Exploration Missions' Tasks Associated with the Risk of Inadequate Design of Human and Automation/Robotic Integration

NASA's Human Research Program (HRP) funds research efforts aimed at mitigating various human health and performance risks, including the Risk of Inadequate Design of Human and Automation/Robotic Integration (HARI). As such, within HRP, the Human Factors and Behavioral Performance (HFBP) Element tasked an evaluation of future HARI needs in order to scope and focus the HARI risk research plan. The objective was to provide a systematic understanding of the critical factors associated with effective HARI that will be necessary to achieve the future mission goals for near- and deep-space exploration. Future mission goals are specified by NASA Design Reference Missions (DRMs) that are pertinent to the HRP. The outcome of this evaluation is a set of NASA-relevant HARI tasks, factors, and interactions required for exploration-class missions.

space operations

Evaluation of Human and AutomationRobotics Integration Needs for Future Human Exploration Missions

NASA employs Design Reference Missions (DRMs) to define potential architectures for future human exploration missions to deep space, the Moon, and Mars. While DRMs to these destinations share some components, each mission has different needs. This paper focuses on the human and automation/robotic integration needs for these future missions, evaluating them with respect to NASA research gaps in the area of space human factors engineering. The outcomes of our assessment is a human and automation/robotic (HAR) task list for each of the four DRMs that we reviewed (i.e., Deep Space Sortie, Lunar Visit/Habitation, Deep Space Habitation, and Planetary), a list of common critical HAR factors that drive HAR design.

design reference missions

Human-Robot Interaction

Human-robot interaction (HRI) is a discipline investigating the factors affecting the interactions between humans and robots. It is important to evaluate how the design of interfaces affect the human's ability to perform tasks effectively and efficiently when working with a robot. By understanding the effects of interface design on human performance, workload, and situation awareness, interfaces can be developed to appropriately support the human in performing tasks with minimal errors and with appropriate interaction time and effort. Thus, the results of research on human-robot interfaces have direct implications for the design of robotic systems. For efficient and effective remote navigation of a rover, a human operator needs to be aware of the robot's environment. However, during teleoperation, operators may get information about the environment only through a robot's front-mounted camera causing a keyhole effect. The keyhole effect reduces situation awareness which may manifest in navigation issues such as higher number of collisions, missing critical aspects of the environment, or reduced speed. One way to compensate for the keyhole effect and the ambiguities operators experience when they teleoperate a robot is adding multiple cameras and including the robot chassis in the camera view. Augmented reality, such as overlays, can also enhance the way a person sees objects in the environment or in camera views by making them more visible. Scenes can be augmented with integrated telemetry, procedures, or map information. Furthermore, the addition of an exocentric (i.e., third-person) field of view from a camera placed in the robot's environment may provide operators with the additional information needed to gain spatial awareness of the robot. Two research studies investigated possible mitigation approaches to address the keyhole effect: 1) combining the inclusion of the robot chassis in the camera view with augmented reality overlays, and 2) modifying the camera frame of reference. The first study investigated the effects of inclusion and exclusion of the robot chassis along with superimposing a simple arrow overlay onto the video feed of operator task performance during teleoperation of a mobile robot in a driving task. In this study, the front half of the robot chassis was made visible through the use of three cameras, two side-facing and one forward-facing. The purpose of the second study was to compare operator performance when teleoperating a robot from an egocentric-only and combined (egocentric plus exocentric camera) view. Camera view parameters that are found to be beneficial in these laboratory experiments can be implemented on NASA rovers and tested in a real-world driving and navigation scenario on-site at the Johnson Space Center.

Sandor, Aniko

Human-Robot Interaction Directed Research Project

Human-robot interaction (HRI) is a discipline investigating the factors affecting the interactions between humans and robots. It is important to evaluate how the design of interfaces and command modalities affect the human's ability to perform tasks accurately, efficiently, and effectively when working with a robot. By understanding the effects of interface design on human performance, workload, and situation awareness, interfaces can be developed to appropriately support the human in performing tasks with minimal errors and with appropriate interaction time and effort. Thus, the results of research on human-robot interfaces have direct implications for the design of robotic systems. This DRP concentrates on three areas associated with interfaces and command modalities in HRI which are applicable to NASA robot systems: 1) Video Overlays, 2) Camera Views, and 3) Command Modalities. The first study focused on video overlays that investigated how Augmented Reality (AR) symbology can be added to the human-robot interface to improve teleoperation performance. Three types of AR symbology were explored in this study, command guidance (CG), situation guidance (SG), and both (SCG). CG symbology gives operators explicit instructions on what commands to input, whereas SG symbology gives operators implicit cues so that operators can infer the input commands. The combination of CG and SG provided operators with explicit and implicit cues allowing the operator to choose which symbology to utilize. The objective of the study was to understand how AR symbology affects the human operator's ability to align a robot arm to a target using a flight stick and the ability to allocate attention between the symbology and external views of the world. The study evaluated the effects type of symbology (CG and SG) has on operator tasks performance and attention allocation during teleoperation of a robot arm. The second study expanded on the first study by evaluating the effects of the type of navigational guidance (CG and SG) on operator task performance and attention allocation during teleoperation of a robot arm through uplinked commands. Although this study complements the first study on navigational guidance with hand controllers, it is a separate investigation due to the distinction in intended operators (i.e., crewmembers versus ground-operators). A third study looked at superimposed and integrated overlays for teleoperation of a mobile robot using a hand controller. When AR is superimposed on the external world, it appears to be fixed onto the display and internal to the operators' workstation. Unlike superimposed overlays, integrated overlays often appear as three-dimensional objects and move as if part of the external world. Studies conducted in the aviation domain show that integrated overlays can improve situation awareness and reduce the amount of deviation from the optimal path. The purpose of the study was to investigate whether these results apply to HRI tasks, such as navigation with a mobile robot.

Sandor, Aniko