Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Tactile Interfaces”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1997

NASA Robotic Neurosurgery Testbed

The detection of tissue interface (e.g., normal tissue, cancer, tumor) has been limited clinically to tactile feedback, temperature monitoring, and the use of a miniature ultrasound probe for tissue differentiation during surgical operations, In neurosurgery, the needle used in the standard stereotactic CT or MRI guided brain biopsy provides no information about the tissue being sampled. The tissue sampled depends entirely upon the accuracy with which the localization provided by the preoperative CT or MRI scan is translated to the intracranial biopsy site. In addition, no information about the tissue being traversed by the needle (e.g., a blood vessel) is provided. Hemorrhage due to the biopsy needle tearing a blood vessel within the brain is the most devastating complication of stereotactic CT/MRI guided brain biopsy. A robotic neurosurgery testbed has been developed at NASA Ames Research Center as a spin-off of technologies from space, aeronautics and medical programs. The invention entitled "Robotic Neurosurgery Leading to Multimodality Devices for Tissue Identification" is nearing a state ready for commercialization. The devices will: 1) improve diagnostic accuracy and precision of general surgery, with near term emphasis on stereotactic brain biopsy, 2) automate tissue identification, with near term emphasis on stereotactic brain biopsy, to permit remote control of the procedure, and 3) reduce morbidity for stereotactic brain biopsy. The commercial impact from this work is the potential development of a whole new generation of smart surgical tools to increase the safety, accuracy and efficiency of surgical procedures. Other potential markets include smart surgical tools for tumor ablation in neurosurgery, general exploratory surgery, prostate cancer surgery, and breast cancer surgery.

Mah, Robert↗
NASA NTRS2012

Tactile Data Entry for Extravehicular Activity

In the task-saturated environment of extravehicular activity (EVA), an astronaut's ability to leverage suit-integrated information systems is limited by a lack of options for data entry. In particular, bulky gloves inhibit the ability to interact with standard computing interfaces such as a mouse or keyboard. This paper presents the results of a preliminary investigation into a system that permits the space suit gloves themselves to be used as data entry devices. Hand motion tracking is combined with simple finger gesture recognition to enable use of a virtual keyboard, while tactile feedback provides touch-based context to the graphical user interface (GUI) and positive confirmation of keystroke events. In human subject trials, conducted with twenty participants using a prototype system, participants entered text significantly faster with tactile feedback than without (p = 0.02). The results support incorporation of vibrotactile information in a future system that will enable full touch typing and general mouse interactions using instrumented EVA gloves.

Adams, Richard J.↗
NASA NTRS2011

Compliant Tactile Sensors

Tactile sensors are currently being designed to sense interactions with human hands or pen-like interfaces. They are generally embedded in screens, keyboards, mousepads, and pushbuttons. However, they are not well fitted to sense interactions with all kinds of objects. A novel sensor was originally designed to investigate robotics manipulation where not only the contact with an object needs to be detected, but also where the object needs to be held and manipulated. This tactile sensor has been designed with features that allow it to sense a large variety of objects in human environments. The sensor is capable of detecting forces coming from any direction. As a result, this sensor delivers a force vector with three components. In contrast to most of the tactile sensors that are flat, this one sticks out from the surface so that it is likely to come in contact with objects. The sensor conforms to the object with which it interacts. This augments the contact's surface, consequently reducing the stress applied to the object. This feature makes the sensor ideal for grabbing objects and other applications that require compliance with objects. The operational range of the sensor allows it to operate well with objects found in peoples' daily life. The fabrication of this sensor is simple and inexpensive because of its compact mechanical configuration and reduced electronics. These features are convenient for mass production of individual sensors as well as dense arrays. The biologically inspired tactile sensor is sensitive to both normal and lateral forces, providing better feedback to the host robot about the object to be grabbed. It has a high sensitivity, enabling its use in manipulation fingers, which typically have low mechanical impedance in order to be very compliant. The construction of the sensor is simple, using inexpensive technologies like silicon rubber molding and standard stock electronics.

Torres-Jara, Eduardo R.↗
NASA NTRS2010

Use of Traditional and Novel Methods to Evaluate the Influence of an EVA Glove on Hand Performance

The gloved hand is one of an astronaut s primary means of interacting with the environment, and any restrictions imposed by the glove can strongly affect performance during extravehicular activity (EVA). Glove restrictions have been the subject of study for decades, yet previous studies have generally been unsuccessful in quantifying glove mobility and tactility. Past studies have tended to focus on the dexterity, strength, and functional performance of the gloved hand; this provides only a circumspect analysis of the impact of each type of restriction on the glove s overall capability. The aim of this study was to develop novel capabilities to provide metrics for mobility and tactility that can be used to assess the performance of a glove in a way that could enable designers and engineers to improve their current designs. A series of evaluations were performed to compare unpressurized and pressurized (4.3 psi) gloved conditions with the ungloved condition. A second series of evaluations were performed with the Thermal Micrometeoroid Garment (TMG) removed. This series of tests provided interesting insight into how much of an effect the TMG has on gloved mobility - in some cases, the presence of the TMG restricted glove mobility as much as pressurization did. Previous hypotheses had assumed that the TMG would have a much lower impact on mobility, but these results suggest that an improvement in the design of the TMG could have a significant impact on glove performance. Tactility testing illustrated the effect of glove pressurization, provided insight into the design of hardware that interfaces with the glove, and highlighted areas of concern. The metrics developed in this study served to benchmark the Phase VI EVA glove and to develop requirements for the next-generation glove for the Constellation program.

Benson, Elizabeth A.↗
NASA NTRS2018

Tactile Display for EVA

As human spaceflight crews engage in more complex missions beyond low Earth orbit, their need for autonomy increases. ISS-like operations in which Earth-based mission control monitors life-critical systems and provides real time support for crew tasks will be limited by communication bandwidth and delays, forcing the crew to take on a subset of these responsibilities. This presents the biggest challenge during Extravehicular Activity (EVA)s, where the crew is already overloaded and their ability to interact with information systems is severely limited. Tactile displays, which present information using the sense of touch, expand the users' communication bandwidth. This untapped interface modality can be used for a wide range of interactions during EVA, including emergency alerts, non-emergency situational awareness, and simple instruction.

Aceves, Ricco↗
NASA NTRS2013

Glove-Enabled Computer Operations (GECO): Design and Testing of an Extravehicular Activity Glove Adapted for Human-Computer Interface

The Glove-Enabled Computer Operations (GECO) system enables an extravehicular activity (EVA) glove to be dual-purposed as a human-computer interface device. This paper describes the design and human participant testing of a right-handed GECO glove in a pressurized glove box. As part of an investigation into the usability of the GECO system for EVA data entry, twenty participants were asked to complete activities including (1) a Simon Says Games in which they attempted to duplicate random sequences of targeted finger strikes and (2) a Text Entry activity in which they used the GECO glove to enter target phrases in two different virtual keyboard modes. In a within-subjects design, both activities were performed both with and without vibrotactile feedback. Participants mean accuracies in correctly generating finger strikes with the pressurized glove were surprisingly high, both with and without the benefit of tactile feedback. Five of the subjects achieved mean accuracies exceeding 99 in both conditions. In Text Entry, tactile feedback provided a statistically significant performance benefit, quantified by characters entered per minute, as well as reduction in error rate. Secondary analyses of responses to a NASA Task Loader Index (TLX) subjective workload assessments reveal a benefit for tactile feedback in GECO glove use for data entry. This first-ever investigation of employment of a pressurized EVA glove for human-computer interface opens up a wide range of future applications, including text chat communications, manipulation of procedureschecklists, cataloguingannotating images, scientific note taking, human-robot interaction, and control of suit andor other EVA systems.

Adams, Richard J.↗
NASA NTRS2013

Glove-Enabled Computer Operations (GECO): Design and Testing of an Extravehicular Activity Glove Adapted for Human-Computer Interface

The Glove-Enabled Computer Operations (GECO) system enables an extravehicular activity (EVA) glove to be dual-purposed as a human-computer interface device. This paper describes the design and human participant testing of a right-handed GECO glove in a pressurized glove box. As part of an investigation into the usability of the GECO system for EVA data entry, twenty participants were asked to complete activities including (1) a Simon Says Games in which they attempted to duplicate random sequences of targeted finger strikes and (2) a Text Entry activity in which they used the GECO glove to enter target phrases in two different virtual keyboard modes. In a within-subjects design, both activities were performed both with and without vibrotactile feedback. Participants' mean accuracies in correctly generating finger strikes with the pressurized glove were surprisingly high, both with and without the benefit of tactile feedback. Five of the subjects achieved mean accuracies exceeding 99% in both conditions. In Text Entry, tactile feedback provided a statistically significant performance benefit, quantified by characters entered per minute, as well as reduction in error rate. Secondary analyses of responses to a NASA Task Loader Index (TLX) subjective workload assessments reveal a benefit for tactile feedback in GECO glove use for data entry. This first-ever investigation of employment of a pressurized EVA glove for human-computer interface opens up a wide range of future applications, including text "chat" communications, manipulation of procedures/checklists, cataloguing/annotating images, scientific note taking, human-robot interaction, and control of suit and/or other EVA systems.

Adams, Richard J.↗
NASA NTRS2021

Advanced Multimodal Solutions for Information Presentation

High-workload, fast-paced, and degraded sensory environments are the likeliest candidates to benefit from multimodal information presentation. For example, during extra-vehicular activity (EVA) and telerobotic operations, the sensory restrictions associated with such a hostile environment provide a major challenge to maintaining the situation awareness (SA) required for safe operations. In particular, orientation, navigation, and collision avoidance are critical aspects of EVA tasks that need to be addressed to ensure the safety of the crew and the success of the mission. Multimodal displays hold promise to enhance situation awareness and task performance by utilizing different sensory modalities and maximizing their effectiveness based on appropriate interaction between modalities. Multimodal displays will also play an important role for long-duration information systems and will likely begin to be developed in the early phases of cislunar Gateway, and later lunar or Mars transit missions. Information systems are envisioned for LDEMs that require spacecraft with greater crew autonomy and increased dependence on computer-provided information needed to perform routine tasks, as well as time- and safety critical tasks. Such a system will require a single, common interface that is easy to learn and use and accesses key information from all relevant vehicle/habitat systems to enable task performance in both nominal and emergency conditions. Understanding of multimodal display technologies and their interactions will help to inform interface guidelines for LDEMs. The scope of the current report is an analysis of potential multimodal display technologies for long duration missions and, in particular, will focus on their potential role in EVA activities. The review will address multimodal (combined visual, auditory and/or tactile) displays investigated by the National Aeronautics and Space Administration (NASA), industry, and Department of Defense (DoD). It also considers the need for adaptive information systems to accommodate a variety of operational contexts such as crew status (e.g., fatigue, workload level) and task environment (e.g., EVA, habitat, rover, spacecraft). Current approaches to guidelines and best practices for combining modalities for the most effective information displays are also reviewed. Potential issues in developing interface guidelines for LDEMs are briefly considered.

multimodal displays↗
NASA NTRS1995

Some mechanical design aspects of the European Robotic Arm

The European Robotic Arm (ERA) is a contribution to the Russian Segment of the International Space Station Alpha. It will start operating on the Russian Segment during the assembly phase. ERA is designed and produced by a large industrial consortium spread over Europe with Fokker Space & Systems as prime contractor. In this paper, we will describe some of the overall design aspects and focus on the development of several mechanisms within ERA. The operation of ERA during the approach of its end effector towards the grapple interface and the grapple operation is discussed, with a focus on mechanisms. This includes the geometry of the end effector leading edge, which is carefully designed to provide the correct and complete tactile information to a torque-force sensor (TFS). The data from this TFS are used to steer the arm such that forces and moments are kept below 20 N and 20 N.m respectively during the grappling operation. Two hardware models of the end effector are built. The problems encountered are described as well as their solutions. The joints in the wrists and the elbow initially used a harmonic drive lubricated by MoS2. During development testing, this combination showed an insufficient lifetime in air to survive the acceptance test program. The switch-over to a system comprising planetary gearboxes with grease lubrication is described. From these development efforts, conclusions are drawn and recommendations are given for the design of complex space mechanisms.

Lambooy, Peter J.↗
NASA NTRS1992

Investigation of the effects of Extra Vehicular Activity (EVA) and Launch and Entry (LES) gloves on performance

Human capabilities such as dexterity, manipulability, and tactile perception are unique and render the hand as a very versatile, effective and a multipurpose tool. This is especially true for unknown environments such as the EVA environment. In the microgravity environment interfaces, procedures, and activities are too complex, diverse, and defy advance definition. Under these conditions the hand becomes the primary means of locomotion, restraint, and material handling. Facilitation of these activities, with simultaneous protection from the cruel EVA environment are the two, often conflicting, objectives of glove design. The objectives of this study was (1) to assess the effects of EVA gloves at different pressures on human hand capabilities, (2) to devise a protocol for evaluating EVA gloves, (3) to develop force time relations for a number of EVA glove pressure combinations, and (4) to evaluate two types of launch and entry suit gloves. The objectives were achieved through three experiments. The experiments for achieving objectives 1, 2, and 3 were performed in the glove box in building 34. In experiment 1 three types of EVA gloves were tested at five pressure differentials. A number of performance measures were recorded. In experiment 2 the same gloves as in experiment 1 were evaluated in a reduced number of pressure conditions. The performance measure was endurance time. Six subjects participated in both the experiments. In experiment 3 two types of launch and entry suit gloves were evaluated using a paradigm similar to experiment 1. Currently the data is being analyzed. However for this report some summary analyses have been performed. The results indicate that a) With EVA gloves strength is reduced by nearly 50 percent, b) performance decrements increase with increasing pressure differential, c) TMG effects are not consistent across the three gloves tested, d) some interesting gender glove interactions were observed, some of which may have been due to the extent (or lack of) fit of the glove to the hand, and e) differences in performance exist between partial pressure suit glove and full pressure suit glove, especially in the unpressurized condition.

Bishu, Ram R.↗
NASA NTRS2013

Wearable Technology

Wearable technology projects, to be useful, in the future, must be seamlessly integrated with the Flight Deck of the Future (F.F). The lab contains mockups of space vehicle cockpits, habitat living quarters, and workstations equipped with novel user interfaces. The Flight Deck of the Future is one element of the Integrated Power, Avionics, and Software (IPAS) facility, which, to a large extent, manages the F.F network and data systems. To date, integration with the Flight Deck of the Future has been limited by a lack of tools and understanding of the Flight Deck of the Future data handling systems. To remedy this problem it will be necessary to learn how data is managed in the Flight Deck of the Future and to develop tools or interfaces that enable easy integration of WEAR Lab and EV3 products into the Flight Deck of the Future mockups. This capability is critical to future prototype integration, evaluation, and demonstration. This will provide the ability for WEAR Lab products, EV3 human interface prototypes, and technologies from other JSC organizations to be evaluated and tested while in the Flight Deck of the Future. All WEAR Lab products must be integrated with the interface that will connect them to the Flight Deck of the Future. The WEAR Lab products will primarily be programmed in Arduino. Arduino will be used for the development of wearable controls and a tactile communication garment. Arduino will also be used in creating wearable methane detection and warning system.

Watson, Amanda↗
NASA NTRS2018

Advanced Multimodal Solutions for Information Presentation

High-workload, fast-paced, and degraded sensory environments are the likeliest candidates to benefit from multimodal information presentation. For example, during EVA (Extra-Vehicular Activity) and telerobotic operations, the sensory restrictions associated with a space environment provide a major challenge to maintaining the situation awareness (SA) required for safe operations. Multimodal displays hold promise to enhance situation awareness and task performance by utilizing different sensory modalities and maximizing their effectiveness based on appropriate interaction between modalities. During EVA, the visual and auditory channels are likely to be the most utilized with tasks such as monitoring the visual environment, attending visual and auditory displays, and maintaining multichannel auditory communications. Previous studies have shown that compared to unimodal displays (spatial auditory or 2D visual), bimodal presentation of information can improve operator performance during simulated extravehicular activity on planetary surfaces for tasks as diverse as orientation, localization or docking, particularly when the visual environment is degraded or workload is increased. Tactile displays offer a third sensory channel that may both offload information processing effort and provide a means to capture attention when urgently required. For example, recent studies suggest that including tactile cues may result in increased orientation and alerting accuracy, improved task response time and decreased workload, as well as provide self-orientation cues in microgravity on the ISS (International Space Station). An important overall issue is that context-dependent factors like task complexity, sensory degradation, peripersonal vs. extrapersonal space operations, workload, experience level, and operator fatigue tend to vary greatly in complex real-world environments and it will be difficult to design a multimodal interface that performs well under all conditions. As a possible solution, adaptive systems have been proposed in which the information presented to the user changes as a function of taskcontext-dependent factors. However, this presupposes that adequate methods for detecting andor predicting such factors are developed. Further, research in adaptive systems for aviation suggests that they can sometimes serve to increase workload and reduce situational awareness. It will be critical to develop multimodal display guidelines that include consideration of smart systems that can select the best display method for a particular contextsituation.The scope of the current work is an analysis of potential multimodal display technologies for long duration missions and, in particular, will focus on their potential role in EVA activities. The review will address multimodal (combined visual, auditory andor tactile) displays investigated by NASA, industry, and DoD (Dept. of Defense). It also considers the need for adaptive information systems to accommodate a variety of operational contexts such as crew status (e.g., fatigue, workload level) and task environment (e.g., EVA, habitat, rover, spacecraft). Current approaches to guidelines and best practices for combining modalities for the most effective information displays are also reviewed. Potential issues in developing interface guidelines for the Exploration Information System (EIS) are briefly considered.

multimodal display↗
NASA NTRS2021

The Role of Tactile Cueing in Multimodal Displays: Application in Complex Task Environments for Space Exploration

This paper reviews the potential role of tactile cueing in multimodal displays that will need to be developed to enable Extravehicular Activity (EVA) and telerobotic exploration for both Moon and Mars missions. Specific missions to be accomplished during EVA surface and space operations will include construction and assembly, surface and geologic exploration, and excavation for protective shelter from radiation and significant solar particle events. EVA crews have limited time, resources, mobility, visibility and dexterity, and activities take place in a perceptually impoverished environment. Limitations include a loss of spatial reference frame leading to spatial disorientation, a loss of information normally provided by the auditory and somato-sensory systems, and a restricted field of view. In addition, in non-surface operations crew must be able to navigate and operate in a fully six degree of freedom (DoF) environment. Fatigue resulting from suited EVA tasks will also critically affect performance and safety. In order to mitigate these factors, it is important that crews be well trained prior to executing actual missions. There is a critical need to design multimodal interfaces to optimize performance under these conditions for both training and actual operations. Because of the high level of complexity of the EVA environment on the one hand, and the “sensory restrictions” on the other, it makes sense to envisage enhancements to the astronauts’ visual environment. Such an enriched environment may include virtual auditory as well as tactile inputs.

multimodal displays↗
NASA NTRS2009

Miniature Six-Axis Load Sensor for Robotic Fingertip

A miniature load sensor has been developed as a prototype of tactile sensors that could fit within fingertips of anthropomorphic robot hands. The sensor includes a force-and-torque transducer in the form of a spring instrumented with at least six semiconductor strain gauges. The strain-gauge wires are secured to one side of an interface circuit board mounted at the base of the spring. This board protects the strain-gauge wires from damage that could otherwise occur as a result of finger motions. On the opposite side of the interface board, cables routed along the neutral axis of the finger route the strain-gauge output voltages to an analog-to-digital converter (A/D) board. The A/D board is mounted as close as possible to the strain gauges to minimize electromagnetic noise and other interference effects. The outputs of the A/D board are fed to a controller, wherein, by means of a predetermined calibration matrix, the digitized strain-gauge output voltages are converted to three vector components of force and three of torque exerted by or on the fingertip.

Diftler, Myron A.↗
NASA NTRS2015

Analysis of Human-Spacesuit Interaction

Astronauts sustain injuries of various natures such as finger delamination, joint pain, and redness due to their interaction with the space suit. The role of the Anthropometry and Biomechanics Facility is to understand the biomechanics, environmental variables, and ergonomics of the suit. This knowledge is then used to make suggestions for improvement in future iterations of the space suit assembly to prevent injuries while allowing astronauts maneuverability, comfort, and tactility. The projects I was involved in were the Extravehicular Mobility Unit (EMU) space suit stiffness study and the glove feasibility study. The EMU project looked at the forces exerted on the shoulder, arm, and wrist when subjects performed kinematic tasks with and without a pressurized suit. The glove study consisted of testing three conditions - the Series 4000 glove, the Phase VI glove, and the no glove condition. With more than forty channels of sensor data total, it was critical to develop programs that could analyze data with basic descriptive statistics and generate relevant graphs to help understand what happens within the space suit and glove. In my project I created a Graphical User Interface (GUI) in MATLAB that would help me visualize what each sensor was doing within a task. The GUI is capable of displaying overlain plots and can be synchronized with video. This was helpful during the stiffness testing to visualize how the forces on the arm acted while the subject performed tasks such as shoulder adduction/abduction and bicep curls. The main project of focus, however, was the glove comparison study. I wrote MATLAB programs which generated movies of the strain vectors during specific tasks. I also generated graphs that summarized the differences between each glove for the strain, shear and FSR sensors. Preliminary results indicate that the Phase VI glove places less strain and shear on the hand. Future work includes continued data analysis of surveys and sensor data. In the end, the ideal glove is one that provides more tactility for the astronauts but lessens injuries. Often times, a more tactile glove transmits forces better to the hand; thus, achieving a balance of both a tactile and safe glove is the main challenge present.

Thomas, Neha↗
NASA NTRS1986

Pilot interface with fly by wire control systems

Aircraft designers are rapidly moving toward full fly by wire control systems for transport aircraft. Aside from pilot interface considerations such as location of the control input device and its basic design such as side stick, there appears to be a desire to change the fundamental way in which a pilot applies manual control. A typical design would have the lowest order of manual control be a control wheel steering mode in which the pilot is controlling an autopilot. This deprives the pilot of the tactile sense of angle of attack which is inherent in present aircraft by virtue of certification requirements for static longitudinal stability whereby a pilot must either force the aircraft away from its trim angle of attack or trim to a new angle of attack. Whether or not an aircraft actually has positive stability, it can be made to feel to a pilot as though it does by artificial feel. Artificial feel systems which interpret pilot input as pitch rate or G rate with automatic trim have proven useful in certain military combat maneuvers, but their transposition to other more normal types of manual control may not be justified.

Melvin, W. W.↗
NASA NTRS1988

Machine intelligence and autonomy for aerospace systems

The present volume discusses progress toward intelligent robot systems in aerospace applications, NASA Space Program automation and robotics efforts, the supervisory control of telerobotics in space, machine intelligence and crew/vehicle interfaces, expert-system terms and building tools, and knowledge-acquisition for autonomous systems. Also discussed are methods for validation of knowledge-based systems, a design methodology for knowledge-based management systems, knowledge-based simulation for aerospace systems, knowledge-based diagnosis, planning and scheduling methods in AI, the treatment of uncertainty in AI, vision-sensing techniques in aerospace applications, image-understanding techniques, tactile sensing for robots, distributed sensor integration, and the control of articulated and deformable space structures.

Heer, Ewald↗
NASA NTRS1989

On discrete control of nonlinear systems with applications to robotics

Much progress has been reported in the areas of modeling and control of nonlinear dynamic systems in a continuous-time framework. From implementation point of view, however, it is essential to study these nonlinear systems directly in a discrete setting that is amenable for interfacing with digital computers. But to develop discrete models and discrete controllers for a nonlinear system such as robot is a nontrivial task. Robot is also inherently a variable-inertia dynamic system involving additional complications. Not only the computer-oriented models of these systems must satisfy the usual requirements for such models, but these must also be compatible with the inherent capabilities of computers and must preserve the fundamental physical characteristics of continuous-time systems such as the conservation of energy and/or momentum. Preliminary issues regarding discrete systems in general and discrete models of a typical industrial robot that is developed with full consideration of the principle of conservation of energy are presented. Some research on the pertinent tactile information processing is reviewed. Finally, system control methods and how to integrate these issues in order to complete the task of discrete control of a robot manipulator are also reviewed.

Eslami, Mansour↗