Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “COGNITIVE WORKLOAD”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Human Factors in Accidents Involving Remotely Piloted Aircraft

This presentation examines human factors that contribute to RPA mishaps and provides analysis of lessons learned. RPA accident data from U.S. military and government agencies were reviewed and analyzed to identify human factors issues. Common contributors to RPA mishaps fell into several major categories: cognitive factors (pilot workload), physiological factors (fatigue and stress), environmental factors (situational awareness), staffing factors (training and crew coordination), and design factors (human machine interface).

Merlin, Peter William↗

Assessments of Physiology and Cognition in Hybrid-Reality Environments (APACHE)

NASA is planning to return to the Moon in the mid-2020s as a stepping stone to Mars missions in the 2030s. Spacewalks, or extravehicular activities (EVAs), performed on the Moon and Mars will differ in a variety of ways from those that have been performed in decades past. NASA has identified multiple risks to human health and performance associated with a crewed mission to Mars, especially those associated with exploration EVAs which are expected to be a primary mission activity. Crew may be expected to conduct up to 24 hours of EVA per person per week, where the likelihood of injury and/or mental mistakes are increased compared to ground-based training or current microgravity EVAs and the consequences of which can be catastrophic. Current test environments for exploration EVA research and technology development are large, costly facilities that are limited in their availability or capabilities. Spacesuit testing in a reduced gravity environment such as NASA’s Neutral Buoyancy Laboratory, while a good representation of the crew’s physical workload during exploration EVAs, typically has small datasets and is difficult to integrate physiological sensors or other types of crew performance measures. Meanwhile, scientific field-based testing such as NASA’s Desert Research and Technology Studies offers an operationally relevant environment for exploration EVAs, particularly for cognitive workload, but is also limited by small datasets, lack of a pressurized spacesuit, and obtrusive measures. The limitations of current analogs for exploration EVAs identify a need for a new test environment that can approximate both the physical and cognitive demands associated with exploration EVAs to enable rapid, controlled, and repeatable evaluations of human health and performance risks of exploration missions. In response, the Human Physiology, Performance, Protection, and Operations Laboratory (H-3PO) at NASA Johnson Space Center has developed a hybrid reality exploration EVA analog named the Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) to address these limitations using a combination of virtual, physical, and hybrid reality techniques. The APACHE facility resides at NASA Johnson Space Center and serves as a large “sandbox” for EVA research and simulation. At its center is a roughly 15x20ft space surrounded by a 14” tall sandbox partially filled with lunar regolith simulant to emulate the physical feeling of walking on a planetary surface and to allow for simulated geology operations. Nearby, a curved passive treadmill (Skillmill Connect, Technogym, Fairfield, NJ) and an omnidirectional treadmill (Infinadeck, Infinadeck, Rocklin, CA) are included to enable exploration of these large virtual environments while also imposing the physical demands, representative timelines, and cognitive burdens required to navigate and traverse these distances during exploration EVA. A 6DOF motion platform is used to simulate rover operations and supports various human performance evaluations and associated risks. Lastly, APACHE can support two extravehicular (EV) crewmembers working in tandem. A computer workstation is located nearby and also supports an intravehicular (IV) crewmember as part of a full mission simulation. The IV crewmember has direct video and audio communication with the EV crew in VR to provide operational and procedural support. The software used in APACHE was created by the JSC Engineering Directorate, in partnership with Buendea, powered by a custom Unreal Engine 5 (UE5.3, Epic Games) project. APACHE currently utilizes the HTC Vive Pro Eye in a wireless configuration for VR simulations. There are two virtual environments that subjects can explore within APACHE, a Lunar and Martian surface. The virtual Lunar surface was created from LIDAR data of the Lunar South Pole to create roughly 16 sq km of explorable terrain. The virtual Martian surface contains roughly 400 sq km of explorable terrain derived from Mars Reconnaissance Orbiter LIDAR data of the Jezero Crater. The immersion and related cognitive burdens of conducting a planetary EVA is simulated through a series of EVA-relevant tasks performed in the VR environment, using these high-fidelity visual representations. Additionally, APACHE includes biosensor driven informatics, such as real-time heart rate monitoring and/or derived values from model simulations, for active monitoring by the EV crew and added cognitive demand. A “Wizard of Oz” control panel enables test operators to activate contingency events such as simulated spacesuit malfunctions, loss of communications, and/or limited visibility. Embedded performance measures such as accuracy, completeness, and execution time have been developed for various exploration tasks to objectively quantify crew performance during an EVA and compare impacts to performance when different environmental stressors, both physical and cognitive, are added to or removed from the simulation. Additionally, validated cognitive and operational performance measures such as the Digit Symbol Substitution Task have been recreated and embedded in VR for direct and relatively unobtrusive measurement of motor perception. The APACHE environment currently supports multiple research studies at NASA. Examples include the CHAPEA project, a series of simulated year-long missions on Mars by a 4-person crew; and the CO2 Contingency Walk Back Study, an investigation of elevated CO2 exposure on crew performance during a contingency EVA scenario. APACHE also provides a test environment to support the development of the Crew State and Risk Model, which is a collection of individualized, mathematical models of crew physical and cognitive state; and the Personalized EVA Informatics and Decision Support system, an operational tool for flight controllers, and eventually a self-reliant Martian crew, to make biomedically-informed decisions in real-time to optimize the EVA planning and execution with respect to crew health and performance. Some technical challenges associated with developing the APACHE environment, as well as current limitations, include VR limitless natural walking with a hybrid spacesuit simulator, optimizing performance for wireless PC VR streaming while maintaining a high degree of visual fidelity, and the integration of various physiological (metabolic masks) and psychometric (eye tracking) sensors with the VR headset.

Human Performance↗

Assessments of Physiology and Cognition in Hybrid-Reality Environments (APACHE) – A VR “Sandbox” for Planetary Spacewalk Research

NASA is planning to return to the Moon in the mid-2020s as a steppingstone to Mars missions in the 2030s. Spacewalks, or extravehicular activities (EVAs), performed on the Moon and Mars will differ in a variety of ways from those that have been performed in decades past. NASA has identified multiple risks to human health and performance associated with a crewed mission to Mars, especially those associated with exploration EVAs which are expected to be a primary mission activity. Crew may be expected to conduct up to 24 hours of EVA per person per week, where the likelihood of injury and/or mental mistakes are increased compared to ground-based training or current microgravity EVAs and the consequences of which can be catastrophic. Current test environments for exploration EVA research and technology development are large, costly facilities that are limited in their availability or capabilities. Spacesuit testing in a reduced gravity environment such as NASA’s Neutral Buoyancy Laboratory, while a good representation of the crew’s physical workload during exploration EVAs, typically has small datasets and is difficult to integrate physiological sensors or other types of crew performance measures. Meanwhile, scientific field-based testing such as NASA’s Desert Research and Technology Studies offers an operationally relevant environment for exploration EVAs, particularly for cognitive workload, but is also limited by small datasets, lack of a pressurized spacesuit, and obtrusive measures. The limitations of current analogs for exploration EVAs identify a need for a new test environment that can approximate both the physical and cognitive demands associated with exploration EVAs to enable rapid, controlled, and repeatable evaluations of human health and performance risks of exploration missions. In response, the Human Physiology, Performance, Protection, and Operations Laboratory (H-3PO) at NASA Johnson Space Center has developed a hybrid reality exploration EVA analog named the Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE)[ to address these limitations using a combination of virtual, physical, and hybrid reality techniques. The APACHE facility resides at NASA Johnson Space Center and serves as a large “sandbox” for EVA research and simulation. At its center is a roughly 15x20ft space surrounded by a 14” tall sandbox partially filled with lunar regolith simulant to emulate the physical feeling of walking on a planetary surface and to allow for simulated geology operations. Nearby, a curved passive treadmill (Skillmill Connect, Technogym, Fairfield, NJ) and an omnidirectional treadmill (Infinadeck, Infinadeck, Rocklin, CA) are included to enable exploration of these large virtual environments while also imposing the physical demands, representative timelines, and cognitive burdens required to navigate and traverse these distances during exploration EVA. A 6DOF motion platform is used to simulate rover operations and supports various human performance evaluations and associated risks. Lastly, APACHE can support two extravehicular (EV) crewmembers working in tandem. A computer workstation is located nearby and also supports an intravehicular (IV) crewmember as part of a full mission simulation. The IV crewmember has direct video and audio communication with the EV crew in VR to provide operational and procedural support.

Human Performance↗

A Preliminary Assessment of Cognition and Fatigue During Simulated Lunar Surface Extravehicular Activities

Introduction: Artemis astronauts will be required to complete more rigorous Extravehicular Activity (EVA) schedules than during ever before. While new spacesuits are designed to sustain high physical workloads during exploration EVAs (xEVA), crewmembers must also sustain cognitive performance throughout xEVA timelines. It is therefore necessary to characterize the effects of surface xEVA tasks and timelines on cognition and fatigue. Methods: This study utilized NASA Johnson Space Center’s Active Response Gravity Offload System (ARGOS) to simulate lunar gravity and assess xEVA tasks and cognitive performance. Two subjects completed two ~5-hour EVAs in a pressurized Mark III spacesuit, completing simulated lander operations, cable routing, crew rescue, geology, payload relocation, and traverses. Subjects completed two cognitive assessments (Digit-Symbol Substitution Task (DSST) and Psychomotor Vigilance Task (PVT)) before the first and after the second simulated EVA to assess effects of xEVA tasks on processing speed and vigilant attention. Additionally, sleep (e.g., quality, duration, and efficiency) was monitored (Oura Ring) for ≥7 days prior to the simulated EVAs, as well as between each EVA, to account for possible effects of sleep decrements on cognitive metrics. Results: Cognitive performance changed minimally from pre to post EVA for both DSST (response time (RT): S1 Δ129.1ms, S2 Δ40.7ms; Accuracy: S1 preEVA = 1.0, S1 postEVA = 0.98, S2 preEVA = 1.0, S2 postEVA = 1.0) and PVT (S1 PVT RT Δ17.7 ms, S2 PVT RT Δ-2.7 ms). Subjects’ sleep duration immediately prior to EVA showed minimal deviation from baseline (Δhrs; S1 preEVA1= + 0.67, S1 preEVA2 = -.03, S2 preEVA1 = - 1.1, S2 preEVA2 = -1.39) and efficiency (Δ%; S1 preEVA1 = 0.09, S1 preEVA2 = 9.54, S2 preEVA1 = 0, S2 preEVA2= 12). Notably, sleep waketime shifted earlier for one subject by ~1 hr which may have impacted performance. Conclusion: Understanding the impacts of xEVA workloads on cognitive performance will be instrumental to future exploration mission planning and success. Future work will expand the subject pool and test new spacesuit designs to better characterize cognitive performance and impacts of sleep during simulated xEVA and inform modeling and prediction capabilities for future Artemis xEVA planning.

Taylor E. Schlotman↗

Telerobotic control of a dextrous manipulator using master and six-DOF hand-controllers for space assembly and servicing tasks

Two studies were conducted evaluating methods of controlling a telerobot; bilateral force reflecting master controllers and proportional rate six degrees of freedom (DOF) hand controllers. The first study compared the controllers on performance of single manipulator arm tasks, a peg-in-the-hole task, and simulated satellite orbital replacement unit changeout. The second study, a Space Station truss assembly task, required simultaneous operation of both manipulator arms (all 12 DOFs) and complex multiaxis slave arm movements. Task times were significantly longer and fewer errors were committed with the hand controllers. The hand controllers were also rated significantly higher in cognitive and manual control workload on the two-arm task. The master controllers were rated significantly higher in physical workload. There were no significant differences in ratings of manipulator control quality.

O'Hara, John M.↗

Control strategies for a telerobot

One of the major issues impacting the utility of telerobotic systems for space is the development of effective control strategies. For near-term applications, telerobot control is likely to utilize teleoperation methodologies with integrated supervisory control capabilities to assist the operator. Two different approaches to telerobotic control are evaluated: bilateral force reflecting master controllers and proportional rate six degrees-of-freedom hand controllers. The controllers' performance of single manipulator arm tasks is compared. Simultaneous operation of both manipulator arms and complex multiaxis slave arm movements is investigated. Task times are significantly longer and fewer errors are committed with the hand controllers. The hand controllers are also rated significantly higher in cognitive and manual control workload on the two-arm task. The master controllers are rated significantly higher in physical workload. The implications of these findings for space teleoperations and higher levels of control are discussed.

Ohara, John↗

The Challenge of Aviation Emergency and Abnormal Situations

Emergency and abnormal situations occur on flights everyday around the world. They range from minor situations readily managed to extremely serious and highly time-critical situations that deeply challenge the skills of even the most effective crews. How well crews respond to these situations is a function of several interacting sets of issues: (1) the design of non-normal procedures and checklists, (2) design of aircraft systems and automation, (3) specific aspects of the non-normal situation, such as time criticality and complexity of the situation, (4) human performance capabilities and cognitive limitations under high workload and stress, (5) design of training for non-normal situations, (6) philosophies, policies and practices within the industry, and (7) economic and regulatory constraints. Researchers and pilots working on NASA's Emergency and Abnormal Situations project are addressing these issues in a long-range study. In this paper we discuss these issues and illustrate them with examples from recent incidents and accidents.

Burian, Barbara K.↗

Bayesian Safety Risk Modeling of Human-Flightdeck Automation Interaction

Usage of automatic systems in airliners has increased fuel efficiency, added extra capabilities, enhanced safety and reliability, as well as provide improved passenger comfort since its introduction in the late 80's. However, original automation benefits, including reduced flight crew workload, human errors or training requirements, were not achieved as originally expected. Instead, automation introduced new failure modes, redistributed, and sometimes increased workload, brought in new cognitive and attention demands, and increased training requirements. Modern airliners have numerous flight modes, providing more flexibility (and inherently more complexity) to the flight crew. However, the price to pay for the increased flexibility is the need for increased mode awareness, as well as the need to supervise, understand, and predict automated system behavior. Also, over-reliance on automation is linked to manual flight skill degradation and complacency in commercial pilots. As a result, recent accidents involving human errors are often caused by the interactions between humans and the automated systems (e.g., the breakdown in man-machine coordination), deteriorated manual flying skills, and/or loss of situational awareness due to heavy dependence on automated systems. This paper describes the development of the increased complexity and reliance on automation baseline model, named FLAP for FLightdeck Automation Problems. The model development process starts with a comprehensive literature review followed by the construction of a framework comprised of high-level causal factors leading to an automation-related flight anomaly. The framework was then converted into a Bayesian Belief Network (BBN) using the Hugin Software v7.8. The effects of automation on flight crew are incorporated into the model, including flight skill degradation, increased cognitive demand and training requirements along with their interactions. Besides flight crew deficiencies, automation system failures and anomalies of avionic systems are also incorporated. The resultant model helps simulate the emergence of automation-related issues in today's modern airliners from a top-down, generalized approach, which serves as a platform to evaluate NASA developed technologies

Ancel, Ersin↗

Single-Pilot Workload Management

Integrated glass cockpit systems place a heavy cognitive load on pilots (Burian Dismukes, 2007). Researchers from the NASA Ames Flight Cognition Lab and the FAA Flight Deck Human Factors Lab examined task and workload management by single pilots. This poster describes pilot performance regarding programming a reroute while at cruise and meeting a waypoint crossing restriction on the initial descent.

Rogers, Jason↗

An Approach to Quantify Workload in a System of Agents

The role of humans in aviation and other domains continues to shift from manual control to automation monitoring. Studies have found that humans are often poorly suited for monitoring roles, and workload can easily spike in off-nominal situations. Current workload measurement tools, like NASA TLX, use human operators to assess their own workload after using a prototype system. Such measures are used late in the design process and can result in ex- pensive alterations when problems are discovered. Our goal in this work is to provide a quantitative workload measure for use early in the design process. We leverage research in human cognition to de ne metrics that can measure workload on belief-desire-intentions based multi-agent systems. These measures can alert designers to potential workload issues early in design. We demonstrate the utility of our approach by characterizing quantitative differences in the workload for a single pilot operations model compared to a traditional two pilot model.

Single Pilot Operations↗

Levels of Information Processing in a Fitts law task (LIPFitts)

State-of-the-art flight technology has restructured the task of human operators, decreasing the need for physical and sensory resources, and increasing the quantity of cognitive effort required, changing it qualitatively. Recent technological advances have the most potential for impacting a pilot in two areas: performance and mental workload. In an environment in which timing is critical, additional cognitive processing can cause performance decrements, and increase a pilot's perception of the mental workload involved. The effects of stimulus processing demands on motor response performance and subjective mental workload are examined, using different combinations of response selection and target acquisition tasks. The information processing demands of the response selection were varied (e.g., Sternberg memory set tasks, math equations, pattern matching), as was the difficulty of the response execution. Response latency as well as subjective workload ratings varied in accordance with the cognitive complexity of the task. Movement times varied according to the difficulty of the response execution task. Implications in terms of real-world flight situations are discussed.

Mosier, K. L.↗

Pupillometric measurement of operator workload

Pupillometry as a method of measuring workload is described. Pupillometric measures provide an indication of momentary fluctuations in central nervous system excitability that occur as cognitive operations are performed; the magnitude of these changes may serve as a sensitive indicator of the workload imposed by cognitive tasks.

Beatty, J.↗

Team Performance and Error Management in Chinese and American Simulated Flight Crews: The Role of Cultural and Individual Differences

This report describes results of a study conducted for NASA-Langley Research Center. This study is part of a program of research conducted for NASA-LARC that has focused on identifying the influence of national culture on the performance of flight crews. We first reviewed the literature devoted to models of teamwork and team performance, crew resource management, error management, and cross-cultural psychology. Davis (1999) reported the results of this review and presented a model that depicted how national culture could influence teamwork and performance in flight crews. The second study in this research program examined accident investigations of foreign airlines in the United States conducted by the National Transportation Safety Board (NTSB). The ability of cross-cultural values to explain national differences in flight outcomes was examined. Cultural values were found to covary in a predicted way with national differences, but the absence of necessary data in the NTSB reports and limitations in the research method that was used prevented a clear understanding of the causal impact of cultural values. Moreover, individual differences such as personality traits were not examined in this study. Davis and Kuang (2001) report results of this second study. The research summarized in the current report extends this previous research by directly assessing cultural and individual differences among students from the United States and China who were trained to fly in a flight simulator using desktop computer workstations. The research design used in this study allowed delineation of the impact of national origin, cultural values, personality traits, cognitive style, shared mental model, and task workload on teamwork, error management and flight outcomes. We briefly review the literature that documents the importance of teamwork and error management and its impact on flight crew performance. We next examine teamwork and crew resource management training designed to improve teamwork. This is followed by discussion of the potential influence of national culture on teamwork and crew resource management. We then examine the influence of other individual and team differences, such as personality traits, cognitive style, shared mental model, and task workload. We provide a heuristic model that depicts the influence of national culture and individual differences on teamwork, error management and flight outcomes. The results demonstrate the usefulness of the model for future research.

Davis, Donald D.↗

Human Performance Measures for the Evaluation of Nuclear Power Plant Control Room Interfaces: A Systematic Review - 265

The purpose of this study was to review the literature related to measuring human performance in the design and evaluation of the human-system interface (HSI) of nuclear power plant (NPP) control rooms and synthesize lessons learned and future directions for research and practice in this field. The design and evaluation of digital or hybrid HSI requires comprehensive measurement of human performance to ensure quality and safety of the nuclear power process control. Human factors evaluation frameworks have been proposed to guide the measurement of human performance constructs. However, there are few guides for selecting appropriate measures for those constructs. A systematic review of empirical research literature was conducted. Studies were identified through academic publication databases and grey literature searches. Eligible studies were coded and information regarding human performance measures was extracted and analyzed. A total of 80 studies met the criteria. Human performance measures extracted from the reviewed studies included measures of: behavioral performance; workload; situation awareness; human-human or human-machine cooperation; other cognitive performance indicators; and system performance. Behavioral performance (speed and accuracy), workload, and situation awareness were the most frequently measured constructs with validated and domain-specific instruments. The results of the literature review provided an overview of the human performance constructs and their corresponding measures for NPP control room HSI evaluation. These results can be used as an initial guide to establish appropriate and comprehensive measurements of human performance for such evaluations. Future directions in measure development are also discussed. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SHAPA: An interactive software tool for protocol analysis applied to aircrew communications and workload

As modern transport environments become increasingly complex, issues such as crew communication, interaction with automation, and workload management have become crucial. Much research is being focused on holistic aspects of social and cognitive behavior, such as the strategies used to handle workload, the flow of information, the scheduling of tasks, the verbal and non-verbal interactions between crew members. Traditional laboratory performance measures no longer sufficiently meet the needs of researchers addressing these issues. However observational techniques are better equipped to capture the type of data needed and to build models of the requisite level of sophistication. Presented here is SHAPA, an interactive software tool for performing both verbal and non-verbal protocol analysis. It has been developed with the idea of affording the researchers the closest possible degree of engagement with protocol data. The researcher can configure SHAPA to encode protocols using any theoretical framework or encoding vocabulary that is desired. SHAPA allows protocol analysis to be performed at any level of analysis, and it supplies a wide variety of tools for data aggregation, manipulation. The output generated by SHAPA can be used alone or in combination with other performance variables to get a rich picture of the influences on sequences of verbal or nonverbal behavior.

James, Jeffrey M.↗

EXPLORING THE POTENTIAL OF SHORT-TIME FOURIER TRANSFORMS FOR ANALYZING SKIN CONDUCTANCE AND PUPILLOMETRY IN REAL-TIME APPLICATIONS

The development of real-time predictors of mental workload is critical for the practical application of augmented cognition to human-machine systems. This paper explores a novel method based on a short-time Fourier transform (STFT) for analyzing galvanic skin conductance (SC) and pupillometry time-series data to extract estimates of mental workload with temporal bandwidth high-enough to be useful for augmented cognition applications. We tested the method in the context of a process control task based on the DURESS simulation developed by Vincente and Pawlak (1994; ported to Java by Cosentino,& Ross, 1999). SC, pupil dilation, blink rate, and visual scanning patterns were measured for four participants actively engaged in controlling the simulation. Fault events were introduced that required participants to diagnose errors and make control adjustments to keep the simulator operating within a target range. We were interested in whether the STFT of these measures would produce visible effects of the increase in mental workload and stress associated with these events. Graphical exploratory data analysis of the STFT showed visible increases in the power spectrum across a range of frequencies directly following fault events. We believe this approach shows potential as a relatively unobtrusive, low-cost, high bandwidth measure of mental workload that could be particularly useful for the application of augmented cognition to human-machine systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗