Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “COGNITIVE WORKLOAD”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

APPLICATION OF EYE TRACKING FOR MEASUREMENT AND EVALUATION IN HUMAN FACTORS STUDIES IN CONTROL ROOM MODERNIZATION

An important element of human factors engineering (HFE) pertains to measurement and evaluation (M&E). The role of HFE-M&E should be integrated throughout the entire control room modernization (CRM) process and be used for human-system performance evaluation and diagnostic purposes with resolving potential human engineering deficiencies (HEDs) and other human machine interface (HMI) design issues. NUREG-0711 describes how HFE in CRM should employ a hierarchical set of measures, particularly during integrated system validation (ISV), including plant performance, personnel task performance, situation awareness, cognitive workload, and anthropometric/ physiological factors. Historically, subjective measures have been primarily used since they are easier to collect and do not require specialized equipment. However, there are pitfalls with relying solely on subjective measures in M&E such that negatively impact reliability, sensitivity, and objectivity. As part of comprehensively capturing a diverse set of measures that strengthen findings and inferences made of the benefits from emerging technologies like advanced displays, this paper discusses the value of using eye tracking as an objective method that can be used in M&E. A brief description of eye tracking technology and relevant eye tracking measures is provided. Additionally, technical considerations and the unique challenges with using eye tracking in full-scaled simulations are addressed. Finally, this paper shares preliminary findings regarding the use of a wearable eye tracking system in a full-scale simulator study. These findings should help guide future full-scale simulator studies using eye tracking as a methodology to evaluate human-system performance.

99 GENERAL AND MISCELLANEOUS↗

Application of eye tracking for measurement and evaluation in human factors studies in control room modernization - 309

An important element of human factors engineering (HFE) pertains to measurement and evaluation (M and E). The role of HFE-M and E should be integrated throughout the entire control room modernization (CRM) process and be used for human-system performance evaluation and diagnostic purposes with resolving potential human engineering deficiencies (HEDs) and other human machine interface (HMI) design issues. NUREG-0711 describes how HFE in CRM should employ a hierarchical set of measures, particularly during integrated system validation (ISV), including plant performance, personnel task performance, situation awareness, cognitive workload, and anthropometric/ physiological factors. Historically, subjective measures have been primarily used since they are easier to collect and do not require specialized equipment. However, there are pitfalls with relying solely on subjective measures in M and E such that negatively impact reliability, sensitivity, and objectivity. As part of comprehensively capturing a diverse set of measures that strengthen findings and inferences made of the benefits from emerging technologies like advanced displays, this paper discusses the value of using eye tracking as an objective method that can be used in M and E. A brief description of eye tracking technology and relevant eye tracking measures is provided. Additionally, technical considerations and the unique challenges with using eye tracking in full-scaled simulations are addressed. Finally, this paper shares preliminary findings regarding the use of a wearable eye tracking system in a full-scale simulator study. These findings should help guide future full-scale simulator studies using eye tracking as a methodology to evaluate human-system performance. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Enhancing power plant safety through simulated cyber events - 341

There are gaps in understanding how a cyber-attack would manifest itself within power plants and what these events would look like within the control room from an operator's perspective. This is especially true for nuclear power plants where safety has much broader consequences than nonnuclear plants. The operating and emergency procedures that operators currently use are likely inadequate for targeted cyber-attacks. This research focuses on understanding how a cyber event would affect the operation of the plant, how an operator would perceive the event, and if the operator's actions would keep the plant in a safe condition. This research is part of Sandia's Laboratory Directed Research and Development program where a nuclear power plant cyber model of the control system digital architecture is coupled with a generic pressurized water reactor plant training simulator. Cyber event scenarios will be performed on the coupled system with plant operators. The scenarios simulate plant conditions that may exist during a cyber-attack, component failure, or insider sabotage, and provide an understanding of the displayed information and the actual plant conditions. These scenarios will determine if plant operators can 1) recognize that they are under cyber-attack and 2) take appropriate actions to keep the plant safe. This will also provide the opportunity to assess the operator cognitive workload during such events and identify where improvements might be made. Experiments with nuclear power plant operators will be carried out over FY 2018 and results of the research are expected by the end of FY 2018. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Automation - Changes in cognitive demands and mental workload

The effect of partial automation on mental workloads in man/machine tasks is investigated experimentally. Subjective workload measures are obtained from six subjects after performance of a task battery comprising two manual (flight-path control, FC, and target acquisition, TA) tasks and one decisionmaking (engine failure, EF) task; the FC task was performed in both a fully manual (altitude and lateral control) mode and in a semiautomated mode (autmatic latitude control). The performance results and subjective evaluations are presented in graphs and characterized in detail. The automation is shown to improve objective performance and lower subjective workload significantly in the combined FC/TA task, but not in the FC task alone or in the FC/EF task.

Tsang, Pamela S.↗

Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) – Physical Workload Approximation

The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a hybrid reality exploration surface analog, “Assessments of Physiology and Cognition in Hybrid-reality Environments” (APACHE). The goal of APACHE is to create a planetary extravehicular activity (EVA) simulation environment that provides a representative physical and cognitive workload approximation using a combination of virtual reality (VR), physical reality, and hybrid reality (HR) techniques. To develop and characterize the physical workload approximation within the APACHE environment, a two-part approach was implemented. In part 1, baseline physical work load during ambulation within APACHE was evaluated and compared with that in other planetary EVA analog environments and with existing data sets from Apollo planetary EVAs and reduced gravity testing of prototype planetary spacesuits. For this evaluation, 10 subjects were asked to ambulate in three surface analog environments: a passive treadmill in APACHE, natural terrain in an outdoor field environment, and a standard motorized treadmill. Subjects’ heart rate and metabolic rate (VO2/VCO2) were measured and compared among the different test conditions and existing data sets. Gait parameters were also collected to compare with suited mechanics and to understand the role of gait kinematics in physical workload. In part 2, the aim is to evaluate the addition of a custom weighted body suit to the aforementioned surface analog environments and the ability to titrate the suit configuration to provide the best possible physical workload approximation for simulation of lunar and Martian EVAs.

Alex Baughman↗

Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) – Physical Workload Approximation

The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a hybrid reality exploration surface analog, “Assessments of Physiology And Cognition in Hybrid-reality Environments” (APACHE). The goal of APACHE is to create a planetary extravehicular activity (EVA) simulation environment that provides a representative physical and cognitive workload approximation using a combination of virtual reality (VR), physical reality, and hybrid reality (HR) techniques. To develop and characterize the physical workload approximation within the APACHE environment, a two-part approach was implemented. In part 1, baseline physical workload during ambulation within APACHE was evaluated and compared with that in other planetary EVA analog environments and with existing data sets from Apollo planetary EVAs and reduced gravity testing of prototype planetary spacesuits. For this evaluation, 10 subjects were asked to ambulate in three surface analog environments: a passive treadmill in APACHE, natural terrain in an outdoor field environment, and a standard motorized treadmill. Subjects’ heart rate and metabolic rate (VO2/VCO2)were measured and compared among the different test conditions and existing data sets. Gait parameters were also collected to compare with suited mechanics and to understand the role of gait kinematics in physical workload. In part 2, the aim is to evaluate the addition of a custom weighted body suit to the aforementioned surface analog environments and the ability to titrate the suit configuration to provide the best possible physical workload approximation for simulation of lunar and Martian EVAs.

Alexander J Baughman↗

Predicting operator workload during system design

A workload prediction methodology was developed in response to the need to measure workloads associated with operation of advanced aircraft. The application of the methodology will involve: (1) conducting mission/task analyses of critical mission segments and assigning estimates of workload for the sensory, cognitive, and psychomotor workload components of each task identified; (2) developing computer-based workload prediction models using the task analysis data; and (3) exercising the computer models to produce predictions of crew workload under varying automation and/or crew configurations. Critical issues include reliability and validity of workload predictors and selection of appropriate criterion measures.

Aldrich, Theodore B.↗

Cognitive and affective components of mental workload: Understanding the effects of each on human decision making behavior

Human factors and ergonomics researchers have recognized for some time the increasing importance of understanding the role of the construct of mental workload in flight research. Current models of mental workload suggest that it is a multidimensional and complex construct, but one that has proved difficult to measure. Because of this difficulty, emphasis has usually been placed on using direct reports through subjective measures such as rating scales to assess levels of mental workload. The NASA Task Load Index (NASA/TLX, Hart and Staveland) has been shown to be a highly reliable and sensitive measure of perceived mental workload. But a problem with measures like TLX is that there is still considerable disagreement as to what it is about mental workload that these subjective measures are actually measuring. The empirical use of subjective workload measures has largely been to provide estimates of the cognitive components of the actual mental workload required for a task. However, my research suggests that these measures may, in fact have greater potential in accurately assessing the affective components of workload. That is, for example, TLX may be more likely to assess the positive and negative feelings associated with varying workload levels, which in turn may potentially influence the decision making behavior that directly bears on performance and safety issues. Pilots, for example, are often called upon to complete many complex tasks that are high in mental workload, stress, and frustration, and that have significant dynamic decision making components -- often ones that involve risk as well.

Nygren, Thomas E.↗

Subjective rating scales as a workload

A multidimensional bipolar-adjective rating scale is employed as a subjective measure of operator workload in the performance of a one-axis tracking task. The rating scale addressed several dimensions of workload, including cognitive, physical, and perceptual task loading as well as fatigue and stress effects. Eight subjects performed a one-axis tracking task (with six levels of difficulty) and rated these tasks on several workload dimensions. Performance measures were tracking error RMS (root-mean square) and the standard deviation of control stick output. Significant relationships were observed between these performance measures and skill required, task complexity, attention level, task difficulty, task demands, and stress level.

Bird, K. L.↗

Physiological and Subjective Responses of Pilots during Advanced Air Mobility Flight Testing with Automated Systems

Aviation is constantly evolving, mostly due to the integration of automated systems into the National Airspace System. This presents a host of challenges and opportunities. NASA’s Advanced Air Mobility (AAM) project has taken a significant leap forward with a research flight test led by the Integration of Automated Systems (IAS) sub-project. This effort focused on assessing automated flight deck algorithms essential for supporting high-density Urban Air Mobility (UAM) operations. Carrying out a two-ship flight test in UAM Maturity Level 4 scenarios, the team evaluated state-of-the-art algorithms, including Hazard Perception and Avoidance (HPA) and flight path management (FPM) systems. This paper investigates into pilots’ physiological and subjective responses during the flight scenarios conducted. In collaboration with Lockheed Martin Advanced Technology Laboratories (ATL), we collected and analyzed live-flight biometric data using eye tracking, mobile brain imaging, and heart rate sensors. The study provides insights into pilots’ workload and cognitive engagement while navigating automated tools, leveraging both biometric data and post-encounter subjective assessments. The research highlights the interaction between human operators and automated systems, contributing valuable lessons learned about gathering human data in live-flight environments. The knowledge acquired from this study enhances our understanding of human factors in automated flight and informs future studies attempting to undertake similar feats.

Kevin J. Monk↗

Physiological and Subjective Responses of Pilots During Advanced Air Mobility Flight Testing With Automated Systems

Aviation is constantly evolving, mostly due to the integration of automated systems into the National Airspace System. This presents a host of challenges and opportunities. NASA's Advanced Air Mobility (AAM) project has taken a significant leap forward with a research flight test led by the Integration of Automated Systems (IAS) sub-project. This effort focused on assessing automated flight deck algorithms essential for supporting high-density Urban Air Mobility (UAM) operations. Carrying out a two-ship flight test in UAM Maturity Level 4 scenarios, the team evaluated state-of-the-art algorithms, including Hazard Perception and Avoidance (HPA) and flight path management (FPM) systems. This presentation focuses on results of pilots' physiological and subjective responses during the flight scenarios conducted. In collaboration with Lockheed Martin Advanced Technology Laboratories (ATL), we collected and analyzed live-flight biometric data using eye tracking, mobile brain imaging, and heart rate sensors. The data provides insights into pilots' workload and cognitive engagement while navigating automated tools, leveraging both biometric data and post-encounter subjective assessments. The research highlights the interaction between human operators and automated systems, contributing valuable lessons learned about gathering human data in live-flight environments. The knowledge acquired from this endeavor enhances our understanding of human factors in automated flight and informs future studies attempting to undertake similar feats.

air mobility↗

PNNL’s Shared Perspectives Technology

Shared Perspectives, one of the technologies within the PNNL-developed GridOPTICS capability suite, enables neighboring organizations, such as different electric utilities, to more effectively partner to solve outages and other grid problems. Shared Perspectives provides a means for organizations to safely stream information from different organizational service areas; the technology then combines and aligns this information into a common, global view, enhancing global situation awareness that can reduce the time it takes to talk through a problem and identify solutions. The technology potentially offers applications in other areas, such as disaster response; collaboration in the monitoring/assessment of real-time events (e.g., hurricanes, earthquakes, and tornadoes); as well as military uses.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Psychophysiological Monitoring of Aerospace Crew State

As next-generation space exploration missions necessitate increasingly autonomous systems, there is a critical need to better detect and anticipate crewmember interactions with these systems. The success of present and future autonomous technology in exploration spaceflight is ultimately dependent upon safe and efficient interaction with the human operator. Optimal interaction is particularly important for surface missions during highly coordinated extravehicular activity (EVA), which consists of high physical and cognitive demands with limited ground support. Crew functional state may be affected by a number of variables including workload, stress, and motivation. Real-time assessments of crew state that do not require a crewmember’s time and attention to complete will be especially important to assess operational performance and behavioral health during flight. In response to the need for objective, passive assessment of crew state, the aim of this work is to develop an accurate and precise prediction model of human functional state for surface EVA using multi-modal psychophysiological sensing. The psychophysiological monitoring approach relies on extracting a set of features from physiological signals and using these features to classify an operator’s cognitive state. This work aims to compile a non-invasive sensor suite to collect physiological data in real-time. Training data during cognitive and more complex functional tasks will be used to develop a classifier to discriminate high and low cognitive workload crew states. The classifier will then be tested in an operationally relevant EVA simulation to predict cognitive workload over time. Once a crew state is determined, further research into specific countermeasures, such as decision support systems, would be necessary to optimize the automation and improve crew state and operational performance.

Wusk, Grace C.↗

Physiological Based Simulator Fidelity Design Guidance

The evolution of the role of flight simulation has reinforced assumptions in aviation that the degree of realism in a simulation system directly correlates to the training benefit, i.e., more fidelity is always better. The construct of fidelity has several dimensions, including physical fidelity, functional fidelity, and cognitive fidelity. Interaction of different fidelity dimensions has an impact on trainee immersion, presence, and transfer of training. This paper discusses research results of a recent study that investigated if physiological-based methods could be used to determine the required level of simulator fidelity. Pilots performed a relatively complex flight task consisting of mission task elements of various levels of difficulty in a fixed base flight simulator and a real fighter jet trainer aircraft. Flight runs were performed using one forward visual channel of 40 deg. field of view for the lowest level of fidelity, 120 deg. field of view for the middle level of fidelity, and unrestricted field of view and full dynamic acceleration in the real airplane. Neuro-cognitive and physiological measures were collected under these conditions using the Cognitive Avionics Tool Set (CATS) and nonlinear closed form models for workload prediction were generated based on these data for the various mission task elements. One finding of the work described herein is that simple heart rate is a relatively good predictor of cognitive workload, even for short tasks with dynamic changes in cognitive loading. Additionally, we found that models that used a wide range of physiological and neuro-cognitive measures can further boost the accuracy of the workload prediction.

Schnell, Thomas↗

Adaptation of time line analysis program to single pilot instrument flight research

A data base was developed for SPIFR operation and the program was run. The outputs indicated that further work was necessary on the workload models. In particular, the workload model for the cognitive channel should be modified as the output workload appears to be too small. Included in the needed refinements are models to show the workload when in turbulence, when overshooting a radial or glideslope, and when copying air traffic control clearances.

Hinton, D. A.↗

Usability Evaluation of Spot and Runway Departure Advisor (SARDA) Concept in Dallas/Fort Worth Airport Tower Simulation

Spot and Runway Departure Advisor (SARDA) is a proposed decision-support tool for air traffic control tower controllers for reducing taxi delay and optimizing the departure sequence. In the present study, the tool's usability was evaluated to ensure that its claimed performance benefits are not being realized at the cost of increasing the work burden on controllers. For the evaluation, workload ratings and questionnaire responses collected during a human-in-the-loop simulation experiment were analyzed to assess the SARDA advisories' effects on the controllers' ratings on cognitive resources (e.g., workload, spare attention) and satisfaction. The results showed that SARDA reduced the controllers' workload and increased their spare attention. It also made workload and attention levels less susceptible to the effects of increases in the traffic load. The questionnaire responses suggested that the controllers generally were satisfied with the ease of use of the tool and the objectives of the SARDA concept, but with some caution. To gain more trust from controllers, the the reasoning behind advisories may need to be made more transparent to them.

human factors↗

Cognitive consequences of clumsy automation on high workload, high consequence human performance

The growth of computational power has fueled attempts to automate more of the human role in complex problem solving domains, especially those where system faults have high consequences and where periods of high workload may saturate the performance capacity of human operators. Examples of these domains include flightdecks, space stations, air traffic control, nuclear power operation, ground satellite control rooms, and surgical operating rooms. Automation efforts may have unanticipated effects on human performance, particularly if they increase the workload at peak workload times or change the practitioners' strategies for coping with workload. Smooth and effective changes in automation requires detailed understanding of the congnitive tasks confronting the user: it has been called user centered automation. The introduction of a new computerized technology in a group of hospital operating rooms used for heart surgery was observed. The study revealed how automation, especially 'clumsy automation', effects practitioner work patterns and suggest that clumsy automation constrains users in specific and significant ways. Users tailor both the new system and their tasks in order to accommodate the needs of process and production. The study of this tailoring may prove a powerful tool for exposing previously hidden patterns of user data processing, integration, and decision making which may, in turn, be useful in the design of more effective human-machine systems.

Cook, Richard I.↗

Demonstration and Evaluation of the Human-Technology Integration Function Allocation Methodology

There is an imminent need for the existing nuclear power plants to reduce their operating and maintenance (O&M) costs to remain economically viable. Digital technology, including automation, provides a significant opportunity for the existing nuclear power plant fleet to transform the way in which work is accomplished, reducing O&M costs, and allowing the fleet to remain economically competitive. One notable opportunity to significantly reduce O&M costs pertains to modifications to the plant equipment and main control room (MCR). Existing instrumentation and control (I&C) technologies in the MCR are highly analog, costly to operate and maintain, and demand a high cognitive and physical workload from plant staff (i.e., operators). Digitalizing the MCR has a range of broad economic benefits, including improved plant performance and reduced manual work. Further, digital I&C systems can fundamentally change the way in which plant staff operate the plant; this is the concept of operation. Human-technology integration is important to ensure that impacts to the concept of operation are done in a way that account for capabilities of people and technology. Human-technology integration employs human factors engineering (HFE) methods and principles to maximize the benefits of digital technology, reducing human error, improving overall decision-making and usability. The U.S. Department of Energy Light Water Reactor Sustainability Program is applying human-technology integration research to ensure digital technologies are safe, reliable, and efficient. This paper documents the demonstration of the human-technology guidance developed by the Light Water Reactor Sustainability Program from a first-of-a-kind digital I&C upgrade, specifically addressing function analysis and allocation for a new digital I&C system that included changes in automation levels. The program’s specific approach is included in this work, following lessons learned. This document serves as a resource for industry to follow in applying human-technology integration and HFE to digital modifications, specific to function analysis and allocation. The lessons learned should be considered in the planning and execution of HFE activities that support such digital modifications.

99 GENERAL AND MISCELLANEOUS↗