Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cognitive task analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

Acquisition and production of skilled behavior in dynamic decision-making tasks

Detailed summaries of two NASA-funded research projects are provided. The first project was an ecological task analysis of the Star Cruiser model. Star Cruiser is a psychological model designed to test a subject's level of cognitive activity. Ecological task analysis is used as a framework to predict the types of cognitive activity required to achieve productive behavior and to suggest how interfaces can be manipulated to alleviate certain types of cognitive demands. The second project is presented in the form of a thesis for the Masters Degree. The thesis discusses the modeling of decision-making through the use of neural network and genetic-algorithm machine learning technologies.

Kirlik, Alex↗
NASA NTRS1993

Brain wave correlates of attentional states: Event related potentials and quantitative EEG analysis during performance of cognitive and perceptual tasks

The increased use of automation in the cockpits of commercial planes has dramatically decreased the workload requirements of pilots, enabling them to function more efficiently and with a higher degree of safety. Unfortunately, advances in technology have led to an unexpected problem: the decreased demands on pilots have increased the probability of inducing 'hazardous states of awareness.' A hazardous state of awareness is defined as a decreased level of alertness or arousal which makes an individual less capable of reacting to unique or emergency types of situations. These states tend to be induced when an individual is not actively processing information. Under such conditions a person is likely to let his/her mind wander, either to internal states or to irrelevant external conditions. As a result, they are less capable of reacting quickly to emergency situations. Since emergencies are relatively rare, and since the high automated cockpit requires progressively decreasing levels of engagement, the probability of being seduced into a lowered state of awareness is increasing. This further decreases the readiness of the pilot to react to unique circumstances such as system failures. The HEM Lab at NASA-Langley Research Center has been studying how these states of awareness are induced and what the physiological correlates of these different states are. Specifically, they have been interested in studying electroencephalographic (EEG) measures of different states of alertness to determine if such states can be identified and, hopefully, avoided. The project worked on this summer involved analyzing the EEG and the event related potentials (ERP) data collected while subjects performed under two conditions. Each condition required subjects to perform a relatively boring vigilance task. The purpose of using these tasks was to induce a decreased state of awareness while still requiring the subject to process information. Each task involved identifying an infrequently presented target stimulus. In addition to the task requirements, irrelevant tones were presented in the background. Research has shown that even though these stimuli are not attended, ERP's to them can still be elicited. The amplitude of the ERP waves has been shown to change as a function of a person's level of alertness. ERP's were also collected and analyzed for the target stimuli for each task. Brain maps were produced based on the ERP voltages for the different stimuli. In addition to the ERP's, a quantitative EEG (QEEG) was performed on the data using a fast Fourier technique to produce a power spectral analysis of the EEG. This analysis was conducted on the continuous EEG while the subjects were performing the tasks. Finally, a QEEG was performed on periods during the task when subjects indicated that they were in an altered state of awareness. During the tasks, subjects were asked to indicate by pressing a button when they realized their level of task awareness had changed. EEG epochs were collected for times just before and just after subjects made this reponse. The purpose of this final analysis was to determine whether or not subjective indices of level of awareness could be correlated with different patterns of EEG.

Freeman, Frederick G.↗
NASA NTRSDate not supplied

Human-Autonomy Teaming Research in Support of m:N Operations

Since 2019, the NASA and industry partners have been involved in research focused on a novel paradigm for operations of remotely piloted aircraft. This paradigm involves multiple people sharing a fleet of multiple vehicles between them. Referred to as m:N (pronounced “em-to-en”), this configuration describes a ratio where m is the number of operators and N is the number of vehicles. Through force and asset multiplication, the m:N concept seeks to enable a scalable and resilient operation of remotely crewed vehicles. The primary means of obtaining such a robust operation is through allowing a flexible crew of variable size to dynamically attend to the needs of assets in while performing real-time operator workload management. It is in that sense that assets are shared between operators: as needed (such as in events of elevated workload) an operator in an m:N context can “handoff” the responsibility for some amount of assets, nh < N, to be absorbed by the m – 1 crew members on staff. At some time later, these nh assets could be returned to their original owner or they may be further distributed to other crew if called for by the mission. During this panel, I will elaborate on the research activity undertaken by the Human-Autonomy Teaming (HAT) Laboratory at NASA Ames Research Center over the previous three years. The studies conducted by the HAT Lab range from interviews with subject matter experts, a cognitive walkthrough, a task analysis, and two simulation experiments to-date. During experimentation, pilots made use of an advanced Ground Control Station developed by the HAT Lab and industry partners to simulate m:N operations in two large, metropolitan areas of Southern California: Los Angeles and San Diego. Further experimentation planned over the next few years. Results from our research to-date indicates that pilots of a moderately sized fleet of about a dozen remotely crewed aircraft adequately maintained safety performance and situation awareness of their aircraft, even when presented with unexpected situations of heightened workload.

multi-vehicle control↗
NASA NTRS1987

User engineering: A new look at system engineering

User Engineering is a new System Engineering perspective responsible for defining and maintaining the user view of the system. Its elements are a process to guide the project and customer, a multidisciplinary team including hard and soft sciences, rapid prototyping tools to build user interfaces quickly and modify them frequently at low cost, and a prototyping center for involving users and designers in an iterative way. The main consideration is reducing the risk that the end user will not or cannot effectively use the system. The process begins with user analysis to produce cognitive and work style models, and task analysis to produce user work functions and scenarios. These become major drivers of the human computer interface design which is presented and reviewed as an interactive prototype by users. Feedback is rapid and productive, and user effectiveness can be measured and observed before the system is built and fielded. Requirements are derived via the prototype and baselined early to serve as an input to the architecture and software design.

Mclaughlin, Larry L.↗
NASA NTRSDate not supplied

Cognitive Engineering in Training: Monitoring and Pilot-Automation Coordination in Complex Environments

This paper reports our investigation of flight path monitoring in aviation. We interviewed experienced pilots to understand the knowledge and skills underlying effective monitoring and we developed an example learning environment to improve these skills. We explore how design of pilot training and learning, like the design of interfaces and of the underlying automation, benefits from cognitive engineering methods and perspective. In aviation, monitoring and managing flight path are critical activities. The influences on flight path are complex and come from the autoflight system, from control actions by the pilot, and from external factors, including weather and Air Traffic Control (ATC). Indeed, inadequate flight path monitoring is a current aviation concern as it has been implicated in accidents and incidents. Effective piloting depends on strategies for noticing, understanding, and anticipating these influences to monitor and manage flight path. Lack of such skills reduces pilots' ability to maintain safety margin and resilience. Although flightdeck automation is intended to aid pilot understanding and prediction, the Fight Management Systems (FMS) can mislead as well as aid the pilot's understanding and projection of what will happen. In dynamic conditions, FMS predictions may be based on old or incomplete information. Understanding such vulnerabilities is an important part of pilot-autoflight coordination. The learning environment we developed is designed to help pilots proactively monitor and manage flight path. We consider how a broad cognitive engineering approach might inform the "what" and "how" of learning in dynamic work domains.

pilot-monitoring↗
NASA NTRS2002

Workload-Matched Adaptive Automation Support of Air Traffic Controller Information Processing Stages

Adaptive automation (AA) has been explored as a solution to the problems associated with human-automation interaction in supervisory control environments. However, research has focused on the performance effects of dynamic control allocations of early stage sensory and information acquisition functions. The present research compares the effects of AA to the entire range of information processing stages of human operators, such as air traffic controllers. The results provide evidence that the effectiveness of AA is dependent on the stage of task performance (human-machine system information processing) that is flexibly automated. The results suggest that humans are better able to adapt to AA when applied to lower-level sensory and psychomotor functions, such as information acquisition and action implementation, as compared to AA applied to cognitive (analysis and decision-making) tasks. The results also provide support for the use of AA, as compared to completely manual control. These results are discussed in terms of implications for AA design for aviation.

Kaber, David B.↗
NASA NTRS1991

The design of electronic map displays

This paper presents a cognitive analysis of a pilot's navigation task and describes an experiment comparing a new map display that employs the principle of visual momentum with the two traditional approaches, track-up and north-up. The data show that the advantage of a track-up alignment is its congruence with the egocentered forward view; however, the inconsistency of the rotating display hinders development of a cognitive map. The stability of a north-up alignment aids the acquisition of a cognitive map, but there is a cost associated with the mental rotation of the display to a track-up alignment for tasks involving the ego-centered forward view. The data also show that the visual momentum design captures the benefits and reduces the costs associated with the two traditional approaches.

Aretz, Anthony J.↗
NASA NTRS2018

Cooperative Automation Supporting Pilot-Dispatch Negotiation of Enroute Trajectory Change Requests

The advent of advanced technologies in communication, navigation, and surveillance is enabling more integration between the aircraft and the ground systems in managing air traffic operations. As a result, automation has evolved to provide the flight crew, air traffic controllers, and traffic flow managers with capabilities for collaborating on information access, analysis, and decision making. In this paper, we investigate different cooperative schemes between these agents, supported by automation, in managing dynamic trajectory changes while the flight is en route to improve flight and system performance. The analysis was conducted using an abstract cognitive tasking framework to identify trajectory change tasks independently from the agent performing them. Cooperation schemes were then derived by assessing different levels of cooperation on each task between the air and ground agents and their automation. The assessment was based on which automation-supported agent is more capable of performing the task and the expected benefit mechanisms that result from cooperating. The cooperation schemes were compared based on a qualitative, but objective, assessment of the benefits expected from cooperation.

air-ground integration↗
NASA NTRS2003

Enabling computer decisions based on EEG input

Multilayer neural networks were successfully trained to classify segments of 12-channel electroencephalogram (EEG) data into one of five classes corresponding to five cognitive tasks performed by a subject. Independent component analysis (ICA) was used to segregate obvious artifact EEG components from other sources, and a frequency-band representation was used to represent the sources computed by ICA. Examples of results include an 85% accuracy rate on differentiation between two tasks, using a segment of EEG only 0.05 s long and a 95% accuracy rate using a 0.5-s-long segment.

Validation Studies↗
NASA NTRS2005

Coping with Trial-to-Trial Variability of Event Related Signals: A Bayesian Inference Approach

In electro-neurophysiology, single-trial brain responses to a sensory stimulus or a motor act are commonly assumed to result from the linear superposition of a stereotypic event-related signal (e.g. the event-related potential or ERP) that is invariant across trials and some ongoing brain activity often referred to as noise. To extract the signal, one performs an ensemble average of the brain responses over many identical trials to attenuate the noise. To date, h s simple signal-plus-noise (SPN) model has been the dominant approach in cognitive neuroscience. Mounting empirical evidence has shown that the assumptions underlying this model may be overly simplistic. More realistic models have been proposed that account for the trial-to-trial variability of the event-related signal as well as the possibility of multiple differentially varying components within a given ERP waveform. The variable-signal-plus-noise (VSPN) model, which has been demonstrated to provide the foundation for separation and characterization of multiple differentially varying components, has the potential to provide a rich source of information for questions related to neural functions that complement the SPN model. Thus, being able to estimate the amplitude and latency of each ERP component on a trial-by-trial basis provides a critical link between the perceived benefits of the VSPN model and its many concrete applications. In this paper we describe a Bayesian approach to deal with this issue and the resulting strategy is referred to as the differentially Variable Component Analysis (dVCA). We compare the performance of dVCA on simulated data with Independent Component Analysis (ICA) and analyze neurobiological recordings from monkeys performing cognitive tasks.

Ding, Mingzhou↗
NASA NTRS2002

Automating CPM-GOMS

CPM-GOMS is a modeling method that combines the task decomposition of a GOMS analysis with a model of human resource usage at the level of cognitive, perceptual, and motor operations. CPM-GOMS models have made accurate predictions about skilled user behavior in routine tasks, but developing such models is tedious and error-prone. We describe a process for automatically generating CPM-GOMS models from a hierarchical task decomposition expressed in a cognitive modeling tool called Apex. Resource scheduling in Apex automates the difficult task of interleaving the cognitive, perceptual, and motor resources underlying common task operators (e.g. mouse move-and-click). Apex's UI automatically generates PERT charts, which allow modelers to visualize a model's complex parallel behavior. Because interleaving and visualization is now automated, it is feasible to construct arbitrarily long sequences of behavior. To demonstrate the process, we present a model of automated teller interactions in Apex and discuss implications for user modeling. available to model human users, the Goals, Operators, Methods, and Selection (GOMS) method [6, 21] has been the most widely used, providing accurate, often zero-parameter, predictions of the routine performance of skilled users in a wide range of procedural tasks [6, 13, 15, 27, 28]. GOMS is meant to model routine behavior. The user is assumed to have methods that apply sequences of operators and to achieve a goal. Selection rules are applied when there is more than one method to achieve a goal. Many routine tasks lend themselves well to such decomposition. Decomposition produces a representation of the task as a set of nested goal states that include an initial state and a final state. The iterative decomposition into goals and nested subgoals can terminate in primitives of any desired granularity, the choice of level of detail dependent on the predictions required. Although GOMS has proven useful in HCI, tools to support the construction of GOMS models have not yet come into general use.

GOMS↗
NASA NTRS2011

A Systematic Approach for Engagement Analysis Under Multitasking Environments

An overload condition can lead to high stress for an operator and further cause substantial drops in performance. On the other extreme, in automated systems, an operator may become underloaded; in which case, it is difficult for the operator to maintain sustained attention. When an unexpected event occurs, either internal or external to the automated system, a disengaged operation may neglect, misunderstand, or respond slowly/inappropriately to the situation. In this paper, we discuss a systematic approach monitor for extremes of cognitive workload and engagement in multitasking environments. Inferences of cognitive workload ar engagement are based on subjective evaluations, objective performance measures, physiological signals, and task analysis results. The systematic approach developed In this paper aggregates these types of information collected under the multitasking environment and can provide a real-time assessment or engagement.

Zhang, Guangfan↗
NASA NTRS2019

The Cognition and Fine Motor Skills Test Batteries: Normative Data and Interdependencies

Space mission success and safety relies upon astronaut functional state. Since spaceflight stressors affect cognitive processing and fine motor skills, NASA requires that measures of performance of these things remain within clinically accepted values (NASA STD 3001). NASA is in the process of developing two test batteries for the assessment of crew cognitive and fine motor skills before, during and after spaceflight. Toward that goal, the current project collected normative scores in 91 “astronaut-like” military and civilian pilots. The Cognition Test Battery (CTB) contains ten sub-tests that measure a range of cognitive abilities. For five of the ten CTB sub-tests, we propose scores to improve the battery’s sensitivity. Among the ten sub-tests, response times were more highly correlated than accuracy scores. Principle component analysis of the correlations revealed that the first response time factor could explain over 40% of the total variance and appeared to represent the tendency of observers to try to respond more quickly. The first accuracy factor (explaining only 20%) gave a high weight to the higher level cognitive sub-tests and a negative weight to tasks associated with motor and lower level cognitive processing. The Fine Motor Skills (FMS) test battery contains four sub-tests (Tracking, Pointing, Tracing, Rotating) performed on an Apple iPad tablet computer. Principle component analysis on the sub-test response time correlations revealed that the first two factors accounted for ~80% of the variance in performance. The first component captured overall speed on all four of the sub-tests. The second factor separated the sub-tasks into two groups (Drag-Point vs Trace-Rotate). Previous work found the first group response times correlated with that of a standard peg board task, while those of the other group did not. Correlations were computed between the first FMS factor and the response time and accuracy scores from each CTB sub-task. Performing fine motor behaviors rapidly was significantly correlated with the ability to perform many of the CTB sub-tests rapidly. This ability cannot be simple motor speed since scores on the Psychomotor Vigilance Test (PVT) subtask did not correlate with the ability to perform the other tasks rapidly. Speed on fine motor skills correlated significantly with accuracy on the short-term-memory sub-test. We hypothesize that eye movements, which can be regarded as a fine motor skill, may explain this relationship.

cognition↗
NASA NTRS2024

Vertiport Management from Simulation to Flight: Continued Human Factors Assessment of Vertiport Operations

The Urban Air Mobility concept envisions a new future for transportation in urban environments, primarily focused around vertiport operations. A vertiport refers to an identifiable ground or elevated area used for the vertical takeoff and landing of an aircraft. One critical role within vertiport operations that has been proposed but is under-researched is the vertiport manager. The vertiport manager is expected to manage the ground-to-air operations at the vertiport, but their precise responsibilities, tasks, and challenges are currently undefined. The High Density Vertiplex Subproject at NASA is responsible for developing and testing technologies, concepts, and architectures that will support the infrastructure needed for terminal environments around vertiports. Our previous work investigated ground control station operators performing simulated and live flight operations within a remote operations environment. In the current study, we extended from our previous work to explore the role of a vertiport manager. Specifically, we investigated five participants serving as a vertiport manager across both simulated and live flight operations. We performed multiple knowledge elicitation techniques, a thematic content analysis of qualitative data, and naturalistic observations to create a list of insights, design and training recommendations, and a simplified cognitive task diagram of the vertiport manager’s primary task. Findings from this study are discussed within the context of the current debate on the degree to which this role should be automated. A third alternative is suggested to allow a human vertiport manager to be successful by teaming with increasingly autonomous systems, designing the role to improve safety and efficiency of Urban Air Mobility operations.

AAM↗
NASA NTRS2024

Vertiport Management from Simulation to Flight: Continued Human Factors Assessment of Vertiport Operations

The Urban Air Mobility concept envisions a new future for transportation in urban environments, primarily focused around vertiport operations. A vertiport refers to an identifiable ground or elevated area used for the vertical takeoff and landing of an aircraft. One critical role within vertiport operations that has been proposed but is under-researched is the vertiport manager. The vertiport manager is expected to manage the ground-to-air operations at the vertiport, but their precise responsibilities, tasks, and challenges are currently undefined. The High Density Vertiplex Subproject at NASA is responsible for developing and testing technologies, concepts, and architectures that will support the infrastructure needed for terminal environments around vertiports. Our previous work investigated ground control station operators performing simulated and live flight operations within a remote operations environment. In the current study, we extended from our previous work to explore the role of a vertiport manager. Specifically, we investigated five participants serving as a vertiport manager across both simulated and live flight operations. We performed multiple knowledge elicitation techniques, a thematic content analysis of qualitative data, and naturalistic observations to create a list of insights, design and training recommendations, and a simplified cognitive task diagram of the vertiport manager’s primary task. Findings from this study are discussed within the context of the current debate on the degree to which this role should be automated. A third alternative is suggested to allow a human vertiport manager to be successful by teaming with increasingly autonomous systems, designing the role to improve safety and efficiency of Urban Air Mobility operations.

AAM↗
NASA NTRS1988

Predicting operator workload during system design

A workload prediction methodology was developed in response to the need to measure workloads associated with operation of advanced aircraft. The application of the methodology will involve: (1) conducting mission/task analyses of critical mission segments and assigning estimates of workload for the sensory, cognitive, and psychomotor workload components of each task identified; (2) developing computer-based workload prediction models using the task analysis data; and (3) exercising the computer models to produce predictions of crew workload under varying automation and/or crew configurations. Critical issues include reliability and validity of workload predictors and selection of appropriate criterion measures.

Aldrich, Theodore B.↗
NASA NTRS2021

Exploration Mission Tasks: A Technical Manual

This technical manual is an abridgement of the Generalizable Skills and Knowledge for Exploration Missions (NASA/CR-2018-22045) report (Stuster et al., 2019), describing research conducted under Cooperative Agreement 80NSSC18K0042 for the Human Factors and Behavioral Performance Element, Human Research Program, located at the National Aeronautics and Space Administration’s (NASA) Johnson Space Center. The research identified tasks that will be conducted by human crew during an expedition to Mars, and the abilities, skills, and knowledge that will be required of crew members. The 3-year study uses research methods that were developed to analyze the work performed by a variety of civilian and military occupational specialties and is consistent with Human Factors methods. The work began by developing a comprehensive inventory of 1,125 tasks that are likely to be performed during the 12 phases of the first human expeditions to Mars, from launch to landing 30 months later. Sixty subject matter experts (SMEs) rated expedition tasks in terms of (likely) frequency of performance, difficulty to learn, and importance to mission success; a fourth metric (criticality), was derived by summing the mean ratings of the three dimensions. Seventy-two SMEs placed the physical, cognitive, and social abilities necessary to perform the tasks in order of importance for specialist domains identified by the task analysis. The research team then identified: 1) Abilities, skills, and knowledge that can be retained and generalized across tasks and 2) Implications for crew size and composition. Study results also led to recommendations concerning equipment, habitats, and procedures for exploration-class space missions. Note: The full-mission task inventory was developed during a comprehensive review of documentation and concepts of operations. It was understood by the study team that the tasks were based on currently available information, and that the tools, equipment, propulsion methods, and/or other aspects of actual human expeditions to Mars might be different from those described here, as a consequence of technological development and evolving Mars Design Reference Missions. The purpose and scope of this technical manual is to present the core, actionable information that resulted from this research. The abridged format is intended to address the needs of development and research teams to quickly access, discern, and use the information in the course of their exploration-related work.

Brandin Munson↗