Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “cognitive task analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Cooperative Automation Supporting Pilot-Dispatch Negotiation of Enroute Trajectory Change Requests

The advent of advanced technologies in communication, navigation, and surveillance is enabling more integration between the aircraft and the ground systems in managing air traffic operations. As a result, automation has evolved to provide the flight crew, air traffic controllers, and traffic flow managers with capabilities for collaborating on information access, analysis, and decision making. In this paper, we investigate different cooperative schemes between these agents, supported by automation, in managing dynamic trajectory changes while the flight is en route to improve flight and system performance. The analysis was conducted using an abstract cognitive tasking framework to identify trajectory change tasks independently from the agent performing them. Cooperation schemes were then derived by assessing different levels of cooperation on each task between the air and ground agents and their automation. The assessment was based on which automation-supported agent is more capable of performing the task and the expected benefit mechanisms that result from cooperating. The cooperation schemes were compared based on a qualitative, but objective, assessment of the benefits expected from cooperation.

air-ground integration↗

Comparing capacity coefficient and dual task assessment of visual multitasking workload

Capacity coefficient analysis could offer a theoretically grounded alternative approach to subjective measures and dual task assessment of cognitive workload. Workload capacity or workload efficiency is a human information processing modeling construct defined as the amount of information that can be processed by the visual cognitive system given a specified of amount of time. In this paper, I explore the relationship between capacity coefficient analysis of workload efficiency and dual task response time measures. To capture multitasking performance, I examine how the relatively simple assumptions underlying the capacity construct generalize beyond the single visual decision making tasks. The fundamental tools for measuring workload efficiency are the integrated hazard and reverse hazard functions of response times, which are defined by log transforms of the response time distribution. These functions are used in the capacity coefficient analysis to provide a functional assessment of the amount of work completed by the cognitive system over the entire range of response times. For the study of visual multitasking, capacity coefficient analysis enables a comparison of visual information throughput as the number of tasks increases from one to two to any number of simultaneous tasks. I illustrate the use of capacity coefficients for visual multitasking on sample data from dynamic multitasking in the modified Multi-attribute Task Battery.

capacity coefficient↗

Enabling computer decisions based on EEG input

Multilayer neural networks were successfully trained to classify segments of 12-channel electroencephalogram (EEG) data into one of five classes corresponding to five cognitive tasks performed by a subject. Independent component analysis (ICA) was used to segregate obvious artifact EEG components from other sources, and a frequency-band representation was used to represent the sources computed by ICA. Examples of results include an 85% accuracy rate on differentiation between two tasks, using a segment of EEG only 0.05 s long and a 95% accuracy rate using a 0.5-s-long segment.

Validation Studies↗

Coping with Trial-to-Trial Variability of Event Related Signals: A Bayesian Inference Approach

In electro-neurophysiology, single-trial brain responses to a sensory stimulus or a motor act are commonly assumed to result from the linear superposition of a stereotypic event-related signal (e.g. the event-related potential or ERP) that is invariant across trials and some ongoing brain activity often referred to as noise. To extract the signal, one performs an ensemble average of the brain responses over many identical trials to attenuate the noise. To date, h s simple signal-plus-noise (SPN) model has been the dominant approach in cognitive neuroscience. Mounting empirical evidence has shown that the assumptions underlying this model may be overly simplistic. More realistic models have been proposed that account for the trial-to-trial variability of the event-related signal as well as the possibility of multiple differentially varying components within a given ERP waveform. The variable-signal-plus-noise (VSPN) model, which has been demonstrated to provide the foundation for separation and characterization of multiple differentially varying components, has the potential to provide a rich source of information for questions related to neural functions that complement the SPN model. Thus, being able to estimate the amplitude and latency of each ERP component on a trial-by-trial basis provides a critical link between the perceived benefits of the VSPN model and its many concrete applications. In this paper we describe a Bayesian approach to deal with this issue and the resulting strategy is referred to as the differentially Variable Component Analysis (dVCA). We compare the performance of dVCA on simulated data with Independent Component Analysis (ICA) and analyze neurobiological recordings from monkeys performing cognitive tasks.

Ding, Mingzhou↗

Automating CPM-GOMS

CPM-GOMS is a modeling method that combines the task decomposition of a GOMS analysis with a model of human resource usage at the level of cognitive, perceptual, and motor operations. CPM-GOMS models have made accurate predictions about skilled user behavior in routine tasks, but developing such models is tedious and error-prone. We describe a process for automatically generating CPM-GOMS models from a hierarchical task decomposition expressed in a cognitive modeling tool called Apex. Resource scheduling in Apex automates the difficult task of interleaving the cognitive, perceptual, and motor resources underlying common task operators (e.g. mouse move-and-click). Apex's UI automatically generates PERT charts, which allow modelers to visualize a model's complex parallel behavior. Because interleaving and visualization is now automated, it is feasible to construct arbitrarily long sequences of behavior. To demonstrate the process, we present a model of automated teller interactions in Apex and discuss implications for user modeling. available to model human users, the Goals, Operators, Methods, and Selection (GOMS) method [6, 21] has been the most widely used, providing accurate, often zero-parameter, predictions of the routine performance of skilled users in a wide range of procedural tasks [6, 13, 15, 27, 28]. GOMS is meant to model routine behavior. The user is assumed to have methods that apply sequences of operators and to achieve a goal. Selection rules are applied when there is more than one method to achieve a goal. Many routine tasks lend themselves well to such decomposition. Decomposition produces a representation of the task as a set of nested goal states that include an initial state and a final state. The iterative decomposition into goals and nested subgoals can terminate in primitives of any desired granularity, the choice of level of detail dependent on the predictions required. Although GOMS has proven useful in HCI, tools to support the construction of GOMS models have not yet come into general use.

GOMS↗

A Systematic Approach for Engagement Analysis Under Multitasking Environments

An overload condition can lead to high stress for an operator and further cause substantial drops in performance. On the other extreme, in automated systems, an operator may become underloaded; in which case, it is difficult for the operator to maintain sustained attention. When an unexpected event occurs, either internal or external to the automated system, a disengaged operation may neglect, misunderstand, or respond slowly/inappropriately to the situation. In this paper, we discuss a systematic approach monitor for extremes of cognitive workload and engagement in multitasking environments. Inferences of cognitive workload ar engagement are based on subjective evaluations, objective performance measures, physiological signals, and task analysis results. The systematic approach developed In this paper aggregates these types of information collected under the multitasking environment and can provide a real-time assessment or engagement.

Zhang, Guangfan↗

The Use Of Computational Human Performance Modeling As Task Analysis Tool

During a review of the Advanced Test Reactor safety basis at the Idaho National Laboratory, human factors engineers identified ergonomic and human reliability risks involving the inadvertent exposure of a fuel element to the air during manual fuel movement and inspection in the canal. There were clear indications that these risks increased the probability of human error and possible severe physical outcomes to the operator. In response to this concern, a detailed study was conducted to determine the probability of the inadvertent exposure of a fuel element. Due to practical and safety constraints, the task network analysis technique was employed to study the work procedures at the canal. Discrete-event simulation software was used to model the entire procedure as well as the salient physical attributes of the task environment, such as distances walked, the effect of dropped tools, the effect of hazardous body postures, and physical exertion due to strenuous tool handling. The model also allowed analysis of the effect of cognitive processes such as visual perception demands, auditory information and verbal communication. The model made it possible to obtain reliable predictions of operator performance and workload estimates. It was also found that operator workload as well as the probability of human error in the fuel inspection and transfer task were influenced by the concurrent nature of certain phases of the task and the associated demand on cognitive and physical resources. More importantly, it was possible to determine with reasonable accuracy the stages as well as physical locations in the fuel handling task where operators would be most at risk of losing their balance and falling into the canal. The model also provided sufficient information for a human reliability analysis that indicated that the postulated fuel exposure accident was less than credible.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

The Cognition and Fine Motor Skills Test Batteries: Normative Data and Interdependencies

Space mission success and safety relies upon astronaut functional state. Since spaceflight stressors affect cognitive processing and fine motor skills, NASA requires that measures of performance of these things remain within clinically accepted values (NASA STD 3001). NASA is in the process of developing two test batteries for the assessment of crew cognitive and fine motor skills before, during and after spaceflight. Toward that goal, the current project collected normative scores in 91 “astronaut-like” military and civilian pilots. The Cognition Test Battery (CTB) contains ten sub-tests that measure a range of cognitive abilities. For five of the ten CTB sub-tests, we propose scores to improve the battery’s sensitivity. Among the ten sub-tests, response times were more highly correlated than accuracy scores. Principle component analysis of the correlations revealed that the first response time factor could explain over 40% of the total variance and appeared to represent the tendency of observers to try to respond more quickly. The first accuracy factor (explaining only 20%) gave a high weight to the higher level cognitive sub-tests and a negative weight to tasks associated with motor and lower level cognitive processing. The Fine Motor Skills (FMS) test battery contains four sub-tests (Tracking, Pointing, Tracing, Rotating) performed on an Apple iPad tablet computer. Principle component analysis on the sub-test response time correlations revealed that the first two factors accounted for ~80% of the variance in performance. The first component captured overall speed on all four of the sub-tests. The second factor separated the sub-tasks into two groups (Drag-Point vs Trace-Rotate). Previous work found the first group response times correlated with that of a standard peg board task, while those of the other group did not. Correlations were computed between the first FMS factor and the response time and accuracy scores from each CTB sub-task. Performing fine motor behaviors rapidly was significantly correlated with the ability to perform many of the CTB sub-tests rapidly. This ability cannot be simple motor speed since scores on the Psychomotor Vigilance Test (PVT) subtask did not correlate with the ability to perform the other tasks rapidly. Speed on fine motor skills correlated significantly with accuracy on the short-term-memory sub-test. We hypothesize that eye movements, which can be regarded as a fine motor skill, may explain this relationship.

cognition↗

El Agente: An autonomous agent for quantum chemistry

Computational chemistry tools are widely used to study the behavior of chemical phenomena. Yet, the complexity of these tools can make them inaccessible to non-specialists and challenging even for experts. In this work, we introduce El Agente Q, an LLM-based multi-agent system that dynamically generates and executes quantum chemistry workflows from natural language user prompts. The system is built on a novel cognitive architecture featuring a hierarchical memory framework that enables flexible task decomposition, adaptive tool selection, post-analysis, and autonomous file handling and submission. El Agente Q is benchmarked on six university-level course exercises and two case studies, demonstrating robust problem-solving performance (averaging >87% task success) and adaptive error handling through in situ debugging. It also supports longer-term, multi-step task execution for more complex workflows, while maintaining transparency through detailed action trace logs. Together, these capabilities lay the foundation for increasingly autonomous and accessible quantum chemistry.

agentic systems↗

Vertiport Management from Simulation to Flight: Continued Human Factors Assessment of Vertiport Operations

The Urban Air Mobility concept envisions a new future for transportation in urban environments, primarily focused around vertiport operations. A vertiport refers to an identifiable ground or elevated area used for the vertical takeoff and landing of an aircraft. One critical role within vertiport operations that has been proposed but is under-researched is the vertiport manager. The vertiport manager is expected to manage the ground-to-air operations at the vertiport, but their precise responsibilities, tasks, and challenges are currently undefined. The High Density Vertiplex Subproject at NASA is responsible for developing and testing technologies, concepts, and architectures that will support the infrastructure needed for terminal environments around vertiports. Our previous work investigated ground control station operators performing simulated and live flight operations within a remote operations environment. In the current study, we extended from our previous work to explore the role of a vertiport manager. Specifically, we investigated five participants serving as a vertiport manager across both simulated and live flight operations. We performed multiple knowledge elicitation techniques, a thematic content analysis of qualitative data, and naturalistic observations to create a list of insights, design and training recommendations, and a simplified cognitive task diagram of the vertiport manager’s primary task. Findings from this study are discussed within the context of the current debate on the degree to which this role should be automated. A third alternative is suggested to allow a human vertiport manager to be successful by teaming with increasingly autonomous systems, designing the role to improve safety and efficiency of Urban Air Mobility operations.

AAM↗

Vertiport Management from Simulation to Flight: Continued Human Factors Assessment of Vertiport Operations

The Urban Air Mobility concept envisions a new future for transportation in urban environments, primarily focused around vertiport operations. A vertiport refers to an identifiable ground or elevated area used for the vertical takeoff and landing of an aircraft. One critical role within vertiport operations that has been proposed but is under-researched is the vertiport manager. The vertiport manager is expected to manage the ground-to-air operations at the vertiport, but their precise responsibilities, tasks, and challenges are currently undefined. The High Density Vertiplex Subproject at NASA is responsible for developing and testing technologies, concepts, and architectures that will support the infrastructure needed for terminal environments around vertiports. Our previous work investigated ground control station operators performing simulated and live flight operations within a remote operations environment. In the current study, we extended from our previous work to explore the role of a vertiport manager. Specifically, we investigated five participants serving as a vertiport manager across both simulated and live flight operations. We performed multiple knowledge elicitation techniques, a thematic content analysis of qualitative data, and naturalistic observations to create a list of insights, design and training recommendations, and a simplified cognitive task diagram of the vertiport manager’s primary task. Findings from this study are discussed within the context of the current debate on the degree to which this role should be automated. A third alternative is suggested to allow a human vertiport manager to be successful by teaming with increasingly autonomous systems, designing the role to improve safety and efficiency of Urban Air Mobility operations.

AAM↗

Predicting operator workload during system design

A workload prediction methodology was developed in response to the need to measure workloads associated with operation of advanced aircraft. The application of the methodology will involve: (1) conducting mission/task analyses of critical mission segments and assigning estimates of workload for the sensory, cognitive, and psychomotor workload components of each task identified; (2) developing computer-based workload prediction models using the task analysis data; and (3) exercising the computer models to produce predictions of crew workload under varying automation and/or crew configurations. Critical issues include reliability and validity of workload predictors and selection of appropriate criterion measures.

Aldrich, Theodore B.↗

Exploration Mission Tasks: A Technical Manual

This technical manual is an abridgement of the Generalizable Skills and Knowledge for Exploration Missions (NASA/CR-2018-22045) report (Stuster et al., 2019), describing research conducted under Cooperative Agreement 80NSSC18K0042 for the Human Factors and Behavioral Performance Element, Human Research Program, located at the National Aeronautics and Space Administration’s (NASA) Johnson Space Center. The research identified tasks that will be conducted by human crew during an expedition to Mars, and the abilities, skills, and knowledge that will be required of crew members. The 3-year study uses research methods that were developed to analyze the work performed by a variety of civilian and military occupational specialties and is consistent with Human Factors methods. The work began by developing a comprehensive inventory of 1,125 tasks that are likely to be performed during the 12 phases of the first human expeditions to Mars, from launch to landing 30 months later. Sixty subject matter experts (SMEs) rated expedition tasks in terms of (likely) frequency of performance, difficulty to learn, and importance to mission success; a fourth metric (criticality), was derived by summing the mean ratings of the three dimensions. Seventy-two SMEs placed the physical, cognitive, and social abilities necessary to perform the tasks in order of importance for specialist domains identified by the task analysis. The research team then identified: 1) Abilities, skills, and knowledge that can be retained and generalized across tasks and 2) Implications for crew size and composition. Study results also led to recommendations concerning equipment, habitats, and procedures for exploration-class space missions. Note: The full-mission task inventory was developed during a comprehensive review of documentation and concepts of operations. It was understood by the study team that the tasks were based on currently available information, and that the tools, equipment, propulsion methods, and/or other aspects of actual human expeditions to Mars might be different from those described here, as a consequence of technological development and evolving Mars Design Reference Missions. The purpose and scope of this technical manual is to present the core, actionable information that resulted from this research. The abridged format is intended to address the needs of development and research teams to quickly access, discern, and use the information in the course of their exploration-related work.

Brandin Munson↗

An Investigation of Time Distributions for Task Primitives to Support the HUNTER Dynamic Human Reliability Analysis

As an effort to support data collection for dynamic human reliability analysis (HRA), this study investigates time distributions for task primitives defined in the Goals, Operators, Methods, and Selection rules (GOMS)–Human Reliability Analysis (HRA) method. GOMS-HRA was developed to provide cognition-based time and human error probability information for dynamic HRA calculation in the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) framework. HUNTER is a framework to support the dynamic modelling of human error in conjunction with other modelling tools. In this paper, we investigate time distributions using experimental data collected from the Simplified Human Error Experimental Program (SHEEP) study, which suggests an HRA data collection framework to complement full-scope simulator research as well as collect input data for dynamic HRA using simplified simulators such as the Rancor Microworld Simulator. In this study, time required for GOMS-HRA task primitives to satisfy thirteen statistical distributions is investigated. Then, the time distributions from student operators and professional operators are compared and discussed. As a result, this study identified several time distributions on five GOMS-HRA task primitives at a statistically significant level. According to analyses to date, a greater number of significant time distributions was found in abnormal or emergency operating procedures rather than standard operating procedures. In the future, it is expected that the result of this study can provide objective reference on elapsed time data for task primitives as well as help to realistically simulate scenarios within dynamic HRA.

99 GENERAL AND MISCELLANEOUS↗

Using Apex To Construct CPM-GOMS Models

process for automatically generating computational models of human/computer interactions as well as graphical and textual representations of the models has been built on the conceptual foundation of a method known in the art as CPM-GOMS. This method is so named because it combines (1) the task decomposition of analysis according to an underlying method known in the art as the goals, operators, methods, and selection (GOMS) method with (2) a model of human resource usage at the level of cognitive, perceptual, and motor (CPM) operations. CPM-GOMS models have made accurate predictions about behaviors of skilled computer users in routine tasks, but heretofore, such models have been generated in a tedious, error-prone manual process. In the present process, CPM-GOMS models are generated automatically from a hierarchical task decomposition expressed by use of a computer program, known as Apex, designed previously to be used to model human behavior in complex, dynamic tasks. An inherent capability of Apex for scheduling of resources automates the difficult task of interleaving the cognitive, perceptual, and motor resources that underlie common task operators (e.g., move and click mouse). The user interface of Apex automatically generates Program Evaluation Review Technique (PERT) charts, which enable modelers to visualize the complex parallel behavior represented by a model. Because interleaving and the generation of displays to aid visualization are automated, it is now feasible to construct arbitrarily long sequences of behaviors. The process was tested by using Apex to create a CPM-GOMS model of a relatively simple human/computer-interaction task and comparing the time predictions of the model and measurements of the times taken by human users in performing the various steps of the task. The task was to withdraw $80 in cash from an automated teller machine (ATM). For the test, a Visual Basic mockup of an ATM was created, with a provision for input from (and measurement of the performance of) the user via a mouse. The times predicted by the automatically generated model turned out to approximate the measured times fairly well (see figure). While these results are promising, there is need for further development of the process. Moreover, it will also be necessary to test other, more complex models: The actions required of the user in the ATM task are too sequential to involve substantial parallelism and interleaving and, hence, do not serve as an adequate test of the unique strength of CPM-GOMS models to accommodate parallelism and interleaving.

John, Bonnie↗

Managing Approach Plate Information Study (MAPLIST): An Information Requirements Analysis of Approach Chart Use

Adequately presenting all necessary information on an approach chart represents a challenge for cartographers. Since many tasks associated with using approach charts are cognitive (e.g., planning the approach and monitoring its progress), and since the characteristic of a successful interface is one that conforms to the users' mental models, understanding pilots' underlying models of approach chart information would greatly assist cartographers. To provide such information, a new methodology was developed for this study that enhances traditional information requirements analyses by combining psychometric scaling techniques with a simulation task to provide quantifiable links between pilots' cognitive representations of approach information and their use of approach information. Results of this study should augment previous information requirements analyses by identifying what information is acquired, when it is acquired, and what presentation concepts might facilitate its efficient use by better matching the pilots' cognitive model of the information. The primary finding in this study indicated that pilots mentally organize approach chart information into ten primary categories: communications, geography, validation, obstructions, navigation, missed approach, final items, other runways, visibility requirement, and navigation aids. These similarity categories were found to underlie the pilots' information acquisitions, other mental models, and higher level cognitive processes that are used to accomplish their approach and landing tasks.

Ricks, Wendell R.↗