Engineering PapersSearch

SEARCH · Engineering Papers

Results for “workload”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Mental workload measurement: Event-related potentials and ratings of workload and fatigue

Event-related potentials were elicited when a digitized word representing a pilot's call-sign was presented. This auditory probe was presented during 27 workload conditions in a 3x3x3 design where the following variables were manipulated: short-term load, tracking task difficulty, and time-on-task. Ratings of workload and fatigue were obtained between each trial of a 2.5-hour test. The data of each subject were analyzed individually to determine whether significant correlations existed between subjective ratings and ERP component measures. Results indicated that a significant number of subjects had positive correlations between: (1) ratings of workload and P300 amplitude, (2) ratings of workload and N400 amplitude, and (3) ratings of fatigue and P300 amplitude. These data are the first to show correlations between ratings of workload or fatigue and ERP components thereby reinforcing their validity as measures of mental workload and fatigue.

Biferno, M. A.

The workload book: Assessment of operator workload to engineering systems

The structure and initial work performed toward the creation of a handbook for workload analysis directed at the operational community of engineers and human factors psychologists are described. The goal, when complete, will be to make accessible to such individuals the results of theoretically-based research that are of practical interest and utility in the analysis and prediction of operator workload in advanced and existing systems. In addition, the results of laboratory study focused on the development of a subjective rating technique for workload that is based on psychophysical scaling techniques are described.

Gopher, D.

Measuring Pilot Workload in a Moving-base Simulator. Part 2: Building Levels of Workload

Pilot behavior in flight simulators often use a secondary task as an index of workload. His routine to regard flying as the primary task and some less complex task as the secondary task. While this assumption is quite reasonable for most secondary tasks used to study mental workload in aircraft, the treatment of flying a simulator through some carefully crafted flight scenario as a unitary task is less justified. The present research acknowledges that total mental workload depends upon the specific nature of the sub-tasks that a pilot must complete as a first approximation, flight tasks were divided into three levels of complexity. The simplest level (called the Base Level) requires elementary maneuvers that do not utilize all the degrees of freedom of which an aircraft, or a moving-base simulator; is capable. The second level (called the Paired Level) requires the pilot to simultaneously execute two Base Level tasks. The third level (called the Complex Level) imposes three simultaneous constraints upon the pilot.

Kantowitz, B. H.

The Underpinnings of Workload in Unmanned Vehicle Systems

This paper identifies and characterizes factors that contribute to operator workload in unmanned vehicle systems. Our objective is to provide a basis for developing models of workload for use in design and operation of complex human-machine systems. In 1986, Hart developed a foundational conceptual model of workload, which formed the basis for arguably the most widely used workload measurement technique—the NASA Task Load Index. Since that time, however, there have been many advances in models and factor identification as well as workload control measures. Additionally, there is a need to further inventory and describe factors that contribute to human workload in light of technological advances, including automation and autonomy. Thus, we propose a conceptual framework for the workload construct and present a taxonomy of factors that can contribute to operator workload. These factors, referred to as workload drivers, are associated with a variety of system elements including the environment, task, equipment and operator. In addition, we discuss how workload moderators, such as automation and interface design, can be manipulated in order to influence operator workload. We contend that workload drivers, workload moderators, and the interactions among drivers and moderators all need to be accounted for when building complex, human-machine systems.

Hooey, Becky L.

Transport pilot workload - A comparison of two subjective techniques

Although SWAT and NASA-TLX workload scales have been compared on numerous occasions, they have not been compared in the context of transport operations. Transport pilot workload has traditionally been classified as long periods of low workload with occasional spikes of high workload. Thus, the relative sensitivity of the scales to variations in workload at the low end of the scale were evaluated. This study was a part of a larger study which investigated workload measures for aircraft certification, conducted in a Phase II certified Link/Boeing 727 simulator. No significant main effects were found for any performance-based measures of workload. However, both SWAT and NASA-TLX were sensitive to differences between high and low workload flights and to differences among flight segments. NASA-TLX (but not SWAT) was sensitive to the increase in workload during the cruise segment of the high workload flight. Between-subject variability was high for SWAT. NASA-TLX was found to be stable when compared in the test/retest paradigm. A test/retest by segment interaction suggested that this was not the case for SWAT ratings.

Battiste, Vernol

Cognitive and affective components of mental workload: Understanding the effects of each on human decision making behavior

Human factors and ergonomics researchers have recognized for some time the increasing importance of understanding the role of the construct of mental workload in flight research. Current models of mental workload suggest that it is a multidimensional and complex construct, but one that has proved difficult to measure. Because of this difficulty, emphasis has usually been placed on using direct reports through subjective measures such as rating scales to assess levels of mental workload. The NASA Task Load Index (NASA/TLX, Hart and Staveland) has been shown to be a highly reliable and sensitive measure of perceived mental workload. But a problem with measures like TLX is that there is still considerable disagreement as to what it is about mental workload that these subjective measures are actually measuring. The empirical use of subjective workload measures has largely been to provide estimates of the cognitive components of the actual mental workload required for a task. However, my research suggests that these measures may, in fact have greater potential in accurately assessing the affective components of workload. That is, for example, TLX may be more likely to assess the positive and negative feelings associated with varying workload levels, which in turn may potentially influence the decision making behavior that directly bears on performance and safety issues. Pilots, for example, are often called upon to complete many complex tasks that are high in mental workload, stress, and frustration, and that have significant dynamic decision making components -- often ones that involve risk as well.

Nygren, Thomas E.

Impact of Conflict Avoidance Responsibility Allocation on Pilot Workload in a Distributed Air Traffic Management System

Pilot workload was examined during simulated flights requiring flight deck-based merging and spacing while avoiding weather. Pilots used flight deck tools to avoid convective weather and space behind a lead aircraft during an arrival into Louisville International airport. Three conflict avoidance management concepts were studied: pilot, controller or automation primarily responsible. A modified Air Traffic Workload Input Technique (ATWIT) metric showed highest workload during the approach phase of flight and lowest during the en-route phase of flight (before deviating for weather). In general, the modified ATWIT was shown to be a valid and reliable workload measure, providing more detailed information than post-run subjective workload metrics. The trend across multiple workload metrics revealed lowest workload when pilots had both conflict alerting and responsibility of the three concepts, while all objective and subjective measures showed highest workload when pilots had no conflict alerting or responsibility. This suggests that pilot workload was not tied primarily to responsibility for resolving conflicts, but to gaining and/or maintaining situation awareness when conflict alerting is unavailable.

Ligda, Sarah V.

Examining the Relationship between Self-Reported Workload and Resilient Performance in Airline Flight Crews

Workload has long been associated with human performance in aviation. High workload is typically viewed as a system design problem. The aim of this work was to find observable behaviors that guard cognitive resource margins; thus, improve handling of perturbations that arise. Twelve commercial airline flight crews participated in an experiment at NASA Langley Research Center. We explored workload data (NASA Task Load Index) self-reported after completing flight simulation scenarios to see how different individuals, using the same technologies, cope with challenging situations. A trained observer from the same airline as the study participants assessed performance. We differentiated a lower workload crew from a higher workload crew and analyzed their workload and performance. Results indicate that the workload may be a component of pilots’ resilient performance. Initial strategies that reduced workload were classified and these types of behaviors, if implemented correctly, might assist pilots in maintaining functional workload resource margins.

Michael Stewart

Examining the Relationship Between Workload and Resilient Performance in Airline Flight Crews

Workload has long been associated with human performance in aviation. High workload is typically viewed as a system design problem. The aim of this work was to find observable behaviors that guard cognitive resource margins; thus, improve handling of perturbations that arise. Twelve commercial airline flight crews participated in an experiment at NASA Langley Research Center. We explored workload data (NASA Task Load Index) self-reported after completing flight simulation scenarios to see how different individuals, using the same technologies, cope with challenging situations. A trained observer from the same airline as the study participants assessed performance. We differentiated a lower workload crew from a higher workload crew and analyzed their workload and performance. Results indicate that the workload may be a component of pilots’ resilient performance. Initial strategies that reduced workload were classified and these types of behaviors, if implemented correctly, might assist pilots in maintaining functional workload resource margins.

Michael Stewart

The Relationship between Workload, Performance and Fatigue in a Short-Haul Airline

Short-haul flights are associated with irregular work schedules and increased workload, due to frequent takeoffs and landings. We examined the relationship between pilot workload, performance and subjective fatigue during normal short-haul operations. Ninety airline pilots (8 female), mean age 33 (±8 years) completed a NASA-Task Load Index (NASA-TLX), a Psychomotor Vigilance Task (PVT; a reaction time test sensitive to sleep loss) and a Samn-Perelli (SP) fatigue scale, over a period of 20 duty days at top-of-descent on 2762 short-haul flights. The duty days included either 2 or 4 flights per day starting at different times as scheduled during normal operations. Workload was measured using the six NASA-TLX scales: mental demand, physical demand, temporal demand, effort, performance and frustration. Lapses (reaction times [RT] > 500ms) were calculated for the PVT. Spearman correlations were calculated to identify relationships between the NASA-TLX, PVT lapses, and SP. The six scales of NASA-TLX were positively correlated with the PVT lapses (p < 0.01) showing an increase in workload when lapses increased. There was a positive correlation between subjective fatigue as measured by the SP fatigue scale and each of the six scales of NASA-TLX (p < 0.001) suggesting that pilots reported higher workload when perceived levels of fatigue were higher. Of the six workload scales, mental demand and performance were rated the highest (mental: M = 40.99, SD = 20.32; performance: M = 41.61, SD = 20.71) and effort was rated the lowest (M = 15.59, SD = 8.98). Preliminary analyses suggest that high workload is associated with poorer PVT performance and increased self-reported fatigue in this population of short-haul pilots. Future studies should explore how other workload factors (i.e. flight hours, time of day) influence self-reported and objective fatigue measures.

TLX

A workload model and measures for computer performance evaluation

A generalized workload definition is presented which constructs measurable workloads of unit size from workload elements, called elementary processes. An elementary process makes almost exclusive use of one of the processors, CPU, I/O processor, etc., and is measured by the cost of its execution. Various kinds of user programs can be simulated by quantitative composition of elementary processes into a type. The character of the type is defined by the weights of its elementary processes and its structure by the amount and sequence of transitions between its elementary processes. A set of types is batched to a mix. Mixes of identical cost are considered as equivalent amounts of workload. These formalized descriptions of workloads allow investigators to compare the results of different studies quantitatively. Since workloads of different composition are assigned a unit of cost, these descriptions enable determination of cost effectiveness of different workloads on a machine. Subsequently performance parameters such as throughput rate, gain factor, internal and external delay factors are defined and used to demonstrate the effects of various workload attributes on the performance of a selected large scale computer system.

Kerner, H.

The effects of control order, feedback, practice, and input device on tracking performance and perceived workload

The present experiment examined the influence of several task-related factors on tracking performance and concomitant workload. The manipulated factors included tracking order, the presence or absence of knowledge of performance, and the control device. Summed root mean square error (rmse) and perceived workload were measured at the termination of each trial. Perceived workload was measured using the NASA Task Load Index (TLX) and the Subjective Workload Assessment Technique (SWAT). Results indicated a large and expected effect for track order on both performance and the perception of load. In general, trackball input was more accurate and judged for lower load than input using a mouse. The presence or absence of knowledge of performance had little effect on either performance or workload. There were a number of interactions between factors shown in performance that were mirrored by perceived workload scores. Results from each workload scale were equivalent in terms of sensitivity to task manipulations. The pattern of results affirm the utility of these workload measures in assessing the imposed load of multiple task-related variables.

Hancock, P. A.

Quantitative EEG patterns of differential in-flight workload

Four test pilots were instrumented for in-flight EEG recordings using a custom portable recording system. Each flew six, two minute tracking tasks in the Calspan NT-33 experimental trainer at Edwards AFB. With the canopy blacked out, pilots used a HUD display to chase a simulated aircraft through a random flight course. Three configurations of flight controls altered the flight characteristics to achieve low, moderate, and high workload, as determined by normative Cooper-Harper ratings. The test protocol was administered by a command pilot in the back seat. Corresponding EEG and tracking data were compared off-line. Tracking performance was measured as deviation from the target aircraft and combined with control difficulty to achieve an estimate of 'cognitive workload'. Trended patterns of parietal EEG activity at 8-12 Hz were sorted according to this classification. In all cases, high workload produced a significantly greater suppression of 8-12 Hz activity than low workload. Further, a clear differentiation of EEG trend patterns was obtained in 80 percent of the cases. High workload produced a sustained suppression of 8-12 Hz activity, while moderate workload resulted in an initial suppression followed by a gradual increment. Low workload was associated with a modulated pattern lacking any periods of marked or sustained suppression. These findings suggest that quantitative analysis of appropriate EEG measures may provide an objective and reliable in-flight index of cognitive effort that could facilitate workload assessment.

Sterman, M. B.

Workload: Measurement and Management

Poster: The workload research project has as its task to survey the available literature on: (1) workload measurement techniques; and (2) the effects of workload on operator performance. The first set of findings provides practitioners with a collection of simple-to-use workload measurement techniques along with characterizations of the kinds of tasks each technique has been shown reliably address. This allows design practitioners to select and use the most appropriate techniques for the task(s) at hand. The second set of findings provides practitioners with the guidance they need to design for appropriate kinds and amounts of workload across all tasks for which the operator is responsible. This guidance helps practitioners design systems and procedures that ensure appropriate levels of engagement across all tasks, and avoid designs and procedures that result in operator boredom, complacency, loss of awareness, undue levels of stress, or skill atrophy that can result from workload that distracts operators from the tasks they perform and monitor, workload levels that are too low, too high, or too consistent or predictable. Only those articles that were peer reviewed, long standing and generally accepted in the field, and applicable to a relevant range of conditions in a select domain of interest, in analogous "extreme" environments to those in space were included. In addition, all articles were reviewed and evaluated on uni-dimensional and multi-dimensional considerations. Casner & Gore also examined the notion of thresholds and the conditions that may benefit mostly from the various methodological approaches. Other considerations included whether the tools would be suitable for guiding a requirement-related and design-related question. An initial review of over 225 articles was conducted and entered into an EndNote database. The reference list included a range of conditions in the domain of interest (subjective/objective measures), the seminal works in workload, as well as summary works

Gore, Brian Francis

An Approach to Quantify Workload in a System of Agents

The role of humans in aviation and other domains continues to shift from manual control to automation monitoring. Studies have found that humans are often poorly suited for monitoring roles, and workload can easily spike in off-nominal situations. Current workload measurement tools, like NASA TLX, use human operators to assess their own workload after using a prototype system. Such measures are used late in the design process and can result in ex- pensive alterations when problems are discovered. Our goal in this work is to provide a quantitative workload measure for use early in the design process. We leverage research in human cognition to de ne metrics that can measure workload on belief-desire-intentions based multi-agent systems. These measures can alert designers to potential workload issues early in design. We demonstrate the utility of our approach by characterizing quantitative differences in the workload for a single pilot operations model compared to a traditional two pilot model.

Single Pilot Operations

Model-based estimation and prediction of task-imposed mental workload

Mental workload has been an area of intensive research for better than a decade. One specific area of interest in aircrew related workload research is concerned with the development of quantitative indices of workload in aircraft piloting tasks. This paper presents a model-based approach for quantifying mental workload in operational terms. The suggested modeling framework is based on an interpreted Petri net characterization of a task in which 'places' are equated to specific task-related activities and 'transitions' are viewed as internal or external forcing events. It is shown that within this framework quantitative assessments can be made of both cumulative and instantaneous workload associated with the performance of a task and its individual component subtasks. It is suggested that insights gained from analyzing task-specific workload within this modeling paradigm can suggest plausible explanations for reconciling discrepancies between subjectively elicited workload estimates and behavioral/performance measures.

Madni, A. M.