Engineering PapersSearch

SEARCH · Engineering Papers

Results for “workload”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

A closed-loop causal model of workload based on a comparison of fuzzy and crisp measurements techniques

Fuzzy and crisp measurements of workload are compared for a tracking task that varied in bandwidth and order of control. Fuzzy measures are as powerful as crisp measures, and can under certain conditions give extra insights into workload causality. Both methods suggest that workload arises in a system in which effort, performance, difficulty, and task variables are linked in a closed loop. Marked individual differences were found. Future work on the fuzzy measurement of workload is justified.

Moray, Neville

Timesharing performance as an indicator of pilot mental workload

The research was performed in two simultaneous phases, each intended to identify and manipulate factors related to operator mental workload. The first phase concerned evaluation of attentional deficits (workloads) in a timesharing task. Work in the second phase involved incorporating the results from these and other experiments into an expert system designed to provide workload metric selection advice to nonexperts in the field interested in operator workload. The results of the experiments conducted are summarized.

Casper, Patricia A.

Decision support for workload assessment - Introducing WC FIELDE

Currently there is a great demand for mental workload evaluation in the course of system design and modification. In light of this demand, a microprocessor-based decision support system has been created called WC FIELDE: Workload Consultant for FIELD Evaluation. The system helps the user select workload measures appropriate to his or her application from the large pool of currently available techniques. Both novices and those with some workload experience may benefit from using WC FIELDE, since the system's operation is entirely transparent and all rules involved in the decision process are available for the user to examine. WC FIELDE recommends several assessment methodologies in decreasing order of appropriateness, and provides additional information on each measure at the end of the program in the form of text files.

Casper, Patricia A.

Absolute magnitude estimation and relative judgement approaches to subjective workload assessment

Two rating scale techniques employing an absolute magnitude estimation method, were compared to a relative judgment method for assessing subjective workload. One of the absolute estimation techniques used was an unidimensional overall workload scale and the other was the multidimensional NASA-Task Load Index technique. Thomas Saaty's Analytic Hierarchy Process was the unidimensional relative judgment method used. These techniques were used to assess the subjective workload of various single- and dual-tracking conditions. The validity of the techniques was defined as their ability to detect the same phenomena observed in the tracking performance. Reliability was assessed by calculating test-retest correlations. Within the context of the experiment, the Saaty Analytic Hierarchy Process was found to be superior in validity and reliability. These findings suggest that the relative judgment method would be an effective addition to the currently available subjective workload assessment techniques.

Vidulich, Michael A.

Individual differences and subjective workload assessment - Comparing pilots to nonpilots

Results by two groups of subjects, pilots and nonpilots, for two subjective workload assessment techniques (the SWAT and NASA-TLX tests) intended to evaluate individual differences in the perception and reporting of subjective workload are compared with results obtained for several traditional personality tests. The personality tests were found to discriminate between the groups while the workload tests did not. It is concluded that although the workload tests may provide useful information with respect to the interaction between tasks and personality, they are not effective as pure tests of individual differences.

Vidulich, Michael A.

Field study of communication and workload in police helicopters - Implications for AI cockpit design

This paper reports on the work performed by civilian helicopter crews, using audio and video recordings and a variety of workload measures (heart rate and subjective ratings) obtained in a field study of public service helicopter missions. The number and frequency of communications provided a significant source of workload. This is relevant to the design of automated cockpit systems, since many designs presuppose the use of voice I/O systems. Fluency of communications (including pauses, hesitation markers, repetitions, and false starts) furnished an early indication of the effects of fatigue. Three workload measures were correlated to identify high workload segments of flight, and to suggest alternate task allocations between crew members.

Linde, Charlotte

Crew workload-management strategies - A critical factor in system performance

This paper reviews the philosophy and goals of the NASA/USAF Strategic Behavior/Workload Management Program. The philosophical foundation of the program is based on the assumption that an improved understanding of pilot strategies will clarify the complex and inconsistent relationships observed among objective task demands and measures of system performance and pilot workload. The goals are to: (1) develop operationally relevant figures of merit for performance, (2) quantify the effects of strategic behaviors on system performance and pilot workload, (3) identify evaluation criteria for workload measures, and (4) develop methods of improving pilots' abilities to manage workload extremes.

Hart, Sandra G.

Dissociation revisited - Workload and performance in a simulated flight task

The multiple resource model has been used as the theoretical basis for interpreting single-to-dual task changes in measures of performance and workload ratings. Inconsistent relationships among these measures have been termed dissociation. It is possible they are an artifact of the way performance and workload measures are collected; performance measures are available for the components of a complex task whereas workload ratings are integrated across all of the tasks performed within an interval of time. This study compared component ratings with global ratings and found that component ratings provide better information about subjects' task strategies and in interpreting the resultant relationships between workload ratings and performance.

King, Teresa

Cognitive consequences of clumsy automation on high workload, high consequence human performance

The growth of computational power has fueled attempts to automate more of the human role in complex problem solving domains, especially those where system faults have high consequences and where periods of high workload may saturate the performance capacity of human operators. Examples of these domains include flightdecks, space stations, air traffic control, nuclear power operation, ground satellite control rooms, and surgical operating rooms. Automation efforts may have unanticipated effects on human performance, particularly if they increase the workload at peak workload times or change the practitioners' strategies for coping with workload. Smooth and effective changes in automation requires detailed understanding of the congnitive tasks confronting the user: it has been called user centered automation. The introduction of a new computerized technology in a group of hospital operating rooms used for heart surgery was observed. The study revealed how automation, especially 'clumsy automation', effects practitioner work patterns and suggest that clumsy automation constrains users in specific and significant ways. Users tailor both the new system and their tasks in order to accommodate the needs of process and production. The study of this tailoring may prove a powerful tool for exposing previously hidden patterns of user data processing, integration, and decision making which may, in turn, be useful in the design of more effective human-machine systems.

Cook, Richard I.

Operator strategies under varying conditions of workload

An attempt was made to operationally define and measure strategic behavior in a complex multiple task environment. The Multi-Attribute Task battery was developed to simulate various aspects of flight and consisted of an auditory communication task, monitoring tasks, a tracking tasks, a resource management task which allowed a wide range of responding patterns, and a scheduling window which allowed operators to predict changes in workload. This battery was validated for its sensitivity to strategic behavior, and baseline measures for each individual task were collected. Twenty-four undergraduate and graduate students then performed the battery for four 64 minute sessions which took place over a period of 2 days. Each subject performed the task battery under four levels of workload, which were presented for equal lengths of time during all four sessions. Results indicated that in general, performance improves as a function of experience with the battery, but that performance decreased as workload level increased. The data also showed that subjects developed strategies for responding to the resource management task which allowed them to manage the high workload levels more efficiently. This particular strategy developed over time but was also associated with errors of complacency. These results are presented along with implications for the aviation field and areas of future research.

Arnegard, Ruth J.

Pilot Mental Workload with Predictive System Status Information

Research has shown a strong pilot preference for predictive information of aircraft system status in the flight deck. However, the mental workload associated with using this predictive information has not been ascertained. The study described here attempted to measure mental workload. In this simulator experiment, three types of predictive information (none, whether a parameter was changing abnormally, and the time for a parameter to reach an alert range) and four initial times to a parameter alert range (1 minute, 5 minutes, 15 minutes, and ETA+45 minutes) were tested to determine their effects on subjects mental workload. Subjective workload ratings increased with increasing predictive information (whether a parameter was changing abnormally or the time for a parameter to reach an alert range). Subjective situation awareness decreased with more predictive information but it became greater with increasing initial times to a parameter alert range. Also, subjective focus changed depending on the type of predictive information. Lastly, skin temperature fluctuated less as the initial time to a parameter alert range increased.

Trujillo, Anna C.

Using Neural Networks to Explore Air Traffic Controller Workload

When a new system, concept, or tool is proposed in the aviation domain, one concern is the impact that this will have on operator workload. As an experience, workload is difficult to measure in a way that will allow comparison of proposed systems with those already in existence. Chatterji and Sridhar (2001) suggested a method by which airspace parameters can be translated into workload ratings, using a neural network. This approach was employed, and modified to accept input from a non-real time airspace simulation model. The following sections describe the preparations and testing work that will enable comparison of a future airspace concept with a current day baseline in terms of workload levels.

Martin, Lynne

Adaptive Planning: Understanding Organizational Workload to Capability/ Capacity through Modeling and Simulation

In August 2003, the Secretary of Defense (SECDEF) established the Adaptive Planning (AP) initiative [1] with an objective of reducing the time necessary to develop and revise Combatant Commander (COCOM) contingency plans and increase SECDEF plan visibility. In addition to reducing the traditional plan development timeline from twenty-four months to less than twelve months (with a goal of six months)[2], AP increased plan visibility to Department of Defense (DoD) leadership through In-Progress Reviews (IPRs). The IPR process, as well as the increased number of campaign and contingency plans COCOMs had to develop, increased the workload while the number of planners remained fixed. Several efforts from collaborative planning tools to streamlined processes were initiated to compensate for the increased workload enabling COCOMS to better meet shorter planning timelines. This paper examines the Joint Strategic Capabilities Plan (JSCP) directed contingency planning and staffing requirements assigned to a combatant commander staff through the lens of modeling and simulation. The dynamics of developing a COCOM plan are captured with an ExtendSim [3] simulation. The resulting analysis provides a quantifiable means by which to measure a combatant commander staffs workload associated with development and staffing JSCP [4] directed contingency plans with COCOM capability/capacity. Modeling and simulation bring significant opportunities in measuring the sensitivity of key variables in the assessment of workload to capability/capacity analysis. Gaining an understanding of the relationship between plan complexity, number of plans, planning processes, and number of planners with time required for plan development provides valuable information to DoD leadership. Through modeling and simulation AP leadership can gain greater insight in making key decisions on knowing where to best allocate scarce resources in an effort to meet DoD planning objectives.

Hase, Chris

Eye Tracking Metrics for Workload Estimation in Flight Deck Operation

Flight decks of the future are being enhanced through improved avionics that adapt to both aircraft and operator state. Eye tracking allows for non-invasive analysis of pilot eye movements, from which a set of metrics can be derived to effectively and reliably characterize workload. This research identifies eye tracking metrics that correlate to aircraft automation conditions, and identifies the correlation of pilot workload to the same automation conditions. Saccade length was used as an indirect index of pilot workload: Pilots in the fully automated condition were observed to have on average, larger saccadic movements in contrast to the guidance and manual flight conditions. The data set itself also provides a general model of human eye movement behavior and so ostensibly visual attention distribution in the cockpit for approach to land tasks with various levels of automation, by means of the same metrics used for workload algorithm development.

Ellis, Kyle

Predicting the Consequences of Workload Management Strategies with Human Performance Modeling

Human performance modelers at the US Army Research Laboratory have developed an approach for establishing Soldier high workload that can be used for analyses of proposed system designs. Their technique includes three key components. To implement the approach in an experiment, the researcher would create two experimental conditions: a baseline and a design alternative. Next they would identify a scenario in which the test participants perform all their representative concurrent interactions with the system. This scenario should include any events that would trigger a different set of goals for the human operators. They would collect workload values during both the control and alternative design condition to see if the alternative increased workload and decreased performance. They have successfully implemented this approach for military vehicle. designs using the human performance modeling tool, IMPRINT. Although ARL researches use IMPRINT to implement their approach, it can be applied to any workload analysis. Researchers using other modeling and simulations tools or conducting experiments or field tests can use the same approach.

Mitchell, Diane Kuhl

Evaluation of Usability and Workload with Paper Strips as Compared to Virtual Flight Strips Used for Ramp Operations

This paper describes an experiment designed to compare the use of paper strips with the use of a new user interface, the Ramp Traffic Console (RTC), designed for use by ramp controllers to be used in place of paper strips. A Human-In-the-Loop (HITL) experiment was performed as the fifth study in a series of six HITL simulation experiments designed to evaluate a concept that provided advisories to the users. The RTC was designed to be used as a Decision Support Tool (DST) that provided advisories to ramp controllers regarding metering or pushback such that most of the delay was taken at the gate to save fuel and emissions. In addition to being a DST, an added benefit of the RTC is that it can provide real-time updates of flight data, airport and airspace status to the controller including Traffic Management Initiatives (TMI). The RTC was designed as new user interface that displays virtual strips on a terminal map drawn on a 27-inch touch screen monitor. The RTC was used in some conditions of the experiment by ramp controllers in place of paper strips and paper maps in the HITL environment. In other conditions the controllers were given paper strips and paper maps similar to what they currently use at Charlotte Douglas International Airport (CLT). The study described here, evaluated the use of the virtual strips displayed on the RTC as compared to the use of paper strips and paper map, using current ramp tower controllers at CLT as participants. The research question being asked was - How does management of ramp traffic affect user workload and usability ratings while using RTC to manage traffic in the ramp verses using paper strips? Workload for our purposes is defined by four components of the NASA-TLX (Task Load Index). Usability was assessed with two sets of usability questions - One set of usability questions addressed traffic management performance and the other set addressed issues of resources and efficiency. Both Post Run and Post Study questionnaire responses were gathered and the results were analyzed to assess controller workload and usability ratings under both conditions, virtual strips shown on RTC and Paper Strips. The results indicate that controllers perceived lower workload while using virtual strips displayed on RTC to manage ramp traffic. Usability ratings for Traffic management performance questions are lower in the virtual strip/RTC condition than in the paper strip condition showing a preference for RTC over Paper. Usability ratings for Resources and efficiency questions show mixed results. Additionally, the Post Study Questions show preference for RTC over paper strips. Results of this data analysis will be presented in this paper. This DST evaluation was an important step in researching and improving the tool, which was planned to be deployed in the field.

Aviation Decision Support Tools

Workload Considerations in Urban Air Mobility

Urban air mobility (UAM) is receiving increased attention in aviation as a system for passenger and cargo-carrying new entrants in urban airspace. In order to develop a safe and efficient system, numerous possible concepts of operation for UAM are being explored throughout industry and research domains, the features and assumptions of which may differ according to near, medium and far term operations. Much of the current research into the development of UAM has dominantly focused on technological and engineering capabilities, such as vehicle development. Although these areas of research are essential to furthering UAM, research into the role of the human operator in UAM is limited. The research described in this paper aims to begin to address this gap by investigating the capabilities and implications of human operators as traffic managers in the UAM system, focusing on near-term UAM operations. A human in the loop air traffic control simulation was used to investigate the effect of UAM traffic density, airspace routes and communication procedures on subjective workload and efficiency-related task performance. Findings indicate that medium and high-density operations were associated with high workload. A reduction in verbal communications through a letter of agreement, and optimized routes, were associated with reduced workload and increased performance efficiency. However, even with these adjustments, reported workload remained high, particularly during the high-density scenario. Future research should focus on the human operator roles and responsibilities, and the amount of involvement, in UAM system management. Particular focus should be directed on the impact of reduced human operator involvement and increased automation, on the safety and efficiency of UAM operations and the integration of UAM with traditional air traffic management.

Edwards, Tamsyn

Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) – Physical Workload Approximation

The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a hybrid reality exploration surface analog, “Assessments of Physiology and Cognition in Hybrid-reality Environments” (APACHE). The goal of APACHE is to create a planetary extravehicular activity (EVA) simulation environment that provides a representative physical and cognitive workload approximation using a combination of virtual reality (VR), physical reality, and hybrid reality (HR) techniques. To develop and characterize the physical workload approximation within the APACHE environment, a two-part approach was implemented. In part 1, baseline physical work load during ambulation within APACHE was evaluated and compared with that in other planetary EVA analog environments and with existing data sets from Apollo planetary EVAs and reduced gravity testing of prototype planetary spacesuits. For this evaluation, 10 subjects were asked to ambulate in three surface analog environments: a passive treadmill in APACHE, natural terrain in an outdoor field environment, and a standard motorized treadmill. Subjects’ heart rate and metabolic rate (VO2/VCO2) were measured and compared among the different test conditions and existing data sets. Gait parameters were also collected to compare with suited mechanics and to understand the role of gait kinematics in physical workload. In part 2, the aim is to evaluate the addition of a custom weighted body suit to the aforementioned surface analog environments and the ability to titrate the suit configuration to provide the best possible physical workload approximation for simulation of lunar and Martian EVAs.

Alex Baughman