Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “workload”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1985

Mental workload measurement: Event-related potentials and ratings of workload and fatigue

Event-related potentials were elicited when a digitized word representing a pilot's call-sign was presented. This auditory probe was presented during 27 workload conditions in a 3x3x3 design where the following variables were manipulated: short-term load, tracking task difficulty, and time-on-task. Ratings of workload and fatigue were obtained between each trial of a 2.5-hour test. The data of each subject were analyzed individually to determine whether significant correlations existed between subjective ratings and ERP component measures. Results indicated that a significant number of subjects had positive correlations between: (1) ratings of workload and P300 amplitude, (2) ratings of workload and N400 amplitude, and (3) ratings of fatigue and P300 amplitude. These data are the first to show correlations between ratings of workload or fatigue and ERP components thereby reinforcing their validity as measures of mental workload and fatigue.

Biferno, M. A.↗
DOE OSTI2023

$\mathrm{RADICAL}$-Pilot and $\mathrm{PMIx}$/$\mathrm{PRRTE}$: Executing Heterogeneous Workloads at Large Scale on Partitioned $\mathrm{HPC}$ Resources

Execution of heterogeneous workflows on high-performance computing (HPC) platforms present unprecedented resource management and execution coordination challenges for runtime systems. Task heterogeneity increases the complexity of resource and execution management, limiting the scalability and efficiency of workflow execution. Re-source partitioning and distribution of tasks execution over portioned re-sources promises to address those problems but we lack an experimental evaluation of its performance at scale. Here this paper provides a performance evaluation of the Process Management Interface for Exascale (PMIx) and its reference implementation PRRTE on the leadership-class HPC plat-form Summit, when integrated into a pilot-based runtime system called RADICAL-Pilot. We partition resources across multiple PRRTE Distributed Virtual Machine (DVM) environments, responsible for launching tasks via the PMIx interface. We experimentally measure the work-load execution performance in terms of task scheduling/launching rate and distribution of DVM task placement times, DVM startup and termination overheads on the Summit leadership-class HPC platform. Integrated solution with PMIx/PRRTE enables using an abstracted, standardized set of interfaces for orchestrating the launch process, dynamic process management and monitoring capabilities. It extends scaling capabilities allowing to overcome a limitation of other launching mechanisms (e.g., JSM/LSF). Explored different DVM setup configurations provide insights on DVM performance and a layout to leverage it. Our experimental results show that heterogeneous workload of 65,500 tasks on 2048 nodes, and partitioned across 32 DVMs, runs steady with resource utilization not lower than 52%. While having less concurrently executed tasks resource utilization is able to reach up to 85%, based on results of heterogeneous workload of 8200 tasks on 256 nodes and 2 DVMs.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1983

The workload book: Assessment of operator workload to engineering systems

The structure and initial work performed toward the creation of a handbook for workload analysis directed at the operational community of engineers and human factors psychologists are described. The goal, when complete, will be to make accessible to such individuals the results of theoretically-based research that are of practical interest and utility in the analysis and prediction of operator workload in advanced and existing systems. In addition, the results of laboratory study focused on the development of a subjective rating technique for workload that is based on psychophysical scaling techniques are described.

Gopher, D.↗
NASA NTRS1984

Measuring Pilot Workload in a Moving-base Simulator. Part 2: Building Levels of Workload

Pilot behavior in flight simulators often use a secondary task as an index of workload. His routine to regard flying as the primary task and some less complex task as the secondary task. While this assumption is quite reasonable for most secondary tasks used to study mental workload in aircraft, the treatment of flying a simulator through some carefully crafted flight scenario as a unitary task is less justified. The present research acknowledges that total mental workload depends upon the specific nature of the sub-tasks that a pilot must complete as a first approximation, flight tasks were divided into three levels of complexity. The simplest level (called the Base Level) requires elementary maneuvers that do not utilize all the degrees of freedom of which an aircraft, or a moving-base simulator; is capable. The second level (called the Paired Level) requires the pilot to simultaneously execute two Base Level tasks. The third level (called the Complex Level) imposes three simultaneous constraints upon the pilot.

Kantowitz, B. H.↗
DOE OSTI2021

Comparative evaluation of deep learning workloads for leadership-class systems

Deep learning (DL) workloads and their performance at scale are becoming important factors to consider as we design, develop and deploy next-generation high-performance computing systems. Since DL applications rely heavily on DL frameworks and underlying compute (CPU/GPU) stacks, it is essential to gain a holistic understanding from compute kernels, models, and frameworks of popular DL stacks, and to assess their impact on science-driven, mission-critical applications. At Oak Ridge Leadership Computing Facility (OLCF), we employ a set of micro and macro DL benchmarks established through the Collaboration of Oak Ridge, Argonne, and Livermore (CORAL) to evaluate the AI readiness of our next-generation supercomputers. In this paper, we present our early observations and performance benchmark comparisons between the Nvidia V100 based Summit system with its CUDA stack and an AMD MI100 based testbed system with its ROCm stack. We take a layered perspective on DL benchmarking and point to opportunities for future optimizations in the technologies that we consider.

Yin, Junqi↗
DOE OSTI2024

Integrating the PanDA Workload Management System with the Vera C. Rubin Observatory

The Vera C. Rubin Observatory will produce an unprecedented astronomical data set for studies of the deep and dynamic universe. Its Legacy Survey of Space and Time (LSST) will image the entire southern sky every three to four days and produce tens of petabytes of raw image data and associated calibration data over the course of the experiment’s run. More than 20 terabytes of data must be stored every night, and annual campaigns to reprocess the entire dataset since the beginning of the survey will be conducted over ten years. The Production and Distributed Analysis (PanDA) system was evaluated by the Rubin Observatory Data Management team and selected to serve the Observatory’s needs due to its demonstrated scalability and flexibility over the years, for its Directed Acyclic Graph (DAG) support, its support for multi-site processing, and its highly scalable complex workflows via the intelligent Data Delivery Service (iDDS). PanDA is also being evaluated for prompt processing where data must be processed within 60 seconds after image capture. This paper will briefly describe the Rubin Data Management system and its Data Facilities (DFs). Finally, it will describe in depth the work performed in order to integrate the PanDA system with the Rubin Observatory to be able to run the Rubin Science Pipelines using PanDA.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2017

The Underpinnings of Workload in Unmanned Vehicle Systems

This paper identifies and characterizes factors that contribute to operator workload in unmanned vehicle systems. Our objective is to provide a basis for developing models of workload for use in design and operation of complex human-machine systems. In 1986, Hart developed a foundational conceptual model of workload, which formed the basis for arguably the most widely used workload measurement technique—the NASA Task Load Index. Since that time, however, there have been many advances in models and factor identification as well as workload control measures. Additionally, there is a need to further inventory and describe factors that contribute to human workload in light of technological advances, including automation and autonomy. Thus, we propose a conceptual framework for the workload construct and present a taxonomy of factors that can contribute to operator workload. These factors, referred to as workload drivers, are associated with a variety of system elements including the environment, task, equipment and operator. In addition, we discuss how workload moderators, such as automation and interface design, can be manipulated in order to influence operator workload. We contend that workload drivers, workload moderators, and the interactions among drivers and moderators all need to be accounted for when building complex, human-machine systems.

Hooey, Becky L.↗
DOE OSTI2023

Neck Muscle Coactivation Response to Varied Levels of Mental Workload During Simulated Flight Tasks

Objective To evaluate neck muscle coactivation across different levels of mental workload during simulated flight tasks. Background Neck pain (NP) is highly prevalent among military aviators. Given the complex nature within the flight environment, mental workload may be a risk factor for NP. This may induce higher levels of neck muscle coactivity, which over time may accelerate fatigue, increase neck discomfort, and affect flight task performance. Method Three counterbalanced mental workload conditions represented by simulated flight tasks modulated by interstimulus frequency and complexity were investigated using the Modifiable Multitasking Environment (ModME). The primary measure was a neck coactivation index to describe the neuromuscular effort of the neck muscles as a system. Additional measures included perceived workload (NASA TLX), subjective discomfort, and task performance. Participants ( n = 60; 30M, 30F) performed three test conditions over 1 hr each while seated in a simulated seating environment. Results Neck coactivation indices (CoA) and subjective neck discomfort corresponded with increasing level of mental workload. Average CoAs for low, medium, and high workloads were: .0278(SD = .0232), .0286(SD = .0231), and .0295(SD = .0228), respectively. NASA TLX mental, temporal, effort, and overall scores also increased with the level of mental workload assigned. For ModME task performance, the overall performance score, monitoring accuracy, and resource management accuracy decreased while reaction times increased with the increasing level of mental workload. Communication accuracy was lowest with the low mental workload but had higher reaction times relative to increasing workload. Conclusion Mental workload affects neck muscle coactivation during combinations of simulated flight tasks within a simulated helicopter seating environment. Application The results of this study provide insights into the physical response to mental workload. With increasing multisensory modalities within the work environment, these insights may assist the consideration of physical effects from cognitive factors.

Behavioral Sciences↗
NASA NTRS1988

Transport pilot workload - A comparison of two subjective techniques

Although SWAT and NASA-TLX workload scales have been compared on numerous occasions, they have not been compared in the context of transport operations. Transport pilot workload has traditionally been classified as long periods of low workload with occasional spikes of high workload. Thus, the relative sensitivity of the scales to variations in workload at the low end of the scale were evaluated. This study was a part of a larger study which investigated workload measures for aircraft certification, conducted in a Phase II certified Link/Boeing 727 simulator. No significant main effects were found for any performance-based measures of workload. However, both SWAT and NASA-TLX were sensitive to differences between high and low workload flights and to differences among flight segments. NASA-TLX (but not SWAT) was sensitive to the increase in workload during the cruise segment of the high workload flight. Between-subject variability was high for SWAT. NASA-TLX was found to be stable when compared in the test/retest paradigm. A test/retest by segment interaction suggested that this was not the case for SWAT ratings.

Battiste, Vernol↗
NASA NTRS1992

Cognitive and affective components of mental workload: Understanding the effects of each on human decision making behavior

Human factors and ergonomics researchers have recognized for some time the increasing importance of understanding the role of the construct of mental workload in flight research. Current models of mental workload suggest that it is a multidimensional and complex construct, but one that has proved difficult to measure. Because of this difficulty, emphasis has usually been placed on using direct reports through subjective measures such as rating scales to assess levels of mental workload. The NASA Task Load Index (NASA/TLX, Hart and Staveland) has been shown to be a highly reliable and sensitive measure of perceived mental workload. But a problem with measures like TLX is that there is still considerable disagreement as to what it is about mental workload that these subjective measures are actually measuring. The empirical use of subjective workload measures has largely been to provide estimates of the cognitive components of the actual mental workload required for a task. However, my research suggests that these measures may, in fact have greater potential in accurately assessing the affective components of workload. That is, for example, TLX may be more likely to assess the positive and negative feelings associated with varying workload levels, which in turn may potentially influence the decision making behavior that directly bears on performance and safety issues. Pilots, for example, are often called upon to complete many complex tasks that are high in mental workload, stress, and frustration, and that have significant dynamic decision making components -- often ones that involve risk as well.

Nygren, Thomas E.↗
NASA NTRS2010

Impact of Conflict Avoidance Responsibility Allocation on Pilot Workload in a Distributed Air Traffic Management System

Pilot workload was examined during simulated flights requiring flight deck-based merging and spacing while avoiding weather. Pilots used flight deck tools to avoid convective weather and space behind a lead aircraft during an arrival into Louisville International airport. Three conflict avoidance management concepts were studied: pilot, controller or automation primarily responsible. A modified Air Traffic Workload Input Technique (ATWIT) metric showed highest workload during the approach phase of flight and lowest during the en-route phase of flight (before deviating for weather). In general, the modified ATWIT was shown to be a valid and reliable workload measure, providing more detailed information than post-run subjective workload metrics. The trend across multiple workload metrics revealed lowest workload when pilots had both conflict alerting and responsibility of the three concepts, while all objective and subjective measures showed highest workload when pilots had no conflict alerting or responsibility. This suggests that pilot workload was not tied primarily to responsibility for resolving conflicts, but to gaining and/or maintaining situation awareness when conflict alerting is unavailable.

Ligda, Sarah V.↗
NASA NTRSDate not supplied

Examining the Relationship between Self-Reported Workload and Resilient Performance in Airline Flight Crews

Workload has long been associated with human performance in aviation. High workload is typically viewed as a system design problem. The aim of this work was to find observable behaviors that guard cognitive resource margins; thus, improve handling of perturbations that arise. Twelve commercial airline flight crews participated in an experiment at NASA Langley Research Center. We explored workload data (NASA Task Load Index) self-reported after completing flight simulation scenarios to see how different individuals, using the same technologies, cope with challenging situations. A trained observer from the same airline as the study participants assessed performance. We differentiated a lower workload crew from a higher workload crew and analyzed their workload and performance. Results indicate that the workload may be a component of pilots’ resilient performance. Initial strategies that reduced workload were classified and these types of behaviors, if implemented correctly, might assist pilots in maintaining functional workload resource margins.

Michael Stewart↗
NASA NTRSDate not supplied

Examining the Relationship Between Workload and Resilient Performance in Airline Flight Crews

Workload has long been associated with human performance in aviation. High workload is typically viewed as a system design problem. The aim of this work was to find observable behaviors that guard cognitive resource margins; thus, improve handling of perturbations that arise. Twelve commercial airline flight crews participated in an experiment at NASA Langley Research Center. We explored workload data (NASA Task Load Index) self-reported after completing flight simulation scenarios to see how different individuals, using the same technologies, cope with challenging situations. A trained observer from the same airline as the study participants assessed performance. We differentiated a lower workload crew from a higher workload crew and analyzed their workload and performance. Results indicate that the workload may be a component of pilots’ resilient performance. Initial strategies that reduced workload were classified and these types of behaviors, if implemented correctly, might assist pilots in maintaining functional workload resource margins.

Michael Stewart↗
NASA NTRS2019

The Relationship between Workload, Performance and Fatigue in a Short-Haul Airline

Short-haul flights are associated with irregular work schedules and increased workload, due to frequent takeoffs and landings. We examined the relationship between pilot workload, performance and subjective fatigue during normal short-haul operations. Ninety airline pilots (8 female), mean age 33 (±8 years) completed a NASA-Task Load Index (NASA-TLX), a Psychomotor Vigilance Task (PVT; a reaction time test sensitive to sleep loss) and a Samn-Perelli (SP) fatigue scale, over a period of 20 duty days at top-of-descent on 2762 short-haul flights. The duty days included either 2 or 4 flights per day starting at different times as scheduled during normal operations. Workload was measured using the six NASA-TLX scales: mental demand, physical demand, temporal demand, effort, performance and frustration. Lapses (reaction times [RT] > 500ms) were calculated for the PVT. Spearman correlations were calculated to identify relationships between the NASA-TLX, PVT lapses, and SP. The six scales of NASA-TLX were positively correlated with the PVT lapses (p < 0.01) showing an increase in workload when lapses increased. There was a positive correlation between subjective fatigue as measured by the SP fatigue scale and each of the six scales of NASA-TLX (p < 0.001) suggesting that pilots reported higher workload when perceived levels of fatigue were higher. Of the six workload scales, mental demand and performance were rated the highest (mental: M = 40.99, SD = 20.32; performance: M = 41.61, SD = 20.71) and effort was rated the lowest (M = 15.59, SD = 8.98). Preliminary analyses suggest that high workload is associated with poorer PVT performance and increased self-reported fatigue in this population of short-haul pilots. Future studies should explore how other workload factors (i.e. flight hours, time of day) influence self-reported and objective fatigue measures.

TLX↗