Results for “workload transitions” — Page 2

NASA NTRS2009

SPoRT - An End-to-End R2O Activity

Established in 2002 to demonstrate the weather and forecasting application of real-time EOS measurements, the Short-term Prediction Research and Transition (SPoRT) program has grown to be an end-to-end research to operations activity focused on the use of advanced NASA modeling and data assimilation approaches, nowcasting techniques, and unique high-resolution multispectral observational data applications from EOS satellites to improve short-term weather forecasts on a regional and local scale. SPoRT currently partners with several universities and other government agencies for access to real-time data and products, and works collaboratively with them and operational end users at 13 WFOs to develop and test the new products and capabilities in a "test-bed" mode. The test-bed simulates key aspects of the operational environment without putting constraints on the forecaster workload. Products and capabilities which show utility in the test-bed environment are then transitioned experimentally into the operational environment for further evaluation and assessment. SPoRT focuses on a suite of data and products from MODIS, AMSR-E, and AIRS on the NASA Terra and Aqua satellites, and total lightning measurements from ground-based networks. Some of the observations are assimilated into or used with various versions of the WRF model to provide supplemental forecast guidance to operational end users. SPoRT is enhancing partnerships with NOAA / NESDIS for new product development and data access to exploit the remote sensing capabilities of instruments on the NPOESS satellites to address short term weather forecasting problems. The VIIRS and CrIS instruments on the NPP and follow-on NPOESS satellites provide similar observing capabilities to the MODIS and AIRS instruments on Terra and Aqua. SPoRT will be transitioning existing and new capabilities into the AWIIPS II environment to continue the continuity of its activities.

Jedlovec, Gary J.↗

NASA NTRS2013

Investigating the Complexity of Transitioning Separation Assurance Tools into NextGen Air Traffic Control

In a study, that introduced ground-based separation assurance automation through a series of envisioned transitional phases of concept maturity, it was found that subjective responses to scales of workload, situation awareness, and acceptability in a post run questionnaire revealed as-predicted results for three of the four study conditions but not for the third, Moderate condition. The trend continued for losses of separation (LOS) where the number of LOS events were far greater than expected in the Moderate condition. To offer an account of why the Moderate condition was perceived to be more difficult to manage than predicted, researchers examined the increase in amount and complexity of traffic, increase in communication load, and increased complexities as a result of the simulation's mix of aircraft equipage. Further analysis compared the tools presented through the phases, finding that controllers took advantage of the informational properties of the tools presented but shied away from using their decision support capabilities. Taking into account similar findings from other studies, it is suggested that the Moderate condition represented the first step into a "shared control" environment, which requires the controller to use the automation as a decision making partner rather than just a provider of information. Viewed in this light, the combination of tools offered in the Moderate condition was reviewed and some tradeoffs that may offset the identified complexities were suggested.

separation assurance↗

DOE OSTI2025

In-Transit Data Transport Strategies for Coupled AI-Simulation Workflow Patterns

Coupled AI-Simulation workflows are becoming the major workloads for HPC facilities, and their increasing complexity necessitates new tools for performance analysis and prototyping of new in-situ workflows. We present SimAI-Bench, a tool designed to both prototype and evaluate these coupled workflows. In this paper, we use SimAI-Bench to benchmark the data transport performance of two common patterns on the Aurora supercomputer: a one-to-one workflow with co-located simulation and AI training instances, and a many-to-one workflow where a single AI model is trained from an ensemble of simulations. For the one-to-one pattern, our analysis shows that node-local and DragonHPC data staging strategies provide excellent performance compared Redis and Lustre file system. For the many-to-one pattern, we find that data transport becomes a dominant bottleneck as the ensemble size grows. Our evaluation reveals that file system is the optimal solution among the tested strategies for the many-to-one pattern.

Tummalapalli, Harikrishna [Argonne National Labora↗

NASA NTRS1983

Model-based estimation and prediction of task-imposed mental workload

Mental workload has been an area of intensive research for better than a decade. One specific area of interest in aircrew related workload research is concerned with the development of quantitative indices of workload in aircraft piloting tasks. This paper presents a model-based approach for quantifying mental workload in operational terms. The suggested modeling framework is based on an interpreted Petri net characterization of a task in which 'places' are equated to specific task-related activities and 'transitions' are viewed as internal or external forcing events. It is shown that within this framework quantitative assessments can be made of both cumulative and instantaneous workload associated with the performance of a task and its individual component subtasks. It is suggested that insights gained from analyzing task-specific workload within this modeling paradigm can suggest plausible explanations for reconciling discrepancies between subjectively elicited workload estimates and behavioral/performance measures.

Madni, A. M.↗

NASA NTRS1988

Performance analysis of the Alliant FX/8 multiprocessor using statistical clustering

Results for two distinct, real, scientific workloads executed on an Alliant FX/8 are discussed. A combination of user concurrency and system overhead measurements was taken for both workloads. Preliminary analysis shows that the first sampled workload is comprised of consistently high user concurrency, low system overhead, and little paging. The second sample has much less user concurrency, but significant paging and system overhead. Statistical cluster analysis is used to extract a state transition model to jointly characterize user concurrency and system overhead. A skewness factor is introduced and used to bring out the effects of unbalanced clustering when determining states with important transitions. The results from the models show that during the collection of the first sample, the system was operating in states of high user concurrency approximately 75 percent of the time. The second workload sample shows the system in high user concurrency states only 26 percent of the time. In addition, it is ascertained that high system overhead is usually accompanied by low user concurrency. The analysis also shows a high predictability of system behavior for both workloads.

Dimpsey, Robert Tod↗

NASA NTRS1972

A workload model and measures for computer performance evaluation

A generalized workload definition is presented which constructs measurable workloads of unit size from workload elements, called elementary processes. An elementary process makes almost exclusive use of one of the processors, CPU, I/O processor, etc., and is measured by the cost of its execution. Various kinds of user programs can be simulated by quantitative composition of elementary processes into a type. The character of the type is defined by the weights of its elementary processes and its structure by the amount and sequence of transitions between its elementary processes. A set of types is batched to a mix. Mixes of identical cost are considered as equivalent amounts of workload. These formalized descriptions of workloads allow investigators to compare the results of different studies quantitatively. Since workloads of different composition are assigned a unit of cost, these descriptions enable determination of cost effectiveness of different workloads on a machine. Subsequently performance parameters such as throughput rate, gain factor, internal and external delay factors are defined and used to demonstrate the effects of various workload attributes on the performance of a selected large scale computer system.

Kerner, H.↗

NASA NTRS1985

Effects of digital altimetry on pilot workload

A series of VOR-DME instrument landing approaches was flown in the DC-9 full-workload simulator to compare pilot performance, scan behavior, and workload when using a computer-drum-pointer altimeter (CDPA) and a digital altimeter (DA). Six pilots executed two sets of instrument landing approaches, with a CDPA on one set and a DA on the other set. Pilot scanning parameters, flight performance, and subjective opinion data were evaluated. It is found that the processes of gathering information from the CDPA and the DA are different. The DA requires a higher mental workload than the CDPA for a VOR-DME type landing approach. Mental processing of altitude information after transitioning back to the attitude indicator is more evident with the DA than with the CDPA.

Harris, R. L., Sr.↗

NASA NTRS1984

Effects of digital altimetry on pilot workload

A series of VOR-DME instrument landing approaches was flown in the DC-9 full-workload simulator to compare pilot performance, scan behavior, and workload when using a computer-drum-pointer altimeter (CDPA) and a digital altimeter (DA). Six pilots executed two sets of instrument landing approaches, with a CDPA on one set and a DA on the other set. Pilot scanning parameters, flight performance, and subjective opinion data were evaluated. It is found that the processes of gathering information from the CDPA and the DA are different. The DA requires a higher mental workload than the CDPA for a VOR-DME type landing approach. Mental processing of altitude information after transitioning back to the attitude indicator is more evident with the DA than with the CDPA.

Harris, R. L., Sr.↗

NASA NTRS1992

Simulation and flight test evaluation of head-up-display guidance for Harrier approach transitions

Position and speed guidance displays for STOVL aircraft curved, decelerating approaches to hover and vertical landing have been evaluated for their effectiveness in reducing pilot workload and improving performance. The NASA V/STOL Systems Research Aircraft, a modified YAV-8B Harrier prototype, was used to evaluate the displays in flight, while the NASA Ames Vertical Motion Simulator was used to extend the flight test results to instrument meteorological conditions (IMC) and to examine performance in various conditions of wind and turbulence. The simulation data showed close correlation with the flight test data, and both demonstrated the feasibility of the displays. With the exception of the hover task in zero visibility, which was Level-3, averaged Cooper-Harper handling qualities ratings given during simulation were Level-2 for both the approach task and the hover task in all conditions. During flight tests in calm and clear conditions, the displays also gave rise to Level-2 handling qualities ratings. Pilot opinion showed that the guidance displays would be useful in visual flight, especially at night, as well as in IMC.

Dorr, D. W.↗

NASA NTRS1994

Simulation and flight test evaluation of head-up-display guidance for harrier approach transitions

Position and speed guidance displays for STOVL aircraft curved, decelerating approaches to hover and vertical landing have been evaluated for their effectiveness in reducing pilot workload and improving performance. The NASA V/STOL Systems Research Aircraft, a modified YAV-8B Harrier prototype, was used to evaluate the displays in flight, whereas the NASA Ames Vertical Motion Simulator was used to extend the flight test results to instrument meteorological conditions (IMC) and to examine performance in various conditions of wind and turbulence. The simulation data showed close correlation with the flight test data, and both demonstrated the feasibility of the displays. With the exception of the hover task in zero visibility, which was level-3, averaged Copper-Harper handling qualities ratings given during simulation were level-2 for both the approach task and the hover task in all conditions. During flight tests in calm and clear conditions, the displays also gave rise to level-2 handling qualities ratings. Pilot opinion showed that the guidance displays would be useful in visual flight, especially at night, as well as in IMC.

HARRIER APPROACH↗

NASA NTRS2010

Interplanetary Transit Simulations Using the International Space Station

We evaluated the space life sciences utility of the International Space Station (ISS) to simulate the outbound transit portion of missions to Mars and Near Earth Asteroids (NEA) to investigate biomedical and psychological aspects of such transits, to develop and test space operation procedures compatible with communication delays and outages, and to demonstrate and validate technologies and countermeasures. Two major categories of space life sciences activities can capitalize on ISS capabilities. The first includes studies that require ISS (or a comparable facility), typically for access to prolonged weightlessness. The second includes studies that do not strictly require ISS but can exploit it to maximize their scientific return more efficiently and productively than in ground-based simulations. For these studies, ISS offers a high fidelity analog for fundamental factors on future missions, such as crew composition, mission control personnel, operational tasks and workload, real-world risk, and isolation, and can mimic the effects of distance and limited accessibility. In addition to conducting Mars- and NEA-transit simulations on 6-month ISS increments, extending the current ISS increment duration from 6 months to 9 or even 12 months will provide opportunities for enhanced and focused research relevant to long duration Mars and NEA missions. Increasing the crew duration may pose little additional risk to crewmembers beyond that currently accepted on 6-month increments, but additional medical monitoring capabilities will be required beyond those currently used for ISS operations. Finally, while presenting major logistical challenges, such a simulation followed by a post-landing simulation of Mars exploration could provide quantitative evidence of capabilities in an actual mission. Thus, the use of ISS to simulate aspects of Mars and NEA missions seems practical. If it were to be implemented without major disruption of on-going ISS activities, then planning should begin soon, in close consultation with all international partners.

Charles, John B.↗

NASA NTRS2016

NASA HRP Plans for Collaboration at the IBMP Ground-Based Experimental Facility (NEK)

NASA and IBMP are planning research collaborations using the IBMP Ground-based Experimental Facility (NEK). The NEK offers unique capabilities to study the effects of isolation on behavioral health and performance as it relates to spaceflight. The NEK is comprised of multiple interconnected modules that range in size from 50-250m(sup3). Modules can be included or excluded in a given mission allowing for flexibility of platform design. The NEK complex includes a Mission Control Center for communications and monitoring of crew members. In an effort to begin these collaborations, a 2-week mission is planned for 2017. In this mission, scientific studies will be conducted to assess facility capabilities in preparation for longer duration missions. A second follow-on 2-week mission may be planned for early in 2018. In future years, long duration missions of 4, 8 and 12 months are being considered. Missions will include scenarios that simulate for example, transit to and from asteroids, the moon, or other interplanetary travel. Mission operations will be structured to include stressors such as, high workloads, communication delays, and sleep deprivation. Studies completed at the NEK will support International Space Station expeditions, and future exploration missions. Topics studied will include communication, crew autonomy, cultural diversity, human factors, and medical capabilities.

Cromwell, Ronita L.↗

NASA NTRSDate not supplied

Effects of Communication Modality on Pilot-Controller Coordination during a Simulated m:N Operation

The last decade or so has seen growing interest in new control paradigms and concepts of operation for uncrewed aircraft systems (UAS) in which multiple aircraft are piloted remotely by a single or relatively small number of people. Referred to as “one-to-many” and “many-to- many” (alternatively, “multi-operator, multi-vehicle”)—and frequently expressed as the corresponding ratios, 1:N and m:N—such novel configurations of aircraft and the people who manage them are seen as critical to the path to future operations involving UAS. Examples of industry domains interested in these control paradigms are small package delivery services utilizing small UAS and passenger-carrying, short-range “Urban Air Mobility” (UAM) operations. Stakeholders in such operations have identified communication and coordination of flight activity with air traffic controllers (ATC) as a barrier to operations. In contrast to present-day flight operations, in which a pilot communicates with one ATC on one radio frequency for one aircraft, multi-vehicle operations potentially entail a significant increase in pilot task load for management of comms. New concepts, such as UAS Service Suppliers (USSs) and Providers of Services to UAM (PSUs), have been proposed to address the known bottleneck for Air Traffic Management (ATM) presented by multi-vehicle operations. While progress has been steadily made over years developing USSs and PSUs, it is generally expected that initial UAM operations will rely on traditional voice-over-radio communication with ATC for purposes of ATM. The current study was a human-in-the-loop simulation that had participants, each possessing a Private Pilot License, act as the ground-based pilot-in- command for multiple vehicles in a hypothetical UAM service in the San Francisco Bay Area. The experiment utilized a 2-by-3, within-subjects design in which the pilot’s Vehicle Load (4 vs. 12) and Comm System (Voice, Datalink, and a Hybrid) were manipulated. The task given to pilots was to use the Comm System to coordinate flight activity for all aircraft with appropriate controllers, having to obtain departure and arrival clearances at “vertiport” facilities and transition clearances for any intermediate airspaces along the route. Pilots were additionally responsible for compliance with vectoring instructions issued by ATC. Subjective workload questionnaires (NASA-TLX) were administered following each experimental trial. Screen recordings of the pilot’s Ground Control Station (GCS) and audio recordings of trials were subsequently coded to obtain performance metrics: response times and error rates. Presented in this paper are results related to pilot responses to vectoring instructions issued by ATC. Workload was found to be significantly higher in the 12-Vehicle condition compared to the 4-Vehicle condition, nearly maxing out the NASA-TLX overall workload scale. There was no significant difference made by the Comm System on workload ratings. Pilots’ response times to communications were fastest in the Voice condition, although overall “service time” for compliance was shorter in Datalink and Hybrid conditions in most cases. Errors by pilots were frequent in both Vehicle Load conditions, most perniciously when using the Voice system. The results of this study suggest tradeoffs in advantages and disadvantages of the three comm systems. Recommendations for communication system design are provided taking the tradeoffs into account.

Garrett G Sadler↗

NASA NTRSDate not supplied

Effects of Communication Modality on Pilot-Controller Coordination during a Simulated m:N Operation

The last decade or so has seen growing interest in new control paradigms and concepts of operation for uncrewed aircraft systems (UAS) in which multiple aircraft are piloted remotely by a single or relatively small number of people. Referred to as “one-to-many” and “many-to- many” (alternatively, “multi-operator, multi-vehicle”)—and frequently expressed as the corresponding ratios, 1:N and m:N—such novel configurations of aircraft and the people who manage them are seen as critical to the path to future operations involving UAS. Examples of industry domains interested in these control paradigms are small package delivery services utilizing small UAS and passenger-carrying, short-range “Urban Air Mobility” (UAM) operations. Stakeholders in such operations have identified communication and coordination of flight activity with air traffic controllers (ATC) as a barrier to operations. In contrast to present-day flight operations, in which a pilot communicates with one ATC on one radio frequency for one aircraft, multi-vehicle operations potentially entail a significant increase in pilot task load for management of comms. New concepts, such as UAS Service Suppliers (USSs) and Providers of Services to UAM (PSUs), have been proposed to address the known bottleneck for Air Traffic Management (ATM) presented by multi-vehicle operations. While progress has been steadily made over years developing USSs and PSUs, it is generally expected that initial UAM operations will rely on traditional voice-over-radio communication with ATC for purposes of ATM. The current study was a human-in-the-loop simulation that had participants, each possessing a Private Pilot License, act as the ground-based pilot-in- command for multiple vehicles in a hypothetical UAM service in the San Francisco Bay Area. The experiment utilized a 2-by-3, within-subjects design in which the pilot’s Vehicle Load (4 vs. 12) and Comm System (Voice, Datalink, and a Hybrid) were manipulated. The task given to pilots was to use the Comm System to coordinate flight activity for all aircraft with appropriate controllers, having to obtain departure and arrival clearances at “vertiport” facilities and transition clearances for any intermediate airspaces along the route. Pilots were additionally responsible for compliance with vectoring instructions issued by ATC. Subjective workload questionnaires (NASA-TLX) were administered following each experimental trial. Screen recordings of the pilot’s Ground Control Station (GCS) and audio recordings of trials were subsequently coded to obtain performance metrics: response times and error rates. Presented in this paper are results related to pilot responses to vectoring instructions issued by ATC. Workload was found to be significantly higher in the 12-Vehicle condition compared to the 4-Vehicle condition, nearly maxing out the NASA-TLX overall workload scale. There was no significant difference made by the Comm System on workload ratings. Pilots’ response times to communications were fastest in the Voice condition, although overall “service time” for compliance was shorter in Datalink and Hybrid conditions in most cases. Errors by pilots were frequent in both Vehicle Load conditions, most perniciously when using the Voice system. The results of this study suggest tradeoffs in advantages and disadvantages of the three comm systems. Recommendations for communication system design are provided taking the tradeoffs into account.

urban air mobility↗

DOE OSTI2022

Lifting and Dropping VMs to Dynamically Transition Between Time- and Space-sharing for Large-Scale HPC Systems

As HPC environments increasingly integrate with edge based systems, system architectures will need to handle a broader class of workloads and scheduling requirements. One result of this shift will be the need to simultaneously support bulk-synchronous parallel (BSP) and on-demand service based applications on the same infrastructure. This in turn will require that future resource management approaches utilize both space-shared as well as time-shared resource scheduling strategies. In this work we introduce the concept of "VM-lifting'' (and its inverse "VM-Dropping'') which allows dynamically switching an HPC workload between space-shared and time-shared scheduling regimes. Our work targets co-kernel based HPC system software environments, in which multiple specialized OS kernels execute natively on dedicated physical resource partitions inside a single compute node. With VM-lifting, a native co-kernel can be migrated at runtime to and from locally hosted Virtual Machine Environments due to changing scheduling requirements of the node. This allows an HPC node to be dynamically (re-)configured as either a time-shared Infrastructure-as-a-Service (IaaS) resource or a dedicated space shared resource based on the current workload demands. We have implemented this approach in the context of the Hobbes Exascale System Software stack and have demonstrated that a node can be reconfigured with minimal impact on the running applications.

Gordon, Nick↗

NASA NTRS2018

Complexity-Based Link Assignment for NASA’s Deep Space Network for Follow-the-Sun Operations

NASA’s Deep Space Network (DSN) recently underwent a paradigm shift in its operations approach called Follow the Sun Operations (FtSO) in an effort to increase efficiency for forthcoming expansion of the network. This change requires each Deep Space Communications Complex (DSCC) to remotely control the other two complexes’ antennas during their local day shift, in contrast to locally controlling only their own antennas 24x7. Remote operations increases the workload of each complex during their day shift, specifically that of the Link Control Operators (LCOs), and presents a new challenge for planning and managing the distribution of responsibility for each link. A new DSN software assembly, the Link Complexity and Maintenance (LCM) software, was developed to support workload management for LCOs, as well as for planning site-local maintenance activities. The LCM deployment was a vital part of the transition to FtSO in November 2017. This paper discusses the architecture of LCM, its feature set, and lessons learned during its development and rollout.

Lee, Carlyn↗

DOE OSTI2024

IRIS-GNN: Leveraging Graph Neural Networks for Scheduling on Truly Heterogeneous Runtime Systems

The diversity of accelerators in computer systems poses significant challenges for software developers, such as managing vendor-specific compiler toolchains, code fragmentation requiring different kernel implementations, and performance portability issues. To address these, the Intelligent Runtime System (IRIS) was developed. IRIS works across various systems, from smartphones to supercomputers, enabling automatic performance scaling based on available accelerators. It introduces abstract tasks for seamless execution transitions between accelerators while ensuring memory consistency and task dependencies. Although IRIS simplifies system details, optimal dynamic scheduling still requires user input to understand workload structures. To address this, we introduce a new scheduling policy for IRIS, termed IRIS-GNN, which is the first IRIS hybrid policy that operates in conjunction with the dynamic policies. This policy employs a Graph-Neural Network (GNN) to conduct Graph Classification of any task graphs submitted to IRIS. This GNN analyzes the structure and attributes of the task graph, categorizing it as either locality, concurrency, or mixed. This classification subsequently guides the selection of the dynamic policy used by IRIS. We provide a comparison of the performance of IRIS-GNN against the complete spectrum of IRIS’s dynamic policies, assess the overhead introduced by the GNN within this scheduling framework, and ultimately explore its practical application in real-world scenarios.

Johnston, Beau↗

NASA NTRS2020

Exploring Cognitive States: Methods for Detecting Physiological Temporal Fingerprints

Cognitive state detection and its relationship to observable physiologically telemetry has been utilized for many human-machine and human-cybernetic applications. This paper aims at understanding and addressing if there are unique psychophysiological patterns over time, a ”physiological temporal fingerprint”, that is associated with specific cognitive states. This preliminary work involves commercial airline pilots completing experimental benchmark task inductions of three cognitive states: 1) Channelized Attention (CA); 2) High Workload (HW); and 3) Low Workload (LW). We approach this objective by modeling these "fingerprints" through the use of Hidden Markov Models and Entropy analysis to evaluate if the transitions over time are complex or rhythmic/predictable by nature. Our results indicate that cognitive states do have unique complexity of physiological sequences that are statistically different from other cognitive states. More specifically, CA has a significantly higher temporal psychophysiological complexity than HW and LW in EEG and ECG telemetry signals. With regards to respiration telemetry, CA has a lower temporal psychophysiological complexity than HW and LW. Through our preliminary work, addressing this unique underpinning can inform whether these underlying dynamics can be utilized to understand how humans transition between cognitive states and for improved detection of cognitive states.

Napoli, Nicholas J.↗