Engineering Papers⌕ Search

Engineering topics

Kirlik, Alex

Publications and source records attributed to Kirlik, Alex.

Flight Envelope Information-Augmented Display for Enhanced Pilot Situation Awareness

This paper presents an interface system display which is conceived to improve pilot situation awareness with respect to a flight envelope protection system developed for a mid-sized transport aircraft. The new display is designed to complement existing cockpit displays, and to augment them with information that relates to both aircraft state and the control automation itself. In particular, the proposed display provides cues about the state of automation directly in terms of pilot control actions, in addition to flight parameters. The paper also describes a forthcoming evaluation test plan that is intended to validate the developed interface by assessing the relevance of the displayed information, as well as the adequacy of the display layout.

Ackerman, Kasey A.↗

Using Computational Cognitive Modeling to Diagnose Possible Sources of Aviation Error

We present a computational model of a closed-loop, pilot-aircraft-visual scene-taxiway system created to shed light on possible sources of taxi error. Creating the cognitive aspects of the model using ACT-R required us to conduct studies with subject matter experts to identify experiential adaptations pilots bring to taxiing. Five decision strategies were found, ranging from cognitively-intensive but precise, to fast, frugal but robust. We provide evidence for the model by comparing its behavior to a NASA Ames Research Center simulation of Chicago O'Hare surface operations. Decision horizons were highly variable; the model selected the most accurate strategy given time available. We found a signature in the simulation data of the use of globally robust heuristics to cope with short decision horizons as revealed by errors occurring most frequently at atypical taxiway geometries or clearance routes. These data provided empirical support for the model.

Pilots↗

Mode Transitions in Glass Cockpit Aircraft: Results of a Field Study

One consequence of increased levels of automation in complex control systems is the presence of modes. A mode is a particular configuration of a control system that defines how human command inputs are interpreted. In complex systems, modes also often determine a specific allocation of control authority between the human and automated systems. Even in simple static devices (e.g., electronic watches, word processors), the presence of modes has been found to cause problems in either-the acquisition or production of skilled performance. Many of these problems arise due to the fact that the selection of a mode causes device behavior to be mediated by hidden internal state information. For these simple systems, many of these interaction problems can be solved by the design of appropriate feedback to communicate internal state information to the human operator. In complex dynamic systems, however, the design issues associated with modes seem to trancend the problem of merely communicating internal state information via displayed feedback. In complex supervisory control systems (e.g., aircraft, spacecraft, military command and control), a key function of modes is the selection of a particular configuration of control authority between the human operator and automated control systems. One mode may result in full manual control, another may result in a mix of manual and automatic control, while a third may result in full automatic control over the entire system. The human operator selects an appropriate mode as a function of current goals, operating conditions, and operating procedures. Thus, the operator is put in a position of essentially trying to control two coupled dynamic systems: the target system itself, and also a highly complex suite of automation controlling the target system. From a historical perspective, it should probably not come as a surprise that very little information is available to guide the design of mode-oriented control systems. The topic of function allocation (i.e., the proper division of control authority among human and computer) has a long history in human-machine systems research. Although this research has produced some relevant guidelines, a design approach capable of defining appropriate allocations of control function between the human and automation is not yet available. As a result, the function allocation decision itself has been allocated to the operator, to be performed in real-time, in the operation of mode-oriented control systems. A variety of documented aircraft accidents and incidents suggest that the real-time selection and monitoring of control modes is a weak link in the effective operation of complex supervisory control systems. Research in human-machine systems and human-computer interaction has barely scraped the surface of the problem of understanding how operators manage this task.The purpose of this paper is to present the results of a field study which examined how operators manage mode selection in a complex supervisory control system. Data on mode engagements using the Boeing B757/767 auto-flight system were collected during approach and descent into four major airports in the East Coast of the United States. Protocols documenting mode selection, automatic mode changes, pilot actions, quantitative records of flight-path variables, and verbal reports during and after mode engagements were collected by an observer from the jumpseat. Observations were conducted on two typical trips between three airports. Each trip was be replicated 11 times, which yielded a total of 22 trips and 66 legs on which data were collected. All data collected concerned the same flight numbers, and therefore, the same time of day, same type of aircraft, and identical operational environments (e.g., ATC facilities, weather patterns, traffic flow etc.)

Degani, Asaf↗

Modes in Supervisory Control Systems: Structure and Transitions

Mode confusion is becoming a major drawback in operator interaction with systems that allow for multiple levels of automation. This drawback has manifested itself in several mode related accidents and incidents in commercial aviation, military control systems, as well as high technology medical systems. In the domain of commercial aviation, there have been four recent airline accidents, all involving highly automated aircraft, in which mode related problems were present. Mode problems, we argue, stem from three principal factors: (1) mis-identification of the current mode, (2) difficulty in apprehending current mode behavior; and (3) difficulty in predicting the consequences of the next mode transition. This combination of factors may lead to mode confusion and possibly unwanted results. We define in this paper a mode as the system's manner of behavior. Any given system or machine, may have several ways of behaving. A controller, either human or machine, provides the input that triggers the transition from one mode of behavior to another. At any point in time, a machine may be in one mode or another modes are mutually exclusive. Complex systems are typically comprised of several subsystems, or components, each one with its own set of modes. Therefore, the status of the system at any point in time can be described as a vector of all the active modes.

Degani, Asaf↗

Acquisition and production of skilled behavior in dynamic decision-making tasks

Summaries of the four projects completed during the performance of this research are included. The four projects described are: Perceptual Augmentation Aiding for Situation Assessment, Perceptual Augmentation Aiding for Dynamic Decision-Making and Control, Action Advisory Aiding for Dynamic Decision-Making and Control, and Display Design to Support Time-Constrained Route Optimization. Papers based on each of these projects are currently in preparation. The theoretical framework upon which the first three projects are based, Ecological Task Analysis, was also developed during the performance of this research, and is described in a previous report. A project concerned with modeling strategies in human control of a dynamic system was also completed during the performance of this research.

Kirlik, Alex↗

Modeling strategic behavior in human-automation interaction - Why an 'aid' can (and should) go unused

Task-offload aids (e.g., an autopilot, an 'intelligent' assistant) can be selectively engaged by the human operator to dynamically delegate tasks to automation. Introducing such aids eliminates some task demands but creates new ones associated with programming, engaging, and disengaging the aiding device via an interface. The burdens associated with managing automation can sometimes outweigh the potential benefits of automation to improved system performance. Aid design parameters and features of the overall multitask context combine to determine whether or not a task-offload aid will effectively support the operator. A modeling and sensitivity analysis approach is presented that identifies effective strategies for human-automation interaction as a function of three task-context parameters and three aid design parameters. The analysis and modeling approaches provide resources for predicting how a well-adapted operator will use a given task-offload aid, and for specifying aid design features that ensure that automation will provide effective operator support in a multitask environment.

Kirlik, Alex↗

Acquisition and production of skilled behavior in dynamic decision-making tasks

This status report consists of a thesis entitled 'Ecological Task Analysis: A Method for Display Enhancements.' Previous use of various analysis processes for the purpose of display interface design or enhancement has run the risk of failing to improve user performance due to the analysis resulting in only a sequencial listing of user tasks. Adopting an ecological approach to performing the task analysis, however, may result in the necessary modeling of an unpredictable and variable task domain required to improve user performance. Kirlik has proposed an Ecological Task Analysis framework which is designed for this purpose. It is the purpose of this research to measure this framework's effectiveness at enhancing display interfaces in order to improve user performance. Following the proposed framework, an ecological task analysis of experienced users of a complex and dynamic laboratory task, Star Cruiser, was performed. Based on this analysis, display enhancements were proposed and implemented. An experiment was then conducted to compare this new version of Star Cruiser to the original. By measuring user performance at different tasks, it was determined that during early sessions, use of the enhanced display contributed to better user performance compared to that achieved using the original display. Furthermore, the results indicate that the enhancements proposed as a result of the ecological task analysis affected user performance differently depending on whether they are enhancements which aid in the selection of a possible action or in the performance of an action. Generalizations of these findings to larger, more complex systems were avoided since the analysis was only performed on this one particular system.

Kirlik, Alex↗

Acquisition and production of skilled behavior in dynamic decision-making tasks

Detailed summaries of two NASA-funded research projects are provided. The first project was an ecological task analysis of the Star Cruiser model. Star Cruiser is a psychological model designed to test a subject's level of cognitive activity. Ecological task analysis is used as a framework to predict the types of cognitive activity required to achieve productive behavior and to suggest how interfaces can be manipulated to alleviate certain types of cognitive demands. The second project is presented in the form of a thesis for the Masters Degree. The thesis discusses the modeling of decision-making through the use of neural network and genetic-algorithm machine learning technologies.

Kirlik, Alex↗

Comparison of display enhancement with intelligent decision-aiding

Currently, two main approaches exist for improving the human-machine interface component of a system in order to improve overall system performance, display enhancement and intelligent decision aiding. Each of these two approaches has its own set of advantages and disadvantages, as well as introduce its own set of additional performance problems. These characteristics should help identify which types of problem situations and domains are better aided by which type of strategy. The characteristic issues are described of these two decision aiding strategies. Then differences in expert and novice decision making are described in order to help determine whether a particular strategy may be better for a particular type of user. Finally, research is outlined to compare and contrast the two technologies, as well as to examine the interaction effects introduced by the different skill levels and the different methods for training operators.

Kirlik, Alex↗

Acquisition and production of skilled behavior in dynamic decision-making tasks

Currently, two main approaches exist for improving the human-machine interface component of a system in order to improve overall system performance - display enhancement and intelligent decision making. Discussed here are the characteristic issues of these two decision-making strategies. Differences in expert and novice decision making are described in order to help determine whether a particular strategy may be better for a particular type of user. Research is outlined to compare and contrast the two technologies, as well as to examine the interaction effects introduced by the different skill levels and the different methods for training operators.

Kirlik, Alex↗

Acquisition and production of skilled behavior in dynamic decision-making tasks: Modeling strategic behavior in human-automation interaction: Why and aid can (and should) go unused

Advances in computer and control technology offer the opportunity for task-offload aiding in human-machine systems. A task-offload aid (e.g., an autopilot, an intelligent assistant) can be selectively engaged by the human operator to dynamically delegate tasks to an automated system. Successful design and performance prediction in such systems requires knowledge of the factors influencing the strategy the operator develops and uses for managing interaction with the task-offload aid. A model is presented that shows how such strategies can be predicted as a function of three task context properties (frequency and duration of secondary tasks and costs of delaying secondary tasks) and three aid design properties (aid engagement and disengagement times, aid performance relative to human performance). Sensitivity analysis indicates how each of these contextual and design factors affect the optimal aid aid usage strategy and attainable system performance. The model is applied to understanding human-automation interaction in laboratory experiments on human supervisory control behavior. The laboratory task allowed subjects freedom to determine strategies for using an autopilot in a dynamic, multi-task environment. Modeling results suggested that many subjects may indeed have been acting appropriately by not using the autopilot in the way its designers intended. Although autopilot function was technically sound, this aid was not designed with due regard to the overall task context in which it was placed. These results demonstrate the need for additional research on how people may strategically manage their own resources, as well as those provided by automation, in an effort to keep workload and performance at acceptable levels.

Kirlik, Alex↗

Requirements for psychological models to support design: Towards ecological task analysis

Cognitive engineering is largely concerned with creating environmental designs to support skillful and effective human activity. A set of necessary conditions are proposed for psychological models capable of supporting this enterprise. An analysis of the psychological nature of the design product is used to identify a set of constraints that models must meet if they can usefully guide design. It is concluded that cognitive engineering requires models with resources for describing the integrated human-environment system, and that these models must be capable of describing the activities underlying fluent and effective interaction. These features are required in order to be able to predict the cognitive activity that will be required given various design concepts, and to design systems that promote the acquisition of fluent, skilled behavior. These necessary conditions suggest that an ecological approach can provide valuable resources for psychological modeling to support design. Relying heavily on concepts from Brunswik's and Gibson's ecological theories, ecological task analysis is proposed as a framework in which to predict the types of cognitive activity required to achieve productive behavior, and to suggest how interfaces can be manipulated to alleviate certain types of cognitive demands. The framework is described in terms, and illustrated with an example from the previous research on modeling skilled human-environment interaction.

Kirlik, Alex↗

Acquisition and production of skilled behavior in dynamic decision-making tasks

Ongoing research investigating perceptual and contextual influences on skilled human performance in dynamic decision making environments is discussed. The research is motivated by two general classes of findings in recent decision making research. First, many studies suggest that the concrete context in which a task is presented has strong influences on the psychological processes used to perform the task and on subsequent performance. Second, studies of skilled behavior in a wide variety of task environments typically implicate the perceptual system as an important contributor to decision-making performance, either in its role as a mediator between the current decision context and stored knowledge, or as a mechanism capable of directly initiating activity through the development of a 'trained eye.' Both contextual and perceptual influences place limits on the ability of traditional utility-theoretic accounts of decision-making to guide display design, as variance in behavior due to contextual factors or the development of a perceptual skill is left unexplained. The author outlines a framework in which to view questions of perceptual and contextual influences on behavior and describe an experimental task and analysis technique which will be used to diagnose the possible role of perception in skilled decision making performance.

Kirlik, Alex↗