Engineering topics

Feary, Michael

Publications and source records attributed to Feary, Michael.

At least 19 records

NASA NTRS2019

Response Timing: Low Airspeed (Energy) Alerting

In response to NTSB Safety Recommendation A-14-043, the FAA was asked to task a panel of human factors, aviation operations, and aircraft design specialists, such as the Avionics Systems Harmonization Working Group (ASHWG), to develop design requirements for context-dependent low energy alerting systems for airplanes engaged in commercial operations. This recommendation is in association to the July 6, 2013, accident involving a Boeing 777-200ER, Korean registration HL7742, operating as Asiana Airlines flight 214, which was on approach to runway 28L when it struck a seawall at San Francisco International Airport (SFO), San Francisco, California. The FAA asked for human factor support from NASA in developing design requirements for context-dependent low energy alerting systems for airplanes engaged in commercial operations. Recently the ASHWG chair asked for continued support in examining flightcrew alert response timing and requested that NASA update the previous working paper on this subject. This product/paper will be provided to the ASHWG as part of the ongoing assignments from each of the ASHWG members in support of developing requirements and guidance for context-dependent low energy alerting systems for airplanes. The ASHWG is made up of interested parties from government and industry.

response timing↗

NASA NTRS2018

A First Look at the Evolution of Flight Crew Requirements for Emerging Market Aircraft

This is an exciting time for aviation. New vehicle and airspace technologies promise large increases in the number of aircraft in operation. One critical technology for these emerging markets is the increased use of automated systems to reduce pilot skill, training, and proficiency requirements. While the use of these systems promises to reduce or eliminate pilot functions in the long-term, the technology development for the required functions will necessitate a phased transition. The transition to, and adoption of automated systems will generate new safety challenges. This paper is a first look at a model to help frame flight crew functions for evaluation of future operational requirements. The model is intended to provide required flight crew functions regardless of whether the functions are performed by human or artificial agent. It is hoped that the model will be useful in identifying safety challenges and enabling a safe transition for the new aviation markets. The paper presents some background for a model for framing the flight crew function model and some thoughts about next steps.

safety-critical automation↗

NASA NTRS2018

Better Performance on the Psychomotor Vigilance Task Is Associated with Longer Sleep Duration and Lower Self-Reported Sleep Need in the Real World

The psychomotor vigilance task (PVT) is sensitive measure of performance impairment arising from sleep loss and circadian misalignment. Some individuals are able to maintain stable, good performance during laboratory-imposed sleep restriction. It is unclear whether such individuals need less sleep or whether they are more resilient to the effects of sleep loss. We aimed to characterize the relationship between sleep duration and perceived sleep need with PVT performance under real-world conditions.

sleep↗

NASA NTRS2018

Humans, Autonomy, and eVTOLs

Electric Vertical Takeoff and Landing (eVTOL) vehicle and airspace technologies promise large increases in the number of aircraft in operation. One critical technology for these emerging markets is the increased use of automated systems to reduce pilot skill, training, and proficiency requirements. While the use of these systems promises to reduce or eliminate pilot functions in the long-term, the technology development for the required functions will necessitate a phased transition. The transition to, and adoption of automated systems will generate new safety challenges. This presentation discusses current safety challenges, new challenges for eVTOLs, and some research focused on addressing these challenges.

Human-Automation Interaction↗

NASA NTRS2018

Managing Complex Airplane System Failures Through a Structured Assessment of Airplane Capabilities

This report describes an analysis of current transport aircraft system-management displays and the initial development of a set of display concepts for providing information about aircraft system status. The new display concepts are motivated by a shift away from the current approach to aircraft system alerting that reports the status of physical components, and towards displaying the implications for mission capability. Specifically, the proposed display concepts describe transport airplane component failures in terms of operational consequences of aircraft system degradations. The research activity described in this report is an effort to examine the utility of different representations of complex systems and operating environments to support real-time decision making during off-nominal situations. A specific focus is to develop display concepts that provide more highly integrated information to allow pilots to more easily reason about the operational consequences of the off-nominal situations. The work can also serve as a foundational element to autonomy-supported decision making since we are developing ideas for integrating information from the airplane and the operational environment to support decision making.

operational decision making↗

NASA NTRS2017

Understanding Human Autonomy Teaming Through Applications

This presentation describes the development and demonstration of human autonomy teaming technologies for improving aviation safety and efficiency during nominal and off-nominal operations by developing and validating increasingly autonomous systems concepts, technologies, and procedures.

Aponso, B.↗

NASA NTRS2016

Considerations for the Use of Remote Gaze Tracking to Assess Behavior in Flight Simulators

Complex user interfaces (such as those found in an aircraft cockpit) may be designed from first principles, but inevitably must be evaluated with real users. User gaze data can provide valuable information that can help to interpret other actions that change the state of the system. However, care must be taken to ensure that any conclusions drawn from gaze data are well supported. Through a combination of empirical and simulated data, we identify several considerations and potential pitfalls when measuring gaze behavior in high-fidelity simulators. We show that physical layout, behavioral differences, and noise levels can all substantially alter the quality of fit for algorithms that segment gaze measurements into individual fixations. We provide guidelines to help investigators ensure that conclusions drawn from gaze tracking data are not artifactual consequences of data quality or analysis techniques.

eye tracking↗

NASA NTRS2016

SIG: Multiple Views on Safety-Critical Automation: Aircraft, Autonomous Vehicles, Air Traffic Management and Satellite Ground Segments Perspectives

This SIG focuses on the engineering of automation in interactive critical systems. Automation has already been studied in a number of (sub-) disciplines and application fields: design, human factors, psychology, (software) engineering, aviation, health care, games. One distinguishing feature of the area we are focusing on is that in the field of interactive critical systems properties such as reliability, dependability, fault tolerance are as important as usability, user experience or overall acceptance issues. The SIG targets at two problem areas: first the engineering of the user interaction with (partly-) autonomous systems: how to design, build and assess autonomous behavior, especially in cases where there is a need to represent on the user interface both autonomous and interactive objects. An example of such integration is the representation of an unmanned aerial vehicle (UAV) (where no direct interaction is possible), together with aircrafts (that have to be instructed by an air traffic controller to avoid the UAV). Second the design and engineering of user interaction in general for autonomous objects/systems (for example a cruise control in a car or an autopilot in an aircraft). The goal of the SIG is to raise interest in the CHI community on the general aspects of automation and to identify a community of researchers and practitioners interested in those increasingly prominent issues of interfaces towards (semi)-autonomous systems. The expected audience should be interested in addressing the issues of integration of mainly unconnected research domains to formulate a new joint research agenda.

human-automation interaction↗

NASA NTRS2016

Understanding Current Safety Issues for Trajectory Based Operations

Increases in procedural complexity were investigated as a possible contributor to flight path deviations in airline operations. Understanding current operational issues and their causes must be embraced to maintain current safety standards while increasing future functionality. ASRS data and expert narratives were used to discover factors relating to pilot deviations. Our investigation pointed to ATC intervention, automation confusion, procedure design, and mixed equipment as primary issues. Future work will need to include objective data and mitigation strategies.

RNAV STAR↗

NASA NTRS2014

Variation in Sleep Duration and Circadian Phase by Duty Start Time Among Short-Haul Commercial Airline Pilots

Prior studies have confirmed that commercial airline pilots experience circadian phase shifts and short sleep duration following travel with layovers in different time zones. Few studies have examined the impact of early and late starts on the sleep and circadian phase of airline pilots who return to their domicile after each duty period. We recruited 44 pilots (4 female) from a short-haul commercial airline to participate in a study examining sleep and circadian phase over four duty schedules (baseline, early starts, mid-day starts, late starts). Each duty schedule was five days long, separated by three rest days. Participants completed the rosters in the same order. Sleep outcomes were estimated using wrist-borne actigraphy (Actiware Software, Respironics, Bend, OR) and daily sleep diaries. Thirteen participants volunteered to collect urine samples for the assessment of 6-sulfatoxymelatonin (aMT6s). Urine samples were collected in four hourly bins during the day and eight-hourly bins during sleep episodes, for 24 hours immediately following each experimental duty schedule. The aMT6s results were fit to a cosine in order to obtain the acrophase to estimate circadian phase. Univariate statistics were calculated for acrophase changes, schedule start times and sleep times. All statistical analyses were computed using SAS software (Cary, IN).The mean duty start times varied as expected (baseline 10:17 [ 3:50], early starts 5:24 [ 0:30], mid-day starts 13:52 [ 1:20], late starts 16:33 [ 1:33]). Actigraphy-derived sleep duration varied between schedule types, with the shortest average sleep durations occurring during the early starts and night duty. Mean circadian phase was similar during each schedule type (baseline 26:14 [ 3:22], early starts 25:29 [2:13], mid-day starts 26:20 [ 3:16], late starts 25:49 [ 4:28]), but there were wide inter-individual differences in phase shifting from the beginning to the end of the study, with phase shifts ranging from a 5.98 hour phase advance to an 11.34 hour phase delay. Our preliminary findings suggest that early and late starts are associated with reduced sleep duration. The dispersion in inter-individual differences in circadian phase across shifting duty schedules should be further evaluated to determine how schedule-induced phase shifts may affect operational performance.

Flynn-Evans, Erin↗

NASA NTRS2012

Cognitive Systems Engineering: The Next 30 Years

This presentation is part of panel discussion on Cognitive Systems Engineering. The purpose of this panel is to discuss the challenges and future directions of Cognitive Systems Engineering for the next 30 years. I intended to present the work we have been doing with the Aviation Safety program and Space Human Factors Engineering project on Work Domain Analysis and some areas of Research Focus. Specifically, I intend to focus on the shift on the need to understand and model attention in mixed-initiative systems, the need for methods which can generate results to be used in trade-off decisions, and the need to account for a range of human behavior in the design.

Feary, Michael↗

NASA NTRS2012

Human-Automation Integration: Principle and Method for Design and Evaluation

Future space missions will increasingly depend on integration of complex engineered systems with their human operators. It is important to ensure that the systems that are designed and developed do a good job of supporting the needs of the work domain. Our research investigates methods for needs analysis. We included analysis of work products (plans for regulation of the space station) as well as work processes (tasks using current software), in a case study of Attitude Determination and Control Officers (ADCO) planning work. This allows comparing how well different designs match the structure of the work to be supported. Redesigned planning software that better matches the structure of work was developed and experimentally assessed. The new prototype enabled substantially faster and more accurate performance in plan revision tasks. This success suggests the approach to needs assessment and use in design and evaluation is promising, and merits investigatation in future research.

human-automation integration↗

NASA NTRS2011

Automated Test Case Generation for an Autopilot Requirement Prototype

Designing safety-critical automation with robust human interaction is a difficult task that is susceptible to a number of known Human-Automation Interaction (HAI) vulnerabilities. It is therefore essential to develop automated tools that provide support both in the design and rapid evaluation of such automation. The Automation Design and Evaluation Prototyping Toolset (ADEPT) enables the rapid development of an executable specification for automation behavior and user interaction. ADEPT supports a number of analysis capabilities, thus enabling the detection of HAI vulnerabilities early in the design process, when modifications are less costly. In this paper, we advocate the introduction of a new capability to model-based prototyping tools such as ADEPT. The new capability is based on symbolic execution that allows us to automatically generate quality test suites based on the system design. Symbolic execution is used to generate both user input and test oracles user input drives the testing of the system implementation, and test oracles ensure that the system behaves as designed. We present early results in the context of a component in the Autopilot system modeled in ADEPT, and discuss the challenges of test case generation in the HAI domain.

Giannakopoulou, Dimitra↗

NASA NTRS2010

Collective Intelligence and Three Aspects of Planning in Organizations: A NASA Example

For many complex sociotechnical systems, planning seems to require explicit coordination; certainly, in executing a plan the activities of different actors must be tightly coupled. However, distributing the needed planning information can be very burdensome and error prone, because different groups need different collections of information, updated or kept current on different time cycles. Further, the information needed to form successful plans is often highly distributed, and while feedback about the success of prior plans may exist, it may not be available to those in a position of using this to improve plans or to detect and resolve other problems in the system (Weick, 1995). Tools to support various aspects of planning have been developed, and can provide a huge benefit to the individuals working on that aspect. To be tractable, most solutions address a quite bounded slice of work, isolating it from the larger context. Prospective planning takes place over multiple, nested cycles of decision making. This builds a plan that specifies activities of different granularity. "Subplans" may specify multiple parallel activities by different groups and individuals, as well as sequential, nested actions by a single actor. Planning produces valuable, sharable, external, representations: in addition to prospective use, plans support retrospective assessment and also action in the present. Viewing planning in a larger context - both temporal and organizational -- enables noticing what one does not know and generating more systemic and effective solutions. Viewing a problem as one of collective intelligence invites thinking about the larger organizational context. Many approaches to supporting collective intelligence do not support execution of highly contingent actions, distributed across many players, and hence provide incomplete support for planning. However, CI technology maybe helpful in managing the processes of gathering information for decision making in planning and of distributing plan information to various actors, needed on various time cycles.

Billman, Dorrit↗

NASA NTRS2003

Drinking from the Fire Hose: Why the Flight Management System Can Be Hard to Train and Difficult to Use

The Flight Management Computer (FMC) and its interface, the Multi-function Control and Display Unit (MCDU) have been identified by researchers and airlines as difficult to train and use. Specifically, airline pilots have described the "drinking from the fire-hose" effect during training. Previous research has identified memorized action sequences as a major factor in a user s ability to learn and operate complex devices. This paper discusses the use of a method to examine the quantity of memorized action sequences required to perform a sample of 102 tasks, using features of the Boeing 777 Flight Management Computer Interface. The analysis identified a large number of memorized action sequences that must be learned during training and then recalled during line operations. Seventy-five percent of the tasks examined require recall of at least one memorized action sequence. Forty-five percent of the tasks require recall of a memorized action sequence and occur infrequently. The large number of memorized action sequences may provide an explanation for the difficulties in training and usage of the automation. Based on these findings, implications for training and the design of new user-interfaces are discussed.

Sherry, Lance↗

NASA NTRS2001

A Cognitive Engineering Analysis of the Vertical Navigation (VNAV) Function

A cognitive engineering analysis of the Flight Management System (FMS) Vertical Navigation (VNAV) function has identified overloading of the VNAV button and overloading of the Flight Mode Annunciator (FMA) used by the VNAV function. These two types of overloading, resulting in modal input devices and ambiguous feedback, are well known sources of operator confusion, and explain, in part, the operational issues experienced by airline pilots using VNAV in descent and approach. A proposal to modify the existing VNAV design to eliminate the overloading is discussed. The proposed design improves pilot's situational awareness of the VNAV function, and potentially reduces the cost of software development and improves safety.

Sherry, Lance↗

NASA NTRS1998

Aiding Vertical Guidance Understanding

A two-part study was conducted to evaluate modern flight deck automation and interfaces. In the first part, a survey was performed to validate the existence of automation surprises with current pilots. Results indicated that pilots were often surprised by the behavior of the automation. There were several surprises that were reported more frequently than others. An experimental study was then performed to evaluate (1) the reduction of automation surprises through training specifically for the vertical guidance logic, and (2) a new display that describes the flight guidance in terms of aircraft behaviors instead of control modes. The study was performed in a simulator that was used to run a complete flight with actual airline pilots. Three groups were used to evaluate the guidance display and training. In the training, condition, participants went through a training program for vertical guidance before flying the simulation. In the display condition, participants ran through the same training program and then flew the experimental scenario with the new Guidance-Flight Mode Annunciator (G-FMA). Results showed improved pilot performance when given training specifically for the vertical guidance logic and greater improvements when given the training and the new G-FMA. Using actual behavior of the avionics to design pilot training and FMA is feasible, and when the automated vertical guidance mode of the Flight Management System is engaged, the display of the guidance mode and targets yields improved pilot performance.

Feary, Michael↗

NASA NTRS1998

Why is it Doing That? - Assumptions about the FMS

In the glass cockpit, it's not uncommon to hear exclamations such as "why is it doing that?". Sometimes pilots ask "what were they thinking when they set it this way?" or "why doesn't it tell me what it's going to do next?". Pilots may hold a conceptual model of the automation that is the result of fleet lore, which may or may not be consistent with what the engineers had in mind. But what did the engineers have in mind? In this study, we present some of the underlying assumptions surrounding the glass cockpit. Engineers and designers make assumptions about the nature of the flight task; at the other end, instructor and line pilots make assumptions about how the automation works and how it was intended to be used. These underlying assumptions are seldom recognized or acknowledged, This study is an attempt to explicitly arti culate such assumptions to better inform design and training developments. This work is part of a larger project to support training strategies for automation.

Feary, Michael↗