Engineering PapersSearch

Engineering topics

Johnson, Walter

Publications and source records attributed to Johnson, Walter.

Application of Human-Autonomy Teaming to an Advanced Ground Station for Reduced Crew Operations

Within human factors there is burgeoning interest in the "human-autonomy teaming" (HAT) concept as a way to address the challenges of interacting with complex, increasingly autonomous systems. The HAT concept comes out of an aspiration to interact with increasingly autonomous systems as a team member, rather than simply use automation as a tool. The authors, and others, have proposed core tenets for HAT that include bi-directional communication, automation and system transparency, and advanced coordination between human and automated teammates via predefined, dynamic task sequences known as "plays." It is believed that, with proper implementation, HAT should foster appropriate teamwork, thus increasing trust and reliance on the system, which in turn will reduce workload, increase situation awareness, and improve performance. To this end, HAT has been demonstrated and/or studied in multiple applications including search and rescue operations, healthcare and medicine, autonomous vehicles, photography, and aviation. The current paper presents one such effort to apply HAT. It details the design of a HAT agent, developed by Human Automation Teaming Solutions, Inc., to facilitate teamwork between the automation and the human operator of an advanced ground dispatch station. This dispatch station was developed to support a NASA project investigating a concept called Reduced Crew Operations (RCO); consequently, we have named the agent R-HATS. Part of the RCO concept involves a ground operator providing enhanced support to a large number of aircraft with a single pilot on the flight deck. When assisted by R-HATS, operators can monitor and support or manage a large number of aircraft and use plays to respond in real-time to complicated, workload-intensive events (e.g., an airport closure). A play is a plan that encapsulates goals, tasks, and a task allocation strategy appropriate for a particular situation. In the current implementation, when a play is initiated by a user, R-HATS determines what tasks need to be completed and has the ability to autonomously execute them (e.g., determining diversion options and uplinking new routes to aircraft) when it is safe and appropriate. R-HATS has been designed to both support end users and researchers in RCO and HAT. Additionally, R-HATS and its underlying architecture were developed with generalizability in mind as a modular software applicable outside of RCO/aviation domains. This paper will also discuss future further development and testing of RHATS.

automation

Effects of Transparency on Pilot Trust and Agreement in the Autonomous Constrained Flight Planner

We performed a human-in-the-loop study to explore the role of transparency in engendering trust and reliance within highly automated systems. Specifically, we examined how transparency impacts trust in and reliance upon the Autonomous Constrained Flight Planner (ACFP), a critical automated system being developed as part of NASA's Reduced Crew Operations (RCO) Concept. The ACFP is designed to provide an enhanced ground operator, termed a super dispatcher, with recommended diversions for aircraft when their primary destinations are unavailable. In the current study, 12 commercial transport rated pilots who played the role of super dispatchers were given six time-pressured all land scenarios where they needed to use the ACFP to determine diversions for multiple aircraft. Two factors were manipulated. The primary factor was level of transparency. In low transparency scenarios the pilots were given a recommended airport and runway, plus basic information about the weather conditions, the aircraft types, and the airport and runway characteristics at that and other airports. In moderate transparency scenarios the pilots were also given a risk evaluation for the recommended airport, and for the other airports if they requested it. In the high transparency scenario additional information including the reasoning for the risk evaluations was made available to the pilots. The secondary factor was level of risk, either high or low. For high-risk aircraft, all potential diversions were rated as highly risky, with the ACFP giving the best option for a bad situation. For low-risk aircraft the ACFP found only low-risk options for the pilot. Both subjective and objective measures were collected, including rated trust, whether the pilots checked the validity of the automation recommendation, and whether the pilots eventually flew to the recommended diversion airport. Key results show that: 1) Pilots trust increased with higher levels of transparency, 2) Pilots were more likely to verify ACFPs recommendations with low levels of transparency and when risk was high, 3) Pilots were more likely to explore other options from the ACFP in low transparency conditions and when risk was high, and 4) Pilots decision to accept or reject ACFPs recommendations increased as a function of the transparency in the explanation. The finding that higher levels of transparency was coupled with higher levels of trust, a lower need to verify other options, and higher levels of agreement with ACFP recommendations, confirms the importance of transparency in aiding reliance on automated recommendations. Additional analyses of qualitative data gathered from subjects through surveys and during debriefing interviews also provided the basis for new design recommendations for the ACFP.

trust

3D-CDTI User Manual v2.1

The 3D-Cockpit Display of Traffic Information (3D-CDTI) is a flight deck tool that presents aircrew with: proximal traffic aircraft location, their current status and flight plan data; strategic conflict detection and alerting; automated conflict resolution strategies; the facility to graphically plan manual route changes; time-based, in-trail spacing on approach. The CDTI is manipulated via a touchpad on the flight deck, and by mouse when presented as part of a desktop flight simulator.

3D CDTI

Pilot Situation Awareness and Its Implications for Single Pilot Operations: Analysis of a Human-In-The-Loop Study

In 2012, NASA began exploring the feasibility of single pilot/reduced crew operations in the context of scheduled air carrier operations. The current study examined how important it was for ground-based personnel providing support to single piloted aircraft (ground operators) to have opportunities to acquire situation awareness (SA) prior to being called on to assist an aircraft. We looked at two distinct concepts of operation, which varied in how much information was available to ground operators prior to being called on to assist a critical event (no vs. some Situation Preview). Thirty-five commercial pilots participated in the current study. Results suggested that a ground operators’ lack of initial SA when called on for dedicated assistance is not an issue, at least when the ground operator station displays environmental and systems data which are important to gaining overall SA of the specified aircraft. With appropriate displays, ground operators were able to provide immediate assistance, even if they had minimal SA prior to getting a request.

Reduced crew operations

Influence of Cultural, Organizational, and Automation Capability on Human Automation Trust: A Case Study of Auto-GCAS Experimental Test Pilots

This paper discusses a case study that examined the influence of cultural, organizational and automation capability upon human trust in, and reliance on, automation. In particular, this paper focuses on the design and application of an extended case study methodology, and on the foundational lessons revealed by it. Experimental test pilots involved in the research and development of the US Air Force's newly developed Automatic Ground Collision Avoidance System served as the context for this examination. An eclectic, multi-pronged approach was designed to conduct this case study, and proved effective in addressing the challenges associated with the case's politically sensitive and military environment. Key results indicate that the system design was in alignment with pilot culture and organizational mission, indicating the potential for appropriate trust development in operational pilots. These include the low-vulnerability/ high risk nature of the pilot profession, automation transparency and suspicion, system reputation, and the setup of and communications among organizations involved in the system development.

trust

An Extended Case Study Methoology for Investigating Influence of Cultural, Organizational, and Automation Factors on Human-Automation Trust

This paper discusses a case study that examined the influence of cultural, organizational and automation capability upon human trust in, and reliance on, automation. In particular, this paper focuses on the design and application of an extended case study methodology, and on the foundational lessons revealed by it. Experimental test pilots involved in the research and development of the US Air Forces newly developed Automatic Ground Collision Avoidance System served as the context for this examination. An eclectic, multi-pronged approach was designed to conduct this case study, and proved effective in addressing the challenges associated with the cases politically sensitive and military environment. Key results indicate that the system design was in alignment with pilot culture and organizational mission, indicating the potential for appropriate trust development in operational pilots. These include the low-vulnerabilityhigh risk nature of the pilot profession, automation transparency and suspicion, system reputation, and the setup of and communications among organizations involved in the system development.

automation suspicion

UAS Integration Into the NAS: An Examination of Baseline Compliance in the Current Airspace System

As a result of the FAA Modernization and Reform Act of 2012, Unmanned Aerial Systems (UAS) are expected to be integrated into the National Airspace System (NAS) by 2015. Several human factors challenges need to be addressed before UAS can safely and routinely fly in the NAS with manned aircraft. Perhaps the most significant challenge is for the UAS to be non-disruptive to the air traffic management system. Another human factors challenge is how to provide UAS pilots with intuitive traffic information in order to support situation awareness (SA) of their airspace environment as well as a see-and-avoid capability comparable to manned aircraft so that a UAS pilot could safely maneuver the aircraft to maintain separation and collision avoidance if necessary. A simulation experiment was conducted to examine baseline compliance of UAS operations in the current airspace system. Researchers also examined the effects of introducing a Cockpit Situation Display (CSD) into a UAS Ground Control Station (GCS) on UAS pilot performance, workload and situation awareness while flying in a positively controlled sector. Pilots were tasked with conducting a highway patrol police mission with a Medium Altitude Long Endurance (MALE) UAS in L.A. Center airspace with two mission objectives: 1) to reroute the UAS when issued new instructions from their commander, and 2) to communicate with Air Traffic Control (ATC) to negotiate flight plan changes and respond to vectoring and altitude change instructions. Objective aircraft separation data, workload ratings, SA data, and subjective ratings regarding UAS operations in the NAS were collected. Results indicate that UAS pilots were able to comply appropriately with ATC instructions. In addition, the introduction of the CSD improved pilot SA and reduced workload associated with UAS and ATC interactions.

Fern, Lisa

Design and Evaluation of Nextgen Aircraft Separation Assurance Concepts

To support the development and evaluation of future function allocation concepts for separation assurance systems for the Next Generation Air Transportation System, this paper presents the design and human-in-the-loop evaluation of three feasible function allocation concepts that allocate primary aircraft separation assurance responsibilities and workload to: 1) pilots; 2) air traffic controllers (ATC); and 3) automation. The design of these concepts also included rules of the road, separation assurance burdens for aircraft of different equipage levels, and utilization of advanced weather displays paired with advanced conflict detection and resolution automation. Results of the human-in-the-loop simulation show that: a) all the concepts are robust with respect to weather perturbation; b) concept 1 (pilots) had highest throughput, closest to assigned spacing, and fewest violations of speed and altitude restrictions; c) the energy of the aircraft during the descent phase was better managed in concepts 1 and 2 (pilots and ATC) than in concept 3 (automation), in which the situation awareness of pilots and controllers was lowest, and workload of pilots was highest. The paper also discusses further development of these concepts and their augmentation and integration with future air traffic management tools and systems that are being considered for NextGen.

Johnson, Walter

Task Allocation for Single Pilot Operations: A Role for the Ground

Researchers at NASA Ames Research Center and NASA Langley Research Center are jointly investigating issues associated with potential configurations for an environment in which a single pilot, or reduced crew, might operate. The research summarized in this document represents several of the efforts being put forth at NASA Ames Research Center. Specifically, researchers at NASA Ames Research Center coordinated and hosted a technical interchange meeting in order to gain insight from members of the aviation community. A description of this meeting and the findings are presented first. Thereafter, plans for ensuing research are presented.

Johnson, Walter

Metrics for Operator Situation Awareness, Workload, and Performance in Automated Separation Assurance Systems

A research consortium of scientists and engineers from California State University Long Beach (CSULB), San Jose State University Foundation (SJSUF), California State University Northridge (CSUN), Purdue University, and The Boeing Company was assembled to evaluate the impact of changes in roles and responsibilities and new automated technologies, being introduced in the Next Generation Air Transportation System (NextGen), on operator situation awareness (SA) and workload. To meet these goals, consortium members performed systems analyses of NextGen concepts and airspace scenarios, and concurrently evaluated SA, workload, and performance measures to assess their appropriateness for evaluations of NextGen concepts and tools. The following activities and accomplishments were supported by the NRA: a distributed simulation, metric development, systems analysis, part-task simulations, and large-scale simulations. As a result of this NRA, we have gained a greater understanding of situation awareness and its measurement, and have shared our knowledge with the scientific community. This network provides a mechanism for consortium members, colleagues, and students to pursue research on other topics in air traffic management and aviation, thus enabling them to make greater contributions to the field

Strybel, Thomas Z.

Factors Influencing the Decisions and Actions of Pilots and Air Traffic Controllers in Three Plausible NextGen Environments

In the current air traffic management (ATM) system, pilots and air traffic controllers have well-established roles and responsibilities: pilots fly aircraft and are concerned with energy management, fuel efficiency, and passenger comfort; controllers separate aircraft and are concerned with safety and management of traffic flows. Despite having different goals and obligations, both groups must be able to effectively communicate and interact with each other for the ATM system to work. This interaction will become even more challenging as traffic volume increases dramatically in the near future. To accommodate this increase, by 2025 the national air transportation system in the U.S. will go through a transformation that will modernize the ATM system and make it safer, more effective, and more efficient. This new system, NextGen, will change how pilots and controllers perform their tasks by incorporating advanced technologies and employing new procedures. It will also distribute responsibility between pilots, controllers and automation over such tasks as maintaining aircraft separation. The present chapter describes three plausible concepts of operations that allocate different ATM responsibilities to these groups. We describe how each concept changes the role of each operator and the types of decisions and actions performed by them.

Vu, Kim-Phuong L.

Pilot and Controller Workload and Situation Awareness with Three Traffic Management Concept

This paper reports on workload and situation awareness of pilots and controllers participating in a human-in-the-loop simulation using three different distributed air-ground traffic management concepts. Eight experimental pilots started the scenario in an en-route phase of flight and were asked to avoid convective weather while performing spacing and merging tasks along with a continuous descent approach (CDA) into Louisville Standiford Airport (SDF). Two controllers managed the sectors through which the pilots flew, with one managing a sector that included the Top of Descent, and the other managing a sector that included the merge point for arrival into SDF. At 3-minute intervals in the scenario, pilots and controllers were probed on their workload or situation awareness. We employed one of three concepts of operation that distributed separation responsibility across human controllers, pilots, and automation to measure changes in operator situation awareness and workload. We found that when pilots were responsible for separation, they had higher levels of awareness, but not necessarily higher levels of workload. When controllers are responsible and actively engaged, they showed higher workload levels compared to pilots and changes in awareness that were dependent on sector characteristics.

Vu, Kim-Phuong L.

Joint NASA Ames/Langley Experimental Evaluation of Integrated Air/Ground Operations for En Route Free Maneuvering

In order to meet the anticipated future demand for air travel, the National Aeronautics and Space Administration (NASA) is investigating a new concept of operations known as Distributed Air-Ground Traffic Management (DAG-TM). Under the En Route Free Maneuvering component of DAG-TM, appropriately equipped autonomous aircraft self separate from other autonomous aircraft and from managed aircraft that continue to fly under today s Instrument Flight Rules (IFR). Controllers provide separation services between IFR aircraft and assign traffic flow management constraints to all aircraft. To address concept feasibility issues pertaining to integrated air/ground operations at various traffic levels, NASA Ames and Langley Research Centers conducted a joint human-in-the-loop experiment. Professional airline pilots and air traffic controllers flew a total of 16 scenarios under four conditions: mixed autonomous/managed operations at three traffic levels and a baseline all-managed condition at the lowest traffic level. These scenarios included en route flights and descents to a terminal area meter fix in airspace modeled after the Dallas Ft. Worth area. Pilots of autonomous aircraft met controller assigned meter fix constraints with high success. Separation violations by subject pilots did not appear to vary with traffic level and were mainly attributable to software errors and procedural lapses. Controller workload was lower for mixed flight conditions, even at higher traffic levels. Pilot workload was deemed acceptable under all conditions. Controllers raised several safety concerns, most of which pertained to the occurrence of near-term conflicts between autonomous and managed aircraft. These issues are being addressed through better compatibility between air and ground systems and refinements to air and ground procedures.

Barhydt, Richard

Evaluation of a Terminal Area In-Trail Approach Spacing, Project and Study

Reported here are the results of work completed as a precursor to Distributed Air Ground (DAG), Concept Element 11 (CE11) research. CE11 is a NASA, Advanced Air Transportation Technologies (AATT) concept initiated to promote research on in-trail merging and spacing during approach in the terminal area environment, such that improvements to the National Air Space (NAS) may be realized. A description of the project concept, results of a preliminary study, and a literature review are presented. In terms of conclusions, study results, and reference material respectively: 1) the concept is supported as being significant to NAS capacity improvement, 2) the preliminary study indicated that having more than one downstream, in-trail aircraft present on a CDTI during approach may be advantageous, and that flying traditional Standard Terminal Arrival Routes (STAR) utilizing advanced decision support tools (DST) may be complicated by wake turbulence considerations, a lack of vertical awareness on the part of the flight crew, and the 'step-down' nature of many terminal area approaches, and 3) the results of a literature review are presented for future reference.

Shelden, Stephen

Pilot Performance on New ATM Operations: Maintaining In-Trail Separation and Arrival Sequencing

Cockpit Display of Traffic Information (CDTI) may enable new Air Traffic Management (ATM) operations. However, CDTI is not the only source of traffic information in the cockpit; ATM procedures may provide information, implicitly and explicitly, about other aircraft. An experiment investigated pilot ability to perform two new ATM operations - maintaining in-trail separation from another aircraft and sequencing into an arrival stream. In the experiment, pilots were provided different amounts of information from displays and procedures. The results are described.

Pritchett, Amy R.

Transition region, corona, and solar wind in coronal holes - Some two-fluid models

A model is presented which treats the heating of the corona and the heating and acceleration of the solar wind as a single process, namely, the turbulent dissipation of solar-generated Alfven waves at the Kolmogorov rate. This model is similar to that described by Hollweg (1986), except that the electron temperature and the proton temperature are allowed to have different values. It is found that, similar to the findings of Hollweg, solutions which yield base pressures in the observed range lead to solar wind flows which are much too slow at 1 AU; a new feature is the appearance of proton temperature peak near 3-4 solar radii. Thus, this model seems to be also unsatisfactory. Several possible resolutions are discussed.

Hollweg, Joseph V.