Engineering Papers⌕ Search

Engineering topics

Martin, Lynne

Publications and source records attributed to Martin, Lynne.

At least 37 records · Page 2

Human-Automation Cooperation for Separation Assurance in Future NextGen Environments

A 2012 Human-In-The-Loop air traffic control simulation investigated a gradual paradigm-shift in the allocation of functions between operators and automation. Air traffic controllers staffed five adjacent high-altitude en route sectors, and during the course of a two-week experiment, worked traffic under different function-allocation approaches aligned with four increasingly mature NextGen operational environments. These NextGen time-frames ranged from near current-day operations to nearly fully-automated control, in which the ground systems automation was responsible for detecting conflicts, issuing strategic and tactical resolutions, and alerting the controller to exceptional circumstances. Results indicate that overall performance was best in the most automated NextGen environment. Safe operations were achieved in this environment for twice todays peak airspace capacity, while being rated by the controllers as highly acceptable. However, results show that sector operations were not always safe; separation violations did in fact occur. This paper will describe in detail the simulation conducted, as well discuss important results and their implications.

air traffic control↗

System-Level Performance Evaluation of ATD-1 Ground-Based Technologies

A series of large-scale human-in-the-loop simulations were conducted in the Airspace Operations Laboratory (AOL) at NASA Ames Research Center to evaluate the system-level performance of NASA Air Traffic Management Technology Demonstration-1 (ATD-1) ground-based technologies. The ATD-1 ground-based technologies are the Traffic Management Advisor for Terminal Metering (TMA-TM) and Controller-Managed Spacing (CMS) tools. The simulations compared current operations to ATD-1 operations for peak-period arrivals to Phoenix Sky Harbor International Airport (PHX). Results indicate that controllers new to ATD-1 operations can increase the use of Performance-Based Navigation (PBN) in complex arrival flows without undue increases in workload.

Callantine, Todd J.↗

An Overview of Current Capabilities and Research Activities in the Airspace Operations Laboratory at NASA Ames Research Center

The Airspace Operations Laboratory at NASA Ames conducts research to provide a better understanding of roles, responsibilities, and requirements for human operators and automation in future air traffic management (ATM) systems. The research encompasses developing, evaluating, and integrating operational concepts and technologies for near-, mid-, and far-term air traffic operations. Current research threads include efficient arrival operations, function allocation in separation assurance and efficient airspace and trajectory management. The AOL has developed powerful air traffic simulation capabilities, most notably the Multi Aircraft Control System (MACS) that is used for many air traffic control simulations at NASA and its partners in government, academia and industry. Several additional NASA technologies have been integrated with the AOL's primary simulation capabilities where appropriate. Using this environment, large and small-scale system-level evaluations can be conducted to help make near-term improvements and transition NASA technologies to the FAA, such as the technologies developed under NASA's Air Traffic Management Demonstration-1 (ATD-1). The AOL's rapid prototyping and flexible simulation capabilities have proven a highly effective environment to progress the initiation of trajectory-based operations and support the mid-term implementation of NextGen. Fundamental questions about accuracy requirements have been investigated as well as realworld problems on how to improve operations in some of the most complex airspaces in the US. This includes using advanced trajectory-based operations and prototype tools for coordinating arrivals to converging runways at Newark airport and coordinating departures and arrivals in the San Francisco and the New York metro areas. Looking beyond NextGen, the AOL has started exploring hybrid human/automation control strategies as well as highly autonomous operations in the air traffic control domain. Initial results indicate improved capacity, low operator workload, good situation awareness and acceptability for controllers teaming with autonomous air traffic systems. While much research and development needs to be conducted to make such concepts a reality, these approaches have the potential to truly transform the airspace system towards increased mobility, safe and efficient growth in global operations and enabling many of the new vehicles and operations that are expected over the next decades. This paper describes how the AOL currently contributes to the ongoing air transportation transformation.

simulation↗

Evaluation of the Terminal Sequencing and Spacing System for Performance Based Navigation Arrivals

NASA has developed the Terminal Sequencing and Spacing (TSS) system, a suite of advanced arrival management technologies combining timebased scheduling and controller precision spacing tools. TSS is a ground-based controller automation tool that facilitates sequencing and merging arrivals that have both current standard ATC routes and terminal Performance-Based Navigation (PBN) routes, especially during highly congested demand periods. In collaboration with the FAA and MITRE's Center for Advanced Aviation System Development (CAASD), TSS system performance was evaluated in human-in-the-loop (HITL) simulations with currently active controllers as participants. Traffic scenarios had mixed Area Navigation (RNAV) and Required Navigation Performance (RNP) equipage, where the more advanced RNP-equipped aircraft had preferential treatment with a shorter approach option. Simulation results indicate the TSS system achieved benefits by enabling PBN, while maintaining high throughput rates-10% above baseline demand levels. Flight path predictability improved, where path deviation was reduced by 2 NM on average and variance in the downwind leg length was 75% less. Arrivals flew more fuel-efficient descents for longer, spending an average of 39 seconds less in step-down level altitude segments. Self-reported controller workload was reduced, with statistically significant differences at the p less than 0.01 level. The RNP-equipped arrivals were also able to more frequently capitalize on the benefits of being "Best-Equipped, Best- Served" (BEBS), where less vectoring was needed and nearly all RNP approaches were conducted without interruption.

terminal sequencing↗

Analysis of Interactive Conflict Resolution Tool Usage in a Mixed Equipage Environment

A human-in-the-loop simulation was conducted that examined separation assurance concepts in varying levels of traffic density with mixtures of aircraft equipage and automation. This paper's analysis focuses on one of the experimental conditions in which traffic levels were approximately fifty percent higher than today, and approximately fifty percent of the traffic within the test area were equipped with data communications (data comm) capabilities. The other fifty percent of the aircraft required control by voice much like today. Within this environment, the air traffic controller participants were provided access to tools and automation designed to support the primary task of separation assurance that are currently unavailable. Two tools were selected for analysis in this paper: 1) a pre-probed altitude fly-out menu that provided instant feedback of conflict probe results for a range of altitudes, and 2) an interactive auto resolver that provided on-demand access to an automation-generated conflict resolution trajectory. Although encouraged, use of the support tools was not required; the participants were free to use the tools as they saw fit, and they were also free to accept, reject, or modify the resolutions offered by the automation. This mode of interaction provided a unique opportunity to examine exactly when and how these tools were used, as well as how acceptable the resolutions were. Results showed that the participants used the pre-probed altitude fly-out menu in 14% of conflict cases and preferred to use it in a strategic timeframe on data comm equipped and level flight aircraft. The interactive auto resolver was also used in a primarily strategic timeframe on 22% of conflicts and that their preference was to use it on conflicts involving data comm equipped aircraft as well. Of the 258 resolutions displayed, 46% were implemented and 54% were not. The auto resolver was rated highly by participants in terms of confidence and preference. Factors such as aircraft equipage, ownership, and location of predicted separation loss appeared to play a role in the decision of controllers to accept or reject the auto resolver's resolutions.

auto resolver↗

Controller Strategies for Automation Tool Use under Varying Levels of Trajectory Prediction Uncertainty

A human-in-the-loop simulation was conducted to examine the effects of varying levels of trajectory prediction uncertainty on air traffic controller workload and performance, as well as how strategies and the use of decision support tools change in response. This paper focuses on the strategies employed by two controllers from separate teams who worked in parallel but independently under identical conditions (airspace, arrival traffic, tools) with the goal of ensuring schedule conformance and safe separation for a dense arrival flow in en route airspace. Despite differences in strategy and methods, both controllers achieved high levels of schedule conformance and safe separation. Overall, results show that trajectory uncertainties introduced by wind and aircraft performance prediction errors do not affect the controllers' ability to manage traffic. Controller strategies were fairly robust to changes in error, though strategies were affected by the amount of delay to absorb (scheduled time of arrival minus estimated time of arrival). Using the results and observations, this paper proposes an ability to dynamically customize the display of information including delay time based on observed error to better accommodate different strategies and objectives.

Strategy↗

The Impact of Trajectory Prediction Uncertainty on Air Traffic Controller Performance and Acceptability

A Human-In-The-Loop air traffic control simulation investigated the impact of uncertainties in trajectory predictions on NextGen Trajectory-Based Operations concepts, seeking to understand when the automation would become unacceptable to controllers or when performance targets could no longer be met. Retired air traffic controllers staffed two en route transition sectors, delivering arrival traffic to the northwest corner-post of Atlanta approach control under time-based metering operations. Using trajectory-based decision-support tools, the participants worked the traffic under varying levels of wind forecast error and aircraft performance model error, impacting the ground automations ability to make accurate predictions. Results suggest that the controllers were able to maintain high levels of performance, despite even the highest levels of trajectory prediction errors.

trajectory prediction uncertainty↗

Pilot and Controller Evaluations of Separation Function Allocation in Air Traffic Management

Two human-in-the-loop simulation experiments were conducted in coordinated fashion to investigate the allocation of separation assurance functions between ground and air and between humans and automation. The experiments modeled a mixed-operations concept in which aircraft receiving ground-based separation services shared the airspace with aircraft providing their own separation service (i.e., self-separation). Ground-based separation was provided by air traffic controllers without automation tools, with tools, or by ground-based automation with controllers in a managing role. Airborne self-separation was provided by airline pilots using self-separation automation enabled by airborne surveillance technology. The two experiments, one pilot-focused and the other controller-focused, addressed selected key issues of mixed operations, assuming the starting point of current-day operations and modeling an emergence of NextGen technologies and procedures. In the controller-focused experiment, the impact of mixed operations on controller performance was assessed at four stages of NextGen implementation. In the pilot-focused experiment, the limits to which pilots with automation tools could take full responsibility for separation from ground-controlled aircraft were tested. Results indicate that the presence of self-separating aircraft had little impact on the controllers' ability to provide separation services for ground-controlled aircraft. Overall performance was best in the most automated environment in which all aircraft were data communications equipped, ground-based separation was highly automated, and self-separating aircraft had access to trajectory intent information for all aircraft. In this environment, safe, efficient, and highly acceptable operations could be achieved for twice today's peak airspace throughput. In less automated environments, reduced trajectory intent exchange and manual air traffic control limited the safely achievable airspace throughput and negatively impacted the maneuver efficiency of self-separating aircraft through high-density airspace. In a test of scripted conflicts with ground-managed aircraft, flight crews of self-separating aircraft prevented separation loss in all conflicts with detection time greater than one minute. In debrief, pilots indicated a preference for at least five minute's alerting notice and trajectory intent information on all aircraft. When intent information on ground-managed aircraft was available, self-separating aircraft benefited from fewer conflict alerts and fewer required deviations from trajectory-based operations.

Wing, David↗

An Investigation of Flight Deck Data Link in the Terminal Area

The Next Generation Air Transportation System (NextGen) and Europe's Single European Sky ATM Research (SESAR) concepts require an increased use of trajectory-based operations, including extensive strategic air traffic control clearances. The clearances are lengthy and complex, which necessitate data link communications to allow for message permanence and integration into the autoflight systems (i.e., autoload capability). This paper examines the use of flight deck data link communications for strategic and tactical clearance usage in the terminal area. A human-in-the-loop simulation was conducted using a high-fidelity flight deck simulator, with ten commercial flight crews as participants. Data were collected from six flight scenarios in the San Francisco terminal airspace. The variables of interest were ATC message modality (voice v. data link), temporal quality of the message (tactical v. strategic) and message length. Dependent variables were message response times, communication clarifications, communication-related errors, and pilot workload. Response time results were longer in data link compared to voice, a finding that has been consistently revealed in a number of other simulations [1]. In addition, strategic clearances and longer messages resulted in a greater number of clarifications and errors, suggesting an increase in uncertainty of message interpretation for the flight crews when compared to tactical clearances. The implications for strategic and compound clearance usage in NextGen and SESAR are discussed

data link communication↗

Evaluation of the Controller-Managed Spacing Tools, Flight-Deck Interval Management and Terminal Area Metering Capabilities for the ATM Technology Demonstration #1

NASA has developed a suite of advanced arrival management technologies combining time-based scheduling with controller- and flight deck-based precision spacing capabilities that allow fuel-efficient arrival operations during periods of high throughput. An operational demonstration of these integrated technologies, i.e., the ATM Technology Demonstration #1 (ATD-1), is slated for 2016. Human-in-the-loop simulations were conducted to evaluate the performance of the ATD-1 system and validate operational feasibility. The ATD-1 system was found to be robust to scenarios with saturated demand levels and high levels of system delay. High throughput, 10 above baseline demand levels, and schedule conformance less than 20 seconds at the 75th percentile were achievable. The flight-deck interval management capabilities also improved the median schedule conformance at the final approach fix from 5 to 3 seconds with less variance.

terminal metering↗

Investigating the Impact of Off-Nominal Events on High-Density "Green" Arrivals

Trajectory-based controller tools developed to support a schedule-based terminal-area air traffic management (ATM) concept have been shown effective for enabling green arrivals along Area Navigation (RNAV) routes in moderately high-density traffic conditions. A recent human-in-the-loop simulation investigated the robustness of the concept and tools to off-nominal events events that lead to situations in which runway arrival schedules require adjustments and controllers can no longer use speed control alone to impose the necessary delays. Study participants included a terminal-area Traffic Management Supervisor responsible for adjusting the schedules. Sector-controller participants could issue alternate RNAV transition routes to absorb large delays. The study also included real-time winds/wind-forecast changes. The results indicate that arrival spacing accuracy, schedule conformance, and tool usage and usefulness are similar to that observed in simulations of nominal operations. However, the time and effort required to recover from an off-nominal event is highly context-sensitive, and impacted by the required schedule adjustments and control methods available for managing the evolving situation. The research suggests ways to bolster the off-nominal recovery process, and highlights challenges related to using human-in-the-loop simulation to investigate the safety and robustness of advanced ATM concepts.

Callatine, Todd J.↗

Resolving Off-Nominal Situations in Schedule-Based Terminal Area Operations: Results from a Human-in-the-Loop Simulation

A recent human-in-the-loop simulation in the Airspace Operations Laboratory (AOL) at NASA's Ames Research Center investigated the robustness of Controller-Managed Spacing (CMS) operations. CMS refers to AOL-developed controller tools and procedures for enabling arrivals to conduct efficient Optimized Profile Descents with sustained high throughput. The simulation provided a rich data set for examining how a traffic management supervisor and terminal-area controller participants used the CMS tools and coordinated to respond to off-nominal events. This paper proposes quantitative measures for characterizing the participants responses. Case studies of go-around events, replicated during the simulation, provide insights into the strategies employed and the role the CMS tools played in supporting them.

Mercer, Joey↗

Air Traffic Controllers' Control Strategies in the Terminal Area Under Off-Nominal Conditions

A human-in-the-loop simulation investigated the robustness of a schedule-based terminal-area air traffic management concept, and its supporting controller tools, to off-nominal events - events that led to situations in which runway arrival schedules required adjustments and controllers could no longer use speed control alone to impose the necessary delays. The main research question was exploratory: to assess whether controllers could safely resolve and control the traffic during off-nominal events. A focus was the role of the supervisor - how he managed the schedules, how he assisted the controllers, what strategies he used, and which combinations of tools he used. Observations and questionnaire responses revealed supervisor strategies for resolving events followed a similar pattern: a standard approach specific to each type of event often resolved to a smooth conclusion. However, due to the range of factors influencing the event (e.g., environmental conditions, aircraft density on the schedule, etc.), sometimes the plan required revision and actions had a wide-ranging effect.

Martin, Lynne↗

Allocation of Functions in a Far-Term Air Traffic Control Environment

A human-in-the-loop exploration of a ground-based automated separation assurance concept was conducted that involved the allocation of certain functions between humans and automation. This exploration included operations that were sustained for prolonged periods of time with high levels of traffic in the presence of convective weather and scheduling constraints. An investigation into the acceptability of the defined roles and performance of tasks was conducted where it was found that the participants rated the concept and allocation of functions with a high level of acceptability. However, issues were encountered with the automation related to the detection of and response to tactical conflicts. Lower ratings were given on account of these concerns, and it was found that a key contributor to the underlying problems was transitioning aircraft and the uncertainty of their trajectories. Stemming from those results, participants responded that they would rather have direct control over aircraft transitions as well as more control over the tactical conflict resolution automation. In contrast, participants responded that they would rather have the automation place aircraft back on trajectory, and perform weather avoidance and scheduling tasks.

Homola, Jeffrey↗

Design and Evaluation of the Terminal Area Precision Scheduling and Spacing System

This paper describes the design, development and results from a high fidelity human-in-the-loop simulation of an integrated set of trajectory-based automation tools providing precision scheduling, sequencing and controller merging and spacing functions. These integrated functions are combined into a system called the Terminal Area Precision Scheduling and Spacing (TAPSS) system. It is a strategic and tactical planning tool that provides Traffic Management Coordinators, En Route and Terminal Radar Approach Control air traffic controllers the ability to efficiently optimize the arrival capacity of a demand-impacted airport while simultaneously enabling fuel-efficient descent procedures. The TAPSS system consists of four-dimensional trajectory prediction, arrival runway balancing, aircraft separation constraint-based scheduling, traffic flow visualization and trajectory-based advisories to assist controllers in efficient metering, sequencing and spacing. The TAPSS system was evaluated and compared to today's ATC operation through extensive series of human-in-the-loop simulations for arrival flows into the Los Angeles International Airport. The test conditions included the variation of aircraft demand from a baseline of today's capacity constrained periods through 5%, 10% and 20% increases. Performance data were collected for engineering and human factor analysis and compared with similar operations both with and without the TAPSS system. The engineering data indicate operations with the TAPSS show up to a 10% increase in airport throughput during capacity constrained periods while maintaining fuel-efficient aircraft descent profiles from cruise to landing.

Swenson, Harry N.↗

Houston, We Have a Problem Solving Model for Training

In late 2006, the Mission Operations Directorate (MOD) at NASA began looking at ways to make training more efficient for the flight controllers who support the International Space Station. The average certification times for flight controllers spanned from 18 months to three years and the MOD, responsible for technical training, was eager to develop creative solutions that would reduce the time to 12 months. Additionally, previously trained flight controllers sometimes participated in more than 50 very costly, eight-hour integrated simulations before becoming certified. New trainees needed to gain proficiency with far fewer lessons and training simulations than their predecessors. This poster presentation reviews the approach and the process that is currently in development to accomplish this goal.

Schmidt, Lacey↗

Functional Allocation for Ground-Based Automated Separation Assurance in NextGen

As part of an ongoing research effort into functional allocation in a NextGen environment, a controller-in-the-loop study on ground-based automated separation assurance was conducted at NASA Ames' Airspace Operations Laboratory in February 2010. Participants included six FAA front line managers, who are currently certified professional controllers and four recently retired controllers. Traffic scenarios were 15 and 30 minutes long where controllers interacted with advanced technologies for ground-based separation assurance, weather avoidance, and arrival metering. The automation managed the separation by resolving conflicts automatically and involved controllers only by exception, e.g., when the automated resolution would have been outside preset limits. Results from data analyses show that workload was low despite high levels of traffic, Operational Errors did occur but were closely tied to local complexity, and safety acceptability ratings varied with traffic levels. Positive feedback was elicited for the overall concept with discussion on the proper allocation of functions and trust in automation.

Prevot, Thomas↗

Using Neural Networks to Explore Air Traffic Controller Workload

When a new system, concept, or tool is proposed in the aviation domain, one concern is the impact that this will have on operator workload. As an experience, workload is difficult to measure in a way that will allow comparison of proposed systems with those already in existence. Chatterji and Sridhar (2001) suggested a method by which airspace parameters can be translated into workload ratings, using a neural network. This approach was employed, and modified to accept input from a non-real time airspace simulation model. The following sections describe the preparations and testing work that will enable comparison of a future airspace concept with a current day baseline in terms of workload levels.

Martin, Lynne↗