Engineering PapersSearch

Engineering topics

Bienert, Nancy

Publications and source records attributed to Bienert, Nancy.

At least 19 records

Evaluation of Early Ground Control Station Configurations for Interacting with a UAS Traffic Management (UTM) System

The purpose of this paper is to report on a human factors evaluation of ground control station design concepts for interacting with an unmanned traffic management system. The data collected for this paper comes from recent field tests for NASA's Unmanned Traffic Management (UTM) project, and covers the following topics; workload, situation awareness, as well as flight crew communication, coordination, and procedures. The goal of this evaluation was to determine if the various software implementations for interacting with the UTM system can be described and classified into design concepts to provide guidance for the development of future UTM interfaces. We begin with a brief description of NASA's UTM project, followed by a description of the test range configuration related to a second development phase. We identified (post hoc) two classes in which the ground control stations could be grouped. This grouping was based on level of display integration. The analysis was exploratory and informal. It was conducted to compare ground stations across those two classes and against the aforementioned topics. Herein, we discuss the results.

unmanned traffic management

Workload and Performance in Air Traffic Control: Exploring the Influence of Levels of Automation and Variation in Task Demand

In air traffic control, task demand and workload have important implications for the safety and efficiency of air traffic. Task demand is dynamic, however, research on demand transitions and associated controller perception and performance is limited. In addition, there is a comparatively restricted understanding of the influence of task demand transitions on workload and performance, in association with automation. This study used an air traffic control simulation to investigate the influence of task demand transitions and two conditions of varying automation, on workload and efficiency-related performance. Findings showed that a both the direction of the task demand variation, and the amount of automation, influenced the relationship between workload and performance. Further research is needed to enhance understanding of demand transition and workload history effects on operator experience and performance, in both air traffic control and other safety-critical domains.

air traffic control

The Relationship Between Workload and Performance in Air Traffic Control: Exploring the Influence of Levels of Automation and Variation in Task Demand

In an air traffic environment, task demand is dynamic. However, previous research has largely considered the association of task demand and controller performance using conditions of stable task demand. Further, there is a comparatively restricted understanding of the influence of task demand transitions on workload and performance in association with different types and levels of automation that are available to controllers. This study used an air traffic control simulation to investigate the influence of task demand transitions, and two conditions of automation, on workload and efficiency-related performance. Findings showed that both the direction of the task demand variation and the amount of automation influenced the relationship between workload and performance. Findings are discussed in relation to capacity and arousal theories. Further research is needed to enhance understanding of demand transition and workload history effects on operator experience and performance, in both air traffic control and other safety-critical domains.

function allocation

Differing Air Traffic Controller Responses to Similar Trajectory Prediction Errors

A Human-In-The-Loop simulation was conducted in January of 2013 in the Airspace Operations Laboratory at NASA's Ames Research Center. The simulation airspace included two en route sectors feeding the northwest corner of Atlanta's Terminal Radar Approach Control. The focus of this paper is on how uncertainties in the study's trajectory predictions impacted the controllers ability to perform their duties. Of particular interest is how the controllers interacted with the delay information displayed in the meter list and data block while managing the arrival flows. Due to wind forecasts with 30-knot over-predictions and 30-knot under-predictions, delay value computations included errors of similar magnitude, albeit in opposite directions. However, when performing their duties in the presence of these errors, did the controllers issue clearances of similar magnitude, albeit in opposite directions?

trajectory prediction uncertainty

UAS Traffic Management (UTM) Simulation Capabilities and Laboratory Environment

NASA has engaged in collaborative research with the FAA to explore the concepts and requirements necessary to enable the safe and scalable application of small unmanned aircraft systems (UAS) in low-altitude airspace. In this effort, the UAS Traffic Management (UTM) project has developed a multi-faceted simulation component that supports near-term live flight testing in addition to further term concept exploration. This paper provides an overview of the simulation capabilities currently available as part of the UTM project and the laboratory environment in which they are applied.

Homola, Jeffrey

Impact of Automation Support on the Conflict Resolution Task in a Human-in-the-Loop Air Traffic Control Simulation

To determine the capabilities and limitations of human operators and automation in separation assurance roles, the second of three Human-in-the-Loop (HITL) part-task studies investigated air traffic controllers ability to detect and resolve conflicts under varying task sets, traffic densities, and run lengths. Operations remained within a single sector, staffed by a single controller, and explored, among other things, the controllers responsibility for conflict resolution with or without their involvement in the conflict detection task. Furthermore, these conditions were examined across two different traffic densities; 1x (current-day traffic) and a 20 increase above current-day traffic levels (1.2x). Analyses herein offer an examination of the conflict resolution strategies employed by controllers. In particular, data in the form of elapsed time between conflict detection and conflict resolution are used to assess if, and how, the controllers involvement in the conflict detection task affected the way in which they resolved traffic conflicts.

human-in-the-loop simulation

How Important is Conflict Detection to the Conflict Resolution Task?

To determine the capabilities and limitations of human operators and automation in separation assurance roles, the second of three Human-in-the-Loop (HITL) part-task studies investigates air traffic controllers ability to detect and resolve conflicts under varying task sets, traffic densities, and run lengths. Operations remained within a single sector, staffed by a single controller, and explored, among other things, the controllers conflict resolution performance in conditions with or without their involvement in the conflict detection task. Whereas comparisons of conflict resolution performance between these two conditions are available in a prior publication, this paper explores whether or not other subjective measures display a relationship to that data. Analyses of controller workload and situation awareness measures attempt to quantify their contribution to controllers ability to resolve traffic conflicts.

function allocation

Task Demand Variation in Air Traffic Control: Implications for Workload, Fatigue, and Performance

In air traffic control, task demand and workload have important implications for the safety and efficiency of air traffic, and remain dominant considerations. Within air traffic control, task demand is dynamic. However, research on demand transitions and subsequent controller perception and performance is limited. This research uses an air traffic control simulation to investigate the effect of task demand transitions, and the direction of those transitions, on workload and fatigue and one efficiency performance measure. Results indicate that a change in task demand appears to affect both workload and fatigue ratings, although not necessarily performance. In addition, participants' workload and fatigue ratings in equivalent task demand periods appear to change depending on the demand period preceding the time of the current ratings. Further research is needed to enhance understanding of demand transition and workload history effects on operator experience and performance, in both air traffic control and other safety-critical domains.

workload history

Task Demand Variation in Air Traffic Control: Implications for Controller Workload, Fatigue, and Performance

In air traffic control, task demand and workload have important implications for the safety and efficiency of air traffic, and remain dominant considerations. Within air traffic control, task demand is dynamic. However, research on demand transitions and subsequent controller perception and performance is limited. This research uses an air traffic control simulation to investigate the effect of task demand transitions, and the direction of those transitions, on workload and fatigue and one efficiency performance measure. Results indicate that a change in task demand appears to affect both workload and fatigue ratings, although not necessarily performance. In addition, participants workload and fatigue ratings in equivalent task demand periods appear to change depending on the demand period preceding the time of the current ratings. Further research is needed to enhance understanding of demand transition and workload history effects on operator experience and performance, in both air traffic control and other safety-critical domains.

workload history

Human-In-The-Loop Investigation of Interoperability Between Terminal Sequencing and Spacing, Automated Terminal Proximity Alert, and Wake-Separation Recategorization

A human-in-the-loop simulation study addressed terminal-area controller-workstation interface variations for interoperability between three new capabilities being introduced by the FAA. The capabilities are Terminal Sequencing and Spacing (TSAS), Automated Terminal Proximity Alert (ATPA), and wake-separation recategorization, or 'RECAT.' TSAS provides controllers with Controller-Managed Spacing (CMS) tools, including slot markers, speed advisories, and early/late indications, together with runway assignments and sequence numbers. ATPA provides automatic monitor, warning, and alert cones to inform controllers about spacing between aircraft on approach. ATPA cones are sized according to RECAT, an improved method of specifying wake-separation standards. The objective of the study was to identify potential issues and provide recommendations for integrating TSAS with ATPA and RECAT. Participants controlled arrival traffic under seven different display configurations, then tested an 'exploratory' configuration developed with participant input. All the display conditions were workable and acceptable, but controllers strongly preferred having the CMS tools available on Feeder positions, and both CMS tools and ATPA available on Final positions. Controllers found the integrated systems favorable and liked being able to tailor configurations to individual preferences.

ATD-1

A Human-in-the Loop Evaluation of a Coordinated Arrival Departure Scheduling Operations for Managing Departure Delays at LaGuardia Airport

LaGuardia (LGA) departure delay was identified by the stakeholders and subject matter experts as a significant bottleneck in the New York metropolitan area. Departure delay at LGA is primarily due to dependency between LGA's arrival and departure runways: LGA departures cannot begin takeoff until arrivals have cleared the runway intersection. If one-in one-out operations are not maintained and a significant arrival-to-departure imbalance occurs, the departure backup can persist through the rest of the day. At NASA Ames Research Center, a solution called "Departure-sensitive Arrival Spacing" (DSAS) was developed to maximize the departure throughput without creating significant delays in the arrival traffic. The concept leverages a Terminal Sequencing and Spacing (TSS) operations that create and manage the arrival schedule to the runway threshold and added an interface enhancement to the traffic manager's timeline to provide the ability to manually adjust inter-arrival spacing to build precise gaps for multiple departures between arrivals. A more complete solution would include a TSS algorithm enhancement that could automatically build these multi-departure gaps. With this set of capabilities, inter-arrival spacing could be controlled for optimal departure throughput. The concept was prototyped in a human-in-the- loop (HITL) simulation environment so that operational requirements such as coordination procedures, timing and magnitude of TSS schedule adjustments, and display features for Tower, TRACON and Traffic Management Unit could be determined. A HITL simulation was conducted in August 2014 to evaluate the concept in terms of feasibility, controller workload impact, and potential benefits. Three conditions were tested, namely a Baseline condition without scheduling, TSS condition that schedules the arrivals to the runway threshold, and TSS+DSAS condition that adjusts the arrival schedule to maximize the departure throughput. The results showed that during high arrival demand period, departure throughput could be incrementally increased under TSS and TSS+DSAS conditions without compromising the arrival throughput. The concept, operational procedures, and summary results were originally published in ATM20151 but detailed results were omitted. This paper expands on the earlier paper to provide the detailed results on throughput, conformance, safety, flight time/distance, etc. that provide extra insights into the feasibility and the potential benefits on the concept.

trajectory-based operations

Exploring Management of Arrival Spacing Using Route Extensions with Terminal Spacing Tools

Airports with shared runway operations between arrivals and departures can experience severe departure gridlock and delays during a heavy arrival push due to insufficient gaps in the arrival stream for aircraft to depart. The problem is accentuated in situations when a large gap in the arrival spacing has to be created at the last minute due to wake vortex separation requirements. At LaGuardia airport, wake vortex separation problems arise when a heavy jet, such as a B757, departing on Runway 31 needs additional spacing between arrivals on Runway 22. A standard solution for controllers in many airports in situations such as this is to extend the downwind leg of arrival aircraft to create extra space between the arrivals. The question addressed in this paper is how such route extensions would work with terminal scheduling operations, namely (1) the automated Terminal Sequencing and Spacing (TSS) tools and (2) a new scheduling tool which increases the availability of gaps for departure aircraft (Departure Sensitive Arrival Spacing or DSAS). In a simulated LaGuardia airport (LGA) Terminal Radar Approach Control (TRACON) airspace, two new RNAV arrival routes were created along with extensions to these routes. The arrival route from the south had a downwind leg extension near the airport in the final sector. The arrival route from the north had an extension in a feeder sector further from the airport. An exploratory one-hour run with the route extensions was compared to an hour run without the extensions. Topics included in the paper are 1) how the route extensions were developed, 2) a procedure outlining how the aircraft could be scheduled to the extensions and who would do it, and 3) the results of the exploratory run compared to the original run without the extensions. The results indicated that the extended downwind leg route helped to create a B757 departure gap in the middle of a packed arrival stream, resulting in a reduction of 11 minutes in average wait time for the B757s, but at a cost of increased controller self-reported workload from low to moderate.

time based flow management

Differing Air Traffic Controller Responses to Similar Trajectory Prediction Errors: An Interrupted Time-Series Analysis of Controller Behavior

A Human-In-The-Loop simulation was conducted in January of 2013 in the Airspace Operations Laboratory at NASAs Ames Research Center. The simulation airspace included two en route sectors feeding the northwest corner of Atlantas Terminal Radar Approach Control. The focus of this paper is on how uncertainties in the studys trajectory predictions impacted the controllers ability to perform their duties. Of particular interest is how the controllers interacted with the delay information displayed in the meter list and data block while managing the arrival flows. Due to wind forecasts with 20-knot over-predictions and 20-knot under-predictions, delay value computations included errors of similar magnitude, albeit in opposite directions. However, when performing their duties in the presence of these errors, did the controllers issue clearances of similar magnitude, albeit in opposite directions?

human-automation interaction

The Effectiveness of a Route Crossing Tool in a Simulated New York Airspace

Congested airspace is the cause of many delays in the terminal area and these delays can have a ripple effect on the rest of a nation's airspace. The New York terminal area is an example of where this happens in the U. S. An important goal, therefore, is to increase the efficiency of operations in congested terminal airspace where possible. Modeling studies of arrival and departure flows have shown that sharing of arrival and departure airspace increases efficiency in terminal operations. One source of inefficiency in terminal operations is that departure aircraft are frequently held level under arrival flows when it would be more efficient to climb the departure aircraft earlier. A Route Crossing Tool was developed to help controllers climb Newark (EWR) departures to the south earlier by temporarily sharing airspace with arrivals coming into LaGuardia (LGA) from the south. Instead of flying under the arrivals, a departure to the south could climb earlier by flying through the arrival airspace if there was a suitable gap between arrivals. A Human-in-the-Loop (HITL) simulation was conducted in this environment which compared three tool conditions: Baseline (no tool), a Single Route Crossing tool in which one route through the arrival flow was evaluated for crossing, and a Multi-Route Crossing tool in which five parallel routes were evaluated. In all conditions, the departures could be held level under the arrival flow. The results showed that controllers climbed a higher proportion of departures in the Multi-Route tool condition than in the other two conditions, with a higher proportion of departures climbed in smaller gaps and in front of trailing arrivals. The controllers indicated that the Multi-Route and Single Route tools helped them estimate distances more accurately and rated safety, workload, and coordination in the simulation as acceptable.

terminal airspace

Scheduling and Delivering Aircraft to Departure Fixes in the NY Metroplex with Controller-Managed Spacing Tools

In this paper, successful Time-Based Flow Management (TBFM) scheduling systems for arrivals are considered and adapted to apply to departures. We present a concept of operations that integrates Controller-Managed Spacing tools for departures (CMS-D) with existing tactical departure scheduling tools to coordinate demand at departure fixes in a metroplex environment. We tested our concept in a Human-in-the-Loop simulation and compared the effect of two scheduling conditions: 1) "Departure Scheduling" consisting of an emulation of the Integrated Departure and Arrival Capability (IDAC) where Towers and a Planner (Traffic Management Coordinator at the appropriate facility) coordinate aircraft scheduled takeoff times to departure fixes; and 2) "Arrival Sensitive Departure Scheduling" where, in addition, the Tower and Planner also consider arrival Scheduled Time of Arrivals (STAs) at the airport's dependent runway. Results indicate little difference between the two scheduling conditions, but a large difference between the No Tools and the two scheduling conditions with CMS-D tools. The scheduling/CMS-D tools conditions markedly reduced heading, speed clearances, and workload for controllers who were merging flows at the departure fixes. In the tool conditions, departure controllers conditioned departures earlier rather than later when aircraft were tied near the departure fixes. In the scheduling/CMS-D tools conditions, departures crossed the departure fixes 50 seconds earlier and with an 8% error rate (consisting of time ahead or behind desired time of arrival) compared to a 19% error rate in the No Tool condition. Two exploratory runs showed that similar beneficial effects can be obtained only with the CMS-D tools without scheduling takeoff times, but at the cost of a somewhat higher workload for controllers, indicating the benefits of pre-departure scheduling of aircraft with minimal delays. Hence, we found that CMS-D tools were very beneficial in the metroplex environment we tested but that further research is needed to clarify the benefits of the various scheduling approaches.

terminal airspace

Arrival Metering Precision Study

This paper describes the background, method and results of the Arrival Metering Precision Study (AMPS) conducted in the Airspace Operations Laboratory at NASA Ames Research Center in May 2014. The simulation study measured delivery accuracy, flight efficiency, controller workload, and acceptability of time-based metering operations to a meter fix at the terminal area boundary for different resolution levels of metering delay times displayed to the air traffic controllers and different levels of airspeed information made available to the Time-Based Flow Management (TBFM) system computing the delay. The results show that the resolution of the delay countdown timer (DCT) on the controllers display has a significant impact on the delivery accuracy at the meter fix. Using the 10 seconds rounded and 1 minute rounded DCT resolutions resulted in more accurate delivery than 1 minute truncated and were preferred by the controllers. Using the speeds the controllers entered into the fourth line of the data tag to update the delay computation in TBFM in high and low altitude sectors increased air traffic control efficiency and reduced fuel burn for arriving aircraft during time based metering.

human/systems

Coordination Between Sectors in Shared Airspace Operations

Recent studies have shown that a more efficient use of airspace may involve shared airspace operations, i.e., temporal as well as spatial separation of arrival and departure flows [1][2]. Temporal separation would permit a departure aircraft to fly through an arrival flow, depending on an available gap. This would necessitate careful and precise coordination between controllers in different sectors. Three methods of coordination which permit the penetration of a controller's airspace by another controller's aircraft are described: point out, look-and-go, and prearranged coordination procedure. Requirements of each method are given, along with associated problems that have surfaced in the field as described by Aviation Safety and Reporting System (ASRS) and other reports. A Human-in-the-Loop simulation was designed to compare two of the methods: point out and prearranged coordination procedures. In prearranged coordination procedures (P-ACP), the controllers control an aircraft in another controller's airspace according to specified prearranged procedures, without coordinating each individual aircraft with another controller, as is done with point outs. In the simulation, three experienced controllers rotated through two arrival sectors and a non-involved arrival sector of a Terminal Radar Approach Control (TRACON) airspace. Results of eighteen one-hour simulation runs (nine in each of the two conditions) showed no impact of the coordination method on separation violations nor on arrival times for 208 departing aircraft crossing an arrival stream. Participant assessment indicated that although both coordination conditions were acceptable, the prearranged coordination procedure condition was slightly safer, more efficient, timely, and overall, worked better operationally. Problems arose in the point out condition regarding controllers noticing acceptance of point outs. Also, in about half of the point-out runs, time pressure was felt to have had an impact on when and if the departures could cross an arrival stream. An additional problem with point outs may be confusion in the field about which controller has responsibility for separating point-out aircraft from other aircraft.

Parke, Bonny

Development of a Route Crossing Tool for Shared Airspace Environments

In current-day Terminal Radar Approach Control (TRACON) operations, departure and arrival controllers maintain separate and dedicated airspace for their respective traffic flows. Although this practice has obvious safety features, it also leads to inefficiencies; for example, departure aircraft may be routinely capped beneath arrival airspace. With the right decision-support and coordination tools, departures could continue to climb through arrival airspace when sufficient gaps exist. Previous studies of ‘shared airspace’ have examined pre-arranged coordination procedures, as well as tools that gave feedback to the controllers on where gaps between arrivals were located and whether the departure aircraft could be scheduled to fly through those gaps [1, 2, 3, 4]. Since then, the Route Crossing Tool (RCT) has been developed to allow controllers to assess multiple pre-defined route options at points where the arrivals and departures cross, thereby increasing the possibility of climbing a departure through an arrival gap.The RCT aids in ensuring lateral separation between departure and arrival aircraft that pass through the same altitude. Since the RCT can be applied tactically, it can enable aircraft to fly through arrival flows even if these aircraft depart outside scheduled times. The RCT makes use of a set of predefined parallel departure routes crossing the arrival flow at equidistant intersecting points on the arrival route. The RCT uses the Estimated Time of Arrival (ETA) of the departure aircraft at each intersecting point to calculate the lateral separation with the neighboring arrivals when it crosses that point; this information is graphically displayed to the controller. Additionally, the RCT incorporates forecast winds in its ETA predictions.Multiple prototypes of the RCT have been iteratively developed with feedback from Subject Matter Experts (SMEs). This paper presents the final design, the design process, and lessons learned. Initial results from a simulation suggest that the tool was successful in helping controllers to safely climb more aircraft. Controller feedback on the tool was also positive.

shared airspace