Engineering Papers⌕ Search

Engineering topics

Comstock, James R., Jr.

Publications and source records attributed to Comstock, James R., Jr..

14 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2016

UAS Air Traffic Controller Acceptability Study-2: Effects of Communications Delays and Winds in Simulation

This study evaluated the effects of Communications Delays and Winds on Air Traffic Controller ratings of acceptability of horizontal miss distances (HMDs) for encounters between UAS and manned aircraft in a simulation of the Dallas-Ft. Worth East-side airspace. Fourteen encounters per hour were staged in the presence of moderate background traffic. Seven recently retired controllers with experience at DFW served as subjects. Guidance provided to the UAS pilots for maintaining a given HMD was provided by information from self-separation algorithms displayed on the Multi-Aircraft Simulation System. Winds tested did not affect the acceptability ratings. Communications delays tested included 0, 400, 1200, and 1800 msec. For longer communications delays, there were changes in strategy and communications flow that were observed and reported by the controllers. The aim of this work is to provide useful information for guiding future rules and regulations applicable to flying UAS in the NAS.

Comstock, James R., Jr.↗
NASA NTRS2016

Unmanned Aircraft Systems Human-in-the-Loop Controller and Pilot Acceptability Study: Collision Avoidance, Self-Separation, and Alerting Times (CASSAT)

The Federal Aviation Administration (FAA) has been mandated by the Congressional funding bill of 2012 to open the National Airspace System (NAS) to Unmanned Aircraft Systems (UAS). With the growing use of unmanned systems, NASA has established a multi-center "UAS Integration in the NAS" Project, in collaboration with the FAA and industry, and is guiding its research efforts to look at and examine crucial safety concerns regarding the integration of UAS into the NAS. Key research efforts are addressing requirements for detect-and-avoid (DAA), self-separation (SS), and collision avoidance (CA) technologies. In one of a series of human-in-the-loop experiments, NASA Langley Research Center set up a study known as Collision Avoidance, Self-Separation, and Alerting Times (CASSAT). The first phase assessed active air traffic controller interactions with DAA systems and the second phase examined reactions to the DAA system and displays by UAS Pilots at a simulated ground control station (GCS). Analyses of the test results from Phase I and Phase II are presented in this paper. Results from the CASSAT study and previous human-in-the-loop experiments will play a crucial role in the FAA's establishment of rules, regulations, and procedures to safely, efficiently, and effectively integrate UAS into the NAS.

Comstock, James R., Jr.↗
NASA NTRS2015

UAS Air Traffic Controller Acceptability Study: Evaluating Detect and Avoid Technology and Communication Delays in Simulation - 2

This study evaluated the effects of communications delays and winds on air traffic controller ratings of acceptability of horizontal miss distances (HMDs) for encounters between Unmanned Aircraft Systems (UAS) and manned aircraft in a simulation of the Dallas-Ft. Worth (DFW) airspace. Fourteen encounters per hour were staged in the presence of moderate background traffic. Seven recently retired controllers with experience at DFW served as subjects. Guidance provided to the UAS pilots for maintaining a given HMD was provided by information from Detect and Avoid (DAA) self-separation algorithms (Stratway+) displayed on the Multi-Aircraft Control System. This guidance consisted of amber "bands" on the heading scale of the UAS navigation display indicating headings that would result in a loss of well clear between the UAS and nearby traffic. Winds tested were successfully handled by the DAA algorithms and did not affect the controller acceptability ratings of the HMDs. Voice communications delays for the UAS were also tested and included one-way delay times of 0, 400, 1200, and 1800 msec. For longer communications delays, there were changes in strategy and communications flow that were observed and reported by the controllers. The aim of this work is to provide useful information for guiding future rules and regulations applicable to flying UAS in the NAS. Information from this study will also be of value to the Radio Technical Commission for Aeronautics (RTCA) Special Committee 228 - Minimum Performance Standards for UAS.

Comstock, James R., Jr.↗
NASA NTRS2015

UAS in the NAS Air Traffic Controller Acceptability Study-1: The Effects of Horizontal Miss Distances on Simulated UAS and Manned Aircraft Encounters

This study examined air traffic controller acceptability ratings based on the effects of differing horizontal miss distances (HMDs) for encounters between UAS and manned aircraft. In a simulation of the Dallas/Fort Worth (DFW) East-side airspace, the CAS-1 experiment at NASA Langley Research Center enlisted fourteen recently retired DFW air traffic controllers to rate well-clear volumes based on differing HMDs that ranged from 0.5 NM to 3.0 NM. The controllers were tasked with rating these HMDs from "too small" to "too excessive" on a defined, 1-5, scale and whether these distances caused any disruptions to the controller and/or to the surrounding traffic flow. Results of the study indicated a clear favoring towards a particular HMD range. Controller workload was also measured. Data from this experiment and subsequent experiments will play a crucial role in the FAA's establishment of rules, regulations, and procedures to safely and efficiently integrate UAS into the NAS.

Ghatas, Rania W.↗
NASA NTRS2015

NASA Controller Acceptability Study 1(CAS-1) Experiment Description and Initial Observations

This paper describes the Controller Acceptability Study 1 (CAS-1) experiment that was conducted by NASA Langley Research Center personnel from January through March 2014 and presents partial CAS-1 results. CAS-1 employed 14 air traffic controller volunteers as research subjects to assess the viability of simulated future unmanned aircraft systems (UAS) operating alongside manned aircraft in moderate-density, moderate-complexity Class E airspace. These simulated UAS were equipped with a prototype pilot-in-the-loop (PITL) Detect and Avoid (DAA) system, specifically the Self-Separation (SS) function of such a system based on Stratway+ software to replace the see-and-avoid capabilities of manned aircraft pilots. A quantitative CAS-1 objective was to determine horizontal miss distance (HMD) values for SS encounters that were most acceptable to air traffic controllers, specifically HMD values that were assessed as neither unsafely small nor disruptively large. HMD values between 0.5 and 3.0 nautical miles (nmi) were assessed for a wide array of encounter geometries between UAS and manned aircraft. The paper includes brief introductory material about DAA systems and their SS functions, followed by descriptions of the CAS-1 simulation environment, prototype PITL SS capability, and experiment design, and concludes with presentation and discussion of partial CAS-1 data and results.

Chamberlain, James P.↗
NASA NTRS2014

UAS in the NAS: Survey Responses by ATC, Manned Aircraft Pilots, and UAS Pilots

NASA currently is working with industry and the Federal Aviation Administration (FAA) to establish future requirements for Unmanned Aircraft Systems (UAS) flying in the National Airspace System (NAS). To work these issues NASA has established a multi-center "UAS Integration in the NAS" project. In order to establish Ground Control Station requirements for UAS, the perspective of each of the major players in NAS operations was desired. Three on-line surveys were administered that focused on Air Traffic Controllers (ATC), pilots of manned aircraft, and pilots of UAS. Follow-up telephone interviews were conducted with some survey respondents. The survey questions addressed UAS control, navigation, and communications from the perspective of small and large unmanned aircraft. Questions also addressed issues of UAS equipage, especially with regard to sense and avoid capabilities. From the civilian ATC and military ATC perspectives, of particular interest are how mixed operations (manned / UAS) have worked in the past and the role of aircraft equipage. Knowledge gained from this information is expected to assist the NASA UAS Integration in the NAS project in directing research foci thus assisting the FAA in the development of rules, regulations, and policies related to UAS in the NAS.

Comstock, James R., Jr.↗
NASA NTRS2013

Flight Crew Workload, Acceptability, and Performance When Using Data Comm in a High-Density Terminal Area Simulation

This document describes a collaborative FAA/NASA experiment using 22 commercial airline pilots to determine the effect of using Data Comm to issue messages during busy, terminal area operations. Four conditions were defined that span current day to future flight deck equipage: Voice communication only, Data Comm only, Data Comm with Moving Map Display, and Data Comm with Moving Map displaying taxi route. Each condition was used in an arrival and a departure scenario at Boston Logan Airport. Of particular interest was the flight crew response to D-TAXI, the use of Data Comm by Air Traffic Control (ATC) to send taxi instructions. Quantitative data was collected on subject reaction time, flight technical error, operational errors, and eye tracking information. Questionnaires collected subjective feedback on workload, situation awareness, and acceptability to the flight crew for using Data Comm in a busy terminal area. Results showed that 95% of the Data Comm messages were responded to by the flight crew within one minute and 97% of the messages within two minutes. However, post experiment debrief comments revealed almost unanimous consensus that two minutes was a reasonable expectation for crew response. Flight crews reported that Expected D-TAXI messages were useful, and employment of these messages acceptable at all altitude bands evaluated during arrival scenarios. Results also indicate that the use of Data Comm for all evaluated message types in the terminal area was acceptable during surface operations, and during arrivals at any altitude above the Final Approach Fix, in terms of response time, workload, situation awareness, and flight technical performance. The flight crew reported the use of Data Comm as implemented in this experiment as unacceptable in two instances: in clearances to cross an active runway, and D-TAXI messages between the Final Approach Fix and 80 knots during landing roll. Critical cockpit tasks and the urgency of out-the window scan made the additional head down time to respond to Data Comm messages undesirable during these events. However, most crews also stated that Data Comm messages without an accompanying audio chime and no expectation of an immediate response could be acceptable even during these events.

Norman, R. Michael↗
NASA NTRS2013

UAS in the NAS: Survey Responses by ATC, Manned Aircraft Pilots, and UAS Pilots

NASA currently is working with industry and the Federal Aviation Administration (FAA) to establish future requirements for Unmanned Aircraft Systems (UAS) flying in the National Airspace System (NAS). To work these issues NASA has established a multi-center UAS Integration in the NAS project. In order to establish Ground Control Station requirements for UAS, the perspective of each of the major players in NAS operations was desired. Three on-line surveys were administered that focused on Air Traffic Controllers (ATC), pilots of manned aircraft, and pilots of UAS. Follow-up telephone interviews were conducted with some survey respondents. The survey questions addressed UAS control, navigation, and communications from the perspective of small and large unmanned aircraft. Questions also addressed issues of UAS equipage, especially with regard to sense and avoid capabilities. From the ATC and military ATC perspective, of particular interest is how mixed-operations (manned/UAS) have worked in the past and the role of aircraft equipage. Knowledge gained from this information is expected to assist the NASA UAS in the NAS project in directing research foci thus assisting the FAA in the development of rules, regulations, and policies related to UAS in the NAS.

Comstock, James R., Jr.↗
NASA NTRS2011

The Multi-Attribute Task Battery II (MATB-II) Software for Human Performance and Workload Research: A User's Guide

The Multi-Attribute Task Battery (MAT Battery). is a computer-based task designed to evaluate operator performance and workload, has been redeveloped to operate in Windows XP Service Pack 3, Windows Vista and Windows 7 operating systems.MATB-II includes essentially the same tasks as the original MAT Battery, plus new configuration options including a graphical user interface for controlling modes of operation. MATB-II can be executed either in training or testing mode, as defined by the MATB-II configuration file. The configuration file also allows set up of the default timeouts for the tasks, the flow rates of the pumps and tank levels of the Resource Management (RESMAN) task. MATB-II comes with a default event file that an experimenter can modify and adapt

Santiago-Espada, Yamira↗
NASA NTRS2010

The Impact of Data Communications Messages in the Terminal Area on Flight Crew Workload and Eye Scanning

This paper, to accompany a discussion panel, describes a collaborative FAA and NASA research study to determine the effect Data Communications (Data Comm) messages have on flight crew workload and eye scanning behavior in busy terminal area operations. In the Next Generation Air Transportation System Concept of Operations, for the period 2017-2022, the FAA envisions Data Comm between controllers and the flight crew to become the primary means of communicating non-time critical information. Four research conditions were defined that span current day to future equipage levels (Voice with Paper map, Data Comm with Paper map, Data Comm with Moving Map Display with ownship position displayed, Data Comm with Moving Map, ownship and taxi route displayed), and were used to create arrival and departure scenarios at Boston Logan Airport. Preliminary results for workload, situation awareness, and pilot head-up time are presented here. Questionnaire data indicated that pilot acceptability, workload, and situation awareness ratings were favorable for all of the conditions tested. Pilots did indicate that there were times during final approach and landing when they would prefer not to hear the message chime, and would not be able to make a quick response due to high priority tasks in the cockpit.

Comstock, James R., Jr.↗
NASA NTRS2006

Using Videos Derived from Simulations to Support the Analysis of Spatial Awareness in Synthetic Vision Displays

The evaluation of human-centered systems can be performed using a variety of different methodologies. This paper describes a human-centered systems evaluation methodology where participants watch 5-second non-interactive videos of a system in operation before supplying judgments and subjective measures based on the information conveyed in the videos. This methodology was used to evaluate the ability of different textures and fields of view to convey spatial awareness in synthetic vision systems (SVS) displays. It produced significant results for both judgment based and subjective measures. This method is compared to other methods commonly used to evaluate SVS displays based on cost, the amount of experimental time required, experimental flexibility, and the type of data provided.

Boton, Matthew L.↗
NASA NTRS2006

Using Relative Position and Temporal Judgments to Assess the Effects of Texture and Field of View on Spatial Awareness for Synthetic Vision Systems Displays

Synthetic Vision Systems (SVS) depict computer generated views of terrain surrounding an aircraft. In the assessment of textures and field of view (FOV) for SVS, no studies have directly measured the 3 levels of spatial awareness: identification of terrain, its relative spatial location, and its relative temporal location. This work introduced spatial awareness measures and used them to evaluate texture and FOV in SVS displays. Eighteen pilots made 4 judgments (relative angle, distance, height, and abeam time) regarding the location of terrain points displayed in 112 5-second, non-interactive simulations of a SVS heads down display. Texture produced significant main effects and trends for the magnitude of error in the relative distance, angle, and abeam time judgments. FOV was significant for the directional magnitude of error in the relative distance, angle, and height judgments. Pilots also provided subjective terrain awareness ratings that were compared with the judgment based measures. The study found that elevation fishnet, photo fishnet, and photo elevation fishnet textures best supported spatial awareness for both the judgments and the subjective awareness measures.

Bolton, Matthew L.↗