Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Detect-and-Avoid”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Investigating Surveillance Performance for UAS Detect-and-Avoid Systems

Most unmanned aircraft systems will be required to be equipped with a detect-and-avoid system that is capable of maintaining appropriate separation from other aircraft. One of the critical components of detect-and-avoid systems is a surveillance system that identifies potential threat aircraft in real time and tracks these aircraft so that their future trajectories may be used to predict conflicts. The performance of the detect-and-avoid system generally depends on technical parameters of the surveillance system, such as the surveillance range. The quantitative requirements for detect-and-avoid systems will be determined to meet safety metrics for the operation of unmanned aircraft systems in the National Airspace System. This study employs a sensor model comprised of the surveillance range, and horizontal and vertical fields of regard that mainly characterize the overall performance of a surveillance system. In this study, potential metrics for evaluating the performance of a surveillance system were investigated through fast-time simulation with a traffic scenario that included both proposed unmanned aircraft flights and historical visual flight rule aircraft tracks. Using the simulation results, an overall analysis of encounter geometry highlights the encounter characteristics that relate surveillance parameters to safety metrics and detect-and-avoid system performance. Then, given several candidate surveillance volumes, performance and safety metrics are derived; these metrics include the ratio of undetected and late-detected violations and the time to violation at first detection. These example metrics demonstrate the utility of the database of encounters created in this work, a database which will be useful in the derivation of required detect-and-avoid surveillance system requirements.

Lee, Seung Man

Pilot Evaluation of a UAS Detect-and-Avoid System's Effectiveness in Remaining Well Clear

Unmanned aircraft will equip with a detect-and-avoid (DAA) system that enables them to comply with the requirement to "see and avoid" other aircraft, an important layer in the overall set of procedural, strategic and tactical separation methods designed to prevent mid-air collisions. Regulators will establish minimum operating standards for DAA effectiveness, but different combinations of algorithms, displays and procedures could be used to meet those standards. The research presented in this paper indicates the effectiveness of the combined pilot-DAA system as a function of the DAA design requirements and provides data that may be used to model the behavior of pilots when employing such systems. Two simulations involving 21 professional unmanned aircraft system (UAS) pilots evaluated eight different DAA system designs in order to assess their ability to maintain the "well clear" separation standard, i.e., the state of maintaining a safe distance from other aircraft that would not normally cause the initiation of a collision avoidance maneuver by either aircraft. When the traffic display was integrated with the primary mission map directly in front of the pilot, there were fewer losses of well clear. Greater warning time provided to the pilot was strongly correlated with success in remaining well clear. Pilots' ability to separate from aircraft with cooperative and non-cooperative surveillance systems was nearly the same after accounting for the amount of alert time provided in each encounter, although the limited surveillance volume for the airborne-equipped aircraft meant alerts tended to occur later and therefore were more difficult to resolve.

detect-and-avoid

Investigating Detect-and-Avoid Surveillance Performance for Unmanned Aircraft Systems

Most unmanned aircraft systems will be required to be equipped with a Detect-and-Avoid (DAA) system with a surveillance component. The surveillance performance requirements of the DAA system to detect and track intruder aircraft will depend on the encounter geometries that unmanned aircraft are expected to have with other aircraft in the airspace. This presentation shows the analysis of the encounter geometries that were simulated using historical low-altitude traffic data and some proposed UAS missions. This analysis suggests how the overall safety and performance of a surveillance system may relate to surveillance parameters such as surveillance range, horizontal and vertical fields or regard. This study proposed and investigated potential safety and performance metrics for evaluating the performance of a surveillance system, such as the ratio of undetected and late-detected separation violations, and the time to violation at first detection for given sets of surveillance parameters.

UAS

Pilot Evaluation of a UAS Detect-and-Avoid System's Effectiveness in Remaining Well Clear

Unmanned aircraft will equip with a detect-and-avoid (DAA) system that allows them to comply with the requirement to see and avoid other aircraft, an important layer in the overall set of procedural, strategic and tactical separation methods designed to prevent mid-air collisions. Although the effectiveness of the DAA system will be set to a minimum threshold by regulators, different combinations of algorithms, displays and procedures could be used to meet that minimum. The research presented in this paper indicates the effectiveness of the combined pilot-DAA system as a function of the DAA design requirements and provides data that may be used to model the behavior of pilots when employing such systems. Over the course of two simulations 21 professional UAS pilots evaluated eight different DAA system designs and metrics were collected on their ability to maintain the well clear separation standard. The independent variables were the time horizon at which pilots were alerted to potential losses of well clear, the location of the traffic display, and the tools and informational elements available on the display to aid the pilot in detecting and resolving those potential losses. In the second experiment the UAS encountered two categories of aircraft: those equipped with simulated transponders that could be seen dozens of miles away and those without that were only detectable by a simulated radar within a range of six nautical miles. The data indicate that integrating the traffic display with the primary mission map directly in front of the pilot reduced the frequency of losses of well clear. Improved detection and resolution tools, including explicit maneuver guidance and a trial planning capability, had less of an effect in reducing the frequency of losses but significantly reduced the time in loss when they occurred. The amount of warning time provided to the pilot had a strong effect on their ability to remain well clear: when alerts were first presented with less than about 15 seconds to a predicted loss of well clear pilots were able to maneuver successfully in only 26 percent of encounters, whereas they were about 83 percent successful when they had more than 15 seconds. Pilots' ability to separate from the two categories of aircraft was nearly the same after accounting for the amount of alert time provided in each encounter, although the limited surveillance volume for the non-transponder equipped aircraft meant alerts tended to occur later and therefore were more difficult to resolve.

loss of well clear

Evaluating Performance of UAS Detect-And-Avoid System Using a Fast-Time Simulation Tool

Most unmanned aircraft systems will be required to be equipped with a Detect-and-Avoid (DAA) system. The surveillance performance of the DAA system to detect and track intruder aircraft will depend on the encounter geometries that unmanned aircraft are expected to have with other aircraft in the airspace. The performance of DAA alerting and avoidance system is also dependent on the timeliness of alerting for UAS pilots to give a sufficient time to determine and command a resolution maneuver to avoid well clear separation violations. This presentation introduces general background of UAS DAA systems and concept of well clear separation standard to satisfy see and avoid regulations. The presentation shows the several UAS mission profiles and analysis of the encounter geometries that were simulated using historical VFR traffic data and some proposed UAS missions. This presentation introduces several potential metrics for evaluating the performance of a DAA system and shows the results that measured through fast-time simulation with traffic scenarios that include NAS-wide VFR manned aircraft and IFR UAS flights. At the end, some research areas will be briefly discussed.

UAS

Java Architecture for Detect and Avoid Extensibility and Modeling

Unmanned aircraft will equip with a detect-and-avoid (DAA) system that enables them to comply with the requirement to "see and avoid" other aircraft, an important layer in the overall set of procedural, strategic and tactical separation methods designed to prevent mid-air collisions. This paper describes a capability called Java Architecture for Detect and Avoid Extensibility and Modeling (JADEM), developed to prototype and help evaluate various DAA technological requirements by providing a flexible and extensible software platform that models all major detect-and-avoid functions. Figure 1 illustrates JADEM's architecture. The surveillance module can be actual equipment on the unmanned aircraft or simulators that model the process by which sensors on-board detect other aircraft and provide track data to the traffic display. The track evaluation function evaluates each detected aircraft and decides whether to provide an alert to the pilot and its severity. Guidance is a combination of intruder track information, alerting, and avoidance/advisory algorithms behind the tools shown on the traffic display to aid the pilot in determining a maneuver to avoid a loss of well clear. All these functions are designed with a common interface and configurable implementation, which is critical in exploring DAA requirements. To date, JADEM has been utilized in three computer simulations of the National Airspace System, three pilot-in-the-loop experiments using a total of 37 professional UAS pilots, and two flight tests using NASA's Predator-B unmanned aircraft, named Ikhana. The data collected has directly informed the quantitative separation standard for "well clear", safety case, requirements development, and the operational environment for the DAA minimum operational performance standards. This work was performed by the Separation Assurance/Sense and Avoid Interoperability team under NASA's UAS Integration in the NAS project.

unmanned aircraft systems

UAS Integration in the NAS Project: Flight Test 3 Data Analysis of JADEM-Autoresolver Detect and Avoid System

The Unmanned Aircraft Systems Integration in the National Airspace System project, or UAS Integration in the NAS, aims to reduce technical barriers related to safety and operational challenges associated with enabling routine UAS access to the NAS. The UAS Integration in the NAS Project conducted a flight test activity, referred to as Flight Test 3 (FT3), involving several Detect-and-Avoid (DAA) research prototype systems between June 15, 2015 and August 12, 2015 at the Armstrong Flight Research Center (AFRC). This report documents the flight testing and analysis results for the NASA Ames-developed JADEM-Autoresolver DAA system, referred to as 'Autoresolver' herein. Four flight test days (June 17, 18, 22, and July 22) were dedicated to Autoresolver testing. The objectives of this test were as follows: 1. Validate CPA prediction accuracy and detect-and-avoid (DAA, formerly known as self-separation) alerting logic in realistic flight conditions. 2. Validate DAA trajectory model including maneuvers. 3. Evaluate TCAS/DAA interoperability. 4. Inform final Minimum Operating Performance Standards (MOPS). Flight test scenarios were designed to collect data to directly address the objectives 1-3. Objective 4, inform final MOPS, was a general objective applicable to the UAS in the NAS project as a whole, of which flight test is a subset. This report presents analysis results completed in support of the UAS in the NAS project FT3 data review conducted on October 20, 2015. Due to time constraints and, to a lesser extent, TCAS data collection issues, objective 3 was not evaluated in this analysis.

flight test

Assuring Ground-Based Detect and Avoid for UAS Operations

One of the goals of the Marginal Ice Zones Observations and Processes Experiment (MIZOPEX) NASA Earth science mission was to show the operational capabilities of Unmanned Aircraft Systems (UAS) when deployed on challenging missions, in difficult environments. Given the extreme conditions of the Arctic environment where MIZOPEX measurements were required, the mission opted to use a radar to provide a ground-based detect-and-avoid (GBDAA) capability as an alternate means of compliance (AMOC) with the see-and-avoid federal aviation regulation. This paper describes how GBDAA safety assurance was provided by interpreting and applying the guidelines in the national policy for UAS operational approval. In particular, we describe how we formulated the appropriate safety goals, defined the processes and procedures for system safety, identified and assembled the relevant safety verification evidence, and created an operational safety case in compliance with Federal Aviation Administration (FAA) requirements. To the best of our knowledge, the safety case, which was ultimately approved by the FAA, is the first successful example of non-military UAS operations using GBDAA in the U.S. National Airspace System (NAS), and, therefore, the first nonmilitary application of the safety case concept in this context.

Detect-and-Avoid

Final Overview of ACES Simulation for Evaluation SARP Well-Clear Definitions

The UAS in the NAS project is studying the minimum operational performance standards for unmanned aerial systems (UAS's) detect-and-avoid (DAA) system in order to operate in the National Airspace System. The DoD's Science and research Panel (SARP) Well-Clear Workshop is investigating the time and spatial boundary at which an UAS violates well-clear. NASA is supporting this effort through use of its Airspace Concept Evaluation System (ACES) simulation platform. This briefing presents the final results to the SARP, which will be used to judge the three candidate well-clear definitions, and for the selection of the most operationally suitable option.

detect and avoid

The Impact of Integrated Maneuver Guidance Information on UAS Pilots Performing the Detect and Avoid Task

The integrated human-in-the-loop (iHITL) simulation examined the effect of four different Detect-and-Avoid (DAA) display concepts on unmanned aircraft system (UAS) pilots' ability to maintain safe separation. The displays varied in the type and amount of guidance they provided to pilots. The study's background and methodology are discussed, followed by the 'measured response' data (i.e., pilots' end-to-end response time in reacting to traffic alerts on their DAA display). Results indicate that display type had a significant impact on how long pilot's spent interacting with the interface (i.e., edit times).

detect and avoid

UAS Integration into the NAS: iHTL: DAA Display Evaluation Preliminary Results

The integrated human-in-the-loop (iHITL) simulation examined the effect of four different Detect-and-Avoid (DAA) display concepts on unmanned aircraft system (UAS) pilots' ability to maintain safe separation. The displays varied in the type and amount of guidance they provided to pilots. The study's background and methodology are discussed, followed by a presentation of the preliminary 'measured response' data (i.e., pilots' end-to-end response time in reacting to traffic alerts on their DAA display). Results indicate that display type had moderate to no affect on pilot measured response times.

unmanned aircraft systems

An Evaluation of Detect and Avoid Displays for UAS: The Effect of Information Level and Display Location on Pilot Performance

The pilot-in-the-loop Detect-and-Avoid (DAA) task requires the pilot to carry out three major functions: 1) detect a potential threat, 2) determine an appropriate resolution maneuver, and 3) execute that resolution maneuver via the GCS control and navigation interface(s). The purpose of the present study was to examine two main questions with respect to DAA display considerations that could impact pilots ability to maintain well clear from other aircraft. First, what is the effect of a minimum (or basic) information display compared to an advanced information display on pilot performance? Second, what is the effect of display location on UAS pilot performance? Two levels of information level (basic, advanced) were compared across two levels of display location (standalone, integrated), for a total of four displays. The results indicate that the advanced displays had faster overall response times compared to the basic displays, however, there were no significant differences between the standalone and integrated displays.

detect and avoid

Piloted Well Clear Performance Evaluation of Detect and Avoid Systems with Suggestive Guidance

Regulations to establish operational and performance requirements for unmanned aircraft systems (UAS) are being developed by a consortium of government, industry and academic institutions (RTCA, 2013). Those requirements will apply to the new detect-and-avoid (DAA) systems and other equipment necessary to integrate UAS with the United States (U.S) National Airspace System (NAS) and will be determined according to their contribution to the overall safety case. That safety case requires demonstration that DAA-equipped UAS collectively operating in the NAS meet an airspace safety threshold (AST). Several key gaps must be closed in order to link equipment requirements to an airspace safety case. Foremost among these is calculation of the systems risk ratio, the degree to which a particular system mitigates violation of an aircraft separation standard (FAA, 2013). The risk ratio of a DAA system, in combination with risk ratios of other collision mitigation mechanisms, will determine the overall safety of the airspace measured in terms of the number of collisions per flight hour. It is not known what the effectiveness is of a pilot-in-the-loop DAA system or even what parameters of the DAA system most improve the pilots ability to maintain separation. The relationship between the DAA system design and the overall effectiveness of the DAA system that includes the pilot, expressed as a risk ratio, must be determined before DAA operational and performance requirements can be finalized. Much research has been devoted to integrating UAS into non-segregated airspace (Dalamagkidis, 2009, Ostwald, 2007, Gillian, 2012, Hesselink, 2011, Santiago, 2015, Rorie 2015 and 2016). Several traffic displays intended for use as part of a DAA system have gone through human-in-the-loop simulation and flight-testing. Most of these evaluations were part of development programs to produce a deployable system, so it is unclear how to generalize particular aspects of those designs to general requirements for future traffic displays (Calhoun, 2014). Other displays have undergone testing to collect data that may generalize to new displays, but have not been evaluated in the context of the development of an overall safety case for UAS equipped with DAA systems in the NAS (Bell, 2012). Other research efforts focus on DAA surveillance performance and separation standards. Together with this work, they are expected to facilitate validation of the airspace safety case (Park, 2014 and Johnson, 2015). The contribution of the present work is to quantify the effectiveness of the pilot-automation system to remain well clear as a function of display features and surveillance sensor error. This quantification will help enable selection of a minimum set of DAA design features that meets the AST, a set that may not be unique for all UAS platforms. A second objective is to collect and analyze pilot performance parameters that will improve the modeling of overall DAA system performance in non-human-in-the-loop simulations. Simulating the DAA-equipped UAS in such batch experiments will allow investigation of a much larger number of encounters than is possible in human simulations. This capability is necessary to demonstrate that a particular set of DAA requirements meets the AST under all foreseeable operational conditions.

detect and avoid

Appendix A: NAS-Wide Encounter Rate Evaluation Using Historical Radar Data and the Airspace Concept Evaluation System (ACES)

Regulations that establish operational and performance requirements for unmanned aircraft systems (UAS) are being developed by a consortium of government, industry and academic institutions. Those requirements will apply to detect-and-avoid (DAA) systems and other equipment necessary to integrate UAS with the National Airspace System (NAS) and are determined according to their contribution to the overall level of safety required to operate in the airspace. Several key gaps must be addressed in order to link equipment requirements to an airspace level of safety. Foremost among these is the calculation of the relative effectiveness of a particular system to mitigate violations of a separation standard with other aircraft, which is known as the systems risk ratio. The risk ratio is calculated as the probability of mid-air collision with a DAA system divided by the probability of mid-air collision without a DAA system. The risk ratio of a DAA system, in combination with the risk ratios of other collision avoidance mitigations, will determine the overall safety of the airspace measured in terms of the number of mid-air collisions per flight hour. Defining the required risk ratio that the DAA system needs to ensure the safety of the airspace requires an evaluation of the current airspace and a simulated evaluation that incorporates UAS aerodynamic performance and the mission characteristics of future UAS operations that are projected to be conducted in areas that interact with current operations. These evaluations will produce the frequency of encounters that currently exist in the airspace and those that could be generated with the introduction of UAS. Together, the frequency of encounters, an evaluation of unmitigated risk of collision, and a desired level of safety of the airspace will yield a required risk ratio of the DAA system. This study will focus on evaluating the encounter rates between aircraft based on historical radar data and encounter rates that could occur based on simulated UAS missions.

Unmanned Aircraft Systems

ACES Preliminary Results Supporting Selection of SARP Well-Clear Definitions

The UAS in the NAS project is studying the minimum operational performance standards for unmanned aerial systems (UAS's) detect-and-avoid (DAA) system in order to operate in the National Airspace System. The DoD's Science and research Panel Well-Clear Workshop is investigating the time and spatial boundary at which an UAS violates well-clear. NASA is supporting this effort through use of its Airspace Concept Evaluation System (ACES) simulation platform. This presentation reviews how the simulation was used to support this work, lessons learned during the experiment, and introduces preliminary results.

well-clear

NASA ACES V&V Alignment Briefing

Regulations to establish operational and performance requirements for unmanned aircraft systems (UAS) are being developed by a consortium of government, industry and academic institutions. Those requirements will apply to the new detect and avoid (DAA) systems and other equipment necessary to integrate UAS with the National Airspace System (NAS) and are determined according to their contribution to the overall safety case for such an integration. This briefing focuses on providing an overview of the Airspace Concept Evaluation System (ACES) platform, review of detect-and-avoid models incorprated in ACES, sumamry of two planned ACES studies, and a way forward to impact the SC-228 VV plan.

Santiago, Confesor

Simulation and Flight Test Data Collection Review for Supporting Phase 1 Detect and Avoid MOPS

RTCA Special Committee 228 is a consortium of government, industry, and academic organizations tasked to develop minimum operational performance standards for UAS detect and avoid systems. The UAS in the NAS (National Airspace System) project is studying the minimum operational performance standards for unmanned aerial systems (UAS's) detect-and-avoid (DAA) system in order to operate in the National Airspace System. Over the past 3 years, the project has executed a series of fast-time simulation, human-in-the-loop experiments, and flight tests in support of this effort. The purpose of this briefing is to summarize the models developed and data collected to overcome UAS integration barriers, so UAS can remain well clear of all traffic.

Santiago, Confesor

Characteristics of a Well Clear Definition and Alerting Criteria for Encounters Between UAS and Manned Aircraft in Class E Airspace

Unmanned aircraft systems (UAS) will be required to equip with a detect-and-avoid (DAA) system in order to satisfy the federal aviation regulations to remain well clear of other aircraft. For a DAA system to satisfy the requirement to stay well clear of other airborne traffic, a quantitative definition of well clear needs to be defined and evaluated. This study investigates the implications of UAS using proposed well clear definitions as a separation standard for conducting operations in the National Airspace System (NAS). The first analysis considers three well clear definitions and presents the relative state conditions of intruder aircraft as they encroach upon the well clear boundary. The second analysis focuses on the definition of the alerting criteria needed to inform the UAS operator of a potential loss of well clear. All analyses are conducted in a NAS-wide fast-time simulation environment using UAS aircraft models, proposed UAS missions, and historical air defense radar data to populate the background traffic operating under visual flight rules. The results presented in this study inform the safety case, requirements development, and the operational environment for DAA minimum operational performance standards.

Safety