Seeing Through the Fog: Perception Testing for Autonomous Flight
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
As the path towards Urban Air Mobility (UAM) continues to take shape, there are outstanding technical challenges to achieving safe and effective air transportation operations under this new paradigm. To inform and guide technology development for UAM, NASA is investigating the current state-of-the-art in key technology areas including traffic management, detect-and-avoid, and autonomy. In support of this effort, a new perception testbed was developed at NASA Ames Research Center to collect data from an array of sensing systems representative of those that could be found on a future UAM vehicle. This testbed, featuring a Light-Detection-and-Ranging (LIDAR) instrument, a long-wave infrared sensor, and a visible spectrum camera was deployed for a multiday test campaign in the Fog Chamber at Sandia National Laboratories (SNL), in Albuquerque, New Mexico. During the test campaign, fog conditions were created for tests with targets including a human, a resolution chart, and a small unmanned aerial vehicle (sUAV). This paper describes in detail, the developed perception testbed, the experimental setup in the fog chamber, the resulting data, and presents an initial result from analysis of the data with the evaluation of methods to increase contrast through filtering techniques.
Explore the source record for details and available documents.
This paper addresses the problem of building trust in online predictions of the remaining available flying time for two different electric Unmanned Aerial Vehicles (eUAVs) powered by lithium-ion-polymer batteries. Flight tests for various automation research missions for the two vehicles were monitored using two on-board battery health management applications to make predictions of the remaining flying time (RFT) for each eUAV and to predict the state of the battery. Playback of the voltage, current and temperature profiles of the battery discharge were used to assess the accuracy of the estimation of the voltage and the charge states of the models as well as the estimate of the RFT. The reference ground truth values were the observed landing time and the measured battery pack resting pack voltage 20 minutes after the flight. The predicted RFT, state of charge (SoC), and state of energy (SoE) were compared with the observed results. Noise values of one standard deviation from the mean values of the internal charge states of the battery model during a reference run were used to vary the states during simulation. One application used an equivalent circuit model of the electrical dynamics of the battery pack, and the other application used a reduced-order electrochemistry model. The variation of the model state components was compared to the variation in the estimate of the RFT and the variation in the SoE to estimate a confidence factor. Variation in the estimates caused by factors affecting the off-line laboratory parameter identification experiments is considered. Variation in the estimates due to environmental factors are discussed.
Autonomous vehicles are no longer futuristic technology; in fact, there are already cars with self-driving features on the road. Over the next five years, the connected vehicles will disrupt the entire automotive and UAS ecosystems. The industry will undergo fundamental change as semi-autonomous driving and flying emerges, followed by an eventual shift to full autonomy.
As aviation adopts new and increasingly complex operational paradigms, vehicle types, and technologies to broaden airspace capability and efficiency, maintaining a safe system will require recognition and timely mitigation of new safety issues as they emerge and before significant consequences occur. A shift toward a more predictive risk mitigation capability becomes critical to meet this challenge. In-time safety assurance comprises monitoring, assessment, and mitigation functions that proactively reduce risk in complex operational environments where the interplay of hazards may not be known (and therefore not accounted for) during design. These functions can also help to understand and predict emergent effects caused by the increased use of automation or autonomous functions that may exhibit unexpected non-deterministic behaviors. The envisioned monitoring and assessment functions can look for precursors, anomalies, and trends (PATs) by applying model-based and data-driven methods. Outputs would then drive downstream mitigation(s) if needed to reduce risk. These mitigations may be accomplished using traditional design revision processes or via operational (and sometimes automated) mechanisms. The latter refers to the ‘in-time’ aspect of the system concept. This report comprises architecture and information requirements and considerations toward enabling such a capability within the domain of low altitude highly autonomous urban flight operations. This domain may span, for example, public-use surveillance missions flown by small unmanned aircraft (e.g., infrastructure inspection, facility management, emergency response, law enforcement, and/or security) to transportation missions flown by larger aircraft that may carry passengers or deliver products. Caveat: Any stated requirements in this report should be considered initial requirements that are intended to drive research and development (R&D). These initial requirements are likely to evolve based on R&D findings, refinement of operational concepts, industry advances, and new industry or regulatory policies or standards related to safety assurance.
The Autonomous Formation Flight (AFF) project at the NASA Dryden Flight Research Center (Edwards, California) investigated performance benefits resulting from formation flight, such as reduced aerodynamic drag and fuel consumption. To obtain data on performance benefits, a trailing F/A-18 airplane flew within the wing tip-shed vortex of a leading F/A-18 airplane. The pilot of the trail airplane used advanced station-keeping technology to aid in positioning the trail airplane at precise locations behind the lead airplane. The specially instrumented trail airplane was able to obtain accurate fuel flow measurements and to calculate engine thrust and vehicle drag. A maneuver technique developed for this test provided a direct comparison of performance values while flying in and out of the vortex. Based on performance within the vortex as a function of changes in vertical, lateral, and longitudinal positioning, these tests explored design-drivers for autonomous stationkeeping control systems. Observations showed significant performance improvements over a large range of trail positions tested. Calculations revealed maximum drag reductions of over 20 percent, and demonstrated maximum reductions in fuel flow of just over 18 percent.
The Autonomous Formation Flight (AFF) project was initiated in 1995 to demonstrate at least 10-percent drag reduction by positioning a trailing aircraft in the wingtip vortex of a leading aircraft. If successful, this technology would provide increased fuel savings, reduced emissions, and extended flight duration for fleet aircraft flying in formation. To demonstrate this technology, the AFF project at NASA Dryden Flight Research Center developed a system architecture incorporating two F-18 aircraft flying in leading-trailing formation. The system architecture has been designed to allow the trailing aircraft to maintain station-keeping position relative to the leading aircraft within +/-10 ft. Development of this architecture would be directed at the design and development of a computing system to feed surface position commands into the flight control computers, thereby controlling the longitudinal and lateral position of the trailing aircraft. In addition, modification to the instrumentation systems of both aircraft, pilot displays, and a means of broadcasting the leading aircraft inertial and global positioning system-based positional data to the trailing aircraft would be needed. This presentation focuses on the design and testing of the AFF Phase 0 research system.
A viewgraph presentation on autonomous soaring flight results for Unmanned Aerial Vehicles (UAV)'s is shown. The topics include: 1) Background; 2) Thermal Soaring Flight Results; 3) Autonomous Dolphin Soaring; and 4) Future Plans.
NASA's Strategic Plan for the Aerospace Technology Enterprise includes ambitious objectives focused on affordable air travel, reduced emissions, and expanded aviation-system capacity. NASA Dryden Flight Research Center, in cooperation with NASA Ames Research Center, the Boeing Company, and the University of California, Los Angeles, has embarked on an autonomous-formation-flight project that promises to make significant strides towards these goals. For millions of years, birds have taken advantage of the aerodynamic benefit of flying in formation. The traditional "V" formation flown by many species of birds (including gulls, pelicans, and geese) enables each of the trailing birds to fly in the upwash flow field that exists just outboard of the bird immediately ahead in the formation. The result for each trailing bird is a decrease in induced drag and thus a reduction in the energy needed to maintain a given speed. Hence, for migratory birds, formation flight extends the range of the system of birds over the range of birds flying solo. The Autonomous Formation Flight (AFF) Project is seeking to extend this symbiotic relationship to aircraft.
The NASA High Density Vertiport project has completed a multi-aircraft flight test of a scalable autonomous vertiport prototype system. These tests included end to end system integration testing of hardware and software, operational procedure testing of defined roles and responsibilities within a vertiport environment, and human factors data collection. This paper provides an overview of the flight test setup , scenarios, and summary results.
This research presents a simulation framework for autonomous research for a UAM vehicle using the NASA Revolutionary Vertical Lift Technology Lift+Cruise concept vehicle. Our research results were produced using the open-source, six degree of freedom, rigid-body, nonlinear generic urban air mobility (GUAM) simulation. The intent of this paper is to demonstrate the GUAM simulation and a series of Challenge Problems that our researchers have posed to the broader autonomous vehicle research community. Our team has developed the GUAM simulation for the express purpose of providing a high-fidelity transition vehicle dynamics model to foster collaboration and algorithm performance comparison across research teams. In this paper, we demonstrate some of the autonomous flight research challenges and some of our current approaches to tackling basic autonomous flight tasks (e.g., trajectory following, stationary and moving obstacle avoidance). Additionally, we propose some flight metrics to assess autonomous algorithm performance while accomplishing these basic autonomous tasks.
This paper summarizes the application of a nonlinear dynamic inversion (DI) flight control system (FCS) to an autonomous flight test vehicle in NASA's X-38 Project, a predecessor to the International Space Station (ISS) Crew Return Vehicle (CRV). Honeywell's Multi-Application Control-H (MACH) is a parameterized FCS design architecture including both model-based DI rate-compensation and classical P+I command-tracking. MACH was adopted by X-38 in order to shorten the design cycle time for different vehicle shapes and flight envelopes and evolving aerodynamic databases. Specific design issues and analysis results are presented for the application of MACH to the 3rd free flight (FF3) of X-38 Vehicle 132 (V132). This B-52 drop test, occurring on March 30, 2000, represents the first flight test of MACH and one of the first few known applications of DI in the primary FCS of an autonomous flight test vehicle.
Autonomous vertical lift vehicles hold considerable potential for supporting planetary science and exploration missions. This paper discusses several technical aspects of vertical lift planetary aerial vehicles in general, and specifically addresses technical challenges and work to date examining notional vertical lift vehicles for Mars, Titan, and Venus exploration.
Autonomous vertical lift vehicles hold considerable potential for supporting planetary science and exploration missions. This paper discusses several technical aspects of vertical lift planetary aerial vehicles in general, and specifically addresses technical challenges and work to date examining notional vertical lift vehicles for Mars, Titan, and Venus exploration.
Autonomous in-air wingtip docking of aircraft offers significant opportunity for system level performance gains for numerous aircraft applications. Several of the technical challenges facing wingtip docking of fixed-wing aircraft are addressed in this paper, including: close proximity aerodynamic coupling; mechanisms and operations for robust docking; and relative state estimation methods. A simulation framework considering the aerodynamics, rigid-body dynamics, and vehicle controls is developed and used to perform docking sensitivity studies for a system of two 5.5% scale NASA Generic Transport Model aircraft. Additionally, proof of- concept testing of a candidate docking mechanism designed to move the primary wingtip vortex inboard suggests the viability of such an approach for achieving robust docking.
We performed a human-in-the-loop study to explore the role of transparency in engendering trust and reliance within highly automated systems. Specifically, we examined how transparency impacts trust in and reliance upon the Autonomous Constrained Flight Planner (ACFP), a critical automated system being developed as part of NASA's Reduced Crew Operations (RCO) Concept. The ACFP is designed to provide an enhanced ground operator, termed a super dispatcher, with recommended diversions for aircraft when their primary destinations are unavailable. In the current study, 12 commercial transport rated pilots who played the role of super dispatchers were given six time-pressured all land scenarios where they needed to use the ACFP to determine diversions for multiple aircraft. Two factors were manipulated. The primary factor was level of transparency. In low transparency scenarios the pilots were given a recommended airport and runway, plus basic information about the weather conditions, the aircraft types, and the airport and runway characteristics at that and other airports. In moderate transparency scenarios the pilots were also given a risk evaluation for the recommended airport, and for the other airports if they requested it. In the high transparency scenario additional information including the reasoning for the risk evaluations was made available to the pilots. The secondary factor was level of risk, either high or low. For high-risk aircraft, all potential diversions were rated as highly risky, with the ACFP giving the best option for a bad situation. For low-risk aircraft the ACFP found only low-risk options for the pilot. Both subjective and objective measures were collected, including rated trust, whether the pilots checked the validity of the automation recommendation, and whether the pilots eventually flew to the recommended diversion airport. Key results show that: 1) Pilots trust increased with higher levels of transparency, 2) Pilots were more likely to verify ACFPs recommendations with low levels of transparency and when risk was high, 3) Pilots were more likely to explore other options from the ACFP in low transparency conditions and when risk was high, and 4) Pilots decision to accept or reject ACFPs recommendations increased as a function of the transparency in the explanation. The finding that higher levels of transparency was coupled with higher levels of trust, a lower need to verify other options, and higher levels of agreement with ACFP recommendations, confirms the importance of transparency in aiding reliance on automated recommendations. Additional analyses of qualitative data gathered from subjects through surveys and during debriefing interviews also provided the basis for new design recommendations for the ACFP.
Urban Air Mobility (UAM) is an emerging aviation sector and is playing an integral part in the on-demand mobility revolution. UAM is powered by the convergence of advances in distributed electrical propulsion (DEP) and vehicle autonomy. The complexity of operations in the urban environment and the unconventional vehicle configurations designed to take advantage of new propulsion technologies, result in numerous challenges that benefit from a control-centric approach. In this talk we outline some of these challenges and present our current approach to addressing them. For example, in order to achieve full market potential and access to UAM, vehicle autonomous flight is required. A key barrier to autonomous flight in a large multi-agent system is dealing with off-nominal situations and contingencies in a safe and predictable manner. We present our approach to intelligent contingency management, and share recent results and open problems. Additionally, we discuss another major barrier to ubiquitous UAM – the noise signature produced by vehicles with multiple rotors. We present our approach to minimizing such noise within the framework of the acoustically-aware vehicle.