Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “UAV trajectory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

A Natural Interaction Interface for UAVs Using Intuitive Gesture Recognition

The popularity of unmanned aerial vehicles (UAVs) is increasing as technological advancements boost their favorability for a broad range of applications. One application is science data collection. In fields like Earth and atmospheric science, researchers are seeking to use UAVs to augment their current portfolio of platforms and increase their accessibility to geographic areas of interest. By increasing the number of data collection platforms UAVs will significantly improve system robustness and allow for more sophisticated studies. Scientists would like be able to deploy an available fleet of UAVs to fly a desired flight path and collect sensor data without needing to understand the complex low-level controls required to describe and coordinate such a mission. A natural interaction interface for a Ground Control System (GCS) using gesture recognition is developed to allow non-expert users (e.g., scientists) to define a complex flight path for a UAV using intuitive hand gesture inputs from the constructed gesture library. The GCS calculates the combined trajectory on-line, verifies the trajectory with the user, and sends it to the UAV controller to be flown.

Chandarana, Meghan↗

Using Natural Language to Enable Mission Managers to Control Multiple Heterogeneous UAVs

The availability of highly capable, yet relatively cheap, unmanned aerial vehicles (UAVs) is opening up new areas of use for hobbyists and for commercial activities. This research is developing methods beyond classical control-stick pilot inputs, to allow operators to manage complex missions without in-depth vehicle expertise. These missions may entail several heterogeneous UAVs flying coordinated patterns or flying multiple trajectories deconflicted in time or space to predefined locations. This paper describes the functionality and preliminary usability measures of an interface that allows an operator to define a mission using speech inputs. With a defined and simple vocabulary, operators can input the vast majority of mission parameters using simple, intuitive voice commands. Although the operator interface is simple, it is based upon autonomous algorithms that allow the mission to proceed with minimal input from the operator. This paper also describes these underlying algorithms that allow an operator to manage several UAVs.

Trujillo, Anna C.↗

Energy‐aware relay positioning in flying networks

Summary The ability to move and hover has made rotary‐wing unmanned aerial vehicles (UAVs) suitable platforms to act as flying communications relays (FCRs), aiming at providing on‐demand, temporary wireless connectivity when there is no network infrastructure available or a need to reinforce the capacity of existing networks. However, since UAVs rely on their on‐board batteries, which can be drained quickly, they typically need to land frequently for recharging or replacing them, limiting their endurance and the flying network availability. The problem is exacerbated when a single FCR UAV is used. The FCR UAV energy is used for two main tasks: Communications and propulsion. The literature has been focused on optimizing both the flying network performance and energy efficiency from the communications point of view, overlooking the energy spent for the UAV propulsion. Yet, the energy spent for communications is typically negligible when compared with the energy spent for the UAV propulsion. In this article, we propose energy‐aware relay positioning (EREP), an algorithm for positioning the FCR taking into account the energy spent for the UAV propulsion. Building upon the conclusion that hovering is not the most energy‐efficient state, EREP defines the trajectory and speed that minimize the energy spent by the FCR UAV on propulsion, without compromising in practice the quality of service offered by the flying network. The EREP algorithm is evaluated using simulations. The obtained results show gains up to 26% in the FCR UAV endurance for negligible throughput and delay degradation.

Rodrigues, Hugo↗

Update on Piloted and Un-Piloted Aircraft at NASA Dryden

This viewgraph presentation reviews the NASA Dryden Flight Research Center's (DFRC) environment for testing of experimental aircraft. Included are a satellite view of the Dryden locale, and a summary of the capabilities at DFRC. It reviews the capabilites of High Altitude Platform (HAP) testing; Gulfstream III (1.)Unmanned Aerial Vehicle (UAV) synthetic aperture radar (SAR) (2) Precision Trajectory Capability Global Hawk (ACTD); ER-2; Ikhana (Predator B);

DelFrate, John H.↗

Autonomous Aerial Power Plant Inspection in GPS-denied Environments

Inspection of coal-fired power plants is frequently dangerous, includes difficult places to reach, and can turn expensive due to the downtimes and cost of inspection crew. Robotic systems have shown capabilities to address some of these issues, but most of the current robotic inspection technology in power plants is designed for specific components. Conversely, recent advances in machine vision have empowered aerial platforms for long-range, remotely-controlled, GPS-based inspections of industrial plants. This capability has led to wide spread utilization of aerial robots (commonly termed Drones, UVS or UAS) platforms for inspection in less challenging environments where both collision avoidance, and GPS reception are not significant issues. The challenge in adapting airborne technology for power plant inspection lies in internal structures and the complex network of piping, and distribution systems, which impose significant risks for collision and can hinder the reception and transmission of GPS signals. The current state of the art in aerial inspection technology within the energy sector is controlled via radio control, and utilizes GPS-based navigation, for inspection of large-scale plants such as offshore platforms and wind turbine parks. Nevertheless, close-range and autonomous inspection in the GPS-denied environments of power plants has not yet been achieved, as it requires precise guidance and navigation with real-time situational awareness and obstacle avoidance capabilities. This endeavor introduced the use of rotary wing flying robots, due to their station keeping and vertical take-off capabilities for power plant components inspection. To enable close quarter inspection two methods were used. One method uses the 3D CAD (Three-dimensional Computer-Aided Design) model of the asset to inspect to generate the UAV’s inspection path. To acquire, analyze and process the 3D model, first, the STL file is produced to obtain surface points and vectors normal to the surface. Later, by introducing other variables such as wall offset and a controlled trajectory between each outline and each subsequent layer, the flight path is generated. The proposed framework will generate a path that will pass as close as desired from the surface and navigate in intricate environments. A second method, use advanced manufacturing techniques such as CNC (Computer Numerical Control) and additive manufacturing. Once the inspection flight path is obtained, vision-based navigation systems are employed to have the UAV autonomously tracking the provided trajectory. Finally, Artificial Intelligence-enabled developments are in charge of detecting cracks and corrosion in structural components of power plants. The proposed methods are validated in simulations, laboratory and industrial setups, where it is shown that the developed systems acting together enable close-quarter autonomous aerial inspection and mapping in power plant assets. The system can be further improved by adding more sensors to navigate in different GPS-denied environments, with non-homogeneous lighting conditions, dust and in general situations where vision-based systems may fail.

01 COAL, LIGNITE, AND PEAT↗

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, a fleet of unmanned ground vehicles (UGVs) was developed as a test and evaluation (T\&E) platform to reduce system integration gaps between simulation and live flight hardware. While simulation and hardware-in-the-loop bench testing provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure increase the risks to safety, property, and the project. Given ATTRACTOR’s goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, bridging these gaps was critical to successful project execution and feasibility assessment. In this paper we present the UGV fleet and its role in speeding up system integration, smoothing the transition from simulation to flight, and providing researchers an easy-to-use hardware test bed. An overview of the hardware and software on-board the vehicles is provided along with supporting infrastructure. The system integration process is documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted since the creation of the fleet. Finally, we discuss the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P. Vaughan↗

Tightly-coupled camera/LiDAR integration for point cloud generation from GNSS/INS-assisted UAV mapping systems

Unmanned aerial vehicles (UAVs) equipped with integrated global navigation satellite systems/inertial navigation systems (GNSS/INS) together with cameras and/or LiDAR sensors are being widely used for topographic mapping in a variety of applications such as precision agriculture, coastal monitoring, and archaeological documentation. Integration of image-based and LiDAR point clouds can provide a comprehensive 3D model of the area of interest. For such integration, ensuring a good alignment between data from the different sources is critical. Although many works have been conducted on this topic, there is still a need for a rigorous integration approach that minimizes the discrepancy between camera and LiDAR data caused by inaccurate system calibration parameters and/or trajectory artifacts. This study proposes an automated tightly-coupled camera/LiDAR integration workflow for GNSS/INS-assisted UAV systems. The proposed strategy is conducted in three main steps. First, an image-based point cloud is generated using a LiDAR/GNSS/INS-assisted structure from motion (SfM) strategy. Then, feature correspondences between image-based and LiDAR point clouds are automatically identified. Finally, an integrated-bundle adjustment procedure including image points, LiDAR raw measurements, and GNSS/INS information is conducted to minimize the discrepancy between point clouds from different sensors while estimating system calibration parameters and refining the trajectory information. The proposed SfM strategy and integration framework are evaluated using five datasets. The SfM results show that using LiDAR data can facilitate feature matching and further increase the number of reconstructed 3D points. The experimental results also illustrate that the developed automated camera/LiDAR integration strategy is capable of accurately estimating system calibration parameters to achieve good alignment among camera/LiDAR data from single/multiple systems. Finally, an absolute accuracy in the range of 3–5 cm is achieved for the image/LiDAR point clouds after the integration process.

42 ENGINEERING↗

In-Time Safety Assessment & Risk Prediction for Unmanned Aerial Systems

One of the critical challenges in emerging autonomous systems is timely mitigation of hazards encountered during operation which may not be known or accounted for at the time of design. Efficient execution of unmanned systems therefore demands a paradigm shift from scheduled periodic maintenance to predictive risk analysis that includes condition-based-monitoring, real-time reliability assessment and hazard mitigation. Particularly, the state-of-health parameters needs to be computed at the component level, unit level as well as the integrated system level. While in the former two levels, the physics of health propagation may be based on underlying electro-mechanical properties, system level prognostics often relies on data-driven models. Further, uncertainty from model, measurements and input sources should be accurately quantified to generate meaningful prediction results that can be fed into reliable decision making processes. Finally, the expected risk and time to failure has to be computed based on the current state-of-health of the overall system. This talk presents a conceptual design of such an in-time safety assurance approach for unmanned aerial vehicles (UAV) operating at low altitudes near and over populated areas. Typical in-flight hazard incidents include unplanned detour, proximity to obstacles, mid-flight component faults, limited battery life and poor quality of GPS measurements. Safety assessment therefore comprises trajectory generation and re-plan, battery RUL computation, distributed fault diagnostics and uncertainty management of predicted trajectory based on GPS measurement noise. The entire monitoring framework will be demonstrated on simulated as well as real UAV flight experiments conducted at the NASA Langley Research Center. This tutorial will therefore guide the audience through a step-by-step tracking of an autonomous system with focus on in-time risk prediction in the presence of unforeseen hazards and uncertain environment.

diagnostics↗

Towards Explainability of UAV-Based Convolutional Neural Networks for Object Classification

f autonomous systems using trust and trustworthiness is the focus of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR), a new NASA Convergent Aeronautical Solutions (CAS) Project. One critical research element of ATTRACTOR is explainability of the decision-making across relevant subsystems of an autonomous system. The ability to explain why an autonomous system makes a decision is needed to establish a basis of trustworthiness to safely complete a mission. Convolutional Neural Networks (CNNs) are popular visual object classifiers that have achieved high levels of classification performances without clear insight into the mechanisms of the internal layers and features. To explore the explainability of the internal components of CNNs, we reviewed three feature visualization methods in a layer-by-layer approach using aviation related images as inputs. Our approach to this is to analyze the key components of a classification event in order to generate component labels for features of the classified image at different layers of depths. For example, an airplane has wings, engines, and landing gear. These could possibly be identified somewhere in the hidden layers from the classification and these descriptive labels could be provided to a human or machine teammate while conducting a shared mission and to engender trust. Each descriptive feature may also be decomposed to a combination of primitives such as shapes and lines. We expect that knowing the combination of shapes and parts that create a classification will enable trust in the system and insight into creating better structures for the CNN.

Dolph, Chester V.↗

Fault Detection and Performance Monitoring of Propellers in Electric UAV

Unmanned aerial vehicles (UAVs) are used in various industries such as agriculture and logistics, to name but a few, where their applications are beyond basic mapping, surveillance, and photography. In near future, UAVs are expected to be used in package delivery service and larger electric vertical takeoff and landing vehicles will be employed for urban air mobility applications (air taxi). Thus, several electric propulsion systems will enter the low-altitude airspace with frequent take offs and landings. To achieve state-of-the-art safety standards under such high traffic density, UAVs will require in-time fault detection and performance monitoring of critical powertrain components. This work focuses on propeller blade performance and damage detection in electric UAVs. Propellers are the fastest moving component in an UAV; even a minor defect in the propeller blades could cause performance deterioration, with consequent challenges in flying through the planned trajectory or adhere to the safety requirements of the operation. Monitoring and updating aerodynamic efficiency of each rotor would therefore enable the detection of off-nominal propeller conditions thus magnifying the state-awareness of powertrain monitoring systems based on the acquired electrical signals. We use an extended Kalman filter-based parameter estimation algorithm that incorporates time history responses from UAV powertrain in conjunction with a full powertrain system model. Propeller fault detection is achieved by incorporating the aerodynamic parameters of propeller into the powertrain model. The proposed technique is successfully validated with numerical simulations.

Unmanned aerial vehicles↗

Bootstrapping Multi-Agent Unmanned Aerial Vehicle (UAV) System Integration Using Ground-Based Assets: Lessons Learned

The highly dynamic nature of UAVs imposes significant challenges when conducting initial testing ranging from safety risks posed by high-capacity lithium batteries and spinning propellers to rigorous timing demands on controllers and the consequences of failures mid-air. Flight testing of a single vehicle is time and labor intensive due to these challenges and more, and the complexity increases exponentially with the number of vehicles. While simulations and hardware-in-the-loop bench testing can provide adequate environments for preliminary validation, differences in system deployment architecture, software interfaces, and hardware infrastructure between simulation and a fleet of real UAVs create a sizable gap that must be navigated carefully during system integration. In support of the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project, which had the goal of establishing a basis of certification of trust and trustworthiness in multi-agent autonomous systems, this gap was tackled from two directions. First, a novel mixed-reality simulation environment was engineered to blur the transition from simulation to flight hardware. Second, a fleet of Unmanned Surface Vehicles (USVs) was developed as a test and evaluation platform that more closely represented the final aerial fleet while eliminating many of the risks associated with air vehicles. This paper delves into the second element, analyzing the efficacy of the USV platform in performing system integration testing for the UAV system. In this paper we present the USV fleet and its role in reducing the aforementioned gaps in deployment architecture, software interfaces, and hardware infrastructure when moving from simulation to flight. An overview of the hardware and software onboard the vehicles will be provided along with supporting infrastructure. The system integration process will be documented including results in supporting both the overarching design reference mission (DRM) of ATTRACTOR and individual research efforts conducted during the project. Finally, we will discuss some of the practical lessons learned regarding the testing, deployment, and operation of multi-agent autonomous systems.

Matthew P Vaughan↗

Examining the Role of IMU Health Characterization and Monitoring in UAS Safety

Inertial measurement units (IMUs) can be vital for vehicle attitude and position estimation in unmanned aerial vehicles (UAVs). Degradation in these units could result in incorrect position estimates that are utilized in vehicle control, trajectory prediction, and other critical systems; however, the modes and effects of degradation in these IMUs are not well understood. In order to quantify the risk posed by degradation in these sensors, a study was conducted on the types of IMUs prevalent in the commercial market, their known failure modes, and the applicability to health monitoring methods for risk reduction and increased safety in an increasingly autonomous airspace. First, use cases and failure modes of the various types and reliability of commercially available IMUs were reviewed, and knowledge gaps and issues in the field were identified. Noting that inexpensive and lightweight MEMS (Microelectromechanical Systems) IMUs are some of the most commonly used but least reliable sensors in sUAS (small Unmanned Aerial Systems), five inexpensive MEMS IMUs were chosen for a performance evaluation study, selected from the Pixhawk autopilot systems, hobby sUAS, and prior NASA experimental studies. For each of these IMUs, a 10-minute bias test and a 12-hour drift test were performed for the accelerometers in a benchtop setting, using a BeagleBone Black for data collection. Using these results, the sensors’ performance is compared to their reported specifications, and the utility of implementing diagnostic methods for MEMS IMUs for research and commercial applications is evaluated. The paper concludes with a planned study for the evaluation of vibration-induced degradation for the selected sensors.

IMUs↗

UAV Inspection of Electrical Transmission Infrastructure with Path Conformance Autonomy and Lidar-Based Geofences NASA Report on UTM Reference Mission Flights at Southern Company Flights November 2016

Flights at low altitudes in close proximity to electrical transmission infrastructure present serious navigational challenges: GPS and radio communication quality is variable and yet tight position control is needed to measure defects while avoiding collisions with ground structures. To advance unmanned aerial vehicle (UAV) navigation technology while accomplishing a task with economic and societal benefit, a high voltage electrical infrastructure inspection reference mission was designed. An integrated air-ground platform was developed for this mission and tested in two days of experimental flights to determine whether navigational augmentation was needed to successfully conduct a controlled inspection experiment. The airborne component of the platform was a multirotor UAV built from commercial off-the-shelf hardware and software, and the ground component was a commercial laptop running open source software. A compact ultraviolet sensor mounted on the UAV can locate 'hot spots' (potential failure points in the electric grid), so long as the UAV flight path adequately samples the airspace near the power grid structures. To improve navigation, the platform was supplemented with two navigation technologies: lidar-to-polyhedron preflight processing for obstacle demarcation and inspection distance planning, and trajectory management software to enforce inspection standoff distance. Both navigation technologies were essential to obtaining useful results from the hot spot sensor in this obstacle-rich, low-altitude airspace. Because the electrical grid extends into crowded airspaces, the UAV position was tracked with NASA unmanned aerial system traffic management (UTM) technology. The following results were obtained: (1) Inspection of high-voltage electrical transmission infrastructure to locate 'hot spots' of ultraviolet emission requires navigation methods that are not broadly available and are not needed at higher altitude flights above ground structures. (2) The sensing capability of a novel airborne UV detector was verified with a standard ground-based instrument. Flights with this sensor showed that UAV measurement operations and recording methods are viable. With improved sensor range, UAVs equipped with compact UV sensors could serve as the detection elements in a self-diagnosing power grid. (3) Simplification of rich lidar maps to polyhedral obstacle maps reduces data volume by orders of magnitude, so that computation with the resultant maps in real time is possible. This enables real-time obstacle avoidance autonomy. Stable navigation may be feasible in the GPS-deprived environment near transmission lines by a UAV that senses ground structures and compares them to these simplified maps. (4) A new, formally verified path conformance software system that runs onboard a UAV was demonstrated in flight for the first time. It successfully maneuvered the aircraft after a sudden lateral perturbation that models a gust of wind, and processed lidar-derived polyhedral obstacle maps in real time. (5) Tracking of the UAV in the national airspace using the NASA UTM technology was a key safety component of this reference mission, since the flights were conducted beneath the landing approach to a heavily used runway. Comparison to autopilot tracking showed that UTM tracking accurately records the UAV position throughout the flight path.

Moore, Andrew J.↗

'Fly Like This': Natural Language Interface for UAV Mission Planning

With the increasing presence of unmanned aerial vehicles (UAVs) in everyday environments, the user base of these powerful and potentially intelligent machines is expanding beyond exclusively highly trained vehicle operators to include non-expert system users. Scientists seeking to augment costly and often inflexible methods of data collection historically used are turning towards lower cost and reconfigurable UAVs. These new users require more intuitive and natural methods for UAV mission planning. This paper explores two natural language interfaces - gesture and speech - for UAV flight path generation through individual user studies. Subjects who participated in the user studies also used a mouse-based interface for a baseline comparison. Each interface allowed the user to build flight paths from a library of twelve individual trajectory segments. Individual user studies evaluated performance, efficacy, and ease-of-use of each interface using background surveys, subjective questionnaires, and observations on time and correctness. Analysis indicates that natural language interfaces are promising alternatives to traditional interfaces. The user study data collected on the efficacy and potential of each interface will be used to inform future intuitive UAV interface design for non-expert users.

Chandarana, Meghan↗

Small UAV Flight Planning in Urban Environments

This work proposes a fast algorithm for generating obstacle-free and wind-efficient flight paths at a constant above-ground-level altitude in urban environments because a fast flight path planning algorithm is an essential function or service needed for enabling small unmanned aerial vehicle (sUAV) to operate in urban environments within Class G airspace. The proposed method first converts the 3D path planning problem to a 2D problem by constructing an obstacle map at a given above-ground-level altitude. A quad-tree decomposition is then used to build a search space in terms of obstacle occupancy and wind difference. The wind cost of traveling through each cell is defined based on energy consumption under various wind conditions. A repulsive potential is also adopted to make sure that the flight plans stay away from obstacles. The Theta* search algorithm, a variant of A* algorithm, is applied to mitigate the path angle change constraints introduced by grid-based graphs. With the Theta* and postsmoothing techniques, an obstacle-free, wind efficient, and constant above-ground-level flight plan can be quickly generated for sUAV operations in urban environments while meeting the lateral path angle constraints. The results showed that the path planning algorithm is efficient and can be finished within several seconds. With a proper choice of wind coefficient, the proposed path planning algorithm outperforms the multiple-shooting trajectory optimization method even in an obstacle-free environment. With the flexibility of incorporating other geo-related costs and computation efficiency, the proposed algorithm shows the potential for real-time flight path planning in complex urban environments.

Path planning↗

Multi-Vehicle Cooperative Control Research at the NASA Armstrong Flight Research Center, 2000-2014

A brief introductory overview of multi-vehicle cooperative control research conducted at the NASA Armstrong Flight Research Center from 2000 - 2014. Both flight research projects and paper studies are included. Since 2000, AFRC has been almost continuously pursuing research in the areas of formation flight for drag reduction and automated cooperative trajectories. An overview of results is given, including flight experiments done on the FA-18 and with the C-17. Other multi-vehicle cooperative research is discussed, including small UAV swarming projects and automated aerial refueling.

group dynamics↗

Intelligent Control Approaches for UAVs

This talk will present overviews of various intelligent control technologies currently being developed and studied at the NASA Ames Research Center as applicable to Unmanned Aerial Vehicles (UAVs), Mars flyers, and to the next generation of flight controllers for manned aircraft. The approaches being examined include: (a) direct adaptive dynamic inverse controller, (b) adaptive critic-based optimal trajectory generator; (c) optimal allocation technique based on linear programming; (4) immunized maneuvering using autopilot building blocks. These approaches can utilize, but do not require, fault detection and isolation information. Piloted and unmanned simulation studies are performed to examine if the intelligent flight control techniques adequately: 1) match flying qualities of modem fly-by-wire flight controllers under nominal conditions; 2) improve performance under failure conditions when sufficient control authority is available; and 3) achieve intelligent maneuvering capabilities for unmanned vehicles. Results obtained so far will be presented and discussed.

KrisnaKumar, Kalmanje↗

Safety Related Considerations in Autonomy

In this talk I will describe NASA strategy and research efforts to provide safety assurance for increasingly autonomous systems used in aviation. In the near future, autonomy will play an important role in civil aviation, and its applications will range from vehicles and platforms (UAVs, transport-class, including supersonic to hypersonic, aircraft) to airspace operations, or health management systems. This infusion of autonomy is driven by a need for optimizing airspace operations to accommodate increasing traffic density (e.g., adaptive trajectory-based operations, autonomous tugs, close parallel runways, and dynamic separation assurance), reducing operation costs to ensure that US operators can compete with emergent countries, and enabling new business models (e.g., fire fighting, UAS-based package delivery and precise aerial photography). In essence virtually every component of the National Airspace System will become increasingly autonomous. Yet we need to do so in a safe manner and have techniques and processes in place to ensure the safety of the public. This talk describes NASA plans to address this problem

Air Traffic Management↗