Contextual Segmentation of Fire Spotting Regions Through Satellite-Augmented Autonomous Modular Sensor Imagery
Explore the source record for details and available documents.
Nikhil Swaminathan Behari↗
Engineering topics
Corey A Ippolito
Publications and source records attributed to Corey A Ippolito.
Scalable Traffic Management for Emergency Response Operations (STEReO)
Overview presentation of NASA's Scalable Traffic Management for Emergency Response Operations (STEReO) project.
Scalable Traffic Management for Emergency Response↗
Wildfire monitoring using Unmanned Aerial Vehicles operating under UTM (STEReO)
STEReO (Scalable Traffic Management for Emergency Response Operations) project at NASA Ames is designed to provide UTM (UAS Traffic Management) services to unmanned aerial vehicles (UAVs) used for natural disaster response scenarios like wildfire and hurricanes. This will facilitate the use of unmanned aerial vehicles in regions where UAVs are currently prohibited to fly. In this paper we describe a complete architecture of using UAVs for wild fire monitoring in this STEReO environment. We simulate a complete fire monitoring scenario in an high fidelity simulation environment. The simulation consists of a fire drill in the vicinity of Redding airport, one of the test sites for CAL-FIRE. The autonomous vehicle connects to the STEReO systems and gathers information of other operation in the vicinity. The vehicle then uses on-board path planners and decision making algorithms for fire monitoring and mapping. In this paper the vehicle on-board architecture is described in details and the requirements to fly and interact with the STEReO system is discussed.
UAV UTM↗
Pursuit-Evasion Game approach to Tree-Based Path Planning for Airborne Dynamic Obstacle Avoidance
Explore the source record for details and available documents.
Sense and avoid↗
Advanced Airborne Autonomy for Urban Flight Operations
Summary of research conducted under the Unmanned Aircraft Systems (UAS) Traffic Management (UTM) project involving airborne autonomy to enable high-density urban operations for UAS.
UTM↗
Overview of Perception and Distributed Sensing Activity
Presentation summary for the Perception and Distributed Sensing project activity under NASA's TTT project.
Perception↗
VSLAM and Coplanar POSIT for Advanced Air Mobility Approach and Landing
Advanced Air Mobility (AAM) aircraft have many challenges for landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different types of guidelines and landmarks at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to detect landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on vision-based precision approach and landing (PAL) and builds on previous work by comparing ORB SLAM, custom VSLAM, and coplanar pose from orthography and scaling with iterations (POSIT) for daytime and nighttime operations. Implementing high fidelity simulations with computer graphics and extracting video frames from flight test data provide promising results for AAM PAL applications.
Evan Kawamura↗
Distributed Sensing and Computer Vision Methods for Advanced Air Mobility Approach and Landing
Advanced Air Mobility (AAM) aircraft require precision approach and landing systems (PALS) in several types of environments such as urban, suburban, and rural. It is difficult to implement current state-of-the-art methods approved for automated approach and landing for AAM operations. However, existing technology and systems that use vision, IR, radar, and GPS methods provide baseline perception and sensing requirements for AAM aircraft approach and landing. This paper focuses on vision-based PAL and computer vision feature correspondence methods to demonstrate a baseline navigation system while adhering to the Federal Aviation Administration requirements and regulations. The coplanar algorithm determines pose estimation, which feeds into an Extended Kalman filter that combines IMU with vision to create a sensor fusion navigation solution for GPS-denied environments. The state estimate leads to glideslope and localizer error computations, which will be pertinent for designing and deriving guidance laws and control laws for AAM PALS. The IMU and vision navigation solution provides promising simulation results for AAM PALS. This paper builds on previous work by incorporating high fidelity simulations with computer graphics rendering to demonstrate a distributed sensor network to track an AAM aircraft during approach and landing to compare with the aircraft's onboard navigation solution.
Evan Kawamura↗
A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility
NASA is conducting investigations into Advanced Air Mobility (AAM) concepts, aircraft, and operations. One of the most challenging scenarios for AAM will be enabling safe routine access into densely populated urban centers. To address challenges in the urban environment, a moderately high-fidelity simulation capability is needed to investigate AAM flight operations over a regional area for the development and evaluation of autonomy technologies. This paper describes a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (10's-100's of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to accurately simulate all phases of flight. Glass cockpit displays have been developed for monitoring aircraft operation over a detailed simulated urban environment. Simulation models have been integrated to simulate air and ground-based sensors, such as radar and LIDAR. The commercial X-Plane software package is used as a rendering engine to mimic vision-based sensors (such as onboard and ground-based cameras) at various times of day and in various weather conditions over a relatively detailed graphical model of the city. The paper presents a detailed illustration of the simulation and software architecture used for traffic over this urban region. This system is enabling the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward aircraft flight test evaluation.
Keerthana Kannan↗
Applications of Advanced Perception and Distributed Sensing Technology towards Autonomous Advanced Air Mobility Applications
Emerging concepts for Advanced Air Mobility (AAM) envisions responsive air transportation capabilities that can safely move people and cargo between places - including local, regional, intraregional, and urban - previously not served or underserved by aviation. Expanding traditional aviation services to these environments, particularly when autonomous operations are involved, face a number of challenges that will require advances beyond the state-of-the-art techniques for airborne sensing and perception, which goes beyond the limits of scalability and applicability of the current air transportation system infrastructure. Additionally, the emerging field of distributed sensing and ‘smart spaces’– where sensing, processing, communication, and actuation are embedded in the environment in which agents are acting and can be exploited by the agents through real-time wireless communication – may provide realistic near-time solutions to limitations imposed by traditional aviation techniques. This paper outlines the needs, challenges, and opportunities for advanced perception and distributed sensing techniques to meet the emerging needs for advanced AAM operations in the national airspace. A general roadmap for research, development, and maturation of perception and distributed sensing (P&DS) technologies is proposed to guide future development through verification, validation, certification into airborne systems. Through this analysis of challenges and the proposed roadmap for technology maturation, we hope to accelerate transition of advanced research techniques from other disciplines into this domain.
Autonomy↗
A Structurally-Adaptive Framework for Distributed Airborne Sensing over Real-time Collaborative Information Sharing Networks
The emergence and maturation of wireless communication technologies continue to transform the aviation industry and are enabling new solutions to challenges faced by NASA’s Advanced Air Mobility (AAM) initiative. AAM is leading towards high-density autonomous aircraft operations in areas underserved by traditional aviation, such as over densely populated urban centers. In this paper, we build on concepts from distributed sensing and smart spaces - where sensing, processing, and communication are embedded in an environment, and agents are operating within the space can exploit these capabilities in real-time through collaborative information sharing networks. Building from these concepts, we propose a framework to enable a dynamic, topologically-adaptive, and distributed estimation system for man-rated aviation to address challenges faced by autonomous AAM operations. This paper presents the initial concept of operations and system design for this framework, presents a mathematical formulation for abstraction of the problem, identifies requirements and constraints for operation, and presents algorithmic constructs to demonstrate operation. The initial framework design will focus on supporting precision navigation and independent surveillance supporting conformance monitoring of aircraft in airspace corridors and vertiport airspaces. Preliminary results from this framework shows promise in addressing gaps in current technologies needed to enable future AAM concepts, while promising greater capabilities, performance, robustness, and safety over current aviation systems and operations.
Distributed sensing↗
Sensing Small Uncrewed Aerial Vehicles with Distributed Radars for Advanced Air Mobility Surveillance
In the context of Advanced and Urban Air Mobility major attention is being reserved to the development of sensing strategies for small Uncrewed Aerial Vehicles (sUAVs) to enable their safe operations in and around urban areas. Such strategies should rely on non-cooperative distributed sensors to strengthen the surveillance solution towards the unreliability of Global Navigation Satellite System (GNSS) positioning information, which is typical for low-altitude-flying platforms in urban regions, and increase the monitored airspace volume. To this aim, this paper proposes a fusion solution for a network of distributed ground-based radars, which can be exploited to not only increase the coverage over large airspace volumes but also improve the overall detectability and traceability of sUAVs by leveraging on multiple views over the same area. The solution exploits a centralized fusion scheme in which measurements collected by each radar are shared with a Fusion Center where Kalman Filtering is exploited to build a unique, fused track. Tests conducted on experimental data collected using two sUAVs as flying targets and three distributed radars showed that the proposed solution can produce an increase in coverage from about 20 % (single radar configuration) to about 80 % of the targets’ flight path, as well as a finer accuracy yielding meter and meter-per-second root mean square error values on position and velocity components.
Federica Vitiello↗
Enabling Smart Urban Airspaces through Distributed Sensing Technologies
Distributed sensing systems offer potential for enhancing safety and efficiency in urban airspaces and low-altitude metropolitan flight corridors. These systems leverage sensor networks to provide real-time airspace monitoring, situational awareness, and data for decision-making. This paper examines application of distributed sensing and smart airspace concepts to enable advanced urban flight, focusing on critical need applications such as airspace monitoring, corridor surveillance, precision navigation, and hazard avoidance. Benefits such as improved monitoring and increased situational awareness of activity within the urban airspace are considered alongside challenges in system design and implementation. This paper summarizes an ongoing effort to study the feasibility and effectiveness of distributed sensing systems for enabling urban airspace operations. Current research and design considerations are summarized, and a proposed roadmap for future work is presented.
Corey A Ippolito↗