Engineering Papers⌕ Search

Engineering topics

Evan Kawamura

Publications and source records attributed to Evan Kawamura.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2025

Considerations for Optimal Sensor Placement for Higher Accuracy Object Localization for Urban Air Mobility

Previous research into object localization has shown that sensor placement and alignment plays an important role in achieving higher accuracy levels of the estimated location of a tracked Urban Air Mobility Vehicle. In general, a near-orthogonal intersection between the ground node observation vectors results in the highest accuracy due to a smaller overlapping uncertainty region between both. This applies to triangulation by means of ground node camera angle observations as well as trilateration by means of ground node distance measurements. However, this simple concept is not easily fulfilled with a network of a limited number of static ground nodes and a moving object to be localized. This case study performs sensitivity analyses and explores practical ways on how to achieve higher estimate accuracy levels in this context.

sensor placement↗
NASA NTRS2024

Distributed Sensor Fusion of Ground and Air Nodes Using Vision and Radar Modalities for Tracking Multirotor Small Uncrewed Air Systems and Birds

High-density airspace operations with multiple aircraft type and potentially noncooperative aircraft require distributed sensor detection and tracking systems to monitor airspace for safe, autonomous flight operations for advanced air mobility, urban air mobility, and high density small uncrewed air systems (SUAS) flight concepts. This work collected data using a distributed radar and camera sensor framework during the NASA Advanced Air Mobility High Density Vertiplex project SUAS flight operation. Node locations include on an onboard SUAS, affixed to the Landing and Impact Research Facility with approximate 200ft elevation, on a tripod on first-floor roof with an approximate elevation of 20 ft, and on a tripod on a concrete pad that is approximately 4 ft above sea level. Each node includes camera, radar, and GPS.

Beyond Visual Line of Sight↗
NASA NTRS2023

Distributed Ground Sensor Fusion Based Object Tracking for Autonomous Advanced Air Mobility Operations

Autonomous operations are a crucial aspect in the context of Advanced Air Mobility and other emerging aviation markets. In order to enable this autonomy, an accurate and detailed understanding of the positions of the various vehicles in the air is necessary. Full localization independent of on-board sensors makes the system suitable for noncooperative vehicles. This paper focuses on the object tracking part that relies on distributed ground-based sensor fusion, considering specific properties and limitations of different sensor types. Results show satisfactory performance in nominal scenarios with full coverage. Dropouts of individual sensors affect the accuracy of the tracking results, which agrees with expectations for partial coverage, when full localization is not achievable anymore. Finally, a study is performed to identify which parameters have the largest impact on the fit error.

Autonomous↗
NASA NTRS2022

Vision-Based Precision Approach and Landing for Advanced Air Mobility

Advanced Air Mobility (AAM) aircraft require perception systems for precision approach and landing systems (PALS) in urban, suburban, rural, and regional environments. The current state-of-the-art methods approved for automated approach and landing will be difficult to utilize in support of AAM operational concepts. However, there are technology and systems from other applications and lower-TRL research that use vision, IR, radar, and GPS methods to provide baseline perception and sensing requirements for AAM aircraft approach and landing. This paper focuses on vision-based PAL to demonstrate a closed-loop baseline controller while adhering to the Federal Aviation Administration requirements and regulations. The coplanar algorithm determines pose estimation, which feeds into an Extended Kalman filter. Combining IMU with vision creates a sensor fusion navigation solution for GPS-denied environments. The state estimate leads to glideslope and localizer error computations, which will be pertinent for designing and deriving guidance laws and control laws for AAM PALS. The IMU and vision navigation solution provides promising simulation results for AAM PALS, and higher fidelity simulations will include computer graphics rendering and feature correspondence.

Evan Kawamura↗
NASA NTRS2019

NASA Ames Research Center SAFE50 Team - LIDAR test 6.24.19

The DJI M600 has been mounted onto a vehicle. With a trail care monitoring from behind, the vehicle completed a journey around the center. This ultimately will lead to the DJI M600 autonomous flight test. Note: Video does not contain sound, run time of 4:23.

Corey Ippolito↗
NASA NTRSDate not supplied

Ground to Air Testing of a Fused Optical-Radar Aircraft Detection and Tracking System

Onboard detection and tracking capability are integral to the sensing component in collision avoidance systems needed to safely operate autonomous urban air taxis and small Unmanned Aircraft Systems. Ground-based validation of detection and tracking systems is an important milestone towards the end goal of real-time collision avoidance using onboard sensors and algorithms. In this work, we evaluate three Extended Kalman Filter(EKF)based fusion trackers with radar and vision detection inputs, and compare them with baseline trackers for each sensor type. Performance is assessed using field collected data of ground to air test flights with the sensors co-located on a stable platform with an instrumented multirotor acting as the intruder performing a waypoint pattern at a distance of1.1km to 0.3km to simulate a head-on collision geometry. Fusing an image-based morphological detector with a radar detector using an EKF covered 74% of the ground truth position updates logged by the flight controller on the multirotor within 50 meters after accounting for alignment offsets while covering 15% more ground truth updates relative to radar only. Removing timestamps when the intruder aircraft is occluded by trees and only considering timestamps where the radar has an update, the EKF image-based morphological detector combined with the radar detector covered 90% of the of the ground truth position updates within 50metersand 97% within 100 meters.

Chester V Dolph↗
NASA NTRSDate not supplied

VSLAM and Coplanar POSIT for Advanced Air Mobility Approach and Landing

Advanced Air Mobility (AAM) aircraft have many challenges for landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different types of guidelines and landmarks at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to detect landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on vision-based precision approach and landing (PAL) and builds on previous work by comparing ORB SLAM, custom VSLAM, and coplanar pose from orthography and scaling with iterations (POSIT) for daytime and nighttime operations. Implementing high fidelity simulations with computer graphics and extracting video frames from flight test data provide promising results for AAM PAL applications.

Evan Kawamura↗
NASA NTRSDate not supplied

Distributed Sensing and Computer Vision Methods for Advanced Air Mobility Approach and Landing

Advanced Air Mobility (AAM) aircraft require precision approach and landing systems (PALS) in several types of environments such as urban, suburban, and rural. It is difficult to implement current state-of-the-art methods approved for automated approach and landing for AAM operations. However, existing technology and systems that use vision, IR, radar, and GPS methods provide baseline perception and sensing requirements for AAM aircraft approach and landing. This paper focuses on vision-based PAL and computer vision feature correspondence methods to demonstrate a baseline navigation system while adhering to the Federal Aviation Administration requirements and regulations. The coplanar algorithm determines pose estimation, which feeds into an Extended Kalman filter that combines IMU with vision to create a sensor fusion navigation solution for GPS-denied environments. The state estimate leads to glideslope and localizer error computations, which will be pertinent for designing and deriving guidance laws and control laws for AAM PALS. The IMU and vision navigation solution provides promising simulation results for AAM PALS. This paper builds on previous work by incorporating high fidelity simulations with computer graphics rendering to demonstrate a distributed sensor network to track an AAM aircraft during approach and landing to compare with the aircraft's onboard navigation solution.

Evan Kawamura↗
NASA NTRSDate not supplied

A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility

NASA is conducting investigations into Advanced Air Mobility (AAM) concepts, aircraft, and operations. One of the most challenging scenarios for AAM will be enabling safe routine access into densely populated urban centers. To address challenges in the urban environment, a moderately high-fidelity simulation capability is needed to investigate AAM flight operations over a regional area for the development and evaluation of autonomy technologies. This paper describes a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (10's-100's of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to accurately simulate all phases of flight. Glass cockpit displays have been developed for monitoring aircraft operation over a detailed simulated urban environment. Simulation models have been integrated to simulate air and ground-based sensors, such as radar and LIDAR. The commercial X-Plane software package is used as a rendering engine to mimic vision-based sensors (such as onboard and ground-based cameras) at various times of day and in various weather conditions over a relatively detailed graphical model of the city. The paper presents a detailed illustration of the simulation and software architecture used for traffic over this urban region. This system is enabling the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward aircraft flight test evaluation.

Keerthana Kannan↗
NASA NTRSDate not supplied

A Structurally-Adaptive Framework for Distributed Airborne Sensing over Real-time Collaborative Information Sharing Networks

The emergence and maturation of wireless communication technologies continue to transform the aviation industry and are enabling new solutions to challenges faced by NASA’s Advanced Air Mobility (AAM) initiative. AAM is leading towards high-density autonomous aircraft operations in areas underserved by traditional aviation, such as over densely populated urban centers. In this paper, we build on concepts from Smart Spaces - where sensing, processing, and communication are embedded in an environment, and agents are operating within the space can exploit these capabilities in real-time through collaborative information sharing networks. Building from these concepts, we propose a framework to enable a dynamic, topologically-adaptive, and distributed estimation system for man-rated aviation to address challenges faced by autonomous AAM operations. This paper presents the initial concept of operations and system design for this framework, presents a mathematical formulation for abstraction of the problem, identifies requirements and constraints for operation, and presents algorithmic constructs and mathematical formalisms to demonstrate operation. The proposed framework will be evaluated on a regional AAM flight scenario and will focus on two initial applications: (1) GPS-free navigation supporting precision approach and landing (PAL), and (2) surveillance and conformance monitoring of aircraft in vertiport airspaces. Such approaches show promise in addressing gaps in current technologies needed to enable future AAM concepts, while promising greater capabilities, performance, robustness, and safety over current aviation systems and operations.

Structurally-Adaptive↗
NASA NTRSDate not supplied

Simulated Vision-based Approach and Landing System for Advanced Air Mobility

Advanced Air Mobility (AAM) aircraft require precision approach and landing systems (PALS) in several environments, such as urban, suburban, and rural. It is challenging to implement current state-of-the-art methods approved for automated approach and landing for AAM operations with challenges such as GPS degradation in urban environments and visual navigation aids like the glideslope and localizer being narrow and not allowing alternative incoming landing angles at vertiports. However, existing technology and systems, i.e., the instrument landing system (ILS) with glideslope and localizer indicators that use vision, IR, radar, or GPS methods, provide baseline perception and sensing requirements for AAM aircraft approach and landing. This paper focuses on vision-based PAL and computer vision feature correspondence methods to demonstrate a baseline navigation system while adhering to the Federal Aviation Administration requirements and regulations about heliport design (FAA AC 150/5390-2C), which is one of the closest references for vertiport requirements and regulations. The coplanar pose from orthography and scaling with iterations (COPOSIT) algorithm determines pose estimation, which feeds into an Extended Kalman filter that combines IMU with vision to create a vision-based approach and landing (VAL) sensor fusion navigation solution for GPS-denied environments. The VAL navigation solution provides promising simulation results for AAM PALS with Hough circle detection and feature correspondence, which demonstrate robustness to false positives. This paper incorporates moderately high- fidelity simulations with computer graphics rendering to show a distributed sensor network to track an AAM aircraft during approach and landing to compare with the aircraft’s onboard vision-based navigation solution.

distributed sensing↗
NASA NTRSDate not supplied

VSLAM and Vision-based Approach and Landing for Advanced Air Mobility

Advanced Air Mobility (AAM) aircraft have many challenges in landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different guidelines, landmarks, and landing light configurations at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to see landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on a vision-based precision approach and landing (PAL) by comparing ORB SLAM 2, a Vision Simultaneous Localization and Mapping (VSLAM) algorithm, and a novel EKF that combines onboard IMU measurements with coplanar pose from orthography and scaling with iterations (COPOSIT). Conducting unmanned aerial system (UAS) flight tests at NASA Armstrong Flight Research Center (AFRC) with landmarks and fiducials distributed around the landing zone provides a simulated AAM approach and landing data to test vision-based PAL methods to provide Alternative Position, Navigation, and Timing (APNT) solutions for AAM PAL applications. The novel vision-based PAL EKF with IMU and COPOSIT provides accurate state estimation when distributed landmarks and fiducials are in the field of view.

distributed sensing↗
NASA NTRSDate not supplied

A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility

As part of its research, NASA investigates concepts, aircraft, and operations related to Advanced Air Mobility (AAM). One of the most challenging scenarios for AAM will be enabling safe routine access near densely populated urban centers. AAM flight operations over a regional area require a moderately high-fidelity simulation capability to develop and evaluate autonomy technologies in the urban environment. This paper aims to describe a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (tens to hundreds of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to simulate all flight phases accurately. The simulation incorporates a detailed simulated urban environment and includes glass cockpit displays to monitor aircraft operations. Simulation models integrate to simulate air and ground-based sensors, such as Radar and LiDAR. As a commercially available rendering engine, X-Plane 11 is used as the renderer to simulate vision-based sensors (such as onboard and ground-based cameras) with a detailed graphical model of a city at different times of the day and weather conditions. This paper presents the simulation and software architecture used for simulating AAM traffic over this urban region. This system enables the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward flight test evaluation.

distributed sensing↗
NASA NTRSDate not supplied

Comparison of Visual and LiDAR SLAM Algorithms using NASA Flight Test Data

Simultaneous Localization and Mapping (SLAM) is a promising technique that provides localization information and precise mapping of the physical environment without having much prior knowledge of the surroundings. SLAM may have a vital role in aeronautics and aerospace, where vehicles and aircraft must operate in complex environments with traditional localization services that may be degraded or unavailable. This paper compares several pre-canned 3D SLAM algorithms based on vision and LiDAR, namely ORB-SLAM, ORB-SLAM2, LOAM, A-LOAM, and F-LOAM on NASA UAS (Unmanned Aircraft System) flight test data. The NASA ARC UAS flight test demonstrates preliminary SLAM algorithm results, which serve as a stepping stone to simulated AAM (Advanced Air Mobility) concepts. Conducting AFRC UAS flight test for simulated AAM approach and landing with SLAM algorithms provides an Alternative Precision Navigation and Timing solution based on distributed landmarks and fiducials in the landing zone. These algorithms use the telemetry data as ground truth for a baseline comparison. The criteria of the performance comparison include robustness, accuracy, re-localization, response to environmental changes, and real-time effectiveness, which are currently qualitative but to be quantitative in the future.

computer vision↗