Engineering Papers⌕ Search

Engineering topics

Thomas Lombaerts

Publications and source records attributed to Thomas Lombaerts.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Simulated Vision-based Approach and Landing System for Advanced Air Mobility

Advanced Air Mobility (AAM) aircraft require precision approach and landing systems (PALS) in several environments, such as urban, suburban, and rural. It is challenging to implement current state-of-the-art methods approved for automated approach and landing for AAM operations with challenges such as GPS degradation in urban environments and visual navigation aids like the glideslope and localizer being narrow and not allowing alternative incoming landing angles at vertiports. However, existing technology and systems, i.e., the instrument landing system (ILS) with glideslope and localizer indicators that use vision, IR, radar, or GPS methods, provide baseline perception and sensing requirements for AAM aircraft approach and landing. This paper focuses on vision-based PAL and computer vision feature correspondence methods to demonstrate a baseline navigation system while adhering to the Federal Aviation Administration requirements and regulations about heliport design (FAA AC 150/5390-2C), which is one of the closest references for vertiport requirements and regulations. The coplanar pose from orthography and scaling with iterations (COPOSIT) algorithm determines pose estimation, which feeds into an Extended Kalman filter that combines IMU with vision to create a vision-based approach and landing (VAL) sensor fusion navigation solution for GPS-denied environments. The VAL navigation solution provides promising simulation results for AAM PALS with Hough circle detection and feature correspondence, which demonstrate robustness to false positives. This paper incorporates moderately high- fidelity simulations with computer graphics rendering to show a distributed sensor network to track an AAM aircraft during approach and landing to compare with the aircraft’s onboard vision-based navigation solution.

distributed sensing↗
NASA NTRSDate not supplied

VSLAM and Vision-based Approach and Landing for Advanced Air Mobility

Advanced Air Mobility (AAM) aircraft have many challenges in landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different guidelines, landmarks, and landing light configurations at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to see landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on a vision-based precision approach and landing (PAL) by comparing ORB SLAM 2, a Vision Simultaneous Localization and Mapping (VSLAM) algorithm, and a novel EKF that combines onboard IMU measurements with coplanar pose from orthography and scaling with iterations (COPOSIT). Conducting unmanned aerial system (UAS) flight tests at NASA Armstrong Flight Research Center (AFRC) with landmarks and fiducials distributed around the landing zone provides a simulated AAM approach and landing data to test vision-based PAL methods to provide Alternative Position, Navigation, and Timing (APNT) solutions for AAM PAL applications. The novel vision-based PAL EKF with IMU and COPOSIT provides accurate state estimation when distributed landmarks and fiducials are in the field of view.

distributed sensing↗
NASA NTRSDate not supplied

A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility

As part of its research, NASA investigates concepts, aircraft, and operations related to Advanced Air Mobility (AAM). One of the most challenging scenarios for AAM will be enabling safe routine access near densely populated urban centers. AAM flight operations over a regional area require a moderately high-fidelity simulation capability to develop and evaluate autonomy technologies in the urban environment. This paper aims to describe a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (tens to hundreds of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to simulate all flight phases accurately. The simulation incorporates a detailed simulated urban environment and includes glass cockpit displays to monitor aircraft operations. Simulation models integrate to simulate air and ground-based sensors, such as Radar and LiDAR. As a commercially available rendering engine, X-Plane 11 is used as the renderer to simulate vision-based sensors (such as onboard and ground-based cameras) with a detailed graphical model of a city at different times of the day and weather conditions. This paper presents the simulation and software architecture used for simulating AAM traffic over this urban region. This system enables the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward flight test evaluation.

distributed sensing↗
NASA NTRSDate not supplied

A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility

As part of its research, NASA investigates concepts, aircraft, and operations related to Advanced Air Mobility (AAM). One of the most challenging scenarios for AAM will be enabling safe routine access near densely populated urban centers. AAM flight operations over a regional area require a moderately high-fidelity simulation capability to develop and evaluate autonomy technologies in the urban environment. This paper aims to describe a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (tens to hundreds of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to simulate all flight phases accurately. The simulation incorporates a detailed simulated urban environment and includes glass cockpit displays to monitor aircraft operations. Simulation models integrate to simulate air and ground-based sensors, such as Radar and LiDAR. As a commercially available rendering engine, X-Plane 11 is used as the renderer to simulate vision-based sensors (such as onboard and ground-based cameras) with a detailed graphical model of a city at different times of the day and weather conditions. This paper presents the simulation and software architecture used for simulating AAM traffic over this urban region. This system enables the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward flight test evaluation.

Distributed sensing↗
NASA NTRSDate not supplied

Target Tracking with Distributed Sensing and Optimal Data Migration

The paper presents an Extended Kalman Filter based framework for airborne target tracking using adaptive information fusion from multi-modal multi-rate distributed sensors network. First, the tracking algorithm execution location is determined using an optimal data migration strategy, which also computes the associated delays for each sensor data to arrive at the computing location. Next, the fast (zero-delay) sensors information is dynamically fused in the filter correction procedure at the arrival instance of each valid sensor reading. Finally, the target estimation is updated based on the valid slow (delayed) data, which are grouped according to the delay-time steps before application of the Larsen's method. This approach is applied to the synthetic sensor data generated by means of the ground based radar and camera models for the simulated target flight in Reflection simulation environment.

Distributed sensing↗
NASA NTRSDate not supplied

Target Tracking with Distributed Sensing and Optimal Data Migration

The paper presents an Extended Kalman Filter based framework for airborne target tracking using adaptive information fusion from multi-modal multi-rate distributed sensors network. First, the tracking algorithm execution location is determined using an optimal data migration strategy, which also computes the associated delays for each sensor data to arrive at the computing location. Next, the fast (zero-delay) sensors information is dynamically fused in the filter correction procedure at the arrival instance of each valid sensor reading. Finally, the target estimation is updated based on the valid slow (delayed) data, which are grouped according to the delay-time steps before application of the Larsen's method. This approach is applied to the synthetic sensor data generated by means of the ground based radar and camera models for the simulated target flight in Reflection simulation environment.

Distributed sensing↗
NASA NTRSDate not supplied

Concepts for Distributed Sensing and Collaborative Airspace Autonomy in Advanced Urban Air Mobility

Emerging concepts for advanced urban air mobility envision responsive air transportation capabilities that will safely move people and cargo in locations presently underserved by aviation. Expanding aviation services to these locales, particularly for high-density autonomous flight operations over urban centers, will require advances beyond the state-of-the-art techniques for airborne sensing. The emerging field of distributed sensing and ‘smart spaces’ – where sensing, processing, communication, and actuation are embedded in the environment in which agents are acting – may provide attractive alternatives over traditional aviation solutions. This paper outlines the challenges and opportunities for distributed sensing and smart space concepts to meet the emerging needs of advanced urban operations in the national airspace. We present an overview of distributed sensing concepts and research currently being investigated under this endeavor.

Distributed sensing↗
NASA NTRSDate not supplied

A Structurally-Adaptive Framework for Distributed Airborne Sensing over Real-time Collaborative Information Sharing Networks

The emergence and maturation of wireless communication technologies continue to transform the aviation industry and are enabling new solutions to challenges faced by NASA’s Advanced Air Mobility (AAM) initiative. AAM is leading towards high-density autonomous aircraft operations in areas underserved by traditional aviation, such as over densely populated urban centers. In this paper, we build on concepts from distributed sensing and smart spaces - where sensing, processing, and communication are embedded in an environment, and agents are operating within the space can exploit these capabilities in real-time through collaborative information sharing networks. Building from these concepts, we propose a framework to enable a dynamic, topologically-adaptive, and distributed estimation system for man-rated aviation to address challenges faced by autonomous AAM operations. This paper presents the initial concept of operations and system design for this framework, presents a mathematical formulation for abstraction of the problem, identifies requirements and constraints for operation, and presents algorithmic constructs to demonstrate operation. The initial framework design will focus on supporting precision navigation and independent surveillance supporting conformance monitoring of aircraft in airspace corridors and vertiport airspaces. Preliminary results from this framework shows promise in addressing gaps in current technologies needed to enable future AAM concepts, while promising greater capabilities, performance, robustness, and safety over current aviation systems and operations.

Distributed sensing↗
NASA NTRSDate not supplied

Hierarchical Mixture of Experts for Advanced Air Mobility Flight Phase Classification

Advanced Air Mobility (AAM) and Urban Air Mobility (UAM) operations will have numerous vehicles and aircraft flying in the airspace, which poses safety and security concerns. Commercial airlines utilize Air Traffic Management (ATM) and Air Traffic Control (ATC) for real-time monitoring, surveillance, traffic coordination, and rerouting to maintain safe and efficient flight patterns. Transferring ATM and ATC architectures to AAM/UAM will be difficult to implement since AAM/UAM aircraft fly at lower altitudes, have more static and dynamic obstacles, operate in highly dense environments, and have several more aircraft to monitor for a given volume of the national airspace (NAS). Automatic flight phase classification will enhance efficiencies of ATM/ATC-like architectures for AAM/UAM. Classifying the main flight phases (takeoff, climb, cruise, descent, and landing) provides insight to ensure safe operations, provide situational awareness of the NAS, and monitor flights in case there are any emergencies. Typical flight phase classification methods are all-or-nothing, which will not capture or accurately classify the transitions between flight phases. Utilizing hierarchical mixture of experts (HME) provides a flight phase classification solution that includes transitions between the flight phases by assigning weights based on ground-based distributed sensor readings from cameras and radar. Adding the transitions between flight phases increases the fidelity of flight phase classification and provides deeper insight for flight phase classification by leveraging distributed sensing concepts.

distributed sensing↗
NASA NTRSDate not supplied

Ground-Based Vision Tracker for Advanced Air Mobility and Urban Air Mobility

Advanced Air Mobility (AAM) Air Mobility and Urban Air Mobility (UAM) require aircraft surveillance and monitoring for safety and security. Persistent tracking of flying objects provides Air Traffic Control (ATC) and Air Traffic Management (ATM) continuous coverage and knowledge of the national airspace (NAS). Since there are numerous more AAM and UAM aircraft than commercial aircraft, it will be challenging to utilize the same ATC/ATM architectures. A first step in creating a similar ATC/ATM architecture for AAM/UAM will require ground-based and airborne-based sensors to provide monitoring, which will be difficult in urban environments due to GPS degradation. This paper proposes a vision-based tracking method with static cameras by utilizing image subtraction and blob detection, which avoids adding additional electromagnetic interferences in the environment with sensors such as radar. The ground-based vision tracker (GBVT) outputs the detected objects' azimuth and elevation angles from unmanned aerial system (UAS) flight tests. Future and ongoing work includes sending the detected objects' azimuth and elevation angles as inputs for an extended Kalman filter (EKF) to estimate the position and velocity of the detected object.

distributed sensing↗
NASA NTRSDate not supplied

Evaluation of Novel eVTOL Aircraft Automation Concepts

As new electric propulsion technologies have matured, many new electric propulsion Vertical Takeoff and Landing (eVTOL) aircraft concepts have been proposed. These new aircraft concepts enable the creation of new aviation markets including Urban Air Mobility (UAM) but also pose new challenges in safety assurance. One early challenge is the evaluation of the diverse aircraft configurations and accompanying advanced control systems and automation designed to aid controllability. This paper describes a research activity to propose candidate means of evaluation for the aircraft concepts and automation in the context of UAM operations. The research activity proposes the adaptation of an evaluation design standard used by the military for advanced rotorcraft along with proposed descriptions and definitions to support evaluation of diverse automated concepts in the civilian eVTOL community.

AAM↗
NASA NTRSDate not supplied

Assessing Performance of Radar and Visual Sensing Techniques for Ground-To-Air Surveillance in Advanced Air Mobility

The safe integration of Unmanned Aircraft Vehicles (UAV) within the civil airspace is of great interest to NASA’s Advanced Air Mobility project, which envisions high density of operations in and around urban areas that include both UAV and AAM aircraft. To enable safe autonomous operations of both platforms, reliable airspace surveillance strategies must be designed and experimentally validated in relevant scenarios, where multiple small UAV operate flying in low altitude conditions. An example of such a scenario is described in this paper which provides performance assessment of various sensing strategies experimentally tested during flight campaigns with four UAV completing simultaneous missions from vertiports. Such campaigns are performed by the High Density Vertiplex subproject which assesses a prototype of Urban Air Mobility ecosystem. For the purposes of this work, the flights are observed from multiple sensing nodes each with radar and camera sensors. The visual detection and tracking algorithms achieved 96.1% to 99.9% average tracking coverage of the UAV above the horizon, reaching detection ranges larger than 1 kilometer for octocopter. Radar-based tracking shows a lower coverage mainly due to ground clutter removal challenges but provides comparable detection ranges and meter-level range accuracy.

Federica Vitiello↗
NASA NTRSDate not supplied

Hierarchical Mixture of Experts for Advanced Air Mobility Flight Phase Classification

Advanced Air Mobility (AAM) and Urban Air Mobility (UAM) operations will have numerous vehicles and aircraft flying in the airspace, which poses safety and security concerns. Commercial airlines utilize Air Traffic Management (ATM) and Air Traffic Control (ATC) for real-time monitoring, surveillance, traffic coordination, and rerouting to maintain safe and efficient flight patterns. Transferring ATM and ATC architectures to AAM/UAM will be challenging to implement since AAM/UAM aircraft fly at lower altitudes, have more static and dynamic obstacles, operate in highly dense environments, and have several more aircraft to monitor for a given volume of the national airspace (NAS). Aircraft typically have the following flight phases: takeoff, climb, cruise, descent, and landing. Classifying these flight phases provides insight into ensuring safe operations, providing situational awareness of the NAS, and monitoring flights in emergencies. Automatic flight phase classification will enhance the efficiencies of ATM/ATC-like architectures for AAM/UAM, especially since numerous aircraft will be flying in highly dense urban environments. Typical flight phase classification methods are all-or-nothing, which will not capture or accurately classify the transitions between flight phases. Utilizing hierarchical mixture of experts (HME) provides a flight phase classification solution that includes transitions between the flight phases by assigning weights based on ground-based distributed sensor readings from cameras and radar. Adding the transitions between flight phases increases the fidelity of flight phase classification and provides deeper insight into flight phase classification by leveraging distributed sensing concepts. Simulation results and post-processed flight test results demonstrate the utility of HME for automatic and robust flight phase classification for real-time AAM operations.

distributed sensing↗
NASA NTRSDate not supplied

Ground-Based Vision Tracker for Advanced Air Mobility and Urban Air Mobility

Advanced Air Mobility (AAM) Air Mobility and Urban Air Mobility (UAM) require aircraft surveillance and monitoring for safety and security. Persistent tracking of flying objects provides Air Traffic Control (ATC) and Air Traffic Management (ATM) continuous coverage and knowledge of the national airspace system (NAS). Given the significant disparity in the number of AAM and UAM aircraft compared to commercial aircraft in the NAS, coupled with the dense AAM/UAM operations in urban environments, employing the existing ATC/ATM architectures poses considerable challenges. A first step in creating a similar ATC/ATM architecture for AAM/UAM will require ground-based and airborne-based sensors to provide monitoring, which will be difficult in urban environments due to GPS degradation. This paper proposes a vision-based tracking method with static cameras by utilizing image subtraction and blob detection, which avoids adding additional electromagnetic interferences in the environment with sensors such as radar. The ground-based vision tracker (GBVT) outputs the detected objects' azimuth and elevation angles from unmanned aerial system (UAS) flight tests. Future and ongoing work includes sending the detected objects' azimuth and elevation angles as inputs for an extended Kalman filter (EKF) to estimate the position and velocity of the detected object.

distributed sensing↗
NASA NTRSDate not supplied

Development and Field Test Results of Distributed Ground Sensor Fusion Based Object Tracking

Autonomous operations are a crucial aspect in the context of Advanced Air Mobility and other emerging aviation markets. In order to enable this autonomy, an accurate and detailed understanding of the positions of the various vehicles in the air is necessary. Full localization independent of on-board sensors makes the system suitable for noncooperative vehicles. This paper focuses on the object tracking part that relies on distributed ground-based RF and other sensor fusion, considering specific properties and limitations of different sensor types. Results show satisfactory performance in nominal scenarios with full coverage for some sensor types, but RF signals are challenging because of their nature. This paper includes the results from simulations as well as field tests to support the observations and conclusions.

sensor fusion↗
NASA NTRSDate not supplied

Experimental Testing of Data Fusion in A Distributed Ground-Based Sensing Network for Advanced Air Mobility

Advanced Air Mobility (AAM) is an active area of development which foresees the integration of autonomous uncrewed aircraft into the civil airspace for air transportation of people and cargo. Safe integration requires significant technological developments and extensive testing phases of sensing and surveillance strategies in dense airspace. Compared to well-assessed manned aviation systems scenarios, surveillance strategies in the AAM and small Uncrewed Aircraft Vehicles(UAVs) context need to detect smaller platforms flying at lower altitude against cluttered backgrounds in dense airspace. Fusion of data provided by a network of distributed sensing nodes is a powerful tool to enable detection and tracking in such complex conditions. This paper contributes to this research direction by proposing a surveillance strategy for the AAM environment based on sensor fusion of data acquired by distributed ground-based radars. Specifically, experimental data collected with two independent radars, observing the flight of two small UAVs, are used. Data fusion at tracking level is based on a leader-helper strategy where the leader radar uses the helper’s measurements to increase the lifespan of its generated tracks. This solution shows promising results with a 10%increase in track coverage with respect to the standalone leader radar tracking solution. The paper also proposes an interference removal processing method which is applied on the data collected by one of the two radars.

Federica Vitiello↗