Engineering Papers⌕ Search

Engineering topics

Nelson Brown

Publications and source records attributed to Nelson Brown.

15 records
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

A Structurally-Adaptive Framework for Distributed Airborne Sensing over Real-time Collaborative Information Sharing Networks

The emergence and maturation of wireless communication technologies continue to transform the aviation industry and are enabling new solutions to challenges faced by NASA’s Advanced Air Mobility (AAM) initiative. AAM is leading towards high-density autonomous aircraft operations in areas underserved by traditional aviation, such as over densely populated urban centers. In this paper, we build on concepts from Smart Spaces - where sensing, processing, and communication are embedded in an environment, and agents are operating within the space can exploit these capabilities in real-time through collaborative information sharing networks. Building from these concepts, we propose a framework to enable a dynamic, topologically-adaptive, and distributed estimation system for man-rated aviation to address challenges faced by autonomous AAM operations. This paper presents the initial concept of operations and system design for this framework, presents a mathematical formulation for abstraction of the problem, identifies requirements and constraints for operation, and presents algorithmic constructs and mathematical formalisms to demonstrate operation. The proposed framework will be evaluated on a regional AAM flight scenario and will focus on two initial applications: (1) GPS-free navigation supporting precision approach and landing (PAL), and (2) surveillance and conformance monitoring of aircraft in vertiport airspaces. Such approaches show promise in addressing gaps in current technologies needed to enable future AAM concepts, while promising greater capabilities, performance, robustness, and safety over current aviation systems and operations.

Structurally-Adaptive↗
NASA NTRSDate not supplied

VSLAM and Vision-based Approach and Landing for Advanced Air Mobility

Advanced Air Mobility (AAM) aircraft have many challenges in landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different guidelines, landmarks, and landing light configurations at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to see landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on a vision-based precision approach and landing (PAL) by comparing ORB SLAM 2, a Vision Simultaneous Localization and Mapping (VSLAM) algorithm, and a novel EKF that combines onboard IMU measurements with coplanar pose from orthography and scaling with iterations (COPOSIT). Conducting unmanned aerial system (UAS) flight tests at NASA Armstrong Flight Research Center (AFRC) with landmarks and fiducials distributed around the landing zone provides a simulated AAM approach and landing data to test vision-based PAL methods to provide Alternative Position, Navigation, and Timing (APNT) solutions for AAM PAL applications. The novel vision-based PAL EKF with IMU and COPOSIT provides accurate state estimation when distributed landmarks and fiducials are in the field of view.

distributed sensing↗
NASA NTRSDate not supplied

A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility

As part of its research, NASA investigates concepts, aircraft, and operations related to Advanced Air Mobility (AAM). One of the most challenging scenarios for AAM will be enabling safe routine access near densely populated urban centers. AAM flight operations over a regional area require a moderately high-fidelity simulation capability to develop and evaluate autonomy technologies in the urban environment. This paper aims to describe a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (tens to hundreds of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to simulate all flight phases accurately. The simulation incorporates a detailed simulated urban environment and includes glass cockpit displays to monitor aircraft operations. Simulation models integrate to simulate air and ground-based sensors, such as Radar and LiDAR. As a commercially available rendering engine, X-Plane 11 is used as the renderer to simulate vision-based sensors (such as onboard and ground-based cameras) with a detailed graphical model of a city at different times of the day and weather conditions. This paper presents the simulation and software architecture used for simulating AAM traffic over this urban region. This system enables the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward flight test evaluation.

distributed sensing↗
NASA NTRSDate not supplied

A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility

As part of its research, NASA investigates concepts, aircraft, and operations related to Advanced Air Mobility (AAM). One of the most challenging scenarios for AAM will be enabling safe routine access near densely populated urban centers. AAM flight operations over a regional area require a moderately high-fidelity simulation capability to develop and evaluate autonomy technologies in the urban environment. This paper aims to describe a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (tens to hundreds of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to simulate all flight phases accurately. The simulation incorporates a detailed simulated urban environment and includes glass cockpit displays to monitor aircraft operations. Simulation models integrate to simulate air and ground-based sensors, such as Radar and LiDAR. As a commercially available rendering engine, X-Plane 11 is used as the renderer to simulate vision-based sensors (such as onboard and ground-based cameras) with a detailed graphical model of a city at different times of the day and weather conditions. This paper presents the simulation and software architecture used for simulating AAM traffic over this urban region. This system enables the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward flight test evaluation.

Distributed sensing↗
NASA NTRSDate not supplied

Concepts for Distributed Sensing and Collaborative Airspace Autonomy in Advanced Urban Air Mobility

Emerging concepts for advanced urban air mobility envision responsive air transportation capabilities that will safely move people and cargo in locations presently underserved by aviation. Expanding aviation services to these locales, particularly for high-density autonomous flight operations over urban centers, will require advances beyond the state-of-the-art techniques for airborne sensing. The emerging field of distributed sensing and ‘smart spaces’ – where sensing, processing, communication, and actuation are embedded in the environment in which agents are acting – may provide attractive alternatives over traditional aviation solutions. This paper outlines the challenges and opportunities for distributed sensing and smart space concepts to meet the emerging needs of advanced urban operations in the national airspace. We present an overview of distributed sensing concepts and research currently being investigated under this endeavor.

Distributed sensing↗
NASA NTRSDate not supplied

A Structurally-Adaptive Framework for Distributed Airborne Sensing over Real-time Collaborative Information Sharing Networks

The emergence and maturation of wireless communication technologies continue to transform the aviation industry and are enabling new solutions to challenges faced by NASA’s Advanced Air Mobility (AAM) initiative. AAM is leading towards high-density autonomous aircraft operations in areas underserved by traditional aviation, such as over densely populated urban centers. In this paper, we build on concepts from distributed sensing and smart spaces - where sensing, processing, and communication are embedded in an environment, and agents are operating within the space can exploit these capabilities in real-time through collaborative information sharing networks. Building from these concepts, we propose a framework to enable a dynamic, topologically-adaptive, and distributed estimation system for man-rated aviation to address challenges faced by autonomous AAM operations. This paper presents the initial concept of operations and system design for this framework, presents a mathematical formulation for abstraction of the problem, identifies requirements and constraints for operation, and presents algorithmic constructs to demonstrate operation. The initial framework design will focus on supporting precision navigation and independent surveillance supporting conformance monitoring of aircraft in airspace corridors and vertiport airspaces. Preliminary results from this framework shows promise in addressing gaps in current technologies needed to enable future AAM concepts, while promising greater capabilities, performance, robustness, and safety over current aviation systems and operations.

Distributed sensing↗
NASA NTRSDate not supplied

Visual and Inertial Datasets for an eVTOL Aircraft Approach and Landing Scenario

A National Aeronautics and Space Administration (NASA) project developing computer vision algorithms for autonomous flight is producing real-world datasets with cameras mounted on aircraft. In related domains, such as autonomous driving, open datasets are key to innovation and advancement in computer vision and autonomous perception for future Advanced Air Mobility (AAM) operations. Few vision datasets, however, are publicly available in the aviation context. This paper introduces preliminary datasets containing several examples of approach and landing scenarios. The platform aircraft include a multirotor small unmanned aerial system (sUAS) and a crewed helicopter as surrogates for future electric vertical take-off and landing (eVTOL) aircraft. The dataset provides video imagery with associated inertial navigation system-global positioning system (INS-GPS) position and attitude estimates and other sensors. Surveyed locations of the visual features of the landing area are included. This dataset is the first to be released in an ongoing effort to collect and share large, diverse datasets relevant to autonomous aviation; community critique that can inform and improve future flight campaigns is welcome.

Nelson Brown↗
NASA NTRSDate not supplied

Computer Vision Dataset for Aircraft Taxi Operations

The development and democratization of computer vision algorithms are contingent on the availability of high-quality datasets. In this paper, we introduce a database of forward-facing videos from taxiing aircraft as well as the time-correlated flight data at approximately 1 to10 Hz containing aircraft state data and environmental conditions. The video data is sourced from the National Aeronautics and Space Administration Airborne Science Program archive and includes over 33 hours of 4k, 1080p, and 720p video from twenty-two airports around the world. This paper describes the method of the database construction and a brief analysis of its contents.

Ryan Horn↗
NASA NTRSDate not supplied

Enabling Smart Urban Airspaces through Distributed Sensing Technologies

Distributed sensing systems offer potential for enhancing safety and efficiency in urban airspaces and low-altitude metropolitan flight corridors. These systems leverage sensor networks to provide real-time airspace monitoring, situational awareness, and data for decision-making. This paper examines application of distributed sensing and smart airspace concepts to enable advanced urban flight, focusing on critical need applications such as airspace monitoring, corridor surveillance, precision navigation, and hazard avoidance. Benefits such as improved monitoring and increased situational awareness of activity within the urban airspace are considered alongside challenges in system design and implementation. This paper summarizes an ongoing effort to study the feasibility and effectiveness of distributed sensing systems for enabling urban airspace operations. Current research and design considerations are summarized, and a proposed roadmap for future work is presented.

Corey A Ippolito↗
NASA NTRSDate not supplied

Vision-Based Distributed Sensing at Vertiports for Advanced Air Mobility and Urban Air Mobility Approach and Landing

Advanced Air Mobility (AAM) encompasses a broad vision for air transportation, including Urban Air Mobility (UAM) as a subset. AAM aims to create a more connected and efficient transportation network across various geographical settings. However, navigating AAM aircraft in GPS-denied or degraded environments during approach and landing is challenging. Traditional vision aids like glideslopes and localizers are limited in vertiport environments due to narrow beam constraints and reduced landing angle options. This paper addresses the need for accurate navigation solutions at vertiports by proposing a vision-based distributed sensing (VIDIS) system utilizing cameras with bundle adjustment to assist incoming AAM aircraft during approach and landing while monitoring surface movements to enhance safety and efficiency. Key focus areas for current and future vertiport developers include identifying suitable sensor types and infrastructure standards to support AAM operations and including vertiport markings as vision-based navigation aids. The proposed system offers a novel approach to overcoming navigation challenges in AAM operations, particularly in urban settings where traditional aids may be insufficient. Preliminary simulation results with distributed cameras demonstrate promising outcomes for implementing bundle adjustment techniques to enhance vision-based navigation solutions at vertiports. Generating waypoint-based trajectories via waypoint integration using explicit guidance synthesis (WINGS) creates smooth AAM trajectories for landing at vertiports by using the current waypoint's terminal conditions as the initial conditions for the next waypoint. Combining bundle adjustment's ground-based solution of vertiport features with WINGS, Coplanar Pose from Orthography and Scaling with Iterations (COPOSIT), and an extended Kalman filter (EKF) estimates the state of an incoming aircraft during approach and landing at vertiports. Future work includes testing VIDIS in a high-fidelity simulation and with real-world data.

Distributed sensing↗
NASA NTRSDate not supplied

Vision-Based Distributed Sensing at Vertiports for Advanced Air Mobility and Urban Air Mobility Approach and Landing

Advanced Air Mobility (AAM) encompasses a broad vision for air transportation, including Urban Air Mobility (UAM) as a subset. AAM aims to create a more connected and efficient transportation network across various geographical settings. However, navigating AAM aircraft in GPS-denied or degraded environments during approach and landing is challenging. Traditional vision aids like glideslopes and localizers are limited in vertiport environments due to narrow beam constraints and reduced landing angle options. This paper addresses the need for accurate navigation solutions at vertiports by proposing a vision-based distributed sensing (VIDIS) system utilizing cameras with bundle adjustment to assist incoming AAM aircraft during approach and landing while monitoring surface movements to enhance safety and efficiency. Key focus areas for current and future vertiport developers include identifying suitable sensor types and infrastructure standards to support AAM operations and including vertiport markings as vision-based navigation aids. The proposed system offers a novel approach to overcoming navigation challenges in AAM operations, particularly in urban settings where traditional aids may be insufficient. Preliminary simulation results with distributed cameras demonstrate promising outcomes for implementing bundle adjustment techniques to enhance vision-based navigation solutions at vertiports. Generating waypoint-based trajectories via waypoint integration using explicit guidance synthesis (WINGS) creates smooth AAM trajectories for landing at vertiports by using the current waypoint's terminal conditions as the initial conditions for the next waypoint. Combining bundle adjustment's ground-based solution of vertiport features with WINGS, Coplanar Pose from Orthography and Scaling with Iterations (COPOSIT), and an extended Kalman filter (EKF) estimates the state of an incoming aircraft during approach and landing at vertiports. Future work includes testing VIDIS in a high-fidelity simulation and with real-world data.

Distributed sensing↗