Engineering Papers⌕ Search

Engineering topics

Brockers, Roland

Publications and source records attributed to Brockers, Roland.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Optimizing Terrain Mapping and Landing Site Detection for Autonomous UAVs

The next generation of Mars rotorcrafts requires on-board autonomous hazard avoidance landing. To this end, this work proposes a system that performs continuous multi- resolution height map reconstruction and safe landing spot detection. Structure-from-Motion measurements are aggregated in a pyramid structure using a novel Optimal Mixture of Gaus- sians formulation that provides a comprehensive uncertainty model. Our multiresolution pyramid is built more efficiently and accurately than past work by decoupling pyramid filling from the measurement updates of different resolutions.To detect the safest landing location, after an optimized hazard segmentation, we use a mean shift algorithm on multiple distance transform peaks to account for terrain roughness and uncertainty. The benefits of our contributions are evaluated on real and synthetic flight data.

Brockers, Roland↗
NASA NTRS2022

On-board Absolute Localization Based on Orbital Imagery for a Future Mars Science Helicopter

Future Mars Rotorcraft require advanced navigationcapabilities to enable all terrain access over long distance flightsthat are executed fully autonomously. A critical component toenable precision navigation during long traverses is the abilityto perform on-board absolute localization to eliminate drift inposition estimates of the on-board odometry algorithm. Inthis paper, we present an approach for on-board map-basedlocalization to provide global reference position based on orbitalor aerial image maps. Our approach builds on a vision-basedlocalization method to localize against a map derived fromHiRISE image products – an ortho-projected image (orthoimage) and a corresponding digital elevation map. The mapis pre-computed using a feature-based approach. Features arestored with their 3D world coordinates, and a descriptor to codethe local image intensity information in the vicinity of the featurelocation. An on-board matching algorithm uses this informationto match visual features in a query image acquired during flight,guided by a pose prior from the on-board range-visual-inertialstate estimator (Range-VIO). Valid matches are then used bya perspective-n-point (PnP) algorithm to estimate the absolutepose of the vehicle in a global frame. We demonstrate andevaluate our approach on simulated data, and data from UASflights.

Balaram, J. Bob↗
NASA NTRS2022

Mid-Air Helicopter Delivery at Mars Using a Jetpack

Mid-Air Helicopter Delivery (MAHD) is a new Entry, Descent and Landing (EDL) architecture to enable in situ mobility for Mars science at lower cost than previous rover missions. It uses a jetpack to slow down a Mars Science Helicopter (MSH) after separation from the backshell, and reach aerodynamic conditions suitable for helicopter take-off in mid air. MAHD's lander-free approach leaves enough room in the aeroshell to accommodate larger rotors. This drastically improves flight performance compared to heritage EDL approaches, notably +60\% science payload mass. MAHD also brings cost savings, a simpler architecture, improved surface access and can reach higher elevations on Mars. This paper introduces a design for the MAHD system architecture and operations. We present a mechanical configuration which fits both MSH and the jetpack within the 2.65-m Mars heritage aeroshell, and a jetpack control architecture which fully leverages the available helicopter avionics. We discuss preliminary numerical models of the flow dynamics resulting from the interaction between the jets, the rotors and the side winds. We define a force-torque sensing architecture capable of handling the wind and trimming the rotors to prepare for safe take-off. Finally, we analyze the dynamic environment and closed-loop control simulation results to demonstrate the preliminary feasibility of MAHD.

Balaram, J.↗
NASA NTRS2021

Multi-Resolution Elevation Mapping and Safe Landing Site Detection with Applications to Planetary Rotorcraft

In this paper, we propose a resource-efficient approach to provide an autonomous UAV with an on-board perception method to detect safe, hazard-free landing sites during flights over complex 3D terrain. We aggregate 3D measurements acquired from a sequence of monocular images by a Structure-from-Motion approach into a local, robot-centric, multi-resolution elevation map of the overflown terrain, which fuses depth measurements according to their lateral surface resolution (pixel-footprint) in a probabilistic framework based on the concept of dynamic Level of Detail. Map aggregation only requires depth maps and the associated poses, which are obtained from an on-board Visual Odometry algorithm. An efficient landing site detection method then exploits the features of the underlying multi-resolution map to detect safe landing sites based on the slope, roughness, and quality of the reconstructed terrain surface. The evaluation of the performance of the mapping and landing site detection modules are analyzed independently and jointly in simulated and realworld experiments in order to establish the efficacy of the proposed approach.

Brockers, Roland↗
NASA NTRS2021

Mid-Air Range-Visual-Inertial Estimator Initialization for Micro Air Vehicles

Monocular Visual-Inertial Odometry (VIO) has become ubiquitous for navigation of autonomous Micro Air Vehicles (MAVs). Yet, state-of-the-art VIO is still very failure- prone, which can have dramatic consequences. To prevent this, VIO must be able to re-initialize in mid-air, either during a free fall or on a constant horizontal velocity trajectory after attitude control has been re-established. However, for both of these trajectories, the visual scale cannot be observed with VIO batch initializers because of the absence of acceleration change. We propose to use a small and lightweight laser range finder and a scene facet model to initialize vision-based navigation at the right scale under any motion condition and over any scene structure. This new range constraint is integrated into a visual-inertial bundle adjustment initializer. We demonstrate in simulation and real data how this approach can address mid-air state estimation failure in real-time and analyze the sensitivity of estimators to initial state errors.

Brockers, Roland↗
NASA NTRS2021

Autonomous Safe Landing Site Detection for a FutureMars Science Helicopter

Future Mars Rotorcrafts require advanced navigation capabilities to enable all terrain access for science investigations with long distance flights that are executed fully autonomously. A critical component is the ability to safely land in hazardous terrain as part of a mission, or triggered by an emergency situation. In this paper, we present an advanced navigation system for continuous on-board terrain reconstruction for the purpose of hazard-free landing site detection for the autonomous navigation of a Mars Science Helicopter - a JPL research concept that investigates the feasibility of flying a multi-kilogram science payload at various Mars science locations, with flight ranges of multiple kilometers per flight. Our approach builds on a visionbased perception system that incorporates an on-board visualinertial state estimator augmented by a laser altimeter (range- VIO), and a structure-from-motion 3D reconstruction approach that uses a single, downward-looking camera to provide dense depth measurements while the vehicle is in motion. Depth measurements are accumulated in a local, robot-centric, multiresolution elevation map that is analyzed by a landing site detector to extract safe landing areas below the rotorcraft, based on a heuristic that includes slope, roughness and the presence of landing hazards. Detected landing sites are prioritized by an on-board autonomy engine that either selects suitable landing sites for immediate landing maneuvers, or can explore a terrain location as part of a mission in order to find a best landing site in a pre-planned area. We demonstrate and evaluate our approach on simulated data and data acquired with a surrogate unmanned aerial system (UAS) executing flights over relevant terrain.

Tzanetos, Teddy↗
NASA NTRS2021

Bistatic Radar Experiments with UAV: Qualification and Performance of a Miniaturized Instrument

Spacecraft-to-ground bistatic radar is an established technique that has enabled the study of the planetary surfaces and near sub-surfaces properties by using the telecommunication signals amplitude, phase, and polarization. The Planetary Radar and Radio Science group at the Jet Propulsion Laboratory (JPL) has been involved in many planetary bistatic radar experiments since the 1970’s using orbiters and Deep Space Network (DSN) antennas. The recent advances in Unmanned Aerial Vehicles (UAVs) technologies are making the UAVs more popular in scientific surveying applications. One such application is the use of UAVs in bistatic radar measurements to explore surfaces on Earth. Our analyses show that UAV-based bistatic radar measurements will improve our understanding of the finer-scale characteristic variations of the surface by acquiring the higher resolution data for a specific region of interest compared to data obtained from a spacecraft. The Mars helicopter, a technology demonstration to test the first powered flight on Mars, will be the beginning of a new era of exploration with UAVs on Mars. This leap in planetary UAV technology has renewed the importance of developing a miniaturized bistatic radar instrument (under 1 kg) compatible with a UAV platform able to meet the science requirements for studying surfaces on Earth, Mars, and other planetary bodies. As part of a task at JPL, we have been working on a technology demonstration using a compact bistatic radar instrument designed to be the payload of a UAV employing signals of opportunity from Earth’s orbiters, i.e. Global Positioning System (GPS). In this paper, we present our design and development of the instrument, our evaluation of different L-band antennas, the performance of compact open-loop receivers in support of Earth and planetary bistatic radar observations, and the instrument fit test on an UAV platform. As part of this publication, we also highlight the results of a field experiment dedicated to test the sensitivity of the miniaturized bistatic radar instrument to different electrical properties of the surface.

Brockers, Roland↗
NASA NTRS2021

Dense 3D-Reconstruction from Monocular Image Sequences for Computationally Constrained UAS

The ability to find safe landing sites over complex 3D terrain is an essential safety feature for fully autonomous small unmanned aerial systems (UAS), which requires on-board perception for 3D reconstruction and terrain analysis if the overflown terrain is unknown. This is a challenge for UAS that are limited in size, weight and computational power, such as small rotorcrafts executing autonomous missions on Earth, or in planetary applications such as the Mars Helicopter. For such a computationally constraint system, we propose a structure from motion approach that uses inputs from a single downward facing camera to produce dense point clouds of the overflown terrain in real time. In contrast to existing approaches, our method uses metric pose information from a visual-inertial odometry algorithm as camera pose priors, which allows deploying a fast pose refinement step to align camera frames such that a conventional stereo algorithm can be used for dense 3D reconstruction. We validate the performance of our approach with extensive evaluations in simulation, and demonstrate the feasibility with data from UAS flights.

Brockers, Roland↗
NASA NTRS2020

Improved State Estimation in Distorted Magnetic Fields

The magnetic field of the Earth – besides varying naturally – may be disturbed locally by the (man-made) environment. State estimation and corresponding navigation frameworks that use magnetometers on-board of mobile platforms suffer from severe performance loss or failure upon local magnetic distortions if these are not detected and mitigated adequately. Advanced estimators include the magnetic variation in the state vector. However, Cartesian coordinates, although widely used in the literature, suffer from observability issues when it comes to disturbance detection. This paper shows the importance of representing the magnetic variation in a spherical coordinate system and subsequent improvements with respect to the common representation in Cartesian coordinates. The spherical representation improves estimator consistency and allows for accurate and fast mitigation of magnetic disturbances through consistent statistical tests which leads to better system state estimates in magnetically distorted areas. The approach is validated by performing tests with simulated and real-world data on embedded hardware.

Brommer, Christian↗
NASA NTRS2017

Gaussian Mixture Models for Temporal Depth Fusion

Sensing the 3D environment of a moving robot is essential for collision avoidance. Most 3D sensors produce dense depth maps, which are subject to imperfections due to various environmental factors. Temporal fusion of depth maps is crucial to overcome those. Temporal fusion is traditionally done in 3D space with voxel data structures, but it can be approached by temporal fusion in image space, with potential benefits in reduced memory and computational cost for applications like reactive collision avoidance for micro air vehicles. In this paper, we present an efficient Gaussian Mixture Models based depth map fusion approach, introducing an online update scheme for dense representations. The environment is modeled from an ego-centric point of view, where each pixel is represented by a mixture of Gaussian inverse-depth models. Consecutive frames are related to each other by transformations obtained from visual odometry. This approach achieves better accuracy than alternative image space depth map fusion techniques at lower computational cost.

Matthies, Larry↗
NASA NTRS2013

4DoF Drift Free Navigation Using Inertial Cues and Optical Flow

In this paper, we describe a novel approach in fusing optical flow with inertial cues (3D acceleration and 3D angular velocities) in order to navigate a Micro Aerial Vehicle (MAV) drift free in 4DoF and metric velocity. Our approach only requires two consecutive images with a minimum of three feature matches. It does not require any (point) map nor any type of feature history. Thus it is an inherently failsafe approach that is immune to map and feature-track failures. With these minimal requirements we show in real experiments that the system is able to navigate drift free in all angles including yaw, in one metric position axis, and in 3D metric velocity. Furthermore, it is a power-on-and-go system able to online self-calibrate the inertial biases, the visual scale and the full 6DoF extrinsic transformation parameters between camera and IMU.

reconnissance↗