Robotics Technology: Perception, User Interfaces and Architecture
An overview of the Intelligent Robotics Group and its current projects. This presentation is used for visitors to Ames Research Center.
Bualat, Maria↗
Engineering topics
Bualat, Maria
Publications and source records attributed to Bualat, Maria.
Astrobee Free Flyers: Integrated and Tested. Ready for Launch!
As of March 2019, four Astrobee free-flying robots have been integrated, tested and shipped to NASA’s Johnson Space Center, Texas, ready to be launched to space. Two of these Astrobee units (Honey and Bumble) will be launched to the International Space Station (ISS) on April 17, 2019, on the Cygnus NG-11 (Northrop Grumman) cargo resupply spacecraft from the Mid-Atlantic Regional Spaceport (MARS) launch facility, at NASA's Wallops Flight Facility, in Virginia, while the third unit (Queen) will be launched in mid-July 2019, with the cargo resupply mission Space-X 18, from Cape Canaveral, at NASA’s Kennedy Space Center. The primary purpose of the Astrobee system is to provide an autonomous and flexible platform for research on zero-g free-flying robotics, with the ability to accommodate guest researchers looking to utilize the unique capabilities of this platform in the microgravity of low earth orbit, and to advance the state of the art of guest science software and research payloads, which range from gecko-inspired adhesives for perching on smooth surfaces, to augmented reality interfaces to help astronauts and robots work together effectively, to RFID reader, performing inventory of RFID tagged items inside the ISS. Astrobee will also serve utility functions, such as free-flying cameras to record video and provide assistance during astronaut activities, and as mobile sensor platforms to conduct surveys of the ISS. In this paper we will give an overview of the status of the Astrobee system, which includes the docking station already launched and mounted in the JAXA JEM module of the ISS, the Astrobee robots, the Astrobee robotic arms, the ground data system (GDS) and the development of the several guest science payloads.
Carlino, Roberto↗
Astrobee: A New Tool for ISS Operations
Astrobee is a new class of free-flying robots that operate in the interior of the International Space Station (ISS). In addition to providing a research platform for zero-g free-flying robotics (replacing the Synchronized Position Hold Engage and Reorient Experimental Satellites (SPHERES)), Astrobee improves the efficiency of ISS operations by providing flight and payload controllers with a mobile camera/sensor platform. The Astrobee system consists of three robots, a docking station, and a ground data system. Development began in late 2014, and Astrobee will launch to ISS in late 2018. This paper provides an overview of the capabilities of the Astrobee system, the concept of operations for ISS operations support, and the challenges of operating a free-flying robot within the constraints of the ISS environment.
ISS↗
Astrobee Guest Science
At the end of 2017, Astrobee will launch three free-flying robots that will navigate the entire US segment of the ISS (International Space Station) and serve as a payload facility. These robots will provide guest science payloads with processor resources, space within the robot for physical attachment, power, communication, propulsion, and human interfaces.
robot↗
Astrobee: A New Platform for Free-Flying Robotics on the International Space Station
The Astrobees are next-generation free-flying robots that will operate in the interior of the International Space Station (ISS). Their primary purpose is to provide a flexible platform for research on zero-g freeflying robotics, with the ability to carry a wide variety of future research payloads and guest science software. They will also serve utility functions: as free-flying cameras to record video of astronaut activities, and as mobile sensor platforms to conduct surveys of the ISS. The Astrobee system includes two robots, a docking station, and a ground data system (GDS). It is developed by the Human Exploration Telerobotics 2 (HET-2) Project, which began in Oct. 2014, and will deliver the Astrobees for launch to ISS in 2017. This paper covers selected aspects of the Astrobee design, focusing on capabilities relevant to potential users of the platform.
robotics↗
Astrobee: Developing a Free Flying Robot for the International Space Station
Astronaut time will always be in short supply, consumables (e.g., oxygen) will always be limited, and some work will not be feasible, or productive, for astronauts to do manually. Free flyers offer significant potential to perform a great variety of tasks, include routine, repetitive or simple but long-duration work, such as conducting environment surveys, taking sensor readings or monitoring crew activities. The "Astrobee" project is developing a new free flying robot system suitable for performing Intravehicular Activity (IVA) work on the International Space Station (ISS). This paper will describe the Astrobee project objectives, initial design, concept of operations, and key challenges.
ISS↗
Testing Astronaut-Controlled Telerobotic Operation of Rovers From the International Space Station as a Precursor to Lunar Missions
Missions to Earth-Moon libration points can advance capabilities for human exploration and provide unique opportunities to advance scientific knowledge. For example, NASA’s Orion spacecraft, currently under development, could serve as a platform from which astronauts would explore the lunar farside using robots that they remotely operate from a libration point. During Summer 2013, we conducted initial testing of this “surface telerobotics” concept of operations using the International Space Station (ISS) as a proxy for Orion orbiting the Moon. Over the course of three test sessions, Expedition 36 astronauts Chris Cassidy, Luca Parmitano, and Karen Nyberg on the ISS remotely operated NASA’s “K10” planetary rover in an outdoor terrain located at the NASA Ames Research Center (ARC). In this paper, we discuss the motivation for Earth-Moon libration point missions, describe the surface telerobotics tests performed to date, and outline directions for future ISS testing.
Fong, Terrence↗
Results from Testing Crew-Controlled Surface Telerobotics on the International Space Station
During Summer 2013, the Intelligent Robotics Group at NASA Ames Research Center conducted a series of tests to examine how astronauts in the International Space Station (ISS) can remotely operate a planetary rover. The tests simulated portions of a proposed lunar mission, in which an astronaut in lunar orbit would remotely operate a planetary rover to deploy a radio telescope on the lunar far side. Over the course of Expedition 36, three ISS astronauts remotely operated the NASA "K10" planetary rover in an analogue lunar terrain located at the NASA Ames Research Center in California. The astronauts used a "Space Station Computer" (crew laptop), a combination of supervisory control (command sequencing) and manual control (discrete commanding), and Ku-band data communications to command and monitor K10 for 11 hours. In this paper, we present and analyze test results, summarize user feedback, and describe directions for future research.
robotics↗
Preparing for Crew-Control of Surface Robots from Orbit
Since 2010, the European Space Agency (ESA) and the National Aeronautics and Space Administration (NASA) have been developing robots that can be remotely operated on planetary surfaces by astronauts in orbiting spacecraft. A primary objective of this work has been to test telerobotic technologies that are needed for future deep-space human exploration missions. Specifically, ESA's Multi-Purpose End-To-End Robotic Operations Network (METERON) project and NASA's Human Exploration Telerobotics (HET) project are complementary initiatives that aim to validate communications, operations and robotic systems through a range of ground and flight experiments with humans and robots in the loop. Several experiments have already been successfully completed and others are now in preparation for flight.
telerobotics↗
Robotics for Human Exploration
Robots can do a variety of work to increase the productivity of human explorers. Robots can perform tasks that are tedious, highly repetitive or long-duration. Robots can perform precursor tasks, such as reconnaissance, which help prepare for future human activity. Robots can work in support of astronauts, assisting or performing tasks in parallel. Robots can also perform "follow-up" work, completing tasks designated or started by humans. In this paper, we summarize the development and testing of robots designed to improve future human exploration of space.
human-robot interaction↗
Robotic Technology Development at Ames: The Intelligent Robotics Group and Surface Telerobotics
Future human missions to the Moon, Mars, and other destinations offer many new opportunities for exploration. But, astronaut time will always be limited and some work will not be feasible for humans to do manually. Robots, however, can complement human explorers, performing work autonomously or under remote supervision from Earth. Since 2004, the Intelligent Robotics Group has been working to make human-robot interaction efficient and effective for space exploration. A central focus of our research has been to develop and field test robots that benefit human exploration. Our approach is inspired by lessons learned from the Mars Exploration Rovers, as well as human spaceflight programs, including Apollo, the Space Shuttle, and the International Space Station. We conduct applied research in computer vision, geospatial data systems, human-robot interaction, planetary mapping and robot software. In planning for future exploration missions, architecture and study teams have made numerous assumptions about how crew can be telepresent on a planetary surface by remotely operating surface robots from space (i.e. from a flight vehicle or deep space habitat). These assumptions include estimates of technology maturity, existing technology gaps, and likely operational and functional risks. These assumptions, however, are not grounded by actual experimental data. Moreover, no crew-controlled surface telerobotic system has yet been fully tested, or rigorously validated, through flight testing. During Summer 2013, we conducted a series of tests to examine how astronauts in the International Space Station (ISS) can remotely operate a planetary rover across short time delays. The tests simulated portions of a proposed human-robotic Lunar Waypoint mission, in which astronauts in lunar orbit remotely operate a planetary rover on the lunar Farside to deploy a radio telescope array. We used these tests to obtain baseline-engineering data.
robotics↗
Surface Telerobotics: Development and Testing of a Crew Controlled Planetary Rover System
During Summer 2013, we conducted a series of tests to examine how astronauts in the In- ternational Space Station (ISS) can remotely operate a planetary rover. The tests simulated portions of a proposed mission, in which an astronaut in lunar orbit remotely operates a planetary rover to deploy a radio telescope on the lunar farside. In this paper, we present the design, implementation, and preliminary test results.
Fong, Terry↗
Robotic Follow-Up for Human Exploration
We are studying how "robotic follow-up" can improve future planetary exploration. Robotic follow-up, which we define as augmenting human field work with subsequent robot activity, is a field exploration technique designed to increase human productivity and science return. To better understand the benefits, requirements, limitations and risks associated with this technique, we are conducting analog field tests with human and robot teams at the Haughton Crater impact structure on Devon Island, Canada. In this paper, we discuss the motivation for robotic follow-up, describe the scientific context and system design for our work, and present results and lessons learned from field testing.
Fong, Terrence↗
Field Testing of Utility Robots for Lunar Surface Operations
Since 2004, NASA has been working to return to the Moon. In contrast to the Apollo missions, two key objectives of the current exploration program is to establish significant infrastructure and an outpost. Achieving these objectives will enable long-duration stays and long-distance exploration of the Moon. To do this, robotic systems will be needed to perform tasks which cannot, or should not, be performed by crew alone. In this paper, we summarize our work to develop "utility robots" for lunar surface operations, present results and lessons learned from field testing, and discuss directions for future research.
Fong, Terrence↗
2D/3D Visual Tracker for Rover Mast
A visual-tracker computer program controls an articulated mast on a Mars rover to keep a designated feature (a target) in view while the rover drives toward the target, avoiding obstacles. Several prior visual-tracker programs have been tested on rover platforms; most require very small and well-estimated motion between consecutive image frames a requirement that is not realistic for a rover on rough terrain. The present visual-tracker program is designed to handle large image motions that lead to significant changes in feature geometry and photometry between frames. When a point is selected in one of the images acquired from stereoscopic cameras on the mast, a stereo triangulation algorithm computes a three-dimensional (3D) location for the target. As the rover moves, its body-mounted cameras feed images to a visual-odometry algorithm, which tracks two-dimensional (2D) corner features and computes their old and new 3D locations. The algorithm rejects points, the 3D motions of which are inconsistent with a rigid-world constraint, and then computes the apparent change in the rover pose (i.e., translation and rotation). The mast pan and tilt angles needed to keep the target centered in the field-of-view of the cameras (thereby minimizing the area over which the 2D-tracking algorithm must operate) are computed from the estimated change in the rover pose, the 3D position of the target feature, and a model of kinematics of the mast. If the motion between the consecutive frames is still large (i.e., 3D tracking was unsuccessful), an adaptive view-based matching technique is applied to the new image. This technique uses correlation-based template matching, in which a feature template is scaled by the ratio between the depth in the original template and the depth of pixels in the new image. This is repeated over the entire search window and the best correlation results indicate the appropriate match. The program could be a core for building application programs for systems that require coordination of vision and robotic motion.
Bajracharya, Max↗