Engineering Papers⌕ Search

Engineering topics

Zornetzer, Steven

Publications and source records attributed to Zornetzer, Steven.

Insect-Inspired Optical-Flow Navigation Sensors

Integrated circuits that exploit optical flow to sense motions of computer mice on or near surfaces ( optical mouse chips ) are used as navigation sensors in a class of small flying robots now undergoing development for potential use in such applications as exploration, search, and surveillance. The basic principles of these robots were described briefly in Insect-Inspired Flight Control for Small Flying Robots (NPO-30545), NASA Tech Briefs, Vol. 29, No. 1 (January 2005), page 61. To recapitulate from the cited prior article: The concept of optical flow can be defined, loosely, as the use of texture in images as a source of motion cues. The flight-control and navigation systems of these robots are inspired largely by the designs and functions of the vision systems and brains of insects, which have been demonstrated to utilize optical flow (as detected by their eyes and brains) resulting from their own motions in the environment. Optical flow has been shown to be very effective as a means of avoiding obstacles and controlling speeds and altitudes in robotic navigation. Prior systems used in experiments on navigating by means of optical flow have involved the use of panoramic optics, high-resolution image sensors, and programmable imagedata- processing computers.

Thakoor, Sarita↗

Insect-Inspired Flight Control for Unmanned Aerial Vehicles

Flight-control and navigation systems inspired by the structure and function of the visual system and brain of insects have been proposed for a class of developmental miniature robotic aircraft called "biomorphic flyers" described earlier in "Development of Biomorphic Flyers" (NPO-30554), NASA Tech Briefs, Vol. 28, No. 11 (November 2004), page 54. These form a subset of biomorphic explorers, which, as reported in several articles in past issues of NASA Tech Briefs ["Biomorphic Explorers" (NPO-20142), Vol. 22, No. 9 (September 1998), page 71; "Bio-Inspired Engineering of Exploration Systems" (NPO-21142), Vol. 27, No. 5 (May 2003), page 54; and "Cooperative Lander-Surface/Aerial Microflyer Missions for Mars Exploration" (NPO-30286), Vol. 28, No. 5 (May 2004), page 36], are proposed small robots, equipped with microsensors and communication systems, that would incorporate crucial functions of mobility, adaptability, and even cooperative behavior. These functions are inherent to biological organisms but are challenging frontiers for technical systems. Biomorphic flyers could be used on Earth or remote planets to explore otherwise difficult or impossible to reach sites. An example of an exploratory task of search/surveillance functions currently being tested is to obtain high-resolution aerial imagery, using a variety of miniaturized electronic cameras. The control functions to be implemented by the systems in development include holding altitude, avoiding hazards, following terrain, navigation by reference to recognizable terrain features, stabilization of flight, and smooth landing. Flying insects perform these and other functions remarkably well, even though insect brains contains fewer than 10(exp -4) as many neurons as does the human brain. Although most insects have immobile, fixed-focus eyes and lack stereoscopy (and hence cannot perceive depth directly), they utilize a number of ingenious strategies for perceiving, and navigating in, three dimensions. Despite their lack of stereoscopy, insects infer distances to potential obstacles and other objects from image motion cues that result from their own motions in the environment. The concept of motion of texture in images as a source of motion cues is denoted generally as the concept of optic or optical flow. Computationally, a strategy based on optical flow is simpler than is stereoscopy for avoiding hazards and following terrain. Hence, this strategy offers the potential to design vision-based control computing subsystems that would be more compact, would weigh less, and would demand less power than would subsystems of equivalent capability based on a conventional stereoscopic approach.

Thakoor, Sarita↗

Development of Biomorphic Flyers

Biomorphic flyers have recently been demonstrated that utilize the approach described earlier in "Bio-Inspired Engineering of Exploration Systems" (NPO-21142), NASA Tech Briefs, Vol. 27, No. 5 (May 2003), page 54, to distill the principles found in successful, nature-tested mechanisms of flight control. Two types of flyers are being built, corresponding to the imaging and shepherding flyers for a biomorphic mission described earlier in "Cooperative Lander- Surface/Aerial Microflyer Missions for Mars Exploration" (NPO-30286), NASA Tech Briefs, Vol. 28, No. 5 (May 2004), page 36. The common features of these two types of flyers are that both are delta-wing airplanes incorporating bio-inspired capabilities of control, navigation, and visual search for exploration. The delta-wing design is robust to approx.40 G axial load and offers ease of stowing and packaging. The prototype that we have built recently is shown in the figure. Such levels of miniaturization and autonomous navigation are essential to enable biomorphic microflyers (<1 kg) that can be deployed in large numbers for distributed measurements and exploration of difficult terrain while avoiding hazards. Individual bio-inspired sensors that will be incorporated in a biomorphic flyer have been demonstrated recently. These sensors include a robust, lightweight (~6 g), and low-power (~40 mW) horizon sensor for flight stabilization. It integrates successfully the principles of the dragonfly ocelli. The ocelli are small eyes on the dorsal and forward regions of the heads of many insects. The ocelli are distinct from the compound eyes that are most commonly associated with insect vision. In many insects, the ocelli are little more than single-point detectors of short-wavelength light and behavioral responses to ocelli stimuli are hard to observe. The notable exception is found in dragonflies, where flight control is notably degraded by any interference with the ocellar system. Our team has discovered recently that the ocelli are a dedicated horizon sensor, with substantial optical processing and multiple spectral sensitivity. To our knowledge, this is the world s first demonstrated use of a "biomorphic ocellus" as a flight-stabilization system. The advantage of the ocelli over a similarly sized system of rate gyroscopes is that both attitude control and rate damping can be realized in one device. A full inertial unit and significant processing would otherwise be required to achieve the same effect. As a prelude to full autonomy, substantial stability augmentation is provided to the pilot at very low cost in terms of space, power, and mass. The sensor is about 40 times lighter than a comparable inertial attitude reference system. Other significant features of the biomorphic flyer shown in the figure include its ability to fly at high angles of attack ~30 and a deep wing chord which allows scaling to small size and low Reynold s number situations. Furthermore, the placement of the propulsion system near the center of gravity allows continued control authority at low speeds. These attributes make such biomorphic flyers uniquely suited to planetary and terrestrial exploration where small size and autonomous airborne operation are required.

Thakoor, Sarita↗

Cooperative Lander-Surface/Aerial Microflyer Missions for Mars Exploration

Concepts are being investigated for exploratory missions to Mars based on Bioinspired Engineering of Exploration Systems (BEES), which is a guiding principle of this effort to develop biomorphic explorers. The novelty lies in the use of a robust telecom architecture for mission data return, utilizing multiple local relays (including the lander itself as a local relay and the explorers in the dual role of a local relay) to enable ranges ~10 to 1,000 km and downlink of color imagery. As illustrated in Figure 1, multiple microflyers that can be both surface or aerially launched are envisioned in shepherding, metamorphic, and imaging roles. These microflyers imbibe key bio-inspired principles in their flight control, navigation, and visual search operations. Honey-bee inspired algorithms utilizing visual cues to perform autonomous navigation operations such as terrain following will be utilized. The instrument suite will consist of a panoramic imager and polarization imager specifically optimized to detect ice and water. For microflyers, particularly at small sizes, bio-inspired solutions appear to offer better alternate solutions than conventional engineered approaches. This investigation addresses a wide range of interrelated issues, including desired scientific data, sizes, rates, and communication ranges that can be accomplished in alternative mission scenarios. The mission illustrated in Figure 1 offers the most robust telecom architecture and the longest range for exploration with two landers being available as main local relays in addition to an ephemeral aerial probe local relay. The shepherding or metamorphic plane are in their dual role as local relays and image data collection/storage nodes. Appropriate placement of the landing site for the scout lander with respect to the main mission lander can allow coverage of extremely large ranges and enable exhaustive survey of the area of interest. In particular, this mission could help with the path planning and risk mitigation in the traverse of the long-distance surface explorer/rover. The basic requirements of design and operation of BEES to implement the scenarios are discussed. Terrestrial applications of such concepts include distributed aerial/surface measurements of meteorological events, i.e., storm watch, seismic monitoring, reconnaissance, biological chemical sensing, search and rescue, surveillance, autonomous security/ protection agents, and/or delivery and lateral distribution of agents (sensors, surface/subsurface crawlers, clean-up agents). Figure 2 illustrates an Earth demonstration that is in development, and its implementation will illustrate the value of these biomorphic mission concepts.

Thakoor, Sarita↗

Advances in Robotic, Human, and Autonomous Systems for Missions of Space Exploration

Space exploration missions are evolving toward more complex architectures involving more capable robotic systems, new levels of human and robotic interaction, and increasingly autonomous systems. How this evolving mix of advanced capabilities will be utilized in the design of new missions is a subject of much current interest. Cost and risk constraints also play a key role in the development of new missions, resulting in a complex interplay of a broad range of factors in the mission development and planning of new missions. This paper will discuss how human, robotic, and autonomous systems could be used in advanced space exploration missions. In particular, a recently completed survey of the state of the art and the potential future of robotic systems, as well as new experiments utilizing human and robotic approaches will be described. Finally, there will be a discussion of how best to utilize these various approaches for meeting space exploration goals.

Gross, Anthony R.↗

Bioinspired engineering of exploration systems for NASA and DoD

A new approach called bioinspired engineering of exploration systems (BEES) and its value for solving pressing NASA and DoD needs are described. Insects (for example honeybees and dragonflies) cope remarkably well with their world, despite possessing a brain containing less than 0.01% as many neurons as the human brain. Although most insects have immobile eyes with fixed focus optics and lack stereo vision, they use a number of ingenious, computationally simple strategies for perceiving their world in three dimensions and navigating successfully within it. We are distilling selected insect-inspired strategies to obtain novel solutions for navigation, hazard avoidance, altitude hold, stable flight, terrain following, and gentle deployment of payload. Such functionality provides potential solutions for future autonomous robotic space and planetary explorers. A BEES approach to developing lightweight low-power autonomous flight systems should be useful for flight control of such biomorphic flyers for both NASA and DoD needs. Recent biological studies of mammalian retinas confirm that representations of multiple features of the visual world are systematically parsed and processed in parallel. Features are mapped to a stack of cellular strata within the retina. Each of these representations can be efficiently modeled in semiconductor cellular nonlinear network (CNN) chips. We describe recent breakthroughs in exploring the feasibility of the unique blending of insect strategies of navigation with mammalian visual search, pattern recognition, and image understanding into hybrid biomorphic flyers for future planetary and terrestrial applications. We describe a few future mission scenarios for Mars exploration, uniquely enabled by these newly developed biomorphic flyers.

Space Flight↗

Intelligence Applied to Air Vehicles

The exponential growth in information technology has provided the potential for air vehicle capabilities that were previously unavailable to mission and vehicle designers. The increasing capabilities of computer hardware and software, including new developments such as neural networks, provide a new balance of work between humans and machines. This paper will describe several NASA projects, and review results and conclusions from ground and flight investigations where vehicle intelligence was developed and applied to aeronautical and space systems. In the first example, flight results from a neural network flight control demonstration will be reviewed. Using, a highly-modified F-15 aircraft, a NASA/Dryden experimental flight test program has demonstrated how the neural network software can correctly identify and respond to changes in aircraft stability and control characteristics. Using its on-line learning capability, the neural net software would identify that something in the vehicle has changed, then reconfigure the flight control computer system to adapt to those changes. The results of the Remote Agent software project will be presented. This capability will reduce the cost of future spacecraft operations as computers become "thinking" partners along with humans. In addition, the paper will describe the objectives and plans for the autonomous airplane program and the autonomous rotorcraft project. Technologies will also be developed.

Rosen, Robert↗