Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “visual stereo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

The 3-D Moons: The Voyager stereo atlas of the outer solar system

Comprehension and analysis of geologic features on any planet is enhanced manyfold by a clear perception between albedo and topography. On many of the icy satellites significant albedo contrasts due to mixtures of dark rocky and bright icy materials can be associated with topographic features. Subtle topographic features can be masked by albedo variation and under high solar illumination albedo and topography can be difficult to separate. To this end we are compiling an atlas of stereo image pairs of the outer solar system based on Voyager imaging for the investigation of various geologic problems and for general use. For the icy satellites, general perceptions of topography are usually gleaned from shape-from-shading information in the images processed by the human brain (i.e. visual inspection). With few exceptions, actual topography has been measured on a spot-by-spot basis using shadow heights or photoclinometry, or along limb profiles (where geographic context may be unavailable). Shadow heights are limited to regions within approximately 10 deg of the terminator and images with resolution better than approximately 1 km/pixel. Photoclinometric scans can be used more widely but are subject to a variety of errors, primarily uncertain assumptions of uniform scene albedo or poorly understood photometry. Stereoscopic analysis, where available, has the potential for greatly expanding topographic perception.

Schenk, P.↗
NASA NTRS2002

Contour completion through depth interferes with stereoacuity

Local disparity signals must interact in visual cortex to represent boundaries and surfaces of three-dimensional (3D) objects. We investigated how disparity signals interact in 3D contours and in 3D surfaces generated from the contours. We compared flat (single disparity) stimuli with curved (multi-disparity) stimuli. We found no consistent differences in sensitivity to contours vs. surfaces; for equivalent amounts of disparity, however, observers were more sensitive to flat stimuli than curved stimuli. Poor depth sensitivity for curved stimuli cannot be explained by the larger range of disparities present in the curved surface, nor by disparity averaging, nor by poor sensitivity to the largest disparity in the stimulus. Surprisingly, sensitivity to surfaces curved in depth was improved by removing portions of the surface and thus removing disparity information. Stimulus configuration had a profound effect on stereo thresholds that cannot be accounted for by disparity-energy models of V1 processing. We suggest that higher-level 3D contour or 3D shape mechanisms are involved.

Non-NASA Center↗
NASA NTRS1989

Use of 3D vision for fine robot motion

An integration of 3-D vision systems with robot manipulators will allow robots to operate in a poorly structured environment by visually locating targets and obstacles. However, by using computer vision for objects acquisition makes the problem of overall system calibration even more difficult. Indeed, in a CAD based manipulation a control architecture has to find an accurate mapping between the 3-D Euclidean work space and a robot configuration space (joint angles). If a stereo vision is involved, then one needs to map a pair of 2-D video images directly into the robot configuration space. Neural Network approach aside, a common solution to this problem is to calibrate vision and manipulator independently, and then tie them via common mapping into the task space. In other words, both vision and robot refer to some common Absolute Euclidean Coordinate Frame via their individual mappings. This approach has two major difficulties. First a vision system has to be calibrated over the total work space. And second, the absolute frame, which is usually quite arbitrary, has to be the same with a high degree of precision for both robot and vision subsystem calibrations. The use of computer vision to allow robust fine motion manipulation in a poorly structured world which is currently in progress is described along with the preliminary results and encountered problems.

Lokshin, Anatole↗
NASA NTRS2008

Venus Quadrangle Geological Mapping: Use of Geoscience Data Visualization Systems in Mapping and Training

We are currently investigating new technological developments in computer visualization and analysis in order to assess their importance and utility in planetary geological analysis and mapping [1,2]. Last year we reported on the range of technologies available and on our application of these to various problems in planetary mapping [3]. In this contribution we focus on the application of these techniques and tools to Venus geological mapping at the 1:5M quadrangle scale. In our current Venus mapping projects we have utilized and tested the various platforms to understand their capabilities and assess their usefulness in defining units, establishing stratigraphic relationships, mapping structures, reaching consensus on interpretations and producing map products. We are specifically assessing how computer visualization display qualities (e.g., level of immersion, stereoscopic vs. monoscopic viewing, field of view, large vs. small display size, etc.) influence performance on scientific analysis and geological mapping. We have been exploring four different environments: 1) conventional desktops (DT), 2) semi-immersive Fishtank VR (FT) (i.e., a conventional desktop with head-tracked stereo and 6DOF input), 3) tiled wall displays (TW), and 4) fully immersive virtual reality (IVR) (e.g., "Cave Automatic Virtual Environment," or Cave system). Formal studies demonstrate that fully immersive Cave environments are superior to desktop systems for many tasks [e.g., 4].

Head, James W.↗
NASA NTRS2020

A ROS-based Simulator for Testing the Enhanced Autonomous Navigation of the Mars 2020 Rover

In order to achieve the ambitious objectives of the Mars 2020 (M2020) mission, in particular the ability to autonomously traverse more challenging terrains more efficiently, new surface mobility software was developed for Enhanced Navigation (ENav). That decision was made early in the project, before most of the new surface flight software (FSW) existed, which created a need for a separate framework where the new navigation algorithms could be quickly prototyped and tested, before more realistic FSW-based testbeds became available. The JPL robotics team chose the Robot Operating System [1] (ROS) as the environment in which to test the new ENav algorithms. This made it possible to write the algorithms in the C language required by the FSW, so they could be directly ported over to the flight module later on, while leveraging all the C++ libraries and tools provided by ROS for simulation and testing. The ENav algorithms were developed as a separate C library, and stubs were used to replace any FSW-specific code, such as Event Reporting (EVRs) and data products (DPs). A ROS simulator was developed to generate a rich set of varied 3D terrains representative of the candidate Mars landing sites and simulate the physics of the rover motion, the point cloud perceived by the rover’s stereo vision system, and the new thinking-while-driving (TWD) navigation logic which directs the rover to drive autonomously to user-specified waypoints. To simulate the rover motion and perception, a ROS node was developed that uses a software library called HyperDrive Sim (HDSim), which is a wrapper for the Rover Sequencing and Visualization Program [2] (RSVP). That library provides roverterrain settling, realistic slip modelling, and camera rendering capability based on the rover’s NavCam machine vision models. To simulate the navigation logic, a ROS node was created that initializes and runs the ENav algorithms in a way that mimics the FSW execution, while also providing the capability to load and replay data products, including re-running the recorded inputs through the ENav algorithms for testing. An engineering Graphical User Interface (GUI) was also developed to visualize various elements, such as the rover pose during the drive, the simulated and perceived terrain, the selected local and global paths to the goal, the evaluated candidate paths and the reasons why they were rejected, the keep-in and keep-out zones (KIOZs), etc. Finally, an advanced Monte Carlo (MC) framework that can run many simulations in parallel on the Cloud and automatically generate reports that capture the key ENav performance metrics was developed to evaluate the system in a statisticallymeaningful way. This paper provides an overview of the ROSbased simulator used for testing the M2020 ENav algorithms.

Toupet, Olivier↗
NASA NTRS2006

Learning to predict slip for ground robots

In this paper we predict the amount of slip an exploration rover would experience using stereo imagery by learning from previous examples of traversing similar terrain. To do that, the information of terrain appearance and geometry regarding some location is correlated to the slip measured by the rover while this location is being traversed. This relationship is learned from previous experience, so slip can be predicted later at a distance from visual information only.

robots↗
NASA NTRS1994

VEVI: A Virtual Reality Tool For Robotic Planetary Explorations

The Virtual Environment Vehicle Interface (VEVI), developed by the NASA Ames Research Center's Intelligent Mechanisms Group, is a modular operator interface for direct teleoperation and supervisory control of robotic vehicles. Virtual environments enable the efficient display and visualization of complex data. This characteristic allows operators to perceive and control complex systems in a natural fashion, utilizing the highly-evolved human sensory system. VEVI utilizes real-time, interactive, 3D graphics and position / orientation sensors to produce a range of interface modalities from the flat panel (windowed or stereoscopic) screen displays to head mounted/head-tracking stereo displays. The interface provides generic video control capability and has been used to control wheeled, legged, air bearing, and underwater vehicles in a variety of different environments. VEVI was designed and implemented to be modular, distributed and easily operated through long-distance communication links, using a communication paradigm called SYNERGY.

Piguet, Laurent↗
NASA NTRS2005

Rover mast calibration, exact camera pointing, and camara handoff for visual target tracking

This paper presents three technical elements that we have developed to improve the accuracy of the visual target tracking for single-sol approach-and-instrument placement in future Mars rover missions. An accurate, straightforward method of rover mast calibration is achieved by using a total station, a camera calibration target, and four prism targets mounted on the rover. The method was applied to Rocky8 rover mast calibration and yielded a 1.1-pixel rms residual error. Camera pointing requires inverse kinematic solutions for mast pan and tilt angles such that the target image appears right at the center of the camera image. Two issues were raised. Mast camera frames are in general not parallel to the masthead base frame. Further, the optical axis of the camera model in general does not pass through the center of the image. Despite these issues, we managed to derive non-iterative closed-form exact solutions, which were verified with Matlab routines. Actual camera pointing experiments aver 50 random target image paints yielded less than 1.3-pixel rms pointing error. Finally, a purely geometric method for camera handoff using stereo views of the target has been developed. Experimental test runs show less than 2.5 pixels error on high-resolution Navcam for Pancam-to-Navcam handoff, and less than 4 pixels error on lower-resolution Hazcam for Navcam-to-Hazcam handoff.

camera handoff↗
NASA NTRS1999

Autonomous Rock Tracking and Acquisition from a Mars Rover

Future Mars exploration missions will perform two types of experiments: science instrument placement for close-up measurement, and sample acquisition for return to Earth. In this paper we describe algorithms we developed for these tasks, and demonstrate them in field experiments using a self-contained Mars Rover prototype, the Rocky 7 rover. Our algorithms perform visual servoing on an elevation map instead of image features, because the latter are subject to abrupt scale changes during the approach. 'This allows us to compensate for the poor odometry that results from motion on loose terrain. We demonstrate the successful grasp of a 5 cm long rock over 1m away using 103-degree field-of-view stereo cameras, and placement of a flexible mast on a rock outcropping over 5m away using 43 degree FOV stereo cameras.

Maimone, Mark W.↗
NASA NTRS2005

Lunar and Planetary Science XXXVI, Part 14

Contents include the following: Destruction of Presolar Silicates by Aqueous Alteration Observed in Murchison CM2 Chondrite. Generation of Chondrule Forming Shock Waves in Solar Nebula by X-Ray Flares. TEM and NanoSIMS Study of Hydrated/Anhydrous Phase Mixed IDPs: Cometary or Asteroidal Origin? Inflight Calibration of Asteroid Multiband Imaging Camera Onboard Hayabusa: Preliminary Results. Corundum and Corundum-Hibonite Grains Discovered by Cathodoluminescence in the Matrix of Acfer 094 Meteorite. Spatial Extent of a Deep Moonquake Nest A Preliminary Report of Reexamination. Modal Abundances of Carbon in Ureilites: Implications for the Petrogenesis of Ureilites. Trapped Noble Gas Components and Exposure History of the Enstatite Chondrite ALH84206. Deep-seated Crustal Material in Dhofar Lunar Meteorites: Evidence from Pyroxene Chemistry. Numerical Investigations of Kuiper Belt Binaries. Dust Devils on Mars: Effects of Surface Roughness on Particle Threshold. Hecates Tholus, Mars: Nighttime Aeolian Activity Suggested by Thermal Images and Mesoscale Atmospheric Model Simulations. Are the Apollo 14 High-Al Basalts Really Impact Melts? Garnet in the Lunar Mantle: Further Evidence from Volcanic Glass Beads. The Earth/Mars Dichotomy in Mg/Si and Al/Si Ratios: Is It Real? Dissecting the Polar Asymmetry in the Non-Condensable Gas Enhancement on Mars: A Numerical Modeling Study. Cassini VIMS Preliminary Exploration of Titan s Surface Hemispheric Albedo Dichotomy. An Improved Instrument for Investigating Planetary Regolith Microstructure. Isotopic Composition of Oxygen in Lunar Zircons Preliminary Design of Visualization Tool for Hayabusa Operation. Size and Shape Distributions of Chondrules and Metal Grains Revealed by X-Ray Computed Tomography Data. Properties of Permanently Shadowed Regolith. Landslides in Interior Layered Deposits, Valles Marineris, Mars: Effects of Water and Ground Shaking on Slope Stability. Mars: Recent and Episodic Volcanic, Hydrothermal, and Glacial Activity Revealed by Mars Express High Resolution Stereo Camera (HRSC). The Cratering Record of the Saturnian Satellites Phoebe, Tethys, Dione and Iapetus in Comparison: First Results from Analysis of the Cassini ISS Imaging Data. Joint Crossover Solutions of Altimetry and Image Data on 433 Eros. The Martian Soil as a Geochemical Sink for.

Source record↗
NASA NTRS2003

Modeling of Depth Cue Integration in Manual Control Tasks

Psychophysical research has demonstrated that human observers utilize a variety of visual cues to form a perception of three-dimensional depth. However, most of these studies have utilized a passive judgement paradigm, and failed to consider depth-cue integration as a dynamic and task-specific process. In the current study, we developed and experimentally validated a model of manual control of depth that examines how two potential cues (stereo disparity and relative size) are utilized in both first- and second-order active depth control tasks. We found that stereo disparity plays the dominate role for determining depth position, while relative size dominates perception of depth velocity. Stereo disparity also plays a reduced role when made less salient (i.e., when viewing distance is increased). Manual control models predict that position information is sufficient for first-order control tasks, while velocity information is required to perform a second-order control task. Thus, the rules for depth-cue integration in active control tasks are dependent on both task demands and cue quality.

Sweet, Barbara T.↗
NASA NTRS1990

Stereopsis cueing effects on hover-in-turbulence performance in a simulated rotorcraft

The efficacy of stereopsis cueing in pictorial displays was assessed in a real-time piloted simulation experiment of a rotorcraft precision hover-in-turbulence task. Seven pilots endeavored to maintain a hover by visually aligning a set of inner and outer wickets (major elements of a real-world pictorial display, thus attaining the desired hover position, in a full factorial experimental design. The display conditions examined included the presence or absence of a velocity display element (a velocity head-up display) as well as the stereopsis cueing conditions, which included non-stereo (binoptic or monoscopic - no depth cues other than those provided by a perspective, real-world display), stereo 3-D, and hyper stereo (telestereoscopic). Subjective and objective results indicated that the depth cues provided by the stereo displays enhanced the situational awareness of the pilot and enabled improved hover performance to be achieved. The velocity display element also improved the hover performance, with the best hover performance being achieved with the combined use of stereo and the velocity display element. Pilot control input data revealed that less control action was required to attain the improved hover performance with the stereo displays.

Parrish, Russell V.↗
NASA NTRS2013

Ground Contact Modeling for the Morpheus Test Vehicle Simulation

The Morpheus vertical test vehicle is an autonomous robotic lander being developed at Johnson Space Center (JSC) to test hazard detection technology. Because the initial ground contact simulation model was not very realistic, it was decided to improve the model without making it too computationally expensive. The first development cycle added capability to define vehicle attachment points (AP) and to keep track of their states in the lander reference frame (LFRAME). These states are used with a spring damper model to compute an AP contact force. The lateral force is then overwritten, if necessary, by the Coulomb static or kinetic friction force. The second development cycle added capability to use the PolySurface class as the contact surface. The class can load CAD data in STL (Stereo Lithography) format, and use the data to compute line of sight (LOS) intercepts. A polygon frame (PFRAME) is computed from the facet intercept normal and used to convert the AP state to PFRAME. Three flat plane tests validate the transitions from kinetic to static, static to kinetic, and vertical impact. The hazardous terrain test will be used to test for visual reasonableness. The improved model is numerically inexpensive, robust, and produces results that are reasonable.

Cordova, Luis↗
NASA NTRS2014

Ground Contact Modeling for the Morpheus Test Vehicle Simulation

The Morpheus vertical test vehicle is an autonomous robotic lander being developed at Johnson Space Center (JSC) to test hazard detection technology. Because the initial ground contact simulation model was not very realistic, it was decided to improve the model without making it too computationally expensive. The first development cycle added capability to define vehicle attachment points (AP) and to keep track of their states in the lander reference frame (LFRAME). These states are used with a spring damper model to compute an AP contact force. The lateral force is then overwritten, if necessary, by the Coulomb static or kinetic friction force. The second development cycle added capability to use the PolySurface class as the contact surface. The class can load CAD data in STL (Stereo Lithography) format, and use the data to compute line of sight (LOS) intercepts. A polygon frame (PFRAME) is computed from the facet intercept normal and used to convert the AP state to PFRAME. Three flat plane tests validate the transitions from kinetic to static, static to kinetic, and vertical impact. The hazardous terrain test will be used to test for visual reasonableness. The improved model is numerically inexpensive, robust, and produces results that are reasonable.

Cordova, Luis↗
NASA NTRS1992

EOS workstation

This final report summarizes the work done from mid-1989 until January 1992 to develop a prototype set of tools for the analysis of EOS-type images. Such images are characterized by great multiplicity and quantity. A single 'snapshot' of EOS-type imagery may contain several hundred component images so that on a particular pixel, one finds multiple gray values. A prototype EOS-sensor, AVIRIS, has 224 gray values at each pixel. The work focused on the ability to utilize very large images and continuously roam through those images, zoom and be able to hold more than one black and white or color image, for example for stereo viewing or for image comparisons. A second focus was the utilization of so-called 'image cubes', where multiple images need to be co-registered and then jointly analyzed, viewed, and manipulated. The target computer platform that was selected was a high-performance graphics superworkstation, Stardent 3000. This particular platform offered many particular graphics tools such as the Application Visualization System (AVS) or Dore, but it missed availability of commercial third-party software for relational data bases, image processing, etc. The project was able to cope with these limitations and a phase-3 activity is currently being negotiated to port the software and enhance it for use with a novel graphics superworkstation to be introduced into the market in the Spring of 1993.

Leberl, Franz↗
NASA NTRS1993

Virtual Reality: You Are There

Telepresence or "virtual reality," allows a person, with assistance from advanced technology devices, to figuratively project himself into another environment. This technology is marketed by several companies, among them Fakespace, Inc., a former Ames Research Center contractor. Fakespace developed a teleoperational motion platform for transmitting sounds and images from remote locations. The "Molly" matches the user's head motion and, when coupled with a stereo viewing device and appropriate software, creates the telepresence experience. Its companion piece is the BOOM-the user's viewing device that provides the sense of involvement in the virtual environment. Either system may be used alone. Because suits, gloves, headphones, etc. are not needed, a whole range of commercial applications is possible, including computer-aided design techniques and virtual reality visualizations. Customers include Sandia National Laboratories, Stanford Research Institute and Mattel Toys.

Source record↗
NASA NTRS2005

Solar System Visualization (SSV) Project

The Solar System Visualization (SSV) project aims at enhancing scientific and public understanding through visual representations and modeling procedures. The SSV project's objectives are to (1) create new visualization technologies, (2) organize science observations and models, and (3) visualize science results and mission Plans. The SSV project currently supports the Mars Exploration Rovers (MER) mission, the Mars Reconnaissance Orbiter (MRO), and Cassini. In support of the these missions, the SSV team has produced pan and zoom animations of large mosaics to reveal details of surface features and topography, created 3D animations of science instruments and procedures, formed 3-D anaglyphs from left and right stereo pairs, and animated registered multi-resolution mosaics to provide context for microscopic images.

Todd, Jessida L.↗