SEARCH · Engineering Papers

Results for “visual stereo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS2010

3D GeoWall Analysis System for Shuttle External Tank Foreign Object Debris Events

An analytical, advanced imaging method has been developed for the initial monitoring and identification of foam debris and similar anomalies that occur post-launch in reference to the space shuttle s external tank (ET). Remote sensing technologies have been used to perform image enhancement and analysis on high-resolution, true-color images collected with the DCS 760 Kodak digital camera located in the right umbilical well of the space shuttle. Improvements to the camera, using filters, have added sharpness/definition to the image sets; however, image review/analysis of the ET has been limited by the fact that the images acquired by umbilical cameras during launch are two-dimensional, and are usually nonreferenceable between frames due to rotation translation of the ET as it falls away from the space shuttle. Use of stereo pairs of these images can enable strong visual indicators that can immediately portray depth perception of damaged areas or movement of fragments between frames is not perceivable in two-dimensional images. A stereoscopic image visualization system has been developed to allow 3D depth perception of stereo-aligned image pairs taken from in-flight umbilical and handheld digital shuttle cameras. This new system has been developed to augment and optimize existing 2D monitoring capabilities. Using this system, candidate sequential image pairs are identified for transformation into stereo viewing pairs. Image orientation is corrected using control points (similar points) between frames to place the two images in proper X-Y viewing perspective. The images are then imported into the WallView stereo viewing software package. The collected control points are used to generate a transformation equation that is used to re-project one image and effectively co-register it to the other image. The co-registered, oriented image pairs are imported into a WallView image set and are used as a 3D stereo analysis slide show. Multiple sequential image pairs can be used to allow forensic review of temporal phenomena between pairs. The observer, while wearing linear polarized glasses, is able to review image pairs in passive 3D stereo.

Brown, Richard↗

NASA NTRS1992

Topography from shading and stereo

Methods exploiting photometric information in images that have been developed in machine vision can be applied to planetary imagery. Present techniques, however, focus on one visual cue, such as shading or binocular stereo, and produce results that are either not very accurate in an absolute sense or provide information only at few points on the surface. We plan to integrate shape from shading, binocular stereo and photometric stereo to yield a robust system for recovering detailed surface shape and surface reflectance information. Such a system will be useful in producing quantitative information from the vast volume of imagery being received, as well as in helping visualize the underlying surface. The work will be carried out on a popular computing platform so that it will be easily accessible to other workers.

Horn, Berthold P.↗

NASA NTRS1993

Topography from shading and stereo

Horn, Berthold P.↗

NASA NTRS2013

Stereoscopic Height and Wind Retrievals for Aerosol Plumes with the MISR INteractive eXplorer (MINX)

The Multi-angle Imaging SpectroRadiometer (MISR) instrument aboard the Terra satellite acquires imagery at 275-m resolution at nine angles ranging from 0deg (nadir) to 70deg off-nadir. This multi-angle capability facilitates the stereoscopic retrieval of heights and motion vectors for clouds and aerosol plumes. MISR's operational stereo product uses this capability to retrieve cloud heights and winds for every satellite orbit, yielding global coverage every nine days. The MISR INteractive eXplorer (MINX) visualization and analysis tool complements the operational stereo product by providing users the ability to retrieve heights and winds locally for detailed studies of smoke, dust and volcanic ash plumes, as well as clouds, at higher spatial resolution and with greater precision than is possible with the operational product or with other space-based, passive, remote sensing instruments. This ability to investigate plume geometry and dynamics is becoming increasingly important as climate and air quality studies require greater knowledge about the injection of aerosols and the location of clouds within the atmosphere. MINX incorporates features that allow users to customize their stereo retrievals for optimum results under varying aerosol and underlying surface conditions. This paper discusses the stereo retrieval algorithms and retrieval options in MINX, and provides appropriate examples to explain how the program can be used to achieve the best results.

MISR↗

NASA NTRS2012

Localization Using Visual Odometry and a Single Downward-Pointing Camera

Stereo imaging is a technique commonly employed for vision-based navigation. For such applications, two images are acquired from different vantage points and then compared using transformations to extract depth information. The technique is commonly used in robotics for obstacle avoidance or for Simultaneous Localization And Mapping, (SLAM). Yet, the process requires a number of image processing steps and therefore tends to be CPU-intensive, which limits the real-time data rate and use in power-limited applications. Evaluated here is a technique where a monocular camera is used for vision-based odometry. In this work, an optical flow technique with feature recognition is performed to generate odometry measurements. The visual odometry sensor measurements are intended to be used as control inputs or measurements in a sensor fusion algorithm using low-cost MEMS based inertial sensors to provide improved localization information. Presented here are visual odometry results which demonstrate the challenges associated with using ground-pointing cameras for visual odometry. The focus is for rover-based robotic applications for localization within GPS-denied environments.

Swank, Aaron J.↗

NASA NTRS1992

The virtual wind tunnel

Consideration is given to the design and implementaion of a virtual environment linked to a graphics workstation for the visualization of complex fluid flows. The user wears a stereo head-tracked display which displays 3D information and an instrumented glove to intuitively position flow-visualization tools. The idea is to create for the user an illusion that he or she is actually in the flow manipulating visualization tools. The user's presence does not disturb the flow so that sensitive flow areas can be easily investigated. The flow is precomputed and can be investigated at any length scale and with control over time. Particular attention is given to the visualization structures and their interfaces in the virtual environment, hardware and software, and the performance of the virtual wind tunnel using flow past a tapered cylinder as an example.

Bryson, Steve↗

NASA NTRS1994

Development of an interchangeable end effector mechanism for the Ranger telerobotic vehicle

The Ranger program at the Space Systems Laboratory (SSL) at the University of Maryland is a demonstration of an extremely low cost, space flight experiment. The Ranger vehicle is designed to perform teleoperated spacecraft maintenance. Completing the various tasks included in spacecraft maintenance requires several specific tools. This paper describes the Ranger interchangeable end effector mechanism (IEEM). Its design allows Ranger to change end effectors to utilize the appropriate tool for the various tasks. The Ranger vehicle is designed with four manipulators. A seven degree-of-freedom (DOF) grappling manipulator securely attaches the vehicle to the work site. A 6 DOF camera positioning manipulator allows the operator to position a stereo pair of video cameras for visual feedback. The two remaining manipulators are the 7 DOF dexterous arms. They are the primary means by which Ranger accomplishes its required tasks. At the end of each of these dexterous manipulators is an IEEM. This paper begins with a brief overview of the Space Systems Laboratory and the Ranger program. The constraints leading to the requirements for an IEEM are described. The following section then describes the design strategies and the down selection process resulting in two candidate designs, taper and pneumatic connector type. Next, the leading candidate design is described in detail, followed by a preliminary discussion of failure modes and planned testing. The paper concludes with a brief review and a section discussing future work.

Cohen, Robert↗

NASA NTRS2004

Path following using visual odometry for Mars Rover in high-slip environments.

An architecture for autonomous operation of Mars rovers in high slip environments has been designed, implemented, and tested. This architecture is composed of several key technologies that enable the rover to accurately follow a designated path, compensate for slippage, and reach intended goals independent of the terrain over which it is traversing (within the mechanical constraints of the mobility system). These technologies include: visual odometry, full vehicle kinematics, a Kalman filter, and a slop compensation/path follower. Visual odometry tracks distinctive scene features in stereo imagery to estimate rover motion between successively acquired stereo image pairs using a maximum likelihood motion estimation algorithm. The full vehicle kinematics for a rocker-bogie suspension system estimates motion, with a no-slip assumption, by measuring wheel, rates, and rocker, bogie, and steering angles. The Kalman filter merges data from an Inertial Measurement Unit (IMU) and visual odometry. This merged estimate is then compared to the kinematic estimate to determining (tracking into account estimate uncertainties) if and how much slippage has occurred then a slip vector is calculated by differencing the current Kalman filter estimate from the kinematic estimate. This slip vector is then used, in conjunction with the inverse kinematics, to determine the necessary wheel velocities and steering angles to compensate for slip and follow the desired path.

Roumeliotis, Stergios I.↗

NASA NTRS1991

VERDEX: A virtual environment demonstrator for remote driving applications

One of the key areas of the National Advanced Robotics Centre's enabling technologies research program is that of the human system interface, phase 1 of which started in July 1989 and is currently addressing the potential of virtual environments to permit intuitive and natural interactions between a human operator and a remote robotic vehicle. The aim of the first 12 months of this program (to September, 1990) is to develop a virtual human-interface demonstrator for use later as a test bed for human factors experimentation. This presentation will describe the current state of development of the test bed, and will outline some human factors issues and problems for more general discussion. In brief, the virtual telepresence system for remote driving has been designed to take the following form. The human operator will be provided with a helmet-mounted stereo display assembly, facilities for speech recognition and synthesis (using the Marconi Macrospeak system), and a VPL DataGlove Model 2 unit. The vehicle to be used for the purposes of remote driving is a Cybermotion Navmaster K2A system, which will be equipped with a stereo camera and microphone pair, mounted on a motorized high-speed pan-and-tilt head incorporating a closed-loop laser ranging sensor for camera convergence control (currently under contractual development). It will be possible to relay information to and from the vehicle and sensory system via an umbilical or RF link. The aim is to develop an interactive audio-visual display system capable of presenting combined stereo TV pictures and virtual graphics windows, the latter featuring control representations appropriate for vehicle driving and interaction using a graphical 'hand,' slaved to the flex and tracking sensors of the DataGlove and an additional helmet-mounted Polhemus IsoTrack sensor. Developments planned for the virtual environment test bed include transfer of operator control between remote driving and remote manipulation, dexterous end effector integration, virtual force and tactile sensing (also the focus of a current ARRL contract, initially employing a 14-pneumatic bladder glove attachment), and sensor-driven world modeling for total virtual environment generation and operator-assistance in remote scene interrogation.

Stone, Robert J.↗

NASA NTRS1996

Fast 3D Net Expeditions: Tools for Effective Scientific Collaboration on the World Wide Web

Two new technologies, the FASTexpedition and Remote FAST, have been developed that provide remote, 3D (three dimensional), high resolution, dynamic, interactive viewing of scientific data. The FASTexpedition permits one to access scientific data from the World Wide Web, take guided expeditions through the data, and continue with self controlled expeditions through the data. Remote FAST permits collaborators at remote sites to simultaneously view an analysis of scientific data being controlled by one of the collaborators. Control can be transferred between sites. These technologies are now being used for remote collaboration in joint university, industry, and NASA projects. Also, NASA Ames Research Center has initiated a project to make scientific data and guided expeditions through the data available as FASTexpeditions on the World Wide Web for educational purposes. Previously, remote visualization of dynamic data was done using video format (transmitting pixel information) such as video conferencing or MPEG (Motion Picture Expert Group) movies on the Internet. The concept for this new technology is to send the raw data (e.g., grids, vectors, and scalars) along with viewing scripts over the Internet and have the pixels generated by a visualization tool running on the viewers local workstation. The visualization tool that is currently used is FAST (Flow Analysis Software Toolkit). The advantages of this new technology over using video format are: (1) The visual is much higher in resolution (1280x1024 pixels with 24 bits of color) than typical video format transmitted over the network. (2) The form of the visualization can be controlled interactively (because the viewer is interactively controlling the visualization tool running on his workstation). (3) A rich variety of guided expeditions through the data can be included easily. (4) A capability is provided for other sites to see a visual analysis of one site as the analysis is interactively performed. Control of the analysis can be passed from site to site. (5) The scenes can be viewed in 3D using stereo vision. (6) The network bandwidth for the visualization using this new technology is much smaller than when using video format. (The measured peak bandwidth used was 1 Kbit/sec whereas the measured bandwidth for a small video picture was 500 Kbits/sec.) This talk will illustrate the use of these new technologies and present a proposal for using these technologies to improve science education.

Watson, Val↗

NASA NTRS1993

Constraints on the rate of discharge and duration of the Mangala Valles flood

Interest in Mangala Valles remains high within the planetary science community. This is justified because the survey mission images provide us with nearly complete coverage of the system at high resolution. Upcoming high resolution topography from the Mars Observer Laser Altimeter will enable the application of flood discharge models with an unprecedented level of detail. Previous work on the Mangala Valles problem has relied on the available low resolution topography. This has limited the ability of workers to constrain discharge calculations to only within several-order-of-magnitude estimates. Local determinations of channel depths via shadow length measurements and photoclinometric profiling are much more accurate, but can only be applied to steep slopes (and/or low sun elevations) in the case of shadow measurements, or across relatively short distances (to avoid changes in albedo along asymmetric photoclinometric profiles). We are taking stereo parallax measurements from medium resolution Viking Orbiter images, which provide a valuable intermediate check of the topography between those measurements made thus far and the upcoming Mars Observer data. The images used are from orbits 034A and 637A, and cover Mangala Valles from the source graben in Memnonia Fossae to the beginning of the bifurcated reach (at 9.5 deg lat., 151.5 deg lon.). These images are about 300 m/pixel and 250 m/pixel, respectively. Both sets of images were orthographically projected to 250 m/pixel. The separation angle between left-right pairs is approximately 52 degrees. This results in a vertical accuracy on the order of plus or minus 260 m. Though this is still somewhat coarse, the channel relief is clearly resolved. Preliminary profiles across Mangala Valles and the large topographic ridge to the east are shown on the following page. An east-west regional tilt that resulted from slight scaling differences in the digital data has been 'removed' by visually estimating a regional datum on the stereo pairs. North-south variations in scale have not yet been adjusted for, so the zero datum for each profile was simply taken to be the high water line of the channel itself. Our depth measurement for the source breach of about 750 m agrees reasonably well with values of 700-1000 m determined from shadow measurements.

Parker, T. J.↗

NASA NTRS1975

A comparative interregional analysis of selected data from LANDSAT-1 and EREP for the inventory and monitoring of natural ecosystems

Comparative statistics were presented on the capability of LANDSAT-1 and three of the Skylab remote sensing systems (S-190A, S-190B, S-192) for the recognition and inventory of analogous natural vegetations and landscape features important in resource allocation and management. Two analogous regions presenting vegetational zonation from salt desert to alpine conditions above the timberline were observed, emphasizing the visual interpretation mode in the investigation. An hierarchical legend system was used as the basic classification of all land surface features. Comparative tests were run on image identifiability with the different sensor systems, and mapping and interpretation tests were made both in monocular and stereo interpretation with all systems except the S-192. Significant advantage was found in the use of stereo from space when image analysis is by visual or visual-machine-aided interactive systems. Some cost factors in mapping from space are identified. The various image types are compared and an operational system is postulated.

Poulton, C. E.↗

NASA NTRS1990

Stereoscopic displays and applications; Proceedings of the Meeting, Santa Clara, CA, Feb. 12-14, 1990

The present conference discusses topics in the fields of stereoscopic displays' user interfaces, three-dimensional (TD) visualization, novel TD displays, and applications of stereoscopic displays. Attention is given to TD cockpit displays, novel computational control techniques for stereo TD displays, characterization of higher-dimensional presentation techniques, volume visualization on a stereoscopic display, and stereoscopic displays for terrain-data base visualization. Also discussed are the experimental design of cyberspaces, a volumetric environment for interactive design of three-dimensional objects, videotape recording of TD TV images, remote manipulator tasks rendered possible by stereo TV, TD endoscopy based on alternating-frame technology, and advancements in computer-generated barrier-strip autostereography.

Merritt, John O.↗

NASA NTRS1995

Bringing "Scientific Expeditions" Into the Schools

Two new technologies, the FASTexpedition and Remote FAST, have been developed that provide remote, 3D, high resolution, dynamic, interactive viewing of scientific data (such as simulations or measurements of fluid dynamics). The FASTexpedition permits one to access scientific data from the World Wide Web, take guided expeditions through the data, and continue with self controlled expeditions through the data. Remote FAST permits collaborators at remote sites to simultaneously view an analysis of scientific data being controlled by one of the collaborators. Control can be transferred between sites. These technologies are now being used for remote collaboration in joint university, industry, and NASA projects in computational fluid dynamics (CFD) and wind tunnel testing. Also, NASA Ames Research Center has initiated a project to make scientific data and guided expeditions through the data available as FASTexpeditions on the World Wide Web for educational purposes. Previously, remote visualiZation of dynamic data was done using video format (transmitting pixel information) such as video conferencing or MPEG movies on the Internet. The concept for this new technology is to send the raw data (e.g., grids, vectors, and scalars) along with viewing scripts over the Internet and have the pixels generated by a visualization tool running on the viewer's local workstation. The visualization tool that is currently used is FAST (Flow Analysis Software Toolkit). The advantages of this new technology over using video format are: 1. The visual is much higher in resolution (1280xl024 pixels with 24 bits of color) than typical video format transmitted over the network. 2. The form of the visualization can be controlled interactively (because the viewer is interactively controlling the visualization tool running on his workstation). 3. A rich variety of guided expeditions through the data can be included easily. 4. A capability is provided for other sites to see a visual analysis of one site as the analysis is interactively performed. Control of the analysis can be passed from site to site. 5. The scenes can be viewed in 3D using stereo vision. 6. The network bandwidth used for the visualization using this new technology is much smaller than when using video format. (The measured peak bandwidth used was 1 Kbit/sec whereas the measured bandwidth for a small video picture was 500 Kbits/sec.)

Watson, Val↗

NASA NTRS1978

Experimental study of the laminar-turbulent transition of a concave wall in a parallel flow

The instability of the laminar boundary layer flow along a concave wall was studied. Observations of these three-dimensional boundary layer phenomena were made using the hydrogen-bubble visualization technique. With the application of stereo-photogrammetric methods in the air-water system it was possible to investigate the flow processes qualitatively and quantitatively. In the case of a concave wall of sufficient curvature, a primary instability occurs first in the form of Goertler vortices with wave lengths depending upon the boundary layer thickness and the wall curvature. At the onset the amplification rate is in agreement with the linear theory. Later, during the non-linear amplification stage, periodic spanwise vorticity concentrations develop in the low velocity region between the longitudinal vortices. Then a meandering motion of the longitudinal vortex streets subsequently ensues, leading to turbulence.

Bippes, H.↗

NASA NTRS2005

Path Following with Slip Compensation for a Mars Rover

A software system for autonomous operation of a Mars rover is composed of several key algorithms that enable the rover to accurately follow a designated path, compensate for slippage of its wheels on terrain, and reach intended goals. The techniques implemented by the algorithms are visual odometry, full vehicle kinematics, a Kalman filter, and path following with slip compensation. The visual-odometry algorithm tracks distinctive scene features in stereo imagery to estimate rover motion between successively acquired stereo image pairs, by use of a maximum-likelihood motion-estimation algorithm. The full-vehicle kinematics algorithm estimates motion, with a no-slip assumption, from measured wheel rates, steering angles, and angles of rockers and bogies in the rover suspension system. The Kalman filter merges data from an inertial measurement unit (IMU) and the visual-odometry algorithm. The merged estimate is then compared to the kinematic estimate to determine whether and how much slippage has occurred. The kinematic estimate is used to complement the Kalman-filter estimate if no statistically significant slippage has occurred. If slippage has occurred, then a slip vector is calculated by subtracting the current Kalman filter estimate from the kinematic estimate. This slip vector is then used, in conjunction with the inverse kinematics, to determine the wheel velocities and steering angles needed to compensate for slip and follow the desired path.

Helmick, Daniel↗

NASA NTRS1991

The effect of monocular target blur on simulated telerobotic manipulation

A simulation involving three types of telerobotic tasks that require information about the spatial position of objects is reported. This is similar to the results of psychophysical experiments examining the effect of blur on stereoacuity. It is suggested that other psychophysical experimental results could be used to predict operator performance for other telerobotic tasks. It is demonstrated that refractive errors in the helmet-mounted stereo display system can affect performance in the three types of telerobotic tasks. The results of two sets of experiments indicate that monocular target blur of two diopters or more degrades stereo display performance to the level of monocular displays. This indicates that moderate levels of visual degradation that affect the operator's stereoacuity may eliminate the performance advantage of stereo displays.

Liu, Andrew↗

NASA NTRS1992

Visual specification of robot motion

The authors describe the use of stereo pairs of images to specify robot motion. The experimental setup includes a SUN workstation, a PUMA 560 robot, and an Imaging 151 vision system. An X-window environment displays stereo images of the work scene. Image processing is performed to extract linear edge segments from the images and the results are displayed on screen. Using a pointing device, the user selects a group of edges from the object relevant to the task. The 3D structure of this group of features is found by stereo triangulation and they can be displayed in 3D from any point of view. A viewpoint orthogonal to the plane defined by these 3D edges is used to specify the robot position relative to object position. The actual robot will then be moved to the specified position.

Shiu, Y. C.↗