Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stereo camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Static stereo vision depth distortions in teleoperation

A major problem in high-precision teleoperation is the high-resolution presentation of depth information. Stereo television has so far proved to be only a partial solution, due to an inherent trade-off among depth resolution, depth distortion and the alignment of the stereo image pair. Converged cameras can guarantee image alignment but suffer significant depth distortion when configured for high depth resolution. Moving the stereo camera rig to scan the work space further distorts depth. The 'dynamic' (camera-motion induced) depth distortion problem was solved by Diner and Von Sydow (1987), who have quantified the 'static' (camera-configuration induced) depth distortion. In this paper, a stereo image presentation technique which yields aligned images, high depth resolution and low depth distortion is demonstrated, thus solving the trade-off problem.

Diner, D. B.↗

Vision-based end-effector position error compensation

This paper describes a computationally efficient algorithm that provides the ability to accurately place an arm end-effector on a target designated in an image using low speed feed back from a fixed stero camera.

error vector↗

Evaluation of an electro-optic remote displacement measuring system

An instrumentation system to provide a noncontact method for measurement of target positions was evaluated. The system employs two electro-optic camera units which give stereo information for use in determining three dimensional target locations. Specially developed, infrared sensitive photodetectors are used in the cameras to sense radiation from light emitting diode targets. Up to 30 of these targets can be monitored with a sampling rate of 312 Hz per target. An important part of the system is a minicomputer which is used to collect the camera data, sort it, make corrections for distortions in the electro-optic system, and perform the necesssary coordinate transformations. If target motions are restricted to locations in a plane which is perpendicular to a camera's optical axis, the system can be used with just one camera. Calibrations performed in this mode characterize accuracies in single camera operation. This information is also useful in determination of single camera contributions to total system errors. For this reason the system was tested in both the single camera and two camera (stereo) modes of operation.

Monteith, J. H.↗

Robonaut 2 - IVA Experiments On-Board ISS and Development Towards EVA Capability

Robonaut 2 (R2) has completed its fixed base activities on-board the ISS and is scheduled to receive its climbing legs in early 2014. In its continuing line of firsts, the R2 torso finished up its on-orbit activities on its stanchion with the manipulation of space blanket materials and performed multiple tasks under teleoperation control by IVA astronauts. The successful completion of these two IVA experiments is a key step in Robonaut's progression towards an EVA capability. Integration with the legs and climbing inside the ISS will provide another important part of the experience that R2 will need prior to performing tasks on the outside of ISS. In support of these on-orbit activities, R2 has been traversing across handrails in simulated zero-g environments and working with EVA tools and equipment on the ground to determine manipulation strategies for an EVA Robonaut. R2 made significant advances in robotic manipulation of deformable materials in space while working with its softgoods task panel. This panel features quarter turn latches that secure a space blanket to the task panel structure. The space blanket covers two cloth cubes that are attached with Velcro to the structure. R2 was able to open and close the latches, pull back the blanket, and remove the cube underneath. R2 simulated cleaning up an EVA worksite as well, by replacing the cube and reattaching the blanket. In order to interact with the softgoods panel, R2 has both autonomously and with a human in the loop identified and localized these deformable objects. Using stereo color cameras, R2 identified characteristic elements on the softgoods panel then extracted the location and orientation of the object in its field of view using stereo disparity and kinematic transforms. R2 used both vision processing and supervisory control to successfully accomplish this important task. Teleoperation is a key capability for Robonaut's effectiveness as an EVA system. To build proficiency, crewmembers have attempted increasingly difficult tasks using R2 inside the Station. After donning motion capture equipment and a virtual reality visor, Expedition 34/35 flight engineer Tom Marshburn began operations with simple hand movements. Having gained confidence, Marshburn guided R2's arms in a leader-follower exercise with crewmate Chris Cassidy. He was also able to use the hand to grab a tumbling roll of tape, a task only demonstrable in microgravity. Later efforts saw Cassidy handle softgoods through shared control with ground operators, mimicking an activity previously achieved using only autonomy. Robotic climbing through the ISS on handrails requires both precision motion and compliant grasps in order to both position grippers on handrails/seat track and prevent large internal forces. R2 climbs using actively controlled compliance and torque limiting to meet both the precision and softness requirements. During a step, the attached leg is controlled to be strong and stiff in order to maintain precision trajectory tracking. The swing leg is controlled to be stiff but weak to minimize unintentional impact forces while maintaining precision. During a simulated dual limb grasp (as shown in Figure 1), the R2 controller maintains one limb rigid and one limb soft to prevent large internal forces from building up. R2's grippers also use a form of force control to limit grip force while not fully closed on either a handrail or seat track thus limiting unintentional forces on cables/objects that may be present in R2's translational path. The on-board torso R2 safety system relies on a single end-effector velocity limit to prevent potential impact forces from exceeding Station maximum load requirements. R2's mobile configuration required modifications to the velocity limiting safety function due to its large, dynamic inertia. R2's legs maneuver the robot's mass creating configuration dependent, joint-relative inertias. A single all-encompassing velocity limit to cover worst case inertia is prohibitively low. The upgraded R2 control and safety systems solve this problem using momentum limiting, momentum control, and kinetic energy minimization. Momentum and kinetic energy take the robot mass into account relieving low velocity restrictions on low inertia end-effectors while ensuring that the overall mass of R2 is limited from hazardous velocities. The momentum of R2's five safety nodes (each of the four end-effectors and the body) is monitored and compared to a single momentum limit. If any of the five nodes exceeds the safety limit, the motor power is removed and the robot comes to a stop. Momentum control/limiting also provides a simple, reliable method to integrate hand held tools into the safety system by providing the tool mass to the control system thus automatically reducing the allowable velocity of the end-effector with the tool. Work on the ground continues to build the skill set for an EVA Robonaut. Recent experiments (Figure 2) demonstrate how a teleoperator can use R2 to manipulate a tether hook, an important safety precaution on spacewalks. Another task displayed Robonaut's ability to pull back a protective jacket over a hose and search for damage, as well as inspect a quick-disconnect fitting for debris. Demonstrations such as these are indicative of EVA work done on ISS, specifically seen during a series of spacewalks over 2012 and 2013 where astronauts searched for an ammonia leak in one of the external cooling loops. Through experiments both on ISS and on the ground, R2 is evolving and providing the information needed to plan out the upgrades that will make an EVA Robonaut an effective tool. With the addition of legs, R2 will start climbing inside the space station and supply invaluable information on how the climbing strategies and task stabilization techniques must be refined. Ground R2 systems will continue to work with additional EVA tools and equipment in preparation for onboard IVA testing and future EVA applications.

Diftler, Myron↗

Graphic overlays in high-precision teleoperation: Current and future work at JPL

In space teleoperation additional problems arise, including signal transmission time delays. These can greatly reduce operator performance. Recent advances in graphics open new possibilities for addressing these and other problems. Currently a multi-camera system with normal 3-D TV and video graphics capabilities is being developed. Trained and untrained operators will be tested for high precision performance using two force reflecting hand controllers and a voice recognition system to control two robot arms and up to 5 movable stereo or non-stereo TV cameras. A number of new techniques of integrating TV and video graphics displays to improve operator training and performance in teleoperation and supervised automation are evaluated.

Diner, Daniel B.↗

Viking Lander Atlas of Mars

Half size reproductions are presented of the extensive set of systematic map products generated for the two Mars Viking landing sites from stereo pairs of images radioed back to Earth. The maps span from the immediate foreground to the remote limits of ranging capability, several hundred meters from the spacecraft. The maps are of two kinds - elevation contour and vertical profile. Background and explanatory material important for understanding and utilizing the map collection included covers the Viking Mission, lander locations, lander cameras, the stereo mapping system and input images to this system.

Liebes, S., Jr.↗

Robot vision.

The work reported had been undertaken to develop hardware that would guide an automatic vehicle in the exploration of the surface of Mars, recognize objects, and report the findings to earth. Approaches for automatically determining the range and shape of objects are discussed, giving attention to the automatic comparison of one scan line of the left with one scan line of the right TV image. Methods of mapping binocular space into match space are considered together with the use of a model in match space, rules for processing random-dot stereograms, the elimination of spurious matches, random-square stereograms, questions of the processing of a real scene, and aspects of range accuracy. Methods of computation for extracting other features are also discussed along with stereo TV cameras and approaches for reconstructing the appearance of a scene.

Sutro, L. L.↗

Robots in space exploration

A brief outline of NASA's current robotics program is presented. Efforts are being concentrated on a roving surface vehicle for Mars exploration. This vehicle will integrate manipulative, locomotive, and visual functions and will feature an electromechanical manipulator, stereo TV cameras, a laser rangefinder, a minicomputer, and a remote off-line computer. The program hinges on the iterative development of complex scenarios describing the robot's mission and the interrelationships among its various subsystems.

Dobrotin, B. M.↗

Computer vision

The field of computer vision is surveyed and assessed, key research issues are identified, and possibilities for a future vision system are discussed. The problems of descriptions of two and three dimensional worlds are discussed. The representation of such features as texture, edges, curves, and corners are detailed. Recognition methods are described in which cross correlation coefficients are maximized or numerical values for a set of features are measured. Object tracking is discussed in terms of the robust matching algorithms that must be devised. Stereo vision, camera control and calibration, and the hardware and systems architecture are discussed.

Gennery, D.↗

The Athena Pancam and Color Microscopic Imager (CMI)

The Athena Mars rover payload includes two primary science-grade imagers: Pancam, a multispectral, stereo, panoramic camera system, and the Color Microscopic Imager (CMI), a multispectral and variable depth-of-field microscope. Both of these instruments will help to achieve the primary Athena science goals by providing information on the geology, mineralogy, and climate history of the landing site. In addition, Pancam provides important support for rover navigation and target selection for Athena in situ investigations. Here we describe the science goals, instrument designs, and instrument performance of the Pancam and CMI investigations.

Bell, J. F., III↗

Remotely-Sensed Geology from Lander-Based to Orbital Perspectives: Results for FIDO Rover Field Tests

Tests of the FIDO (Field Integration Design and Operations) rover and Athena-like operational scenarios were conducted May 7-16, 2000. A group located at the Jet Propulsion Lab, Pasadena, CA, formed the Core Operations Team (COT) that designed experiments and command sequences while another team tracked, maintained, and secured the rover in the field. The COT had no knowledge of the specific field location, thus the tests were done "blind." In addition to FIDO rover instrumentation, the COT had access to LANDSAT 7, TIMS, and AVIRIS regional coverage and color descent images. Using data from the FIDO instruments, primarily a color microscopic imager (CMI), infrared point spectrometer (IPS; 1.5-2.4 microns), and a three-color stereo panoramic camera (Pancam), the COT correlated lithologic features (mineralogy, rock types) from the simulated landing site to a regional scale. The May test results provide an example of how to relate site geology from landed rover investigations to the regional geology using remote sensing. The capability to relate mineralogic signatures using the point IR spectrometer to remotely sensed, multispectral or hyperspectral data proved to be key to integration of the in-situ and remote data. This exercise demonstrated the potential synergy between lander-based and orbital data, and highlighted the need to investigate a landing site in detail and at multiple scales.

Jolliff, B.↗

Evaluation of a Compression-Loaded-Stitched-Multi-Bay Fuselage Panel With Barely Visible Impact Damage

The experimental results from a stitched VaRTM carbon-epoxy composite panel tested under uni-axial compression loading are presented along with nonlinear finite element analysis prediction of the response. The curved panel is divided by frames and stringers into six bays with a column of three bays along the compressive loading direction. The frames are supported at the frame ends to resist out-of-plane translation. Back-to-back strain gages are used to record the strain and displacement transducers were used to record the out-of-plane displacements. In addition a full-field-displacement measurement technique that utilizes a camera-based-stereo-vision system was used to record the displacements. The panel was loaded to 1.5 times the predicted initial buckling load (1st bay buckling load, P(sub er) from the nonlinear finite element analysis and then was removed from the test machine for impact testing. After impacting with 20 ft-lbs of energy using a spherical impactor to produce barely visible damage the panel was loaded in compression until failure. The buckling load of the first bay to buckle was 97% of the buckling load before impact. The stitching constrained the impact damage from growing during the loading to failure. Impact damage had very little overall effect on panel stiffness. Panel stiffness measured by the full-field-displacement technique indicated a 13% loss in stiffness after impact. The panel failed at 1.64 times the first panel buckling load. The barely visible impact damage did not grow noticeably as the panel failed by global instability due to stringer-web terminations at the frame locations. The predictions from the nonlinear analysis of the finite element modeling of the entire specimen were very effective in the capture of the initial buckling and global behavior of the panel. In addition, the prediction highlighted the weakness of the panel under compression due to stringer web terminations. Both the test results and the nonlinear predictions serve to reinforce the severe penalty in structural integrity caused by the low cost manufacturing technique to terminate the stringer webs, and demonstrates the importance of this type of sub-component testing and high fidelity failure analysis in the design of a composite fuselage.

Baker, Donald J.↗

Progress in Development of the Axel Rovers

Progress has been made in the development of a family of robotic land vehicles having modular and minimalist design features chosen to impart a combination of robustness, reliability, and versatility. These vehicles at earlier stages of development were described in two previous NASA Tech Briefs articles: "Reconfigurable Exploratory Robotic Vehicles" (NPO-20944), Vol. 25, No. 7 (July 2001), page 56; and "More About Reconfigurable Exploratory Robotic Vehicles" (NPO-30890), Vol. 33, No. 8 (August 2009), page 40. Conceived for use in exploration of the surfaces of Mars and other remote planets, these vehicles could also be adapted to terrestrial applications, including exploration of volcanic craters or other hostile terrain, military reconnaissance, inspection of hazardous sites, and searching for victims of earthquakes, landslides, avalanches, or mining accidents. In addition, simplified versions of these vehicles might be marketable as toys. The most basic module in this family of reconfigurable robots is the Axel rover, which has a cylindrical body with two main wheels and a trailing link. Inside its body are three motors and associated mechanisms for driving the two wheels and for rotating the link 360 around its symmetrical body. The actuated link serves several purposes: It is used as a lever arm to react to the wheels thrust to move Axel in multiple directions. It is used to rotate the Axel housing in order to tilt, to the desired angle, any sensors and instruments mounted on or in the Axel housing. It provides an alternative mobility mode, which is primarily used in its tethered configuration. Turn ing the link into the ground in lieu of driving the wheels causes the Axel housing and wheels to roll as a unit and thereby leads to a tumbling motion along the ground. With a tether mounted around Axel s cylindrical body, the link serves as a winch mechanism to reel and unreel the tether raising and lowering Axel over steep and vertical surfaces (Figure 1). Sensors, computation, and communication modules are also housed inside Axel s body. A pair of stereo vision cameras provides three-dimensional view for autonomous navigation and avoiding obstacles. Inertial sensors determine the tilt of the robot and are used for estimating its motion. In a fully developed version, power would be supplied by rechargeable batteries aboard Axel; at the time of reporting the information for this article, power was supplied from an external source via a cable. In and of itself, the Axel rover is fully capable of traversing and sampling terrains on planetary surfaces. By use of only the two main wheel actuators and the caster link actuator, Axel can be made to follow an arbitrary path, turn in place, and operate upside- down or right-side-up. If operated in a tethered configuration, as shown in Figure 1, it can be made to move down and up a steep crater wall, descend from an overhang to a cave, and ascend from the cave back to the overhang, all by use of the same three actuators. Such tethered operation could be useful in searching for accident victims or missing persons in mines, caves, and rubble piles. Running the tether through the caster link enhances the stability of Axel and provides a restoring force that keeps the link off the ground for the most part during operation on a steep slope. In its extended configuration, two Axel modules can dock to either side of a payload module to form the four wheeled Axel2 rover (Figure 2). Additional payload and Axel modules can dock to either side of the Axel2 to form the Axel3 rover, extending its payload capacity and its mobility capabilities.

Nesnas, Issa A.↗

Construction and Resource Utilization Explorer: Regolith Characterization Using a Modular Instrument Suite and Analysis Tools

The Construction Resource Utilization Explorer (CRUX) is a technology maturation project for the U.S. National Aeronautics and Space Administration to provide enabling technology for lunar and planetary surface operations (LPSO). The CRUX will have 10 instruments, a data handling function (Mapper - with features of data subscription, fusion, interpretation, and publication through geographical information system [GIs] displays), and a decision support system DSS) to provide information needed to plan and conduct LPSO. Six CRUX instruments are associated with an instrumented drill to directly measure regolith properties (thermal, electrical, mechanical, and textural) and to determine the presence of water and other hydrogen sources to a depth of about 2 m (Prospector). CRUX surface and geophysical instruments (Surveyor) are designed to determine the presence of hydrogen, delineate near subsurface properties, stratigraphy, and buried objects over a broad area through the use of neutron and seismic probes, and ground penetrating radar. Techniques to receive data from existing space qualified stereo pair cameras to determine surface topography will also be part of the CRUX. The Mapper will ingest information from CRUX instruments and other lunar and planetary data sources, and provide data handling and display features for DSS output. CRUX operation will be semi-autonomous and near real-time to allow its use for either planning or operations purposes.

Moon↗

Boundary Layer Remote Sensing with Combined Active and Passive Techniques: GPS Radio Occultation and High-Resolution Stereo Imaging (WindCam) Small Satellite Concept

Objective: significant progress in understanding low-cloud boundary layer processes. This is the Single largest uncertainty in climate projections. Radio occultation has unique features suited to boundary layer remote sensing (1) Cloud penetrating (2) Very high vertical resolution (approximately 50m-100m) (3) Sensitivity to thermodynamic variables

stereo camera↗

Tracking the Momentum Flux of a CME and Quantifying Its Influence on Geomagnetically Induced Currents at Earth

We investigate a coronal mass ejection (CME) propagating toward Earth on 29 March 2011. This event is specifically chosen for its predominately northward directed magnetic field, so that the influence from the momentum flux onto Earth can be isolated. We focus our study on understanding how a small Earth-directed segment propagates. Mass images are created from the white-light cameras onboard STEREO which are also converted into mass height-time maps (mass J-maps). The mass tracks on these J-maps correspond to the sheath region between the CME and its associated shockfront as detected by in situ measurements at L1. A time series of mass measurements from the STEREOCOR-2A instrument is made along the Earth propagation direction. Qualitatively, this mass time series shows a remarkable resemblance to the L1 in situ density series. The in situ measurements are used as inputs into a three-dimensional (3-D) magnetospheric space weather simulation from the Community Coordinated Modeling Center. These simulations display a sudden compression of the magnetosphere from the large momentum flux at the leading edge of the CME, and predictions are made for the time derivative of the magnetic field (dBdt) on the ground. The predicted dBdt values were then compared with the observations from specific equatorially located ground stations and showed notable similarity. This study of the momentum of a CME from the Sun down to its influence on magnetic ground stations on Earth is presented as a preliminary proof of concept, such that future attempts may try to use remote sensing to create density and velocity time series as inputs to magnetospheric simulations.

time series analysis↗

Autonomous Rover Traverse and Precise Arm Placement on Remotely Designated Targets

This software controls a rover platform to traverse rocky terrain autonomously, plan paths, and avoid obstacles using its stereo hazard and navigation cameras. It does so while continuously tracking a target of interest selected from 10 20 m away. The rover drives and tracks the target until it reaches the vicinity of the target. The rover then positions itself to approach the target, deploys its robotic arm, and places the end effector instrument on the designated target to within 2-3-cm accuracy of the originally selected target. This software features continuous navigation in a fairly rocky field in an outdoor environment and the ability to enable the rover to avoid large rocks and traverse over smaller ones. Using point-and-click mouse commands, a scientist designates targets in the initial imagery acquired from the rover s mast cameras. The navigation software uses stereo imaging, traversability analysis, path planning, trajectory generation, and trajectory execution. It also includes visual target tracking of a designated target selected from 10 m away while continuously navigating the rocky terrain. Improvements in this design include steering while driving, which uses continuous curvature paths. There are also several improvements to the traversability analyzer, including improved data fusion of traversability maps that result from pose estimation uncertainties, dealing with boundary effects to enable tighter maneuvers, and handling a wider range of obstacles. This work advances what has been previously developed and integrated on the Mars Exploration Rovers by using algorithms that are capable of traversing more rock-dense terrains, enabling tight, thread-the-needle maneuvers. These algorithms were integrated on the newly refurbished Athena Mars research rover, and were fielded in the JPL Mars Yard. Forty-three runs were conducted with targets at distances ranging from 5 to 15 m, and a success rate of 93% was achieved for placement of the instrument within 2-3 cm of the target.

Nesnas, Issa A.↗

Stereo mapping with the Viking Lander camera imagery

Stereomapping techniques applicable to the processing of imagery from facsimile cameras on board the Viking Mars landing vehicles are discussed. Two methods of stereomapping are considered: use of a gnomonic projection to transform the digital imagery to an equivalent of a perspective projection by computerized rectification through image processing; and interfacing a high-speed digital computer to an analytical plotter so that rectification and corrections proceed in real time. Contour maps produced during tests of the Viking Lander cameras, as well as maps of the area surrounding the Viking Lander on the Martian surface, are presented.

Wu, S. S. C.↗