Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stereo camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

2003 Mars Exploration Rover Mission: Robotic Field Geologists for a Mars Sample Return Mission

The Mars Exploration Rover (MER) Spirit landed in Gusev crater on Jan. 4, 2004 and the rover Opportunity arrived on the plains of Meridiani Planum on Jan. 25, 2004. The rovers continue to return new discoveries after 4 continuous Earth years of operations on the surface of the red planet. Spirit has successfully traversed 7.5 km over the Gusev crater plains, ascended to the top of Husband Hill, and entered into the Inner Basin of the Columbia Hills. Opportunity has traveled nearly 12 km over flat plains of Meridiani and descended into several impact craters. Spirit and Opportunity carry an integrated suite of scientific instruments and tools called the Athena science payload. The Athena science payload consists of the 1) Panoramic Camera (Pancam) that provides high-resolution, color stereo imaging, 2) Miniature Thermal Emission Spectrometer (Mini-TES) that provides spectral cubes at mid-infrared wavelengths, 3) Microscopic Imager (MI) for close-up imaging, 4) Alpha Particle X-Ray Spectrometer (APXS) for elemental chemistry, 5) Moessbauer Spectrometer (MB) for the mineralogy of Fe-bearing materials, 6) Rock Abrasion Tool (RAT) for removing dusty and weathered surfaces and exposing fresh rock underneath, and 7) Magnetic Properties Experiment that allow the instruments to study the composition of magnetic martian materials [1]. The primary objective of the Athena science investigation is to explore two sites on the martian surface where water may once have been present, and to assess past environmental conditions at those sites and their suitability for life. The Athena science instruments have made numerous scientific discoveries over the 4 plus years of operations. The objectives of this paper are to 1) describe the major scientific discoveries of the MER robotic field geologists and 2) briefly summarize what major outstanding questions were not answered by MER that might be addressed by returning samples to our laboratories on Earth.

Ming, Douglas W.↗

Crater Morphometry and Crater Degradation on Mercury: Mercury Laser Altimeter (MLA) Measurements and Comparison to Stereo-DTM Derived Results

Two types of measurements of Mercury's surface topography were obtained by the MESSENGER (MErcury Surface Space ENvironment, GEochemisty and Ranging) spacecraft: laser ranging data from Mercury Laser Altimeter (MLA) [1], and stereo imagery from the Mercury Dual Imaging System (MDIS) camera [e.g., 2, 3]. MLA data provide precise and accurate elevation meaurements, but with sparse spatial sampling except at the highest northern latitudes. Digital terrain models (DTMs) from MDIS have superior resolution but with less vertical accuracy, limited approximately to the pixel resolution of the original images (in the case of [3], 15-75 m). Last year [4], we reported topographic measurements of craters in the D=2.5 to 5 km diameter range from stereo images and suggested that craters on Mercury degrade more quickly than on the Moon (by a factor of up to approximately 10×). However, we listed several alternative explanations for this finding, including the hypothesis that the lower depth/diameter ratios we observe might be a result of the resolution and accuracy of the stereo DTMs. Thus, additional measurements were undertaken using MLA data to examine the morphometry of craters in this diameter range and assess whether the faster crater degradation rates proposed to occur on Mercury is robust.

morphometry↗

Near real-time stereo vision system

The apparatus for a near real-time stereo vision system for use with a robotic vehicle is described. The system is comprised of two cameras mounted on three-axis rotation platforms, image-processing boards, a CPU, and specialized stereo vision algorithms. Bandpass-filtered image pyramids are computed, stereo matching is performed by least-squares correlation, and confidence ranges are estimated by means of Bayes' theorem. In particular, Laplacian image pyramids are built and disparity maps are produced from the 60 x 64 level of the pyramids at rates of up to 2 seconds per image pair. The first autonomous cross-country robotic traverses (of up to 100 meters) have been achieved using the stereo vision system of the present invention with all computing done onboard the vehicle. The overall approach disclosed herein provides a unifying paradigm for practical domain-independent stereo ranging.

Anderson, Charles H.↗

Photonic Doppler Velocimetry Probe Designed with Stereo Imaging

The velocity distribution of an imploding curved surface is measured with a miniature fiber-optic probe. The probe uses fiber matrix arrays that are focused onto different regions of this curved surface. A pyramid reflector deflects the interrogation onto specific regions of this curved surface. The fiber arrays record velocity along several hundred lines of sight with sub-nanosecond resolution. Reflected light from each spot on the moving surface is Doppler shifted with a small portion of this light propagating backwards through the launching fiber. The reflected light is mixed with a reference laser in a technique called Photonic Doppler velocimetry, providing continuous time records. Within the probe, seven groups of miniature optical relay lenses are grouped into a close-packed array, allowing the interrogation of seven regions of interest. A six-faceted pyramid reflector with a conical hole drilled into its center is used to direct the light beams onto different regions. To minimize back reflections, the fiber matrix arrays are index matched onto the first relay lens made of fused silica. The optical lens design minimizes the laser beam diameters and also provides excellent imaging capabilities. Therefore, two of the fiber matrix arrays are replaced by coherent bundles for stereo imaging recorded by a high-speed framing camera. This requires additional cutouts of the pyramid reflector to allow imaging overlap. Six additional 1.5 mm diameter incoherent bundles are attached to the edges of the pyramid reflector and are used for illumination. Precision metrology on the direction cosines of the trajectories is measured to satisfy environmental requirements for vibration and temperature.

photonic doppler velocimetry, PDV, pyramid reflect↗

ThermalTracker 3D

ThermalTracker-3D is a stereo-vision solution for evaluating flight tracks of birds and bats around offshore wind turbines. Using a pair of thermal video cameras, the technology remotely senses movement of animals and objects, day and night, near critical assets. It generates motion tracks by collapsing a sequence of video frames from each camera into a single image that contains an entire flight track and then applies stereo-vision processing to transform the flight track into three dimensions. The approach allows tracking in near real time and automatically identifies moving objects based on features from the motion track and object size.

Matzner, Shari↗

3D GeoWall Analysis System for Shuttle External Tank Foreign Object Debris Events

An analytical, advanced imaging method has been developed for the initial monitoring and identification of foam debris and similar anomalies that occur post-launch in reference to the space shuttle s external tank (ET). Remote sensing technologies have been used to perform image enhancement and analysis on high-resolution, true-color images collected with the DCS 760 Kodak digital camera located in the right umbilical well of the space shuttle. Improvements to the camera, using filters, have added sharpness/definition to the image sets; however, image review/analysis of the ET has been limited by the fact that the images acquired by umbilical cameras during launch are two-dimensional, and are usually nonreferenceable between frames due to rotation translation of the ET as it falls away from the space shuttle. Use of stereo pairs of these images can enable strong visual indicators that can immediately portray depth perception of damaged areas or movement of fragments between frames is not perceivable in two-dimensional images. A stereoscopic image visualization system has been developed to allow 3D depth perception of stereo-aligned image pairs taken from in-flight umbilical and handheld digital shuttle cameras. This new system has been developed to augment and optimize existing 2D monitoring capabilities. Using this system, candidate sequential image pairs are identified for transformation into stereo viewing pairs. Image orientation is corrected using control points (similar points) between frames to place the two images in proper X-Y viewing perspective. The images are then imported into the WallView stereo viewing software package. The collected control points are used to generate a transformation equation that is used to re-project one image and effectively co-register it to the other image. The co-registered, oriented image pairs are imported into a WallView image set and are used as a 3D stereo analysis slide show. Multiple sequential image pairs can be used to allow forensic review of temporal phenomena between pairs. The observer, while wearing linear polarized glasses, is able to review image pairs in passive 3D stereo.

Brown, Richard↗

The Viking Mars lander camera

The 7.3 kg cameras for the 1976 Viking Mars expedition feature an array of 12 silicon photodiodes, including six spectral bands for color and near-infrared imaging with an angular resolution of 0.12 deg and four focus steps for broadband imaging, with an improved angular resolution of 0.04 deg. The field of view in elevation ranges from 40 deg above to 60 deg below the horizon, and in azimuth ranges to 342.5 deg. The cameras are mounted 0.8 m apart to provide a stereo view of the area accessible to a surface sampler for biological and chemical investigations. The scanning rates are synchronized to the lander data transmission rates of 16000 bits per sec to the Viking orbiters as relay stations and 250 bits per sec directly to earth. However, image data can also be stored on a lander tape recorder. About 10 million bits of image data will be transmitted during most days of the 60-day-long mission planned for each lander.

Huck, F. O.↗

A fuzzy structural matching scheme for space robotics vision

In this paper, we propose a new fuzzy structural matching scheme for space stereo vision which is based on the fuzzy properties of regions of images and effectively reduces the computational burden in the following low level matching process. Three dimensional distance images of a space truss structural model are estimated using this scheme from stereo images sensed by Charge Coupled Device (CCD) TV cameras.

Naka, Masao↗

The Athena Mars Rover Science Payload

The Mars Surveyor missions that will be launched in April of 2001 will include a highly capable rover that is a successor to the Mars Pathfinder mission's Sojourner rover. The design goals for this rover are a total traverse distance of at least 10 km and a total lifetime of at least one Earth year. The rover's job will be to explore a site in Mars' ancient terrain, searching for materials likely to preserve a record of ancient martian water, climate, and possibly biology. The rover will collect rock and soil samples, and will store them for return to Earth by a subsequent Mars Surveyor mission in 2005. The Athena Mars rover science payload is the suite of scientific instruments and sample collection tools that will be used to perform this job. The specific science objectives that NASA has identified for the '01 rover payload are to: (1) Provide color stereo imaging of martian surface environments, and remotely-sensed point discrimination of mineralogical composition. (2) Determine the elemental and mineralogical composition of martian surface materials. (3) Determine the fine-scale textural properties of these materials. (4) Collect and store samples. The Athena payload has been designed to meet these objectives. The focus of the design is on field operations: making sure the rover can locate, characterize, and collect scientifically important samples in a dusty, dirty, real-world environment. The topography, morphology, and mineralogy of the scene around the rover will be revealed by Pancam/Mini-TES, an integrated imager and IR spectrometer. Pancam views the surface around the rover in stereo and color. It uses two high-resolution cameras that are identical in most respects to the rover's navigation cameras. The detectors are low-power, low-mass active pixel sensors with on-chip 12-bit analog-to-digital conversion. Filters provide 8-12 color spectral bandpasses over the spectral region from 0.4 to 1.1 micron Narrow-angle optics provide an angular resolution of 0.28 mrad/pixel, nearly a factor of four higher than that of the Mars Pathfinder and Mars Surveyor '98 cameras. Image compression will be performed using a wavelet compression algorithm. The Mini-Thermal Emission Spectrometer (Mini-TES) is a point spectrometer operating in -the thermal IR. It produces high spectral resolution (5 /cm) image cubes with a wavelength range of 5-40 gm, a nominal signal/noise ratio of 500:1, and a maximum angular resolution of 7 mrad (7 cm at a distance of 10 in). The wavelength region over which it operates samples the diagnostic fundamental absorption features of rockforming minerals, and also provides some capability to see through dust coatings that could tend to obscure spectral features. The mineralogical information that Mini-TES provides will be used to select from a distance the rocks and soils that will be investigated in more detail and ultimately sampled. Mini-TES is derived from the MO/MGS TES instrument, but is significantly smaller and simpler. The instrument uses an 8-cm Cassegrain telescope, a Michelson interferometer, and uncooled pyroelectric detectors. Along with its mineralogical capabilities, Mini-TES can provide information on the thermophysical properties of rocks and soils. Viewing upward, it can also provide temperature profiles through the martian atmospheric boundary layer. Elemental and Mineralogical Composition: Once promising samples have been identified from a distance using Pancam/Mini-TES, they will be studied in detail using up to three compositional sensors that can be placed directly against them by an Instrument Arm. The two compositional sensors, presently on the payload are an Alpha-Proton-X-Ray Spectrometer (APXS), and a Mossbauer Spectrometer. The APXS is derived closely from the instrument that flew on Mars Pathfinder. Radioactive alpha sources and three detection modes (alpha, proton, and x-ray) provide elemental abundances of rocks and soils to complement and constrain mineralogical data. The Athena APXS will have a revised mechanical design that will cut down significantly on backscattering of alpha particles from martian atmospheric carbon. It will also include a target of known elemental composition that will be used for calibration purposes. The Athena Mossbauer Spectrometer is a diagnostic instrument for the mineralogy and oxidation state of Fe-bearing phases, which are particularly important on Mars. The instrument measures the resonant absorption of gamma rays produced by a Co-57 source to determine splitting of nuclear energy levels in Fe atoms that is related to the electronic environment surrounding them. It has been under development for space flight for many years at the Technical University of Darmstadt. The Mossbauer Spectrometer (and the other arm instruments) will be able to view a small permanent magnet array that will attract magnetic particles in the martian soil. The payload may also include a Raman Spectrometer. If included, the Raman Spectrometer will provide precise identification of major and minor mineral phases. It requires no sample preparation, and is also sensitive to organics. Fine-Scale Texture: The Instrument Arm a also carries a Microscopic Imager that will obtain high-resolution monochromatic images of the same materials for which compositional data will be obtained. Its spatial resolution is 20 micron/pixel over a 1 cm depth of field, and 40 micron/pixel over a 1-cm depth of field. Like Pancam, it uses the same active pixel sensor detectors and electronics as the rover's navigation cameras. The Instrument Arm is a three degree-of-freedom arm that uses designs and components from the Mars Pathfinder and Mars Surveyor '98 projects. Its primary function is instrument positioning. Along with the instruments noted above, it also carries a brush that can be used to remove dust and other loose coatings from rocks. Sample Collection and Storage: Martian rock and soil samples will be collected using a low-power rotary coring drill called the Mini-Corer. An important characteristic of this device is that it can obtain intact samples of rock from up to 5 cm within strong boulders and bedrock, Nominal core dimensions are 8xl7 mm. The Mini-Corer drills a core to the commanded depth in a rock, shears it off, retains it, and extracts it. It can also acquire samples of loose soil, using soil sample cups that are pressed downward into loose material. The Mini-Corer can drill at angles from vertical to 45' off vertical. It has six interchangeable bits for long life. Mechanical damage to the sample during drilling is minimal, and heating is negligible. After acquisition, the sample may be viewed by the arm instruments, and/or placed in one of 104 compartments in the Sample Container. A subset of the acquired samples may be replaced with other samples obtained later if desired. The Sample Container has no moving parts, and is mounted external to the rover for easy removal by the Mars Surveyor 2005 flight system. Operation of the rover will make extensive use of automated onboard navigation and hazard avoidance capabilities. Otherwise, use of onboard autonomy is minimal. Data downlink capability is about 40 Mbit/sol, and the use of the Mars Surveyor '01 orbiter for data relay imposes a limit of at most two command cycles per sol. Because of the significant amount of time available between command cycles, all payload elements will be operated sequentially, rather than in parallel.; this approach also significantly simplifies operations and minimizes peak power usage. The landing site for the '01 rover has not been selected yet. Site selection will make as full use as possible of Mars Global Surveyor data, and will involve substantial input from the broad Mars science community. Summary: The following table describes the mass, power, providers, and key scientific objectives of all the major elements of the Athena payload. Additional Athena payload information may be found at: http://astrosun.tn.cornell.edu/athena/index.html. Additional information contained in the original.

Squyes, S. W.↗

Daytime Water Detection Based on Color Variation

Robust water detection is a critical perception requirement for unmanned ground vehicle (UGV) autonomous navigation. This is particularly true in wide open areas where water can collect in naturally occurring terrain depressions during periods of heavy precipitation and form large water bodies (such as ponds). At far range, reflections of the sky provide a strong cue for water. But at close range, the color coming out of a water body dominates sky reflections and the water cue from sky reflections is of marginal use. We model this behavior by using water body intensity data from multiple frames of RGB imagery to estimate the total reflection coefficient contribution from surface reflections and the combination of all other factors. Then we describe an algorithm that uses one of the color cameras in a forward- looking, UGV-mounted stereo-vision perception system to detect water bodies in wide open areas. This detector exploits the knowledge that the change in saturation-to-brightness ratio across a water body from the leading to trailing edge is uniform and distinct from other terrain types. In test sequences approaching a pond under clear, overcast, and cloudy sky conditions, the true positive and false negative water detection rates were (95.76%, 96.71%, 98.77%) and (0.45%, 0.60%, 0.62%), respectively. This software has been integrated on an experimental unmanned vehicle and field tested at Ft. Indiantown Gap, PA.

reflection coefficient↗

Using virtual reality for science mission planning: A Mars Pathfinder case

NASA's Mars Pathfinder Project requires a Ground Data System (GDS) that supports both engineering and scientific payloads with reduced mission operations staffing, and short planning schedules. Also, successful surface operation of the lander camera requires efficient mission planning and accurate pointing of the camera. To meet these challenges, a new software strategy that integrates virtual reality technology with existing navigational ancillary information and image processing capabilities. The result is an interactive workstation based applications software that provides a high resolution, 3-dimensial, stereo display of Mars as if it were viewed through the lander camera. The design, implementation strategy and parametric specification phases for the development of this software were completed, and the prototype tested. When completed, the software will allow scientists and mission planners to access simulated and actual scenes of Mars' surface. The perspective from the lander camera will enable scientists to plan activities more accurately and completely. The application will also support the sequence and command generation process and will allow testing and verification of camera pointing commands via simulation.

Kim, Jacqueline H.↗

Three Dimensional Instantaneous Spray Measurements of Additively Manufactured Candidate Injector Schemes at Varying Pressure Drops

Additively manufactured (AM) injectors have the potential to improve upon the combustion performance achieved using traditionally manufactured (TM) injectors. Traditionally manufactured injector combustion performance decreases greatly in off-design conditions. Additively manufactured injectors hold the potential to sustain high combustion performance over a broader range of operating conditions than currently seen in TM injectors. Additively manufactured injectors promise to offer higher resistances to instability and achieve better overall propellant mixing and atomization for all types of combustion devices. This study expands upon previous studies that used 2-D imaging techniques to characterize the injector spray pattern of candidate AM injector elements. In this study, 3-D instantaneous measurements of the injector spray pattern are taken, allowing for deeper insight into the liquid spray breakup, an inherently 3-D phenomena. Stereo imaging is used for three dimensional analysis, which utilizes two cameras at different angles to reconstruct a three dimensional reconstruction. With this information, AM injectors can be designed to improve propellant mixing and atomization and reduce breakup length. As part of this work, a high-pressure, cold flow experimental spray facility was modified to measure each injector’s spray characteristics in terms of 𝑅𝑒 𝐿 and 𝑊𝑒 𝑔 . This facility is operated to capture instantaneous stereo photographic images, mass flow rates, and injector element thrust for pressure drop across the injector face ranging from 100 to 200 psig at a stiffness ratio of 1.0.

Murphy Mitchell↗

A vision system for a Mars rover

A Mars rover must be able to sense its local environment with sufficient resolution and accuracy to avoid local obstacles and hazards while moving a significant distance each day. Power efficiency and reliability are extremely important considerations, making stereo correlation an attractive method of range sensing compared to laser scanning, if the computational load and correspondence errors can be handled. Techniques for treatment of these problems, including the use of more than two cameras to reduce correspondence errors and possibly to limit the computational burden of stereo processing, have been tested at JPL. Once a reliable range map is obtained, it must be transformed to a plan view and compared to a stored terrain database, in order to refine the estimated position of the rover and to improve the database. The slope and roughness of each terrain region are computed, which form the basis for a traversability map allowing local path planning. Ongoing research and field testing of such a system is described.

Wilcox, Brian H.↗

Robust Mosaicking of Stereo Digital Elevation Models from the Ames Stereo Pipeline

Robust estimation method is proposed to combine multiple observations and create consistent, accurate, dense Digital Elevation Models (DEMs) from lunar orbital imagery. The NASA Ames Intelligent Robotics Group (IRG) aims to produce higher-quality terrain reconstructions of the Moon from Apollo Metric Camera (AMC) data than is currently possible. In particular, IRG makes use of a stereo vision process, the Ames Stereo Pipeline (ASP), to automatically generate DEMs from consecutive AMC image pairs. However, the DEMs currently produced by the ASP often contain errors and inconsistencies due to image noise, shadows, etc. The proposed method addresses this problem by making use of multiple observations and by considering their goodness of fit to improve both the accuracy and robustness of the estimate. The stepwise regression method is applied to estimate the relaxed weight of each observation.

Kim, Tae Min↗

A New Lunar Digital Elevation Model from the Lunar Orbiter Laser Altimeter and SELENE Terrain Camera

We present an improved lunar digital elevation model (DEM) covering latitudes within +/-60 deg, at a horizontal resolution of 512 pixels per degree ( approx.60 m at the equator) and a typical vertical accuracy approx.3 to 4 m. This DEM is constructed from approx.4.5 ×10(exp 9) geodetically-accurate topographic heights from the Lunar Orbiter Laser Altimeter (LOLA) onboard the Lunar Reconnaissance Orbiter, to which we co-registered 43,200 stereo-derived DEMs (each 1 deg×1 deg) from the SELENE Terrain Camera (TC) ( approx.10(exp 10) pixels total). After co-registration, approximately 90% of the TC DEMs show root-mean-square vertical residuals with the LOLA data of < 5 m compared to approx.50% prior to co-registration. We use the co-registered TC data to estimate and correct orbital and pointing geolocation errors from the LOLA altimetric profiles (typically amounting to < 10 m horizontally and < 1 m vertically). By combining both co-registered datasets, we obtain a near-global DEM with high geodetic accuracy, and without the need for surface interpolation. We evaluate the resulting LOLA + TC merged DEM (designated as "SLDEM2015") with particular attention to quantifying seams and crossover errors.

Barker, M. K.↗

Field-sequential stereo television

System includes viewing devices that provide low interference to normal vision. It provides stereo display observable from broader area. Left and right video cameras are focused on object. Output signals from cameras are time provided by each camera. Multiplexed signal, fed to standard television monitor, displays left and right images of object.

Perry, W. E.↗

Observing the Ultrahigh Energy Universe with OWL Eyes

The goal of the Orbiting Wide-field Light-collectors (0WL) mission is to study the origin and physics of the highest energy particles known in nature, the ultra- high energy cosmic rays (UHECRs). The OWL mission consists of telescopes with UV sensitive cameras on two satellites operating in tandem to view in stereo the development of the giant particle showers induced in the Earth s atmosphere by UHECRs. This paper discusses the characteristics of the 0WL mission.

Stecker, F. W.↗