Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stereo camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

Ten-Meter Scale Topography and Roughness of Mars Exploration Rovers Landing Sites and Martian Polar Regions

The Mars Orbiter Camera (MOC) has been operating on board of the Mars Global Surveyor (MGS) spacecraft since 1998. It consists of three cameras - Red and Blue Wide Angle cameras (FOV=140 deg.) and Narrow Angle camera (FOV=0.44 deg.). The Wide Angle camera allows surface resolution down to 230 m/pixel and the Narrow Angle camera - down to 1.5 m/pixel. This work is a continuation of the project, which we have reported previously. Since then we have refined and improved our stereo correlation algorithm and have processed many more stereo pairs. We will discuss results of our stereo pair analysis located in the Mars Exploration rovers (MER) landing sites and address feasibility of recovering topography from stereo pairs (especially in the polar regions), taken during MGS 'Relay-16' mode.

Ivanov, Anton B.↗
NASA NTRS2005

Operation and Performance of the Mars Exploration Rover Imaging System on the Martian Surface

This slide presentation details the Mars Exploration Rover (MER) imaging system. Over 144,000 images have been gathered from all Mars Missions, with 83.5% of them being gathered by MER. Each Rover has 9 cameras (Navcam, front and rear Hazcam, Pancam, Microscopic Image, Descent Camera, Engineering Camera, Science Camera) and produces 1024 x 1024 (1 Megapixel) images in the same format. All onboard image processing code is implemented in flight software and includes extensive processing capabilities such as autoexposure, flat field correction, image orientation, thumbnail generation, subframing, and image compression. Ground image processing is done at the Jet Propulsion Laboratory's Multimission Image Processing Laboratory using Video Image Communication and Retrieval (VICAR) while stereo processing (left/right pairs) is provided for raw image, radiometric correction; solar energy maps,triangulation (Cartesian 3-spaces) and slope maps.

imaging↗
NASA NTRS1999

Location and Geologic Setting for the Three U.S. Mars Landers

Super resolution of the horizon at both Viking landing sites has revealed "new" features we use for triangulation, similar to the approach used during the Mars Pathfinder Mission. We propose alternative landing site locations for both landers for which we believe the confidence is very high. Super resolution of VL-1 images also reveals some of the drift material at the site to consist of gravel-size deposits. Since our proposed location for VL-2 is NOT on the Mie ejecta blanket, the blocky surface around the lander may represent the meter-scale texture of "smooth palins" in the region. The Viking Lander panchromatic images typically offer more repeat coverage than does the IMP on Mars Pathfinder, due to the longer duration of these landed missions. Sub-pixel offsets, necessary for super resolution to work, appear to be attributable to thermal effects on the lander and settling of the lander over time. Due to the greater repeat coverage (particularly in the near and mid-fields) and all-panchromatic images, the gain in resolution by super resolution processing is better for Viking than it is with most IMP image sequences. This enhances the study of textural details near the lander and enables the identification rock and surface textures at greater distances from the lander. Discernment of stereo in super resolution im-ages is possible to great distances from the lander, but is limited by the non-rotating baseline between the two cameras and the shorter height of the cameras above the ground compared to IMP. With super resolution, details of horizon features, such as blockiness and crater rim shapes, may be better correlated with Orbiter images. A number of horizon features - craters and ridges - were identified at VL-1 during the misison, and a few hils and subtle ridges were identified at VL-2. We have added a few "new" horizon features for triangulation at the VL-2 landing site in Utopia Planitia. These features were used for independent triangulation with features visible in Viking Orbiter and MGS MOC images, though the actual location of VL-1 lies in a data dropout in the MOC image of the area. Additional information is contained in the original extended abstract.

Parker, T. J.↗
NASA NTRS1975

Solid state electro-optic color filter and iris

A pair of solid state electro-optic filters (SSEF) in a binocular holder were designed and fabricated for evaluation of field sequential stereo TV applications. The electronic circuitry for use with the stereo goggles was designed and fabricated, requiring only an external video input. A polarizing screen suitable for attachment to various size TV monitors for use in conjunction with the stereo goggles was designed and fabricated. An improved engineering model 2 filter was fabricated using the bonded holder technique developed previously and integrated to a GCTA color TV camera. An engineering model color filter was fabricated and assembled using PLZT control elements. In addition, a ruggedized holder assembly was designed, fabricated and tested. This assembly provides electrical contacts, high voltage protection, and support for the fragile PLZT disk, and also permits mounting and optical alignment of the associated polarizers.

Source record↗
NASA NTRS1982

Photogrammetric application of Viking orbital photography

The paper describes special techniques for the photogrammetric compilation of topographic maps and profiles from stereoscopic photographs taken by the two Viking Orbiter spacecraft. These techniques were developed because the extremely narrow field of view of the Viking cameras rules out compilation by conventional photogrammetric methods. The techniques adjust for internal consistency the Supplementary Experimental Data Record and the computation of geometric orientation parameters of the stereo models. A series of contour maps of Mars is being compiled by these new techniques using a wide variety of Viking Orbiter photographs.

Wu, S. S. C.↗
NASA NTRS1992

On line quantification of crystal surfaces by stereo imaging

The shape of an interface while a crystal is growing inside a crystal growth furnace is an important measurement to assess the crystal quality on-line. If the crystal surface can be visualized by video or x ray imaging, the interface shape can be determined by the stereo image processing techniques. This paper presents a methodology to determine the shape of the solid-melt interface by stereo based imaging techniques while the crystal is growing inside a transparent furnace. The methodology generates qualitative shape information provided that a good pair of stereo images of the interface can be captured. For a quantitative shape description, i.e., for the determination of interface points with respect to a fixed coordinate frame, both cameras must be calibrated. This paper illustrates the methodology for qualitative shape determination of lead bromide crystal interface.

Batur, Celal↗
NASA NTRS2003

MRO High Resolution Imaging Science Experiment (HiRISE): Instrument Development

The primary functional requirement of the HiRISE imager is to allow identification of both predicted and unknown features on the surface of Mars to a much finer resolution and contrast than previously possible. This results in a camera with a very wide swath width, 6km at 300km altitude, and a high signal to noise ratio, >100:1. Generation of terrain maps, 30 cm vertical resolution, from stereo images requires very accurate geometric calibration. The project limitations of mass, cost and schedule make the development challenging. In addition, the spacecraft stability must not be a major limitation to image quality. The nominal orbit for the science phase of the mission is a 3pm orbit of 255 by 320 km with periapsis locked to the south pole. The track velocity is approximately 3,400 m/s.

Alan Delamere↗
NASA NTRS2011

FPGA Implementation of Stereo Disparity with High Throughput for Mobility Applications

High speed stereo vision can allow unmanned robotic systems to navigate safely in unstructured terrain, but the computational cost can exceed the capacity of typical embedded CPUs. In this paper, we describe an end-to-end stereo computation co-processing system optimized for fast throughput that has been implemented on a single Virtex 4 LX160 FPGA. This system is capable of operating on images from a 1024 x 768 3CCD (true RGB) camera pair at 15 Hz. Data enters the FPGA directly from the cameras via Camera Link and is rectified, pre-filtered and converted into a disparity image all within the FPGA, incurring no CPU load. Once complete, a rectified image and the final disparity image are read out over the PCI bus, for a bandwidth cost of 68 MB/sec. Within the FPGA there are 4 distinct algorithms: Camera Link capture, Bilinear rectification, Bilateral subtraction pre-filtering and the Sum of Absolute Difference (SAD) disparity. Each module will be described in brief along with the data flow and control logic for the system. The system has been successfully fielded upon the Carnegie Mellon University's National Robotics Engineering Center (NREC) Crusher system during extensive field trials in 2007 and 2008 and is being implemented for other surface mobility systems at JPL.

Random access memory↗
NASA NTRS1979

Recent developments at JPL in the application of image processing to astronomy

Four applications of image processing to astronomy, automated location and analysis of star and galaxy images, geometric and radiometric decalibration of vidicon spectra, display of multiband radio images, and generation of high resolution polarization direction and magnitude maps from images are presented with illustrative examples. The technique by which a digital image can be analyzed automatically to locate and segregate between stars and galaxies and the steps performed by the classifier to determine the nature of each object are outlined. The classification program executed on a 48 inch Schmidt plate of the cluster of galaxies 655 is described. The calibration and decalibration steps to remove geometric and radiometric distortions from a silicon vidicon camera digital spectra are discussed. Three methods of displaying multispectral radio data, generating a mosaic of each image, producing a color coded image to depict radio velocity, and producing a stereo pair with radial velocity as depth are described. The generation of polarization information from images obtained through linear polarizing filters is illustrated, and it is concluded that in each case information was displayed using digital techniques which could not readily have been provided visually.

Lorre, J. J.↗
NASA NTRS2012

MISR 17.6 KM Gridded Cloud Motion Vectors: Overview and Assessment

The MISR (Multi-angle Imaging SpectroRadiometer) instrument on the Terra satellite has been retrieving cloud motion vectors (CMVs) globally and almost continuously since early in 2000. In February 2012 the new MISR Level 2 Cloud product was publicly released, providing cloud motion vectors at 17.6 km resolution with improved accuracy and roughly threefold increased coverage relative to the 70.4 km resolution vectors of the current MISR Level 2 Stereo product (which remains available). MISR retrieves both horizontal cloud motion and height from the apparent displacement due to parallax and movement of cloud features across three visible channel (670nm) camera views over a span of 200 seconds. The retrieval has comparable accuracy to operational atmospheric motion vectors from other current sensors, but holds the additional advantage of global coverage and finer precision height retrieval that is insensitive to radiometric calibration. The MISR mission is expected to continue operation for many more years, possibly until 2019, and Level 2 Cloud has the possibility of being produced with a sensing-to-availability lag of 5 hours. This report compares MISR CMV with collocated motion vectors from arctic rawinsonde sites, and from the GOES and MODISTerra instruments. CMV at heights below 3 km exhibit the smallest differences, as small as 3.3 m/s for MISR and GOES. Clouds above 3 km exhibit larger differences, as large as 8.9 m/s for MISR and MODIS. Typical differences are on the order of 6 m/s.

MISR (Multi-angle Imaging SpectroRadiometer)↗
NASA NTRSDate not supplied

Towards An Autonomous sUAS Operating in UTM TCL4+ and STEReO Fire Scenario

This study presents two sUAS payload point designs for enabling autonomous BVLOS flight in UTM TCL4+ urban environments and STEReO fire responses. The payload components for the first payload include an onboard computer and a 360 LIDAR. The second payload, which is a continuation of the first, adds a range finder altimeter, downward-facing monocular camera, forward-facing thermal and visible light dual camera, vehicle-to-vehicle radio modem, and Li-ion smart battery. The components are mounted on enclosed structural frames that were designed in-house. Placing the autonomy components onboard leverages the advantages of sUAS over manned aircraft such as low-cost, quick response time, and increased scalability. Autonomous capabilities include embedded processing, SLAM, object and fire detection, and V2V communication. Data processing is conducted onboard the aircraft to eliminate the dependency on a groundstation downlink. The first iteration of the payload is tested in both simulation and flight tests while the continuing iteration is in development.

Autonomous UAS↗
NASA NTRS2008

MISR Instrument Data Visualization

The MISR Interactive eXplorer (MINX) software functions both as a general-purpose tool to visualize Multiangle Imaging SpectroRadiometer (MISR) instrument data, and as a specialized tool to analyze properties of smoke, dust, and volcanic plumes. It includes high-level options to create map views of MISR orbit locations; scrollable, single-camera RGB (red-greenblue) images of MISR level 1B2 (L1B2) radiance data; and animations of the nine MISR camera images that provide a 3D perspective of the scenes that MISR has acquired. NASA Tech Briefs, September 2008 55 The plume height capability provides an accurate estimate of the injection height of plumes that is needed by air quality and climate modelers. MISR provides global high-quality stereo height information, and this program uses that information to perform detailed height retrievals of aerosol plumes. Users can interactively digitize smoke, dust, or volcanic plumes and automatically retrieve heights and winds, and can also archive MISR albedos and aerosol properties, as well as fire power and brightness temperatures associated with smoke plumes derived from Moderate Resolution Imaging Spectroradiometer (MODIS) data. Some of the specialized options in MINX enable the user to do other tasks. Users can display plots of top-of-atmosphere bidirectional reflectance factors (BRFs) versus camera-angle for selected pixels. Images and animations can be saved to disk in various formats. Also, users can apply a geometric registration correction to warp camera images when the standard processing correction is inadequate. It is possible to difference the images of two MISR orbits that share a path (identical ground track), as well as to construct pseudo-color images by assigning different combinations of MISR channels (angle or spectral band) to the RGB display channels. This software is an interactive application written in IDL and compiled into an IDL Virtual Machine (VM) ".sav" file.

Nelson, David↗
DOE OSTI2022

Combined thermographic phosphor and digital image correlation (TP + DIC) for simultaneous temperature and strain measurements

We report thermographic phosphors (TP) are combined with stereo digital image correlation (DIC) in a novel diagnostic, TP + DIC, to measure full-field surface strains and temperatures simultaneously. The TP + DIC method is presented, including corrections for nonlinear CMOS camera detectors and generation of pixel-wise calibration curves to relate the known temperature to the ratio of pixel intensities between two distinct wavelength bands. Additionally, DIC is employed not only for strain measurements but also for accurate image registration between the two cameras for the two-colour ratio method approach of phosphoric thermography. TP + DIC is applied to characterize the thermo-mechanical response of 304L stainless steel dog bones during tensile testing at different strain rates. The dog bones are patterned for DIC with Mg 3 F 2 GeO 4 :Mn (MFG) via aerosol deposition through a shadow mask. Temperatures up to 425°K (150°C) and strains up to 1.0 mm/mm are measured in the localized necking region, with conservative noise levels of 10°K and 0.01 mm/mm or less. Finally, TP + DIC is compared to the more established method of combining infrared (IR) thermography with DIC (IR + DIC), with results agreeing favourably. Three topics of continued research are identified, including cracking of the aerosol-deposited phosphor DIC features, incomplete illumination for pixels on the border of the phosphor features, and phosphor emission evolution as a function of applied substrate strain. This work demonstrates the combination of phosphor thermography and DIC and lays the foundation for further development of TP + DIC for testing in combined thermo-mechancial environments.

304L stainless steel↗
NASA NTRS1992

Stereo optical guidance system for control of industrial robots

A device for the generation of basic electrical signals which are supplied to a computerized processing complex for the operation of industrial robots. The system includes a stereo mirror arrangement for the projection of views from opposite sides of a visible indicia formed on a workpiece. The views are projected onto independent halves of the retina of a single camera. The camera retina is of the CCD (charge-coupled-device) type and is therefore capable of providing signals in response to the image projected thereupon. These signals are then processed for control of industrial robots or similar devices.

Powell, Bradley W.↗
NASA NTRS1998

Stereo-Video Data Reduction of Wake Vortices and Trailing Aircrafts

This report presents stereo image theory and the corresponding image processing software developed to analyze stereo imaging data acquired for the wake-vortex hazard flight experiment conducted at NASA Langley Research Center. In this experiment, a leading Lockheed C-130 was equipped with wing-tip smokers to visualize its wing vortices, while a trailing Boeing 737 flew into the wake vortices of the leading airplane. A Rockwell OV-10A airplane, fitted with video cameras under its wings, flew at 400 to 1000 feet above and parallel to the wakes, and photographed the wake interception process for the purpose of determining the three-dimensional location of the trailing aircraft relative to the wake. The report establishes the image-processing tools developed to analyze the video flight-test data, identifies sources of potential inaccuracies, and assesses the quality of the resultant set of stereo data reduction.

Alter-Gartenberg, Rachel↗
NASA NTRS1998

Mars Volatiles and Climate Surveyor (MVACS) Integrated Payload for the Mars Polar Lander Mission

The Mars Volatiles and Climate Surveyor (MVACS) integrated payload for the Mars Polar Lander will be launched in January 1999, with a scheduled landing on Mars' south-polar layered deposits in December 1999. Over the course of its 90-day nominal mission during the martian southern spring and summer seasons, it will make in situ measurements that will provide new insights into the behavior and distribution of martian volatiles, MVACS consists of four major instrument systems: a surface stereo imager (SSI), which will acquire multispectral stereo images of the surface and atmosphere; a 2-m robotic arm (RA), which will dig a O.5-m deep trench and acquire surface and subsurface samples that will be imaged by a focusable robotic arm camera (RAC), which will take close-up images of surface and subsurface samples at a spatial resolution of 21 micron; a meteorology package (MET), which will make the first measurements of surface pressure, temperature, and winds in Mars' southern hemisphere and employ a tunable diode laser (TDL) spectrometer to measure the water-vapor concentration and isotopic composition of CO2 in the martian atmosphere; and a thermal and evolved gas analyzer (TEGA), which will use differential scanning calorimetry and TDL-evolved gas analysis to determine the concentrations of ices, adsorbed volatiles, and volatile-bearing minerals in surface and subsurface soil samples. The unique in situ measurements made by MVACS at its high-latitude landing site will define a number of important aspects of the physical, isotopic, and chemical nature of the martian near-surface and subsurface environment that will be valuable in better understanding Mars meteorites and returned samples, as well as in the search for martian resources that could be utilized by humans.

Paige, D. A.↗
NASA NTRS2012

Compact Autonomous Hemispheric Vision System

Solar System Exploration camera implementations to date have involved either single cameras with wide field-of-view (FOV) and consequently coarser spatial resolution, cameras on a movable mast, or single cameras necessitating rotation of the host vehicle to afford visibility outside a relatively narrow FOV. These cameras require detailed commanding from the ground or separate onboard computers to operate properly, and are incapable of making decisions based on image content that control pointing and downlink strategy. For color, a filter wheel having selectable positions was often added, which added moving parts, size, mass, power, and reduced reliability. A system was developed based on a general-purpose miniature visible-light camera using advanced CMOS (complementary metal oxide semiconductor) imager technology. The baseline camera has a 92 FOV and six cameras are arranged in an angled-up carousel fashion, with FOV overlaps such that the system has a 360 FOV (azimuth). A seventh camera, also with a FOV of 92 , is installed normal to the plane of the other 6 cameras giving the system a > 90 FOV in elevation and completing the hemispheric vision system. A central unit houses the common electronics box (CEB) controlling the system (power conversion, data processing, memory, and control software). Stereo is achieved by adding a second system on a baseline, and color is achieved by stacking two more systems (for a total of three, each system equipped with its own filter.) Two connectors on the bottom of the CEB provide a connection to a carrier (rover, spacecraft, balloon, etc.) for telemetry, commands, and power. This system has no moving parts. The system's onboard software (SW) supports autonomous operations such as pattern recognition and tracking.

Pingree, Paula J.↗
NASA NTRS1987

Sensing and perception research for space telerobotics at JPL

PIFLEX is a pipelined-image processor that can perform elaborate computations whose exact nature is not fixed in the hardware, and that can handle multiple images. A wire-wrapped prototype PIFEX module has been produced and debugged, using a version of the convolver composed of three custom VLSI chips (plus the line buffers). A printed circuit layout is being designed for use with a single-chip convolver, leading to production of a PIFEX with about 120 modules. A high-level language for programming PIFEX has been designed, and a compiler will be written for it. The camera calibration software has been completed and tested. Two more terms in the camera model, for lens distortion, probably will be added later. The acquisition and tracking system has been designed and most of it has been coded in Pascal for the MicroVAX-II. The feature tracker, motion stereo module and stereo matcher have executed successfully. The model matcher is still under development, and coding has begun on the tracking initializer. The object tracker was running on a different computer from the VAX, and preliminary runs on real images have been performed there. Once all modules are working, optimization and integration will begin. Finally, when a sufficiently large PIFEX is available, appropriate parts of acquisition and tracking, including much of the feature tracker, will be programmed into PIFEX, thus increasing the speed and robustness of the system.

Gennery, Donald B.↗