Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stereo camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

An Autonomous sUAS Operating in UTM TCL4+ and STEReO Fire Scenario

This study presents a sUAS payload point design that enables autonomous BVLOS flightin UTM TCL4+ urban environments and STEReO fire responses. The payload components include an onboard computer, 360 deg LIDAR, range finder altimeter, downward-facing monocular camera, forward-facing thermal and visible light dual camera, vehicle-to-vehicle radio modem, and Li-ion smart battery. The components are mounted on an enclosed structural frame that was designed in-house. Placing the autonomy components onboard leverages the advantages of sUAS over manned aircraft such as low-cost, quick response time, and increased scalability. Autonomous capabilities include object and fire detection, V2V communication, embedded processing, and SLAM. Data processing is conducted on-board the aircraft to eliminate the dependency on a ground station downlink. The payload is evaluated in both software simulation as well as flight tests.

Autonomous UAS↗
DOE OSTI2014

SU-E-J-128: 3D Surface Reconstruction of a Patient Using Epipolar Geometry

Purpose: To obtain a 3D surface data of a patient in a non-invasive way can substantially reduce the effort for the registration of patient in radiation therapy. To achieve this goal, we introduced the multiple view stereo technique, which is known to be used in a 'photo tourism' on the internet. Methods: 70 Images were taken with a digital single-lens reflex camera from different angles and positions. The camera positions and angles were inferred later in the reconstruction step. A sparse 3D reconstruction model was locating by SIFT features, which is robust for rotation and shift variance, in each image. We then found a set of correspondences between pairs of images by computing the fundamental matrix using the eight-point algorithm with RANSAC. After the pair matching, we optimized the parameter including camera positions to minimize the reprojection error by use of bundle adjustment technique (non-linear optimization). As a final step, we performed dense reconstruction and associate a color with each point using the library of PMVS. Results: Surface data were reconstructed well by visual inspection. The human skin is reconstructed well, althogh the reconstruction was time-consuming for direct use in daily clinical practice. Conclusion: 3D reconstruction using multi view stereo geometry is a promising tool for reducing the effort of patient setup. This work was supported by JSPS KAKENHI(25861128)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2012

Constructing a Database from Multiple 2D Images for Camera Pose Estimation and Robot Localization

The LMDB (Landmark Database) Builder software identifies persistent image features (landmarks) in a scene viewed multiple times and precisely estimates the landmarks 3D world positions. The software receives as input multiple 2D images of approximately the same scene, along with an initial guess of the camera poses for each image, and a table of features matched pair-wise in each frame. LMDB Builder aggregates landmarks across an arbitrarily large collection of frames with matched features. Range data from stereo vision processing can also be passed to improve the initial guess of the 3D point estimates. The LMDB Builder aggregates feature lists across all frames, manages the process to promote selected features to landmarks, and iteratively calculates the 3D landmark positions using the current camera pose estimations (via an optimal ray projection method), and then improves the camera pose estimates using the 3D landmark positions. Finally, it extracts image patches for each landmark from auto-selected key frames and constructs the landmark database. The landmark database can then be used to estimate future camera poses (and therefore localize a robotic vehicle that may be carrying the cameras) by matching current imagery to landmark database image patches and using the known 3D landmark positions to estimate the current pose.

Wolf, Michael↗
NASA NTRS2004

Daytime Water Detection by Fusing Multiple Cues for Autonomous Off-Road Navigation

Detecting water hazards is a significant challenge to unmanned ground vehicle autonomous off-road navigation. This paper focuses on detecting the presence of water during the daytime using color cameras. A multi-cue approach is taken. Evidence of the presence of water is generated from color, texture, and the detection of reflections in stereo range data. A rule base for fusing water cues was developed by evaluating detection results from an extensive archive of data collection imagery containing water. This software has been implemented into a run-time passive perception subsystem and tested thus far under Linux on a Pentium based processor.

COMPONENT REPORTS↗
NASA NTRS2018

Surface Reconstruction of a Challenging Region with Permanent Shadows on the Moon

As the Earth is orbiting the Sun, there is the region a sunlight can't be reached on the Moon, a satellite of the Earth. Usually, the permanent shadows are located near a pole area and the surface reconstruction in the permanent shadows region is challenging because of the lack of sunlight.In this research, the reconstruction method containing the permanent shadows is suggested. To apply this method, the time-varying shadow region and a permanently shadowed region are needed to be separated. In the time-varying shadow region, the pixel intensity of the image can be composed of the albedo and the reflectance model. Using the light source direction from ISIS3 of USGS, the shape of the region can be extracted from the reflectance model. Though this region is visible in the camera, the change of illumination is quite large in this region, it is hard to reconstruct the shape using stereo-photogrammetry or SfS. So, it is needed of collecting more surface normal information from several pixel level-aligned images. In this process, the albedo information can be initialized and enhanced easily from many images.In the middle of permanent shadows, the high-resolution DEM is generated by LOLA DEM. The LOLA DEM is generated by interpolation between measured data point strips, the actual scene of the permanent shadows. Using the sensor like DIVINER, the Imaginary scene generation via a trained network between the sunlight sensor and other kinds of a sensor is suggested.

Moon, Sunghyun↗
NASA NTRS1995

Stereo-Based Region-Growing using String Matching

We present a novel stereo algorithm based on a coarse texture segmentation preprocessing phase. Matching is performed using a string comparison. Matching sub-strings correspond to matching sequences of textures. Inter-scanline clustering of matching sub-strings yields regions of matching texture. The shape of these regions yield information concerning object's height, width and azimuthal position relative to the camera pair. Hence, rather than the standard dense depth map, the output of this algorithm is a segmentation of objects in the scene. Such a format is useful for the integration of stereo with other sensor modalities on a mobile robotic platform. It is also useful for localization; the height and width of a detected object may be used for landmark recognition, while depth and relative azimuthal location determine pose. The algorithm does not rely on the monotonicity of order of image primitives. Occlusions, exposures, and foreshortening effects are not problematic. The algorithm can deal with certain types of transparencies. It is computationally efficient, and very amenable to parallel implementation. Further, the epipolar constraints may be relaxed to some small but significant degree. A version of the algorithm has been implemented and tested on various types of images. It performs best on random dot stereograms, on images with easily filtered backgrounds (as in synthetic images), and on real scenes with uncontrived backgrounds.

Mandelbaum, Robert↗
NASA NTRS1983

Thunderstorm observations from Space Shuttle

Results of the Nighttime/Daytime Optical Survey of Lightning (NOSL) experiments done on the STS-2 and STS-4 flights are covered. During these two flights of the Space Shuttle Columbia, the astronaut teams of J. Engle and R. Truly, and K. Mattingly II and H. Hartsfield took motion pictures of thunderstorms with a 16 mm cine camera. Film taken during daylight showed interesting thunderstorm cloud formations, where individual frames taken tens of seconds apart, when viewed as stereo pairs, provided information on the three-dimensional structure of the cloud systems. Film taken at night showed clouds illuminated by lightning with discharges that propagated horizontally at speeds of up to 10 to the 5th m/sec and extended for distances on the order of 60 km or more.

Vonnegut, B.↗
NASA NTRS1997

Ranging Apparatus and Method Implementing Stereo Vision System

A laser-directed ranging system for use in telerobotics applications and other applications involving physically handicapped individuals. The ranging system includes a left and right video camera mounted on a camera platform, and a remotely positioned operator. The position of the camera platform is controlled by three servo motors to orient the roll axis, pitch axis and yaw axis of the video cameras, based upon an operator input such as head motion. A laser is provided between the left and right video camera and is directed by the user to point to a target device. The images produced by the left and right video cameras are processed to eliminate all background images except for the spot created by the laser. This processing is performed by creating a digital image of the target prior to illumination by the laser, and then eliminating common pixels from the subsequent digital image which includes the laser spot. The horizontal disparity between the two processed images is calculated for use in a stereometric ranging analysis from which range is determined.

Li, Larry C.↗
NASA NTRS2008

Image Compression Algorithm Altered to Improve Stereo Ranging

A report discusses a modification of the ICER image-data-compression algorithm to increase the accuracy of ranging computations performed on compressed stereoscopic image pairs captured by cameras aboard the Mars Exploration Rovers. (ICER and variants thereof were discussed in several prior NASA Tech Briefs articles.) Like many image compressors, ICER was designed to minimize a mean-square-error measure of distortion in reconstructed images as a function of the compressed data volume. The present modification of ICER was preceded by formulation of an alternative error measure, an image-quality metric that focuses on stereoscopic-ranging quality and takes account of image-processing steps in the stereoscopic-ranging process. This metric was used in empirical evaluation of bit planes of wavelet-transform subbands that are generated in ICER. The present modification, which is a change in a bit-plane prioritization rule in ICER, was adopted on the basis of this evaluation. This modification changes the order in which image data are encoded, such that when ICER is used for lossy compression, better stereoscopic-ranging results are obtained as a function of the compressed data volume.

Kiely, Aaron↗
NASA NTRSDate not supplied

MISR Level 1B2 Ellipsoid Data (MI1B2E_V1)

The MISR instrument consists of nine pushbroom cameras which measure radiance in four spectral bands. Global coverage is achieved in nine days. The cameras are arranged with one camera pointing toward the nadir, four cameras pointing forward and four cameras pointing aftward. It takes 7 minutes for all nine cameras to view the same surface location. The view angles relative to the surface reference ellipsoid, are 0, 26.1, 45.6, 60.0, and 70.5 degrees. The spectral band shapes are nominally gaussian, centered at 443, 555, 670, and 865 nm. The Ellipsoid product is referenced to the World Geodetic System 1984 (WGS84) ellipsoid, which approximates the Earth's shape at sea level. In this product, the radiances and associated altitudes are projected to the ellipsoid, so that higher elevation data appear displaced from their true location for non-nadir camera views, much as they are seen by the instrument. (A cloud at location F, or a mountain top at location T in the image below appears as if it is at location E.) The more oblique the camera view, or the higher in altitude the feature, the more displaced the elevated data will appear. This displacement is used to advantage in MISR stereo retrievals, and this product is the primary input to Level 2 top-of-atmosphere/cloud processing. [Location=GLOBAL] [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=563.2 km (cross-track); Longitude_Resolution=140.8 km (along-track); Horizontal_Resolution_Range=250 meters - < 500 meters; Temporal_Resolution=about 15 orbits/day; Temporal_Resolution_Range=about 15 orbits/day].

EOSDIS↗
NASA NTRS2008

Parallel-Processing Software for Creating Mosaic Images

A computer program implements parallel processing for nearly real-time creation of panoramic mosaics of images of terrain acquired by video cameras on an exploratory robotic vehicle (e.g., a Mars rover). Because the original images are typically acquired at various camera positions and orientations, it is necessary to warp the images into the reference frame of the mosaic before stitching them together to create the mosaic. [Also see "Parallel-Processing Software for Correlating Stereo Images," Software Supplement to NASA Tech Briefs, Vol. 31, No. 9 (September 2007) page 26.] The warping algorithm in this computer program reflects the considerations that (1) for every pixel in the desired final mosaic, a good corresponding point must be found in one or more of the original images and (2) for this purpose, one needs a good mathematical model of the cameras and a good correlation of individual pixels with respect to their positions in three dimensions. The desired mosaic is divided into slices, each of which is assigned to one of a number of central processing units (CPUs) operating simultaneously. The results from the CPUs are gathered and placed into the final mosaic. The time taken to create the mosaic depends upon the number of CPUs, the speed of each CPU, and whether a local or a remote data-staging mechanism is used.

Klimeck, Gerhard↗
NASA NTRSDate not supplied

MISR Level 1B2 Ellipsoid Data (MI1B2E_V2)

The MISR instrument consists of nine pushbroom cameras which measure radiance in four spectral bands. Global coverage is achieved in nine days. The cameras are arranged with one camera pointing toward the nadir, four cameras pointing forward and four cameras pointing aftward. It takes 7 minutes for all nine cameras to view the same surface location. The view angles relative to the surface reference ellipsoid, are 0, 26.1, 45.6, 60.0, and 70.5 degrees. The spectral band shapes are nominally gaussian, centered at 443, 555, 670, and 865 nm. The Ellipsoid product is referenced to the World Geodetic System 1984 (WGS84) ellipsoid, which approximates the Earth's shape at sea level. In this product, the radiances and associated altitudes are projected to the ellipsoid, so that higher elevation data appear displaced from their true location for non-nadir camera views, much as they are seen by the instrument. (A cloud at location F, or a mountain top at location T in the image below appears as if it is at location E.) The more oblique the camera view, or the higher in altitude the feature, the more displaced the elevated data will appear. This displacement is used to advantage in MISR stereo retrievals, and this product is the primary input to Level 2 top-of-atmosphere/cloud processing. [Location=GLOBAL] [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=563.2 km (cross-track); Longitude_Resolution=140.8 km (along-track); Horizontal_Resolution_Range=500 meters - < 1 km; Temporal_Resolution=about 15 orbits/day; Temporal_Resolution_Range=about 15 orbits/day].

EOSDIS↗
NASA NTRS2004

Autonomous Navigation Results from the Mars Exploration Rover (MER) Mission

In January, 2004, the Mars Exploration Rover (MER) mission landed two rovers, Spirit and Opportunity, on the surface of Mars. Several autonomous navigation capabilities were employed in space for the first time in this mission. ]n the Entry, Descent, and Landing (EDL) phase, both landers used a vision system called the, Descent Image Motion Estimation System (DIMES) to estimate horizontal velocity during the last 2000 meters (m) of descent, by tracking features on the ground with a downlooking camera, in order to control retro-rocket firing to reduce horizontal velocity before impact. During surface operations, the rovers navigate autonomously using stereo vision for local terrain mapping and a local, reactive planning algorithm called Grid-based Estimation of Surface Traversability Applied to Local Terrain (GESTALT) for obstacle avoidance. ]n areas of high slip, stereo vision-based visual odometry has been used to estimate rover motion, As of mid-June, Spirit had traversed 3405 m, of which 1253 m were done autonomously; Opportunity had traversed 1264 m, of which 224 m were autonomous. These results have contributed substantially to the success of the mission and paved the way for increased levels of autonomy in future missions.

autonomous↗
NASA NTRSDate not supplied

A Simulated Fire Edge Vis-IR Detection and Tracking Approach for Autonomous sUAS in STEReO

This study presents a fire edge detection and tracking methodology for an autonomous small UAS (sUAS). The sUAS, onboard sensors, and wildfire are simulated to evaluate the methodology. A visible light (Vis) camera and an infrared (IR) camera are simulated onboard the sUAS to identify burnt, burning, and unburnt areas on a static wildfire bitmap. After differentiating between these areas, a form of nonlinear guidance law (NLGL) is used to generate virtual target points (VTP) that guide the sUAS so that the fire edge is kept within the camera FOV. The VTP are passed to the sUAS flight management system (FMS) in the form of waypoints. The approach was tested in simulation and demonstrated tracking curved, sharp, and linear fire edge shapes at different altitudes. Higher altitude tracking proved to demand the least control effort without sacrificing continuous tracking.

Autonomous UAV↗
NASA NTRS1990

Stereo advantage for a peg-in-hole task using a force-feedback manipulator

An improved assessment methodology has been implemented at NOSC and tested using an instrumented peg-in-hole (PiH) taskboard. Several aspects of the methodology are discussed in light of their implications for future studies of manipulator performance. Using a simple (but high-fidelity) force-feedback manipulator, a group of 9 trained operators showed a consistent advantage for stereoscopic TV viewing over monoscopic TV viewing when performing the PiH task. To introduce a controlled element of spatial uncertainty into the testing procedure, taskboard orientation relative to the manipulator and remote video camera head was changed in a randomized order on a trial-by-trial basis. The stereoscopic advantage demonstrated by this study can reasonably be expected to be even more pronounced as the quality of the stereo TV interface is improved and force-feedback provided through the manipulator system is diminished and/or distorted.

Spain, Edward H.↗
NASA NTRSDate not supplied

MISR Level 1B2 Ellipsoid Data (MI1B2E_V3)

The MISR instrument consists of nine pushbroom cameras which measure radiance in four spectral bands. Global coverage is achieved in nine days. The cameras are arranged with one camera pointing toward the nadir, four cameras pointing forward and four cameras pointing aftward. It takes 7 minutes for all nine cameras to view the same surface location. The view angles relative to the surface reference ellipsoid, are 0, 26.1, 45.6, 60.0, and 70.5 degrees. The spectral band shapes are nominally gaussian, centered at 443, 555, 670, and 865 nm. The Ellipsoid product is referenced to the World Geodetic System 1984 (WGS84) ellipsoid, which approximates the Earth's shape at sea level. In this product, the radiances and associated altitudes are projected to the ellipsoid, so that higher elevation data appear displaced from their true location for non-nadir camera views, much as they are seen by the instrument. (A cloud at location F, or a mountain top at location T in the image below appears as if it is at location E.) The more oblique the camera view, or the higher in altitude the feature, the more displaced the elevated data will appear. This displacement is used to advantage in MISR stereo retrievals, and this product is the primary input to Level 2 top-of-atmosphere/cloud processing. [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=563.2 km (cross-track); Longitude_Resolution=140.8 km (along-track); Temporal_Resolution=about 15 orbits/day; Temporal_Resolution_Range=about 15 orbits/day].

TOA↗
NASA NTRS1977

Earth orbital teleoperator visual system evaluation program

Visual system parameters and stereoptic television component geometries were evaluated for optimum viewing. The accuracy of operator range estimation using a Fresnell stereo television system with a three dimensional cursor was examined. An operator's ability to align three dimensional targets using vidicon tube and solid state television cameras as part of a Fresnell stereoptic system was evaluated. An operator's ability to discriminate between varied color samples viewed with a color television system was determined.

Frederick, P. N.↗