Engineering PapersSearch

SEARCH · Engineering Papers

Results for “stereo camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Space environment robot vision system

A prototype twin-camera stereo vision system for autonomous robots has been developed at Goddard Space Flight Center. Standard charge coupled device (CCD) imagers are interfaced with commercial frame buffers and direct memory access to a computer. The overlapping portions of the images are analyzed using photogrammetric techniques to obtain information about the position and orientation of objects in the scene. The camera head consists of two 510 x 492 x 8-bit CCD cameras mounted on individually adjustable mounts. The 16 mm efl lenses are designed for minimum geometric distortion. The cameras can be rotated in the pitch, roll, and yaw (pan angle) directions with respect to their optical axes. Calibration routines have been developed which automatically determine the lens focal lengths and pan angle between the two cameras. The calibration utilizes observations of a calibration structure with known geometry. Test results show the precision attainable is plus or minus 0.8 mm in range at 2 m distance using a camera separation of 171 mm. To demonstrate a task needed on Space Station Freedom, a target structure with a movable I beam was built. The camera head can autonomously direct actuators to dock the I-beam to another one so that they could be bolted together.

Wood, H. John

Onboard Stereo Vision for Drone Pursuit or Sense and Avoid

Wedescribeanew,on-board,shortrangeperceptionsystem that enables micro aerial vehicles (MAVs) to detect, track, and follow or avoid nearby drones (within 2-20 meters) in GPS-denied environments. Each vehicle is able to sense its neighborhood and adapt its motion accordingly without use of centralized reasoning or inter-vehicle communication. To enable a lightweight, low power solution, on-board stereo cameras are used for detection and tracking with depth images, while a downward-looking camera and an inertial measurement unit are used to estimate the position of the observer without use of GPS. We illustrate the robustness and accuracy of this approach through real-time, outdoor leader-follower experiments with three quadrotors. Our experiments show that state-of-art trackers are far less robust in detection against cluttered background. This demonstrates that stereo vision is a highly effective approach to perception for safe navigation of multiple MAVs in close proximity.

Matthies, Larry

Optical Depth Retrievals from HRSC Stereo Images

Mars Express is due to arrive in orbit around Mars during the last days of 2003. A primary task of its mission is to map Mars in stereo with the High Resolution Stereo Camera (HRSC) at a spatial resolution of up to 12 m. The Martian atmosphere contains large amounts of dust and other aerosols that scatter light and influence the images. Therefore, image analysis requires careful consideration of these atmospheric effects. An essential parameter to consider is the optical depth. It will be possible to map the optical depth of the Martian atmosphere from HRSC stereo images by analyzing contrast differences. Software to this purpose has been developed at the Max-Planck Institute for Aeronomy in Lindau Germany. We present examples of optical depth-retrievals from airborne HRSC-A images of a region in the French Alps.

N M Hoekzema

Dig Hazard Assessment Using a Stereo Pair of Cameras

This software evaluates the terrain within reach of a lander s robotic arm for dig hazards using a stereo pair of cameras that are part of the lander s sensor system. A relative level of risk is calculated for a set of dig sectors. There are two versions of this software; one is designed to run onboard a lander as part of the flight software, and the other runs on a PC under Linux as a ground tool that produces the same results generated on the lander, given stereo images acquired by the lander and downlinked to Earth. Onboard dig hazard assessment is accomplished by executing a workspace panorama command sequence. This sequence acquires a set of stereo pairs of images of the terrain the arm can reach, generates a set of candidate dig sectors, and assesses the dig hazard of each candidate dig sector. The 3D perimeter points of candidate dig sectors are generated using configurable parameters. A 3D reconstruction of the terrain in front of the lander is generated using a set of stereo images acquired from the mast cameras. The 3D reconstruction is used to evaluate the dig goodness of each candidate dig sector based on a set of eight metrics. The eight metrics are: 1. The maximum change in elevation in each sector, 2. The elevation standard deviation in each sector, 3. The forward tilt of each sector with respect to the payload frame, 4. The side tilt of each sector with respect to the payload frame, 5. The maximum size of missing data regions in each sector, 6. The percentage of a sector that has missing data, 7. The roughness of each sector, and 8. Monochrome intensity standard deviation of each sector. Each of the eight metrics forms a goodness image layer where the goodness value of each sector ranges from 0 to 1. Goodness values of 0 and 1 correspond to high and low risk, respectively. For each dig sector, the eight goodness values are merged by selecting the lowest one. Including the merged goodness image layer, there are nine goodness image layers for each stereo pair of mast images.

Rankin, Arturo L.

Icing flight research: Aerodynamic effects of ice and ice shape documentation with stereo photography

Aircraft icing flight research was performed in natural icing conditions. A data base consisting of icing cloud measurements, ice shapes, and aerodynamic measurements is being developed. During research icing encounters the icing cloud was continuously measured. After the encounter, the ice accretion shapes on the wing were documented with a stereo camera system. The increase in wing section drag was measured with a wake survey probe. The overall aircraft performance loss in terms of lift and drag coefficient changes was obtained by steady level speed/power measurements. Selective deicing of the airframe components was performed to determine their contributions to the total drag increase. Engine out capability in terms of power available was analyzed for the iced aircraft. It was shown that the stereo photography system can be used to document ice shapes in flight and that the wake survey probe can measure increases in wing section drag caused by ice. On one flight, the wing section drag coefficient (c sub d) increased approximately 120 percent over the uniced baseline at an aircraft angle of attack of 6 deg. On another flight, the aircraft darg coefficient (c sub d) increased by 75 percent over the uniced baseline at an aircraft lift coefficient (C sub d) of 0.5.

Mikkelsen, K. L.

Icing flight research - Aerodynamic effects of ice and ice shape documentation with stereo photography

Aircraft icing flight research was performed in natural icing conditions. A data base consisting of icing cloud measurements, ice shapes, and aerodynamic measurements is being developed. During research icing encounters the icing cloud was continuously measured. After the encounter, the ice accretion shapes on the wing were documented with a stereo camera system. The increase in wing section drag was measured with a wake survey probe. The overall aircraft performance loss in terms of lift and drag coefficient changes were obtained by steady level speed/power measurements. Selective deicing of the airframe components was performed to determine their contributions to the total drag increase. Engine out capability in terms of power available was analyzed for the iced aircraft. It was shown that the stereo photography system can be used to document ice shapes in flight and that the wake survey probe can measure increases in wing section drag caused by ice. On one flight, the wing section drag coefficient (c sub d) increased approximately 120 percent over the uniced baseline at an aircraft angle of attack of 6 deg. On another flight, the aircraft drag coefficient (c sub d) increased by 75 percent over the uniced baseline at an aircraft lift coefficient (c sub d) of 0.5.

Mikkelsen, K. L.

Hand-Eye Calibration Using Active Vision

The project described in this paper designed and implemented a hand-eye calibration method for manipulators under observation by stereo cameras. This method has been utilized on Johnson Space Center's Robonaut, and on a planetary manipulator mock-up at the Jet Propulsion Laboratory. The intent of this calibration is to improve the manipulator's hand-eye coordination.

manipulation

Planar Particle Imaging Doppler Velocimetry Developed

Two current techniques exist for the measurement of planar, three-component velocity fields. Both techniques require multiple views of the illumination plane in order to extract all three velocity components. Particle image velocimetry (PIV) is a high-resolution, high accuracy, planar velocimetry technique that provides valuable instantaneous velocity information in aeropropulsion test facilities. PIV can provide three-component flow-field measurements using a two-camera, stereo viewing configuration. Doppler global velocimetry (DGV) is another planar velocimetry technique that can provide three component flow-field measurements; however, it requires three detector systems that must be located at oblique angles from the measurement plane. The three-dimensional configurations of either technique require multiple (DGV) or at least large (stereo PIV) optical access ports in the facility in which the measurements are being conducted. Optical access is extremely limited in aeropropulsion test facilities. In many cases, only one optical access port is available. A hybrid measurement technique has been developed at the NASA Glenn Research Center, planar particle image and Doppler velocimetry (PPIDV), which combines elements from both the PIV and DGV techniques into a single detection system that can measure all three components of velocity across a planar region of a flow field through a single optical access port. In the standard PIV technique, a pulsed laser is used to illuminate the flow field at two closely spaced instances in time, which are recorded on a "frame-straddling" camera, yielding a pair of single-exposure image frames. The PIV camera is oriented perpendicular to the light sheet, and the processed PIV data yield the two-component velocity field in the plane of the light sheet. In the standard DGV technique, an injection-seeded Nd:YAG pulsed laser light sheet illuminates the seeded flow field, and three receiver systems are used to measure three components of velocity. The receiver systems are oriented at oblique angles to the light sheet in order to accurately resolve the three-component velocity. Each DGV receiver system contains two cameras, which share a common view of the illuminated flow through a beam-splitting cube. One camera views the illuminated flow directly (reference camera) and the second camera images the illuminated flow through an iodine vapor cell (signal camera). The laser frequency (wavelength) is adjusted so that the Doppler-shifted light from particles in the flow falls on an iodine absorption feature, see the following graph. The iodine vapor cell acts as a frequency-to-velocity filter by modulating the intensity of the transmitted light as a function of the flow velocity (Doppler shift). The ratio of the signal and reference images yields the component of the flow velocity along the bisector of the laser sheet propagation direction and the receiver system observation direction. The hybrid system employs a single-component DGV receiver system configured to simultaneously acquire PIV image data, as shown in the following diagram. The cameras used in the DGV receiver are replaced with PIV frame-straddling cameras, and the receiver system views the illuminated light sheet plane at 90 (as in the standard PIV configuration).

Wernet, Mark P.

Lunar and Planetary Science XXXVI, Part 14

Contents include the following: Destruction of Presolar Silicates by Aqueous Alteration Observed in Murchison CM2 Chondrite. Generation of Chondrule Forming Shock Waves in Solar Nebula by X-Ray Flares. TEM and NanoSIMS Study of Hydrated/Anhydrous Phase Mixed IDPs: Cometary or Asteroidal Origin? Inflight Calibration of Asteroid Multiband Imaging Camera Onboard Hayabusa: Preliminary Results. Corundum and Corundum-Hibonite Grains Discovered by Cathodoluminescence in the Matrix of Acfer 094 Meteorite. Spatial Extent of a Deep Moonquake Nest A Preliminary Report of Reexamination. Modal Abundances of Carbon in Ureilites: Implications for the Petrogenesis of Ureilites. Trapped Noble Gas Components and Exposure History of the Enstatite Chondrite ALH84206. Deep-seated Crustal Material in Dhofar Lunar Meteorites: Evidence from Pyroxene Chemistry. Numerical Investigations of Kuiper Belt Binaries. Dust Devils on Mars: Effects of Surface Roughness on Particle Threshold. Hecates Tholus, Mars: Nighttime Aeolian Activity Suggested by Thermal Images and Mesoscale Atmospheric Model Simulations. Are the Apollo 14 High-Al Basalts Really Impact Melts? Garnet in the Lunar Mantle: Further Evidence from Volcanic Glass Beads. The Earth/Mars Dichotomy in Mg/Si and Al/Si Ratios: Is It Real? Dissecting the Polar Asymmetry in the Non-Condensable Gas Enhancement on Mars: A Numerical Modeling Study. Cassini VIMS Preliminary Exploration of Titan s Surface Hemispheric Albedo Dichotomy. An Improved Instrument for Investigating Planetary Regolith Microstructure. Isotopic Composition of Oxygen in Lunar Zircons Preliminary Design of Visualization Tool for Hayabusa Operation. Size and Shape Distributions of Chondrules and Metal Grains Revealed by X-Ray Computed Tomography Data. Properties of Permanently Shadowed Regolith. Landslides in Interior Layered Deposits, Valles Marineris, Mars: Effects of Water and Ground Shaking on Slope Stability. Mars: Recent and Episodic Volcanic, Hydrothermal, and Glacial Activity Revealed by Mars Express High Resolution Stereo Camera (HRSC). The Cratering Record of the Saturnian Satellites Phoebe, Tethys, Dione and Iapetus in Comparison: First Results from Analysis of the Cassini ISS Imaging Data. Joint Crossover Solutions of Altimetry and Image Data on 433 Eros. The Martian Soil as a Geochemical Sink for.

Source record

Summertime Continental Shallow Cumulus Cloud Detection Using GOES‐16 Satellite and Ground‐Based Ceilometer at North Alabama

Abstract Accurate simulations of boundary layer cloud processes remain challenging in Earth system modeling. Observations are essential to evaluate and improve models of such processes. This study introduces a comprehensive validation framework for a satellite‐based detection algorithm of continental shallow cumulus (ShCu) clouds during the daytime, which was initially developed using ground‐based observations of stereo cameras at the Department of Energy Atmospheric Radiation Measurement (ARM) Southern Great Plains site (J. Tian et al., 2021, https://doi.org/10.3390/rs13122309 , 2022, https://doi.org/10.1029/2021gl097070 ). To validate this algorithm, the framework employs ground‐based ceilometer measurements from North Alabama (NA) where ShCu populations are prevalent. This study first generates clear‐sky surface reflectance maps at NA and identifies ShCu pixels with a detection threshold using Geostationary Operational Environmental Satellite (GOES) reflectance data. The obtained cloud fractions (CFs) are then compared against CFs from a ground‐based ceilometer, considering factors such as observed area differences, satellite parallax issue, and systematic biases. We found that with a detection threshold (∆R) of 0.05, the ShCu detection algorithm is effective for NA, enabling the reproduction of hourly ShCu CFs using GOES. Our framework is straightforward and easily repeatable to evaluate the effectiveness of a ∆R threshold for detecting ShCu clouds in various geographic regions where ceilometers are deployed. This satellite detection of ShCu provides a crucial regional context for ground‐based measurements, facilitating the tracking of convection initiation and its coupling with land surface conditions. Integrating localized ground‐based and regional satellite data will enhance our ability to conduct thorough studies of cloud morphology and land‐atmosphere interactions in North Alabama.

54 ENVIRONMENTAL SCIENCES

TEAMER - Field Demonstration of MarineSitu’s Marine Energy Monitoring Tools - CRADA 664 (Abstract)

In order to effectively monitor for marine life around marine energy devices and thus minimize the risk of collision, multiple sensors working in coordination and augmented with around-the-clock automated monitoring algorithms need to be installed in challenging high-energy tidal and wave environments. Such systems are often too expensive for widespread adoption, or lack sufficient sensors or smarts to enable around-the-clock, real-time monitoring without human involvement. MarineSitu has been working to tackle this problem by developing a low-cost, combined sonar and stereo camera sensor array with connected real-time AI-based algorithms for automatically detecting marine life in these marine energy suitable environments. In this TEAMER project with Pacific Northwest National Lab (PNNL), MarineSitu will be testing this novel sensor system for the first time in the high-energy tidal channel environment at PNNL’s Marine and Coastal Research Lab. Throughout this deployment, MarineSitu will be monitoring their system and running analytics on the sensor’s data in real-time. Meanwhile, PNNL Data Scientists and Ocean Engineers, will be evaluating the system’s effectiveness and ease of use both as a tool for plug-and-play environmental monitoring and novel environmental monitoring research. In doing so, the team will improve MarineSitu’s system and software, produce insightful data products, and develop novel visualizations and AI algorithms for combining and analyzing the data produced by systems like MarineSitu’s.

16 TIDAL AND WAVE POWER

TEAMER – Field Demonstration of MarineSitu’s Marine Energy Monitoring (Abstract)

In order to effectively monitor for marine life around marine energy devices and thus minimize the risk of collision, multiple sensors working in coordination and augmented with around-the-clock automated monitoring algorithms need to be installed in challenging high-energy tidal and wave environments. Such systems are often too expensive for widespread adoption, or lack sufficient sensors or smarts to enable around-the-clock, real-time monitoring without human involvement. MarineSitu has been working to tackle this problem by developing a low-cost, combined sonar and stereo camera sensor array with connected real-time AI-based algorithms for automatically detecting marine life in these marine energy suitable environments. In this TEAMER project with Pacific Northwest National Lab (PNNL), MarineSitu will be testing this novel sensor system for the first time in the high-energy tidal channel environment at PNNL’s Marine and Coastal Research Lab. Throughout this deployment, MarineSitu will be monitoring their system and running analytics on the sensor’s data in real-time. Meanwhile, PNNL Data Scientists and Ocean Engineers, will be evaluating the system’s effectiveness and ease of use both as a tool for plug-and-play environmental monitoring and novel environmental monitoring research. In doing so, the team will improve MarineSitu’s system and software, produce insightful data products, and develop novel visualizations and AI algorithms for combining and analyzing the data produced by systems like MarineSitu’s.

16 TIDAL AND WAVE POWER

Requirements for particulate monitoring system for Space Station

We recommend that a stereo camera system be utilized as a diagnostic for the particulate environment surrounding the Space Station. This system should have sufficient sensitivity to identify contaminated periods, to isolate the effects of sources and activities and to determine optical clearing times. A reasonable compromise between sensitivity and other operational constraints is recommended. Sensitivity comparable to the film camera systems should suffice, but long periods of unattended operation and remotely controlled exposure sequences are essential requirements.

Green, Byron David

ROTEX-TRIIFEX: Proposal for a joint FRG-USA telerobotic flight experiment

The concepts and main elements of a RObot Technology EXperiment (ROTEX) proposed to fly with the next German spacelab mission, D2, are presented. It provides a 1 meter size, six axis robot inside a spacelab rack, equipped with a multisensory gripper (force-torque sensors, an array of range finders, and mini stereo cameras). The robot will perform assembly and servicing tasks in a generic way, and will grasp a floating object. The man machine and supervisory control concepts for teleoperation from the spacelab and from ground are discussed. The predictive estimation schemes for an extensive use of time-delay compensating 3D computer graphics are explained.

Hirzinger, G.

Manipulator design and development for the Ranger satellite servicing vehicle

The Ranger program is a planned series of low cost telerobotics flight experiments, based on the use of Pegasus launch vehicles. As the first step towards this goal, the Space Systems Lab was developing a neutral buoyancy version of Ranger for use in design verification and operations testing. The design approach and results of the Ranger manipulator development program is related. Ranger is designed to incorporate four appendages: a pair of dexterous, seven degree of freedom manipulators for general manipulation; a six DOF grappling arm for securing the vehicle to the local work site; and a five DOF positioning manipulator for the stereo camera pair that provide feedback to the remote operator. Each of these manipulators incorporate unique approaches to satisfying design requirements. The numerical and operational requirements are given for Ranger manipulators, and the evolution is discussed of the differing design approaches based on similarities and differences in the requirements. Testing results for individual joints and manipulator assemblies are presented, followed by initial results of operational testing on satellite servicing tasks with the integrated Ranger neutral buoyancy vehicle.

Howard, Russell D.

Satellite Test Assistant Robot (STAR)

A three-year, three-phase program to demonstrate the applicability of telerobotic technology to the testing of satellites and other spacecraft has been initiated. Specifically, the objectives are to design, fabricate, and install into the JPL 25-ft. Space Simulator (SS) a system that will provide the capability to view test articles from all directions in both the visible and infrared (IR) spectral regions, to automatically map the solar flux intensity over the entire work volume of the chamber, and to provide the capability for leak detection. The first year's work, which provides a vertically mobile viewing platform equipped with stereo cameras, will be discussed. Design constraints and system implementation approaches mandated by the requirements of thermal vacuum operation will be emphasized.

Mcaffee, D. A.

Skyline based terrain matching

Skyline-based terrain matching, a new method for locating the vantage point of stereo camera or laser range-finding measurements on a global map previously prepared by satellite or aerial mapping is described. The orientation of the vantage is assumed known, but its translational parameters are determined by the algorithm. Skylines, or occluding contours, can be extracted from the sensory measurements taken by an autonomous vehicle. They can also be modeled from the global map, given a vantage estimate from which to start. The two sets of skylines, represented in cylindrical coordinates about either the true or the estimated vantage, are employed as 'features' or reference objects common to both sources of information. The terrain matching problem is formulated in terms of finding a translation between the respective representations of the skylines, by approximating the two sets of skylines as identical features (curves) on the actual terrain. The search for this translation is based on selecting the longest of the minimum-distance vectors between corresponding curves from the two sets of skylines. In successive iterations of the algorithm, the approximation that the two sets of curves are identical becomes more accurate, and the vantage estimate continues to improve. The algorithm was implemented and evaluated on a simulated terrain. Illustrations and examples are included.

Page, Lance A.

An evaluation of three-dimensional sensors for the extravehicular activity helper/retreiver

The Extravehicular Activity Retriever/Helper (EVAHR) is a robotic device currently under development at the NASA Johnson Space Center that is designed to fetch objects or to assist in retrieving an astronaut who may have become inadvertently de-tethered. The EVAHR will be required to exhibit a high degree of intelligent autonomous operation and will base much of its reasoning upon information obtained from one or more three-dimensional sensors that it will carry and control. At the highest level of visual cognition and reasoning, the EVAHR will be required to detect objects, recognize them, and estimate their spatial orientation and location. The recognition phase and estimation of spatial pose will depend on the ability of the vision system to reliably extract geometric features of the objects such as whether the surface topologies observed are planar or curved and the spatial relationships between the component surfaces. In order to achieve these tasks, accurate sensing of the operational environment and objects in the environment will therefore be critical. The qualitative and quantitative results of empirical studies of three sensors that are capable of providing three-dimensional information to the EVAHR, but using completely different hardware approaches are documented. The first of these devices is a phase shift laser with an effective operating range (ambiguity interval) of approximately 15 meters. The second sensor is a laser triangulation system designed to operate at much closer range and to provide higher resolution images. The third sensor is a dual camera stereo imaging system from which range images can also be obtained. The remainder of the report characterizes the strengths and weaknesses of each of these systems relative to quality of data extracted and how different object characteristics affect sensor operation.

Magee, Michael