Engineering PapersSearch

SEARCH · Engineering Papers

Results for “video guidance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Next Generation Advanced Video Guidance Sensor

The first autonomous rendezvous and docking in the history of the U.S. Space Program was successfully accomplished by Orbital Express, using the Advanced Video Guidance Sensor (AVGS) as the primary docking sensor. The United States now has a mature and flight proven sensor technology for supporting Crew Exploration Vehicles (CEV) and Commercial Orbital Transport. Systems (COTS) Automated Rendezvous and Docking (AR&D). AVGS has a proven pedigree, based on extensive ground testing and flight demonstrations. The AVGS on the Demonstration of Autonomous Rendezvous Technology (DART)mission operated successfully in "spot mode" out to 2 km. The first generation rendezvous and docking sensor, the Video Guidance Sensor (VGS), was developed and successfully flown on Space Shuttle flights in 1997 and 1998. Parts obsolescence issues prevent the construction of more AVGS. units, and the next generation sensor must be updated to support the CEV and COTS programs. The flight proven AR&D sensor is being redesigned to update parts and add additional. capabilities for CEV and COTS with the development of the Next, Generation AVGS (NGAVGS) at the Marshall Space Flight Center. The obsolete imager and processor are being replaced with new radiation tolerant parts. In addition, new capabilities might include greater sensor range, auto ranging, and real-time video output. This paper presents an approach to sensor hardware trades, use of highly integrated laser components, and addresses the needs of future vehicles that may rendezvous and dock with the International Space Station (ISS) and other Constellation vehicles. It will also discuss approaches for upgrading AVGS to address parts obsolescence, and concepts for minimizing the sensor footprint, weight, and power requirements. In addition, parts selection and test plans for the NGAVGS will be addressed to provide a highly reliable flight qualified sensor. Expanded capabilities through innovative use of existing capabilities will also be discussed.

Lee, Jimmy

Video Guidance Sensor and Time-of-Flight Rangefinder

A proposed video guidance sensor (VGS) would be based mostly on the hardware and software of a prior Advanced VGS (AVGS), with some additions to enable it to function as a time-of-flight rangefinder (in contradistinction to a triangulation or image-processing rangefinder). It would typically be used at distances of the order of 2 or 3 kilometers, where a typical target would appear in a video image as a single blob, making it possible to extract the direction to the target (but not the orientation of the target or the distance to the target) from a video image of light reflected from the target. As described in several previous NASA Tech Briefs articles, an AVGS system is an optoelectronic system that provides guidance for automated docking of two vehicles. In the original application, the two vehicles are spacecraft, but the basic principles of design and operation of the system are applicable to aircraft, robots, objects maneuvered by cranes, or other objects that may be required to be aligned and brought together automatically or under remote control. In a prior AVGS system of the type upon which the now-proposed VGS is largely based, the tracked vehicle is equipped with one or more passive targets that reflect light from one or more continuous-wave laser diode(s) on the tracking vehicle, a video camera on the tracking vehicle acquires images of the targets in the reflected laser light, the video images are digitized, and the image data are processed to obtain the direction to the target. The design concept of the proposed VGS does not call for any memory or processor hardware beyond that already present in the prior AVGS, but does call for some additional hardware and some additional software. It also calls for assignment of some additional tasks to two subsystems that are parts of the prior VGS: a field-programmable gate array (FPGA) that generates timing and control signals, and a digital signal processor (DSP) that processes the digitized video images. The additional timing and control signals generated by the FPGA would cause the VGS to alternate between an imaging (direction-finding) mode and a time-of-flight (range-finding mode) and would govern operation in the range-finding mode.

Bryan, Thomas

Video Guidance Sensor for automated capture

The paper describes a video-based sensor, the Video Guidance Sensor, which has been developed for use in automated docking systems or for automated capture with robotic systems. The sensor itself consists of several basic components: IR diode illuminators, a solid-state camera, a frame grabber, and a microprocessor. The target consists of three circular retroreflectors evenly spaced in a line with the middle reflector mounted on a short pole. Each retroreflector has a narrow bandpass optical filter in front of it. From this sensor and target configuration, the positions and attitudes of the target relative to the sensor can be determined. The position information can be differenced to with respect to time in order to obtain the relative positional and angular velocities. That information is sufficient to perform automated docking, berthing, or capture. The paper gives details of the sensor's make-up, including accuracies, noise characteristics, and operating ranges.

Howard, R. T.

Control Method for Video Guidance Sensor System

A method is provided for controlling operations in a video guidance sensor system wherein images of laser output signals transmitted by the system and returned from a target are captured and processed by the system to produce data used in tracking of the target. Six modes of operation are provided as follows: (i) a reset mode; (ii) a diagnostic mode; (iii) a standby mode; (iv) an acquisition mode; (v) a tracking mode; and (vi) a spot mode wherein captured images of returned laser signals are processed to produce data for all spots found in the image. The method provides for automatic transition to the standby mode from the reset mode after integrity checks are performed and from the diagnostic mode to the reset mode after diagnostic operations are commands is permitted only when the system is in the carried out. Further, acceptance of reset and diagnostic standby mode. The method also provides for automatic transition from the acquisition mode to the tracking mode when an acceptable target is found.

Richard T Howard

Control method for video guidance sensor system

A method is provided for controlling operations in a video guidance sensor system wherein images of laser output signals transmitted by the system and returned from a target are captured and processed by the system to produce data used in tracking of the target. Six modes of operation are provided as follows: (i) a reset mode; (ii) a diagnostic mode; (iii) a standby mode; (iv) an acquisition mode; (v) a tracking mode; and (vi) a spot mode wherein captured images of returned laser signals are processed to produce data for all spots found in the image. The method provides for automatic transition to the standby mode from the reset mode after integrity checks are performed and from the diagnostic mode to the reset mode after diagnostic operations are carried out. Further, acceptance of reset and diagnostic commands is permitted only when the system is in the standby mode. The method also provides for automatic transition from the acquisition mode to the tracking mode when an acceptable target is found.

Howard, Richard T.

Video Guidance, Landing, and Imaging system (VGLIS) for space missions

The feasibility of an autonomous video guidance system that is capable of observing a planetary surface during terminal descent and selecting the most acceptable landing site was demonstrated. The system was breadboarded and "flown" on a physical simulator consisting of a control panel and monitor, a dynamic simulator, and a PDP-9 computer. The breadboard VGLIS consisted of an image dissector camera and the appropriate processing logic. Results are reported.

Schappell, R. T.

Advanced Video Guidance Sensor Development Testing

NASA's Marshall Space Flight Center was the driving force behind the development of the Advanced Video Guidance Sensor, an active sensor system that provides near-range sensor data as part of an automatic rendezvous and docking system. The sensor determines the relative positions and attitudes between the active sensor and the passive target at ranges up to 300 meters. The VGS uses laser diodes to illuminate retro-reflectors in the target, a solid-state camera to detect the return from the target, and image capture electronics and a digital signal processor to convert the video information into the relative positions and attitudes. This development effort has required a great deal of testing of various sorts at every phase of development, and some of the test efforts, predictions, and results will be laid out in this paper.

Howard, Richard T.

Advanced Video Guidance Sensor (AVGS) Development Testing

NASA's Marshall Space Flight Center was the driving force behind the development of the Advanced Video Guidance Sensor, an active sensor system that provides near-range sensor data as part of an automatic rendezvous and docking system. The sensor determines the relative positions and attitudes between the active sensor and the passive target at ranges up to 300 meters. The AVGS uses laser diodes to illuminate retro-reflectors in the target, a solid-state camera to detect the return from the target, and image capture electronics and a digital signal processor to convert the video information into the relative positions and attitudes. The AVGS will fly as part of the Demonstration of Autonomous Rendezvous Technologies (DART) in October, 2004. This development effort has required a great deal of testing of various sorts at every phase of development. Some of the test efforts included optical characterization of performance with the intended target, thermal vacuum testing, performance tests in long range vacuum facilities, EMI/EMC tests, and performance testing in dynamic situations. The sensor has been shown to track a target at ranges of up to 300 meters, both in vacuum and ambient conditions, to survive and operate during the thermal vacuum cycling specific to the DART mission, to handle EM1 well, and to perform well in dynamic situations.

Howard, Richard T.

Video Guidance Sensor Flight Experiment Results

NASA's Marshall Space Flight Center flew on the STS-87 mission an active sensor system, the Video Guidance Sensor (VGS), to demonstrate its functioning in space and to collect performance data. The VGS was designed to provide near-range sensor data as part of an automatic rendezvous and docking system. The sensor determines the relative positions and attitudes between the active sensor and the passive target. The VGS uses laser diodes to illuminate retro-reflectors in the target, a solid-state camera to detect the return from the target, and a frame grabber and digital signal processor to convert the video information into the relative positions and attitudes. The system is designed to operate with the target within a relative azimuth of +/- 9.5 degrees and a relative elevation of +/- 7.5 degrees. The system will acquire and track the target within that field-of-view anywhere from 1.5 meters to 110 meters range, and is designed to acquire at relative attitudes of +/- 10 degrees in pitch and yaw and at any roll angle. The data is output from the sensor at 5 Hz, and the target and sensor software have been designed to permit two independent sensors to operate simultaneously (in order to allow for redundancy). The data from the flight experiment includes raw video data from the VGS camera, relative position and attitude measurements from the VGS to the target, independent hand-held laser ranges from the Shuttle Aft Flight Deck to the target, and Remote Manipulator System position data to correlate with the VGS data. The experiment was quite successful and returned much useful information. The experience gained from the design and flight of this experiment will lead to improved video sensors in the future.

Howard, Richard T.

The Video Guidance Sensor: Space, Earth, Ground, and Sea

Engineers at the Marshall Space Flight Center (MSFC) have been developing and testing video-based sensors for automated spacecraft guidance for several years. The next generation of Video Guidance Sensor (VGS) is being designed to be faster and more capable than ever. It will have applications to relative position measurement in any field of endeavor. The system works by sequentially firing two different wavelengths of laser diodes at the target (which has retroreflectors) and processing the two images. Since the target only reflects one wavelength, it shows up well in one image and not at all in the other. Because the target's dimensions are known, the relative positions and attitudes of the target and the sensor can be computed from the spots reflected from the target. The current sensor operates at 5 Hz at ranges from 1 to 110 meters with a 20 deg. field-of-view. The Video Guidance Sensor (VGS) developed over the past several years has performed well in testing and met the objective of being used as the terminal guidance sensor for an automated rendezvous and capture system. The first VGS was successfully tested in closed-loop 3-degree-of-freedom (3-DOF) tests in 1989 and then in 6-DOF open-loop tests in 1992 and closed-loop tests in 1993-4. Development and testing continued, and in 1995 approval was given to test the VGS in an experiment on the Space Shuttle. The VGS flew in 1997 and in 1998, performing well during both flight experiments. During the development and testing before, during, and after the flight experiments, numerous areas for improvement were found. The next generation of VGS is being designed to operate at up to 100 Hz tracking rates and at ranges from 0.5 to 200 meters. In addition to its use as a spacecraft guidance sensor, it could be used as an alignment aid for an operator of a remote system (giving position and attitude feedback data), as a feedback system for a robotic arm, or for automated vehicle guidance. The next generation VGS, with its higher tracking rates, smaller size, and lower power could be used in more places than the original VGS, and by using LED's instead of laser diodes, the system would be eye-safe at any range. More potential applications include aerial station keeping (keeping 2 or more autonomous aircraft within particular relative positions), under-water robotics, and the guidance of ground vehicles in predefined areas equipped with sets of targets.

Howard, Richard T.

The Advanced Video Guidance Sensor: Orbital Express and the Next Generation

The Orbital Express (OE) mission performed the first autonomous rendezvous and docking in the history of the United States on May 5-6, 2007 with the Advanced Video Guidance Sensor (AVGS) acting as one of the primary docking sensors. Since that event, the OE spacecraft performed four more rendezvous and docking maneuvers, each time using the AVGS as one of the docking sensors. The Marshall Space Flight Center's (MSFC's) AVGS is a nearfield proximity operations sensor that was integrated into the Autonomous Rendezvous and Capture Sensor System (ARCSS) on OE. The ARCSS provided the relative state knowledge to allow the OE spacecraft to rendezvous and dock. The AVGS is a mature sensor technology designed to support Automated Rendezvous and Docking (AR&D) operations. It is a video-based laser-illuminated sensor that can determine the relative position and attitude between itself and its target. Due to parts obsolescence, the AVGS that was flown on OE can no longer be manufactured. MSFC has been working on the next generation of AVGS for application to future Constellation missions. This paper provides an overview of the performance of the AVGS on Orbital Express and discusses the work on the Next Generation AVGS (NGAVGS).

Howard, Richard T.

Orbital Express Advanced Video Guidance Sensor

In May 2007 the first US fully autonomous rendezvous and capture was successfully performed by DARPA's Orbital Express (OE) mission. Since then, the Boeing ASTRO spacecraft and the Ball Aerospace NEXTSat have performed multiple rendezvous and docking maneuvers to demonstrate the technologies needed for satellite servicing. MSFC's Advanced Video Guidance Sensor (AVGS) is a primary near-field proximity operations sensor integrated into ASTRO's Autonomous Rendezvous and Capture Sensor System (ARCSS), which provides relative state knowledge to the ASTRO GN&C system. This paper provides an overview of the AVGS sensor flying on Orbital Express, and a summary of the ground testing and on-orbit performance of the AVGS for OE. The AVGS is a laser-based system that is capable of providing range and bearing at midrange distances and full six degree-of-freedom (6DOF) knowledge at near fields. The sensor fires lasers at two different frequencies to illuminate the Long Range Targets (LRTs) and the Short Range Targets (SRTs) on NEXTSat. Subtraction of one image from the other image removes extraneous light sources and reflections from anything other than the corner cubes on the LRTs and SRTs. This feature has played a significant role for Orbital Express in poor lighting conditions. The very bright spots that remain in the subtracted image are processed by the target recognition algorithms and the inverse-perspective algorithms, to provide 3DOF or 6DOF relative state information. Although Orbital Express has configured the ASTRO ARCSS system to only use AVGS at ranges of 120 m or less, some OE scenarios have provided opportunities for AVGS to acquire and track NEXTSat at greater distances. Orbital Express scenarios to date that have utilized AVGS include a berthing operation performed by the ASTRO robotic arm, sensor checkout maneuvers performed by the ASTRO robotic arm, 10-m unmated operations, 30-m unmated operations, and Scenario 3-1 anomaly recovery. The AVGS performed very well during the pre-unmated operations, effectively tracking beyond its 10-degree Pitch and Yaw limit-specifications, and did not require I-LOAD adjustments before unmated operations. AVGS provided excellent performance in the 10-m unmated operations, effectively tracking and maintaining lock for the duration of this scenario, and showing good agreement between the short and long range targets. During the 30-m unmated operations, the AVGS continuously tracked the SRT to 31.6 m, exceeding expectations, and continuously tracked the LRT from 8.8 m out to 31.6 m, with good agreement between these two target solutions. After this scenario was aborted at a 10-m separation during remate operations, the AVGS tracked the LRT out 54.3 m, until the relative attitude between the vehicles was too large. The vehicles remained apart for eight days, at ranges from 1 km to 6 km. During the approach to remate in this recovery operation, the AVGS began tracking the LRT at 150 m, well beyond the OE planned limits for AVGS ranges, and functioned as the primary sensor for the autonomous rendezvous and docking.

Howard, Ricky

Orbital Express Advanced Video Guidance Sensor: Ground Testing, Flight Results and Comparisons

Orbital Express (OE) was a successful mission demonstrating automated rendezvous and docking. The 2007 mission consisted of two spacecraft, the Autonomous Space Transport Robotic Operations (ASTRO) and the Next Generation Serviceable Satellite (NEXTSat) that were designed to work together and test a variety of service operations in orbit. The Advanced Video Guidance Sensor, AVGS, was included as one of the primary proximity navigation sensors on board the ASTRO. The AVGS was one of four sensors that provided relative position and attitude between the two vehicles. Marshall Space Flight Center was responsible for the AVGS software and testing (especially the extensive ground testing), flight operations support, and analyzing the flight data. This paper briefly describes the historical mission, the data taken on-orbit, the ground testing that occurred, and finally comparisons between flight data and ground test data for two different flight regimes.

Pinson, Robin M.

Advanced Video Guidance Sensor and Next Generation Autonomous Docking Sensors

In recent decades, NASA's interest in spacecraft rendezvous and proximity operations has grown. Additional instrumentation is needed to improve manned docking operations' safety, as well as to enable telerobotic operation of spacecraft or completely autonomous rendezvous and docking. To address this need, Advanced Optical Systems, Inc., Orbital Sciences Corporation, and Marshall Space Flight Center have developed the Advanced Video Guidance Sensor (AVGS) under the auspices of the Demonstration of Autonomous Rendezvous Technology (DART) program. Given a cooperative target comprising several retro-reflectors, AVGS provides six-degree-of-freedom information at ranges of up to 300 meters for the DART target. It does so by imaging the target, then performing pattern recognition on the resulting image. Longer range operation is possible through different target geometries. Now that AVGS is being readied for its test flight in 2004, the question is: what next? Modifications can be made to AVGS, including different pattern recognition algorithms and changes to the retro-reflector targets, to make it more robust and accurate. AVGS could be coupled with other space-qualified sensors, such as a laser range-and-bearing finder, that would operate at longer ranges. Different target configurations, including the use of active targets, could result in significant miniaturization over the current AVGS package. We will discuss these and other possibilities for a next-generation docking sensor or sensor suite that involve AVGS.

Granade, Stephen R.

Experimental and simulation study results of an Adaptive Video Guidance System /AVGS/

Studies relating to stellar-body exploration programs have pointed out the need for an adaptive guidance scheme capable of providing automatic real-time guidance and site selection capability. For the case of a planetary lander, without such guidance, targeting is limited to what are believed to be generally benign areas in order to ensure a reasonable landing-success probability. Typically, the Mars Viking Lander will be jeopardized by obstacles exceeding 22 centimers in diameter. The benefits of on-board navigation and real-time selection of a landing site and obstacle avoidance have been demonstrated by the Apollo lunar landings, in which man performed the surface sensing and steering functions. Therefore, an Adaptive Video Guidance System (AVGS) has been developed, bread-boarded, and flown on a six-degree-of-freedom simulator.

Schappell, R. T.

Video guidance sensor for autonomous capture

A video-based sensor has been developed specifically for the close-range maneuvering required in the last phase of autonomous rendezvous and capture. The system is a combination of target and sensor, with the target being a modified version of the standard target used by the astronauts with the Remote Manipulator System (RMS). The system, as currently configured, works well for autonomous docking maneuvers from approximately forty feet in to soft-docking and capture. The sensor was developed specifically to track and calculate its position and attitude relative to a target consisting of three retro-reflective spots, equally spaced, with the center spot being on a pole. This target configuration was chosen for its sensitivity to small amounts of relative pitch and yaw and because it could be used with a small modification to the standard RMS target already in use by NASA.

Howard, Richard T.

Video guidance sensor

A Martin-Marietta study comparing the application of laser, video, or RF sensors was conducted in 1982. The study concluded that video was the most attractive sensor (the video also could be used for operator monitoring). The Retro-Reflector field Tracker from the Solar Array Flight Experiment was chosen as a 'first generation' sensor and integrated with guidance algorithms for evaluation on the air-bearing vehicle. Results indicated that this sensor was not applicable for the noise environment posed by the multi-layer insulation used on most spacecraft. A 'second generation' sensor was developed to be used with a modified RMS target. This sensor utilized two sets of laser diodes to acquire three optically filtered targets. The targets were illuminated first with a 780 nanometer diode, followed by illumination with a 830 nm diode. The second digitized picture was subtracted from the first to get a low-noise image. The centroids of the retroreflectors were used then to uniquely derive target attitude and range. The sensor presently operates to 80 feet and within +/- 40 degrees in pitch and yaw. Sensor operability is a concern if the sun is within a +/- 40 degree cone angle to the target. The present sensor performance characteristics are less than 1 percent range error and less than 1 degree angle error. Future sensor development is anticipated to extend the operating range to 150 feet and reduce the cone angle of sensor inoperability to within +/- 10 degrees of direct sunlight. Performance improvements also are anticipated. TRW currently is developing a system that utilizes dual cameras with simultaneous diode illumination. Although further development is being pursued, the basic system has proven sound, and the sensor is essentially ready for application.

Howard, Richard

Hardware/Software Issues for Video Guidance Systems: The Coreco Frame Grabber

The F64 frame grabber is a high performance video image acquisition and processing board utilizing the TMS320C40 and TMS34020 processors. The hardware is designed for the ISA 16 bit bus and supports multiple digital or analog cameras. It has an acquisition rate of 40 million pixels per second, with a variable sampling frequency of 510 kHz to MO MHz. The board has a 4MB frame buffer memory expandable to 32 MB, and has a simultaneous acquisition and processing capability. It supports both VGA and RGB displays, and accepts all analog and digital video input standards.

Bales, John W.