Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “computer vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57
All sourcesNASA NTRSDOE OSTI
NASA NTRS2006

Implementing the President's Vision: JPL and NASA's Exploration Systems Mission Directorate

As part of the NASA team the Jet Propulsion Laboratory is involved in the Exploration Systems Mission Directorate (ESMD) work to implement the President's Vision for Space exploration. In this slide presentation the roles that are assigned to the various NASA centers to implement the vision are reviewed. The plan for JPL is to use the Constellation program to advance the combination of science an Constellation program objectives. JPL's current participation is to contribute systems engineering support, Command, Control, Computing and Information (C3I) architecture, Crew Exploration Vehicle, (CEV) Thermal Protection System (TPS) project support/CEV landing assist support, Ground support systems support at JSC and KSC, Exploration Communication and Navigation System (ECANS), Flight prototypes for cabin atmosphere instruments

Industry Day↗
NASA NTRS2011

Implementation of Pin Point Landing Vision Components in an FPGA System

Pin-point landing is required to enable missions to land close, typically within 10 meters, to scientifically important targets in generally hazardous terrain. In Pin Point Landing both high accuracy and high speed estimation of position and orientation is needed to provide input to the control system to safely choose and navigate to a safe landing site. A proposed algorithm called VISion aided Inertial NAVigation (VISINAV) has shown that the accuracy requirements can be met. [2][3] VISINAV was shown in software only, and was expected to use FPGA enhancements in the future to improve the computational speed needed for pin point landing during Entry Descent and Landing (EDL). Homography, feature detection and spatial correlation are computationally intensive parts of VISINAV. Homography aligns the map image with the descent image so that small correlation windows can be used, and feature detection provides regions that spatial correlation can track from frame to frame in order to estimate vehicle motion. On MER the image Homography, Feature Detection and Correlation would take approximately 650ms tracking 75 features between frames. We implemented Homography, Feature detection and Correlation on a Virtex 4 LX160 FPGA to run in under 25ms while tracking 500 features to improve algorithm reliability and throughput.

aircraft landing guidance↗
NASA NTRS2017

COBALT: Development of a Platform to Flight Test Lander GN&C Technologies on Suborbital Rockets

The NASA COBALT Project (CoOperative Blending of Autonomous Landing Technologies) is developing and integrating new precision-landing Guidance, Navigation and Control (GN&C) technologies, along with developing a terrestrial fight-test platform for Technology Readiness Level (TRL) maturation. The current technologies include a third- generation Navigation Doppler Lidar (NDL) sensor for ultra-precise velocity and line- of-site (LOS) range measurements, and the Lander Vision System (LVS) that provides passive-optical Terrain Relative Navigation (TRN) estimates of map-relative position. The COBALT platform is self contained and includes the NDL and LVS sensors, blending filter, a custom compute element, power unit, and communication system. The platform incorporates a structural frame that has been designed to integrate with the payload frame onboard the new Masten Xodiac vertical take-o, vertical landing (VTVL) terrestrial rocket vehicle. Ground integration and testing is underway, and terrestrial fight testing onboard Xodiac is planned for 2017 with two flight campaigns: one open-loop and one closed-loop.

Carson, John M., III↗
DOE OSTI2022

Vision 0.3.2 Users Guide: Revision 0

Vision is a research software application developed by Pacific Northwest National Laboratory (PNNL) that incorporates the scientific and operational expertise for reviewing data from treaty monitoring radionuclide stations. These stations are part of a worldwide network to monitor for nuclear explosions, and the data they produce are critical to make the determination of whether a sample is from a nuclear explosion or some other source (i.e., nuclear reactor or medical isotope production facility). Stations deliver their measurements and system status to the International Monitoring System (IMS), which forwards it via email to all subscribers. Vision provides tools for viewing and analyzing these stations’ state of health data.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1991

Automated site characterization for robotic sample acquisition systems

A mobile, semi-autonomous vehicle with multiple sensors and on-board intelligence is proposed for performing preliminary scientific investigations on extraterrestrial bodies prior to human exploration. Two technologies, a hybrid optical-digital computer system based on optical correlator technology and an image and instrument data analysis system, provide complementary capabilities which might be part of an instrument package for an intelligent robotic vehicle. The hybrid digital-optical vision system could perform real-time image classification tasks using an optical correlator with programmable matched filters under control of a digital microcomputer. The data analysis system would analyze visible and multiband imagery to extract mineral composition and textural information for geologic characterization. Together these technologies would support the site characterization needs of a robotic vehicle for both navigational and scientific purposes.

Scholl, Marija S.↗
NASA NTRS2003

Surface color perception under two illuminants: the second illuminant reduces color constancy

This study investigates color perception in a scene with two different illuminants. The two illuminants, in opposite corners, simultaneously shine on a (simulated) scene with an opaque dividing wall, which controls how much of the scene is illuminated by each source. In the first experiment, the height of the dividing wall was varied. This changed the amount of each illuminant reaching objects on the opposite side of the wall. Results showed that the degree of color constancy decreased when a region on one side of the wall had cues to both illuminants, suggesting that cues from the second illuminant are detrimental to color constancy. In a later experiment, color constancy was found to improve when the specular highlight cues from the second illuminant were altered to be consistent with the first illuminant. This corroborates the influence of specular highlights in surface color perception, and suggests that the reduced color constancy in the first experiment is due to the inconsistent, though physically correct, cues from the two illuminants.

Contrast Sensitivity/physiology↗
NASA NTRS2018

Initial Flight Testing of an eXternal Vision System (XVS) for the Low Boom Flight Demonstrator (LBFD)

NASA will design an eXternal Vision System (XVS) that, with other aircraft systems and subsystems, will ensure safe and efficient operations in all phases of flight for its Low Boom Flight Demonstrator vehicle. XVS is a combination of display, sensor, and computing technologies, creating an electronic means of forward visibility for the pilot. A flight test was performed evaluating a preliminary design of an XVS to quantify, by direct comparison, the ability of a pilot using an XVS to see and recognize airborne traffic compared to that of a pilot using forward-facing windows during challenging see-and-avoid scenarios. The data showed that the XVS and forward-facing windows were essentially equivalent in detecting and recognizing incurring traffic aircraft. The data also showed that the pilot using the XVS could see and recognize the incurring traffic at no less than 0.7 nm prior to the pilot using the forward-facing windows. The performance of the XVS was dependent upon the application of image contrast enhancement. Recommendations for future improvements were captured from evaluation pilot commentary.

Kramer, Lynda J↗
NASA NTRS1992

Color matrix display simulation based upon luminance and chromatic contrast sensitivity of early vision

This paper describes the design and operation of a new simulation model for color matrix display development. It models the physical structure, the signal processing, and the visual perception of static displays, to allow optimization of display design parameters through image quality measures. The model is simple, implemented in the Mathematica computer language, and highly modular. Signal processing modules operate on the original image. The hardware modules describe backlights and filters, the pixel shape, and the tiling of the pixels over the display. Small regions of the displayed image can be visualized on a CRT. Visual perception modules assume static foveal images. The image is converted into cone catches and then into luminance, red-green, and blue-yellow images. A Haar transform pyramid separates the three images into spatial frequency and direction-specific channels. The channels are scaled by weights taken from human contrast sensitivity measurements of chromatic and luminance mechanisms at similar frequencies and orientations. Each channel provides a detectability measure. These measures allow the comparison of images displayed on prospective devices and, by that, the optimization of display designs.

Martin, Russel A.↗
NASA NTRS2022

Vision-based Velocimetry over Unknown Terrain with a Low-Noise IMU

This paper presents a novel approach to terrain-relative navigation with a visual camera and Inertial Measurement Unit (IMU). The proposed algorithm uses an Extended Kalman Filter (EKF) to combine an IMU propagated state estimate with batch correction estimates computed over a sliding window of measurements. The batch correction algorithm follows the Maximum Likelihood Estimation (MLE) approach used in other Bundle Adjustment systems. Unlike other systems, the proposed system parameterizes the state over the entire window in terms of the state at a single epoch. By ignoring IMU error over the window duration, we obtain a state epoch MLE that jointly estimates the epoch state and terrain parameters with drastically reduced computationally cost. This paper presents the general architecture which can be adapted for various state parameterizations and measurement inputs. For space applications with high-accuracy IMUs, the reduction in computational cost comes with only a modest increase in estimation errors. The increase in error is quantified via a linear covariance analysis presented in this paper. Furthermore, we present simulation results which show the applicability of this algorithm to planetary landing problems.

San Martin, A. Miguel↗
DOE OSTI2024

Short-Wave Infrared Upconverting Nanoparticles

Optical technologies enable real-time, noninvasive analysis of complex systems but are limited to discrete regions of the optical spectrum. While wavelengths in the short-wave infrared (SWIR) window (typically, 1700-3000 nm) should enable deep subsurface penetration and reduced photodamage, there are few luminescent probes that can be excited in this region. Here, we report the discovery of lanthanide-based upconverting nanoparticles (UCNPs) that efficiently convert 1740 or 1950 nm excitation to wavelengths compatible with conventional silicon detectors. Screening of Ln3+ ion combinations by differential rate equation modeling identifies Ho3+/Tm3+ or Tm3+ dopants with strong visible or NIR-I emission following SWIR excitation. Experimental upconverted photoluminescence excitation (U-PLE) spectra find that 10% Tm3+-doped NaYF4 core/shell UCNPs have the strongest 800 nm emission from SWIR wavelengths, while UCNPs with an added 2% or 10% Ho3+ show the strongest red emission when excited at 1740 or 1950 nm. Mechanistic modeling shows that addition of a low percentage of Ho3+ to Tm3+-doped UCNPs shifts their emission from 800 to 652 nm by acting as a hub of efficient SWIR energy acceptance and redistribution up to visible emission manifolds. Parallel experimental and computational analysis shows rate equation models are able to predict compositions for specific wavelengths of both excitation and emission. These SWIR-responsive probes open a new IR bioimaging window, and are responsive at wavelengths important for vision technologies.

Qi, Xiao↗
NASA NTRS1994

Coordinating complex decision support activities across distributed applications

Knowledge-based technologies have been applied successfully to automate planning and scheduling in many problem domains. Automation of decision support can be increased further by integrating task-specific applications with supporting database systems, and by coordinating interactions between such tools to facilitate collaborative activities. Unfortunately, the technical obstacles that must be overcome to achieve this vision of transparent, cooperative problem-solving are daunting. Intelligent decision support tools are typically developed for standalone use, rely on incompatible, task-specific representational models and application programming interfaces (API's), and run on heterogeneous computing platforms. Getting such applications to interact freely calls for platform independent capabilities for distributed communication, as well as tools for mapping information across disparate representations. Symbiotics is developing a layered set of software tools (called NetWorks! for integrating and coordinating heterogeneous distributed applications. he top layer of tools consists of an extensible set of generic, programmable coordination services. Developers access these services via high-level API's to implement the desired interactions between distributed applications.

Adler, Richard M.↗
NASA NTRS1993

US general aviation: The ingredients for a renaissance. A vision and technology strategy for US industry, NASA, FAA, universities

General aviation today is a vital component in the nation's air transportation system. It is threatened for survival but has enormous potential for expansion in utility and use. This potential for expansion is fueled by new satellite navigation and communication systems, small computers, flat panel displays, and advanced aerodynamics, materials and manufacturing methods, and propulsion technologies which create opportunities for new levels of environmental and economic acceptability. Expanded general aviation utility and use could have a large impact on the nation's jobs, commerce, industry, airspace capacity, trade balance, and quality of life. This paper presents, in viewgraph form, a general overview of U.S. general aviation. Topics covered include general aviation shipment and billings; airport and general aviation infrastructure; cockpit, airplane, and airspace technologies; market demand; air traffic operations and aviation accidents; fuel efficiency comparisons; and general aviation goals and strategy.

Holmes, Bruce↗
DOE OSTI2022

Vision-based inspection of prefabricated components using camera poses: Addressing inherent limitations of image-based 3D reconstruction

Modular construction can lead to additional cost overruns and delays when a defect is found on the construction site and is not easily repairable. Researchers have developed various methods that use image-based 3D reconstruction for quality assessment, but they have inherent limitations, such as inconsistency and dealing with surfaces with reflectivity and limited visual features. Therefore, this paper presents a vision-based quality assessment method using cameras for prefabricated components by addressing these limitations. Specifically, this paper proposes a novel quality inspection method with sub-millimeter accuracy using cameras focused on leveraging camera poses (as opposed to 3D point clouds that are often not consistent in quality) from the image-based 3D reconstruction. The 3D point estimation by computing triangulation was used for achieving accurate measurement. The proposed method is validated using six different variances and two case studies – an aluminum pipe with a reflective surface and a fabricated concrete column. Furthermore, the results demonstrate the accuracy and effectiveness of the proposed method.

42 ENGINEERING↗
NASA NTRS2008

Cell-Detection Technique for Automated Patch Clamping

A unique and customizable machinevision and image-data-processing technique has been developed for use in automated identification of cells that are optimal for patch clamping. [Patch clamping (in which patch electrodes are pressed against cell membranes) is an electrophysiological technique widely applied for the study of ion channels, and of membrane proteins that regulate the flow of ions across the membranes. Patch clamping is used in many biological research fields such as neurobiology, pharmacology, and molecular biology.] While there exist several hardware techniques for automated patch clamping of cells, very few of those techniques incorporate machine vision for locating cells that are ideal subjects for patch clamping. In contrast, the present technique is embodied in a machine-vision algorithm that, in practical application, enables the user to identify good and bad cells for patch clamping in an image captured by a charge-coupled-device (CCD) camera attached to a microscope, within a processing time of one second. Hence, the present technique can save time, thereby increasing efficiency and reducing cost. The present technique involves the utilization of cell-feature metrics to accurately make decisions on the degree to which individual cells are "good" or "bad" candidates for patch clamping. These metrics include position coordinates (x,y) in the image plane, major-axis length, minor-axis length, area, elongation, roundness, smoothness, angle of orientation, and degree of inclusion in the field of view. The present technique does not require any special hardware beyond commercially available, off-the-shelf patch-clamping hardware: A standard patchclamping microscope system with an attached CCD camera, a personal computer with an imagedata- processing board, and some experience in utilizing imagedata- processing software are all that are needed. A cell image is first captured by the microscope CCD camera and image-data-processing board, then the image data are analyzed by software that implements the present machine-vision technique. This analysis results in the identification of cells that are "good" candidates for patch clamping (see figure). Once a "good" cell is identified, a patch clamp can be effected by an automated patchclamping apparatus or by a human operator. This technique has been shown to enable reliable identification of "good" and "bad" candidate cells for patch clamping. The ultimate goal in further development of this technique is to combine artificial-intelligence processing with instrumentation and controls in order to produce a complete "turnkey" automated patch-clamping system capable of accurately and reliably patch clamping cells with a minimum intervention by a human operator. Moreover, this technique can be adapted to virtually any cellular-analysis procedure that includes repetitive operation of microscope hardware by a human.

McDowell, Mark↗
NASA NTRS1986

Design and development of a Space Station proximity operations research and development mockup

Proximity operations (Prox-Ops) on-orbit refers to all activities taking place within one km of the Space Station. Designing a Prox-Ops control station calls for a comprehensive systems approach which takes into account structural constraints, orbital dynamics including approach/departure flight paths, myriad human factors and other topics. This paper describes a reconfigurable full-scale mock-up of a Prox-Ops station constructed at Ames incorporating an array of windows (with dynamic star field, target vehicle(s), and head-up symbology), head-down perspective display of manned and unmanned vehicles, voice- actuated 'electronic checklist', computer-generated voice system, expert system (to help diagnose subsystem malfunctions), and other displays and controls. The facility is used for demonstrations of selected Prox-Ops approach scenarios, human factors research (work-load assessment, determining external vision envelope requirements, head-down and head-up symbology design, voice synthesis and recognition research, etc.) and development of engineering design guidelines for future module interiors.

Haines, Richard F.↗
NASA NTRS2000

Tera-Ops Processing for ATR

A three-dimensional microelectronic device (3DANN-R) capable of performing general image convolution at the speed of 1012 operations/second (ops) in a volume of less than 1.5 cubic centimeter has been successfully built under the BMDO/JPL VIGILANTE program. 3DANN-R was developed in partnership with Irvine Sensors Corp., Costa Mesa, California. 3DANN-R is a sugar-cube-sized, low power image convolution engine that in its core computation circuitry is capable of performing 64 image convolutions with large (64x64) windows at video frame rates. This paper explores potential applications of 3DANN-R such as target recognition, SAR and hyperspectral data processing, and general machine vision using real data and discuss technical challenges for providing deployable systems for BMDO surveillance and interceptor programs.

Udomkesmalee, Suraphol↗
NASA NTRS1997

A Vision in Aeronautics: The K-12 Wind Tunnel Project

A Vision in Aeronautics, a project within the NASA Lewis Research Center's Information Infrastructure Technologies and Applications (IITA) K-12 Program, employs small-scale, subsonic wind tunnels to inspire students to explore the world of aeronautics and computers. Recently, two educational K-12 wind tunnels were built in the Cleveland area. During the 1995-1996 school year, preliminary testing occurred in both tunnels.

Source record↗