SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A telerobotic control station is described. In it, a machine vision system measures the position, orientation, and configuration of a user's hand. A robotic manipulator mirrors the status of the hand. This concept has two benefits: control actions are intuitive and easily learned, and the workstation requires little volume or mass.
NASA has developed an image processor, the Programmable Remapper, for certain functions in machine vision. The Remapper performs a highly arbitrary geometric warping of an image at video rate. It might ultimately be shrunk to a size and cost that could allow its use in a low-vision prosthesis. Coordinate warpings have been developed for retinitis pigmentosa (tunnel vision) and for maculapathy (loss of central field) that are intended to make best use of the patient's remaining viable retina. The rationales and mathematics are presented for some warpings that we will try in clinical studies using the Remapper's prototype.
In this paper we formulate and use information and fidelity criteria to assess image gathering and processing, combining optical design with image-forming and edge-detection algorithms. The optical design of the image-gathering system revolves around the relationship among sampling passband, spatial response, and signal-to-noise ratio (SNR). Our formulations of information, fidelity, and optimal (Wiener) restoration account for the insufficient sampling (i.e., aliasing) common in image gathering as well as for the blurring and noise that conventional formulations account for. Performance analyses and simulations for ordinary optical-design constraints and random scences indicate that (1) different image-forming algorithms prefer different optical designs; (2) informationally optimized designs maximize the robustness of optimal image restorations and lead to the highest-spatial-frequency channel (relative to the sampling passband) for which edge detection is reliable (if the SNR is sufficiently high); and (3) combining the informationally optimized design with a 3 by 3 lateral-inhibitory image-plane-processing algorithm leads to a spatial-response shape that approximates the optimal edge-detection response of (Marr's model of) human vision and thus reduces the data preprocessing and transmission required for machine vision.
As the technological world strives for efficiency, the need for economical equipment that increases operator proficiency in minimal time is fundamental. This system links a CCD camera, a controller and a robotic arm to a computer vision system to provide an alternative method of image analysis. The machine vision system which was employed possesses software tools for acquiring and analyzing images which are received through a CCD camera. After feature extraction on the object in the image was performed, information about the object's location, orientation and distance from the robotic gripper is sent to the robot controller so that the robot can manipulate the object.
The recent interest in the use of machine vision for flight vehicle guidance is motivated by the need to automate the nap-of-the-earth flight regime of helicopters. Vision-based stereo ranging problem is cast as an optimal control problem in this paper. A quadratic performance index consisting of the integral of the error between observed image irradiances and those predicted by a Pade approximation of the correspondence hypothesis is then used to define an optimization problem. The necessary conditions for optimality yield a set of linear two-point boundary-value problems. These two-point boundary-value problems are solved in feedback form using a version of the backward sweep method. Application of the ranging algorithm is illustrated using a laboratory image pair.
A low-power high-speed smart sensor system based on a large format active pixel sensor (APS) integrated with a programmable neural processor for space exploration missions is presented. The concept of building an advanced smart sensing system is demonstrated by a system-level microchip design that is composed with an APS sensor, a programmable neural processor, and an embedded microprocessor in a SOI CMOS technology. This ultra-fast smart sensor system-on-a-chip design mimics what is inherent in biological vision systems. Moreover, it is programmable and capable of performing ultra-fast machine vision processing in all levels such as image acquisition, image fusion, image analysis, scene interpretation, and control functions. The system provides about one tera-operation-per-second computing power which is a two order-of-magnitude increase over that of state-of-the-art microcomputers. Its high performance is due to massively parallel computing structures, high data throughput rates, fast learning capabilities, and advanced VLSI system-on-a-chip implementation.
This work covers the design and test of a machine vision algorithm for generating high-accuracy pitch and yaw pointing solutions relative to the sun for the High Energy Replicated Optics to Explore the Sun (HEROES) mission. It describes how images were constructed by focusing an image of the sun onto a plate printed with a pattern of small fiducial markers. Images of this plate were processed in real time to determine relative position of the balloon payload to the sun. The algorithm is broken into four problems: circle detection, fiducial detection, fiducial identification, and image registration. Circle detection is handled by an "Average Intersection" method, fiducial detection by a matched filter approach, identification with an ad-hoc method based on the spacing between fiducials, and image registration with a simple least squares fit. Performance is verified on a combination of artificially generated images, test data recorded on the ground, and images from the 2013 flight
This work covers the design and test of a machine vision algorithm for generating high-accuracy pitch and yaw pointing solutions relative to the sun for the High Energy Replicated Optics to Explore the Sun (HEROES) mission. It describes how images were constructed by focusing an image of the sun onto a plate printed with a pattern of small fiducial markers. Images of this plate were processed in real time to determine relative position of the balloon payload to the sun. The algorithm is broken into four problems: circle detection, fiducial detection, fiducial identification, and image registration. Circle detection is handled by an Average Intersection method, fiducial detection by a matched filter approach, identification with an ad-hoc method based on the spacing between fiducials, and image registration with a simple least squares fit. Performance is verified on a combination of artificially generated images, test data recorded on the ground, and images from the 2013 flight.
Stereoscopy and motion provide clues to outlines of objects. Digital image-processing system acts as "intelligent" automatic machine-vision system by processing views from stereoscopic television cameras into three-dimensional coordinates of moving object in view. Epipolar-line technique used to find corresponding points in stereoscopic views. Robotic vision system analyzes views from two television cameras to detect rigid three-dimensional objects and reconstruct numerically in terms of coordinates of corner points. Stereoscopy and effects of motion on two images complement each other in providing image-analyzing subsystem with clues to natures and locations of principal features.
In this paper, an ultra-fast low-power smart vision system-on-a-chip design is proposed to provide effective solutions for real time machine vision applications by taking advantages of advances in integrated sensing/processing designs, electronic neural networks, advanced microprocessors, and sub-micron VLSI systemns-on-a-chip (SOAC) technology.
This work covers the design and test of a machine vision algorithm for generating high- accuracy pitch and yaw pointing solutions relative to the sun on a high altitude balloon. It describes how images were constructed by focusing an image of the sun onto a plate printed with a pattern of small cross-shaped fiducial markers. Images of this plate taken with an off-the-shelf camera were processed to determine relative position of the balloon payload to the sun. The algorithm is broken into four problems: circle detection, fiducial detection, fiducial identification, and image registration. Circle detection is handled by an "Average Intersection" method, fiducial detection by a matched filter approach, and identification with an ad-hoc method based on the spacing between fiducials. Performance is verified on real test data where possible, but otherwise uses artificially generated data. Pointing knowledge is ultimately verified to meet the 20 arcsecond requirement.
The project addressed an inability to monitor avian interactions with photovoltaic (PV) solar energy facilities necessary for understanding PV solar impacts on birds. In the project, machine-vision technology that continuously monitors avian activities at PV solar facilities was developed. The technology includes four machine-learning (ML) models, each of which accomplishes a specific task in detecting birds and classifying their activities in live or recorded videos—detecting and tracking moving objects, differentiating birds from other objects, detecting bird collisions with solar panels, and classifying non-collision bird activities around PV facilities. Major project outcomes include adoption by two of DOE SETO’s SolWEB projects, providing novel observational data on birds to promote co-location of PV solar development and habitat conservation, known as ecovoltaics.
The abrasive waterjet machining process was introduced in the 1980s as a new cutting tool; the process has the ability to cut almost any material. Currently, the AWJ process is used in many world-class factories, producing parts for use in daily life. A description of this process and its influencing parameters are first presented in this paper, along with process models for the AWJ tool itself and also for the jet–material interaction. The AWJ material removal process occurs through the high-velocity impact of abrasive particles, whose tips micromachine the material at the microscopic scale, with no thermal or mechanical adverse effects. The macro-characteristics of the cut surface, such as its taper, trailback, and waviness, are discussed, along with methods of improving the geometrical accuracy of the cut parts using these attributes. For example, dynamic angular compensation is used to correct for the taper and undercut in shape cutting. The surface finish is controlled by the cutting speed, hydraulic, and abrasive parameters using software and process models built into the controllers of CNC machines. In addition to shape cutting, edge trimming is presented, with a focus on the carbon fiber composites used in aircraft and automotive structures, where special AWJ tools and manipulators are used. Examples of the precision cutting of microelectronic and solar cell parts are discussed to describe the special techniques that are used, such as machine vision and vacuum-assist, which have been found to be essential to the integrity and accuracy of cut parts. The use of the AWJ machining process was extended to other applications, such as drilling, boring, milling, turning, and surface modification, which are presented in this paper as actual industrial applications. To demonstrate the versatility of the AWJ machining process, the data in this paper were selected to cover a wide range of materials, such as metal, glass, composites, and ceramics, and also a wide range of thicknesses, from 1 mm to 600 mm. The trends of Industry 4.0 and 5.0, AI, and IoT are also presented.
Spectral machine vision collects spectral and spatial information as three-dimensional hypercubes and digitally processes them, which causes a data bottleneck, limiting power efficiency, frame rate, and spectral-spatial resolution. This work introduces spectral kernel machines (SKMs) to overcome these bottlenecks. SKM directly compresses spectral analysis through the output photocurrent and learns from example objects to identify and classify new samples in a "sniff-and-seek" mode. We experimentally demonstrated SKMs with electrically tunable bipolar black phosphorus-molybdenum disulfide (bP-MoS2) photodiodes in the near- and mid-infrared band and silicon photoconductors in the visible band, performing versatile intelligent tasks from chemometrics to semiconductor metrology. This architecture consumed substantially less power and was more than an order of magnitude faster than existing solutions for hyperspectral image analysis, defining an intelligent imaging and sensing paradigm with intriguing possibilities.
The scope of the current work is to develop practical sensing implementations for robots operating in complex, partially unstructured environments. A focus in this work is to develop object models and estimation techniques which are specific to requirements of robot locomotion, approach and avoidance, and grasp and manipulation. Such problems have to date received limited attention in either computer or human vision - in essence, asking not only how perception is in general modeled, but also what is the functional purpose of its underlying representations. As in the past, researchers are drawing on ideas from both the psychological and machine vision literature. Of particular interest is the development 3-D shape and motion estimates for complex objects when given only partial and uncertain information and when such information is incrementally accrued over time. Current studies consider the use of surface motion, contour, and texture information, with the longer range goal of developing a fused sensing strategy based on these sources and others.
The paper discusses the incorporation of vision into a robotic cell to obtain cell status information and use this information to influence the robot operation. It discusses both mechanical and informational solutions to the operational issues which are present. The cell uses a machine vision system to determine information about part presence in the shipping tray, part location in the tray, and tray orientation. The vision system's edge detector algorithm is used to identify the orientation of the packing trays. In addition, different vision tools are used to determine if parts are present in the trays based on the unique configuration of the individual parts. The mechanical solutions discuss the handling of medium weight (10 - 25 lb.) parts at an average cycle time of 3.1 seconds per part. The robot gripper must handle 33 different models, three identical parts at a time. This is accomplished by using stacks of rotary actuators and slides between the stacks.
We have previously shown that the perceived speed of a moving grating depends upon its contrast, with lower-contrast patterns appearing to move more slowly than otherwise identical higher-contrast patterns. To explain this finding while remaining consistent with the findings of McKee, Silverman and Nakayama [(1986) Vision Research, 26, 609-619], we proposed that this misperception might arise from a modified version of the contrast-normalization procedure, envisaged by Adelson and Bergen [(1986) The extraction of spatio-temporal energy in human and machine vision (pp. 135-139). Charleston, S.C.: IEEE Computer Society] as a necessary second stage of motion-energy models of human motion processing. Specifically, our previous results might be explained if the two gratings to be compared interfered with each other's normalization. To test this hypothesis we performed two experiments. Experiment 1 demonstrates that the contrast effects persist even when two grating patches to be compared are presented up to 5 sec apart so that they would not be expected to bias each other's normalization. Experiment 2 shows that the contrast effects are unchanged when the two grating patches are surrounded by a range of patterns whose contrast would be expected to interfere with any normalization process. These two results allow the rejection of the contrast-normalized motion-energy hypothesis as an explanation of human speed perception. We discuss the consequences of these results on models of speed processing in the human visual system.
Current available robotic systems provide limited support for CAD-based model-driven visualization, sensing algorithm development and integration, and automated graphical planning systems. This paper describes ongoing work which provides the functionality necessary to apply advanced robotics to automated manufacturing and assembly operations. An interface has been built which incorporates 6-DOF tactile manipulation, displays for three dimensional graphical models, and automated tracking functions which depend on automated machine vision. A set of tools for single and multiple focal plane sensor image processing and understanding has been demonstrated which utilizes object recognition models. The resulting tool will enable sensing and planning from computationally simple graphical objects. A synergistic interplay between human and operator vision is created from programmable feedback received from the controller. This approach can be used as the basis for implementing enhanced safety in automated robotics manufacturing, assembly, repair and inspection tasks in both ground and space applications. Thus, an interactive capability has been developed to match the modeled environment to the real task environment for safe and predictable task execution.