Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image and video processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Automated synthesis of image processing procedures using AI planning techniques

This paper describes the Multimission VICAR (Video Image Communication and Retrieval) Planner (MVP) (Chien 1994) system, which uses artificial intelligence planning techniques (Iwasaki & Friedland, 1985, Pemberthy & Weld, 1992, Stefik, 1981) to automatically construct executable complex image processing procedures (using models of the smaller constituent image processing subprograms) in response to image processing requests made to the JPL Multimission Image Processing Laboratory (MIPL). The MVP system allows the user to specify the image processing requirements in terms of the various types of correction required. Given this information, MVP derives unspecified required processing steps and determines appropriate image processing programs and parameters to achieve the specified image processing goals. This information is output as an executable image processing program which can then be executed to fill the processing request.

Chien, Steve↗

Bioreactor Mass Transport Studies

The objectives of the proposed research efforts were to develop both a simulation tool and a series of experiments to provide a quantitative assessment of mass transport in the NASA rotating wall perfused vessel (RWPV) bioreactor to be flown on EDU#2. This effort consisted of a literature review of bioreactor mass transport studies, the extension of an existing scalar transport computer simulation to include production and utilization of the scalar, and the evaluation of experimental techniques for determining mass transport in these vessels. Since mass transport at the cell surface is determined primarily by the relative motion of the cell assemblage and the surrounding fluid, a detailed assessment of the relative motion was conducted. Results of the simulations of the motion of spheres in the RWPV under microgravity conditions are compared with flight data from EDU#1 flown on STS-70. The mass transport across the cell membrane depends upon the environment, the cell type, and the biological state of the cell. Results from a literature review of cell requirements of several scalars are presented. As a first approximation, a model with a uniform spatial distribution of utilization or production was developed and results from these simulations are presented. There were two candidate processes considered for the experimental mass transport evaluations. The first was to measure the dissolution rate of solid or gel beads. The second was to measure the induced fluorescence of beads as a stimulant (for example hydrogen peroxide) is infused into the vessel. Either technique would use video taped images of the process for recording the quantitative results. Results of preliminary tests of these techniques are discussed.

Kleis, Stanley J.↗

Three-dimensional perspective visualization

It was demonstrated that image processing computer graphic techniques can provide an effective means of physiographic analysis of remotely sensed regions through the use of three-dimensional perspective rendering. THe methods used to simulate and animate three-dimensional surfaces from two-dimensional imagery and digital elevation models are explained. A brief historic look at JPL's efforts in this field and several examples of animations, illustrating the evolution of these techniques from 1985, are shown. JPL's current research in this area is discussed along with examples of technology transfer and potential commercial application. The software is part of the VICAR (Video Image Communication and Retrieval) image processing system which was developed at the Multimission Image Processing Laboratory of JPL.

Hussey, Kevin↗

Stereo Imaging Miniature Endoscope with Single Imaging Chip and Conjugated Multi-Bandpass Filters

A dual objective endoscope for insertion into a cavity of a body for providing a stereoscopic image of a region of interest inside of the body including an imaging device at the distal end for obtaining optical images of the region of interest (ROI), and processing the optical images for forming video signals for wired and/or wireless transmission and display of 3D images on a rendering device. The imaging device includes a focal plane detector array (FPA) for obtaining the optical images of the ROI, and processing circuits behind the FPA. The processing circuits convert the optical images into the video signals. The imaging device includes right and left pupil for receiving a right and left images through a right and left conjugated multi-band pass filters. Illuminators illuminate the ROI through a multi-band pass filter having three right and three left pass bands that are matched to the right and left conjugated multi-band pass filters. A full color image is collected after three or six sequential illuminations with the red, green and blue lights.

Shahinian, Hrayr Karnig↗

Use Of Video In Microscopic And Ultrasonic Inspection

Two combinations of video and image-data-processing techniques, tone-pulse encoding and precision acoustic imaging, yield grain- and pore-size distributions. Knowledge of such and of fiber orientation important because these characteristics directly related to tensile strength, hardness, fracture toughness, fracture stress, and resistance to impact. One of these combinations of techniques used in nondestructive evaluation of composite parts; both play important roles in development of lightweight composites for use at high temperatures in advanced engines and aircraft. Video system provides easy access to information on diffraction and refraction like that described in article, "Ultrasonic Inspection With Angular-Power-Spectrum Scanning" (LEW-15386).

Generazio, Edward R.↗

Ranging Apparatus and Method Implementing Stereo Vision System

A laser-directed ranging system for use in telerobotics applications and other applications involving physically handicapped individuals. The ranging system includes a left and right video camera mounted on a camera platform, and a remotely positioned operator. The position of the camera platform is controlled by three servo motors to orient the roll axis, pitch axis and yaw axis of the video cameras, based upon an operator input such as head motion. A laser is provided between the left and right video camera and is directed by the user to point to a target device. The images produced by the left and right video cameras are processed to eliminate all background images except for the spot created by the laser. This processing is performed by creating a digital image of the target prior to illumination by the laser, and then eliminating common pixels from the subsequent digital image which includes the laser spot. The horizontal disparity between the two processed images is calculated for use in a stereometric ranging analysis from which range is determined.

Li, Larry C.↗

FPGA-accelerated SpeckleNN with SNL for real-time X-ray single-particle imaging

We present the implementation of a specialized version of our previously published unified embedding model, SpeckleNN, for real-time speckle pattern classification in X-ray Single-Particle Imaging (SPI), using the SLAC Neural Network Library (SNL) on an FPGA platform. This hardware realization transitions SpeckleNN from a prototypic model into a practical edge solution, optimized for running inference near the detector in high-throughput X-ray free-electron laser (XFEL) facilities, such as those found at the Linac Coherent Light Source (LCLS). To address the resource constraints inherent in FPGAs, we developed a more specialized version of SpeckleNN. The original model, which was designed for broader classification across multiple biological samples, comprised ~5.6 million parameters. The new implementation, while reducing the parameter count to 64.6K (a 98.8% reduction), focuses on maintaining the model's essential functionality for real-time operation, achieving an accuracy of 90%. Furthermore, we compressed the latent space from 128 to 50 dimensions. This implementation was demonstrated on the KCU1500 FPGA board, utilizing 71% of available DSPs, 75% of LUTs, and 48% of FFs, with an average power consumption of 9.4W according to the Vivado post-implementation report. The FPGA performed inference on a single image with a latency of 45.015 microseconds at a 200 MHz clock rate. In comparison, running the same inference on an NVIDIA A100 GPU resulted in an average power consumption of ~73W and an image processing latency of around 400 microseconds. Our FPGA-accelerated version of SpeckleNN demonstrated significant improvements, achieving an 8.9 × speedup and a 7.8 × reduction in power consumption compared to the GPU implementation. Key advancements include model specialization and dynamic weight loading through SNL, which eliminates the need for time-consuming FPGA design re-synthesis, allowing fast and continuous deployment of models (re)trained online. These innovations enable real-time adaptive classification and efficient vetoing of speckle patterns, making SpeckleNN more suited for deployment in XFEL facilities. This implementation has the potential to significantly accelerate SPI experiments and enhance adaptability to evolving experimental conditions.

47 OTHER INSTRUMENTATION↗

Applications of Digital Image Processing 11

A new technique, digital image velocimetry, is proposed for the measurement of instantaneous velocity fields of time dependent flows. A time sequence of single-exposure images of seed particles are captured with a high-speed camera, and a finite number of the single-exposure images are sampled within a prescribed period in time. The sampled images are then digitized on an image processor, enhanced, and superimposed to construct an image which is equivalent to a multiple exposure image used in both laser speckle velocimetry and particle image velocimetry. The superimposed image and a single-exposure Image are digitally Fourier transformed for extraction of information on the velocity field. A great enhancement of the dynamic range of the velocity measurement is accomplished through the new technique by manipulating the Fourier transform of both the single-exposure image and the superimposed image. Also the direction of the velocity vector is unequivocally determined. With the use of a high-speed video camera, the whole process from image acquisition to velocity determination can be carried out electronically; thus this technique can be developed into a real-time capability.

Cho, Y. -C.↗

Digital television system design study

The use of digital techniques for transmission of pictorial data is discussed for multi-frame images (television). Video signals are processed in a manner which includes quantization and coding such that they are separable from the noise introduced into the channel. The performance of digital television systems is determined by the nature of the processing techniques (i.e., whether the video signal itself or, instead, something related to the video signal is quantized and coded) and to the quantization and coding schemes employed.

Huth, G. K.↗

Probabilistic Extraction Of Vectors In PIV

Probabilistic technique for extraction of velocity vectors in particle-image velocimetry (PIV) implemented with much less computation. Double-exposure photograph of particles in flow illuminated by sheet of light provides data on velocity field of flow. Photograph converted into video image then digitized and processed by computer into velocity-field data. Velocity vectors in interrogation region chosen from magnitude and angle histograms constructed from centroid map of region.

Humphreys, William M., Jr.↗

Monocular Video Measurement Of Position And Orientation

Monocular video imaging and image-data-processing system views robotic vehicle and measures position and orientation of vehicle in terms of position and orientation of colored cylinder mounted on vehicle. Data-processing subsystem determines position of cylinder from viewing angle and size of colored cylinder in image. System also follows innovative approach in determining orientation of cylinder.

Volpe, Richard A.↗

Transport and Chemical Effects on Concurrent and Opposed-Flow Flame Spread at Microgravity

With support from a previous NASA grant, NAG3-161 1, the PI studied the effects of diluent type, the addition of sub-flammability-limit concentrations of combustible gases, and the effects of concurrent buoyant flow on flame spread processes. The results of these studies are reported and directions for the current grant outlined. Most experiments were conducted in a 20 liter combustion chamber. Exactly the same apparatus was used for 1 g and microgravity tests. The effect of inert gases He, Ar, N2, CO2 and SF6 on flame spread were tested since they provide a variety of radiative properties and oxygen Lewis numbers. CO and CH4 were used for the gaseous fuels in partially-premixed atmosphere tests, plus H2, C3H8 and NH3 for 1 g tests only. In most experiments 5 cm wide Kimwipe samples 15 cm long were used and were held by aluminum quenching plates. The samples were ignited by an electrically-heated Kanthal wire. The flame spread process was imaged via three video cameras and a laser shearing interferometer.

Honda, L. K.↗

Autonomic straightening after gravitropic curvature of cress roots

Few studies have documented the response of gravitropically curved organs to a withdrawal of a constant gravitational stimulus. The effects of stimulus withdrawal on gravitropic curvature were studied by following individual roots of cress (Lepidium sativum L.) through reorientation and clinostat rotation. Roots turned to the horizontal curved down 62 degrees and 88 degrees after 1 and 5 h, respectively. Subsequent rotation on a clinostat for 6 h resulted in root straightening through a loss of gravitropic curvature in older regions and through new growth becoming aligned closer to the prestimulus vertical. However, these roots did not return completely to the prestimulus vertical, indicating the retention of some gravitropic response. Clinostat rotation shifted the mean root angle -36 degrees closer to the prestimulus vertical, regardless of the duration of prior horizontal stimulation. Control roots (no horizontal stimulation) were slanted at various angles after clinostat rotation. These findings indicate that gravitropic curvature is not necessarily permanent, and that the root retains some commitment to its equilibrium orientation prior to gravitropic stimulation.

Non-NASA Center↗

Colour thresholding and objective quantification in bioimaging

Computer imaging is rapidly becoming an indispensable tool for the quantification of variables in research and medicine. Whilst its use in medicine has largely been limited to qualitative observations, imaging in applied basic sciences, medical research and biotechnology demands objective quantification of the variables in question. In black and white densitometry (0-256 levels of intensity) the separation of subtle differences between closely related hues from stains is sometimes very difficult. True-colour and real-time video microscopy analysis offer choices not previously available with monochrome systems. In this paper we demonstrate the usefulness of colour thresholding, which has so far proven indispensable for proper objective quantification of the products of histochemical reactions and/or subtle differences in tissue and cells. In addition, we provide interested, but untrained readers with basic information that may assist decisions regarding the most suitable set-up for a project under consideration. Data from projects in progress at Tulane are shown to illustrate the advantage of colour thresholding over monochrome densitometry and for objective quantification of subtle colour differences between experimental and control samples.

NASA Discipline Neuroscience↗

Some technical considerations on the evolution of the IBIS system

In connection with work related to the use of earth-resources images, it became apparent by 1974, that certain system improvements are necessary for the efficient processing of digital data. To resolve this dilemma, Billingsley and Bryant (1975) proposed the use of image processing technology. Bryant and Zobrist (1976) reported the development of the Image Based Information System (IBIS) as a subset of an overall Video Image Communication and Retrieval (VICAR) image processing system. A description of IBIS is presented, and its employment in connection with advanced applications is discussed. It is concluded that several important lessons have been learned from the development of IBIS. The development of a flexible system such as IBIS is found to rest upon the prior development of a general purpose image processing system, such as VICAR.

Bryant, N. A.↗

Visual Object Recognition and Tracking of Tools

A method has been created to automatically build an algorithm off-line, using computer-aided design (CAD) models, and to apply this at runtime. The object type is discriminated, and the position and orientation are identified. This system can work with a single image and can provide improved performance using multiple images provided from videos. The spatial processing unit uses three stages: (1) segmentation; (2) initial type, pose, and geometry (ITPG) estimation; and (3) refined type, pose, and geometry (RTPG) calculation. The image segmentation module files all the tools in an image and isolates them from the background. For this, the system uses edge-detection and thresholding to find the pixels that are part of a tool. After the pixels are identified, nearby pixels are grouped into blobs. These blobs represent the potential tools in the image and are the product of the segmentation algorithm. The second module uses matched filtering (or template matching). This approach is used for condensing synthetic images using an image subspace that captures key information. Three degrees of orientation, three degrees of position, and any number of degrees of freedom in geometry change are included. To do this, a template-matching framework is applied. This framework uses an off-line system for calculating template images, measurement images, and the measurements of the template images. These results are used online to match segmented tools against the templates. The final module is the RTPG processor. Its role is to find the exact states of the tools given initial conditions provided by the ITPG module. The requirement that the initial conditions exist allows this module to make use of a local search (whereas the ITPG module had global scope). To perform the local search, 3D model matching is used, where a synthetic image of the object is created and compared to the sensed data. The availability of low-cost PC graphics hardware allows rapid creation of synthetic images. In this approach, a function of orientation, distance, and articulation is defined as a metric on the difference between the captured image and a synthetic image with an object in the given orientation, distance, and articulation. The synthetic image is created using a model that is looked up in an object-model database. A composable software architecture is used for implementation. Video is first preprocessed to remove sensor anomalies (like dead pixels), and then is processed sequentially by a prioritized list of tracker-identifiers.

English, James↗

The interactive digital video interface

A frequent complaint in the computer oriented trade journals is that current hardware technology is progressing so quickly that software developers cannot keep up. A example of this phenomenon can be seen in the field of microcomputer graphics. To exploit the advantages of new mechanisms of information storage and retrieval, new approaches must be made towards incorporating existing programs as well as developing entirely new applications. A particular area of need is the correlation of discrete image elements to textural information. The interactive digital video (IDV) interface embodies a new concept in software design which addresses these needs. The IDV interface is a patented device and language independent process for identifying image features on a digital video display and which allows a number of different processes to be keyed to that identification. Its capabilities include the correlation of discrete image elements to relevant text information and the correlation of these image features to other images as well as to program control mechanisms. Sophisticated interrelationships can be set up between images, text, and program control mechanisms.

Doyle, Michael D.↗

High resolution, high frame rate video technology development plan and the near-term system conceptual design

The objective of the High Resolution, High Frame Rate Video Technology (HHVT) development effort is to provide technology advancements to remove constraints on the amount of high speed, detailed optical data recorded and transmitted for microgravity science and application experiments. These advancements will enable the development of video systems capable of high resolution, high frame rate video data recording, processing, and transmission. Techniques such as multichannel image scan, video parameter tradeoff, and the use of dual recording media were identified as methods of making the most efficient use of the near-term technology.

Ziemke, Robert A.↗