Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “IMAGE ALIGNMENT”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Image Mapping and Visual Attention on the Sensory Ego-Sphere

The Sensory Ego-Sphere (SES) is a short-term memory for a robot in the form of an egocentric, tessellated, spherical, sensory-motor map of the robot s locale. Visual attention enables fast alignment of overlapping images without warping or position optimization, since an attentional point (AP) on the composite typically corresponds to one on each of the collocated regions in the images. Such alignment speeds analysis of the multiple images of the area. Compositing and attention were performed two ways and compared: (1) APs were computed directly on the composite and not on the full-resolution images until the time of retrieval; and (2) the attentional operator was applied to all incoming imagery. It was found that although the second method was slower, it produced consistent and, thereby, more useful APs. The SES is an integral part of a control system that will enable a robot to learn new behaviors based on its previous experiences, and that will enable it to recombine its known behaviors in such a way as to solve related, but novel, task problems with apparent creativity. The approach is to combine sensory-motor data association and dimensionality reduction to learn navigation and manipulation tasks as sequences of basic behaviors that can be implemented with a small set of closed-loop controllers. Over time, the aggregate of behaviors and their transition probabilities form a stochastic network. Then given a task, the robot finds a path in the network that leads from its current state to the goal. The SES provides a short-term memory for the cognitive functions of the robot, association of sensory and motor data via spatio-temporal coincidence, direction of the attention of the robot, navigation through spatial localization with respect to known or discovered landmarks, and structured data sharing between the robot and human team members, the individuals in multi-robot teams, or with a C3 center.

Fleming, Katherine Achim↗
DOE OSTI2018

Towards Automated Transcription of Label Text from Pinned Insect Collections

We present a computer vision system that can transcribe the text on tiny printed labels stacked beneath pinned insects (as found in museum collections). The approach uses multiple views of each label because the labels are often occluded by the pin, the insect specimen, and other labels. Our approach handles occlusion and the extreme viewing angles required to image the stacked labels. Automated image analysis identifies the lines of text and then aligns and rectifies the images. Combining the aligned and rectified images from multiple viewpoints enables us to create a composite image that can be read using optical character recognition tools (OCR) to extract the text. We provide experimental demonstration using both museum specimens and experimental test labels

Agarwal, Nitin↗
DOE OSTI2025

The persistent shadow of the supermassive black hole of M87. II. Model comparisons and theoretical interpretations

The Event Horizon Telescope (EHT) observation of M87∗ in 2018 has revealed a ring with a diameter that is consistent with the 2017 observation. The brightest part of the ring is shifted to the southwest from the southeast. In this paper, we provide theoretical interpretations for the multi-epoch EHT observations for M87∗ by comparing a new general relativistic magnetohydrodynamics model image library with the EHT observations for M87∗ in both 2017 and 2018. The model images include aligned and tilted accretion with parameterized thermal and nonthermal synchrotron emission properties. The 2018 observation again shows that the spin vector of the M87∗ supermassive black hole is pointed away from Earth. A shift of the brightest part of the ring during the multi-epoch observations can naturally be explained by the turbulent nature of black hole accretion, which is supported by the fact that the more turbulent retrograde models can explain the multi-epoch observations better than the prograde models. The EHT data are inconsistent with the tilted models in our model image library. Assuming that the black hole spin axis and its large-scale jet direction are roughly aligned, we expect the brightest part of the ring to be most commonly observed 90 deg clockwise from the forward jet. This prediction can be statistically tested through future observations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Multiperspective Automotive Labeling

Supervised machine learning techniques inherently rely on datasets to be trained. With image datasets traditionally being annotated by humans, many advancements in image annotation tools have been made to ensure creation of rich datasets with accurate labels. Nevertheless, users still find it challenging to create and use their own datasets with labels that reflect their problem domain. We propose a streamlined labeling process that aligns multiperspective images and allows a transition from a labeled perspective to other perspectives. The main goal of this work is to reduce the human effort required for labeling vehicle images under favorable conditions where the image perspectives are correlated and one or more perspectives are known. A case study is described and analyzed to show the effectiveness of the process, as well as constraints and limitations when applied to other cases.

training dataset, multiperspective images, supervi↗
NASA NTRS2010

Polarization Imaging Apparatus

A polarization imaging apparatus has shown promise as a prototype of instruments for medical imaging with contrast greater than that achievable by use of non-polarized light. The underlying principles of design and operation are derived from observations that light interacts with tissue ultrastructures that affect reflectance, scattering, absorption, and polarization of light. The apparatus utilizes high-speed electro-optical components for generating light properties and acquiring polarization images through aligned polarizers. These components include phase retarders made of OptoCeramic (registered TradeMark) material - a ceramic that has a high electro-optical coefficient. The apparatus includes a computer running a program that implements a novel algorithm for controlling the phase retarders, capturing image data, and computing the Stokes polarization images. Potential applications include imaging of superficial cancers and other skin lesions, early detection of diseased cells, and microscopic analysis of tissues. The high imaging speed of this apparatus could be beneficial for observing live cells or tissues, and could enable rapid identification of moving targets in astronomy and national defense. The apparatus could also be used as an analysis tool in material research and industrial processing.

Zou, Yingyin K.↗
NASA NTRS1994

Directional emittance surface measurement system and process

Apparatus and process for measuring the variation of directional emittance of surfaces at various temperatures using a radiometric infrared imaging system. A surface test sample is coated onto a copper target plate provided with selective heating within the desired incremental temperature range to be tested and positioned onto a precision rotator to present selected inclination angles of the sample relative to the fixed positioned and optically aligned infrared imager. A thermal insulator holder maintains the target plate on the precision rotator. A screen display of the temperature obtained by the infrared imager, and inclination readings are provided with computer calculations of directional emittance being performed automatically according to equations provided to convert selected incremental target temperatures and inclination angles to relative target directional emittance values. The directional emittance of flat black lacquer and an epoxy resin measurements obtained are in agreement with the predictions of the electromagnetic theory and with directional emittance data inferred from directional reflectance measurements made on a spectrophotometer.

Puram, Chith K.↗
DOE OSTI2026

SpaceNet 9—Cross-Sensor Alignment of Optical and SAR Imagery

Precise registration of high-resolution synthetic aperture radar (SAR) and optical imagery is necessary for realizing the full potential and benefits of multimodal image analysis. However, two significant challenges presently exist. First, there is a lack of annotated datasets and benchmarks available for high-resolution SAR–optical image registration. Second, an assessment of efficient and reliable image registration methods that can precisely align these modalities is lacking. Here, we present a holistic description of the SpaceNet 9 Challenge and its results. We present a description of the dataset and baseline algorithm along with the results of the challenge, including a description of the winning algorithms. We release the SpaceNet 9 dataset along with open-sourcing the winning algorithms and baseline. The objective of SpaceNet 9 was to compute a dense displacement map that indicates the shift needed to align pixels in an optical image to the pixels in a SAR image. The challenge launched in April 2025 and was active for approximately two months. The top five solutions reduced image alignment error from approximately 34 m to under 13 m for public and private test data, with the best results obtaining a registration error of only 8.5 and 6.7 m on the public testing and private testing dataset, respectively. Usage of pretrained image matching models, robust outlier rejection with RANSAC, and estimating local displacement were common among the top solutions. The results of this challenge provide insight into high-resolution SAR–optical image registration and offer opportunities for future benchmarking in this domain. The baseline algorithm, winning solutions, and datasets are available at https://spacenet.ai/sn9-challenge/.

benchmark datasets↗
NASA NTRS1989

Image defects from surface and alignment errors in grazing incidence telescopes

The rigid body motions and low frequency surface errors of grazing incidence Wolter telescopes are studied. The analysis is based on surface error descriptors proposed by Paul Glenn. In his analysis, the alignment and surface errors are expressed in terms of Legendre-Fourier polynomials. Individual terms in the expression correspond to rigid body motions (decenter and tilt) and low spatial frequency surface errors of mirrors. With the help of the Legendre-Fourier polynomials and the geometry of grazing incidence telescopes, exact and approximated first order equations are derived in this paper for the components of the ray intercepts at the image plane. These equations are then used to calculate the sensitivities of Wolter type I and II telescopes for the rigid body motions and surface deformations. The rms spot diameters calculated from this theory and OSAC ray tracing code agree very well. This theory also provides a tool to predict how rigid body motions and surface errors of the mirrors compensate each other.

Saha, Timo T.↗
NASA NTRS2011

Alignment and Characterization of High Uniformity Imaging Spectrometers

Imaging spectrometers require precise adjustments, in some cases at the sub-micrometer level, in order to achieve auniform response over both the spectral and spatial dimensions. We describe a set of measurement techniques and theircorresponding alignment adjustments to achieve the 95% or higher uniformity specifications required for Earthobservingimaging spectrometers. The methods are illustrated with measurements from the Next Generation Imaging Spectrometer system that has been built at the Jet Propulsion Laboratory, California Institute of Technology, under contract with the National Aeronautics and Space Administration.

Offner spectrometer↗
NASA NTRS1991

Efficient visual grasping alignment for cylinders

Monocular information from a gripper-mounted camera is used to servo the robot gripper to grasp a cylinder. The fundamental concept for rapid pose estimation is to reduce the amount of information that needs to be processed during each vision update interval. The grasping procedure is divided into four phases: learn, recognition, alignment, and approach. In the learn phase, a cylinder is placed in the gripper and the pose estimate is stored and later used as the servo target. This is performed once as a calibration step. The recognition phase verifies the presence of a cylinder in the camera field of view. An initial pose estimate is computed and uncluttered scan regions are selected. The radius of the cylinder is estimated by moving the robot a fixed distance toward the cylinder and observing the change in the image. The alignment phase processes only the scan regions obtained previously. Rapid pose estimates are used to align the robot with the cylinder at a fixed distance from it. The relative motion of the cylinder is used to generate an extrapolated pose-based trajectory for the robot controller. The approach phase guides the robot gripper to a grasping position. The cylinder can be grasped with a minimal reaction force and torque when only rough global pose information is initially available.

Nicewarner, Keith E.↗
NASA NTRS1992

Efficient visual grasping alignment for cylinders

Monocular information from a gripper-mounted camera is used to servo the robot gripper to grasp a cylinder. The fundamental concept for rapid pose estimation is to reduce the amount of information that needs to be processed during each vision update interval. The grasping procedure is divided into four phases: learn, recognition, alignment, and approach. In the learn phase, a cylinder is placed in the gripper and the pose estimate is stored and later used as the servo target. This is performed once as a calibration step. The recognition phase verifies the presence of a cylinder in the camera field of view. An initial pose estimate is computed and uncluttered scan regions are selected. The radius of the cylinder is estimated by moving the robot a fixed distance toward the cylinder and observing the change in the image. The alignment phase processes only the scan regions obtained previously. Rapid pose estimates are used to align the robot with the cylinder at a fixed distance from it. The relative motion of the cylinder is used to generate an extrapolated pose-based trajectory for the robot controller. The approach phase guides the robot gripper to a grasping position. The cylinder can be grasped with a minimal reaction force and torque when only rough global pose information is initially available.

Nicewarner, Keith E.↗
NASA NTRS2004

Examples of Current and Future Uses of Neural-Net Image Processing for Aerospace Applications

Feed forward artificial neural networks are very convenient for performing correlated interpolation of pairs of complex noisy data sets as well as detecting small changes in image data. Image-to-image, image-to-variable and image-to-index applications have been tested at Glenn. Early demonstration applications are summarized including image-directed alignment of optics, tomography, flow-visualization control of wind-tunnel operations and structural-model-trained neural networks. A practical application is reviewed that employs neural-net detection of structural damage from interference fringe patterns. Both sensor-based and optics-only calibration procedures are available for this technique. These accomplishments have generated the knowledge necessary to suggest some other applications for NASA and Government programs. A tomography application is discussed to support Glenn's Icing Research tomography effort. The self-regularizing capability of a neural net is shown to predict the expected performance of the tomography geometry and to augment fast data processing. Other potential applications involve the quantum technologies. It may be possible to use a neural net as an image-to-image controller of an optical tweezers being used for diagnostics of isolated nano structures. The image-to-image transformation properties also offer the potential for simulating quantum computing. Computer resources are detailed for implementing the black box calibration features of the neural nets.

Decker, Arthur J.↗
NASA NTRS2009

Cryogenic Pupil Alignment Test Architecture for Aberrated Pupil Images

A document describes cryogenic test architecture for the James Webb Space Telescope (JWST) integrated science instrument module (ISIM). The ISIM element primarily consists of a mechanical metering structure, three science instruments, and a fine guidance sensor. One of the critical optomechanical alignments is the co-registration of the optical telescope element (OTE) exit pupil with the entrance pupils of the ISIM instruments. The test architecture has been developed to verify that the ISIM element will be properly aligned with the nominal OTE exit pupil when the two elements come together. The architecture measures three of the most critical pupil degrees-of-freedom during optical testing of the ISIM element. The pupil measurement scheme makes use of specularly reflective pupil alignment references located inside the JWST instruments, ground support equipment that contains a pupil imaging module, an OTE simulator, and pupil viewing channels in two of the JWST flight instruments. Pupil alignment references (PARs) are introduced into the instrument, and their reflections are checked using the instrument's mirrors. After the pupil imaging module (PIM) captures a reflected PAR image, the image will be analyzed to determine the relative alignment offset. The instrument pupil alignment preferences are specularly reflective mirrors with non-reflective fiducials, which makes the test architecture feasible. The instrument channels have fairly large fields of view, allowing PAR tip/tilt tolerances on the order of 0.5deg.

Bos, Brent↗
DOE OSTI2026

Polyolefin blends with co-continuous architectures enabled by dynamic covalent crosslinking

Blending polymers produces brittle materials due to macrophase separation and poor interfacial adhesion, which is exemplified by mixtures of polyolefins. This presents a formidable challenge for the mechanical recycling of mixed plastic waste. Here, we demonstrate that dynamic covalent crosslinking of immiscible polyolefin blends creates macrophase separated co-continuous architectures, yet they display excellent mechanical properties, which challenges the conventional wisdom regarding morphology-property relationships in polymer blend compatibilization. We find that the position and orientation of dynamic crosslinks and their influence on crystallinity are key to understanding the structure-morphology-property relationships. In particular, high-resolution microscopy imaging reveals alignment of crystallite planes with strong orientational preference, particularly at polymer-polymer interfaces, which contribute to material performance. We further demonstrate that changes in crosslinker density and valency allow the properties of binary and ternary polyolefin blends to be tuned in a modular fashion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Toward Improving the Generation Quality of Autoregressive Slot VAEs

Unconditional scene inference and generation are challenging to learn jointly with a single compositional model. Despite encouraging progress on models that extract object-centric representations (“slots”) from images, unconditional generation of scenes from slots has received less attention. This is primarily because learning the multiobject relations necessary to imagine coherent scenes is difficult. We hypothesize that most existing slot-based models have a limited ability to learn object correlations. We propose two improvements that strengthen object correlation learning. The first is to condition the slots on a global, scene-level variable that captures higher-order correlations between slots. Second, we address the fundamental lack of a canonical order for objects in images by proposing to learn a consistent order to use for the autoregressive generation of scene objects. Specifically, we train an autoregressive slot prior to sequentially generate scene objects following a learned order. Ordered slot inference entails first estimating a randomly ordered set of slots using existing approaches for extracting slots from images, then aligning those slots to ordered slots generated autoregressively with the slot prior. Our experiments across three multiobject environments demonstrate clear gains in unconditional scene generation quality. Detailed ablation studies are also provided that validate the two proposed improvements.

MATHEMATICS AND COMPUTING↗
NASA NTRS1994

The Transition Region And Coronal Explorer (TRACE)

The objectives and the characteristics of TRACE, selected as a NASA small explorer mission for development and flight in late 1997, is presented. The TRACE science investigation explores the connections between fine-scale magnetic fields and the associated plasma structures on the sun. The instrument collects images of solar plasmas at temperatures from 10(exp 4) to 10(exp 7) K, with an arc second spatial resolution and good temporal resolution and continuum. TRACE and SOHO will gather simultaneous, digital measurements of all temperature regimes of the solar atmospheric, in both high-resolution imaging and spectroscopy, and magnetogram to photosphere. The 30 cm aperture TRACE telescope uses three normal-incidence coatings for the extreme ultraviolet and one for the ultraviolet on quadrants of the primary and secondary mirrors. Interference filters isolate five different ultraviolet bands. The images are aligned and internally stabilized against spacecraft jitter. TRACE will be launched into a sun-synchronous orbit, allowing continuous observing for eight months of the baseline one-year mission. It will be operated in coordination with the SOHO experiment operations facility.

Tarbell, T. D.↗
NASA NTRS1995

Laser-Beam-Alignment Controller

In laser-beam-alignment controller, images from video camera compared to reference patterns by fuzzy-logic pattern comparator. Results processed by fuzzy-logic microcontroller, which sends control signals to motor driver adjusting lens and pinhole in spatial filter.

Krasowski, M. J.↗
NASA NTRS2000

Poster Presentation: Optical Test of NGST Developmental Mirrors

An Optical Testing System (OTS) has been developed to measure the figure and radius of curvature of NGST developmental mirrors in the vacuum, cryogenic environment of the X-Ray Calibration Facility (XRCF) at Marshall Space Flight Center (MSFC). The OTS consists of a WaveScope Shack-Hartmann sensor from Adaptive Optics Associates as the main instrument, a Point Diffraction Interferometer (PDI), a Point Spread Function (PSF) imager, an alignment system, a Leica Disto Pro distance measurement instrument, and a laser source palette (632.8 nm wavelength) that is fiber-coupled to the sensor instruments. All of the instruments except the laser source palette are located on a single breadboard known as the Wavefront Sensor Pallet (WSP). The WSP is located on top of a 5-DOF motion system located at the center of curvature of the test mirror. Two PC's are used to control the OTS. The error in the figure measurement is dominated by the WaveScope's measurement error. An analysis using the absolute wavefront gradient error of 1/50 wave P-V (at 0.6328 microns) provided by the manufacturer leads to a total surface figure measurement error of approximately 1/100 wave rms. This easily meets the requirement of 1/10 wave P-V. The error in radius of curvature is dominated by the Leica's absolute measurement error of VI.5 mm and the focus setting error of Vi.4 mm, giving an overall error of V2 mm. The OTS is currently being used to test the NGST Mirror System Demonstrators (NMSD's) and the Subscale Beryllium Mirror Demonstrator (SBNM).

Hadaway, James B.↗