Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image alignment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Efficient visual grasping alignment for cylinders

Monocular information from a gripper-mounted camera is used to servo the robot gripper to grasp a cylinder. The fundamental concept for rapid pose estimation is to reduce the amount of information that needs to be processed during each vision update interval. The grasping procedure is divided into four phases: learn, recognition, alignment, and approach. In the learn phase, a cylinder is placed in the gripper and the pose estimate is stored and later used as the servo target. This is performed once as a calibration step. The recognition phase verifies the presence of a cylinder in the camera field of view. An initial pose estimate is computed and uncluttered scan regions are selected. The radius of the cylinder is estimated by moving the robot a fixed distance toward the cylinder and observing the change in the image. The alignment phase processes only the scan regions obtained previously. Rapid pose estimates are used to align the robot with the cylinder at a fixed distance from it. The relative motion of the cylinder is used to generate an extrapolated pose-based trajectory for the robot controller. The approach phase guides the robot gripper to a grasping position. The cylinder can be grasped with a minimal reaction force and torque when only rough global pose information is initially available.

Nicewarner, Keith E.↗

Efficient visual grasping alignment for cylinders

Monocular information from a gripper-mounted camera is used to servo the robot gripper to grasp a cylinder. The fundamental concept for rapid pose estimation is to reduce the amount of information that needs to be processed during each vision update interval. The grasping procedure is divided into four phases: learn, recognition, alignment, and approach. In the learn phase, a cylinder is placed in the gripper and the pose estimate is stored and later used as the servo target. This is performed once as a calibration step. The recognition phase verifies the presence of a cylinder in the camera field of view. An initial pose estimate is computed and uncluttered scan regions are selected. The radius of the cylinder is estimated by moving the robot a fixed distance toward the cylinder and observing the change in the image. The alignment phase processes only the scan regions obtained previously. Rapid pose estimates are used to align the robot with the cylinder at a fixed distance from it. The relative motion of the cylinder is used to generate an extrapolated pose-based trajectory for the robot controller. The approach phase guides the robot gripper to a grasping position. The cylinder can be grasped with a minimal reaction force and torque when only rough global pose information is initially available.

Nicewarner, Keith E.↗

Examples of Current and Future Uses of Neural-Net Image Processing for Aerospace Applications

Feed forward artificial neural networks are very convenient for performing correlated interpolation of pairs of complex noisy data sets as well as detecting small changes in image data. Image-to-image, image-to-variable and image-to-index applications have been tested at Glenn. Early demonstration applications are summarized including image-directed alignment of optics, tomography, flow-visualization control of wind-tunnel operations and structural-model-trained neural networks. A practical application is reviewed that employs neural-net detection of structural damage from interference fringe patterns. Both sensor-based and optics-only calibration procedures are available for this technique. These accomplishments have generated the knowledge necessary to suggest some other applications for NASA and Government programs. A tomography application is discussed to support Glenn's Icing Research tomography effort. The self-regularizing capability of a neural net is shown to predict the expected performance of the tomography geometry and to augment fast data processing. Other potential applications involve the quantum technologies. It may be possible to use a neural net as an image-to-image controller of an optical tweezers being used for diagnostics of isolated nano structures. The image-to-image transformation properties also offer the potential for simulating quantum computing. Computer resources are detailed for implementing the black box calibration features of the neural nets.

Decker, Arthur J.↗

Predicting oropharyngeal tumor volume throughout the course of radiation therapy from pretreatment computed tomography data using general linear models

Purpose: The purpose of this work was to develop and evaluate the accuracy of several predictive models of variation in tumor volume throughout the course of radiation therapy. Methods: Nineteen patients with oropharyngeal cancers were imaged daily with CT-on-rails for image-guided alignment per an institutional protocol. The daily volumes of 35 tumors in these 19 patients were determined and used to generate (1) a linear model in which tumor volume changed at a constant rate, (2) a general linear model that utilized the power fit relationship between the daily and initial tumor volumes, and (3) a functional general linear model that identified and exploited the primary modes of variation between time series describing the changing tumor volumes. Primary and nodal tumor volumes were examined separately. The accuracy of these models in predicting daily tumor volumes were compared with those of static and linear reference models using leave-one-out cross-validation. Results: In predicting the daily volume of primary tumors, the general linear model and the functional general linear model were more accurate than the static reference model by 9.9% (range: −11.6%–23.8%) and 14.6% (range: −7.3%–27.5%), respectively, and were more accurate than the linear reference model by 14.2% (range: −6.8%–40.3%) and 13.1% (range: −1.5%–52.5%), respectively. In predicting the daily volume of nodal tumors, only the 14.4% (range: −11.1%–20.5%) improvement in accuracy of the functional general linear model compared to the static reference model was statistically significant. Conclusions: A general linear model and a functional general linear model trained on data from a small population of patients can predict the primary tumor volume throughout the course of radiation therapy with greater accuracy than standard reference models. These more accurate models may increase the prognostic value of information about the tumor garnered from pretreatment computed tomography images and facilitate improved treatment management.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Cryogenic Pupil Alignment Test Architecture for Aberrated Pupil Images

A document describes cryogenic test architecture for the James Webb Space Telescope (JWST) integrated science instrument module (ISIM). The ISIM element primarily consists of a mechanical metering structure, three science instruments, and a fine guidance sensor. One of the critical optomechanical alignments is the co-registration of the optical telescope element (OTE) exit pupil with the entrance pupils of the ISIM instruments. The test architecture has been developed to verify that the ISIM element will be properly aligned with the nominal OTE exit pupil when the two elements come together. The architecture measures three of the most critical pupil degrees-of-freedom during optical testing of the ISIM element. The pupil measurement scheme makes use of specularly reflective pupil alignment references located inside the JWST instruments, ground support equipment that contains a pupil imaging module, an OTE simulator, and pupil viewing channels in two of the JWST flight instruments. Pupil alignment references (PARs) are introduced into the instrument, and their reflections are checked using the instrument's mirrors. After the pupil imaging module (PIM) captures a reflected PAR image, the image will be analyzed to determine the relative alignment offset. The instrument pupil alignment preferences are specularly reflective mirrors with non-reflective fiducials, which makes the test architecture feasible. The instrument channels have fairly large fields of view, allowing PAR tip/tilt tolerances on the order of 0.5deg.

Bos, Brent↗

SU-F-T-118: Characterization of Change in Fractional Anisotropy After Radiation Therapy: Does Nearby Disruption Predict for White Matter Damage?

Purpose: We investigated predictors of fractional anisotropy (FA) change in the corticospinal white matter tract (CST) following radiation therapy (RT). Methods: Diffusion tensor imaging (DTI) is a non-invasive modality which models water diffusion properties. FA quantifies the extent of directional bias—a decrease indicates disrupted white matter integrity. Fifteen patients with high-grade glioma underwent DTI scans before, and ten months after RT to 59.4–60 Gy. The CST was segmented using an automated atlas-based algorithm on all DTI images. Treatment planning CT and DTI images were aligned using non-linear registration allowing for baseline FA, follow-up FA, and absorbed dose to be determined in each voxel. Relative FA change was dichotomized into a binary outcome using 25% decrease as cutoff. Three metrics were assessed as predictors: voxel dose, distance from the voxel to the center of the CST (Rc), and the number of neighboring voxels (Nadj from 0 to 26) with ≥25% decrease in FA. Logistic regression and the area under the receiver-operating characteristics curve (AUC) analysis were performed for each patient. Results: Median age of the cohort was 59 years (range: 40–85). The average number of voxels in the CST amongst all patients was 1181 (±172, SD). In logistic regression, the probability of FA change was highly associated with Nadj in all 15 patients with corresponding AUCs between 0.81 and 0.97. With all three metrics included in the logistic regression models, Nadj was highly significant (p<0.001) in all patients, voxel dose significant (p<0.05) in 3/15 patients, and Rc significant in 12/15 patients (p<0.05). Conclusion: The number of neighboring voxels with change in FA was the dominant predictor of FA change at any given voxel. This suggests that the microenvironment of surrounding white matter disruption after radiation therapy may drive local effects along a white matter tract. Pettersson and Cervino are funded by a Varian Medical Systems grant.

60 APPLIED LIFE SCIENCES↗

How Important Is a Reproducible Breath Hold for Deep Inspiration Breath Hold Breast Radiation Therapy?

Purpose: Deep inspiration breath hold (DIBH) for left-sided breast cancer has been shown to reduce heart dose. Surface imaging helps to ensure accurate breast positioning, but it does not guarantee a reproducible breath hold (BH) at DIBH treatments. We examine the effects of variable BH positions for DIBH treatments. Methods and Materials: Twenty-five patients who underwent free breathing (FB) and DIBH scans were reviewed. Four plans were created for each patient: FB, DIBH, FB-DIBH (the DIBH plans were copied to the FB images and recalculated, and image registration was based on breast tissue), and P-DIBH (a partial BH with the heart shifted midway between the FB and DIBH positions). The FB-DIBH plans give a “worst-case” scenario for surface imaging DIBH, where the breast is aligned by surface imaging but the patient is not holding their breath. Kolmogorov-Smirnov tests were used to compare the dose metrics. Results: The DIBH plans gave lower heart dose and comparable breast coverage versus FB in all cases. The FB-DIBH plans showed no significant difference versus FB plans for breast coverage, mean heart dose, or maximum heart dose (P≥.10). The mean heart dose differed between FB-DIBH and FB by <2 Gy for all cases, and the maximum heart dose differed by <2 Gy for 21 cases. The P-DIBH plans showed significantly lower mean heart dose than FB (P<.01). The mean heart doses for the P-DIBH plans were <FB for 22 cases, the maximum dose was <FB for 18 cases. Conclusions: A DIBH plan delivered to a FB patient setup with surface imaging will yield dosimetry similar to that of a plan created and delivered FB. A DIBH plan delivered with even a partial BH can give reduced heart dose compared with FB techniques.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

WE-F-16A-04: Micro-Irradiator Treatment Verification with High-Resolution 3D-Printed Rodent-Morphic Dosimeters

Purpose: Pre-clinical micro-radiation therapy studies often utilize very small beams (∼0.5-5mm), and require accurate dose delivery in order to effectively investigate treatment efficacy. Here we present a novel high-resolution absolute 3D dosimetry procedure, capable of ∼100-micron isotopic dosimetry in anatomically accurate rodent-morphic phantoms Methods: Anatomically accurate rat-shaped 3D dosimeters were made using 3D printing techniques from outer body contours and spinal contours outlined on CT. The dosimeters were made from a radiochromic plastic material PRESAGE, and incorporated high-Z PRESASGE inserts mimicking the spine. A simulated 180-degree spinal arc treatment was delivered through a 2 step process: (i) cone-beam-CT image-guided positioning was performed to precisely position the rat-dosimeter for treatment on the XRad225 small animal irradiator, then (ii) treatment was delivered with a simulated spine-treatment with a 180-degree arc with 20mm x 10mm cone at 225 kVp. Dose distribution was determined from the optical density change using a high-resolution in-house optical-CT system. Absolute dosimetry was enabled through calibration against a novel nano-particle scintillation detector positioned in a channel in the center of the distribution. Results: Sufficient contrast between regular PRESAGE (tissue equivalent) and high-Z PRESAGE (spinal insert) was observed to enable highly accurate image-guided alignment and targeting. The PRESAGE was found to have linear optical density (OD) change sensitivity with respect to dose (R{sup 2} = 0.9993). Absolute dose for 360-second irradiation at isocenter was found to be 9.21Gy when measured with OD change, and 9.4Gy with nano-particle detector- an agreement within 2%. The 3D dose distribution was measured at 500-micron resolution Conclusion: This work demonstrates for the first time, the feasibility of accurate absolute 3D dose measurement in anatomically accurate rat phantoms containing variable density PRESAGE material (tissue equivalent and bone equivalent). This method enables precise treatment verification of micro-radiation therapies, and enhances the robustness of tumor radio-response studies. This work was supported by NIH R01CA100835.

60 APPLIED LIFE SCIENCES↗

Depth-resolved registration of transesophageal echo to x-ray fluoroscopy using an inverse geometry fluoroscopy system

Purpose: Image registration between standard x-ray fluoroscopy and transesophageal echocardiography (TEE) has recently been proposed. Scanning-beam digital x-ray (SBDX) is an inverse geometry fluoroscopy system designed for cardiac procedures. This study presents a method for 3D registration of SBDX and TEE images based on the tomosynthesis and 3D tracking capabilities of SBDX. Methods: The registration algorithm utilizes the stack of tomosynthetic planes produced by the SBDX system to estimate the physical 3D coordinates of salient key-points on the TEE probe. The key-points are used to arrive at an initial estimate of the probe pose, which is then refined using a 2D/3D registration method adapted for inverse geometry fluoroscopy. A phantom study was conducted to evaluate probe pose estimation accuracy relative to the ground truth, as defined by a set of coregistered fiducial markers. This experiment was conducted with varying probe poses and levels of signal difference-to-noise ratio (SDNR). Additional phantom and in vivo studies were performed to evaluate the correspondence of catheter tip positions in TEE and x-ray images following registration of the two modalities. Results: Target registration error (TRE) was used to characterize both pose estimation and registration accuracy. In the study of pose estimation accuracy, successful pose estimates (3D TRE < 5.0 mm) were obtained in 97% of cases when the SDNR was 5.9 or higher in seven out of eight poses. Under these conditions, 3D TRE was 2.32 ± 1.88 mm, and 2D (projection) TRE was 1.61 ± 1.36 mm. Probe localization error along the source-detector axis was 0.87 ± 1.31 mm. For the in vivo experiments, mean 3D TRE ranged from 2.6 to 4.6 mm and mean 2D TRE ranged from 1.1 to 1.6 mm. Anatomy extracted from the echo images appeared well aligned when projected onto the SBDX images. Conclusions: Full 6 DOF image registration between SBDX and TEE is feasible and accurate to within 5 mm. Future studies will focus on real-time implementation and application-specific analysis.

60 APPLIED LIFE SCIENCES↗

WE-H-207A-05: Spatial Co-Localization of F-18 NaF Vs. F-18 FDG Defined Disease Volumes

Purpose: Both [F-18]NaF and [F-18]FDG show promise for quantitative PET/CT assessment in metastatic prostate cancer to bone. Broad agreement between the tracers has been shown but voxel-wise correspondence has not been explored in depth. This study evaluates the spatial co-localization of [F-18]NaF PET and [F-18]FDG PET in bone lesions. Methods: Seventy-three lesion contours were identified in six patients receiving dynamic NaF PET/CT and FDG PET/CT scans two hours apart using identical fields-of-view. Tracer uptake (SUV) reflecting 60 minutes post-injection was modeled from kinetic parameters. Lesions were segmented by a physician separately on NaF PET and FDG PET. PET images were rigidly aligned using skeletal references on CT images. Lesion size, degree of overlap, voxel-wise tracer uptake values (SUV), and CT density distributions were compared using Dice coefficient, Positive Predictive Value (PPV), and Spearman rank correlation tests. Results: Across all patients, 42 lesions were identified on NaF PET (median 1.4 cm{sup 3}, range <1–204 cm{sup 3}) compared to 31 using FDG PET (median 1.8 cm{sup 3}, range <1–244 cm{sup 3}). Spatial cooccurrence was found in 25 lesion pairs. Lesions on NaF PET had PPV of 0.91 and on FDG a PPV of 0.65. Overall, NaF-defined lesions were 47% (±24%) larger by volume with moderate overlap to FDG, resulting in mean Dice coefficient of 34% (±22%). In areas of overlap, voxel-wise correlation of NaF and FDG SUV was moderate (ρ=0.56). Expanding to regions of non-spatial overlap, voxels contained in FDG-only contours were almost exclusively low HU (median 118), compared to dense regions of NaF-only voxels (median 250). In sclerotic sub-volumes (HU > 300) NaF-defined contours encompassed 83% of total FDG volume. Conclusion: Moderate voxel-wise correlation of FDG and NaF PET/CT uptake was observed. Spatial discrepancies in FDG and NaF PET/CT imaging of boney metastases could be influenced by poor sensitivity of FDG PET/CT in sclerotic regions. Funded by Prostate Cancer Foundation.

60 APPLIED LIFE SCIENCES↗

Polyolefin blends with co-continuous architectures enabled by dynamic covalent crosslinking

Blending polymers produces brittle materials due to macrophase separation and poor interfacial adhesion, which is exemplified by mixtures of polyolefins. This presents a formidable challenge for the mechanical recycling of mixed plastic waste. Here, we demonstrate that dynamic covalent crosslinking of immiscible polyolefin blends creates macrophase separated co-continuous architectures, yet they display excellent mechanical properties, which challenges the conventional wisdom regarding morphology-property relationships in polymer blend compatibilization. We find that the position and orientation of dynamic crosslinks and their influence on crystallinity are key to understanding the structure-morphology-property relationships. In particular, high-resolution microscopy imaging reveals alignment of crystallite planes with strong orientational preference, particularly at polymer-polymer interfaces, which contribute to material performance. We further demonstrate that changes in crosslinker density and valency allow the properties of binary and ternary polyolefin blends to be tuned in a modular fashion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Toward Improving the Generation Quality of Autoregressive Slot VAEs

Unconditional scene inference and generation are challenging to learn jointly with a single compositional model. Despite encouraging progress on models that extract object-centric representations (“slots”) from images, unconditional generation of scenes from slots has received less attention. This is primarily because learning the multiobject relations necessary to imagine coherent scenes is difficult. We hypothesize that most existing slot-based models have a limited ability to learn object correlations. We propose two improvements that strengthen object correlation learning. The first is to condition the slots on a global, scene-level variable that captures higher-order correlations between slots. Second, we address the fundamental lack of a canonical order for objects in images by proposing to learn a consistent order to use for the autoregressive generation of scene objects. Specifically, we train an autoregressive slot prior to sequentially generate scene objects following a learned order. Ordered slot inference entails first estimating a randomly ordered set of slots using existing approaches for extracting slots from images, then aligning those slots to ordered slots generated autoregressively with the slot prior. Our experiments across three multiobject environments demonstrate clear gains in unconditional scene generation quality. Detailed ablation studies are also provided that validate the two proposed improvements.

MATHEMATICS AND COMPUTING↗

The Transition Region And Coronal Explorer (TRACE)

The objectives and the characteristics of TRACE, selected as a NASA small explorer mission for development and flight in late 1997, is presented. The TRACE science investigation explores the connections between fine-scale magnetic fields and the associated plasma structures on the sun. The instrument collects images of solar plasmas at temperatures from 10(exp 4) to 10(exp 7) K, with an arc second spatial resolution and good temporal resolution and continuum. TRACE and SOHO will gather simultaneous, digital measurements of all temperature regimes of the solar atmospheric, in both high-resolution imaging and spectroscopy, and magnetogram to photosphere. The 30 cm aperture TRACE telescope uses three normal-incidence coatings for the extreme ultraviolet and one for the ultraviolet on quadrants of the primary and secondary mirrors. Interference filters isolate five different ultraviolet bands. The images are aligned and internally stabilized against spacecraft jitter. TRACE will be launched into a sun-synchronous orbit, allowing continuous observing for eight months of the baseline one-year mission. It will be operated in coordination with the SOHO experiment operations facility.

Tarbell, T. D.↗

Laser-Beam-Alignment Controller

In laser-beam-alignment controller, images from video camera compared to reference patterns by fuzzy-logic pattern comparator. Results processed by fuzzy-logic microcontroller, which sends control signals to motor driver adjusting lens and pinhole in spatial filter.

Krasowski, M. J.↗

Poster Presentation: Optical Test of NGST Developmental Mirrors

An Optical Testing System (OTS) has been developed to measure the figure and radius of curvature of NGST developmental mirrors in the vacuum, cryogenic environment of the X-Ray Calibration Facility (XRCF) at Marshall Space Flight Center (MSFC). The OTS consists of a WaveScope Shack-Hartmann sensor from Adaptive Optics Associates as the main instrument, a Point Diffraction Interferometer (PDI), a Point Spread Function (PSF) imager, an alignment system, a Leica Disto Pro distance measurement instrument, and a laser source palette (632.8 nm wavelength) that is fiber-coupled to the sensor instruments. All of the instruments except the laser source palette are located on a single breadboard known as the Wavefront Sensor Pallet (WSP). The WSP is located on top of a 5-DOF motion system located at the center of curvature of the test mirror. Two PC's are used to control the OTS. The error in the figure measurement is dominated by the WaveScope's measurement error. An analysis using the absolute wavefront gradient error of 1/50 wave P-V (at 0.6328 microns) provided by the manufacturer leads to a total surface figure measurement error of approximately 1/100 wave rms. This easily meets the requirement of 1/10 wave P-V. The error in radius of curvature is dominated by the Leica's absolute measurement error of VI.5 mm and the focus setting error of Vi.4 mm, giving an overall error of V2 mm. The OTS is currently being used to test the NGST Mirror System Demonstrators (NMSD's) and the Subscale Beryllium Mirror Demonstrator (SBNM).

Hadaway, James B.↗

Three-Dimensional Morphological Analysis of ALH84001 Magnetite Using Electron Tomography

We report here the crystal morphologies of MV-1 and ALH84001 magnetites as calculated by back-projection using electron tomography. In the present study, we used a 300 keV TEM with a field emission gun (Tecnai F-30 from FEI Inc.), equipped with a 2048 x 2048 pixel CCD camera from Gatan Inc. to image magnetite crystals over tilt ranges of approx. +/- 72 deg in 2 deg tilt intervals. The images were aligned for back-projection, either manually, or through the use of fiducial 5 nm Au spheres affixed to the specimen prior to microscopy. Three-dimensional (3-D) reconstructions were computed using weighted back-projection of the tilted views. The tomograms were viewed and analyzed as a series of slices 1.0 nm thick, taken parallel to the specimen-supporting grid, using the IMOD software package. The shape of each magnetite crystal was determined by defining the external contour of a given magnetite in each slice and assembling a stack of these contours in 3-D. To aid in visualization, the stacked contour array was reduced to an optimal mesh by Delaunay triangulation. The surface normal to each of the triangles in the mesh was calculated and the triangle faces colored according to the orientation of that surface normal relative to the principal crystallographic axis of magnetite. Green surfaces correspond to {111} orientations, blue surfaces to {100} orientations, and red surfaces to {110} orientations. Triangles whose surface normal did not correspond to one of the principal axes were colored gray. Within the experimental and numerical uncertainties of the deconvolution, the tomographic reconstruction of both MV-1 and ALH84001 magnetites are equivalent and correspond to a truncated hexa-octahedral morphology.

Thomas-Keprta, Kathie L.↗