Image Processing Alignment Algorithms for the Optical Thomson Scattering Laser at the National Ignition Facility
Explore the source record for details and available documents.
Energy, Engineering, Lasers↗
SEARCH · Engineering Papers
Results for “image alignment”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Orientation mapping of semicrystalline polymers using scanning electron nanobeam diffraction
Here, we demonstrate a scanning electron nanobeam diffraction technique that can be used for mapping the size and distribution of nanoscale crystalline regions in a polymer blend. In addition, it can map the relative orientation of crystallites and the degree of crystallinity of the material. The model polymer blend is a 50:50 w/w mixture of semicrystalline poly(3-hexylthiophene-2,5-diyl) (P3HT) and amorphous polystyrene (PS). The technique uses a scanning electron beam to raster across the sample and acquires a diffraction image at each probe position. Through image alignment and filtering, the diffraction image dataset enables mapping of the crystalline regions within the scanned area and construction of an orientation map.
36 MATERIALS SCIENCE↗
Drifty shifty deluxe.m
Performs a cross-correlation calculation to align images. This is particularly useful for aligning frames of a movie so that an object of interest does not spatially drift. For in situ microscopy experiments. Movies are collected where an object changes with time. At the same time, the object usually drifts too. This shifts the movie frames so that the object is aligned from frame to frame. Then it is easy to see the object changes without the added complication of it moving too.
Josh Sugar, DaveRobinson↗
Multi-Image Registration for an Enhanced Vision System
An Enhanced Vision System (EVS) utilizing multi-sensor image fusion is currently under development at the NASA Langley Research Center. The EVS will provide enhanced images of the flight environment to assist pilots in poor visibility conditions. Multi-spectral images obtained from a short wave infrared (SWIR), a long wave infrared (LWIR), and a color visible band CCD camera, are enhanced and fused using the Retinex algorithm. The images from the different sensors do not have a uniform data structure: the three sensors not only operate at different wavelengths, but they also have different spatial resolutions, optical fields of view (FOV), and bore-sighting inaccuracies. Thus, in order to perform image fusion, the images must first be co-registered. Image registration is the task of aligning images taken at different times, from different sensors, or from different viewpoints, so that all corresponding points in the images match. In this paper, we present two methods for registering multiple multi-spectral images. The first method performs registration using sensor specifications to match the FOVs and resolutions directly through image resampling. In the second method, registration is obtained through geometric correction based on a spatial transformation defined by user selected control points and regression analysis.
Hines, Glenn↗
Drifty shifty deluxe.m
Performs a cross-correlation calculation to align images. This is particularly useful for aligning frames of a movie so that an object of interest does not spatially drift. For in situ microscopy experiments. Movies are collected where an object changes with time. At the same time, the object usually drifts too. This shifts the movie frames so that the object is aligned from frame to frame. Then it is easy to see the object changes without the added complication of it moving too.
Josh Sugar, Dave Robinson↗
Patch-Based Convolutional Neural Networks for Multiple Microstructural Features Detection in FIB-SEM Micrographs of Irradiated Nuclear Fuel
Focused ion beam scanning electron microscopy (FIB-SEM) tomography has increasingly been utilized for acquiring three-dimensional (3D) microstructure features at the sub-micron scale in irradiated nuclear materials. This technique involves sequential ion beam slicing followed by electron beam imaging and compositional mapping using energy dispersive spectroscopy (EDS). Despite its growing use, several challenges persist. These include the time-intensive nature of data collection of EDS data, difficulties in distinguishing between various microstructures, and issues with image alignment. These challenges currently limit the broader application of FIB-SEM tomography in the field. To overcome these limitations, we propose using convolutional neural networks (CNNs) to automate microstructure identification in SEM images. Our study introduces a new framework for identifying microstructures in irradiated U-10Zr (wt. %) metallic fuel with limited annotated data. The framework includes the creation of a reliable annotated dataset with paired SEM and ground truth data from EDS maps, the applications of CNNs for microstructure identification, and the validation of model performance. Specifically, we employed the Segment Anything Model (SAM) to align SEM images with corresponding EDS maps and focused ion beam (FIB) tomography SEM data. We evaluate several models, including Patch-based U-Net, Attention U-Net, and Residual U-Net, finding that patch-based U-Net exhibits superior segmentation performance and consistency. This approach reduces reliance on EDS detectors and aids in accelerating nuclear material analysis process, highlighting the potential of advanced deep learning techniques to improve microstructural understanding in nuclear material. This is the first framework to integrate SAM and Patch-based CNN models for semantic segmentation of irradiated nuclear materials, with potential applicability to other tomography datasets.
36 - MATERIALS SCIENCE↗
CDS Re Mix
CDS (Change Detection Systems) is a mechanism for rapid visual analysis using complex image alignment algorithms. CDS is controlled with a simple interface that has been designed for use for anyone that can operate a digital camera. A challenge of complex industrial systems like nuclear power plants is to accurately identify changes in systems, structures and components that may critically impact the operation of the facility. CDS can provide a means of early intervention before the issues evolve into safety and production challenges.
97 MATHEMATICS AND COMPUTING↗
Phase Retrieval Using a Genetic Algorithm on the Systematic Image-Based Optical Alignment Testbed
NASA s Marshall Space Flight Center s Systematic Image-Based Optical Alignment (SIBOA) Testbed was developed to test phase retrieval algorithms and hardware techniques. Individuals working with the facility developed the idea of implementing phase retrieval by breaking the determination of the tip/tilt of each mirror apart from the piston motion (or translation) of each mirror. Presented in this report is an algorithm that determines the optimal phase correction associated only with the piston motion of the mirrors. A description of the Phase Retrieval problem is first presented. The Systematic Image-Based Optical Alignment (SIBOA) Testbeb is then described. A Discrete Fourier Transform (DFT) is necessary to transfer the incoming wavefront (or estimate of phase error) into the spatial frequency domain to compare it with the image. A method for reducing the DFT to seven scalar/matrix multiplications is presented. A genetic algorithm is then used to search for the phase error. The results of this new algorithm on a test problem are presented.
Taylor, Jaime R.↗
3D GeoWall Analysis System for Shuttle External Tank Foreign Object Debris Events
An analytical, advanced imaging method has been developed for the initial monitoring and identification of foam debris and similar anomalies that occur post-launch in reference to the space shuttle s external tank (ET). Remote sensing technologies have been used to perform image enhancement and analysis on high-resolution, true-color images collected with the DCS 760 Kodak digital camera located in the right umbilical well of the space shuttle. Improvements to the camera, using filters, have added sharpness/definition to the image sets; however, image review/analysis of the ET has been limited by the fact that the images acquired by umbilical cameras during launch are two-dimensional, and are usually nonreferenceable between frames due to rotation translation of the ET as it falls away from the space shuttle. Use of stereo pairs of these images can enable strong visual indicators that can immediately portray depth perception of damaged areas or movement of fragments between frames is not perceivable in two-dimensional images. A stereoscopic image visualization system has been developed to allow 3D depth perception of stereo-aligned image pairs taken from in-flight umbilical and handheld digital shuttle cameras. This new system has been developed to augment and optimize existing 2D monitoring capabilities. Using this system, candidate sequential image pairs are identified for transformation into stereo viewing pairs. Image orientation is corrected using control points (similar points) between frames to place the two images in proper X-Y viewing perspective. The images are then imported into the WallView stereo viewing software package. The collected control points are used to generate a transformation equation that is used to re-project one image and effectively co-register it to the other image. The co-registered, oriented image pairs are imported into a WallView image set and are used as a 3D stereo analysis slide show. Multiple sequential image pairs can be used to allow forensic review of temporal phenomena between pairs. The observer, while wearing linear polarized glasses, is able to review image pairs in passive 3D stereo.
Brown, Richard↗
SU-F-J-94: Development of a Plug-in Based Image Analysis Tool for Integration Into Treatment Planning
Purpose: To extend the functionality of a commercial treatment planning system (TPS) to support (i) direct use of quantitative image-based metrics within treatment plan optimization and (ii) evaluation of dose-functional volume relationships to assist in functional image adaptive radiotherapy. Methods: A script was written that interfaces with a commercial TPS via an Application Programming Interface (API). The script executes a program that performs dose-functional volume analyses. Written in C#, the script reads the dose grid and correlates it with image data on a voxel-by-voxel basis through API extensions that can access registration transforms. A user interface was designed through WinForms to input parameters and display results. To test the performance of this program, image- and dose-based metrics computed from perfusion SPECT images aligned to the treatment planning CT were generated, validated, and compared. Results: The integration of image analysis information was successfully implemented as a plug-in to a commercial TPS. Perfusion SPECT images were used to validate the calculation and display of image-based metrics as well as dose-intensity metrics and histograms for defined structures on the treatment planning CT. Various biological dose correction models, custom image-based metrics, dose-intensity computations, and dose-intensity histograms were applied to analyze the image-dose profile. Conclusion: It is possible to add image analysis features to commercial TPSs through custom scripting applications. A tool was developed to enable the evaluation of image-intensity-based metrics in the context of functional targeting and avoidance. In addition to providing dose-intensity metrics and histograms that can be easily extracted from a plan database and correlated with outcomes, the system can also be extended to a plug-in optimization system, which can directly use the computed metrics for optimization of post-treatment tumor or normal tissue response models. Supported by NIH - P01 - CA059827.
60 APPLIED LIFE SCIENCES↗
The Inter-Calibration of the DSCOVR EPIC Imager 2 with Aqua-MODIS and NPP-VIIRS
The Deep Space Climate Observatory (DSCOVR) Earth Polychromatic Imaging Camera (EPIC) continuously observes the illuminated disk from the Lagrange-1 point. The EPIC sensor was designed to monitor the diurnal variation of ozone, clouds, aerosols, and vegetation, especially those features that benefit from observation near-backscatter conditions. The EPIC sensor does not contain any onboard calibration systems. This study describes the inter-calibration of EPIC channels 5 (0.44 μm), 6 (0.55 μm), 7 (0.68 μm), and 10 (0.78 μm) with respect to Aqua-MODIS and NPP-VIIRS. The calibration is transferred using coincident ray-matched reflectance pairs over all-sky tropical ocean (ATO) and deep convective cloud (DCC) targets. A robust and automated image-alignment technique based on feature matching was formulated to improve the navigation quality of the EPIC images. The EPIC V02 dataset exhibits improved navigation over V01. Because the visible channels display similar spatial features, a single visible channel can be used to co-register the remaining visible bands. The VIIRS-referenced EPIC ATO and DCC ray-matched calibration coefficients are within 0.3%. The EPIC four-year calibration trends based on VIIRS are within 0.15%/year. The MODIS-based EPIC calibration coefficients were compared against the Geogdzhayev and Marshak 2018 published calibration coefficients and are found to be within 1.6%.
DSCOVR↗
Methodology for the Elimination of Reflection and System Vibration Effects in Particle Image Velocimetry Data Processing
A methodology to eliminate model reflection and system vibration effects from post processed particle image velocimetry data is presented. Reflection and vibration lead to loss of data, and biased velocity calculations in PIV processing. A series of algorithms were developed to alleviate these problems. Reflections emanating from the model surface caused by the laser light sheet are removed from the PIV images by subtracting an image in which only the reflections are visible from all of the images within a data acquisition set. The result is a set of PIV images where only the seeded particles are apparent. Fiduciary marks painted on the surface of the test model were used as reference points in the images. By locating the centroids of these marks it was possible to shift all of the images to a common reference frame. This image alignment procedure as well as the subtraction of model reflection are performed in a first algorithm. Once the images have been shifted, they are compared with a background image that was recorded under no flow conditions. The second and third algorithms find the coordinates of fiduciary marks in the acquisition set images and the background image and calculate the displacement between these images. The final algorithm shifts all of the images so that fiduciary mark centroids lie in the same location as the background image centroids. This methodology effectively eliminated the effects of vibration so that unbiased data could be used for PIV processing. The PIV data used for this work was generated at the NASA Langley Research Center Quiet Flow Facility. The experiment entailed flow visualization near the flap side edge region of an airfoil model. Commercial PIV software was used for data acquisition and processing. In this paper, the experiment and the PIV acquisition of the data are described. The methodology used to develop the algorithms for reflection and system vibration removal is stated, and the implementation, testing and validation of these algorithms are presented.
Bremmer, David M.↗
Nanoporous gold: a hierarchical and multiscale 3D test pattern for characterizing X-ray nano-tomography systems
Full-field transmission X-ray microscopy (TXM) is a well established technique, available at various synchrotron beamlines around the world as well as by laboratory benchtop devices. One of the major TXM challenges, due to its nanometre-scale resolution, is the overall instrument stability during the acquisition of the series of tomographic projections. The ability to correct for vertical and horizontal distortions of each projection image during acquisition is necessary in order to achieve the effective 3D spatial resolution. The effectiveness of such an image alignment is also heavily influenced by the absorption properties and strong contrast of specific features in the scanned sample. Here it is shown that nanoporous gold (NPG) can be used as an ideal 3D test pattern for evaluating and optimizing the performance of a TXM instrument for hard X-rays at a synchrotron beamline. Unique features of NPG, such as hierarchical structures at multiple length scales and high absorbing capabilities, makes it an ideal choice for characterization, which involves a combination of a rapid-alignment algorithm applied on the acquired projections followed by the extraction of a set of both 2D- and 3D-descriptive image parameters. This protocol can be used for comparing the efficiency of TXM instruments at different synchrotron beamlines in the world or benchtop devices, based on a reference library of scanned NPG samples, containing information about the estimated horizontal and vertical alignment values, 2D qualitative parameters and quantitative 3D parameters. The possibility to tailor the ligament sizes of NPG to match the achievable resolution in combination with the high electron density of gold makes NPG an ideal 3D test pattern for evaluating the status and performance of a given synchrotron-based or benchtop-based TXM setup.
36 MATERIALS SCIENCE↗
SU-E-J-213: Imaging and Treatment Isocenter Verification of a Gantry Mounted Proton Therapy System
Purpose: The Mevion proton therapy machine is the first to feature a gantry mounted sychro-cyclotron. In addition, the system utilizes a 6D motion couch and kV imaging for precise proton therapy. To quantify coincidence between these systems, isocentricity tests were performed based on kV imaging alignment using radiochromic film. Methods: The 100 ton gantry and 6D robotic couch can rotate 190° around isocenter to provide necessary beam angles for treatment. The kV sources and detector panels are deployed as needed to acquire orthogonal portals. Gantry and couch mechanical isocenter were tested using star-shots and radiochromic-film (RCF). Using kV imaging, the star-shot phantom was aligned to an embedded fiducial and the isocenter was marked on RCF with a pinprick. The couch and gantry stars were performed by irradiating films at every 45° and 30°, respectively. A proton beam with a range and modulation-width of 18 cm was used. A Winston-Lutz test was also performed at the same gantry and couch rotations using a custom jig holding RCF and a tungsten ball placed at isocenter. A 2 cm diameter circular aperture was used for the irradiation. Results: The couch star-shot indicated a minimum tangent circle of 0.6 mm, with a 0.9 mm offset from the manually marked isocenter. The gantry star-shot showed a 0.6 mm minimum tangent circle with a 0.5 mm offset from the pinprick. The Winston Lutz test performed for gantry rotation showed a maximum deviation from center of 0.5 mm. Conclusion: Based on star-shots and Winston-Lutz tests, the proton gantry and 6D couch isocentricity are within 1 mm. In this study, we have shown that the methods commonly utilized for Linac characterization can be applied to proton therapy. This revolutionary proton therapy system possesses excellent agreement between the mechanical and radiation isocenter, providing highly precise treatment.
07 ISOTOPE AND RADIATION SOURCES↗
The JCMT Transient Survey: Data Reduction and Calibration Methods
Though there has been a significant amount of work investigating the early stages of low-mass star formation in recent years, the evolution of the mass assembly rate onto the central protostar remains largely unconstrained. Examining in depth the variation in this rate is critical to understanding the physics of star formation. Instabilities in the outer and inner circumstellar disk can lead to episodic outbursts. Observing these brightness variations at infrared or submillimeter wavelengths constrains the current accretion models. The JCMT Transient Survey is a three-year project dedicated to studying the continuum variability of deeply embedded protostars in eight nearby star-forming regions at a one-month cadence. We use the SCUBA-2 instrument to simultaneously observe these regions at wavelengths of 450 and 850 μ m. In this paper, we present the data reduction techniques, image alignment procedures, and relative flux calibration methods for 850 μ m data. We compare the properties and locations of bright, compact emission sources fitted with Gaussians over time. Doing so, we achieve a spatial alignment of better than 1″ between the repeated observations and an uncertainty of 2%–3% in the relative peak brightness of significant, localized emission. This combination of imaging performance is unprecedented in ground-based, single-dish submillimeter observations. Finally, we identify a few sources that show possible and confirmed brightness variations. These sources will be closely monitored and presented in further detail in additional studies throughout the duration of the survey.
79 ASTRONOMY AND ASTROPHYSICS↗
3D imaging of magnetic domains in Nd 2 Fe 14 B using scanning hard X-ray nanotomography
Nanoscale structural and electronic heterogeneities are prevalent in condensed matter physics. Investigating these heterogeneities in 3D has become an important task for understanding material properties. To provide a tool to unravel the connection between nanoscale heterogeneity and macroscopic emergent properties in magnetic materials, scanning transmission X-ray microscopy (STXM) is combined with X-ray magnetic circular dichroism. A vector tomography algorithm has been developed to reconstruct the full 3D magnetic vector field without any prior noise assumptions or knowledge about the sample. Two tomographic scans around the vertical axis are acquired on single-crystalline Nd 2 Fe 14 B pillars tilted at two different angles, with 2D STXM projections recorded using a focused 120 nm X-ray beam with left and right circular polarization. Image alignment and iterative registration have been implemented based on the 2D STXM projections for the two tilts. Dichroic projections obtained from difference images are used for the tomographic reconstruction to obtain the 3D magnetization distribution at the nanoscale.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Multi-frame, ultrafast, x-ray microscope for imaging shockwave dynamics
Inertial confinement fusion (ICF) holds increasing promise as a potential source of abundant, clean energy, but has been impeded by defects such as micro-voids in the ablator layer of the fuel capsules. It is critical to understand how these micro-voids interact with the laser-driven shock waves that compress the fuel pellet. At the Matter in Extreme Conditions (MEC) instrument at the Linac Coherent Light Source (LCLS), we utilized an x-ray pulse train with ns separation, an x-ray microscope, and an ultrafast x-ray imaging (UXI) detector to image shock wave interactions with micro-voids. To minimize the high- and low-frequency variations of the captured images, we incorporated principal component analysis (PCA) and image alignment for flat-field correction. After applying these techniques we generated phase and attenuation maps from a 2D hydrodynamic radiation code (xRAGE), which were used to simulate XPCI images that we qualitatively compare with experimental images, providing a one-to-one comparison for benchmarking material performance. Moreover, we implement a transport-of-intensity (TIE) based method to obtain the average projected mass density (areal density) of our experimental images, yielding insight into how defect-bearing ablator materials alter microstructural feature evolution, material compression, and shock wave propagation on ICF-relevant time scales.
47 OTHER INSTRUMENTATION↗
Support Routines for In Situ Image Processing
This software consists of a set of application programs that support ground-based image processing for in situ missions. These programs represent a collection of utility routines that perform miscellaneous functions in the context of the ground data system. Each one fulfills some specific need as determined via operational experience. The most unique aspect to these programs is that they are integrated into the large, in situ image processing system via the PIG (Planetary Image Geometry) library. They work directly with space in situ data, understanding the appropriate image meta-data fields and updating them properly. The programs themselves are completely multimission; all mission dependencies are handled by PIG. This suite of programs consists of: (1)marscahv: Generates a linearized, epi-polar aligned image given a stereo pair of images. These images are optimized for 1-D stereo correlations, (2) marscheckcm: Compares the camera model in an image label with one derived via kinematics modeling on the ground, (3) marschkovl: Checks the overlaps between a list of images in order to determine which might be stereo pairs. This is useful for non-traditional stereo images like long-baseline or those from an articulating arm camera, (4) marscoordtrans: Translates mosaic coordinates from one form into another, (5) marsdispcompare: Checks a Left Right stereo disparity image against a Right Left disparity image to ensure they are consistent with each other, (6) marsdispwarp: Takes one image of a stereo pair and warps it through a disparity map to create a synthetic opposite- eye image. For example, a right eye image could be transformed to look like it was taken from the left eye via this program, (7) marsfidfinder: Finds fiducial markers in an image by projecting their approximate location and then using correlation to locate the markers to subpixel accuracy. These fiducial markets are small targets attached to the spacecraft surface. This helps verify, or improve, the pointing of in situ cameras, (8) marsinvrange: Inverse of marsrange . given a range file, re-computes an XYZ file that closely matches the original. . marsproj: Projects an XYZ coordinate through the camera model, and reports the line/sample coordinates of the point in the image, (9) marsprojfid: Given the output of marsfidfinder, projects the XYZ locations and compares them to the found locations, creating a report showing the fiducial errors in each image. marsrad: Radiometrically corrects an image, (10) marsrelabel: Updates coordinate system or camera model labels in an image, (11) marstiexyz: Given a stereo pair, allows the user to interactively pick a point in each image and reports the XYZ value corresponding to that pair of locations. marsunmosaic: Extracts a single frame from a mosaic, which will be created such that it could have been an input to the original mosaic. Useful for creating simulated input frames using different camera models than the original mosaic used, and (12) merinverter: Uses an inverse lookup table to convert 8-bit telemetered data to its 12-bit original form. Can be used in other missions despite the name.
Deen, Robert G.↗