SEARCH · Engineering Papers

Results for “image registration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Fast GPU 3D diffeomorphic image registration

3D image registration is one of the most fundamental and computationally expensive operations in medical image analysis. Here, we present a mixed-precision, Gauss–Newton–Krylov solver for diffeomorphic registration of two images. Our work extends the publicly available CLAIRE library to GPU architectures. Despite the importance of image registration, only a few implementations of large deformation diffeomorphic registration packages support GPUs. Our contributions are new algorithms to significantly reduce the run time of the two main computational kernels in CLAIRE: calculation of derivatives and scattered-data interpolation. Additionally, we deploy (i) highly-optimized, mixed-precision GPU-kernels for the evaluation of scattered-data interpolation, (ii) replace Fast-Fourier-Transform (FFT)-based first-order derivatives with optimized 8th-order finite differences, and (iii) compare with state-of-the-art CPU and GPU implementations. As a highlight, we demonstrate that we can register clinical images in less than 6 s on a single NVIDIA Tesla V100. This amounts to over 20 speed-up over the current version of CLAIRE and over 30 speed-up over existing GPU implementations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

CLAIRE—Parallelized Diffeomorphic Image Registration for Large-Scale Biomedical Imaging Applications

We study the performance of CLAIRE—a diffeomorphic multi-node, multi-GPU image-registration algorithm and software—in large-scale biomedical imaging applications with billions of voxels. At such resolutions, most existing software packages for diffeomorphic image registration are prohibitively expensive. As a result, practitioners first significantly downsample the original images and then register them using existing tools. Our main contribution is an extensive analysis of the impact of downsampling on registration performance. We study this impact by comparing full-resolution registrations obtained with CLAIRE to lower resolution registrations for synthetic and real-world imaging datasets. Our results suggest that registration at full resolution can yield a superior registration quality—but not always. For example, downsampling a synthetic image from 10243 to 2563 decreases the Dice coefficient from 92% to 79%. However, the differences are less pronounced for noisy or low contrast high resolution images. CLAIRE allows us not only to register images of clinically relevant size in a few seconds but also to register images at unprecedented resolution in reasonable time. The highest resolution considered are CLARITY images of size 2816×3016×1162. To the best of our knowledge, this is the first study on image registration quality at such resolutions.

Himthani, Naveen↗

DOE OSTI2024

Image registration for in situ X-ray nano-imaging of a composite battery cathode with deformation

The structural and chemical evolution of battery electrodes at the nanoscale plays an important role in affecting the cell performance. Nano-resolution X-ray microscopy has been demonstrated as a powerful technique for characterizing the evolution of battery electrodes under operating conditions with sensitivity to their morphology, compositional distribution and redox heterogeneity. In real-world batteries, the electrode could deform upon battery operation, causing challenges for the image registration which is necessary for several experimental modalities, e.g. XANES imaging. To address this challenge, this work develops a deep-learning-based method for automatic particle identification and tracking. This approach was not only able to facilitate image registration with good robustness but also allowed quantification of the degree of sample deformation. The effectiveness of the method was first demonstrated using synthetic datasets with known ground truth. The method was then applied to an experimental dataset collected on an operating lithium battery cell, revealing a high degree of intra- and interparticle chemical complexity in operating batteries.

25 ENERGY STORAGE↗

DOE OSTI2023

Homography generation for image registration in inlier-poor domains

A method for efficient image registration between two images in the presence of inlier-poor domains includes receiving a set of candidate correspondences between the two images. An approximate homography between the two images is generated based upon a first correspondence in the correspondences. The set of candidate correspondences is filtered to identify inlier correspondences based upon the approximate homography. A candidate homography is computed based upon the inlier correspondences. The candidate homography can be selected as a final homography between the two images based upon a support of the candidate homography against the set of candidate correspondences. An image registration is performed between the two images based upon the candidate homography being selected as the final homography.

Gonzales, Antonio↗

DOE OSTI2025

Image registration for accurate electrode deformation analysis in operando microscopy of battery materials

Operando imaging techniques have become increasingly valuable in both battery research and manufacturing. However, the reliability of these methods can be compromised by instabilities in the imaging setup and operando cells, particularly when utilizing high-resolution imaging systems. The acquired imaging data often include features arising from both undesirable system vibrations and drift, as well as the scientifically relevant deformations occurring in the battery sample during cell operation. For meaningful analysis, it is crucial to distinguish and separately evaluate these two factors. To address these challenges, we employ a suite of advanced image-processing techniques. These include fast Fourier transform analysis in the frequency domain, power spectrum-based assessments for image quality, as well as rigid and non-rigid image-registration methods. These techniques allow us to identify and exclude blurred images, correct for displacements caused by motor vibrations and sample holder drift and, thus, prevent unwanted image artifacts from affecting subsequent analyses and interpretations. Additionally, we apply optical flow analysis to track the dynamic deformation of battery electrode materials during electrochemical cycling. This enables us to observe and quantify the evolving mechanical responses of the electrodes, offering deeper insights into battery degradation. Together, these methods ensure more accurate image analysis and enhance our understanding of the chemomechanical interplay in battery performance and longevity.

Sun, Tianxiao↗

DOE OSTI2021

Deep-learning-based image registration for nano-resolution tomographic reconstruction

Nano-resolution full-field transmission X-ray microscopy has been successfully applied to a wide range of research fields thanks to its capability of non-destructively reconstructing the 3D structure with high resolution. Due to constraints in the practical implementations, the nano-tomography data is often associated with a random image jitter, resulting from imperfections in the hardware setup. Without a proper image registration process prior to the reconstruction, the quality of the result will be compromised. Here a deep-learning-based image jitter correction method is presented, which registers the projective images with high efficiency and accuracy, facilitating a high-quality tomographic reconstruction. This development is demonstrated and validated using synthetic and experimental datasets. We report the method is effective and readily applicable to a broad range of applications. Together with this paper, the source code is published and adoptions and improvements from our colleagues in this field are welcomed.

deep learning↗

DOE OSTI2021

Automatic 3D image registration for nano-resolution chemical mapping using synchrotron spectro-tomography

Nano-resolution synchrotron X-ray spectro-tomography has been demonstrated as a powerful tool for probing the three-dimensional (3D) structural and chemical heterogeneity of a sample. By reconstructing a number of tomographic data sets recorded at different X-ray energy levels, the energy-dependent intensity variation in every given voxel fingerprints the corresponding local chemistry. The resolution and accuracy of this method, however, could be jeopardized by non-ideal experimental conditions, e.g. instability in the hardware system and/or in the sample itself. Herein is presented one such case, in which unanticipated sample deformation severely degrades the data quality. Here, to address this issue, an automatic 3D image registration method is implemented to evaluate and correct this effect. The method allows the redox heterogeneity in partially delithiated Li x Ta 0.3 Mn 0.4 O 2 battery cathode particles to be revealed with significantly improved fidelity.

3D image registration↗

DOE OSTI2022

Rigid registration algorithm based on the minimization of the total variation of the difference map

Image registration is broadly used in various scenarios in which similar scenes in different images are to be aligned. However, image registration becomes challenging when the contrasts and backgrounds in the images are vastly different. This work proposes using the total variation of the difference map between two images (TVDM) as a dissimilarity metric in rigid registration. A method based on TVDM minimization is implemented for image rigid registration. The method is tested with both synthesized and real experimental data that have various noise and background conditions. The performance of the proposed method is compared with the results of other rigid registration methods. It is demonstrated that the proposed method is highly accurate and robust and outperforms other methods in all of the tests. The new algorithm provides a robust option for image registrations that are critical to many nano-scale X-ray imaging and microscopy applications.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Dose Summation Strategies for External Beam Radiation Therapy and Brachytherapy in Gynecologic Malignancy: A Review from the NRG Oncology and NCTN Medical Physics Subcommittees

Definitive, nonsurgical management of gynecologic malignancies involves external beam radiation therapy (EBRT) and/or brachytherapy (BT). Summation of the cumulative dose is critical to assess the total biologic effective dose to targets and organs at risk. Cumulative dose calculation from EBRT and BT can be performed with or without image registration (IR) and biologic dose summation. Among these dose summation strategies, linear addition of dose-volume histogram (DVH) parameters without IR is the global standard for composite dose reporting. This approach stems from an era without image guidance and simple external beam and brachytherapy treatment approaches. With technological advances, EBRT and high-dose-rate BT have evolved to allow for volume-based treatment planning and delivery. Modern conformal therapeutic radiation involves volumetric or intensity modulated EBRT, capable of simultaneously treating multiple targets at different specified dose levels. Therefore, given the complexity of modern radiation treatment, the linear addition of DVH parameters from EBRT and high-dose-rate BT is challenging to represent the combined dose distribution. Deformable image registration (DIR) between EBRT and image guided brachytherapy (IGBT) data sets may provide a more nuanced calculation of multimodal dose accumulation. However, DIR is still nascent in this regard, and needs further development for accuracy and efficiency for clinical use. Biologic dose summation can combine physical dose maps from EBRT and each IGBT fraction, thereby generating a composite DVH from the biologic effective dose. However, accurate radiobiologic parameters are tissue-dependent and not well characterized. A combination of voxel-based DIR and biologic weighted dose maps may be the best approximation of dose accumulation but remains invalidated. The purpose of this report is to review dose summation strategies for EBRT and BT, including conventional equivalent dose in 2-Gy fractions dose summation without image registration, physical dose summation using 3-dimensional rigid IR and DIR, and biologic dose summation. We also provide general clinical workflows for IGBT with a focus on cervical cancer.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2026

SpaceNet 9—Cross-Sensor Alignment of Optical and SAR Imagery

Precise registration of high-resolution synthetic aperture radar (SAR) and optical imagery is necessary for realizing the full potential and benefits of multimodal image analysis. However, two significant challenges presently exist. First, there is a lack of annotated datasets and benchmarks available for high-resolution SAR–optical image registration. Second, an assessment of efficient and reliable image registration methods that can precisely align these modalities is lacking. Here, we present a holistic description of the SpaceNet 9 Challenge and its results. We present a description of the dataset and baseline algorithm along with the results of the challenge, including a description of the winning algorithms. We release the SpaceNet 9 dataset along with open-sourcing the winning algorithms and baseline. The objective of SpaceNet 9 was to compute a dense displacement map that indicates the shift needed to align pixels in an optical image to the pixels in a SAR image. The challenge launched in April 2025 and was active for approximately two months. The top five solutions reduced image alignment error from approximately 34 m to under 13 m for public and private test data, with the best results obtaining a registration error of only 8.5 and 6.7 m on the public testing and private testing dataset, respectively. Usage of pretrained image matching models, robust outlier rejection with RANSAC, and estimating local displacement were common among the top solutions. The results of this challenge provide insight into high-resolution SAR–optical image registration and offer opportunities for future benchmarking in this domain. The baseline algorithm, winning solutions, and datasets are available at https://spacenet.ai/sn9-challenge/.

benchmark datasets↗

DOE OSTI2023

CIEL ∗ Ch color map for visualization and analysis of sea ice motion

The International Commission on Illumination (CIE) designed its color space to be perceptually uniform so that a given numerical change in the color code corresponds to perceived change in color. This color encoding is demon- strated to be advantageous in scientific visualization and analysis of vector fields. The specific application is analysis of ice motion in the Arctic where patterns in smooth monthly-averaged ice motion are seen. Furthermore, fractures occurring in the ice cover result in discontinuities in the ice motion. This vector jump in displacement can also be visualized. We then analyze modeled and observed fractures through the use of a metric on the color space, and image amplitude and phase metrics. Amplitude and phase met- rics arise from image registration that is accomplished by sampling images using space filling curves, thus reducing the image registration problem to the more reliable functional alignment problem. We demonstrate this through an exploration of the metrics to compare model runs to an observed ice crack.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Introducing SpaceNet 9 - Cross-Modal Satellite Imagery Registration for Natural Disaster Responses

Computer vision algorithms are increasingly leveraged to accelerate geospatial analysis for disaster response and recovery. As the diversity of remote sensing imagery grows with optical, SAR, and other modalities, a perquisite for analytics is cross-modal image registration. There is a high potential to harness computer vision for this pre-processing requirement toward enabling downstream analytics such as heterogeneous change detection, automated feature extraction, and data fusion. Advancement in these areas has the potential to simplify data wrangling tasks and further accelerate disaster response timelines. The SpaceNet 9 challenge (launching in mid-2024) focuses on addressing the cross-modal image registration problem and demonstrating the utility of such modules on earthquake impacted scenarios. This paper describes the motivation for the SpaceNet 9 and provides a first overview of the dataset, the baseline algorithm, and implications for seeking cross-modal image registration in Earth observation. Code is available at https://github.com/SpaceNetChallenge/SpaceNet9.

Hansch, Ronny↗

DOE OSTI2022

XRF-ROI Finder: Machine Learning to Guide Region-of-Interest Scanning for X-ray Fluorescence Microscopy

The ROI-finder software is being developed for use by several Microscopy Group beamlines at Argonne National Laboratory, including 2-ID microprobes and 9-ID-B Bionanoprobe which use multi-scale scanning fluorescence microscopy to acquire elemental maps (multi-modal image data). Microscopy experiments require scan of samples at a coarse resolution followed by ROI identification using feature detection based on domain expertise. Finer resolution scans are then conducted based on identified ROI. The decision-making process based on domain expertise will be difficult to perform for faster data rates and much larger sampling volumes anticipated after APS-U necessitating the need for the ROI-finder software. The ROI- finder detects regions of interest through a continuous learning process, starting with a unsupervised representation learning and improving its recommendations through supervised learning and an interactive tool for user annotation. The scope of ongoing development efforts includes the integration of image registration module to correlate optical and X-ray images, extraction of feature morphology as well as elemental signatures in the image space and incorporation of beamtime streaming data by the scanning probe via EPICS.

CHOWDHURY, M. ARSHAD ZAHANGIR↗

DOE OSTI2024

Intern Poster

Digital Image Correlation (DIC) is an optical technique that combines image registration and tracking methods for accurate two-dimensional and three-dimensional changes in images. DIC software can be used to track the contour, deformation, and strain of a sample. In the Advanced Test Reactor (ATR) at INL (Idaho National Laboratory) there exists a small working window of samples that can become irradiated. Hundreds of graphite disks called piggybacks have undergone this irradiation as part of the Advanced Reactor Technologies (ART) program. After irradiation, it is desirable to understand the change in tensile strength as a function of dose. Due to the limited space in the ATR, typical dog bone tensile tests reduce the number of graphite samples from hundreds to tens. However, there does exist an ASTM standard, D8289, which uses disc compression of graphite to estimate the tensile strength of the specimen with the Brazilian Disk test fixture. While only used as an estimate, which is typically off by a third, it is the purpose of this study to identify how to amend D8289 to remove the word "estimate" with the help of DIC.

36 MATERIALS SCIENCE↗

DOE OSTI2020

A large field-of-view high-resolution hard x-ray microscope using polymer optics

Here, we present an effective approach using a matched pair of polymer-based condenser-objective lenses to build a compact full-field X-ray microscope with a high spatial resolution. A unique condenser comprising arrays of high-aspect-ratio prisms with equilateral cross-section is used for uniformly illuminating samples over a large field of view (FoV) from all angles, which match the acceptance of an objective made of interdigitated orthogonal rows of one-dimensional lenses. State-of-the-art Talbot grating interferometry used to characterize these lenses for the first time revealed excellent focusing properties and minimal wave-front distortions. Using a specific lens-pair designed for 20 keV X-rays, short-exposure times, and image registration with a cross-correlation technique, we circumvent vibrational instabilities to obtain distortion-free images with a uniform resolution of 240 nm (smallest resolvable line pair) over a large FoV, 80 × 80 µm 2 in extent. The results were contrasted with those collected under illumination using commercial two-dimensional parabolic lenses with a smaller FoV. This approach implemented on a diffractometer would enable diffraction-contrast or dark-field microscopy for fast observations of ‘mesoscopic’ phenomena in real space complementing reciprocal-space studies using diffraction on the same instrument.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

MusMorph, a database of standardized mouse morphology data for morphometric meta-analyses

Complex morphological traits are the product of many genes with transient or lasting developmental effects that interact in anatomical context. Mouse models are a key resource for disentangling such effects, because they offer myriad tools for manipulating the genome in a controlled environment. Unfortunately, phenotypic data are often obtained using laboratory-specific protocols, resulting in self-contained datasets that are difficult to relate to one another for larger scale analyses. To enable meta-analyses of morphological variation, particularly in the craniofacial complex and brain, we created MusMorph, a database of standardized mouse morphology data spanning numerous genotypes and developmental stages, including E10.5, E11.5, E14.5, E15.5, E18.5, and adulthood. To standardize data collection, we implemented an atlas-based phenotyping pipeline that combines techniques from image registration, deep learning, and morphometrics. Alongside stage-specific atlases, we provide aligned micro-computed tomography images, dense anatomical landmarks, and segmentations (if available) for each specimen (N = 10,056). Our workflow is open-source to encourage transparency and reproducible data collection.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Reconstruction of concrete microstructure using complementarity of X-ray and neutron tomography

The concrete microstructure was successfully reconstructed using the complementarity of X-ray and neutron computed tomography (CT). Neither tomogram alone was found to be suitable to properly describe the microstructure of concrete under this study. However, by merging the information revealed by the two modalities, and using image segmentation, noise reduction, and image registration techniques we reconstruct the concrete microstructure. Void, aggregate, and cement paste phases are successfully captured down to the images' spatial resolution, even though the aggregate consists of multiple minerals. The coarse-aggregate volume fraction of the reconstructed microstructure was similar to that of the mixing proportions. Furthermore, image-based finite element analysis is performed to demonstrate the effects of microstructure on stress concentration and strain localization.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Statistical characterization of experimental magnetized liner inertial fusion stagnation images using deep-learning-based fuel–background segmentation

Significant variety is observed in spherical crystal x-ray imager (SCXI) data for the stagnated fuel–liner system created in Magnetized Liner Inertial Fusion (MagLIF) experiments conducted at the Sandia National Laboratories Z-facility. As a result, image analysis tasks involving, e.g., region-of-interest selection (i.e. segmentation), background subtraction and image registration have generally required tedious manual treatment leading to increased risk of irreproducibility, lack of uncertainty quantification and smaller-scale studies using only a fraction of available data. We present a convolutional neural network (CNN)-based pipeline to automate much of the image processing workflow. This tool enabled batch preprocessing of an ensemble of N scans = 139 SCXI images across N exp = 67 different experiments for subsequent study. The pipeline begins by segmenting images into the stagnated fuel and background using a CNN trained on synthetic images generated from a geometric model of a physical three-dimensional plasma. The resulting segmentation allows for a rules-based registration. Our approach flexibly handles rarely occurring artifacts through minimal user input and avoids the need for extensive hand labelling and augmentation of our experimental dataset that would be needed to train an end-to-end pipeline. Here we also fit background pixels using low-degree polynomials, and perform a statistical assessment of the background and noise properties over the entire image database. Our results provide a guide for choices made in statistical inference models using stagnation image data and can be applied in the generation of synthetic datasets with realistic choices of noise statistics and background models used for machine learning tasks in MagLIF data analysis. We anticipate that the method may be readily extended to automate other MagLIF stagnation imaging applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗