Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image stitching”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Super Resolution Digital Image Correlation (SR-DIC): an Alternative to Image Stitching at High Magnifications

Abstract Background High-resolution Digital Image Correlation (DIC) measurements have previously been produced by stitching of neighboring images, which often requires short working distances. Separately, the image processing community has developed super resolution (SR) imaging techniques, which improve resolution by combining multiple overlapping images. Objective This work investigates the novel pairing of super resolution with digital image correlation, as an alternative method to produce high-resolution full-field strain measurements. Methods First, an image reconstruction test is performed, comparing the ability of three previously published SR algorithms to replicate a high-resolution image. Second, an applied translation is compared against DIC measurement using both low- and super-resolution images. Third, a ring sample is mechanically deformed and DIC strain measurements from low- and super-resolution images are compared. Results SR measurements show improvements compared to low-resolution images, although they do not perfectly replicate the high-resolution image. SR-DIC demonstrates reduced error and improved confidence in measuring rigid body translation when compared to low resolution alternatives, and it also shows improvement in spatial resolution for strain measurements of ring deformation. Conclusions Super resolution imaging can be effectively paired with Digital Image Correlation, offering improved spatial resolution, reduced error, and increased measurement confidence.

Hansen, R. S.↗
DOE OSTI2025

A bi-channel aided stitching of atomic force microscopy images

Microscopy is an essential tool in scientific research, enabling the visualization of structures at micro- and nanoscale resolutions. However, the field of microscopy often encounters limitations in field-of-view (FOV), restricting the amount of sample that can be imaged in a single capture. To overcome this limitation, image stitching techniques have been developed to seamlessly merge multiple overlapping images into a single, high-resolution composite. The images collected from microscope need to be optimally stitched before accurate physical information can be extracted from post analysis. However, the existing stitching tools either struggle to stitch images together when the microscopy images are feature sparse or cannot address all the transformations of images when performing image stitching. To address these issues, we propose a bi-channel aided feature-based image stitching method and demonstrate its use on Atomic Force Microscopy (AFM) generated Pantoea sp. YR343 biofilm and PTO thin film sample images as experimental data. The topographical channel image of AFM data captures the morphological details of the sample, and a stitched topographical image is desired for researchers. We utilize the amplitude and phase channels of AFM data to maximize the matching features and to estimate the position of the original topographical images and show that the proposed bi-channel aided stitching method outperforms the traditional direct stitching approach in AFM topographical image stitching task. Here, we demonstrated the application on AFM, but similar approaches could be employed of optical microscopy with brightfield and fluorescence channels. We believe this proposed workflow can serve as a valuable augmentation strategy for microscopy image stitching tasks and will benefit the experimentalist to avoid erroneous analysis and discovery due to incorrect stitching.

Atomic force microscopy↗
DOE OSTI2024

Development of techniques for gantryless associated-particle imaging

To move fast-neutron radiography using the associated-particle imaging technique from the laboratory to the field, the development of new analysis techniques is required. In particular, the relative positions of the source and detectors need to be determined when they have been placed by hand, the normalization for a particular source–detector geometry needs to be determined without a measurement in the same geometry with no object present, and accurate image stitching is required when multiple detector positions are necessary to image an object. The present work describes methods that employ transmission neutron data to localize a fast-neutron imaging panel with respect to the neutron source, calculate a normalization for a given source–detector geometry, stitch images together, and describes the required system calibrations. The reported techniques enable in-field neutron radiography for cases in which the source–detector geometry is not well known a priori and where operational constraints preclude a normalization measurement.

Heath, Matthew↗
DOE OSTI2023

Characterization of Lab-Grown Cracks for Aerosol Transmission Testing

Motivation: Determine the length and opening of two lab-grown cracks, designated as LT-14 and LT-28, representative of stress corrosion cracks in spent nuclear fuel dry storage casks to supplement future testing of gas and aerosol transport. Problem: The extreme aspect ratio of the crack length to opening requires that imaging occurs in stages with the results merged before final analysis. Method: High magnification (1500x) optical images of both sides of the two plates were acquired. 20x stitched images with LSCM were acquired, fully stitched along the length, and leveled with newly developed PLATES Method in MATLAB®. Conclusion for LT-14: Side 1 is 47.25 mm long and has 366 separate crack features with an average length of 23.50 µm and an average opening of 8.27 µm. Side 2 is 69.44 mm long and has 550 separate crack features with an average length of 81.63 µm and an average opening of 67.70 µm. Conclusion for LT-28: Side 1 is 71.95 mm long and has 1,127 separate crack features with an average length of 42.27 µm and an average opening of 10.31 µm. Side 2 is 74.88 mm long and has 520 separate crack features with an average length of 98.13 µm and an average opening of 14.99 µm. The adjacent crack on side 1 is 18.95 mm long and has 37 separate crack features with an average length of 17.46 µm and an average opening of 10.42 µm. The adjacent crack on side 2 is 26.40 mm long and has 55 separate crack features with an average length of 87.26 µm and an average opening of 48.29 µm. Each adjacent crack is approximately 26 mm from the main crack.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Computer vision-based rock bolt detection in orthomosaic imagery obtained in the Waste Isolation Pilot Plant underground facility

Assessing structural integrity of large underground tunnel facilities is often a time consuming and human-labor intensive task. Thus, research using various modes of sensing and automated detection of key structural components in mines is posed to aid in safety assessments and establishing overall structural health. We propose an approach utilizing off-the-shelf camera and lidar technology fixed to a custom sensing platform, image stitching techniques, fine-tuned object detection models, and specialized model-inference methods to automatically detect, count, and map roof bolts for assessment of structural safety in man-made underground tunnels. Results show a novel workflow for effective object counting in orthomosaic tunnel ceiling images generated from collections in GPS-denied mining environments. Additionally, we demonstrate effective fine-tuning of EfficientDet object detectors utilizing state-of-the-art image augmentation techniques known as the mosaic and mixup transformations. Our work is demonstrated on sensed data and imagery collected from the Department of Energy (DOE) Waste Isolation Pilot Plant (WIPP) where miles of tunnel ceiling must be assessed for structural integrity.

42 ENGINEERING↗
DOE OSTI2025

Wide‐Field Bond Quality Evaluation Using Frequency Domain Thermoreflectance with Deep Neural Network Feature Reconstruction

Heterogeneous integration of microelectronic components provides a pathway to improve circuit/component performance; however, this comes with assembly challenges, in particular due to complex interfaces via subsurface bump bonds. The ability of these bonds to transmit electrical signals and conduct heat to the carrier substrate limits component performance. In this work, hyperspectral frequency‐domain thermoreflectance (FDTR) imaging is demonstrated as a robust technique for evaluating the quality of subsurface indium bump bonds in a surrogate microelectronic sample. By performing microscale FDTR imaging with coarse motion image stitching, thermal phase maps that cover a 4 mm by 4 mm field‐of‐view with subsurface feature sensitivity at depths greater than 50 µm are obtained. The resulting FDTR hyperspectral data contains more than three million pixels and reveal the quality of subsurface microbump arrays. Wide‐field analysis of bonded versus gap regions is enabled by deep neural network feature reconstruction, that after training, rapidly provides an interpretable representation of bond quality. Utility of noisy higher frequency FDTR phase maps, i.e., near the computationally predicted sensing depth limit, results in an average prediction error of 11%. Taken together, FDTR with neural network‐based analysis demonstrates subsurface bond monitoring at length scales relevant for heterogeneously integrated microelectronics.

FDTR↗
DOE OSTI2025

Analysis of biofilm assembly by large area automated AFM

Biofilms are complex microbial communities critical in medical, industrial, and environmental contexts. Understanding their assembly, structure, genetic regulation, interspecies interactions, and environmental responses is key to developing effective control and mitigation strategies. While atomic force microscopy (AFM) offers critically important high-resolution insights on structural and functional properties at the cellular and even sub-cellular level, its limited scan range and labor-intensive nature restricts the ability to link these smaller scale features to the functional macroscale organization of the films. We begin to address this limitation by introducing an automated large area AFM approach capable of capturing high-resolution images over millimeter-scale areas, aided by machine learning for seamless image stitching, cell detection, and classification. Large area AFM is shown to provide a very detailed view of spatial heterogeneity and cellular morphology during the early stages of biofilm formation which were previously obscured. Using this approach, we examined the organization of Pantoea sp. YR343 on PFOTS-treated glass surfaces. Our findings reveal a preferred cellular orientation among surface-attached cells, forming a distinctive honeycomb pattern. Detailed mapping of flagella interactions suggests that flagellar coordination plays a role in biofilm assembly beyond initial attachment. Additionally, we use large-area AFM to characterize surface modifications on silicon substrates, observing a significant reduction in bacterial density. This highlights the potential of this method for studying surface modifications to better understand and control bacterial adhesion and biofilm formation.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Data processing methods and data acquisition for samples larger than the field of view in parallel-beam tomography

Parallel-beam tomography systems at synchrotron facilities have limited field of view (FOV) determined by the available beam size and detector system coverage. Scanning the full size of samples bigger than the FOV requires various data acquisition schemes such as grid scan, 360-degree scan with offset center-of-rotation (COR), helical scan, or combinations of these schemes. Though straightforward to implement, these scanning techniques have not often been used due to the lack of software and methods to process such types of data in an easy and automated fashion. The ease of use and automation is critical at synchrotron facilities where using visual inspection in data processing steps such as image stitching, COR determination, or helical data conversion is impractical due to the large size of datasets. Here, we provide methods and their implementations in a Python package, named Algotom, for not only processing such data types but also with the highest quality possible. The efficiency and ease of use of these tools can help to extend applications of parallel-beam tomography systems.

36 MATERIALS SCIENCE↗
DOE OSTI2023

A New Reflected Target Optical Assessment System: Stage 1 Development Results

NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL’s outdoor Non-Intrusive Optical (NIO) measurement technique [1]. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed to require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements, making it a valuable tool for quality assurance and laboratory measurement of heliostat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. In this paper, we describe the methodology behind the measurement system, present an initial analysis of its uncertainty and sensitivity, and compare it with established optical measurement systems.

Kesseli, Devon (ORCID:0000000193113036)↗
DOE OSTI2023

A New Reflected Target Optical Assessment System - Stage 1 Development Results: Preprint

NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL's NIO technique. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements on fully assembled heliostats and parabolic trough facets, making it a valuable tool for quality assurance and laboratory measurement of helio-stat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. The measurement system's methodology and an analysis of its uncertainty, sensitivity and comparison with established optical measurement systems is described below.

canting↗
NASA NTRS2019

GOES-R Solar UltraViolet Imager Extended Coronal Imaging

GOES-16 and GOES-17 each hosts a Solar UltraViolet Imager (SUVI) that images the Sun in six extreme ultraviolet (EUV) wavelengths: 9.4 nm, 13.1nm, 17.1nm, 19.5nm, 28.4nm, and 30.4nm. The SUVI is nominally Sun-pointed and has a four-minute imaging sequence covering all the channels and meeting the dynamic range requirements. Based on the SUVI capabilities observed on-orbit, a campaign to image the extended solar corona was undertaken in 2018. This was performed by off-pointing the SUVI line-of-sight to the left and right of the Sun and producing a composite image by stitching together the off-pointed and the Sun-centered images. The imaging area in the composite is about three times the nominal image area in the East-West direction (about 5 RSun versus 1.8 RSun for nominal images). The campaign was conducted in February (4 hours), June (72 hours), and August-September of 2018 (5 weeks). Results from the campaign indicated the presence of solar corona to three solar radii, even in the quiet Sun part of the solar cycle. NOAA can operationalize this concept by tasking the SUVI on one of GOES-E and GOES-W. Such long-term operation will provide data that is needed to establish the much needed connectivity between the EUV and white light coronagraph data for the CME events.

Extended Coronal↗
NASA NTRS2013

Helicopter Flight Test of a Compact, Real-Time 3-D Flash Lidar for Imaging Hazardous Terrain During Planetary Landing

A second generation, compact, real-time, air-cooled 3-D imaging Flash Lidar sensor system, developed from a number of cutting-edge components from industry and NASA, is lab characterized and helicopter flight tested under the Autonomous Precision Landing and Hazard Detection and Avoidance Technology (ALHAT) project. The ALHAT project is seeking to develop a guidance, navigation, and control (GN&C) and sensing system based on lidar technology capable of enabling safe, precise crewed or robotic landings in challenging terrain on planetary bodies under any ambient lighting conditions. The Flash Lidar incorporates a 3-D imaging video camera based on Indium-Gallium-Arsenide Avalanche Photo Diode and novel micro-electronic technology for a 128 x 128 pixel array operating at a video rate of 20 Hz, a high pulse-energy 1.06 μm Neodymium-doped: Yttrium Aluminum Garnet (Nd:YAG) laser, a remote laser safety termination system, high performance transmitter and receiver optics with one and five degrees field-of-view (FOV), enhanced onboard thermal control, as well as a compact and self-contained suite of support electronics housed in a single box and built around a PC-104 architecture to enable autonomous operations. The Flash Lidar was developed and then characterized at two NASA-Langley Research Center (LaRC) outdoor laser test range facilities both statically and dynamically, integrated with other ALHAT GN&C subsystems from partner organizations, and installed onto a Bell UH-1H Iroquois "Huey" helicopter at LaRC. The integrated system was flight tested at the NASA-Kennedy Space Center (KSC) on simulated lunar approach to a custom hazard field consisting of rocks, craters, hazardous slopes, and safe-sites near the Shuttle Landing Facility runway starting at slant ranges of 750 m. In order to evaluate different methods of achieving hazard detection, the lidar, in conjunction with the ALHAT hazard detection and GN&C system, operates in both a narrow 1deg FOV raster-scanning mode in which successive, gimbaled images of the hazard field are mosaicked together as well as in a wider, 4.85deg FOV staring mode in which digital magnification, via a novel 3-D superresolution technique, is used to effectively achieve the same spatial precision attained with the more narrow FOV optics. The lidar generates calibrated and corrected 3-D range images of the hazard field in real-time and passes them to the ALHAT Hazard Detection System (HDS) which stitches the images together to generate on-the-fly Digital Elevation Maps (DEM's) and identifies hazards and safe-landing sites which the ALHAT GN&C system can then use to guide the host vehicle to a safe landing on the selected site. Results indicate that, for the KSC hazard field, the lidar operational range extends from 100m to 1.35 km for a 30 degree line-of-sight angle and a range precision as low as 8 cm which permits hazards as small as 25 cm to be identified. Based on the Flash Lidar images, the HDS correctly found and reported safe sites in near-real-time during several of the flights. A follow-on field test, planned for 2013, seeks to complete the closing of the GN&C loop for fully-autonomous operations on-board the Morpheus robotic, rocket-powered, free-flyer test bed in which the ALHAT system would scan the KSC hazard field (which was vetted during the present testing) and command the vehicle to landing on one of the selected safe sites.

Roback, VIncent E.↗
DOE OSTI2021

Processed Surface Imagery & Raster Imagery taken onboard TigerShark (U3) UAS

Land-surface orthomosaic imagery derived from the images collected using the Micasense Altum Imager on board the UAS TigerShark (U3) on March 11th, 2021 at an altitude of 2000 ft. The Altum takes images of the land surface across five visible bands and one long wave infrared thermal band. The photogrametry software Agisoft PhotoScan v 1.4 is used to align and stitch the images into a larger composet image using the technique of structure from motion image capture to construct a dense cloud and 3-D model of the surface, which is used to produce a digital elevation model of the terraine surveyed and orthomosaic imagery. This dataset contains the raster calculated orthomosaics of various vegetative indicies, which are used to indicate plant health and land surface characteristics, including Normalized Difference Vegetation Index (NDVI), Green Normalized Difference Vegetation Index (GNDVI), Normalized Difference Water Index (NDWI), surface temperature, and Enhanced_vegetation_index (EVI). These orthomosaics were collected west of the Starkville, MS, airport, and include natural, agricultural, and industrial land coverage. The images have a resolution of 0.2 m/pix.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2022

Celestial Mapping System Video Demonstration Part 4

The current presentation focuses on the work performed by the authors, to consume a unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar south pole which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool. This tool was developed in direct support of NASA's VIPER and Artemis programs to enhance the extremely low-light images of the interior of PSRs and provide the first-time ability to see within these regions at 3m scale visibility. We focused on the region near Nobili crater, selected site for VIPER mission and stitched several images to create a high-resolution map of B01 crater, that included the visualization of PSRs. We have developed an in-built line of sight analysis tool in CMS, that analyzes the terrain profile and obstructions and provides the visibility of a given terrain for a remote observer. This tool was utilized to perform viewshed analysis to investigate the area inside the PSR B01, a remote observer such as a rover could see without actually crossing the region. This analysis was extended further to set different heights for various observers and then perform the viewshed analysis. The combined visibility profile at different locations could subsequently lead to traverse planning.

Mapping↗