Results for “IMAGE” — Page 99

DOE OSTI2020

Ultra-Fast Electron Microscopic Imaging of Single Molecules With a Direct Electron Detection Camera and Noise Reduction

Time-resolved imaging of molecules and materials made of light elements is an emerging field of transmission electron microscopy (TEM), and the recent development of direct electron detection cameras, capable of taking as many as 1,600 fps, has potentially broadened the scope of the time-resolved TEM imaging in chemistry and nanotechnology. However, such a high frame rate reduces electron dose per frame, lowers the signal-to-noise ratio (SNR), and renders the molecular images practically invisible. Here, we examined image noise reduction to take the best advantage of fast cameras and concluded that the Chambolle total variation denoising algorithm is the method of choice, as illustrated for imaging of a molecule in the 1D hollow space of a carbon nanotube with ~1 ms time resolution. Through the systematic comparison of the performance of multiple denoising algorithms, we found that the Chambolle algorithm improves the SNR by more than an order of magnitude when applied to TEM images taken at a low electron dose as required for imaging at around 1,000 fps. Open-source code and a standalone application to apply Chambolle denoising to TEM images and video frames are available for download.

47 OTHER INSTRUMENTATION↗

DOE OSTI2017

Machine learning to analyze images of shocked materials for precise and accurate measurements

A supervised machine learning algorithm, called locally adaptive discriminant analysis (LADA), has been developed to locate boundaries between identifiable image features that have varying intensities. LADA is an adaptation of image segmentation, which includes techniques that find the positions of image features (classes) using statistical intensity distributions for each class in the image. In order to place a pixel in the proper class, LADA considers the intensity at that pixel and the distribution of intensities in local (nearby) pixels. This paper presents the use of LADA to provide, with statistical uncertainties, the positions and shapes of features within ultrafast images of shock waves. We demonstrate the ability to locate image features including crystals, density changes associated with shock waves, and material jetting caused by shock waves. This algorithm can analyze images that exhibit a wide range of physical phenomena because it does not rely on comparison to a model. LADA enables analysis of images from shock physics with statistical rigor independent of underlying models or simulations.

47 OTHER INSTRUMENTATION↗

DOE OSTI2013

Population of anatomically variable 4D XCAT adult phantoms for imaging research and optimization

Purpose: The authors previously developed the 4D extended cardiac-torso (XCAT) phantom for multimodality imaging research. The XCAT consisted of highly detailed whole-body models for the standard male and female adult, including the cardiac and respiratory motions. In this work, the authors extend the XCAT beyond these reference anatomies by developing a series of anatomically variable 4D XCAT adult phantoms for imaging research, the first library of 4D computational phantoms. Methods: The initial anatomy of each phantom was based on chest-abdomen-pelvis computed tomography data from normal patients obtained from the Duke University database. The major organs and structures for each phantom were segmented from the corresponding data and defined using nonuniform rational B-spline surfaces. To complete the body, the authors manually added on the head, arms, and legs using the original XCAT adult male and female anatomies. The structures were scaled to best match the age and anatomy of the patient. A multichannel large deformation diffeomorphic metric mapping algorithm was then used to calculate the transform from the template XCAT phantom (male or female) to the target patient model. The transform was applied to the template XCAT to fill in any unsegmented structures within the target phantom and to implement the 4D cardiac and respiratory models in the new anatomy. Each new phantom was refined by checking for anatomical accuracy via inspection of the models. Results: Using these methods, the authors created a series of computerized phantoms with thousands of anatomical structures and modeling cardiac and respiratory motions. The database consists of 58 (35 male and 23 female) anatomically variable phantoms in total. Like the original XCAT, these phantoms can be combined with existing simulation packages to simulate realistic imaging data. Each new phantom contains parameterized models for the anatomy and the cardiac and respiratory motions and can, therefore, serve as a jumping point from which to create an unlimited number of 3D and 4D variations for imaging research. Conclusions: A population of phantoms that includes a range of anatomical variations representative of the public at large is needed to more closely mimic a clinical study or trial. The series of anatomically variable phantoms developed in this work provide a valuable resource for investigating 3D and 4D imaging devices and the effects of anatomy and motion in imaging. Combined with Monte Carlo simulation programs, the phantoms also provide a valuable tool to investigate patient-specific dose and image quality, and optimization for adults undergoing imaging procedures.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2014

SU-E-I-41: Non-Cartesian MR Image Reconstruction with Integrated Gradient Non-Linearity Correction

Purpose: Nonlinearities in the spatial encoding gradients of MRI systems cause geometric distortion in images. Typically, this is retrospectively corrected via image-domain interpolation (a.k.a., “gradwarp”) albeit with a loss of spatial resolution. For non-Cartesian MRI, the latter problem is exaggerated by noise and undersampling artifact. In this study, we describe a novel correction strategy that accounts for gradient nonlinearities during — rather than after — non-Cartesian MRI reconstruction, and demonstrate that this approach mitigates the resolution loss that can occur with standard methods. Methods: To test the proposed method, the American College of Radiology (ACR) quality control phantom was scanned on at 1.5 T (General Electric, v16.0, “zoom” gradient) using a 1.6x undersampled 3D non- Cartesian Shells trajectory (GRE, FOV=24 cm3, 120 shells, 16552 shots, 512 readout, matrix=2403). Image reconstruction was first performed via standard k-space density-compensated gridding and retrospectively corrected via cubic spline interpolation. Image reconstruction was then separately performed using a k-space and image-domain densitycompensated type-3 non-uniform fast Fourier transform (NUFFT), which provides a direct mapping between non-Cartesian k-space samples and warped image space voxel locations. Thus, no separate distortion correction procedure is needed for the proposed approach. The gradient distortion field was determined using vendor provided calibration data. Results: Phantom scan results show that both processing approaches successfully correct geometric distortion. However, visual inspection of the ACR phantom spatial resolution inserts shows that the proposed strategy preserves the resolution of the nominal (uncorrected) reconstruction while “gradwarp” imparts marked spatial blurring (especially for the 1.0 and 1.1 mm inserts) and thus resolution loss. Conclusion: We've presented a novel reconstruction strategy for non-Cartesian MRI that corrects for gradient nonlinearities during — rather than after — reconstruction, and thus better preserves image resolution than traditional interpolation-based methods. This approach is expected to be especially advantageous when imaging with non-standard magnet geometries. NIH RR018898; NIH EB10065.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2015

TU-G-303-00: Radiomics: Advances in the Use of Quantitative Imaging Used for Predictive Modeling

‘Radiomics’ refers to studies that extract a large amount of quantitative information from medical imaging studies as a basis for characterizing a specific aspect of patient health. Radiomics models can be built to address a wide range of outcome predictions, clinical decisions, basic cancer biology, etc. For example, radiomics models can be built to predict the aggressiveness of an imaged cancer, cancer gene expression characteristics (radiogenomics), radiation therapy treatment response, etc. Technically, radiomics brings together quantitative imaging, computer vision/image processing, and machine learning. In this symposium, speakers will discuss approaches to radiomics investigations, including: longitudinal radiomics, radiomics combined with other biomarkers (‘pan-omics’), radiomics for various imaging modalities (CT, MRI, and PET), and the use of registered multi-modality imaging datasets as a basis for radiomics. There are many challenges to the eventual use of radiomics-derived methods in clinical practice, including: standardization and robustness of selected metrics, accruing the data required, building and validating the resulting models, registering longitudinal data that often involve significant patient changes, reliable automated cancer segmentation tools, etc. Despite the hurdles, results achieved so far indicate the tremendous potential of this general approach to quantifying and using data from medical images. Specific applications of radiomics to be presented in this symposium will include: the longitudinal analysis of patients with low-grade gliomas; automatic detection and assessment of patients with metastatic bone lesions; image-based monitoring of patients with growing lymph nodes; predicting radiotherapy outcomes using multi-modality radiomics; and studies relating radiomics with genomics in lung cancer and glioblastoma. Learning Objectives: Understanding the basic image features that are often used in radiomic models. Understanding requirements for reliable radiomic models, including robustness of metrics, adequate predictive accuracy, and generalizability. Understanding the methodology behind radiomic-genomic (’radiogenomics’) correlations. Research supported by NIH (US), CIHR (Canada), and NSERC (Canada)

60 APPLIED LIFE SCIENCES↗

DOE OSTI2015

TU-G-303-01: Radiomics: Quantitative Imaging in the Service of Improved Treatment Decision Making

‘Radiomics’ refers to studies that extract a large amount of quantitative information from medical imaging studies as a basis for characterizing a specific aspect of patient health. Radiomics models can be built to address a wide range of outcome predictions, clinical decisions, basic cancer biology, etc. For example, radiomics models can be built to predict the aggressiveness of an imaged cancer, cancer gene expression characteristics (radiogenomics), radiation therapy treatment response, etc. Technically, radiomics brings together quantitative imaging, computer vision/image processing, and machine learning. In this symposium, speakers will discuss approaches to radiomics investigations, including: longitudinal radiomics, radiomics combined with other biomarkers (‘pan-omics’), radiomics for various imaging modalities (CT, MRI, and PET), and the use of registered multi-modality imaging datasets as a basis for radiomics. There are many challenges to the eventual use of radiomics-derived methods in clinical practice, including: standardization and robustness of selected metrics, accruing the data required, building and validating the resulting models, registering longitudinal data that often involve significant patient changes, reliable automated cancer segmentation tools, etc. Despite the hurdles, results achieved so far indicate the tremendous potential of this general approach to quantifying and using data from medical images. Specific applications of radiomics to be presented in this symposium will include: the longitudinal analysis of patients with low-grade gliomas; automatic detection and assessment of patients with metastatic bone lesions; image-based monitoring of patients with growing lymph nodes; predicting radiotherapy outcomes using multi-modality radiomics; and studies relating radiomics with genomics in lung cancer and glioblastoma. Learning Objectives: Understanding the basic image features that are often used in radiomic models. Understanding requirements for reliable radiomic models, including robustness of metrics, adequate predictive accuracy, and generalizability. Understanding the methodology behind radiomic-genomic (’radiogenomics’) correlations. Research supported by NIH (US), CIHR (Canada), and NSERC (Canada)

60 APPLIED LIFE SCIENCES↗

DOE OSTI2015

TU-G-303-02: Robust Radiomics Methods for PET and CT Imaging

‘Radiomics’ refers to studies that extract a large amount of quantitative information from medical imaging studies as a basis for characterizing a specific aspect of patient health. Radiomics models can be built to address a wide range of outcome predictions, clinical decisions, basic cancer biology, etc. For example, radiomics models can be built to predict the aggressiveness of an imaged cancer, cancer gene expression characteristics (radiogenomics), radiation therapy treatment response, etc. Technically, radiomics brings together quantitative imaging, computer vision/image processing, and machine learning. In this symposium, speakers will discuss approaches to radiomics investigations, including: longitudinal radiomics, radiomics combined with other biomarkers (‘pan-omics’), radiomics for various imaging modalities (CT, MRI, and PET), and the use of registered multi-modality imaging datasets as a basis for radiomics. There are many challenges to the eventual use of radiomics-derived methods in clinical practice, including: standardization and robustness of selected metrics, accruing the data required, building and validating the resulting models, registering longitudinal data that often involve significant patient changes, reliable automated cancer segmentation tools, etc. Despite the hurdles, results achieved so far indicate the tremendous potential of this general approach to quantifying and using data from medical images. Specific applications of radiomics to be presented in this symposium will include: the longitudinal analysis of patients with low-grade gliomas; automatic detection and assessment of patients with metastatic bone lesions; image-based monitoring of patients with growing lymph nodes; predicting radiotherapy outcomes using multi-modality radiomics; and studies relating radiomics with genomics in lung cancer and glioblastoma. Learning Objectives: Understanding the basic image features that are often used in radiomic models. Understanding requirements for reliable radiomic models, including robustness of metrics, adequate predictive accuracy, and generalizability. Understanding the methodology behind radiomic-genomic (’radiogenomics’) correlations. Research supported by NIH (US), CIHR (Canada), and NSERC (Canada)

60 APPLIED LIFE SCIENCES↗

DOE OSTI2015

TU-G-303-03: Machine Learning to Improve Human Learning From Longitudinal Image Sets

‘Radiomics’ refers to studies that extract a large amount of quantitative information from medical imaging studies as a basis for characterizing a specific aspect of patient health. Radiomics models can be built to address a wide range of outcome predictions, clinical decisions, basic cancer biology, etc. For example, radiomics models can be built to predict the aggressiveness of an imaged cancer, cancer gene expression characteristics (radiogenomics), radiation therapy treatment response, etc. Technically, radiomics brings together quantitative imaging, computer vision/image processing, and machine learning. In this symposium, speakers will discuss approaches to radiomics investigations, including: longitudinal radiomics, radiomics combined with other biomarkers (‘pan-omics’), radiomics for various imaging modalities (CT, MRI, and PET), and the use of registered multi-modality imaging datasets as a basis for radiomics. There are many challenges to the eventual use of radiomics-derived methods in clinical practice, including: standardization and robustness of selected metrics, accruing the data required, building and validating the resulting models, registering longitudinal data that often involve significant patient changes, reliable automated cancer segmentation tools, etc. Despite the hurdles, results achieved so far indicate the tremendous potential of this general approach to quantifying and using data from medical images. Specific applications of radiomics to be presented in this symposium will include: the longitudinal analysis of patients with low-grade gliomas; automatic detection and assessment of patients with metastatic bone lesions; image-based monitoring of patients with growing lymph nodes; predicting radiotherapy outcomes using multi-modality radiomics; and studies relating radiomics with genomics in lung cancer and glioblastoma. Learning Objectives: Understanding the basic image features that are often used in radiomic models. Understanding requirements for reliable radiomic models, including robustness of metrics, adequate predictive accuracy, and generalizability. Understanding the methodology behind radiomic-genomic (’radiogenomics’) correlations. Research supported by NIH (US), CIHR (Canada), and NSERC (Canada)

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Simulation studies of a full-ring, CZT SPECT system for whole-body imaging of 99m Tc and 177 Lu

Single photon emission computed tomography (SPECT) is an imaging modality that has demonstrated its utility in a number of clinical indications. Despite this progress, a high sensitivity, high spatial resolution, multi-tracer SPECT with a large field of view suitable for whole-body imaging of a broad range of radiotracers for theranostics is not available. With the goal of filling this technological gap, we have designed a cadmium zinc telluride (CZT) full-ring SPECT scanner instrumented with a broad-energy tungsten collimator. The final purpose is to provide a multi-tracer solution for brain and whole-body imaging. Our static SPECT does not rely on the dual- and the triple-head rotational SPECT standard paradigm, enabling a larger effective area in each scan to increase the sensitivity. We provide a demonstration of the performance of our design using a realistic model of our detector with simulated body-sized phantoms filled with 99m Tc and 177 Lu. Our SPECT design can resolve 7.9 mm rods for 99m Tc (140 keV) and 9.5 mm for 177 Lu (208 keV) in a hot-rod Derenzo phantom with a 3-min exposure and reach an image contrast of 78% for 99m Tc and 57% for 177 Lu using the NEMA IQ phantom with a 6-min exposure. Our modified scatter correction shows an improved contrast-recovery ratio compared to a standard correction. In this paper, we demonstrate the good performance of our design for whole-body imaging purposes. This adds to our previous demonstration of improved qualitative and quantitative 99m Tc imaging of brain perfusion and 123 I imaging of dopamine transport with respect to state-of-the-art NaI dual-head cameras. We show that our design provides similar IQ and contrast to the commercial full-ring SPECT VERITON for 99m Tc. Regarding 177 Lu imaging of the 208 keV emissions, our design provides similar contrast to that of other state-of-the-art SPECTs with a significant reduction in exposure. In conclusion, the high sensitivity and extended energy range up to 250 keV makes our SPECT design a promising alternative for clinical imaging and theranostics of emerging radionuclides.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2019

Improved reconstruction stability for chemical shift encoded hyperpolarized 13 C magnetic resonance spectroscopic imaging using k‐t spiral acquisitions

Purpose A multiecho, field of view (FOV)‐oversampled k‐t spiral acquisition and direct iterative decomposition of water and fat with echo asymmetry and least‐squares estimation reconstruction is demonstrated to improve the stability of hyperpolarized 13 C magnetic resonance spectroscopic imaging (MRSI) in the presence of signal ambiguities attributed to low‐SNR (signal‐to‐noise‐ratio) species, local uncertainties in metabolite peaks, and echo‐to‐echo signal inconsistencies. Theory k‐t spiral acquisitions redistribute readout points to be more densely spaced radially in k‐space by acquiring an FOV and matrix that are oversampled by η . These more densely spaced spiral turns constitute effective intraspiral echoes and can supplement conventional interspiral echoes to improve spectral separation and reduce spectral cross‐talk to better resolve 13 C‐labeled species for spectroscopic imaging. Methods Digital simulations and imaging phantom experiments were performed for a range of interspiral echo spacings and η using multiecho, k‐t spiral acquisitions. Image spectral cross‐talk artifacts were evaluated both qualitatively and quantitatively as the percent error in measured metabolite ratios. In vivo murine experiments evaluated the feasibility of multiecho, k‐t spiral [1‐ 13 C]pyruvate MRSI to reduce spectral cross‐talk for 3 scenarios of different expected reconstruction stability. Results Digital simulations and imaging phantom experiments both demonstrated reduced or comparable image spectral cross‐talk and percent errors in measured metabolite ratios with increasing η and better choices of echo spacings. In vivo images displayed markedly reduced spectral cross‐talk in lactate images acquired with η = 7 versus η = 1. Conclusion The precision of hyperpolarized 13 C metabolic imaging and quantification in the presence of low‐SNR species, local uncertainties in metabolite resonances, and echo‐to‐echo signal inconsistencies can be improved with the use of FOV‐oversampled k‐t spiral acquisitions.

Macdonald, Erin B.↗

DOE OSTI2025

Automated Scoring of Morphological Changes in Images of Pentaerythritol Tetranitrate

Recent advances in characterization techniques that generate large datasets of material microstructure images require robust, automated image-processing. We applied an unsupervised anomaly detection method called feature anomaly detection system (FADS) to automatically detect and quantify microstructure changes in images of the explosive pentaerythritol tetranitrate (PETN) aged at various temperatures. We demonstrated the FADS approach on two-dimensional images extracted from computed tomography scans, but the same technique can be readily applied to other imaging modalities. FADS calculates anomaly scores on the basis of differences in filter activations of nominal and test data in pretrained convolutional neural networks. The FADS scores successfully differentiated between pristine PETN and PETN aged at a temperature where material coarsening occurred. Morphological metric analysis of segmented images verified observed trends in FADS scores as a function of aging temperature and aging time, specifically by calculating volume fractions, specific boundary lengths, two-point correlation functions, and local thicknesses. Here, the FADS technique has two important advantages compared to traditional morphological analysis: First, it uses grayscale images as input, rather than images that are segmented to separate the appropriate phases; and second, FADS scores capture any type of changes among image sets, rather than requiring prior knowledge or selection of a relevant set of metrics.

Accelerated aging↗

DOE OSTI2019

Diffusion-weighted imaging as a part of PET/MR for small lesion detection in patients with primary abdominal and pelvic cancer, with or without TOF reconstruction technique

Objectives: To investigate the value of diffusion-weighted imaging (DWI) in detection of small lesions (≤ 10 mm) in patients with primary abdominal and pelvic cancer in hybrid PET/MR with or without time-of-flight (TOF) technique. Materials and methods: Twenty patients (11 females and 9 males, mean age 67.23 ± 12.90 years) with histologically confirmed primary abdominal and pelvic cancer underwent hybrid PET/MR examination. A total of 64 small lesions were included in this study, which were divided into two groups (≤ 10 mm and 10–30 mm). Visual scores of small lesion detection ability were rated by five-point ordinal scale. The visual scores and detectability of small lesions on TOF PET image, noTOF PET image, and DWI sequences of hybrid PET/MR examination with or without TOF technique were analyzed. Logistic regression model was established for analysis in the value of DWI in hybrid PET/MR examination with or without TOF technique in detection of the small lesions between two groups. Results: The visual evaluation revealed the small lesion (≤ 10 mm) visual scores of DWI (mean ± SD: 4.23 ± 1.41), TOF PET image (mean ± SD: 4.14 ± 0.89), and noTOF PET image (mean ± SD: 2.68 ± 1.13);.and the visual scores of small lesions (10–30 mm) on DWI (mean ± SD: 4.98 ± 0.15), TOF PET image (mean ± SD: 4.57 ± 0.59), and noTOF PET image (mean ± SD: 3.98 ± 1.05). The visual scores of all small lesions on DWI were higher than that on TOF PET data and noTOF PET data in both two groups (**P < 0.01). The missed diagnosis rates of small FDG avid lesions (≤ 10 mm) of DWI and noTOF PET image were 9.1% and 9.1%, respectively. However, the TOF PET-based clinical diagnosis detected all small lesions (≤ 30 mm). DWI was of great importance in detection of small lesions (≤ 10 mm) in the absence of TOF technique in PET/MR examination (**P < 0.01). DWI’s effect on detection of small lesions(10-30 mm) has shown no difference between PET/MR examinations with TOF and without TOF techniques (P > 0.05). Conclusion: DWI has significant value in the detection of small lesions (≤ 10 mm) in hybrid PET/MR examination without TOF technique for patients with primary abdominal and pelvic cancer. However, it had less detection benefits in the small lesions (≤ 10 mm) in hybrid PET/MR examination with TOF PET image.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2019

Experimental study on flow characterization of a rectangular spouted bed by image processing

Systematic image processing methods are applied to characterize gas-solid flow under different operating conditions in a 30.2 mm x 101.6 mm rectangular spouted bed. Geldart D particles are imaged using a highspeed video camera. Superficial gas velocity, initial bed height, and nozzle size are investigated as influence factors. By applying adaptive thresholding and logical operation to the video frames, the original color images are transformed into binary images exposing detailed boundary information. By analyzing the binary image using a self-developed algorithm in combination with mask operations, the bed height is successfully determined, through which the variation of the bed expansion ratio with superficial gas velocity can be obtained. Additionally, the application of image morphological operations, i.e. dilation and erosion on the binarized images ensures the accurate identification of the contours of the jet and fountain so that the jet and fountain heights can be determined. Based on the image processing methods, the variation of bed expansion ratio, jet height and fountain height with the three influence factors are discussed. The current study highlights the application of image analysis in investigating the flow characterization and obtaining more hydrodynamic information in a rectangular spouted bed.

42 ENGINEERING↗

DOE OSTI2018

An Algorithm for Enhancing the Image Contrast of Electron Tomography

Abstract Three-dimensional (3D) reconstruction of a single protein molecule is essential for understanding the relationship between the structural dynamics and functions of the protein. Electron tomography (ET) provides a tool for imaging an individual particle of protein from a series of tilted angles. Individual-particle electron tomography (IPET) provides an approach for reconstructing a 3D density map from a single targeted protein particle (without averaging from different particles of this type of protein), in which the target particle was imaged from a series of tilting angles. However, owing to radiation damage limitations, low-dose images (high noise, and low image contrast) are often challenging to be aligned for 3D reconstruction at intermediate resolution (1–3 nm). Here, we propose a computational method to enhance the image contrast, without increasing any experimental dose, for IPET 3D reconstruction. Using an edge-preserving smoothing-based multi-scale image decomposition algorithm, this method can detect the object against a high-noise background and enhance the object image contrast without increasing the noise level or significantly decreasing the image resolution. The method was validated by using both negative staining (NS) ET and cryo-ET images. The successful 3D reconstruction of a small molecule (<100 kDa) indicated that this method can be used as a supporting tool to current ET 3D reconstruction methods for studying protein dynamics via structure determination from each individual particle of the same type of protein.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Deep learning-based noise filtering toward millisecond order imaging by using scanning transmission electron microscopy

Application of scanning transmission electron microscopy (STEM) to in situ observation will be essential in the current and emerging data-driven materials science by taking STEM’s high affinity with various analytical options into account. As is well known, STEM’s image acquisition time needs to be further shortened to capture a targeted phenomenon in real-time as STEM’s current temporal resolution is far below the conventional TEM’s. However, rapid image acquisition in the millisecond per frame or faster generally causes image distortion, poor electron signals, and unidirectional blurring, which are obstacles for realizing video-rate STEM observation. Here we show an image correction framework integrating deep learning (DL)-based denoising and image distortion correction schemes optimized for STEM rapid image acquisition. By comparing a series of distortion corrected rapid scan images with corresponding regular scan speed images, the trained DL network is shown to remove not only the statistical noise but also the unidirectional blurring. This result demonstrates that rapid as well as high-quality image acquisition by STEM without hardware modification can be established by the DL. The DL-based noise filter could be applied to in-situ observation, such as dislocation activities under external stimuli, with high spatio-temporal resolution.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Classification of computed thermal tomography images with deep learning convolutional neural network

Thermal tomography (TT) is a computational method for the reconstruction of depth profile of the internal material defects from Pulsed Infrared Thermography (PIT) nondestructive evaluation. Here, the PIT method consists of recording material surface temperature transients with a fast frame infrared camera, following thermal pulse deposition on the material surface with a flashlamp and heat diffusion into material bulk. TT algorithm obtains depth reconstructions of thermal effusivity, which has been shown to provide visualization of the subsurface internal defects in metals. In many applications, one needs to determine the defect shape and orientation from reconstructed effusivity images. Interpretation of TT images is non-trivial because of blurring, which increases with depth due to the heat diffusion-based nature of image formation. We have developed a deep learning convolutional neural network (CNN) to classify the size and orientation of subsurface material defects in TT images. CNN was trained with TT images produced with computer simulations of 2D metallic structures (thin plates) containing elliptical subsurface voids. The performance of CNN was investigated using test TT images developed with computer simulations of plates containing elliptical defects, and defects with shapes imported from scanning electron microscopy images. CNN demonstrated the ability to classify radii and angular orientation of elliptical defects in previously unseen test TT images. We have also demonstrated that CNN trained on the TT images of elliptical defects is capable of classifying the shape and orientation of irregular defects.

42 ENGINEERING↗

DOE OSTI2025

Forward modeling fluctuations in the DESI LRGs target sample using image simulations

We use the forward modeling pipeline, Obiwan, to study the imaging systematics of the Luminous Red Galaxies (LRGs) targeted by the Dark Energy Spectroscopic Instrument (DESI). Imaging systematics refers to the false fluctuation of galaxy densities due to varying observing conditions and astrophysical foregrounds corresponding to the imaging surveys from which DESI LRG target galaxies are selected. We update the Obiwan pipeline, which we previously developed to simulate the optical images used to target DESI data, to further simulate WISE images in the infrared. This addition allows simulating the DESI LRGs sample, which utilizes WISE data in the target selection. Deep DESI imaging data combined with a method to account for biases in their shapes is used to define a truth sample of potential LRG targets. We inject these data evenly throughout the DESI Legacy Imaging Survey footprint at declinations between -30 and 32.375 degrees. We simulate a total of 15 million galaxies to obtain a simulated LRG sample (Obiwan LRGs) that predicts the variations in target density due to imaging properties. We find that the simulations predict the trends with depth observed in the data, including how they depend on the intrinsic brightness of the galaxies. We observe that faint LRGs are the main contributing source of the imaging systematics trend induced by depth. We also find significant trends in the data against Galactic extinction that are not predicted by Obiwan. These trends depend strongly on the particular map of Galactic extinction chosen to test against, implying systematic contamination in the Galactic extinction maps is a likely root cause (e.g., Cosmic-Infrared Background, dust temperature correction). We additionally observe a morphological change of the DESI LRGs population evidenced by a correlation between OII emission line average intensity and the size of the z-band PSF. This effect most likely results from uncertainties in background subtraction. The detailed findings we present should be used to guide any observational systematics mitigation treatment for the clustering of the DESI LRGs sample.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

3D Optical Coherence Tomography image processing in BISCAP: characterization of biofilm structure and properties

Abstract Motivation BISCAP is a state-of-the-art tool for automatically characterizing biofilm images obtained from Optical Coherence Tomography. Limited availability of other software tools is reported in the field. BISCAP’s first version processes 2D images only. Processing 3D images is a problem of greater scientific relevance since it deals with the entire structure of biofilms instead of their 2D slices. Results Building on the image-processing principles and algorithms proposed earlier for 2D images, these were adapted to the 3D case, and a more general implementation of BISCAP was developed. The primary goal concerns the extension of the initial methodology to incorporate the depth axis in 3D images; multiple improvements were also made to boost computational performance. The calculation of structural properties and visual outputs was extended to offer new insights into the 3D structure of biofilms. BISCAP was tested using 3D images of biofilms with different morphologies, consistently delivering accurate characterizations of 3D structures in a few minutes using standard laptop machines. Low user dependency is required for image analysis. Availability and implementation BISCAP is available from https://github.com/diogonarciso/BISCAP. All images used in the tutorials and the validation examples are available from https://web.fe.up.pt/∼fgm/biscap3d.

Narciso, Diogo A. C. (ORCID:0000000227767477)↗