Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Development of Multi-Edge Slant Target for Unlocalized MTF Measurement of Airborne Imaging System Payloads

Calibration of imaging instruments is a critical step in effectively characterizing imaging data. A comprehensive characterization of an imaging system provides valuable insight into the overall uncertainties in the results derived from the raw data collected. The Scientifically Calibrated In-Flight Imagery (SCIFLI) team (based at NASA Langley Research Center) has designed, built, tested, and successfully flown the optical payload known as the SCIFLI Airborne Multispectral Imager (SAMI). SAMI is a multispectral imaging payload, complete with sensor configurations for the Ultraviolet-Visible spectrum as well as Near- Infrared, Shortwave Infrared, and Midwave Infrared bands and is fitted with various optical hardware designed to turn, split, and focus light beams to the respective in-band sensors. Radiometric calibrations are performed for SAMI such that the accuracy and uncertainty of thermal and spectral measurements are effectively characterized. However, SAMI does not regularly undergo spatial characterizations to evaluate the performance of the imager at high spatial frequencies. This is essential, as understanding the spatial sensor response of discrete sensors is just as important as the spectral sensor response. The payload currently utilizes a calibration cart for lab testing. Equipped with a modular setup and several radiation sources, it is perfect for performing high-quality radiometric calibrations. This work focuses on using the calibration cart to perform spatial calibrations. A custom designed calibration target is being used to evaluate the optical performance of SAMI. Specifically, the target is designed to measure the Modulation Transfer Function (MTF) of the imager in discrete locations around the focal plane. The results of this characterization will provide insight into the spatial resolution capabilities of the SAMI payload in practice. Future work includes using the results of the study to correct optical imperfections in imagery taken with SAMI.

SAMI↗
DOE OSTI2023

Coded aperture and Compton imaging for the development of 225 Ac‐based radiopharmaceuticals

Abstract Background Targeted alpha‐particle therapy (TAT) has great promise as a cancer treatment. Arguably the most promising TAT radionuclide that has been proposed is 225 Ac. The development of 225 Ac‐based radiopharmaceuticals has been hampered due to the lack of effective means to study the daughter redistribution of these agents in small animals at the preclinical stage. Purpose The ability to directly image the daughters, namely 221 Fr and 213 Bi, via their gamma‐ray emissions would be a boon for preclinical studies. That said, conventional medical imaging modalities, including single photon emission computed tomography (SPECT) based on nonmultiplexed collimation, cannot be employed due to sensitivity limitations. Methods As an alternative, we propose the use of both coded aperture and Compton imaging with the former modality suited to the 218‐keV gamma‐ray emission of 221 Fr and the latter suited to the 440‐keV gamma‐ray emission of 213 Bi. Results This work includes coded aperture images of 221 Fr and Compton images of 213 Bi in tumor‐bearing mice injected with 225 Ac‐based radiopharmaceuticals. Conclusions These results are the first demonstration of visualizing and quantifying the 225 Ac daughters in small animals through the application of coded aperture and Compton imaging.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2022

NaroNet: Discovery of tumor microenvironment elements from highly multiplexed images

Understanding the spatial interactions between the elements of the tumor microenvironment -i.e. tumor cells. fibroblasts, immune cells- and how these interactions relate to the diagnosis or prognosis of a tumor is one of the goals of computational pathology. We present NaroNet, a deep learning framework that models the multi-scale tumor microenvironment from multiplex-stained cancer tissue images and provides patient-level interpretable predictions using a seamless end-to-end learning pipeline. Trained only with multiplex-stained tissue images and their corresponding patient-level clinical labels, NaroNet unsupervisedly learns which cell phenotypes, cell neighborhoods, and neighborhood interactions have the highest influence to predict the correct label. To this end, NaroNet incorporates several novel and state-of-the-art deep learning techniques, such as patch-level contrastive learning, multi-level graph embeddings, a novel max-sum pooling operation, or a metric that quantifies the relevance that each microenvironment element has in the individual predictions. We validate NaroNet using synthetic data simulating multiplex-immunostained images where a patient label is artificially associated to the -adjustable- probabilistic incidence of different microenvironment elements. We then apply our model to two sets of images of human cancer tissues: 336 seven-color multiplex-immunostained images from 12 high-grade endometrial cancer patients; and 382 35-plex mass cytometry images from 215 breast cancer patients. In both synthetic and real datasets, NaroNet provides outstanding predictions of relevant clinical information while associating those predictions to the presence of specific microenvironment elements.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Design of the high-yield time-gated x-ray hot-spot imager for OMEGA

Time-resolved x-ray self-emission imaging of hot spots in inertial confinement fusion experiments along several lines of sight provides critical information on the pressure and the transient morphology of the hot spot on the University of Rochester’s OMEGA Laser System. At least three quasi-orthogonal lines of sight are required to infer the tomographic information of the hot spots of deuterium–tritium cryogenic layered implosions. OMEGA currently has two time-gated x-ray hot-spot imagers: the time-resolved Kirkpatrick–Baez x-ray microscope and the single-line-of-sight, time-resolved x-ray imager (SLOS-TRXI). The time-gated x-ray hot-spot imager (XRHSI) is being developed for use on OMEGA as the third line of sight for the high-yield operation of up to 4 × 10 14 neutrons. XRHSI follows the SLOS-TRXI concept; however, it will have improved spatial and temporal resolutions of 5 μm and 20 ps, respectively. The simultaneous operation of the three instruments will provide 3-D reconstructions of the assembled hot-spot fuel at various times through peak thermonuclear output. The technical approach consists of a pinhole array imager and demagnifying time-dilation drift tube that are coupled to two side-by-side hybrid complementary metal–oxide semiconductor (hCMOS) image sensors. To minimize the background and to harden the diagnostics, an angled drift-tube assembly shifting the hCMOS sensors out of the direct line of sight and neutron shielding will be applied. As a result, the technical design space for the instrument will be discussed and the conceptual design will be presented.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Characterization of a Pixelated Cadmium Telluride Detector System Using a Polychromatic X-Ray Source and Gold Nanoparticle-Loaded Phantoms for Benchtop X-Ray Fluorescence Imaging

In this paper, the imaging dose and scan time have been considered as the two major constraints for routine benchtop x-ray fluorescence computed tomography (XFCT) imaging. One way to address this issue is to acquire x-ray fluorescence (XRF) signals in parallel through a 2D array of single-crystal detectors or a pixelated detector along with the cone-beam x-ray source. To identify a detector system suitable for this purpose, a commercially available, fully spectroscopic cadmium telluride (CdTe) pixelated detector, HEXITEC (High-Energy X-ray Imaging Technology), was tested under the experimental conditions optimized for benchtop XFCT imaging of gold nanoparticles (GNPs). Specifically, two different parallel-hole stainless steel collimators were fabricated and coupled with the detector for seamless integration into our existing benchtop cone-beam XFCT system. After the detector deployment, this benchtop XFCT system was used to detect XRF photons from GNP-loaded phantoms. A pixel-merging algorithm was introduced to enhance the sensitivity of XRF photon detection thereby minimizing the scan time. The effect of pixel-level charge sharing correction algorithms was investigated within the context of benchtop XFCT imaging. The detector energy resolution, in terms of the full width at half maximum (FWHM) values at different gold K-shell XRF energies, was also determined. Of the two charge sharing correction algorithms examined, the charge sharing addition gave better sensitivity than the charge sharing discrimination (csd). On the other hand, under the current experimental conditions, the energy resolution of the HEXITEC detector was the best with the csd and estimated to be 1.56 keV FWHM at 66-69 keV photon energy. Overall, despite some degradation of the detector energy resolution (compared with typical single crystal CdTe detectors), the HEXITEC detector enabled parallel data acquisition under the experimental conditions typical of benchtop XFCT imaging and operated well within our benchtop XFCT setup.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2011

Phase-Sensitive Coherence and the Classical-Quantum Boundary in Ghost Imaging

The theory of partial coherence has a long and storied history in classical statistical optics. the vast majority of this work addresses fields that are statistically stationary in time, hence their complex envelopes only have phase-insensitive correlations. The quantum optics of squeezed-state generation, however, depends on nonlinear interactions producing baseband field operators with phase-insensitive and phase-sensitive correlations. Utilizing quantum light to enhance imaging has been a topic of considerable current interest, much of it involving biphotons, i.e., streams of entangled-photon pairs. Biphotons have been employed for quantum versions of optical coherence tomography, ghost imaging, holography, and lithography. However, their seemingly quantum features have been mimicked with classical-sate light, questioning wherein lies the classical-quantum boundary. We have shown, for the case of Gaussian-state light, that this boundary is intimately connected to the theory of phase-sensitive partial coherence. Here we present that theory, contrasting it with the familiar case of phase-insensitive partial coherence, and use it to elucidate the classical-quantum boundary of ghost imaging. We show, both theoretically and experimentally, that classical phase-sensitive light produces ghost imaging most closely mimicking those obtained in biphotons, and we derived the spatial resolution, image contrast, and signal-to-noise ratio of a standoff-sensing ghost imager, taking into account target-induced speckle.

coherence theory↗
DOE OSTI2020

Atomic‐Resolution Imaging of Halide Perovskites Using Electron Microscopy

Abstract Atomic‐resolution imaging of halide perovskites (HPs) using transmission electron microscopy (TEM) is challenging because of the sensitivity of their structures to the electron beam. In this article, recent achievements in this area are reviewed, covering both all‐inorganic and organic–inorganic hybrid HPs, with an emphasis on the specific imaging conditions that have proven to be effective in avoiding electron beam‐induced structural damage. The discussion focusses on the total electron dose that HPs can bear before being damaged and the effects of different imaging modes, accelerating voltages, and temperatures. The crucial role of a direct‐detection electron‐counting camera in reducing the required electron dose is outlined, which is indispensable for imaging extremely sensitive organic–inorganic hybrid perovskites. In addition to reviewing published works, the results of initial attempts to perform atomic‐resolution elemental mapping for an all‐inorganic HP and image a hybrid HP using scanning TEM are introduced. The preparation of a TEM specimen from macroscopic crystals or devices of HPs, which is very important for practical applications but has not yet received attention, is also discussed. This article aims to provide guidance on the acquisition of atomic‐resolution TEM images of HPs and inspire the development of more imaging technologies for sensitive materials.

Song, Kepeng↗
DOE OSTI2022

Utilization of the Critic Subnetwork of a Generative Adversarial Network as Detector of Morphological Material Change in Image Data

The resolution of computed tomography (CT) has become high enough to monitor morphological changes due to aging in materials in long-term applications. For this work, we explored the utility of the critic of a generative adversarial network (GAN) to automatically detect such changes. The GAN was trained with images of pristine Pharmatose, which is used as a surrogate energetic material. It is important to note that images of the material with altered morphology were only used during the test phase. The GAN-generated images reproduced the microstructure of Pharmatose well, although some unrealistic particle fusion was seen. Calculated morphological metrics (volume fraction, interfacial line length, and local thickness) for the synthetic images also showed good agreement with the training data, albeit with signs of mode collapse in the interfacial line length. While the critic exposed changes in particle size, it showed limited ability to distinguish images by particle shape. The detection of shape differences was also a more challenging task for the selected morphological metrics that related to energetic material performance. We further tested the critic with images of aged Pharmatose. Subtle changes due to aging are difficult for the human analyst to detect; but both critic and morphological metrics analysis showed image differentiation.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Dual particle imaging using time-of-flight neutron classification

Fast-neutron imaging technology is well-suited for passive nuclear material monitoring, secondary inspection of flagged cargo, and wide-area search for lost neutron sources. However, imaging systems that use pulse shape discrimination for event classification require complex pulse waveform analysis. In this work, we evaluate time-of-flight (TOF) based particle classification as an alternative solution for fast-neutron imaging by classifying all events with a TOF above a maximum threshold as neutrons. We measured a Cf-252 source next to Cs-137 using a 12-bar organic-glass scintillator array. By varying the TOF thresholds for neutron identification, we demonstrate a clear trade-off between event yield and backprojection image fidelity, with stricter thresholds improving precision at the cost of statistics, TOF thresholded data generated an image that predicted the neutron source direction with 20% reduced mean central angle prediction error compared to a traditional pulse shape discrimination (PSD) method with comparable event count. Time-of-flight particle classification shows promise as an alternative to pulse shape discrimination systems for fast neutron imaging systems looking to minimize costs and size of electronics with comparable imaging quality. The sources used demonstrate that the method is effective in classifying measured neutrons in a measurement environment with 150 μCi Cs-137 and 1.6 × 10 6 n/s Cf-252 sources positioned at distances of 66 cm and 81 cm from the detector. Additionally, the method classifies low-energy neutron events that pulse shape discrimination removes, so a combination of both methods would result in a higher overall neutron event efficiency.

Heriot, William [Univ. of Michigan, Ann Arbor, MI ↗
DOE OSTI2022

Understanding the Influence of Receptive Field and Network Complexity in Neural Network-Guided TEM Image Analysis

Abstract Trained neural networks are promising tools to analyze the ever-increasing amount of scientific image data, but it is unclear how to best customize these networks for the unique features in transmission electron micrographs. Here, we systematically examine how neural network architecture choices affect how neural networks segment, or pixel-wise separate, crystalline nanoparticles from amorphous background in transmission electron microscopy (TEM) images. We focus on decoupling the influence of receptive field, or the area of the input image that contributes to the output decision, from network complexity, which dictates the number of trainable parameters. For low-resolution TEM images which rely on amplitude contrast to distinguish nanoparticles from background, we find that the receptive field does not significantly influence segmentation performance. On the other hand, for high-resolution TEM images which rely on both amplitude and phase-contrast changes to identify nanoparticles, receptive field is an important parameter for increased performance, especially in images with minimal amplitude contrast. Rather than depending on atom or nanoparticle size, the ideal receptive field seems to be inversely correlated to the degree of nanoparticle contrast in the image. Our results provide insight and guidance as to how to adapt neural networks for applications with TEM datasets.

42 ENGINEERING↗
DOE OSTI2026

Image processing pipeline for AI-driven nanoparticle megalibrary characterization

Recent innovations have made it possible to produce megalibraries, millions of structurally and compositionally distinct nanoparticles on a chip. These megalibraries yield vast volumes of data that are impossible to analyze manually, necessitating the development of automated tools. In previous work, we created a binary classification machine learning model to select quality nanoparticle images for downstream analysis. In this work, we show that adding a custom image processing step before training can produce significantly higher-performing models in a fraction of the time and make them more robust to different image noise levels and microscope acquisition settings. The image processing pipeline proposed here effectively cleans raw nanoparticle images, enhances key features, and allows us to use much lower resolution images and simpler neural network model architectures. These features result in higher performance and significant cost savings. Experiments demonstrate superior performance relative to baseline, including an 18.2% improvement in recall and a 13.1% increase in accuracy. Given the high cost of downstream analysis, it is critical to minimize false positives, and our best-performing model reaches a precision of 95.9% and a weighted F-score of 95.1% on an unseen test set. Additionally, model training time is reduced from hours to less than a minute. We also show that, using this custom image processing pipeline, model performance is significantly improved at lower pixel resolutions compared to downsizing alone. We expect that adopting this pipeline for AI-driven automated nanoparticle characterization will allow researchers to rapidly and accurately analyze much greater volumes of data, thereby accelerating materials discovery.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2025

Dark-field X-ray microscopy with structured illumination for three-dimensional imaging

Dark-field X-ray microscopy is a lens-based technique that enables real-space imaging of heterogeneous micro- and meso-scale ordered materials. However, achieving accurate three-dimensional (3D) reconstruction often requires meticulous sample alignment or rastering, requiring complex rotational setups and extended acquisition times. To address these challenges, we introduce a structured illumination technique optimized for 3D imaging of ordered materials at sub-micrometer length scales. Our approach employs a coded aperture to spatially modulate the incident X-ray beam, enabling 3D structural reconstruction from images captured at various aperture positions. Unlike current 3D imaging approaches, which often rely on rotational or rastering methods, our technique uses scanning X-ray silhouettes of the coded aperture for depth resolution along the diffraction axis. This eliminates the need for sample rotation or rastering, resulting in a highly stable and efficient imaging modality. We validated the efficacy of this approach through experimental imaging of an isolated twin domain within a bulk single crystal of an iron pnictide using a dark-field X-ray microscope. This advancement aligns with the enhanced brightness upgrades of modern synchrotron radiation facilities, unlocking new possibilities for high-resolution imaging of ordered materials.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

High-resolution ultra-low field magnetic resonance imaging with a high-sensitivity sensing coil

We present high-resolution magnetic resonance imaging (MRI) at ultra-low field (ULF) with a proton Larmor frequency of around 120 kHz. The key element is a specially designed high-sensitivity sensing coil in the shape of a solenoid with a few millimeter gap between windings to decrease the proximity effect and, hence, increase the coil’s quality ([Formula: see text]) factor and sensitivity. External noise is strongly suppressed by enclosing the sensing coil in a copper cylindrical shield, large enough not to negatively affect the coil’s [Formula: see text] factor and sensitivity, measured to be 217 and 0.47 fT/Hz[Formula: see text], respectively. To enhance small polarization of proton spins at ULF, a strong pulsed 0.1 T prepolarization field is applied, making the signal-to-noise ratio (SNR) of ULF MRI sufficient for high-quality imaging in a short time. We demonstrate ULF MRI of a copper sulfate solution phantom with a resolution of [Formula: see text] and SNR of 10. The acquisition time is 6.3 min without averaging. The sensing coil size in the current realization can accommodate imaging objects of 9 cm in size, sufficient for hand, and it can be further increased for human head imaging in the future. Since the in-plane resolution of [Formula: see text] is typical in anatomical medical imaging, this ULF MRI method can be an alternative low-cost, rapid, portable method for anatomical medical imaging of the human body or animals. This ULF MRI method can supplement other MRI methods, especially when such methods are restricted due to high cost, portability requirement, imaging artifacts, and other factors.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Wide-field microwave magnetic field imaging with nitrogen-vacancy centers in diamond

Non-invasive imaging of microwave (MW) magnetic fields with microscale lateral resolution is pivotal for various applications, such as MW technologies and integrated circuit failure analysis. Diamond nitrogen-vacancy (NV) center magnetometry has emerged as an ideal tool, offering micrometer-scale resolution, millimeter-scale field of view, high sensitivity, and non-invasive imaging compatible with diverse samples. However, up until now, it has been predominantly used for imaging of static or low-frequency magnetic fields or, concerning MW field imaging, to directly characterize the same microwave device used to drive the NV spin transitions. In this work, we leverage an NV center ensemble in diamond for wide-field imaging of MW magnetic fields generated by a test device employing a differential measurement protocol. The microscope is equipped with a MW loop to induce Rabi oscillations between NV spin states, and the MW field from the device-under-test is measured through local deviations in the Rabi frequency. This differential protocol yields magnetic field maps of a 2.57 GHz MW field with a sensitivity of ∼9 μT Hz −1/2 for a total measurement duration of T=357 s, covering a 340 × 340 μm 2 field of view with a micrometer-scale spatial resolution and a device-under-test input power dynamic range of 30 dB. This work demonstrates a novel NV magnetometry protocol, based on differential Rabi frequency measurement, that extends NV wide-field imaging capabilities to imaging of weak MW magnetic fields that would be difficult to measure directly through standard NV Rabi magnetometry.

crystallographic defects↗
DOE OSTI2023

Versatile recognition of graphene layers from optical images under controlled illumination through green channel correlation method

In this study, a simple yet versatile method is proposed for identifying the number of exfoliated graphene layers transferred on an oxide substrate from optical images, utilizing a limited number of input images for training, paired with a more traditional number of a few thousand well-published Github images for testing and predicting. Two thresholding approaches, namely the standard deviation-based approach and the linear regression-based approach, were employed in this study. The method specifically leverages the red, green, and blue color channels of image pixels and creates a correlation between the green channel of the background and the green channel of the various layers of graphene. This method proves to be a feasible alternative to deep learning-based graphene recognition and traditional microscopic analysis. The proposed methodology performs well under conditions where the effect of surrounding light on the graphene-on-oxide sample is minimum and allows rapid identification of the various graphene layers. Here, the study additionally addresses the functionality of the proposed methodology with nonhomogeneous lighting conditions, showcasing successful prediction of graphene layers from images that are lower in quality compared to typically published in literature. In all, the proposed methodology opens up the possibility for the non-destructive identification of graphene layers from optical images by utilizing a new and versatile method that is quick, inexpensive, and works well with fewer images that are not necessarily of high quality.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Pre- and post-treatment image-based dosimetry in 90 Y-microsphere radioembolization using the TOPAS Monte Carlo toolkit

Objective.To evaluate the pre-treatment and post-treatment imaging-based dosimetry of patients treated with 90Y-microspheres, including accurate estimations of dose to tumor, healthy liver and lung. To do so, the Monte Carlo (MC) TOPAS platform is in this work extended towards its utilization in radionuclide therapy. Approach. In this study, five patients treated at the Massachusetts General Hospital were selected for this study. All patients had data for both pre-treatment SPECT-CT imaging using 99mTc-MAA as a surrogate of the 90Y-microspheres treatment and SPECT-CT imaging immediately after the 90Y activity administration. Pre- and post-treatment doses were computed with TOPAS using the SPECT images to localize the source positions and the CT images to account for tissue inhomoegeneities. We compared our results with analytical calculations following the voxel-based MIRD scheme. Main results. TOPAS results largely agreed with the MIRD-based calculations in soft tissue regions: the average difference in mean dose to the liver was 0.14 Gy GBq -1 (2.6%). However, dose distributions in the lung differed considerably: absolute differences in mean doses to the lung ranged from 1.2 to 6.3 Gy GBq -1 and relative differences from 153% to 231%. We also found large differences in the intra-hepatic dose distributions between pre- and post-treatment imaging, but only limited differences in the pulmonary dose. Significance. Doses to lung were found to be higher using TOPAS with respect to analytical calculations which may significantly underestimate dose to the lung, suggesting the use of MC methods for 90Y dosimetry. According to our results, pre-treatment imaging may still be representative of dose to lung in these treatments.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2025

Mitigating imaging systematics for DESI 2024 emission Line Galaxies and beyond

Emission Line Galaxies (ELGs) are one of the main tracers that the Dark Energy Spectroscopic Instrument (DESI) uses to probe the universe. However, they are afflicted by strong spurious correlations between target density and observing conditions known as imaging systematics. In this paper, we present the imaging systematics mitigation applied to the DESI Data Release 1 (DR1) large-scale structure catalogs used in the DESI 2024 cosmological analyses. We also explore extensions of the fiducial treatment. This includes a combined approach, through forward image simulations (Obiwan) in conjunction with neural network-based regression, to obtain an angular selection function that mitigates the imaging systematics observed in the DESI DR1 ELGs target density. We further derive a line of sight selection function from the forward model that removes the strong redshift dependence between imaging systematics and low redshift ELGs. Combining both angular and redshift-dependent systematics, we construct a three-dimensional selection function and assess the impact of all selection functions on clustering statistics. We quantify differences between these extended treatments and the fiducial treatment in terms of the measured 2-point statistics. We find that the results are generally consistent with the fiducial treatment and conclude that the differences are far less than the imaging systematics uncertainty included in DESI 2024 full-shape measurements. We extend our investigation to the ELGs at 0.6 < z < 0.8, i.e., beyond the redshift range (0.8 < z < 1.6) adopted for the DESI clustering catalog, and demonstrate that determining the full three-dimensional selection function is necessary in this redshift range. Our tests showed that all changes are consistent with statistical noise for BAO analyses indicating they are robust to even severe imaging systematics. Specific tests for the full-shape analysis will be presented in a companion paper.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Automatic Detection and Classification of Radio Galaxy Images by Deep Learning

Abstract Surveys conducted by radio astronomy observatories, such as SKA, MeerKAT, Very Large Array, and ASKAP, have generated massive astronomical images containing radio galaxies (RGs). This generation of massive RG images has imposed strict requirements on the detection and classification of RGs and makes manual classification and detection increasingly difficult, even impossible. Rapid classification and detection of images of different types of RGs help astronomers make full use of the observed astronomical image data for further processing and analysis. The classification of FRI and FRII is relatively easy, and there are more studies and literature on them at present, but FR0 and FRI are similar, so it is difficult to distinguish them. It poses a greater challenge to image processing. At present, deep learning has made breakthrough progress in the field of image analysis and processing and has preliminary applications in astronomical data processing. Compared with classification algorithms that can only classify galaxies, object detection algorithms that can locate and classify RGs simultaneously are preferred. In target detection algorithms, YOLOv5 has outstanding advantages in the classification and positioning of small targets. Therefore, we propose a deep-learning method based on an improved YOLOv5 object detection model that makes full use of multisource data, combining FIRST radio with SDSS optical image data, and realizes the automatic detection of FR0, FRI, and FRII RGs. The innovation of our work is that on the basis of the original YOLOv5 object detection model, we introduce the SE Net attention mechanism, increase the number of preset anchors, adjust the network structure of the feature pyramid, and modify the network structure, thereby allowing our model to demonstrate galaxy classification and position detection effects. Our improved model produces satisfactory results, as evidenced by experiments. Overall, the mean average precision (mAP@0.5) of our improved model on the test set reaches 89.4%, which can determine the position (R.A. and decl.) and automatically detect and classify FR0s, FRIs, and FRIIs. Our work contributes to astronomy because it allows astronomers to locate FR0, FRI, and FRII galaxies in a relatively short time and can be further combined with other astronomically generated data to study the properties of these galaxies. The target detection model can also help astronomers find FR0s, FRIs, and FRIIs in future surveys and build a large-scale star RG catalog. Moreover, our work is also useful for the detection of other types of galaxies.

Astronomy & Astrophysics↗