Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Color segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

34 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Toward an AI-Powered Software Pipeline for Real-Time Tracking and Analysis of Wildfire and Smoke

Real-time tracking of wildfires and smoke is crucial for effective response, minimizing damage, protecting lives, and efficiently managing resources during fire emergencies. We develop a web-based AI-powered pipeline that detects wildfires in aerial video and estimates deployment-relevant behavior metrics, including cumulative burned area, burned-area growth rate, fire spread direction, and smoke dispersion. The system combines a YOLO-based detector with YCbCr-based fire segmentation, HSV-based smoke segmentation, Farneback optical flow, and centroid-based spatiotemporal tracking. Using ground sampling distance (GSD), pixel-level fire masks are converted to physical burned-area measurements by correlating fire pixel counts with camera altitude and tilt angle. We benchmark YOLO variants and non-YOLO baselines (GoogLeNet, CNN, DBN, Autoencoder, U-Net, and AlexNet) on the IEEE FLAME dataset and a newly created aerial frame dataset, Wildfire-DB. Cross-dataset evaluation uses a strict threshold-transfer protocol: decision thresholds are selected on FLAME validation and transferred unchanged to Wildfire-DB to quantify generalization under domain shift. YOLOv6 achieves the strongest cross-dataset frame-level fire detection on Wildfire-DB (ROC-AUC 0.8200, PR-AUC 0.8044, and transferred-threshold F1 0.7596). For tracking-oriented deployment requiring oriented localization, YOLO11-OBB provides the most reliable cross-dataset behavior among OBB-capable models while remaining computationally feasible. To analyze the feasibility of UAV deployment, we further measure inference efficiency using synchronized GPU and CPU power logs on a fixed workload of 1569 frames. YOLO-family models process the video in 5.73–12.47 seconds with net energy of 1247.28–1775.39 J, substantially lower latency and energy than heavier classification and reconstruction baselines. Overall, model optimality depends on operational objectives: YOLOv6 is best for cross-dataset detection robustness, whereas YOL...

Color segmentation↗
DOE OSTI2025

Reconfigurable structural color by reversible switching of colloidal discoid liquid crystal alignment

Combining the effects of alternating-current (AC) electric fields and sedimentation reconfigures colloidal discoids between planar and homeotropic orientational alignments, thereby controlling the material’s structural color. Here, we self-assemble micrometer-size polystyrene discoids in an isopropanol-water mixture. After sedimentation, the discoids adopt a homeotropic alignment, with the minor axis perpendicular to the substrate. Adding an AC electric field (1 kHz) of ≥0.50 V switches the discoids to planar alignment—with the minor axis parallel to the substrate—within ∼100 s. Removing the field switches them back to homeotropic alignment within ∼300 s. Kinetic modeling of the field-induced torques yields good agreement with these measurements. The peak wavelength and intensity of the crystal’s diffraction response shift significantly upon reconfiguration; scattering simulation predicts these shifts. The reconfiguration is maintained for at least 10 cycles. This method is a simple, scalable avenue to reconfigure the optical properties of colloidal crystals produced from simple dielectric spheroids.

colloidal crystals↗
DOE OSTI2026

A Chemist’s Guide to Solid-State Qubits: Diamond Color Centers as Embedded Vacancy-Centered Molecules

Diamond point defects or color centers are at the crux of solid-state quantum technology applications, from computing to sensing. Modeling molecular qubits has advanced by leaps and bounds mainly due to the advanced quantum mechanical (QM) tools in the arsenal of quantum chemists for modeling (isolated) molecular systems, which should be easily translatable for analogous systems in the solid state. Here, we simulate a series of diamond defects: a carbon vacancy (V C ) and second row substitutions that are adjacent to a V C or D C V C , with D = B, N, and O, to evaluate their magnetic and optical properties. We applied molecular orbital principles, an embedded cluster method, and a multiconfigurational QM theory to computationally characterize the above-mentioned defects for a multitude of spin, charge, and excited states. Our computational approach delivered high-quality QM insights that compare well with experiments. Furthermore, with this framework, we confirm the spin-triplets B C V C – and O C V C 0 to be analogous to N C V C – , with calculated bright transitions that respectively correspond to UV (3.80 eV) and blue (2.65 eV) light absorption and emission lifetimes (τ) of 2.3 and 5.6 ns, which are higher in energy and more short-lived (and thus brighter) than that for N C V C – : green (2.26 eV), τ = 9.5 ns.

Martirez, John Mark P. [Princeton Plasma Physics L↗
DOE OSTI2026

NanoPSD: A software for automatic detection of Nano-Particle Shape Distribution in electron microscopy images

Accurate quantification of the size and morphology of nanoparticles from electron microscopy (EM) images is essential to understand growth mechanisms, surface reactivity, and functional behavior in nanoscale materials. Manual analysis remains slow, subjective, and difficult to reproduce in large datasets. We introduce NanoPSD (Nano-Particle Shape Distribution), an open-source and fully automated framework for quantitative particle detection and morphology analysis from EM images. NanoPSD integrates adaptive contrast enhancement, polarity-agnostic scale-bar detection, Optical Character Recognition (OCR)-based calibration, and classical segmentation via Otsu thresholding with morphological refinement. Particle contours are used to extract geometric descriptors, including equivalent circular diameter, aspect ratio, circularity, and solidity, enabling automated classification into spherical, rod-like, and aggregate morphologies. The framework supports both single-image and batch processing, generating publication-quality visualizations, LaTeX-ready tables, and structured comma-separated values (CSV) datasets. As a demonstration, we applied NanoPSD to plasma-synthesized nanoparticle samples diagnosed via transmission electron microscopy (TEM). The code produced statistically robust size and morphology distributions spanning a few to tens of nanometers with minimal user supervision. The pipeline demonstrates high reproducibility and scalability, processing large image collections with consistent calibration and output formatting. Its modular design enables seamless integration of future deep-learning-based segmentation models, providing a pathway toward intelligent, data-driven electron microscopy analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Molecules to Masterpieces: Bridging Materials Science and the Arts

Art and materials innovation have always been intertwined, dating back to the earliest human creations. In modern times, however, the increasing specialization of materials science often restricts artists' access to cutting-edge materials. Here, the materials science aspects of an art-science collaboration between artist Kimsooja and the Wiesner Lab at Cornell University, are detailed. The project involves the development of a custom-made iridescent block copolymer coating by means of self-assembly, originally applied to transparent window panels of a façade for the ≈14 m tall art installation: A Needle Woman: Galaxy Is a Memory, Earth is a Souvenir by artist Kimsooja. After several exhibitions in the US and Europe, the installation is now part of the permanent museum collection at Yorkshire Sculpture Park in Wakefield, UK. Full characterization of the solution blade-cast coatings show shear aligned, standing up lamellar morphologies that behave as volume-phase gratings with periodicities between 300 and 400 nm. Coatings are also applied to foldable (origami) paper and converted into iridescent porous ceramic materials. Furthermore, it is hoped this work inspires and informs communities across materials science, the arts, and architecture.

Architectural nanomaterials↗
DOE OSTI2025

Monitoring Depolymerization in Mesopores Using Dynamic Properties of Polymeric Melt Accessed via Dielectric Spectroscopy

Traditional design principles for heterogeneous catalysis guide the use of catalytic particles with mesosized (∼2–50 nm) pores to increase the number of surface-active sites by way of an increased surface area. However, the entry of long-chain polymers into such pores may be significantly limited by the size and entanglement of polymers in the melt state, thereby decreasing the number of accessible sites. Assessment of catalyst performance from traditional reactor-based studies averages over intrapore reaction events as well as reactions on the surface of a particle, resulting in an inability to distinguish between differences in site accessibility and activity. Techniques that assess the intrapore performance can inform the design of future heterogeneous catalysts for polymer upcycling. In this work, we demonstrate the use of broadband dielectric spectroscopy to monitor depolymerization of a polymer melt within mesopores via changes in the segmental relaxation time scale of amorphous polymer chains. In particular, we highlight the use of an anodic aluminum oxide (AAO) membrane as a readily available model for catalyst pores with a well-characterized pore morphology. The decrease in the segmental relaxation (α-relaxation) time of the melt with increasing chain scission emerges as a measure of the extent of polymer deconstruction inside mesopores. To demonstrate the utility of this technique, we demonstrate the decomposition of two commercial poly(propylene carbonate) polymers with different decomposition rates within mesopores. As the polymers depolymerize, their segmental relaxation time decreases as the molecular weight decreases (as predicted by the Fox–Flory equation). The BDS-measured change in segmental relaxation time mirrors the expected trend based on change in molecular weight measured by size exclusion chromatography.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

U.S. ESCO Industry Report: Industry Size and Recent Market Trends, 2022- 2024

The latest edition of the U.S. Energy Service Company (ESCO) Industry Report by Lawrence Berkeley National Laboratory (LBNL) finds that the U.S. ESCO industry continues to show strong growth. The report draws from ESCO industry reported revenue data for the 2022-2024 period, detailing the current size and characteristics of the U.S. ESCO industry. Following 20 years of ESCO industry reports, the 2024 report explores significant revenue trends across market segments, geographic regions, ESCO size, financing structures, and business activities. New analysis in this report outlines customer priorities and non-energy benefit drivers of Energy Savings Performance Contract projects, adjusted revenue analysis detailing the impacts of inflation on industry growth, and project challenges by market segment.

Chelminski, Kathryn↗
DOE OSTI2025

Revealing the evolution of order in materials microstructures using multi-modal computer vision

The development of high-performance materials for microelectronics, energy storage, and extreme environments depends on our ability to describe and direct property-defining microstructural order. Our present understanding is typically derived from laborious manual analysis of imaging and spectroscopy data, which is difficult to scale, challenging to reproduce, and lacks the ability to reveal latent associations needed for mechanistic models. Here, we demonstrate a multi-modal machine learning (ML) approach to describe order from electron microscopy analysis of the complex oxide La 1−x Sr x FeO 3 . We construct a hybrid pipeline based on fully and semi-supervised classification, allowing us to evaluate both the characteristics of each data modality and the value each modality adds to the ensemble. We observe distinct differences in the performance of uni- and multi-modal models, from which we draw general lessons in describing crystal order using computer vision.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Dielectric Spectroscopy Cable NDE for Unequal Aging Over Different Lengths

This Pacific Northwest National Laboratory milestone report assesses the effect of unequal aging over different lengths of cable on dielectric spectroscopy (DS) bulk impedance measurements from the cable end. DS measurements can indicate the remaining useful life of cables; however, most benchmark tests are based on accelerated aging of the entire cable. If only a portion of the cable is exposed to a harsh environment (as is frequently the case), the DS measurement will indicate a significantly less-aged cable than if the entire cable were exposed to a uniform environmental stress. The DS measurement is primarily related to the intrinsic insulation material relative permittivity—typically between 1.5 and 3.0. Insulation aging increases permittivity and, correspondingly, the cable’s overall capacitance measured from the cable end. To judge the health of the overall cable system, operators are primarily interested in the condition of the most severely aged section since that is where a failure is most likely to occur. This can be expressed as the dimensionless relative permittivity of the severely aged section divided by the permittivity of a pristine cable. This relative permittivity is an intrinsic material parameter independent of cable length and can serve as a quantitative indication of the insulation condition. If the relative percentages of cable exposed to a harsh and benign environment are known, the DS measurement of the entire cable length, including both pristine and aged sections, can be compensated to predict the relative permittivity (relative to pristine permittivity) of the most severly aged segment. A test was performed on three 50 ft (16 m) cables with 10%, 50%, and 90% of the cable inside a thermal aging oven. Predictably, the aging effect on the DS response was greatest in the 90% sample, followed by the 50% sample, and then the 10% sample. The more interesting result is the ratio of the aged insulation permittivity to the pristine insulation permittivity. Based on prior work, an end-of-life cable has a value of approximately 1.35. If the relative percentages of pristine and severely aged cable lengths are known, and the total cable-length capacitance of the initial pristine cable and the combined pristine plus aged cable are known, the relative aged permittivity (ratio of aged section permittivity / pristine section permittivity) can be estimated. The relative cable lengths exposed to a harsh environment may be known or estimated based on plant layout drawings or cable reflectometry tests that can locate the oven entry and exit points. The compensation was verified using a lumped-parameter model to predict the aged-segment permittivity e2/e1, where e2 is the aged-segment permittivity and e1 is the pristine-segment permittivity. For all three percentages of aged cable lengths, the ratio was quite similar, as would be expected since all cable segments were exposed to the same aging environment. This ratio of aged permittivity to pristine permittivity can be compared to other damage indicating tests, including elongation at break, to assess cable condition.

ARENA Test Bed↗
DOE OSTI2021

AI-Batt (Autonomous Identification of Battery Life Models) [SWR 21-36]

Autonomous Identification of Battery Life Models (AI-Batt) AI-Batt is a MATLAB code base for developing lifetime models for batteries from accelerated aging data. The code base provides many functions for processing, visualizing, and modeling battery aging data, making the data processing, exploration, and modeling workflow substantially faster. These tools are tailored for working with battery aging data sets, which usually consist of many separate time-series for each cell, with many test conditions and possible replicates at each condition, which makes it difficult to simply process or visualize the data set. Complex modeling tasks, such as cross-validation, sensitivity analysis, and uncertainty quantification have been implemented to enable thorough statistical investigation of model predictions. Additionally, several machine-learning algorithms are implemented to autonomously identify suitable models via symbolic regression. Data processing functions automatically cast data from the struct data type, which is commonly used to store experimental data, but is not an acceptable input for most algorithms, to the table data type, which can be easily used as input to any optimization algorithm. Also, the data can be separated into time-invariant and time-variant data tables, which is helpful for exploring the data set as well as developing separate models for time-variant and time-invariant aging mechanisms. For example, in aging tests with constant temperature, temperature is a time-invariant experimental condition. Visualization tools enable plotting of data, model fits, and model simulations possible with single-line function calls, empowering data exploration of complex data sets with both time-varying and time-invariant trends. Plots can be automatically generated for the whole data set, or separated by data group (groups of test replicates) or individual data series. Data points or data series can be automatically colored by the value of a variable with a variety of color maps, and model predictions can also be colored by the value of a fit statistic. Comparisons between data sets and the predictions/simulations of different models on the same data set can be easily plotted as well. Distributions of parameter values from bootstrap resampling can be plotted to visualize the reliability of parameter estimation, or determine any correlations between parameters. Modeling tools handle the complex task of creating and parsing symbolic equations for modeling battery lifetime. Equations are parsed to grab relevant data variables, parameter values, or specified sub-models for input into optimization, evaluation, or simulation functions. Models can be optimized locally (one set of parameters for each data series), bi-level (some parameters shared across the data set), or globally (single set of parameters for all data). Functions implementing symbolic regression algorithms help users to discover effective model equations, even in poorly sampled, high-dimensional data.

Smith, Kandler [National Renewable Energy Lab. (NR↗
DOE OSTI2024

Stellar Population Properties in the Stellar Streams around SPRC047

Abstract We have investigated the properties (e.g., age, metallicity) of the stellar populations of a ringlike tidal stellar stream (or streams) around the edge-on galaxy SPRC047 (z= 0.031) using spectral energy distribution (SED) fits to integrated broadband aperture flux densities. We used visual images in six different bands and Spitzer/IRAC 3.6μm data. We have attempted to derive best-fit stellar population parameters (metallicity, age) in three noncontiguous segments of the stream. Due to the very low surface brightness of the stream, we have performed a deconvolution with a Richardson–Lucy–type algorithm of the low spatial resolution 3.6μm IRAC image, thereby reducing the effect of the point-spread function aliasedemissionfrom the bright edge-on central galaxy at the locations of our three stream segments. Our SED fits that used several different star formation (SF) history priors, from an exponentially decaying SF burst to continuous SF, indicate that the age–metallicity–dust degeneracy is not resolved, most likely because of inadequate wavelength coverage and low signal-to-noise ratios of the low surface brightness features. We also discuss how future deep visual–near-infrared observations, combined with absolute flux calibration uncertainties at or below the 1% level, complemented by equally well absolute flux-calibrated observations in ultraviolet and mid-infrared bands, would improve the accuracy of broadband SED fitting results for low surface brightness targets, such as stellar streams around nearby galaxies that are not resolved into stars.

Astronomy & Astrophysics↗
DOE OSTI2026

Entropy-defect synergy for dual luminescence mechanism in spinel: Time-resolved anti-counterfeiting and fingerprint visualization

Multimodal luminescent materials, while promising for anti-counterfeiting, often lack dynamic time-dependent responses and controllable spatial distribution, limiting their encryption capabilities in the spatiotemporal dimension. Here, this work presents a coordinated control strategy based on entropy and defect engineering, and uses a backpropagation (BP) neural network for material screening to successfully prepare spinel Mg 0.8 (Fe 0.04 Co 0.04 Ni 0.04 Cu 0.04 Zn 0.04 )Cr 2 O 4 (MgA 5 CO) phosphors with time-dependent dynamic luminescence behavior. This phosphor simultaneously activated the d-d transition luminescence (∼618 nm) derived from Co 2+ /Cr 3+ and the defect luminescence (∼398 nm) related to zinc vacancies (V Zn ) in a single-phase solid solution. The phosphor exhibits a time-dependent color evolution from pink to purple under fixed-wavelength excitation, due to the different excited-state dynamics and decay lifetimes associated with the d-d transition and defect luminescence. Structural characterization and spectral analysis confirmed the existence of V Zn and its significant role in defect luminescence process. The fluorescent and dynamic luminescent properties of entropy-based spinel oxide enable its use in advanced anti-counterfeiting applications like fingerprint recognition and color-changing dedicated anti-counterfeiting mark, showing promise in high-end and time-dynamic anti-counterfeiting fields. This research not only developed a new type of fluorescent dynamic anti-counterfeiting material, but also provided a new idea for constructing advanced optical functional materials with multiple luminescence mechanisms.

Defect project↗
DOE OSTI2026

Maintenance strategy, structural design, and site layout of the ST-E1 fusion power plant

An effective fusion reactor maintenance scheme enables safe operations and short downtimes. This in turn leads to high availability, which is critical to the commercial viability of a power-producing plant. In tokamak-based fusion power plants, the chosen maintenance approach has a significant impact on the spatial design of the tokamak, as well as the surrounding infrastructure, and therefore needs to be considered from the outset. Tokamak Energy has developed a pre-concept design of a fusion power plant, ST-E1. This work describes the major drivers and constraints that have been considered, presents the tokamak architecture and chosen maintenance regime, and discusses how this enables the plant’s two-phased approach to demonstrating commercial operations. It also shows the implications for the design of other systems areas, in particular the machine structural arrangement and bioshield and hot cell layout. The reactor core segmentation and removal scheme replaces entire toroidal segments radially through a large vacuum port, along a single axis only. The result is a change-tolerant machine and plant layout that can accommodate the evolving designs of the tokamak.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Assembly and Testing of Scintillator Tile Modules for the CMS High-Granularity Calorimeter Upgrade

The High-Granularity Calorimeter (HGCAL), part of the upgrade to the Compact Muon Solenoid (CMS) experiment, employs silicon and scintillator tile modules in the endcaps to maintain detector performance during the High-Luminosity Large Hadron Collider (HL-LHC) era, scheduled to operate from 2030 to 2040. The upgraded calorimeter will provide highly segmented three-dimensional imaging, energy measurements, and precise timing for particle shower reconstruction. Approximately half of the HGCal plastic scintillator tile modules (1,834 total) will be assembled at Fermilab using an automated pick-and-place (PnP) machine. Following assembly, each tile module undergoes quality control (QC) procedures such as electrical validation, thermal testing, and physics validation using cosmic rays. This poster/talk presents the QC procedures and results from the tile module production in 2026, demonstrating the performance and quality of the assembled tile modules.

Bazimya, Jean Luc [Grambling State U.]↗
DOE OSTI2026

Deep Learning and Photogrammetric Reconstruction for Automated Crack Detection and Dimensional Measurement in Mining Operations

Surface crack detection and dimensional measurement at active mining sites present significant safety and operational challenges. Manual inspection methods are labor-intensive, spatially incomplete, and expose personnel to hazardous environments, while existing automated approaches have been developed primarily for concrete civil infrastructure and have not been validated on the complex, variable surfaces characteristic of mining environments. This dissertation presents an automated pipeline that integrates deep learning semantic segmentation with Structure-from-Motion photogrammetry to detect surface cracks and measure their aperture, length, and vertical displacement from standard RGB imagery acquired during routine Uncrewed Aerial Vehicle (UAV) survey operations, without requiring additional sensor hardware or manual measurement. The pipeline combines a U-Net architecture with an EfficientNet-B0 encoder, pretrained on the SDNET2018 concrete crack dataset and fine-tuned on a mining-specific dataset spanning laboratory concrete specimens, coal refuse impoundment embankments, and post-blast limestone quarry benches. Photogrammetric reconstruction is performed using COLMAP Structure-from-Motion and Multi-View Stereo, with crack segmentation masks projected into the reconstructed point cloud to enable three-dimensional vertical displacement measurement through local plane fitting and bimodal surface detection. The pipeline was validated across 36 controlled laboratory specimens at three imaging distances and four vertical displacement levels, achieving aperture measurement RMSE of 0.047 cm and R² of 0.954, and vertical displacement RMSE of 0.140 cm and R² of 0.966, against independent caliper measurements. Field application at a coal refuse impoundment in southwestern Pennsylvania detected 71 crack components across the embankment crest, with a dominant longitudinal crack exhibiting aperture values reaching 28 cm and a 95th percentile vertical displacement of 35.53 cm, consistent in magnitude and spatial distribution with simultaneously acquired LiDAR-derived estimates. Application across four post-blast limestone quarry bench datasets in California successfully characterized blast-induced fracture networks at ground sampling distances ranging from 0.59 to 1.23 cm/pixel, with detected crack geometries physically consistent with observable surface conditions at each site. The results demonstrate that deep learning-based crack detection and photogrammetric measurement can be integrated into routine UAV inspection workflows at mining sites, providing repeatable, scalable, and quantitative crack characterization across surface types, crack scales, and displacement magnitudes not previously addressed in the literature. The pipeline requires no dedicated surveying equipment beyond the UAV platforms already deployed at mine sites for survey and monitoring purposes, supporting practical adoption within existing operational workflows.

Crack detection, Dimensional Measurement↗
DOE OSTI2026

String-Breaking Dynamics in Quantum Adiabatic and Diabatic Processes

Confinement prohibits isolation of color charges, e.g., quarks, in nature via a process called string breaking : the separation of two charges results in an increase in the energy of a color flux, visualized as a string, connecting those charges. Eventually, creating additional charges is energetically favored, hence breaking the string. Such a phenomenon can be probed in simpler models, including quantum spin chains, enabling enhanced understanding of string-breaking dynamics. A challenging task is to understand how string breaking occurs as time elapses, in an out-of-equilibrium setting. This work establishes the phenomenology of dynamical string breaking induced by a gradual increase of string tension over time. It, thus, goes beyond instantaneous quench processes and enables tracking the real-time evolution of strings in a more controlled setting. We focus on domain-wall confinement in a family of quantum Ising chains. Our results indicate that, for sufficiently short strings and slow evolution, string breaking can be described by the transition dynamics of a two-state quantum system akin to a Landau-Zener process. For longer strings, a more intricate spatiotemporal pattern emerges: the string breaks by forming a superposition of bubbles (domains of flipped spins of varying sizes), which involve highly excited states. We finally demonstrate that string breaking driven only by quantum fluctuations can be realized in the presence of sufficiently long-ranged interactions. This work holds immediate relevance for studying string breaking in quantum-simulation experiments.

Ising model↗
DOE OSTI2023

RadioGalaxyNET: Dataset and novel computer vision algorithms for the detection of extended radio galaxies and infrared hosts

Abstract Creating radio galaxy catalogues from next-generation deep surveys requires automated identification of associated components of extended sources and their corresponding infrared hosts. In this paper, we introduce RadioGalaxyNET, a multimodal dataset, and a suite of novel computer vision algorithms designed to automate the detection and localization of multi-component extended radio galaxies and their corresponding infrared hosts. The dataset comprises 4 155 instances of galaxies in 2 800 images with both radio and infrared channels. Each instance provides information about the extended radio galaxy class, its corresponding bounding box encompassing all components, the pixel-level segmentation mask, and the keypoint position of its corresponding infrared host galaxy. RadioGalaxyNET is the first dataset to include images from the highly sensitive Australian Square Kilometre Array Pathfinder (ASKAP) radio telescope, corresponding infrared images, and instance-level annotations for galaxy detection. We benchmark several object detection algorithms on the dataset and propose a novel multimodal approach to simultaneously detect radio galaxies and the positions of infrared hosts.

Astronomy & Astrophysics↗