Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Photometric redshifts from SDSS images with an interpretable deep capsule network

ABSTRACT Studies of cosmology, galaxy evolution, and astronomical transients with current and next-generation wide-field imaging surveys like the Rubin Observatory Legacy Survey of Space and Time are all critically dependent on estimates of photometric redshifts. Capsule networks are a new type of neural network architecture that is better suited for identifying morphological features of the input images than traditional convolutional neural networks. We use a deep capsule network trained on ugriz images, spectroscopic redshifts, and Galaxy Zoo spiral/elliptical classifications of ∼400 000 Sloan Digital Sky Survey galaxies to do photometric redshift estimation. We achieve a photometric redshift prediction accuracy and a fraction of catastrophic outliers that are comparable to or better than current methods for SDSS main galaxy sample-like data sets (r ≤ 17.8 and zspec ≤ 0.4) while requiring less data and fewer trainable parameters. Furthermore, the decision-making of our capsule network is much more easily interpretable as capsules act as a low-dimensional encoding of the image. When the capsules are projected on a two-dimensional manifold, they form a single redshift sequence with the fraction of spirals in a region exhibiting a gradient roughly perpendicular to the redshift sequence. We perturb encodings of real galaxy images in this low-dimensional space to create synthetic galaxy images that demonstrate the image properties (e.g. size, orientation, and surface brightness) encoded by each dimension. We also measure correlations between galaxy properties (e.g. magnitudes, colours, and stellar mass) and each capsule dimension. We publicly release our code, estimated redshifts, and additional catalogues at https://biprateep.github.io/encapZulate-1.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Gaussian Process Classification for Galaxy Blend Identification in LSST

Abstract A significant fraction of observed galaxies in the Rubin Observatory Legacy Survey of Space and Time (LSST) will overlap at least one other galaxy along the same line of sight, in a so-called “blend.” The current standard method of assessing blend likelihood in LSST images relies on counting up the number of intensity peaks in the smoothed image of a blend candidate, but the reliability of this procedure has not yet been comprehensively studied. Here we construct a realistic distribution of blended and unblended galaxies through high-fidelity simulations of LSST-like images, and from this we examine the blend classification accuracy of the standard peak-finding method. Furthermore, we develop a novel Gaussian process blend classifier model, and show that this classifier is competitive with both the peak finding method as well as with a convolutional neural network model. Finally, whereas the peak-finding method does not naturally assign probabilities to its classification estimates, the Gaussian process model does, and we show that the Gaussian process classification probabilities are generally reliable.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Image processing pipeline for AI-driven nanoparticle megalibrary characterization

Recent innovations have made it possible to produce megalibraries, millions of structurally and compositionally distinct nanoparticles on a chip. These megalibraries yield vast volumes of data that are impossible to analyze manually, necessitating the development of automated tools. In previous work, we created a binary classification machine learning model to select quality nanoparticle images for downstream analysis. In this work, we show that adding a custom image processing step before training can produce significantly higher-performing models in a fraction of the time and make them more robust to different image noise levels and microscope acquisition settings. The image processing pipeline proposed here effectively cleans raw nanoparticle images, enhances key features, and allows us to use much lower resolution images and simpler neural network model architectures. These features result in higher performance and significant cost savings. Experiments demonstrate superior performance relative to baseline, including an 18.2% improvement in recall and a 13.1% increase in accuracy. Given the high cost of downstream analysis, it is critical to minimize false positives, and our best-performing model reaches a precision of 95.9% and a weighted F-score of 95.1% on an unseen test set. Additionally, model training time is reduced from hours to less than a minute. We also show that, using this custom image processing pipeline, model performance is significantly improved at lower pixel resolutions compared to downsizing alone. We expect that adopting this pipeline for AI-driven automated nanoparticle characterization will allow researchers to rapidly and accurately analyze much greater volumes of data, thereby accelerating materials discovery.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2025

An AI-Based 3D Bat Movement Tracking System at Wind Energy Facilities Using Multi-Thermal Video Cameras

The poster at the 15th Wind Wildlife Research Meeting discusses how to leverage the potential of real-time thermal-imaging methodologies in quantifying nocturnal bat activities at wind turbines, using 3D computer vision techniques within a deep learning framework. This innovation enables the automatic detection and classification of bats, birds, and insects in thermal-imaging videos captured at wind turbine sites, facilitating efficient and accurate data analysis for enhanced understanding and mitigation of bat-wind turbine interactions.

AI↗
DOE OSTI2025

An AI-Based 3D Bat Movement Tracking System at Wind Energy Facilities Using Multi-Thermal Video Cameras

The talk at the NAWEA Wind Tech 2024 conference discusses how to leverage the potential of real-time thermal-imaging methodologies in quantifying nocturnal bat activities at wind turbines, using 3D computer vision techniques within a deep learning framework. This innovation enables the automatic detection and classification of bats, birds, and insects in thermal-imaging videos captured at wind turbine sites, facilitating efficient and accurate data analysis for enhanced understanding and mitigation of bat-wind turbine interactions.

AI↗
DOE OSTI2020

Artificial illumination identification from an unmanned aerial vehicle

Artificial illumination identification within images is a useful tool for many applications. Performing such identification allows for an estimation of the illumination source spectrum, which in turn can be used for additional applications ranging from spectral detection and exploitation to statistics about nighttime light usage. Illumination identification has been performed in laboratory settings but not from an unmanned aerial vehicle (UAV) platform. Here, we test the feasibility of using a UAV and commercial off-the-shelf multispectral imaging sensor to perform such artificial illumination identification through linear discriminant analysis using nighttime UAV images. The results are very promising, showing source classification accuracies of 83.3%, 92.3%, 100%, and 100% for the incandescent, light-emitting diode, high pressure sodium, and metal halide illumination sources, respectively. We show that the information gained from the source identification can be further used to inform additional analysis, such as spectral identification. The high resolution of UAV imaging techniques combined with the knowledge of the illumination source can lead to better exploitation of such nighttime data for many applications.

42 ENGINEERING↗
DOE OSTI2024

Hydra: Computer Vision for Online Data Quality Monitoring

Hydra is a system utilizing computer vision for near real-time data quality monitoring. Currently operational across all of Jefferson Lab’s experimental halls, it reduces the workload of shift takers by autonomously monitoring diagnostic plots during experiments. Hydra uses "off-the-shelf" supervised learning technologies and is supported by a comprehensive MySQL database. To simplify access, web apps have been developed to facilitate both labeling and monitoring of Hydra’s inferences. Hydra can connect with the alarm system and incorporates complete historical tracking, enabling it to identify issues that shift takers could miss. When issues are detected, a natural first question is: "Why does Hydra think there is a problem?" To answer, Hydra employs Gradient-weighted Class Activation Maps (GradCAM) to identify regions of the image that are important for the specific classification. This interpretive layer enhances transparency and trustworthiness, which is essential for integration with experiment workflows and operation. The Hydra system, results, and sociological considerations for deployment will be discussed.

Jeske, Torri↗
DOE OSTI2022

The merger fraction of post-starburst galaxies in UNIONS

ABSTRACT Post-starburst galaxies (PSBs) are defined as having experienced a recent burst of star formation, followed by a prompt truncation in further activity. Identifying the mechanism(s) causing a galaxy to experience a post-starburst phase therefore provides integral insight into the causes of rapid quenching. Galaxy mergers have long been proposed as a possible post-starburst trigger. Effectively testing this hypothesis requires a large spectroscopic galaxy survey to identify the rare PSBs as well as high-quality imaging and robust morphology metrics to identify mergers. We bring together these critical elements by selecting PSBs from the overlap of the Sloan Digital Sky Survey and the Canada–France Imaging Survey and applying a suite of classification methods: non-parametric morphology metrics such as asymmetry and Gini-M20, a convolutional neural network trained to identify post-merger galaxies, and visual classification. This work is therefore the largest and most comprehensive assessment of the merger fraction of PSBs to date. We find that the merger fraction of PSBs ranges from 19 per cent to 42 per cent depending on the merger identification method and details of the PSB sample selection. These merger fractions represent an excess of 3–46× relative to non-PSB control samples. Our results demonstrate that mergers play a significant role in generating PSBs, but that other mechanisms are also required. However, applying our merger identification metrics to known post-mergers in the IllustrisTNG simulation shows that 70 per cent of recent post-mergers (≲200 Myr) would not be detected. Thus, we cannot exclude the possibility that nearly all PSBs have undergone a merger in their recent past.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Type Ia supernovae in the star formation deserts of spiral host galaxies

ABSTRACT Using a sample of nearby spiral galaxies hosting 185 supernovae (SNe) Ia, we perform a comparative analysis of the locations and light-curve decline rates (Δm15) of normal and peculiar SNe Ia in the star formation deserts (SFDs) and beyond. To accomplish this, we present a simple visual classification approach based on the UV/H α images of the discs of host galaxies. We demonstrate that, from the perspective of the dynamical time-scale of the SFD, where the star formation is suppressed by the bar evolution, the Δm15 of SN Ia and progenitor age can be related. The SFD phenomenon gives an excellent possibility to separate a subpopulation of SN Ia progenitors with ages older than a few Gyr. We show, for the first time, that the SFDs contain mostly faster declining SNe Ia (Δm15 > 1.25). For the galaxies without SFDs, the region within the bar radius, and outer disc contain mostly slower declining SNe Ia. To better constrain the delay times of SNe Ia, we encourage new studies (e.g. integral field observations) using the SFD phenomenon on larger and more robust datasets of SNe Ia and their host galaxies.

Hakobyan, A. A. (ORCID:0000000173921765)↗
DOE OSTI2022

Soil viruses: Understudied agents of soil ecology

Over the past couple decades there has been intense exploration of the soil microbiome using modern sequencing and bioinformatics approaches. These studies have revealed a vast diversity of microorganisms across a variety of habitats (Thompson et al., 2017) and how differences in the environment, for example with climate change, influence the soil microbial community composition (Jansson and Hofmockel, 2020). The focus of these studies has primarily been on microbial cellular organisms, including bacteria, archaea and fungi. By contrast, in depth study of soil viruses has been largely neglected, until recently. There are several reasons that soil viruses are less studied, including difficulties with extraction of viruses from soil particles, difficulties with classification of soil viruses based on microscopic imaging, and reliance on the small proportion of microbial hosts that can be cultivated. Now that comprehensive soil metagenomes are available the current trend has been to survey the metagenomes for viral sequences. This approach has revealed that soil viruses are incredibly abundant, highly diverse, and largely uncharacterized (Paez-Espino et al., 2016). This so-called ‘viral dark matter’ presents an incredible research opportunity for the future. Here I will highlight some of these potential research avenues based on what is known to date.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

DeepAdversaries: examining the robustness of deep learning models for galaxy morphology classification

With increased adoption of supervised deep learning methods for work with cosmological survey data, the assessment of data perturbation effects (that can naturally occur in the data processing and analysis pipelines) and the development of methods that increase model robustness are increasingly important. In the context of morphological classification of galaxies, we study the effects of perturbations in imaging data. In particular, we examine the consequences of using neural networks when training on baseline data and testing on perturbed data. We consider perturbations associated with two primary sources: (a) increased observational noise as represented by higher levels of Poisson noise and (b) data processing noise incurred by steps such as image compression or telescope errors as represented by one-pixel adversarial attacks. We also test the efficacy of domain adaptation techniques in mitigating the perturbation-driven errors. We use classification accuracy, latent space visualizations, and latent space distance to assess model robustness in the face of these perturbations. For deep learning models without domain adaptation, we find that processing pixel-level errors easily flip the classification into an incorrect class and that higher observational noise makes the model trained on low-noise data unable to classify galaxy morphologies. On the other hand, we show that training with domain adaptation improves model robustness and mitigates the effects of these perturbations, improving the classification accuracy up to 23% on data with higher observational noise. Domain adaptation also increases up to a factor of ${\approx}2.3$ the latent space distance between the baseline and the incorrectly classified one-pixel perturbed image, making the model more robust to inadvertent perturbations. Successful development and implementation of methods that increase model robustness in astronomical survey pipelines will help pave the way for many more uses of deep learning for astronomy.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Epidural anesthesia needle guidance by forward-view endoscopic optical coherence tomography and deep learning

Epidural anesthesia requires injection of anesthetic into the epidural space in the spine. Accurate placement of the epidural needle is a major challenge. To address this, we developed a forward-view endoscopic optical coherence tomography (OCT) system for real-time imaging of the tissue in front of the needle tip during the puncture. We tested this OCT system in porcine backbones and developed a set of deep learning models to automatically process the imaging data for needle localization. A series of binary classification models were developed to recognize the five layers of the backbone, including fat, interspinous ligament, ligamentum flavum, epidural space, and spinal cord. The classification models provided an average classification accuracy of 96.65%. During puncture, it is important to maintain a safe distance between the needle tip and the dura mater. Regression models were developed to estimate that distance based on the OCT imaging data. Based on the Inception architecture, our models achieved a mean absolute percentage error of 3.05% ± 0.55%. Overall, our results validated the technical feasibility of using this novel imaging strategy to automatically recognize different tissue structures and measure the distances ahead of the needle tip during the epidural needle placement.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Let’s Unleash the Network Judgment: A Self-Supervised Approach for Cloud Image Analysis

Accurate cloud type identification and coverage analysis are crucial in understanding the Earth’s radiative budget. Traditional computer vision methods rely on low-level visual features of clouds for estimating cloud coverage or sky conditions. Several handcrafted approaches have been proposed; however, scope for improvement still exists. Newer deep neural networks (DNNs) have demonstrated superior performance for cloud segmentation and categorization. These methods, however, need expert engineering intervention in the preprocessing steps—in the traditional methods—or human assistance in assigning cloud or clear sky labels to a pixel for training DNNs. Such human mediation imposes considerable time and labor costs. We present the application of a new self-supervised learning approach to autonomously extract relevant features from sky images captured by ground-based cameras, for the classification and segmentation of clouds. We evaluate a joint embedding architecture that uses self-knowledge distillation plus regularization. We use two datasets to demonstrate the network’s ability to classify and segment sky images—one with ~85,000 images collected from our ground-based camera and another with 400 labeled images from the WSISEG database. We find that this approach can discriminate full-sky images based on cloud coverage, diurnal variation, and cloud base height. Additionally, it semantically segments the cloud areas without labels. The approach shows competitive performance in all tested tasks, suggesting a new alternative for cloud characterization.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Convolutional neural network identification of galaxy post-mergers in UNIONS using IllustrisTNG

ABSTRACT The Canada–France Imaging Survey (CFIS) will consist of deep, high-resolution r-band imaging over ∼5000 deg2 of the sky, representing a first-rate opportunity to identify recently merged galaxies. Because of the large number of galaxies in CFIS, we investigate the use of a convolutional neural network (CNN) for automated merger classification. Training samples of post-merger and isolated galaxy images are generated from the IllustrisTNG simulation processed with the observational realism code RealSim. The CNN’s overall classification accuracy is 88 per cent, remaining stable over a wide range of intrinsic and environmental parameters. We generate a mock galaxy survey from IllustrisTNG in order to explore the expected purity of post-merger samples identified by the CNN. Despite the CNN’s good performance in training, the intrinsic rarity of post-mergers leads to a sample that is only ∼6 per cent pure when the default decision threshold is used. We investigate trade-offs in purity and completeness with a variable decision threshold and find that we recover the statistical distribution of merger-induced star formation rate enhancements. Finally, the performance of the CNN is compared with both traditional automated methods and human classifiers. The CNN is shown to outperform Gini–M20 and asymmetry methods by an order of magnitude in post-merger sample purity on the mock survey data. Although the CNN outperforms the human classifiers on sample completeness, the purity of the post-merger sample identified by humans is frequently higher, indicating that a hybrid approach to classifications may be an effective solution to merger classifications in large surveys.

Bickley, Robert W.↗
DOE OSTI2025

Classification of Cloud Particle Imagery and Thermodynamics (COCPIT): A New Databasing Tool for the Characterization of Cloud Particle Images Captured During DOE Field Campaigns

The Department of Energy for decades has explored the earth system and atmosphere through research and deployment of in-situ and remote sensing platforms during field campaigns. Among these datasets exists a vast supply of cloud particle images that provide visual insight into the complex microphysics in the clouds that span our globe. The millions of images collected over decades of deployments provides a unique opportunity to further our understanding of our atmosphere down to the crystal size. This work over the past 5 years has sought to organize these images into digestible datasets that can then be used by scientists to further our understanding of microphysics. A machine learning model was developed that categorizes over 1.5 million images across 11 weather events with over 90% accuracy according to particle type. The database was then extended to include dimensional characteristics of the particle as well as co-location of environmental properties, such as temperature and water content. Then, to initialize the connection between these data and our understanding of how crystals form and grow, weather research and forecasting simulations were run to generate the growth histories of the classified crystals. This research culminates with 2 databases per event: (1) a database of all classified crystals and their dimensional and environmental properties and (2) simulated growth histories of each crystal. Finally, a user interface was created to allow researchers to explore data statistics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Panel-Segmentation: A Python Package for Automated Solar Array Metadata Extraction Using Satellite Imagery

The NREL Python Panel-Segmentation package is a toolkit that automates the process of extracting accurate and valuable metadata related to solar array installations, using publicly available Google Maps satellite imagery. Previously published work includes automated azimuth estimation for individual solar installations in satellite images. Our continued research focuses on automated detection and classification of solar installation mounting configuration (tracking or fixed-tilt; rooftop, ground, or carport). Specifically, a Faster-RCNN Resnet-50 feature pyramid network (FPN) model was trained and validated on 862 manually labeled satellite images. This model was used to perform object detection on satellite imagery, locating and classifying individual solar installations' mounting configuration and type. Model results showed a mean average precision score (mAP) of 77.79%, with the model strongest at detecting fixed-tilt ground mount and fixed-tilt carport installations. The object detection model and its outputs have been incorporated into the Panel-Segmentation package's automated metadata extraction pipeline, which returns the mounting configuration and azimuth for individual solar arrays in satellite imagery. The complete image data set with labels has been released on the U.S. Department of Energy (DOE) DuraMAT DataHub, to encourage further research in this area.

deep learning↗
DOE OSTI2023

Galaxy Cruise: Deep Insights into Interacting Galaxies in the Local Universe

Abstract We present the first results from GALAXY CRUISE, a community (or citizen) science project based on data from the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). The current paradigm of galaxy evolution suggests that galaxies grow hierarchically via mergers, but our observational understanding of the role of mergers is still limited. The data from HSC-SSP are ideally suited to improve our understanding with improved identifications of interacting galaxies thanks to the superb depth and image quality of HSC-SSP. We launched a community science project, GALAXY CRUISE, in 2019 and have collected over two million independent classifications of 20686 galaxies at z < 0.2. We first characterize the accuracy of the participants’ classifications and demonstrate that it surpasses previous studies based on shallower imaging data. We then investigate various aspects of interacting galaxies in detail. We show that there is a clear sign of enhanced activities of super-massive black holes and star formation in interacting galaxies compared to those in isolated galaxies. The enhancement seems particularly strong for galaxies undergoing violent mergers. We also show that the mass growth rate inferred from our results is roughly consistent with the observed evolution of the stellar mass function. The second season of GALAXY CRUISE is currently underway and we conclude with future prospects. We make the morphological classification catalog used in this paper publicly available at the GALAXY CRUISE website, which will be particularly useful for machine-learning applications.

Tanaka, Masayuki↗
DOE OSTI2025

Potential of deep learning methods to enhance satellite-based monitoring of nuclear power plants focusing on remote operation evaluations

The anticipated expansion of the nuclear industry and the deployment of new nuclear reactors (200 + GW of new nuclear capacity by 2050) require the development of monitoring systems that align with safety and security concerns, providing enhanced evaluation capabilities. A remote monitoring system using satellites and deep learning techniques was evaluated for its ability to detect anomalies and capture various features of nuclear reactors independently of the conditions on the ground. Satellite images of current operational and under-construction nuclear power plants were collected from Google Earth Pro as a surrogate database. Subsequently, five datasets were created from the collected images. Transfer learning technique was used for several classification tasks utilizing VGG16, ResNet50V2, Xception, DenseNet121, and MobileNetV2 pre-trained models. In the first task, the capability of the monitoring system to detect abnormal conditions or processes in a nuclear power plant was investigated. In the second task, the ability to capture operational features remotely was examined. As an example, for the purposes of this study, these features included classifying reactors based on type, power range, or onsite condition. Several evaluation metrics were used to compare the performance of the pre-trained models and the overall monitoring system. Here, the evaluation results demonstrated that deep learning techniques and pre-trained models applied to satellite images have the potential to facilitate further and expand capabilities in monitoring systems to assess plant operation details.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗