Optimization of Plane Fits to Image Segments in Multi-View Stereo
Abstract not provided
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “image segmentation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Use of ML in Image-Based Simulation: CNNs for 3D Image Segmentation and Uncertainty Quantification.
Abstract not provided.
Roberts, Scott Alan↗
Reconstruction of 3D Concrete Microstructures Combining High-Resolution Characterization and Convolutional Neural Network for Image Segmentation
After water, concrete is the second most used material in the world. Concrete’s forming adaptability and low-cost constituents make it a predominant material used in the construction of civil infrastructures in nuclear power plants such as concrete biological shields, containment buildings, turbine buildings, fuel handling and storage buildings, underground piping for cooling, cooling towers, and so on. Depending on environmental and operating conditions, these passive structures are subject to time-dependent phenomena that can either enhance (e.g., continued hydration) or degrade concrete’s structural performance. Unlike components such as the reactor pressure vessel and the primary circuit, concrete composition varies regionally because it is manufactured using local aggregates and cement. Hence, concrete performance metrics over time cannot be derived confidently using empirical relations. Alternatively, the specific characteristics of the local concrete constituents and their assemblage in concrete must be considered.
36 MATERIALS SCIENCE↗
Refining image segmentation by polygon skeletonization
A skeletonization algorithm was encoded and applied to a test data set of land-use polygons taken from a USGS digital land use dataset at 1:250,000. The distance transform produced by this method was instrumental in the description of the shape, size, and level of generalization of the outlines of the polygons. A comparison of the topology of skeletons for forested wetlands and lakes indicated that some distinction based solely upon the shape properties of the areas is possible, and may be of use in an intelligent automated land cover classification system.
Clarke, Keith C.↗
Establishing Uniform Image Segmentation Ground Truth Protocols for Uncertainty Quantification and Improved Model Evaluation.
Abstract not provided.
Chen, Maximillian Gene↗
Selecting Parameters for Image Processing Algorithms: A Case Study Using Retinal Image Segmentation
Explore the source record for details and available documents.
Mathematics and Computing↗
SAM-I-Am: Semantic boosting for zero-shot atomic-scale electron micrograph segmentation
Image segmentation is a critical enabler for tasks ranging from medical diagnostics to autonomous driving. However, the correct segmentation semantics — where are boundaries located? what segments are logically similar? — change depending on the domain, such that state-of-the-art foundation models can generate meaningless and incorrect results. Moreover, in certain domains, fine-tuning and retraining techniques are infeasible: obtaining labels is costly and time-consuming; domain images (micrographs) can be exponentially diverse; and data sharing (for third-party retraining) is restricted. To enable rapid adaptation of the best segmentation technology, we propose the concept of semantic boosting: given a zero-shot foundation model, guide its segmentation and adjust results to match domain expectations. Here, we apply semantic boosting to the Segment Anything Model (SAM) to obtain microstructure segmentation for transmission electron microscopy. Our booster, SAM-I-Am, serves as a post-processing engine that extracts geometric and textural features of various intermediate masks to perform mask removal and mask merging operations. We demonstrate a zero-shot performance increase of (absolute) +21.35%, +12.6%, +5.27% in mean IoU, and a -9.91%, -18.42%, -4.06% drop in mean false positive masks across images of three difficulty classes over vanilla SAM (ViT-L).
36 MATERIALS SCIENCE↗
The correlation study of parallel feature extractor and noise reduction approaches
This paper presents literature reviews that show variety of techniques to develop parallel feature extractor and finding its correlation with noise reduction approaches for low light intensity images. Low light intensity images are normally displayed as darker images and low contrast. Without proper handling techniques, those images regularly become evidences of misperception of objects and textures, the incapability to section them. The visual illusions regularly clues to disorientation, user fatigue, poor detection and classification performance of humans and computer algorithms. Noise reduction approaches (NR) therefore is an essential step for other image processing steps such as edge detection, image segmentation, image compression, etc. Parallel Feature Extractor (PFE) meant to capture visual contents of images involves partitioning images into segments, detecting image overlaps if any, and controlling distributed and redistributed segments to extract the features. Working on low light intensity images make the PFE face challenges and closely depend on the quality of its pre-processing steps. Some papers have suggested many well established NR as well as PFE strategies however only few resources have suggested or mentioned the correlation between them. This paper reviews best approaches of the NR and the PFE with detailed explanation on the suggested correlation. This finding may suggest relevant strategies of the PFE development. With the help of knowledge based reasoning, computational approaches and algorithms, we present the correlation study between the NR and the PFE that can be useful for the development and enhancement of other existing PFE.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
WE-G-207-05: Relationship Between CT Image Quality, Segmentation Performance, and Quantitative Image Feature Analysis
Purpose: Segmentation quality can affect quantitative image feature analysis. The objective of this study is to examine the relationship between computed tomography (CT) image quality, segmentation performance, and quantitative image feature analysis. Methods: A total of 90 pathology proven breast lesions in 87 dedicated breast CT images were considered. An iterative image reconstruction (IIR) algorithm was used to obtain CT images with different quality. With different combinations of 4 variables in the algorithm, this study obtained a total of 28 different qualities of CT images. Two imaging tasks/objectives were considered: 1) segmentation and 2) classification of the lesion as benign or malignant. Twenty-three image features were extracted after segmentation using a semi-automated algorithm and 5 of them were selected via a feature selection technique. Logistic regression was trained and tested using leave-one-out-cross-validation and its area under the ROC curve (AUC) was recorded. The standard deviation of a homogeneous portion and the gradient of a parenchymal portion of an example breast were used as an estimate of image noise and sharpness. The DICE coefficient was computed using a radiologist’s drawing on the lesion. Mean DICE and AUC were used as performance metrics for each of the 28 reconstructions. The relationship between segmentation and classification performance under different reconstructions were compared. Distributions (median, 95% confidence interval) of DICE and AUC for each reconstruction were also compared. Results: Moderate correlation (Pearson’s rho = 0.43, p-value = 0.02) between DICE and AUC values was found. However, the variation between DICE and AUC values for each reconstruction increased as the image sharpness increased. There was a combination of IIR parameters that resulted in the best segmentation with the worst classification performance. Conclusion: There are certain images that yield better segmentation or classification performance. The best segmentation Result does not necessarily lead to the best classification Result. This work has been supported in part by grants from the NIH R21-EB015053. R Nishikawa is receives royalties form Hologic, Inc.
60 APPLIED LIFE SCIENCES↗
Monitoring Change Through Hierarchical Segmentation of Remotely Sensed Image Data
NASA's Goddard Space Flight Center has developed a fast and effective method for generating image segmentation hierarchies. These segmentation hierarchies organize image data in a manner that makes their information content more accessible for analysis. Image segmentation enables analysis through the examination of image regions rather than individual image pixels. In addition, the segmentation hierarchy provides additional analysis clues through the tracing of the behavior of image region characteristics at several levels of segmentation detail. The potential for extracting the information content from imagery data based on segmentation hierarchies has not been fully explored for the benefit of the Earth and space science communities. This paper explores the potential of exploiting these segmentation hierarchies for the analysis of multi-date data sets, and for the particular application of change monitoring.
Tilton, James C.↗
MO-B-207B-00: Harmonization & Robustness in Radiomics
Feature extraction for radiomics studies typically comprises the following stages: Imaging, segmentation, image processing, and feature extraction. Each of these stages has associated uncertainties that can affect the quality of a radiomics model created using the resulting image features. For example, the imaging device manufacturer and model have been shown to impact the values of image features, as have pixel size and imaging protocol parameters. Image processing, such as low-pass filtering to reduce noise, also changes calculated image features and should be designed to optimize the information content of the resulting features. The details of certain feature algorithms, such as co-occurrence matrix bin sizes, are also important, and should be optimized for specific radiomics tasks. The volume of the region of interest should be considered as image features can be related to volume and can give unanticipated results when the volumes are too small. In this session we will describe approaches to quantify the variabilities in radiomics studies, including the most recent results quantifying these variabilities for CT, MRI and PET imaging. We will discuss methods to optimize image processing and feature extraction in order to maximize the information content of the image features. Finally, we will describe work to harmonize imaging protocols and feature calculations to help minimize uncertainties in radiomics studies. Learning Objectives: At the end of this session, participants will be able to: Identify the sources of uncertainty in radiomics studies (CT, PET, and MRI imaging) Describe methods for quantifying the magnitude of uncertainties Describe approaches for mitigating the effects of the uncertainties on radiomics models Funding from NIH, CPRIT, Varian, Elekta; L. Court, NCI, CPRIT, Varian, Elekta.
60 APPLIED LIFE SCIENCES↗
MO-B-207B-01: Harmonization & Robustness in Radiomics
Feature extraction for radiomics studies typically comprises the following stages: Imaging, segmentation, image processing, and feature extraction. Each of these stages has associated uncertainties that can affect the quality of a radiomics model created using the resulting image features. For example, the imaging device manufacturer and model have been shown to impact the values of image features, as have pixel size and imaging protocol parameters. Image processing, such as low-pass filtering to reduce noise, also changes calculated image features and should be designed to optimize the information content of the resulting features. The details of certain feature algorithms, such as co-occurrence matrix bin sizes, are also important, and should be optimized for specific radiomics tasks. The volume of the region of interest should be considered as image features can be related to volume and can give unanticipated results when the volumes are too small. In this session we will describe approaches to quantify the variabilities in radiomics studies, including the most recent results quantifying these variabilities for CT, MRI and PET imaging. We will discuss methods to optimize image processing and feature extraction in order to maximize the information content of the image features. Finally, we will describe work to harmonize imaging protocols and feature calculations to help minimize uncertainties in radiomics studies. Learning Objectives: At the end of this session, participants will be able to: Identify the sources of uncertainty in radiomics studies (CT, PET, and MRI imaging) Describe methods for quantifying the magnitude of uncertainties Describe approaches for mitigating the effects of the uncertainties on radiomics models Funding from NIH, CPRIT, Varian, Elekta; L. Court, NCI, CPRIT, Varian, Elekta.
60 APPLIED LIFE SCIENCES↗
Image Analysis via Fuzzy-Reasoning Approach: Prototype Applications at NASA
A set of imaging techniques based on Fuzzy Reasoning (FR) approach was built for NASA at Kennedy Space Center (KSC) to perform complex real-time visual-related safety prototype tasks, such as detection and tracking of moving Foreign Objects Debris (FOD) during the NASA Space Shuttle liftoff and visual anomaly detection on slidewires used in the emergency egress system for Space Shuttle at the launch pad. The system has also proved its prospective in enhancing X-ray images used to screen hard-covered items leading to a better visualization. The system capability was used as well during the imaging analysis of the Space Shuttle Columbia accident. These FR-based imaging techniques include novel proprietary adaptive image segmentation, image edge extraction, and image enhancement. Probabilistic Neural Network (PNN) scheme available from NeuroShell(TM) Classifier and optimized via Genetic Algorithm (GA) was also used along with this set of novel imaging techniques to add powerful learning and image classification capabilities. Prototype applications built using these techniques have received NASA Space Awards, including a Board Action Award, and are currently being filed for patents by NASA; they are being offered for commercialization through the Research Triangle Institute (RTI), an internationally recognized corporation in scientific research and technology development. Companies from different fields, including security, medical, text digitalization, and aerospace, are currently in the process of licensing these technologies from NASA.
Dominguez, Jesus A.↗
TH-CD-206-02: BEST IN PHYSICS (IMAGING): 3D Prostate Segmentation in MR Images Using Patch-Based Anatomical Signature
Purpose: MRI has shown promise in identifying prostate tumors with high sensitivity and specificity for the detection of prostate cancer. Accurate segmentation of the prostate plays a key role various tasks: to accurately localize prostate boundaries for biopsy needle placement and radiotherapy, to initialize multi-modal registration algorithms or to obtain the region of interest for computer-aided detection of prostate cancer. However, manual segmentation during biopsy or radiation therapy can be time consuming and subject to inter- and intra-observer variation. This study’s purpose it to develop an automated method to address this technical challenge. Methods: We present an automated multi-atlas segmentation for MR prostate segmentation using patch-based label fusion. After an initial preprocessing for all images, all the atlases are non-rigidly registered to a target image. And then, the resulting transformation is used to propagate the anatomical structure labels of the atlas into the space of the target image. The top L similar atlases are further chosen by measuring intensity and structure difference in the region of interest around prostate. Finally, using voxel weighting based on patch-based anatomical signature, the label that the majority of all warped labels predict for each voxel is used for the final segmentation of the target image. Results: This segmentation technique was validated with a clinical study of 13 patients. The accuracy of our approach was assessed using the manual segmentation (gold standard). The mean volume Dice Overlap Coefficient was 89.5±2.9% between our and manual segmentation, which indicate that the automatic segmentation method works well and could be used for 3D MRI-guided prostate intervention. Conclusion: We have developed a new prostate segmentation approach based on the optimal feature learning label fusion framework, demonstrated its clinical feasibility, and validated its accuracy. This segmentation technique could be a useful tool in image-guided interventions for prostate-cancer diagnosis and treatment.
60 APPLIED LIFE SCIENCES↗
Parallel Implementation of the Recursive Approximation of an Unsupervised Hierarchical Segmentation Algorithm
The hierarchical image segmentation algorithm (referred to as HSEG) is a hybrid of hierarchical step-wise optimization (HSWO) and constrained spectral clustering that produces a hierarchical set of image segmentations. HSWO is an iterative approach to region grooving segmentation in which the optimal image segmentation is found at N(sub R) regions, given a segmentation at N(sub R+1) regions. HSEG's addition of constrained spectral clustering makes it a computationally intensive algorithm, for all but, the smallest of images. To counteract this, a computationally efficient recursive approximation of HSEG (called RHSEG) has been devised. Further improvements in processing speed are obtained through a parallel implementation of RHSEG. This chapter describes this parallel implementation and demonstrates its computational efficiency on a Landsat Thematic Mapper test scene.
Tilton, James C.↗
WE-EF-210-08: BEST IN PHYSICS (IMAGING): 3D Prostate Segmentation in Ultrasound Images Using Patch-Based Anatomical Feature
Purpose: Transrectal ultrasound (TRUS) is the standard imaging modality for the image-guided prostate-cancer interventions (e.g., biopsy and brachytherapy) due to its versatility and real-time capability. Accurate segmentation of the prostate plays a key role in biopsy needle placement, treatment planning, and motion monitoring. As ultrasound images have a relatively low signal-to-noise ratio (SNR), automatic segmentation of the prostate is difficult. However, manual segmentation during biopsy or radiation therapy can be time consuming. We are developing an automated method to address this technical challenge. Methods: The proposed segmentation method consists of two major stages: the training stage and the segmentation stage. During the training stage, patch-based anatomical features are extracted from the registered training images with patient-specific information, because these training images have been mapped to the new patient’ images, and the more informative anatomical features are selected to train the kernel support vector machine (KSVM). During the segmentation stage, the selected anatomical features are extracted from newly acquired image as the input of the well-trained KSVM and the output of this trained KSVM is the segmented prostate of this patient. Results: This segmentation technique was validated with a clinical study of 10 patients. The accuracy of our approach was assessed using the manual segmentation. The mean volume Dice Overlap Coefficient was 89.7±2.3%, and the average surface distance was 1.52 ± 0.57 mm between our and manual segmentation, which indicate that the automatic segmentation method works well and could be used for 3D ultrasound-guided prostate intervention. Conclusion: We have developed a new prostate segmentation approach based on the optimal feature learning framework, demonstrated its clinical feasibility, and validated its accuracy with manual segmentation (gold standard). This segmentation technique could be a useful tool for image-guided interventions in prostate-cancer diagnosis and treatment. This research is supported in part by DOD PCRP Award W81XWH-13-1-0269, and National Cancer Institute (NCI) Grant CA114313.
60 APPLIED LIFE SCIENCES↗
Super-resolution and segmentation deep learning for breast cancer histopathology image analysis
Traditionally, a high-performance microscope with a large numerical aperture is required to acquire high-resolution images. However, the images’ size is typically tremendous. Therefore, they are not conveniently managed and transferred across a computer network or stored in a limited computer storage system. As a result, image compression is commonly used to reduce image size resulting in poor image resolution. Here, we demonstrate custom convolution neural networks (CNNs) for both super-resolution image enhancement from low-resolution images and characterization of both cells and nuclei from hematoxylin and eosin (H&E) stained breast cancer histopathological images by using a combination of generator and discriminator networks so-called super-resolution generative adversarial network-based on aggregated residual transformation (SRGAN-ResNeXt) to facilitate cancer diagnosis in low resource settings. The results provide high enhancement in image quality where the peak signal-to-noise ratio and structural similarity of our network results are over 30 dB and 0.93, respectively. The derived performance is superior to the results obtained from both the bicubic interpolation and the well-known SRGAN deep-learning methods. In addition, another custom CNN is used to perform image segmentation from the generated high-resolution breast cancer images derived with our model with an average Intersection over Union of 0.869 and an average dice similarity coefficient of 0.893 for the H&E image segmentation results. Finally, we propose the jointly trained SRGAN-ResNeXt and Inception U-net Models, which applied the weights from the individually trained SRGAN-ResNeXt and inception U-net models as the pre-trained weights for transfer learning. The jointly trained model’s results are progressively improved and promising. We anticipate these custom CNNs can help resolve the inaccessibility of advanced microscopes or whole slide imaging (WSI) systems to acquire high-resolution images from low-performance microscopes located in remote-constraint settings.
60 APPLIED LIFE SCIENCES↗