Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Computer Vision: EO Imaging & Video Tasks, Metrics, and Datasets [Slides]

Classification is an assignment of an image to a certain category. Localization is identified by the box surrounding the object in the image. Object detection detects instances of semantic objects of a certain class. Semantic segmentation categorizes all the pixels of an image into classes of objects. Instance segmentation identifies each instance of each object in the image. Panoptic (i.e., showing or seeing everything at once) segmentation is a combination of semantic and instance segmentation and classifies all the pixels in the image.

97 MATHEMATICS AND COMPUTING↗

Modified Recursive Hierarchical Segmentation of Data

An algorithm and a computer program that implements the algorithm that performs recursive hierarchical segmentation (RHSEG) of data have been developed. While the current implementation is for two-dimensional data having spatial characteristics (e.g., image, spectral, or spectral-image data), the generalized algorithm also applies to three-dimensional or higher dimensional data and also to data with no spatial characteristics. The algorithm and software are modified versions of a prior RHSEG algorithm and software, the outputs of which often contain processing-window artifacts including, for example, spurious segmentation-image regions along the boundaries of processing-window edges.

Tilton, James C.↗

Superpixel edges for boundary detection

Various embodiments presented herein relate to identifying one or more edges in a synthetic aperture radar (SAR) image comprising a plurality of superpixels. Superpixels sharing an edge (or boundary) can be identified and one or more properties of the shared superpixels can be compared to determine whether the superpixels form the same or two different features. Where the superpixels form the same feature the edge is identified as an internal edge. Where the superpixels form two different features, the edge is identified as an external edge. Based upon classification of the superpixels, the external edge can be further determined to form part of a roof, wall, etc. The superpixels can be formed from a speckle-reduced SAR image product formed from a registered stack of SAR images, which is further segmented into a plurality of superpixels. The edge identification process is applied to the SAR image comprising the superpixels and edges.

47 OTHER INSTRUMENTATION↗

Development and validation of an automatic method to detect the latest contracting viable left ventricular segments to assist guide CRT therapy from gated SPECT myocardial perfusion imaging

Objectives: The purpose of this study is to use ECG-gated SPECT MPI to detect the latest contracting viable left ventricular (LV) segments to help guide the LV probe placement used in CRT therapy and to validate segment selection against the visual integration method by experts. Methods: For each patient, the resting ECG-gated SPECT MPI short-axis images were sampled in 3D to generate a polar map of the perfusion distribution used to determine LV myocardial viability, and to measure LV synchronicity using our phase analysis tool. In the visual integration method, two experts visually interpreted the LV viability and mechanical dyssynchrony from the short-axis images and polar maps of viability and phase, to determine the latest contracting viable segments using the 17-segment model. In the automatic method, the apical segments, septal segments, and segments with more than 50% scar were excluded as these are not candidates for CRT LV probe placement. Amongst the remaining viable segments, the segments, whose phase angles were within 10° of the latest phase angle (the most delayed contracting segment), were identified for potential CRT LV probe placement and ranked based on the phase angles of the segments. Both methods were tested in 36 pre-CRT patients who underwent ECG-gated SPECT MPI. The accuracy was determined as the percent agreement between the visual integration and automatic methods. The automatic method was performed by a second independent operator to evaluate the inter-operator processing reproducibility. Results: In all the 36 patients, the LV lead positions of the 1st choices recommended by the automatic and visual integration methods were in the same segments in 35 patients, which achieved an agreement rate of 97.2%. In the inter-operator reproducibility test, the LV lead positions of the 1st choices recommended by the two operators were in the same segments in 25 patients, and were in the adjacent segments in 7 patients, which achieved an overall agreement of 88.8%. Conclusions: An automatic method has been developed to detect the latest contracting viable LV segments to help guide the LV probe placement used in CRT therapy. The retrospective clinical study with 36 patients suggests that this method has high agreement against the visual integration method by experts and good inter-operator reproducibility. Consequently, this method is promising to be a clinical tool to recommend the CRT LV lead positions.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Rays for Roots - Integrating Backscatter X-Ray Phenotyping, Modeling and Genetics to Increase Carbon Sequestration and Switchgrass Resource Use (Final Report)

To increase carbon (C) deposition in the soil and enhance crop resource use efficiency, characterizing root form and function is essential. Several root and soil traits have been linked to increased root-to-soil C transfer. Technology that could provide high-resolution characterization of many of these traits in field conditions would revolutionize our ability to study and understand how to increase C sequestration. In this effort, we developed an initial early prototype backscatter X-ray system for non-destructive imaging of root traits. We collected initial backscatter X-ray data in field and lab settings and carried out early analysis of these data. Along with this prototype, we also developed a suite of root phenotyping approaches including advanced minirhizotron image analysis, soil core imaging, and mesocosm imaging. Minirhizotron (MR) tubes are clear tubes inserted into the soil in the field and used to image roots and the surrounding soil. Our team has developed deep learning-based methods that can segment roots from soil that can learn from imprecise image-level labels. The ability to learn or fine-tune our deep learning algorithms from image-level labels allows easier and faster application of these approaches to new locations and new plant species. We have successfully implemented and applied our MR analysis approaches to thousands of switchgrass MR images collected across geographical regions. An advantage of MR imaging is the ability to collect root and soil images over time. Our soil core analysis included collecting hundreds of soil core samples from harvested switchgrass fields and imaging these cores with both X-ray CT and backscatter X-ray imaging. Initial segmentation approaches for the X-ray CT images of these cores have been developed and applied. An advantage of soil core analysis is that it preserves the three-dimensional structures of the roots and soil in the core collected. Our group also developed photogrammetry-based mesocosm root imaging and phenotyping approaches. In this approach, a plant was grown in a large mesocosm with a three-dimensional grid of thin supporting lines inserted throughout the mesocosm. After the plant (and, correspondingly, the root architecture is grown and established) the soil media was removed and the supporting lines approximately preserved the three-dimensional root architecture. Then, we applied photogrammetry techniques to create a three-dimensional digital representation of the root architecture for which we developed analysis algorithms including skeletonization. We carried out our phenotyping development with powerful switchgrass resources and physiological and agroecosystem modeling to deliver novel technology. This project contributes to multiple ARPA-E missions including reduction of foreign imports of energy, reduction of energy-related emissions including greenhouse gases, and ensuring that the United States maintains a technological lead in developing and deploying advanced energy technology. Furthermore, the developed tools could transform public and private plant breeding and could be broadly applicable to other crops and, potentially, other application areas. Our team of engineers, plant and soil scientists, and modelers i) developed an early prototype backscatter X-ray platform that can operate in field conditions; ii) developed a suite of root phenotyping and characterization approaches as described above; iii) developed and carried out plant biology and physiology roots studies and; iv) developed and implemented mechanistic physiological modeling.

42 ENGINEERING↗

Computing water flow through complex landscapes – Part 2: Finding hierarchies in depressions and morphological segmentations

Depressions – inwardly draining regions of digital elevation models – present difficulties for terrain analysis and hydrological modeling. Analogous “depressions” also arise in image processing and morphological segmentation, where they may represent noise, features of interest, or both. Here we provide a new data structure – the depression hierarchy – that captures the full topologic and topographic complexity of depressions in a region. We treat depressions as networks in a way that is analogous to surface-water flow paths, in which individual sub-depressions merge together to form meta-depressions in a process that continues until they begin to drain externally. This hierarchy can be used to selectively fill or breach depressions or to accelerate dynamic models of hydrological flow. Complete, well-commented, open-source code and correctness tests are available on GitHub and Zenodo.

54 ENVIRONMENTAL SCIENCES↗

Automated phase segmentation and quantification of high-resolution TEM image for alloy design

In the alloy design and development process, a wealth of atomically resolved structural high-resolution transmission electron microscopy (HRTEM) images are produced. Identifying the different nano-precipitate phases and tracking their evolution under various compositions and during manufacturing or post-processing requires hundreds of HRTEM images and thousands of precipitates. The nanoscopic phase information labeling and analysis purely relies on humans are prohibitively costly and time-consuming, sometimes not reliable because of the lack of authoritative knowledge. Here, in this work, we develop a novel unsupervised machine learning approach coupled with adaptive computer vision techniques with features in the Fourier space to automatically determine the number of phases and segment/quantify the phases with nanoscale resolution, allowing for quantitative correlation between nanostructure formation, processing and functional properties. To automate the phase extraction/quantification and ascertain its applicability, we have applied the developed framework to the HRTEM images from several alloy systems, processing conditions, image magnifications, and phase types and morphologies (precipitates, nano-twins, stacking faults, crystalline matrix, and amorphous structures) for verification. This study paves the road for compression, visualization, and translation of raw image structural data into physically relevant information in real-time with minimal human supervision. It shows the promise of enabling high-throughput materials characterization for the acceleration of alloy manufacturing and design.

36 MATERIALS SCIENCE↗

Multi-scale structural analysis of proteins by deep semantic segmentation

Abstract Motivation Recent advances in computational methods have facilitated large-scale sampling of protein structures, leading to breakthroughs in protein structural prediction and enabling de novo protein design. Establishing methods to identify candidate structures that can lead to native folds or designable structures remains a challenge, since few existing metrics capture high-level structural features such as architectures, folds and conformity to conserved structural motifs. Convolutional Neural Networks (CNNs) have been successfully used in semantic segmentation—a subfield of image classification in which a class label is predicted for every pixel. Here, we apply semantic segmentation to protein structures as a novel strategy for fold identification and structure quality assessment. Results We train a CNN that assigns each residue in a multi-domain protein to one of 38 architecture classes designated by the CATH database. Our model achieves a high per-residue accuracy of 90.8% on the test set (95.0% average per-class accuracy; 87.8% average per-structure accuracy). We demonstrate that individual class probabilities can be used as a metric that indicates the degree to which a randomly generated structure assumes a specific fold, as well as a metric that highlights non-conformative regions of a protein belonging to a known class. These capabilities yield a powerful tool for guiding structural sampling for both structural prediction and design. Availability and implementation The trained classifier network, parser network, and entropy calculation scripts are available for download at https://git.io/fp6bd, with detailed usage instructions provided at the download page. A step-by-step tutorial for setup is provided at https://goo.gl/e8GB2S. All Rosetta commands, RosettaRemodel blueprints, and predictions for all datasets used in the study are available in the Supplementary Information. Supplementary information Supplementary data are available at Bioinformatics online.

Eguchi, Raphael R.↗

Paint and Click: Unified Interactions for Image Boundaries

Image boundaries are a fundamental component of many interactive digital photography techniques, enabling applications such as segmentation, panoramas, and seamless image composition. Interactions for image boundaries often rely on two complementary but separate approaches: editing via painting or clicking constraints. In this work, we provide a novel, unified approach for interactive editing of pairwise image boundaries that combines the ease of painting with the direct control of constraints. Rather than a sequential coupling, this new formulation allows full use of both interactions simultaneously, giving users unprecedented flexibility for fast boundary editing. To enable this new approach, we provide technical advancements. In particular, we detail a reformulation of image boundaries as a problem of finding cycles, expanding and correcting limitations of the previous work. Our new formulation provides boundary solutions for painted regions with performance on par with state-of-the-art specialized, paint-only techniques. In addition, we provide instantaneous exploration of the boundary solution space with user constraints. Finally, we provide examples of common graphics applications impacted by our new approach.

97 MATHEMATICS AND COMPUTING↗

Dynamic radionuclide determination of regional left ventricular wall motion using a new digital imaging device

In 47 men with arteriographically defined coronary artery disease comparative studies of left ventricular ejection fraction and segmental wall motion were made with radionuclide data obtained from the image intensifier camera computer system and with contrast cineventriculography. The radionuclide data was digitized and the images corresponding to left ventricular end-diastole and end-systole were identified from the left ventricular time-activity curve. The left ventricular end-diastolic and end-systolic images were subtracted to form a silhouette difference image which described wall motion of the anterior and inferior left ventricular segments. The image intensifier camera allows manipulation of dynamically acquired radionuclide data because of the high count rate and consequently improved resolution of the left ventricular image.

Steele, P.↗

Mars Terrain Segmentation with Less Labels

Planetary rover systems need to perform terrain segmentation to identify drivable areas as well as identify specific types of soil for sample collection. The latest Martian terrain segmentation methods rely on supervised learning which is very data hungry and difficult to train where only a small number of labeled samples are available. Moreover, the semantic classes are defined differently for different applications (e.g., rover traversal vs. geological) and as a result the network has to be trained from scratch each time, which is an inefficient use of resources. This research proposes a semi-supervised learning framework for Mars terrain segmentation where a deep segmentation network trained in an unsupervised manner on unlabeled images is transferred to the task of terrain segmentation trained on few labeled images. The network incorporates a backbone module which is trained using a contrastive loss function and an output atrous convolution module which is trained using a pixel-wise cross-entropy loss function. Evaluation results using the metric of segmentation accuracy show that the proposed method with contrastive pre-training outperforms plain supervised learning by 2%-10%. Moreover, the proposed model is able to achieve a segmentation accuracy of 91.1% using only 161 training images (1% of the original dataset) compared to 81.9% with plain supervised learning.

Wilson, Brian D↗

Optical image analysis of WSe 2 − thresholding for layer detection

The fast and reliable layer identification of two-dimensional transition metal dichalcogenide (TMD), such as WSe 2 , is essential to investigating their thickness-dependent electronic and optical properties. This article presents efficient optical image thresholding methodology designed to segment the mono, bi, and tri-layer regions of WSe 2 flakes mechanically exfoliated onto a SiO 2 /Si substrate. The optical images were first preprocessed to exclude the background effect and analyzed using the pixel medians and interquartile ranges for fundamental color channels—red, green, and blue (RGB). The analysis of red channel pixel intensities yielded three distinct ranges, serving as thresholds for layer segmentation: monolayer (111.0–118.0), bilayer (103.0–110.0), and tri-layer (93.0–103.0). Similarly, thresholds were established for each color channel, facilitating a comparative study of the segmentation performances. Further, the intersection-over-union ($IoU$) calculations revealed that the red and green channels demonstrated greater than 99 % and 90 % accuracy in differentiating each layer, respectively. This approach yields remarkable results without substantial data calibration that utilizes time-intensive heuristic techniques. Moreover, the proposed methodology offers the flexibility to compare performances across different color channels, expanding the applicability for other 2D material systems.

2D Materials↗

TU-AB-BRA-01: Abdominal Synthetic CT Generation in Support of Liver SBRT Dose Calculation

Purpose: To demonstrate and validate a technique for generating MRI-derived synthetic CT volumes (MRCTs) in support of adaptive liver SBRT. Methods: Under IRB approval, ten hepatocellular carcinoma patients were scanned using a single MR sequence (T1 Dixon-VIBE), yielding inherently-registered water, fat, and T1-weighted images. Air-containing voxels were identified by intensity thresholding. The envelope of the anterior vertebral bodies was segmented from the fat image by fitting a shape model to vertebral body candidate voxels, then using level sets to expand the contour outward. Fuzzy-C-Means (FCM) was then used to classify each non-air voxel in the image as fat, water, bone, or marrow. Bone and marrow only were classified within the vertebral body envelope. The MRCT was created by integrating the product of the FCM class probability with the assigned class density for each voxel. The resulting MRCTs were deformably aligned with planning CTs and 2-ARC SBRT VMAT plans were optimized on the MRCT density maps. Fluence was copied onto the CT density grids and dose recalculated. Results: The MRCTs faithfully reproduced most of the features visible in the corresponding CT image volumes, with exceptions of ribs and posterior spinous processes. The liver, vertebral bodies, kidneys, spleen and cord all had median HU differences of less than 75 between MRCT and CT images. PTV D99% values had an average 0.2% difference (standard deviation: 0.46%) between calculations on MRCT and CT density grids. The maximum difference in dose to 0.1cc of the PTV was 0.25% (std:0.49%). OAR dose differences were similarly small (mean:0.03Gy, std:0.26Gy). The largest normal tissue complication percentage (NTCP) difference was 1.48% (mean:0.06%, std:0.54%). Conclusions: MRCTs from a single abdominal imaging sequence are promising for use in SBRT dose calculation. Future work will focus on extending models to better define bones in the upper abdomen. Supported by NIHR01EB016079 and NIH1L30CA199594-01.

60 APPLIED LIFE SCIENCES↗