Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Automatic Segmentation of the Eye in 3D Magnetic Resonance Imaging: A Novel Statistical Shape Model for Treatment Planning of Retinoblastoma

Purpose: Proper delineation of ocular anatomy in 3-dimensional (3D) imaging is a big challenge, particularly when developing treatment plans for ocular diseases. Magnetic resonance imaging (MRI) is presently used in clinical practice for diagnosis confirmation and treatment planning for treatment of retinoblastoma in infants, where it serves as a source of information, complementary to the fundus or ultrasonographic imaging. Here we present a framework to fully automatically segment the eye anatomy for MRI based on 3D active shape models (ASM), and we validate the results and present a proof of concept to automatically segment pathological eyes. Methods and Materials: Manual and automatic segmentation were performed in 24 images of healthy children's eyes (3.29 ± 2.15 years of age). Imaging was performed using a 3-T MRI scanner. The ASM consists of the lens, the vitreous humor, the sclera, and the cornea. The model was fitted by first automatically detecting the position of the eye center, the lens, and the optic nerve, and then aligning the model and fitting it to the patient. We validated our segmentation method by using a leave-one-out cross-validation. The segmentation results were evaluated by measuring the overlap, using the Dice similarity coefficient (DSC) and the mean distance error. Results: We obtained a DSC of 94.90 ± 2.12% for the sclera and the cornea, 94.72 ± 1.89% for the vitreous humor, and 85.16 ± 4.91% for the lens. The mean distance error was 0.26 ± 0.09 mm. The entire process took 14 seconds on average per eye. Conclusion: We provide a reliable and accurate tool that enables clinicians to automatically segment the sclera, the cornea, the vitreous humor, and the lens, using MRI. We additionally present a proof of concept for fully automatically segmenting eye pathology. This tool reduces the time needed for eye shape delineation and thus can help clinicians when planning eye treatment and confirming the extent of the tumor.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Automatic Segmentation of Whole Breast Using Atlas Approach and Deformable Image Registration

Purpose: To compare interobserver variations in delineating the whole breast for treatment planning using two contouring methods. Methods and Materials: Autosegmented contours were generated by a deformable image registration-based breast segmentation method (DEF-SEG) by mapping the whole breast clinical target volume (CTVwb) from a template case to a new patient case. Eight breast radiation oncologists modified the autosegmented contours as necessary to achieve a clinically appropriate CTVwb and then recontoured the same case from scratch for comparison. The times to complete each approach, as well as the interobserver variations, were analyzed. The template case was also mapped to 10 breast cancer patients with a body mass index of 19.1-35.9 kg/m{sup 2}. The three-dimensional surface-to-surface distances and volume overlapping analyses were computed to quantify contour variations. Results: The median time to edit the DEF-SEG-generated CTVwb was 12.9 min (range, 3.4-35.9) compared with 18.6 min (range, 8.9-45.2) to contour the CTVwb from scratch (30% faster, p = 0.028). The mean surface-to-surface distance was noticeably reduced from 1.6 mm among the contours generated from scratch to 1.0 mm using the DEF-SEG method (p = 0.047). The deformed contours in 10 patients achieved 94% volume overlap before correction and required editing of 5% (range, 1-10%) of the contoured volume. Conclusion: Significant interobserver variations suggested a lack of consensus regarding the CTVwb, even among breast cancer specialists. Using the DEF-SEG method produced more consistent results and required less time. The DEF-SEG method can be successfully applied to patients with different body mass indexes.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

MO-C-17A-11: A Segmentation and Point Matching Enhanced Deformable Image Registration Method for Dose Accumulation Between HDR CT Images

Purpose: To propose and validate a novel and accurate deformable image registration (DIR) scheme to facilitate dose accumulation among treatment fractions of high-dose-rate (HDR) gynecological brachytherapy. Method: We have developed a method to adapt DIR algorithms to gynecologic anatomies with HDR applicators by incorporating a segmentation step and a point-matching step into an existing DIR framework. In the segmentation step, random walks algorithm is used to accurately segment and remove the applicator region (AR) in the HDR CT image. A semi-automatic seed point generation approach is developed to obtain the incremented foreground and background point sets to feed the random walks algorithm. In the subsequent point-matching step, a feature-based thin-plate spline-robust point matching (TPS-RPM) algorithm is employed for AR surface point matching. With the resulting mapping, a DVF characteristic of the deformation between the two AR surfaces is generated by B-spline approximation, which serves as the initial DVF for the following Demons DIR between the two AR-free HDR CT images. Finally, the calculated DVF via Demons combined with the initial one serve as the final DVF to map doses between HDR fractions. Results: The segmentation and registration accuracy are quantitatively assessed by nine clinical HDR cases from three gynecological cancer patients. The quantitative results as well as the visual inspection of the DIR indicate that our proposed method can suppress the interference of the applicator with the DIR algorithm, and accurately register HDR CT images as well as deform and add interfractional HDR doses. Conclusions: We have developed a novel and robust DIR scheme that can perform registration between HDR gynecological CT images and yield accurate registration results. This new DIR scheme has potential for accurate interfractional HDR dose accumulation. This work is supported in part by the National Natural ScienceFoundation of China (no 30970866 and no 81301940)

60 APPLIED LIFE SCIENCES↗

TU-CD-207-12: Impact of Anatomical Noise On Detection Performance of Microcalcifications in Multi-Contrast Breast Imaging

Purpose: The anatomical noise power spectra (NPS) for differential phase contrast (DPC) and dark field (DF) imaging have recently been characterized using a power-law model with two parameters, alpha and beta, an innovative extension to the methodology used in x-ray attenuation based breast imaging such as mammography, DBT, or cone-beam CT. Beta values of 3.6, 2.6, and 1.3 have been measured for absorption, DPC, and DF respectively for cadaver breasts imaged in the coronal plane; these dramatic differences should be reflected in their detection performance. The purpose of this study was to determine the impact of anatomical noise on breast calcification detection and compare the detection performance of the three contrast mechanisms of a multi-contrast x-ray imaging system. Methods: In our studies, a calcification image object was segmented out of the multi-contrast images of a cadaver breast specimen. 50 measured total NPS were measured from breast cadavers directly. The ideal model observer detectability was calculated for a range of doses (5–100%) and a range of calcification sizes (diameter = 0.25–2.5 mm). Results: Overall we found the highest average detectability corresponded to DPC imaging (7.4 for 1 mm calc.), with DF the next highest (3.8 for 1 mm calc.), and absorption the lowest (3.2 for 1 mm calc.). However, absorption imaging also showed the slowest dependence on dose of the three modalities due to the significant anatomical noise. DPC showed a peak detectability for calcifications ∼1.25 mm in diameter, DF showed a peak for calcifications around 0.75 mm in diameter, and absorption imaging had no such peak in the range explored. Conclusion: Understanding imaging performance for DPC and DF is critical to transition these modalities to the clinic. The results presented here offer new insight into how these modalities complement absorption imaging to maximize the likelihood of detecting early breast cancers. J. Garrett, Y. Ge, K. Li: Nothing to disclose. G.-H. Chen: Research funded, GE Healthcare; Research funded, Siemens AX.

60 APPLIED LIFE SCIENCES↗

Unsupervised Tattoo Segmentation Combining Bottom-Up and Top-Down Cues

Tattoo segmentation is challenging due to the complexity and large variance in tattoo structures. We have developed a segmentation algorithm for nding tattoos in an image. Our basic idea is split-merge: split each tattoo image into clusters through a bottom-up process, learn to merge the clusters containing skin and then distinguish tattoo from the other skin via top-down prior in the image itself. Tattoo segmentation with unknown number of clusters is transferred to a gure-ground segmentation. We have applied our segmentation algorithm on a tattoo dataset and the results have shown that our tattoo segmentation system is e cient and suitable for further tattoo classi cation and retrieval purpose.

Allen, Josef D↗

TH-A-18C-01: Design Optimization of Segmented Scintillators for Megavoltage Cone- Beam CT

Purpose: Active matrix flat-panel imagers incorporating thick, segmented scintillators for megavoltage cone-beam CT (MV CBCT) imaging have demonstrated strong potential for facilitating soft-tissue visualization at low, clinically practical doses. In order to identify scintillator design parameters that optimize performance for this purpose, a modeling technique which includes both radiation and optical effects and which lends itself to computationally practical implementation has been developed and explored. Methods: A hybrid modeling technique, based on Monte Carlo event-by-event simulation of radiation transport and separate determination of optical effects, was devised as an alternative to computationally prohibitive event-by- event simulations of both radiation and optical transport. The technique was validated against empirical results from a previously reported 1.13 cm thick, 1.016 mm element-to-element pitch BGO scintillator prototype. Using this technique, the contrast-to-noise ratio (CNR) and spatial resolution performance of numerous scintillator designs, with thicknesses ranging from 0.5 to 6 cm and pitches ranging from 0.508 to 1.524 mm, were examined. Results: CNR and spatial resolution performance for the various scintillator designs demonstrate complex behavior as scintillator thickness and pitch are varied - exhibiting a clear trade-off between these two imaging metrics up to a thickness of ~3 cm. Based on these results, an optimization map highlighting those regions of design that provide a balance between these metrics was created. The map indicates that, for a given set of optical parameters, scintillator thickness and pitch can be judiciously chosen to maximize performance without resorting to thicker, more costly scintillators. Conclusion: Modeling radiation and optical effects in thick, segmented scintillators through use of a hybrid modeling technique provides a practical way to gain insight as to how to optimize the performance of such devices for radiotherapy imaging. Assisted by such modeling, the development of practical designs should greatly facilitate low-dose, soft tissue visualization through MV CBCT imaging. This project was supported in part by NIH grant R01 CA051397.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Instance Segmentation for Direct Measurements of Satellites in Metal Powders and Automated Microstructural Characterization from Image Data

In this work, we propose instance segmentation as a useful tool for image analysis in materials science. Instance segmentation is an advanced technique in computer vision which generates individual segmentation masks for every object of interest that is recognized in an image. Using an out-of-the-box implementation of Mask R-CNN, instance segmentation is applied to images of metal powder particles produced through gas atomization. Leveraging transfer learning allows for the analysis to be conducted with a very small training set of labeled images. As well as providing another method for measuring the particle size distribution, we demonstrate the first direct measurements of the satellite content in powder samples. After analyzing the results for the labeled data dataset, the trained model was used to generate measurements for a much larger set of unlabeled images. The resulting particle size measurements showed reasonable agreement with laser scattering measurements. The satellite measurements were self-consistent and showed good agreement with the expected trends for different samples. Finally, we present a small case study showing how instance segmentation can be used to measure spheroidite content in the UltraHigh Carbon Steel DataBase, demonstrating the flexibility of the technique.

36 MATERIALS SCIENCE↗

RU Net for Automatic Characterization of TRISO Fuel Cross Sections

TRistructural ISOtropic (TRISO) particle fuel is a type of nuclear fuel known for its high-temperature and high-burnup performance. Each sub-millimeter diameter TRISO particle consists of uranium-oxycarbide (UCO) or UO2 fuel kernel, coated with buffer, inner pyrolytic carbon (IPyC), silicon carbide (SiC), and outer pyrolytic carbon (OPyC) layers. The SiC layer acts as the main containment barrier for the TRISO particle to retain the fission products, while the IPyC and OPyC layers provide additional barriers to the release of fission products, especially fission gases. During irradiation, phenomena like kernel swelling, buffer densification, and IPyC fracture may impact fuel performance. Post-irradiation microscopy on entire compact cross sections or samples of individual particles deconsolidated from compacts is often used to identify these irradiation-induced changes in morphology. However, each fuel compact generally contains thousands of TRISO particles. To get statistical information on these phenomena, it is cumbersome work if done manually. For example, to get information about swelling/densification behaviors of different layers or kernels after irradiation, researchers previously manually measured the perimeter of each TRISO layer in hundreds of particles after four rounds of iterative grinding and polishing encompassing more than 2000 cross-section images for a total of four fuel compacts. To attempt to reduce the subjectivity inherent in that process and accelerate data analysis, we conducted a study on the automatic TRISO layer segmentation on cross-sectional microscopic images using Convolutional Neural Networks (CNNs). CNNs are a class of machine learning algorithms specifically designed for processing structured grid data that have gained popularity in recent years due to their remarkable performance in various computer vision tasks, including image classification, object detection, and image segmentation. In this research, we have generated the large irradiated TRISO layer dataset with more than 2000 cross-section TRISO microscopic images and the corresponding annotated images. Based on these annotated images, we have employed different CNNs for automatic segmentation of different TRISO layers. These include RU-Net (developed in this study), as well as three existing architectures: U-Net, Residual Network (ResNet), and Attention U-Net. The preliminary results show that the model based on RU-Net has the best performance in terms of intersection-over-union (IoU). Through the aid of these CNN models, we can expedite the analysis of TRISO particle cross-sections, significantly reducing the manual labor involved and improving the objectivity of the segmentation results.

Convolutional Neural Networks↗

The Precision Segmented Reflector program - On-orbit thermal behavior of the Submillimeter Imager and Line Survey telescope

The Precision Segmented Reflector program and the Submillimeter Imager and Line Survey mission are overviewed. The temperature requirements, thermal design and environment, as well as the on-orbit thermal performance of a 3.65-m-diameter passively-cooled submillimeter-wavelength telescope are discussed, and focus is placed on the geometric and thermal mathematical models employed in the study. Attention is given to an inflatable space-rigidized sunshade protecting the primary mirror thermally and the highly elliptical orbit chosen to reduce heat input from the earth. Primary-reflector temperature predictions are shown to indicate that a large spatial gradient can exist and the magnitude of the gradient is a strong function of the telescope pitch angle. It is suggested that the cryostat outer-shell temperature may be further lowered with the introduction of a rectangular shield between a solar array and the cryostat.

Tsuyuki, G.↗

High-resolution imaging gamma-ray spectroscopy with externally segmented germanium detectors

Externally segmented germanium detectors promise a breakthrough in gamma-ray imaging capabilities while retaining the superb energy resolution of germanium spectrometers. An angular resolution of 0.2 deg becomes practical by combining position-sensitive germanium detectors having a segment thickness of a few millimeters with a one-dimensional coded aperture located about a meter from the detectors. Correspondingly higher angular resolutions are possible with larger separations between the detectors and the coded aperture. Two-dimensional images can be obtained by rotating the instrument. Although the basic concept is similar to optical or X-ray coded-aperture imaging techniques, several complicating effects arise because of the penetrating nature of gamma rays. The complications include partial transmission through the coded aperture elements, Compton scattering in the germanium detectors, and high background count rates. Extensive electron-photon Monte Carlo modeling of a realistic detector/coded-aperture/collimator system has been performed. Results show that these complicating effects can be characterized and accounted for with no significant loss in instrument sensitivity.

Callas, J. L.↗

Fine-tuning TrailMap: The utility of transfer learning to improve the performance of deep learning in axon segmentation of light-sheet microscopy images

Light-sheet microscopy has made possible the 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual undertaking. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through optimizing transfer learning. We fine-tuned the existing TrailMap model using expert-labeled data from noradrenergic axonal structures in the mouse brain. By changing the cross-entropy weights and using augmentation, we demonstrate a generally improved adjusted F1-score over using the originally trained TrailMap model within our test datasets.

97 MATHEMATICS AND COMPUTING↗

Data-driven Mapping of the Mouse Connectome: The utility of transfer learning to improve the performance of deep learning models performing axon segmentation on light-sheet microscopy images

Light sheet microscopy has made possible the high temporal and spatial 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual process. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through the application of refinements such as transfer learning.

59 BASIC BIOLOGICAL SCIENCES↗

Electron and Proton Auroral Dynamics

Data from the Wide-band Imaging Camera (WIC) sensitive to far ultraviolet auroras and from the Spectrographic Imager (SI) channel SI12, sensitive to proton precipitation induced Lyman alpha were analyzed during a high altitude orbit segment of the IMAGE spacecraft. This segment began during the expansive phase of a substorm. The aurora changed into a double oval configuration, consisting of a set of discrete pole-ward forms and a separate diffuse auroral oval equatorwards, Although IMF Bz was strongly southward considerable activity could be seen poleward of the discrete auroras in the region that was considered to be the polar cap. The SI12 Doppler shifted Lyman alpha signature of precipitating protons show that the proton aurora is on the equatorward side of the diffuse aurora. In the following several hours the IMF Bz field changed signed. Although the general character of the proton and electron aurora did not change, the dayside aurora moved equatorward when the Bz was negative and more bright aurora was seen in the central polar cap during periods of positive Bz.

Mende, S. B.↗

Achromatic shearing phase sensor for generating images indicative of measure(s) of alignment between segments of a segmented telescope's mirrors

An achromatic shearing phase sensor generates an image indicative of at least one measure of alignment between two segments of a segmented telescope's mirrors. An optical grating receives at least a portion of irradiance originating at the segmented telescope in the form of a collimated beam and the collimated beam into a plurality of diffraction orders. Focusing optics separate and focus the diffraction orders. Filtering optics then filter the diffraction orders to generate a resultant set of diffraction orders that are modified. Imaging optics combine portions of the resultant set of diffraction orders to generate an interference pattern that is ultimately imaged by an imager.

Stahl, H. Philip↗

Material Characterization and Geometric Segmentation of a Composite Structure Using Microfocus X-Ray Computed Tomography Image-Based Finite Element Modeling

This study utilizes microfocus x-ray computed tomography (CT) slice sets to model and characterize the damage locations and sizes in thermal protection system materials that underwent impact testing. ScanIP/FE software is used to visualize and process the slice sets, followed by mesh generation on the segmented volumetric rendering. Then, the local stress fields around several of the damaged regions are calculated for realistic mission profiles that subject the sample to extreme temperature and other severe environmental conditions. The resulting stress fields are used to quantify damage severity and make an assessment as to whether damage that did not penetrate to the base material can still result in catastrophic failure of the structure. It is expected that this study will demonstrate that finite element modeling based on an accurate three-dimensional rendered model from a series of CT slices is an essential tool to quantify the internal macroscopic defects and damage of a complex system made out of thermal protection material. Results obtained showing details of segmented images; three-dimensional volume-rendered models, finite element meshes generated, and the resulting thermomechanical stress state due to impact loading for the material are presented and discussed. Further, this study is conducted to exhibit certain high-caliber capabilities that the nondestructive evaluation (NDE) group at NASA Glenn Research Center can offer to assist in assessing the structural durability of such highly specialized materials so improvements in their performance and capacities to handle harsh operating conditions can be made.

Abdul-Aziz, Ali↗

EDS-PhaSe: Phase Segmentation and Analysis from EDS Elemental Map Images Using Markers of Elemental Segregation

Scanning electron microscopy (SEM), combined with energy-dispersive spectroscopy (EDS), is an extensively used technique for in-depth microstructural analysis. Here, we present the EDS-Phase Segmentation (EDS-PhaSe) tool that enables phase segmentation and phase analysis using the EDS elemental map images. Importantly, it converts the EDS map images into estimated composition maps for calculating markers of selective elemental redistribution in the scanned area and creates a phase-segmented micrograph while providing approximate fraction and composition of each identified phase. EDS-PhaSe offers two unique advantages. Firstly, it enables the direct processing of EDS elemental map images without requiring any raw or proprietary data/software, thereby allowing the analysis of EDS results available in the published literature as images. Secondly, it enables segmentation and analysis of phases even when the phase contrast is missing in backscattered micrographs, assisting in correlating the XRD and SEM-EDS data as shown in this work for a AlCoCrFeNi high-entropy alloy.

36 MATERIALS SCIENCE↗

SpArcFiRe: Scalable automated detection of spiral galaxy arm segments

Given an approximately centered image of a spiral galaxy, we describe an entirely automated method that finds, centers, and sizes the galaxy (possibly masking nearby stars and other objects if necessary in order to isolate the galaxy itself) and then automatically extracts structural information about the spiral arms. For each arm segment found, we list the pixels in that segment, allowing image analysis on a per-arm-segment basis. We also perform a least-squares fit of a logarithmic spiral arc to the pixels in that segment, giving per-arc parameters, such as the pitch angle, arm segment length, location, etc. The algorithm takes about one minute per galaxies, and can easily be scaled using parallelism. We have run it on all ∼644,000 Sloan objects that are larger than 40 pixels across and classified as 'galaxies'. We find a very good correlation between our quantitative description of a spiral structure and the qualitative description provided by Galaxy Zoo humans. Our objective, quantitative measures of structure demonstrate the difficulty in defining exactly what constitutes a spiral 'arm', leading us to prefer the term 'arm segment'. We find that pitch angle often varies significantly segment-to-segment in a single spiral galaxy, making it difficult to define the pitch angle for a single galaxy. We demonstrate how our new database of arm segments can be queried to find galaxies satisfying specific quantitative visual criteria. For example, even though our code does not explicitly find rings, a good surrogate is to look for galaxies having one long, low-pitch-angle arm—which is how our code views ring galaxies. SpArcFiRe is available at http://sparcfire.ics.uci.edu.

79 ASTRONOMY AND ASTROPHYSICS↗

A Machine Learning Approach to Quantitative Analysis of Enamel Microstructure from Scanning Electron Microscopy Images

Dental enamel, the outermost tissue of mammalian teeth, must withstand a lifetime of wear and cyclic contact. To meet this demand, enamel possesses a combination of high hardness and resistance to fracture, properties that are typically mutually exclusive. The impressive damage tolerance has been attributed largely to decussation of the enamel rods, the principal unit of its microstructure. As such, enamel is inspiring the design of next‐generation structural materials. However, quantitative descriptions of the decussated enamel rod microstructure remain limited due to challenges encountered in applying computed tomography and in acquiring quality images appropriate for traditional digital processing methods. Here, a machine learning segmentation method is applied to images of the enamel obtained using scanning electron microscopy to support quantitative analysis of the microstructure. A pretrained convolutional neural network is used to expand the input training image dataset to allow the training of a random forest classifier, which ultimately segments the image with a very small training set ( n = 3 images). A validation of this segmentation method is presented, in addition to its application to calculate relevant microstructural parameters for images of tooth enamel from selected mammalian species. The methodology applied here is equally applicable to other hard tissues.

36 MATERIALS SCIENCE↗