Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

MusMorph, a database of standardized mouse morphology data for morphometric meta-analyses

Complex morphological traits are the product of many genes with transient or lasting developmental effects that interact in anatomical context. Mouse models are a key resource for disentangling such effects, because they offer myriad tools for manipulating the genome in a controlled environment. Unfortunately, phenotypic data are often obtained using laboratory-specific protocols, resulting in self-contained datasets that are difficult to relate to one another for larger scale analyses. To enable meta-analyses of morphological variation, particularly in the craniofacial complex and brain, we created MusMorph, a database of standardized mouse morphology data spanning numerous genotypes and developmental stages, including E10.5, E11.5, E14.5, E15.5, E18.5, and adulthood. To standardize data collection, we implemented an atlas-based phenotyping pipeline that combines techniques from image registration, deep learning, and morphometrics. Alongside stage-specific atlases, we provide aligned micro-computed tomography images, dense anatomical landmarks, and segmentations (if available) for each specimen (N = 10,056). Our workflow is open-source to encourage transparency and reproducible data collection.

59 BASIC BIOLOGICAL SCIENCES↗

Three-Dimensional Ultrastructure of Arabidopsis Cotyledons Infected with Colletotrichum higginsianum

We used serial block-face scanning electron microscopy (SBF-SEM) to study the host–pathogen interface between Arabidopsis cotyledons and the hemibiotrophic fungus Colletotrichum higginsianum. By combining high-pressure freezing and freeze-substitution with SBF-SEM, followed by segmentation and reconstruction of the imaging volume using the freely accessible software IMOD, we created 3D models of the series of cytological events that occur during the Colletotrichum–Arabidopsis susceptible interaction. We found that the host cell membranes underwent massive expansion to accommodate the rapidly growing intracellular hypha. As the fungal infection proceeded from the biotrophic to the necrotrophic stage, the host cell membranes went through increasing levels of disintegration culminating in host cell death. Intriguingly, we documented autophagosomes in proximity to biotrophic hyphae using transmission electron microscopy (TEM) and a concurrent increase in autophagic flux between early to mid/late biotrophic phase of the infection process. Occasionally, we observed osmiophilic bodies in the vicinity of biotrophic hyphae using TEM only and near necrotrophic hyphae under both TEM and SBF-SEM. Overall, we established a method for obtaining serial SBF-SEM images, each with a lateral ( x-y) pixel resolution of 10 nm and an axial ( z) resolution of 40 nm, that can be reconstructed into interactive 3D models using the IMOD. Application of this method to the Colletotrichum–Arabidopsis pathosystem allowed us to more fully understand the spatial arrangement and morphological architecture of the fungal hyphae after they penetrate epidermal cells of Arabidopsis cotyledons and the cytological changes the host cell undergoes as the infection progresses toward necrotrophy. [Formula: see text] Copyright © 2024 The Author(s). This is an open access article distributed under the CC BY 4.0 International license .

Biochemistry & Molecular Biology↗

Detectors based on silicon photomultiplier arrays for medical imaging applications

Silicon photomultipliers (SiPMs) have experienced a fast development and are now employed in different research fields. The availability of 2D arrays that provide information of the interaction position in the detector has had a high interest for medical imaging. Continuous crystals combined with segmented photodetectors can provide higher efficiency than pixellated crystals and very high spatial resolution. The IRIS group at IFIC is working on the development of detector heads based on continuous crystals coupled to SiPM arrays for different applications, including a small animal PET scanner in collaboration with the Univ. of Pisa and INFN Pisa, and a Compton telescope for dose monitoring in hadron therapy. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SU-F-T-516: Effects of Inter-Fraction Organ Displacement/deformation On the Delivered Doses to the Heart, Esophagus, and Lungs in Patients Receiving Thoracic Radiotherapy

Purpose: To quantitatively assess the effects of inter-fraction changes in organ shape and location on the delivered dose distribution to the organs at risk (OAR) in lung cancer patients. Methods: This study analyzes treatment data of 10 patients, who were treated to 60Gy in 30 fractions. In each fraction a cone beam CT (CBCT) was acquired. Each CBCT was registered with the planning CT using deformable registration tools within MIM Software. The daily setup shifts were used to translate the planned dose distribution on the deformed planning CT. The structures of lungs, esophagus and heart were re-delineated by a physician on each CBCT. The doses delivered to each OAR, reflecting changes in the position and shape variations, were recomputed. Resultant daily dose volume histograms (DVHs) for OARs were computed and compared to those from the planning CT. Results: Based on the findings of two patients and 24 CBCTs analyzed so far, higher doses are delivered to the lungs and esophagus compared to the treatment plan. The dose differences per fraction between the delivered doses and those in the treatment plan are: for patient 1, lung mean dose = 5.3±1.3cGy and esophagus mean dose = 3.4±3.5cGy. For patient 2, lung mean dose = 12.0±3.9cGy and esophagus mean dose = 34.2±7.5cGy. Regarding the maximum dose to heart, the results varied (−18.9±22.0cGy for patient1 and 53.0±62.2cGy for patient2). Conclusion: The dosimetric effects of inter-fractional anatomical variations could be estimated using deformable image registration and manual organ segmentation for each CBCT. A considerable dose distribution variation between fractions was observed for the OARs. These changes are currently not taken into account while treating the patients and these may explain cases with severe side effects even when the treatment plan looks satisfactory. These results suggest the need for automated daily dose tracking and accumulation.

60 APPLIED LIFE SCIENCES↗

TH-AB-207A-06: The Use of Realistic Phantoms to Predict CT Dose to Pediatric Patients

Purpose: To predict pediatric patient dose from diagnostic CT scans using Monte Carlo simulation of realistic reference phantoms of various ages, weights, and heights. Methods: A series of deformable pediatric reference phantoms using Non-Uniform Rational B-Splines (NURBS) was developed for a large range of ages, percentiles, and reference anatomy. Individual bones were modeled using age-dependent factors, and red marrow was modeled as functions of age and spatial distribution based on Cristy1. Organ and effective doses for the phantom series were calculated using Monte Carlo simulation of chest, abdominopelvic, and chest-abdomen-pelvis CT exams. Non-linear regression was performed to determine the relationship between dose-length-product (DLP)-normalized organ and effective doses and phantom diameter. Patient-specific voxel computational phantoms were also created by manual segmentation of previously acquired CT images for 40 pediatric patients (0.7 to 17 years). Organ and effective doses were determined by Monte Carlo simulation of these patient-specific phantoms. Each patient was matched to the closest pediatric reference phantom based primarily on age and diameter for all major organs within the torso. Results: A total of 80 NURBS phantoms were created ranging from newborn to 15 years with height/weight percentiles from 10 to 90%. Organ and effective dose normalized by DLP correlated strongly with exponentially decreasing average phantom diameter (R{sup 2} > 0.95 for most organs). A similar relationship was determined for the patient-specific voxel phantoms. Differences between patient-phantom matched organ-dose values ranged from 0.37 to 2.39 mGy (2.87% to 22.1%). Conclusion: Dose estimation using NURBS-based pediatric reference phantoms offers the ability to predict patient dose before and after CT examinations, and physicians and scientists can use this information in their analysis of dose prescriptions for particular subjects and study types. This may lead to practices that minimize radiation dose while still achieving high quality images and, ultimately, improved patient care. NIH/NCI 1 R01 CA155400-01A1.

60 APPLIED LIFE SCIENCES↗

SkX_NN: Neural Network for skyrmion identification in Lorentz TEM

A neural network for segmenting and processing Lorentz TEM images of skyrmion lattices. This software based on U-Net architecture is capable of identifying skyrmions in out-of-focus Lorentz TEM images based on training data. This isspecifically useful for analyzing large area data from in-situ experiments.

PHATAK, CHARUDATTA↗

Developing a Massively Parallel Forward Projection Radiography Model for Large-Scale Industrial Applications

This project utilizes Graphics Processing Units (GPUs) to compute radiograph simulations for arbitrary objects. The generation of radiographs, also known as the forward projection imaging model, is computationally intensive and not widely utilized. The goal of this research is to develop a massively parallel algorithm that can compute forward projections for objects with a trillion voxels (3D pixels). To achieve this end, the data are divided into blocks that can each t into GPU memory. The forward projected image is also divided into segments to allow for future parallelization and to avoid needless computations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Advancing SiC clad fuel performance model: bridging micro- and macro-scale models and experimental validation

This report presents a workflow for advancing fuel performance modeling of SiC composite cladding for light-water reactors by linking microscale, experimental data-informed finite element analysis with rod-scale fuel performance codes such as BISON. The workflow uses X-ray computed tomography (XCT) to capture the actual geometry and processing-induced defects of as-fabricated SiC composite tube specimens, particularly porosity and wall-thickness variations, and converts the segmented XCT volumes into image-based finite element meshes for high fidelity structural analysis.

Koyanagi, Takaaki [Oak Ridge National Laboratory (↗

Single-Pol Synthetic Aperture Radar Terrain Classification using Multiclass Confidence for One-Class Classifiers

Except in the most extreme conditions, Synthetic aperture radar (SAR) is a remote sensing technology that can operate day or night. A SAR can provide surveillance over a long time period by making multiple passes over a wide area. For object-based intelligence it is convenient to segment and classify the SAR images into objects that identify various terrains and man-made structures that we call “static features.” In this paper we introduce a novel SAR image product that captures how different regions decorrelate at different rates. Using superpixels and their first two moments we develop a series of one-class classification algorithms using a goodness-of-fit metric. P-value fusion is used to combine the results from different classes. We also show how to combine multiple one-class classifiers to get a confidence about a classification. This can be used by downstream algorithms such as a conditional random field to enforce spatial constraints.

Koch, Mark William↗

ADVANCED-STEM-BASED DEEP LEARNING FOR SEMANTIC SEGMENTATION OF DEFECTS IN STEELS

In this work, we developed a novel deep convolutional neural network (DCNN) model, called DefectNet, for robust and automated semantic segmentation of three crystallographic defects including line dislocations, precipitates and voids commonly observed in structural metals and alloys. In previous work, we established an experimental protocol for a diffraction contrast imaging scanning transmission electron microscopy (DCI STEM) technique and tailored it specifically for imaging defects in popular iron-based structural alloy. Thus, the DefectNet was trained over a small but high-quality DCI STEM defect image sets of a HT-9 martensitic steel before and after neutron irradiation for 111.8 dpa at 412°C. For the defect quantification that typically takes at least half an hour even for an expert, with a good model the machine learning algorithm can produce more reproducible and reliable quantification in a few seconds. This work demonstrates the feasibility of using deep learning algorithms for fast and accurate defect quantitative analysis.

Machine Learning, Radiation effects, Image analysi↗

Cholecystokinin-Assisted Hydrodissection of the Gallbladder Fossa during FDG PET/CT-guided Liver Ablation

A 68-year-old female with colorectal cancer developed a metachronous isolated fluorodeoxyglucose-avid (FDG-avid) segment 5/6 gallbladder fossa hepatic lesion and was referred for percutaneous ablation. Pre-procedure computed tomography (CT) images demonstrated a distended gallbladder abutting the segment 5/6 hepatic metastasis. In order to perform ablation with clear margins and avoid direct puncture and aspiration of the gallbladder, cholecystokinin was administered intravenously to stimulate gallbladder contraction before hydrodissection. Subsequently, the lesion was ablated successfully with sufficient margins, of greater than 1.0 cm, using microwave with ultrasound and FDG PET/CT guidance. The patient tolerated the procedure very well and was discharged home the next day.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SU-D-207A-05: Investigating Sparse-Sampled MRI for Motion Management in Thoracic Radiotherapy

Purpose: Sparse sampling and reconstruction-based MRI techniques represent an attractive strategy to achieve sufficiently high image acquisition speed while maintaining image quality for the task of radiotherapy guidance. In this study, we examine rapid dynamic MRI using a sparse sampling sequence k-t BLAST in capturing motion-induced, cycle-to-cycle variations in tumor position. We investigate the utility of long-term MRI-based motion monitoring as a means of better characterizing respiration-induced tumor motion compared to a single-cycle 4DCT. Methods: An MRI-compatible, programmable, deformable lung motion phantom with eleven 1.5 ml water marker tubes was placed inside a 3.0 T whole-body MR scanner (Philips Ingenia). The phantom was programmed with 10 lung tumor motion traces previously recorded using the Synchrony system. 2D+t image sequences of a coronal slice were acquired using a balanced-SSFP sequence combined with k-t BLAST (accn=3, resolution=0.66×0.66×5 mm3; acquisition time = 110 ms/slice). kV fluoroscopic (ground truth) and 4DCT imaging was performed with the same phantom setup and motion trajectories. Marker positions in all three modalities were segmented and tracked using an opensource deformable image registration package, NiftyReg. Results: Marker trajectories obtained from rapid MRI exhibited <1 mm error compared to kv Fluoro trajectories in the presence of complex motion including baseline shifts and changes in respiratory amplitude, indicating the ability of MRI to monitor motion with adequate geometric fidelity for the purpose of radiotherapy guidance. In contrast, the trajectory derived from 4DCT exhibited significant errors up to 6 mm due to cycle-to-cycle variations and baseline shifts. Consequently, 4DCT was found to underestimate the range of marker motion by as much as 50%. Conclusion: Dynamic MRI is a promising tool for radiotherapy motion management as it permits for longterm, dose-free, soft-tissue-based monitoring of motion, yielding richer and more accurate information about tumor position and motion range compared to the current state-of-the-art, 4DCT. This work was partially supported through research funding from National Institutes of Health (R01CA169102).

60 APPLIED LIFE SCIENCES↗

WE-EF-BRA-04: Evaluation of Dosimetric Uncertainties in Individualized Targeted Radionuclide Therapy (TRT) Treatment Planning Using Pre-Clinical Data

Purpose: Dosimetry for targeted radionuclide therapy (TRT) is moving away from conventional model-based methods towards patient-specific approaches. To address this need, a Monte Carlo (MC) dosimetry platform was developed to estimate patient-specific therapeutic 3D dose distributions based on pre-treatment imaging. However, because a standard practice for patient-specific internal dosimetry has not yet been established, there are many sources of dosimetric uncertainties. The goal of this work was to quantify the sensitivity of various parameters on MC dose estimations. Methods: The ‘diapeutic’ agent, CLR1404, was used as a proof-of-principle compound in this work. CLR1404 can be radiolabeled with either {sup 124}I for PET imaging or {sup 131}I for radiotherapy or SPECT imaging. PET/CT images of 5 mice were acquired out to 240 hrs post-injection of {sup 124}I-CLR1404. The therapeutic {sup 131}I-CLR1404 absorbed dose (AD) distribution was calculated using a Geant4-based MC dosimetry platform. A series of sensitivity studies were performed. The variables that were investigated included the PET/CT voxel resolution, partial volume corrections (PVC), material segmentation, inter-observer contouring variability, and the pre-treatment image acquisition frequency. Results: Resampling the PET/CT voxel size between 0.2–0.8 mm resulted in up to a 13% variation in the mean AD. Application of the PVC increased the mean AD by 0.5–11.2%. Less than 1% differences in ROI mean AD were observed between the tissue segmentation schemes using 4 and 27 different material compositions. Inter-observer contouring variability led to up to a 20% CoV (stdev/mean) in the mean AD between the users. Varying the number and frequency of pre-treatment images used resulted in changes in mean AD up to 176% compared to the case using all 12 images. Conclusion: Voxel resolution, contour segmentation, the image acquisition protocol most significantly impacted patient-specific TRT dosimetry. Further work is needed to develop a standard protocol that optimizes accuracy and efficiency for patient-specific internal dosimetry. BT and JG are affiliated with Cellectar Biosciences which owns the licensing rights to CLR1404 and related compounds.

60 APPLIED LIFE SCIENCES↗

Lung tumor tracking in fluoroscopic video based on optical flow

Respiratory gating and tumor tracking for dynamic multileaf collimator delivery require accurate and real-time localization of the lung tumor position during treatment. Deriving tumor position from external surrogates such as abdominal surface motion may have large uncertainties due to the intra- and interfraction variations of the correlation between the external surrogates and internal tumor motion. Implanted fiducial markers can be used to track tumors fluoroscopically in real time with sufficient accuracy. However, it may not be a practical procedure when implanting fiducials bronchoscopically. In this work, a method is presented to track the lung tumor mass or relevant anatomic features projected in fluoroscopic images without implanted fiducial markers based on an optical flow algorithm. The algorithm generates the centroid position of the tracked target and ignores shape changes of the tumor mass shadow. The tracking starts with a segmented tumor projection in an initial image frame. Then, the optical flow between this and all incoming frames acquired during treatment delivery is computed as initial estimations of tumor centroid displacements. The tumor contour in the initial frame is transferred to the incoming frames based on the average of the motion vectors, and its positions in the incoming frames are determined by fine-tuning the contour positions using a template matching algorithm with a small search range. The tracking results were validated by comparing with clinician determined contours on each frame. The position difference in 95% of the frames was found to be less than 1.4 pixels ({approx}0.7 mm) in the best case and 2.8 pixels ({approx}1.4 mm) in the worst case for the five patients studied.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Let’s Unleash the Network Judgment: A Self-Supervised Approach for Cloud Image Analysis

Accurate cloud type identification and coverage analysis are crucial in understanding the Earth’s radiative budget. Traditional computer vision methods rely on low-level visual features of clouds for estimating cloud coverage or sky conditions. Several handcrafted approaches have been proposed; however, scope for improvement still exists. Newer deep neural networks (DNNs) have demonstrated superior performance for cloud segmentation and categorization. These methods, however, need expert engineering intervention in the preprocessing steps—in the traditional methods—or human assistance in assigning cloud or clear sky labels to a pixel for training DNNs. Such human mediation imposes considerable time and labor costs. We present the application of a new self-supervised learning approach to autonomously extract relevant features from sky images captured by ground-based cameras, for the classification and segmentation of clouds. We evaluate a joint embedding architecture that uses self-knowledge distillation plus regularization. We use two datasets to demonstrate the network’s ability to classify and segment sky images—one with ~85,000 images collected from our ground-based camera and another with 400 labeled images from the WSISEG database. We find that this approach can discriminate full-sky images based on cloud coverage, diurnal variation, and cloud base height. Additionally, it semantically segments the cloud areas without labels. The approach shows competitive performance in all tested tasks, suggesting a new alternative for cloud characterization.

54 ENVIRONMENTAL SCIENCES↗

An Iris Segmentation Algorithm based on Edge Orientation for Off-angle Iris Recognition

Iris recognition is known as one of the most accurate and reliable biometrics. However, the accuracy of iris recognition systems depends on the quality of data capture and is negatively affected by several factors such as angle, occlusion, and dilation. In this paper, we present a segmentation algorithm for off-angle iris images that uses edge detection, edge elimination, edge classification, and ellipse fitting techniques. In our approach, we first detect all candidate edges in the iris image by using the canny edge detector; this collection contains edges from the iris and pupil boundaries as well as eyelash, eyelids, iris texture etc. Edge orientation is used to eliminate the edges that cannot be part of the iris or pupil. Then, we classify the remaining edge points into two sets as pupil edges and iris edges. Finally, we randomly generate subsets of iris and pupil edge points, fit ellipses for each subset, select ellipses with similar parameters, and average to form the resultant ellipses. Based on the results from real experiments, the proposed method shows effectiveness in segmentation for off-angle iris images.

Karakaya, Mahmut↗

3D sorghum reconstructions from depth images identify QTL regulating shoot architecture

Dissecting the genetic basis of complex traits is aided by frequent and nondestructive measurements. Advances in range imaging technologies enable the rapid acquisition of three-dimensional (3D) data from an imaged scene. A depth camera was used to acquire images of sorghum (Sorghum bicolor), an important grain, forage, and bioenergy crop, at multiple developmental time points from a greenhouse-grown recombinant inbred line population. A semiautomated software pipeline was developed and used to generate segmented, 3D plant reconstructions from the images. Automated measurements made from 3D plant reconstructions identified quantitative trait loci for standard measures of shoot architecture, such as shoot height, leaf angle, and leaf length, and for novel composite traits, such as shoot compactness. The phenotypic variability associated with some of the quantitative trait loci displayed differences in temporal prevalence; for example, alleles closely linked with the sorghum Dwarf3 gene, an auxin transporter and pleiotropic regulator of both leaf inclination angle and shoot height, influence leaf angle prior to an effect on shoot height. Furthermore, variability in composite phenotypes that measure overall shoot architecture, such as shoot compactness, is regulated by loci underlying component phenotypes like leaf angle. As such, depth imaging is an economical and rapid method to acquire shoot architecture phenotypes in agriculturally important plants like sorghum to study the genetic basis of complex traits.

59 BASIC BIOLOGICAL SCIENCES↗

SU-E-J-141: Comparison of Dose Calculation On Automatically Generated MRBased ED Maps and Corresponding Patient CT for Clinical Prostate EBRT Plans

Purpose: To analyze the effect of computing radiation dose on automatically generated MR-based simulated CT images compared to true patient CTs. Methods: Six prostate cancer patients received a regular planning CT for RT planning as well as a conventional 3D fast-field dual-echo scan on a Philips 3.0T Achieva, adding approximately 2 min of scan time to the clinical protocol. Simulated CTs (simCT) where synthesized by assigning known average CT values to the tissue classes air, water, fat, cortical and cancellous bone. For this, Dixon reconstruction of the nearly out-of-phase (echo 1) and in-phase images (echo 2) allowed for water and fat classification. Model based bone segmentation was performed on a combination of the DIXON images. A subsequent automatic threshold divides into cortical and cancellous bone. For validation, the simCT was registered to the true CT and clinical treatment plans were re-computed on the simCT in pinnacle{sup 3}. To differentiate effects related to the 5 tissue classes and changes in the patient anatomy not compensated by rigid registration, we also calculate the dose on a stratified CT, where HU values are sorted in to the same 5 tissue classes as the simCT. Results: Dose and volume parameters on PTV and risk organs as used for the clinical approval were compared. All deviations are below 1.1%, except the anal sphincter mean dose, which is at most 2.2%, but well below clinical acceptance threshold. Average deviations are below 0.4% for PTV and risk organs and 1.3% for the anal sphincter. The deviations of the stratifiedCT are in the same range as for the simCT. All plans would have passed clinical acceptance thresholds on the simulated CT images. Conclusion: This study demonstrated the clinical usability of MR based dose calculation with the presented Dixon acquisition and subsequent fully automatic image processing. N. Schadewaldt, H. Schulz, M. Helle and S. Renisch are employed by Phlips Technologie Innovative Techonologies, a subsidiary of Royal Philips NV.

60 APPLIED LIFE SCIENCES↗