Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
NASA NTRS1987

Constraint-based stereo matching

The major difficulty in stereo vision is the correspondence problem that requires matching features in two stereo images. Researchers describe a constraint-based stereo matching technique using local geometric constraints among edge segments to limit the search space and to resolve matching ambiguity. Edge segments are used as image features for stereo matching. Epipolar constraint and individual edge properties are used to determine possible initial matches between edge segments in a stereo image pair. Local edge geometric attributes such as continuity, junction structure, and edge neighborhood relations are used as constraints to guide the stereo matching process. The result is a locally consistent set of edge segment correspondences between stereo images. These locally consistent matches are used to generate higher-level hypotheses on extended edge segments and junctions to form more global contexts to achieve global consistency.

Kuan, D. T.↗
DOE OSTI2016

TU-AB-202-11: Tumor Segmentation by Fusion of Multi-Tracer PET Images Using Copula Based Statistical Methods

Purpose: Multi-tracer PET imaging is getting more attention in radiotherapy by providing additional tumor volume information such as glucose and oxygenation. However, automatic PET-based tumor segmentation is still a very challenging problem. We propose a statistical fusion approach to joint segment the sub-area of tumors from the two tracers FDG and FMISO PET images. Methods: Non-standardized Gamma distributions are convenient to model intensity distributions in PET. As a serious correlation exists in multi-tracer PET images, we proposed a new fusion method based on copula which is capable to represent dependency between different tracers. The Hidden Markov Field (HMF) model is used to represent spatial relationship between PET image voxels and statistical dynamics of intensities for each modality. Real PET images of five patients with FDG and FMISO are used to evaluate quantitatively and qualitatively our method. A comparison between individual and multi-tracer segmentations was conducted to show advantages of the proposed fusion method. Results: The segmentation results show that fusion with Gaussian copula can receive high Dice coefficient of 0.84 compared to that of 0.54 and 0.3 of monomodal segmentation results based on individual segmentation of FDG and FMISO PET images. In addition, high correlation coefficients (0.75 to 0.91) for the Gaussian copula for all five testing patients indicates the dependency between tumor regions in the multi-tracer PET images. Conclusion: This study shows that using multi-tracer PET imaging can efficiently improve the segmentation of tumor region where hypoxia and glucidic consumption are present at the same time. Introduction of copulas for modeling the dependency between two tracers can simultaneously take into account information from both tracers and deal with two pathological phenomena. Future work will be to consider other families of copula such as spherical and archimedian copulas, and to eliminate partial volume effect by considering dependency between neighboring voxels.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

Interactive lung segmentation in abnormal human and animal chest CT scans

Purpose: Many medical image analysis systems require segmentation of the structures of interest as a first step. For scans with gross pathology, automatic segmentation methods may fail. The authors’ aim is to develop a versatile, fast, and reliable interactive system to segment anatomical structures. In this study, this system was used for segmenting lungs in challenging thoracic computed tomography (CT) scans. Methods: In volumetric thoracic CT scans, the chest is segmented and divided into 3D volumes of interest (VOIs), containing voxels with similar densities. These VOIs are automatically labeled as either lung tissue or nonlung tissue. The automatic labeling results can be corrected using an interactive or a supervised interactive approach. When using the supervised interactive system, the user is shown the classification results per slice, whereupon he/she can adjust incorrect labels. The system is retrained continuously, taking the corrections and approvals of the user into account. In this way, the system learns to make a better distinction between lung tissue and nonlung tissue. When using the interactive framework without supervised learning, the user corrects all incorrectly labeled VOIs manually. Both interactive segmentation tools were tested on 32 volumetric CT scans of pigs, mice and humans, containing pulmonary abnormalities. Results: On average, supervised interactive lung segmentation took under 9 min of user interaction. Algorithm computing time was 2 min on average, but can easily be reduced. On average, 2.0% of all VOIs in a scan had to be relabeled. Lung segmentation using the interactive segmentation method took on average 13 min and involved relabeling 3.0% of all VOIs on average. The resulting segmentations correspond well to manual delineations of eight axial slices per scan, with an average Dice similarity coefficient of 0.933. Conclusions: The authors have developed two fast and reliable methods for interactive lung segmentation in challenging chest CT images. Both systems do not require prior knowledge of the scans under consideration and work on a variety of scans.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

Evaluation of a deformable registration algorithm for subsequent lung computed tomography imaging during radiochemotherapy

Purpose: Rating both a lung segmentation algorithm and a deformable image registration (DIR) algorithm for subsequent lung computed tomography (CT) images by different evaluation techniques. Furthermore, investigating the relative performance and the correlation of the different evaluation techniques to address their potential value in a clinical setting. Methods: Two to seven subsequent CT images (69 in total) of 15 lung cancer patients were acquired prior, during, and after radiochemotherapy. Automated lung segmentations were compared to manually adapted contours. DIR between the first and all following CT images was performed with a fast algorithm specialized for lung tissue registration, requiring the lung segmentation as input. DIR results were evaluated based on landmark distances, lung contour metrics, and vector field inconsistencies in different subvolumes defined by eroding the lung contour. Correlations between the results from the three methods were evaluated. Results: Automated lung contour segmentation was satisfactory in 18 cases (26%), failed in 6 cases (9%), and required manual correction in 45 cases (66%). Initial and corrected contours had large overlap but showed strong local deviations. Landmark-based DIR evaluation revealed high accuracy compared to CT resolution with an average error of 2.9 mm. Contour metrics of deformed contours were largely satisfactory. The median vector length of inconsistency vector fields was 0.9 mm in the lung volume and slightly smaller for the eroded volumes. There was no clear correlation between the three evaluation approaches. Conclusions: Automatic lung segmentation remains challenging but can assist the manual delineation process. Proven by three techniques, the inspected DIR algorithm delivers reliable results for the lung CT data sets acquired at different time points. Clinical application of DIR demands a fast DIR evaluation to identify unacceptable results, for instance, by combining different automated DIR evaluation methods.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Online thermal profile prediction for large format additive manufacturing: A hybrid CNN-LSTM based approach

Large format additive manufacturing (LFAM) is an advanced 3D printing technique that efficiently fabricates large-scale components through a layer-by-layer extrusion and deposition process. Accurate surface layer temperature monitoring is essential to prevent manufacturing failures and ensure final product quality. Traditional physics-based offline approaches for simulating thermal behavior are often inefficient and complex, posing challenges on real-time, in-situ monitoring. Here, to address this, we propose a data-driven hybrid CNN-LSTM model to predict sequential thermal images of arbitrary length using real-time infrared thermal imaging. In this approach, a Convolutional Neural Networks (CNN) is trained offline to capture spatial features, reduce dimensional complexity, and enhance time efficiency, while a stacked Long Short-Term Memory (LSTM) is applied online to capture temporal information for improved prediction of future thermal behavior in subsequent printing layers. Model performance is evaluated using MSE, SSIM, and PSNR metrics and is benchmarked against stacked LSTM and convolutional LSTM models, demonstrating superior accuracy and applicability. Additionally, to mitigate noise from moving extruders and gantry backgrounds in thermal images, a fine-tuned semantic segmentation model is implemented offline to extract printing geometry, enabling precise temperature tracking along the tool path for further thermal analysis. The frameworks developed in this study significantly advance temperature monitoring, thermal analysis, and in-situ manufacturing control for LFAM, bridging the gap between theoretical modeling and practical application.

Geometry extraction↗
DOE OSTI2014

SU-E-I-52: Validation of Multi-Frequency Electrical Impedance Tomography Using Computed Tomography

Purpose: Multi-frequency EIT has been reported to be a potential tool in distinguishing a tissue anomaly from background. In this study, we investigate the feasibility of acquiring functional information by comparing multi-frequency EIT images in reference to the structural information from the CT image through fusion. Methods: EIT data was acquired from a slice of winter melon using sixteen electrodes around the phantom, injecting a current of 0.4mA at 100, 66, 24.8 and 9.9 kHz. Differential EIT images were generated by considering different combinations of pair frequencies, one serving as reference data and the other as test data. The experiment was repeated after creating an anomaly in the form of an off-centered cavity of diameter 4.5 cm inside the melon. All EIT images were reconstructed using Electrical Impedance Tomography and Diffuse Optical Tomography Reconstruction Software (EIDORS) package in 2-D differential imaging mode using one-step Gaussian Newton minimization solver. CT image of the melon was obtained using a Phillips CT Scanner. A segmented binary mask image was generated based on the reference electrode position and the CT image to define the regions of interest. The region selected by the user was fused with the CT image through logical indexing. Results: Differential images based on the reference and test signal frequencies were reconstructed from EIT data. Result illustrated distinct structural inhomogeneity in seeded region compared to fruit flesh. The seeded region was seen as a higherimpedance region if the test frequency was lower than the base frequency in the differential EIT reconstruction. When the test frequency was higher than the base frequency, the signal experienced less electrical impedance in the seeded region during the EIT data acquisition. Conclusion: Frequency-based differential EIT imaging can be explored to provide additional functional information along with structural information from CT for identifying different tissues.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2015

TU-AB-BRA-06: Texture Feature Reproducibility Between PET/CT and PET/MR Imaging Modalities

Purpose: Radiomics involves the extraction of texture features from different imaging modalities with the purpose of developing models to predict patient treatment outcomes. The purpose of this study is to investigate texture feature reproducibility across [18F]FDG PET/CT and [18F]FDG PET/MR imaging in patients with primary malignancies. Methods: Twenty five prospective patients with solid tumors underwent clinical [18F]FDG PET/CT scan followed by [18F]FDG PET/MR scans. In all patients the lesions were identified using nuclear medicine reports. The images were co-registered and segmented using an in-house auto-segmentation method. Fifty features, based on the intensity histogram, second and high order matrices, were extracted from the segmented regions from both image data sets. One-way random-effects ANOVA model of the intra-class correlation coefficient (ICC) was used to establish texture feature correlations between both data sets. Results: Fifty features were classified based on their ICC values, which were found in the range from 0.1 to 0.86, in three categories: high, intermediate, and low. Ten features extracted from second and high-order matrices showed large ICC ≥ 0.70. Seventeen features presented intermediate 0.5 ≤ ICC ≤ 0.65 and the remaining twenty three presented low ICC ≤ 0.45. Conclusion: Features with large ICC values could be reliable candidates for quantification as they lead to similar results from both imaging modalities. Features with small ICC indicates a lack of correlation. Therefore, the use of these features as a quantitative measure will lead to different assessments of the same lesion depending on the imaging modality from where they are extracted. This study shows the importance of the need for further investigation and standardization of features across multiple imaging modalities.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-F-J-220: Micro-CT Based Quantification of Mouse Brain Vasculature: The Effects of Acquisition Technique and Contrast Material

Purpose: Cognitive impairment from radiation therapy to the brain may be linked to the loss of total blood volume in the brain. To account for brain injury, it is crucial to develop an understanding of blood volume loss as a result of radiation therapy. This study investigates µCT based quantification of mouse brain vasculature, focusing on the effect of acquisition technique and contrast material. Methods: Four mice were scanned on a µCT scanner (Siemens Inveon). The reconstructed voxel size was 18µm3 and all protocols were Hounsfield Unit (HU) calibrated. The mice were injected with 40mg of gold nanoparticles (MediLumine) or 100µl of Exitron 12000 (Miltenyi Biotec). Two acquisition techniques were also performed. A single kVp technique scanned the mouse once using an x-ray beam of 80kVp and segmentation was completed based on a threshold of HU values. The dual kVp technique scanned the mouse twice using 50kVp and 80kVp, this segmentation was based on the ratio of the HU value of the two kVps. After image reconstruction and segmentation, the brain blood volume was determined as a percentage of the total brain volume. Results: For the single kVp acquisition at 80kVp, the brain blood volume had an average of 3.5% for gold and 4.0% for Exitron 12000. Also at 80kVp, the contrast-noise ratio was significantly better for images acquired with the gold nanoparticles (2.0) than for those acquired with the Exitron 12000 (1.4). The dual kVp acquisition shows improved separation of skull from vasculature, but increased image noise. Conclusion: In summary, the effects of acquisition technique and contrast material for quantification of mouse brain vasculature showed that gold nanoparticles produced more consistent segmentation of brain vasculature than Exitron 12000. Also, dual kVp acquisition may improve the accuracy of brain vasculature quantification, although the effect of noise amplification warrants further study.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1993

Gamma-ray imaging with germanium detectors

Externally segmented germanium detectors promise a breakthrough in gamma-ray imaging capabilities while retaining the superb energy resolution of germanium spectrometers. By combining existing position-sensitive detectors with an appropriate code aperture, two-dimensional imaging with 0.2-deg angular resolution becomes practical for a typical balloon experiment. Much finer resolutions are possible with larger separations between detectors and the coded aperture as would be applicable for space-based or lunar-based observatories. Two coaxial germanium detectors divided into five external segments have been fabricated and have undergone extensive performance evaluation and imaging testing in our laboratory. These tests together with detailed Monte Carlo modeling calculations have demonstrated the great promise of this sensor technology for future gamma-ray missions.

Mahoney, W. A.↗
NASA NTRSDate not supplied

End-to-end Modeling of Lyot Coronagraph for LUVOIR: Sensitivity to Segment-Level Aberrations

Direct imaging and spectroscopic characterization of atmospheres of Earth-like exoplanets require starlight suppression to detect a faint planetary signal at small angular separations. Future space telescopes will require segmentation to survey a statistically significant population of nearby stars systems by increasing aperture size beyond the limits set by traditional monolithic apertures; however, segmentation also represents an additional challenge due to the introduction of temporal pupil discontinuities in terms of both phase and amplitude. For this study, a baseline Lyot coronagraph is used with the Large UV / Optical /Infrared (LUVOIR) mission’s 15-m on-axis, segmented optical telescope assembly (OTA). We present a high-fidelity, end-to-end modeling approach developed as part of the Segmented Coronagraph Design and Analysis (SCDA) group that includes diffractive optical propagations at the 1e-10 contrast level across the entire optical train including the OTA and intermediate re-imaging optics inside the coronagraph instrument. We perform a tolerancing analysis to assess the contrast sensitivity to wavefront perturbations for a set of key telescope terms including segment-level low-order and mid-spatial frequency aberrations. As an input to the end-to-end telescope model, we use two industry-provided segment-level wavefront aberration datasets pertaining: (1) thermal gradients and accelerations (courtesy of Ball-Aerospace and L3-Harris), and (2) telescope dynamics including line-of-sight and segment jitter (courtesy of Lockheed-Martin). Contrast performance outputs of the coronagraph are fed into a mission design reference simulator to assess the scientific yield sensitivity. End-to-end modeling will incorporate performance improvements due to active wavefront sensing and control and/or segment-level metrology to improve system performance.

Optics↗
NASA NTRS1989

Image wavelet decomposition and applications

The general problem of computer vision has been investigated for more that 20 years and is still one of the most challenging fields in artificial intelligence. Indeed, taking a look at the human visual system can give us an idea of the complexity of any solution to the problem of visual recognition. This general task can be decomposed into a whole hierarchy of problems ranging from pixel processing to high level segmentation and complex objects recognition. Contrasting an image at different representations provides useful information such as edges. An example of low level signal and image processing using the theory of wavelets is introduced which provides the basis for multiresolution representation. Like the human brain, we use a multiorientation process which detects features independently in different orientation sectors. So, images of the same orientation but of different resolutions are contrasted to gather information about an image. An interesting image representation using energy zero crossings is developed. This representation is shown to be experimentally complete and leads to some higher level applications such as edge and corner finding, which in turn provides two basic steps to image segmentation. The possibilities of feedback between different levels of processing are also discussed.

Treil, N.↗
NASA NTRS2001

Left ventricular endocardial surface detection based on real-time 3D echocardiographic data

OBJECTIVE: A new computerized semi-automatic method for left ventricular (LV) chamber segmentation is presented. METHODS: The LV is imaged by real-time three-dimensional echocardiography (RT3DE). The surface detection model, based on level set techniques, is applied to RT3DE data for image analysis. The modified level set partial differential equation we use is solved by applying numerical methods for conservation laws. The initial conditions are manually established on some slices of the entire volume. The solution obtained for each slice is a contour line corresponding with the boundary between LV cavity and LV endocardium. RESULTS: The mathematical model has been applied to sequences of frames of human hearts (volume range: 34-109 ml) imaged by 2D and reconstructed off-line and RT3DE data. Volume estimation obtained by this new semi-automatic method shows an excellent correlation with those obtained by manual tracing (r = 0.992). Dynamic change of LV volume during the cardiac cycle is also obtained. CONCLUSION: The volume estimation method is accurate; edge based segmentation, image completion and volume reconstruction can be accomplished. The visualization technique also allows to navigate into the reconstructed volume and to display any section of the volume.

Non-NASA Center↗
DOE OSTI2015

Validation of a novel robot-assisted 3DUS system for real-time planning and guidance of breast interstitial HDR brachytherapy

Purpose: In current clinical practice, there is no integrated 3D ultrasound (3DUS) guidance system clinically available for breast brachytherapy. In this study, the authors present a novel robot-assisted 3DUS system for real-time planning and guidance of breast interstitial high dose rate (HDR) brachytherapy treatment. Methods: For this work, a new computer controlled robotic 3DUS system was built to perform a hybrid motion scan, which is a combination of a 6 cm linear translation with a 30° rotation at both ends. The new 3DUS scanner was designed to fit on a modified Kuske assembly, keeping the current template grid configuration but modifying the frame to allow the mounting of the 3DUS system at several positions. A finer grid was also tested. A user interface was developed to perform image reconstruction, semiautomatic segmentation of the surgical bed as well as catheter reconstruction and tracking. A 3D string phantom was used to validate the geometric accuracy of the reconstruction. The volumetric accuracy of the system was validated with phantoms using magnetic resonance imaging (MRI) and computed tomography (CT) images. In order to accurately determine whether 3DUS can effectively replace CT for treatment planning, the authors have compared the 3DUS catheter reconstruction to the one obtained from CT images. In addition, in agarose-based phantoms, an end-to-end procedure was performed by executing six independent complete procedures with both 14 and 16 catheters, and for both standard and finer Kuske grids. Finally, in phantoms, five end-to-end procedures were performed with the final CT planning for the validation of 3DUS preplanning. Results: The 3DUS acquisition time is approximately 10 s. A paired Student t-test showed that there was no statistical significant difference between known and measured values of string separations in each direction. Both MRI and CT volume measurements were not statistically different from 3DUS volume (Student t-test: p > 0.05) and they were significantly correlated to 3DUS measurement (Pearson test: MRI p < 0.05 and CT p < 0.001). The mean angular separation distance between catheter trajectories segmented from 3DUS and CT images was 0.42° ± 0.24°, while the maximum and mean trajectory separations were 0.51 ± 0.19 and 0.37 ± 0.17 mm, respectively. Overall, the new finer grid has performed significantly better in terms of dosimetric indices. The planning target volume dosimetric indices were not found statistically different between 3DUS and CT planning (Student t-test, p > 0.05). Both the skin and the pectoral muscle dosimetric indices were within ABS guidelines. Conclusions: A novel robot-assisted 3DUS system was designed and validated. To their knowledge, this is the first system capable of performing real-time guidance and planning of breast multicatheter HDR brachytherapy treatments. Future investigation will test the feasibility of using the system in the clinic and for permanent breast brachytherapy.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2019

PTT System Performance Evaluation in 3-D Imaging of AM Components

Additive manufacturing (AM, or 3D printing) for commercial nuclear energy applications is an emerging method for cost-efficient manufacturing aimed at replacing aging nuclear reactor parts and reducing costs for new construction. Because of the geometry of metallic structures of interest for nuclear applications, which consist of planar primitives with no symmetry of revolution, limited options are available for non-destructive evaluation (NDE) either during or post manufacturing. Known material flaws in AM include low density regions consisting of nonsintered powder, which have to be detected to ensure the safety of long-term performance nuclear reactor components. As a solution to NDE of AM, we are developing pulsed thermal tomography (PTT) models and depth inversion algorithms for 3D imaging. PTT has many advantages because the method is non-contact and allows for in-service, NDE of AM nuclear reactor parts. By analyzing transients of surface temperature response due to internal thermal resistances, one can obtain 3D reconstructions of material effusivity using a unique inversion algorithm developed at Argonne. This study investigates the capability of PTT in imaging several AM structures fabricated from Inconel 718 (IN718) feedstock. The AM structures have complex geometry, but do not have calibrated internal defects. The objective is to determine PTT settings, such as the total integration time, for imaging of representative AM structures. A new FLIR X8500sc IR camera with higher spatial resolution (1280x1024 at 181Hz frame rate) was integrated into the PTT laboratory setup. Software tools were developed to ensure compatibility of new camera files with legacy effusivity reconstruction codes. The new camera was used to obtain 3-D reconstructions of IN718 nozzle plate and a particle filter plate. The results demonstrate the capability of PTT in 3- D imaging of complex geometry AM structures. Further, increased resolution imaging is achieved compared to prior results using older FLIR SC4000 IR camera. In addition, preliminary studies were conducted on developing image processing algorithms for automated detection of flaws. Initial demonstrations are shown for segmentation of PTT images of flat bottom hole (FBH) specimens. Imaging of FBH specimens was described in a prior report. Intermediate results demonstrated in this report will be developed further in detection of flaws in AM specimens.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1982

Automatic digital image registration

This paper introduces a general procedure for automatic registration of two images which may have translational, rotational, and scaling differences. This procedure involves (1) segmentation of the images, (2) isolation of dominant objects from the images, (3) determination of corresponding objects in the two images, and (4) estimation of transformation parameters using the center of gravities of objects as control points. An example is given which uses this technique to register two images which have translational, rotational, and scaling differences.

Goshtasby, A.↗
DOE OSTI2016

Technical Note: SCUDA: A software platform for cumulative dose assessment

Purpose: Accurate tracking of anatomical changes and computation of actually delivered dose to the patient are critical for successful adaptive radiation therapy (ART). Additionally, efficient data management and fast processing are practically important for the adoption in clinic as ART involves a large amount of image and treatment data. The purpose of this study was to develop an accurate and efficient Software platform for CUmulative Dose Assessment (SCUDA) that can be seamlessly integrated into the clinical workflow. Methods: SCUDA consists of deformable image registration (DIR), segmentation, dose computation modules, and a graphical user interface. It is connected to our image PACS and radiotherapy informatics databases from which it automatically queries/retrieves patient images, radiotherapy plan, beam data, and daily treatment information, thus providing an efficient and unified workflow. For accurate registration of the planning CT and daily CBCTs, the authors iteratively correct CBCT intensities by matching local intensity histograms during the DIR process. Contours of the target tumor and critical structures are then propagated from the planning CT to daily CBCTs using the computed deformations. The actual delivered daily dose is computed using the registered CT and patient setup information by a superposition/convolution algorithm, and accumulated using the computed deformation fields. Both DIR and dose computation modules are accelerated by a graphics processing unit. Results: The cumulative dose computation process has been validated on 30 head and neck (HN) cancer cases, showing 3.5 ± 5.0 Gy (mean±STD) absolute mean dose differences between the planned and the actually delivered doses in the parotid glands. On average, DIR, dose computation, and segmentation take 20 s/fraction and 17 min for a 35-fraction treatment including additional computation for dose accumulation. Conclusions: The authors developed a unified software platform that provides accurate and efficient monitoring of anatomical changes and computation of actually delivered dose to the patient, thus realizing an efficient cumulative dose computation workflow. Evaluation on HN cases demonstrated the utility of our platform for monitoring the treatment quality and detecting significant dosimetric variations that are keys to successful ART.

60 APPLIED LIFE SCIENCES↗