Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “3D segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Automatic Segmentation of Building Envelope Point Cloud Data Using Machine Learning

About 50% of buildings in the US were constructed before energy codes were introduced. Modular overclad panel retrofits, in which a new envelope is constructed over the existing building, are a promising solution given that it minimizes occupant disruption and shortens construction time at the jobsite. Current state-of-the-art retrofit panel layout and dimensioning consists of three steps: 1) 3D point cloud data generation of the building envelope using commonly available surveying equipment, 2) manual segmentation of 3D point cloud data by a trained professional to identify and dimension window openings, door openings, and other architectural features, and 3) modular panel layout optimization and dimensioning by an architect or engineer. Among these steps, the second one remains the most difficult and costly because it is very labor-intensive. We propose a methodology to automatically label 3D point cloud data to reduce the time and expense spent in manual segmentation. Machine learning methods were employed to classify the point cloud data into distinct groups, each of which corresponds to different features of the building envelope. After classification, a segmentation algorithm was developed to perform boundary detection and separate the components of the façade. Finally, the algorithm returns the relative positions and dimensions of the features in the building envelope. The measurements obtained with the proposed automated method were compared against the actual dimensions to determine the overall algorithm accuracy. The proposed algorithm can then be used to reduce manual efforts for 3D point cloud labeling before modular panel layout optimization is performed.

Maldonado Puente, Bryan↗

WE-D-18A-05: Construction of Realistic Liver Phantoms From Patient Images and a Commercial 3D Printer

Purpose: To assess image quality and radiation dose reduction in abdominal CT imaging, physical phantoms having realistic background textures and lesions are highly desirable. The purpose of this work was to construct a liver phantom with realistic background and lesions using patient CT images and a 3D printer. Methods: Patient CT images containing liver lesions were segmented into liver tissue, contrast-enhanced vessels, and liver lesions using commercial software (Mimics, Materialise, Belgium). Stereolithography (STL) files of each segmented object were created and imported to a 3D printer (Object350 Connex, Stratasys, MN). After test scans were performed to map the eight available printing materials into CT numbers, printing materials were assigned to each object and a physical liver phantom printed. The printed phantom was scanned on a clinical CT scanner and resulting images were compared with the original patient CT images. Results: The eight available materials used to print the liver phantom had CT number ranging from 62 to 117 HU. In scans of the liver phantom, the liver lesions and veins represented in the STL files were all visible. Although the absolute value of the CT number in the background liver material (approx. 85 HU) was higher than in patients (approx. 40 HU), the difference in CT numbers between lesions and background were representative of the low contrast values needed for optimization tasks. Future work will investigate materials with contrast sufficient to emulate contrast-enhanced arteries. Conclusion: Realistic liver phantoms can be constructed from patient CT images using a commercial 3D printer. This technique may provide phantoms able to determine the effect of radiation dose reduction and noise reduction techniques on the ability to detect subtle liver lesions in the context of realistic background textures.

60 APPLIED LIFE SCIENCES↗

Direct Write of 3D Nanoscale Mesh Objects with Platinum Precursor via Focused Helium Ion Beam Induced Deposition

The next generation optical, electronic, biological, and sensing devices as well as platforms will inevitably extend their architecture into the 3rd dimension to enhance functionality. In focused ion beam induced deposition (FIBID), a helium gas field ion source can be used with an organometallic precursor gas to fabricate nanoscale structures in 3D with high-precision and smaller critical dimensions than focused electron beam induced deposition (FEBID), traditional liquid metal source FIBID, or other additive manufacturing technology. In this work, we report the effect of beam current, dwell time, and pixel pitch on the resultant segment and angle growth for nanoscale 3D mesh objects. We note subtle beam heating effects, which impact the segment angle and the feature size. Additionally, we investigate the competition of material deposition and sputtering during the 3D FIBID process, with helium ion microscopy experiments and Monte Carlo simulations. Our results show complex 3D mesh structures measuring ~300 nm in the largest dimension, with individual features as small as 16 nm at full width half maximum (FWHM). These assemblies can be completed in minutes, with the underlying fabrication technology compatible with existing lithographic techniques, suggesting a higher-throughput pathway to integrating FIBID with established nanofabrication techniques.

36 MATERIALS SCIENCE↗

Comparative Study of 3-Dimensional Woven Joint Architectures for Composite Spacecraft Structures

The National Aeronautics and Space Administration (NASA) Exploration Systems Mission Directorate initiated an Advanced Composite Technology (ACT) Project through the Exploration Technology Development Program in order to support the polymer composite needs for future heavy lift launch architectures. As an example, the large composite structural applications on Ares V inspired the evaluation of advanced joining technologies, specifically 3D woven composite joints, which could be applied to segmented barrel structures needed for autoclave cured barrel segments due to autoclave size constraints. Implementation of these 3D woven joint technologies may offer enhancements in damage tolerance without sacrificing weight. However, baseline mechanical performance data is needed to properly analyze the joint stresses and subsequently design/down-select a preform architecture. Six different configurations were designed and prepared for this study; each consisting of a different combination of warp/fill fiber volume ratio and preform interlocking method (Z-fiber, fully interlocked, or hybrid). Tensile testing was performed for this study with the enhancement of a dual camera Digital Image Correlation (DIC) system which provides the capability to measure full-field strains and three dimensional displacements of objects under load. As expected, the ratio of warp/fill fiber has a direct influence on strength and modulus, with higher values measured in the direction of higher fiber volume bias. When comparing the Z-fiber weave to a fully interlocked weave with comparable fiber bias, the Z-fiber weave demonstrated the best performance in two different comparisons. We report the measured tensile strengths and moduli for test coupons from the 6 different weave configurations under study.

Jones, Justin S.↗

Automatic point Cloud Building Envelope Segmentation (Auto-CuBES) using Machine Learning

Modern retrofit construction practices use 3D point cloud data of the building envelope to obtain the as-built dimensions. However, manual segmentation by a trained professional is required to identify and measure window openings, door openings, and other architectural features, making the use of 3D point clouds labor-intensive. In this study, the Automatic point Cloud Building Envelope Segmentation (Auto-CuBES) algorithm is described, which can significantly reduce the time spent during point cloud segmentation. The Auto-CuBES algorithm inputs a 3D point cloud generated by commonly available surveying equipment and outputs a wire-frame model of the building envelope. Unsupervised machine learning methods were used to identify facades, windows, and doors while minimizing the number of calibration parameters. Additionally, Auto-CuBES generates a heat map of each facade indicating non-planar characteristics that are crucial for the optimization of connections used in overclad envelope retrofits. With a scan resolution of 3 mm, the resulting window dimensions showed a mean absolute error of 4.2 mm compared to manual laser measurements.

Maldonado Puente, Bryan↗

Spacesuit and Mobility Performance Changes

The complex interactions between the human body and spacesuit lead to changes inmovement patterns and mobility performancesof the wearer. In general, factors including the geometric properties, such as shape and size, mechanical properties of the suit, and pressurization of the suit are known to be associated with altered movement patterns as compared to an unsuited human.However, their relative contributions have not been explicitly quantified from the mobility performance perspectives. The goal of this study wasthus to assessthe effects fromthe different types of mobility constraintconditions, namely by wearing either a 3D printed hard upper torso (HUT) assembly orfully pressurized spacesuit. The outcome was also compared against the unsuited motions. For this study, an xEMU (exploration Extravehicular Mobility Unit) suitwas considered, which is the next generation spacesuit developed by NASA. In each test condition, the subject was asked to move the arm and hand as prescribedfor different task types, and the corresponding body segment locations were recordedusing a 3D motion capture system. The following three tasks were performedand analyzed: 1) Outward one-handed reaches:the subject in a standing pose made sweeping motions with the extended right arm from the extreme end-to-end positions, including side-to-side at different elevations and top-to-bottom at different azimuths. 2) Outward two-handed reaches:similarto the previous task, howeverthe subject kept the hands together during the motions in order to assessthe areas that can be reached by both hands. 3) Inward one-handed reaches:the subject made right-hand reach motions to the surface of the HUT.The hand traces collected from each task were modeled by a template shape parametrically deformed with a radial basis function. This process enabled foran abstraction of the hand traces into a smooth surface envelope representing the maximally reachable area of the test subject, of which the shapes and sizes were compared across the different test conditions. The preliminary analysis has shown that theoverall size of reachenvelopes decreases in a pressurized suit compared to 3D printed mockup HUT and unsuited conditions. The specific shape of the envelopes, which were determined by the reachable and unreachable zones, alsovary with the testconditions, and the differences werepronounced with the inward reaches to the HUT surface. The latter observation ispotentially relatedto the increased demandfor shoulder and elbow flexions.Overcomingthe resistance from the pressurizedsoft goods and mechanical constraints of the shoulder assemblywas seen to be associated with the difference in motion patterns between the suited and unsuited conditions. Overall, the information quantified from this study is expected to provide structured metrics for spacesuit mobility, which can improve design optimization and human-system integration.

K Han Kim↗

3D printer generated thorax phantom with mobile tumor for radiation dosimetry

This article describes the design, construction, and properties of an anthropomorphic thorax phantom with a moving surrogate tumor. This novel phantom permits detection of dose both inside and outside a moving tumor and within the substitute lung tissue material. A 3D printer generated the thorax shell composed of a chest wall, spinal column, and posterior regions of the phantom. Images of a computed tomography scan of the thorax from a patient with lung cancer provided the template for the 3D printing. The plastic phantom is segmented into two materials representing the muscle and bones, and its geometry closely matches a patient. A surrogate spherical plastic tumor controlled by a 3D linear stage simulates a lung tumor’s trajectory during normal breathing. Sawdust emulates the lung tissue in terms of average and distribution in Hounsfield numbers. The sawdust also provides a forgiving medium that permits tumor motion and sandwiching of radiochromic film inside the mobile surrogate plastic tumor for dosimetry. A custom cork casing shields the film and tumor and eliminates film bending during extended scans. The phantom, lung tissue surrogate, and radiochromic film are exposed to a seven field plan based on an ECLIPSE plan for 6 MV photons from a Trilogy machine delivering 230 cGy to the isocenter. The dose collected in a sagittal plane is compared to the calculated plan. Gamma analysis finds 8.8% and 5.5% gamma failure rates for measurements of large amplitude trajectory and static measurements relative to the large amplitude plan, respectively. These particular gamma analysis results were achieved using parameters of 3% dose and 3 mm, for regions receiving doses >150 cGy. The plan assumes a stationary detection grid unlike the moving radiochromic film and tissues. This difference was experimentally observed and motivated calculated dose distributions that incorporated the phase of the tumor periodic motion. These calculations modestly improve agreement between the measured and intended doses.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Technical Note: Radiological properties of tissue surrogates used in a multimodality deformable pelvic phantom for MR-guided radiotherapy

Purpose: Phantom surrogates were developed to allow multimodal [computed tomography (CT), magnetic resonance imaging (MRI), and teletherapy] and anthropomorphic tissue simulation as well as materials and methods to construct deformable organ shapes and anthropomorphic bone models. Methods: Agarose gels of variable concentrations and loadings were investigated to simulate various soft tissue types. Oils, fats, and Vaseline were investigated as surrogates for adipose tissue and bone marrow. Anthropomorphic shapes of bone and organs were realized using 3D-printing techniques based on segmentations of patient CT-scans. All materials were characterized in dual energy CT and MRI to adapt CT numbers, electron density, effective atomic number, as well as T1- and T2-relaxation times to patient and literature values. Results: Soft tissue simulation could be achieved with agarose gels in combination with a gadolinium-based contrast agent and NaF to simulate muscle, prostate, and tumor tissues. Vegetable oils were shown to be a good representation for adipose tissue in all modalities. Inner bone was realized using a mixture of Vaseline and K{sub 2}HPO{sub 4}, resulting in both a fatty bone marrow signal in MRI and inhomogeneous areas of low and high attenuation in CT. The high attenuation of outer bone was additionally adapted by applying gypsum bandages to the 3D-printed hollow bone case with values up to 1200 HU. Deformable hollow organs were manufactured using silicone. Signal loss in the MR images based on the conductivity of the gels needs to be further investigated. Conclusions: The presented surrogates and techniques allow the customized construction of multimodality, anthropomorphic, and deformable phantoms as exemplarily shown for a pelvic phantom, which is intended to study adaptive treatment scenarios in MR-guided radiation therapy.

61 RADIATION PROTECTION AND DOSIMETRY↗

Quantifying the unknown impact of segmentation uncertainty on image-based simulations

Abstract Image-based simulation, the use of 3D images to calculate physical quantities, relies on image segmentation for geometry creation. However, this process introduces image segmentation uncertainty because different segmentation tools (both manual and machine-learning-based) will each produce a unique and valid segmentation. First, we demonstrate that these variations propagate into the physics simulations, compromising the resulting physics quantities. Second, we propose a general framework for rapidly quantifying segmentation uncertainty. Through the creation and sampling of segmentation uncertainty probability maps, we systematically and objectively create uncertainty distributions of the physics quantities. We show that physics quantity uncertainty distributions can follow a Normal distribution, but, in more complicated physics simulations, the resulting uncertainty distribution can be surprisingly nontrivial. We establish that bounding segmentation uncertainty can fail in these nontrivial situations. While our work does not eliminate segmentation uncertainty, it improves simulation credibility by making visible the previously unrecognized segmentation uncertainty plaguing image-based simulation.

42 ENGINEERING↗

Application of morphological synthesis for understanding electrode microstructure evolution as a function of applied charge/discharge cycles

Morphological analysis and synthesis operations were employed for analysis of electrode microstructure transformations and evolution accompanying the application of charge/discharge cycles to electrochemical storage systems (batteries). Using state-of-the-art morphological algorithms, it was possible to predict microstructure evolution in porous Si electrodes for Li-ion batteries with sufficient accuracy. Algorithms for image analyses (segmentation, feature extraction, and 3D-reconstructions using 2D-images) were also developed. Altogether, these techniques could be considered supplementary to phase-field mesoscopic approach to microstructure evolution that is based upon clear and definitive changes in the appearance of microstructure. However, unlike in phase-field, the governing equations for morphological approach are geometry-, not physics-based. Similar non-physics based approach to understanding different phenomena was attempted with the introduction of cellular automata. It is anticipated that morphological synthesis and analysis will represent a useful supplementary tool to phase-field and will render assistance to unraveling the underlying microstructure-property relationships. The paper contains data on electrochemical characterization of different electrode materials that was conducted in parallel to morphological study.

25 ENERGY STORAGE↗

X-ray microscopy of soft and hard human tissues

The simultaneous post mortem visualization of soft and hard tissues using absorption-based CT remains a challenge. If the photon energy is optimized for the visualization of hard tissue, the surrounding soft tissue components are almost X-ray transparent. Therefore, the combination with other modalities such as phase-contrast CT, magnetic resonance microscopy, and histology is essential to detect the anatomical features. The combination of the 2D and 3D data sets using sophisticated segmentation and registration tools allows for conclusions about otherwise inaccessible anatomical features essential for improved patient treatments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

What can we learn from in-soil imaging of a live plant: X-ray Computed Tomography and 3D numerical simulation of root-soil system

Plant roots play a critical role in plant-soil-microbe interactions that occur in the rhizosphere, as well as processes with important implications to farming, forest management and climate change. X-ray computed tomography (XCT) has been proven to be an effective tool for non-invasive root imaging and analysis. A combination of XCT, open-source software, and our own code was used to noninvasively image a prairie dropseed (Sporobolus heterolepis) specimen, segment the root data to obtain a 3D image of the root structure at 31µm resolution, and extract quantitative information (root volume and surface area) from the 3D data, respectively. Based on the mesh generated from the root structure, computational fluid dynamics (CFD) simulations were applied to numerically investigate the root-soil-groundwater system. The plant root conductivity, soil hydraulic conductivity and transpiration rate were shown to control the groundwater distribution. The flow variability and soil water distributions under different scenarios were investigated. Parameterizations were evaluated to show their impacts on the average conductivity. The pore-scale modeling approach provides realistic simulations of rhizosphere flow processes and provides useful information that can be linked to upscaled models.

54 ENVIRONMENTAL SCIENCES↗

Deep learning-based segmentation of lithium-ion battery microstructures enhanced by artificially generated electrodes

Accurate 3D representations of lithium-ion battery electrodes, in which the active particles, binder and pore phases are distinguished and labeled, can assist in understanding and ultimately improving battery performance. Here, we demonstrate a methodology for using deep-learning tools to achieve reliable segmentations of volumetric images of electrodes on which standard segmentation approaches fail due to insufficient contrast. We implement the 3D U-Net architecture for segmentation, and, to overcome the limitations of training data obtained experimentally through imaging, we show how synthetic learning data, consisting of realistic artificial electrode structures and their tomographic reconstructions, can be generated and used to enhance network performance. We apply our method to segment x-ray tomographic microscopy images of graphite-silicon composite electrodes and show it is accurate across standard metrics. We then apply it to obtain a statistically meaningful analysis of the microstructural evolution of the carbon-black and binder domain during battery operation.

25 ENERGY STORAGE↗

Automatic segmentation of the glenohumeral cartilages from magnetic resonance images

Purpose: Magnetic resonance (MR) imaging plays a key role in investigating early degenerative disorders and traumatic injuries of the glenohumeral cartilages. Subtle morphometric and biochemical changes of potential relevance to clinical diagnosis, treatment planning, and evaluation can be assessed from measurements derived from in vivo MR segmentation of the cartilages. However, segmentation of the glenohumeral cartilages, using approaches spanning manual to automated methods, is technically challenging, due to their thin, curved structure and overlapping intensities of surrounding tissues. Automatic segmentation of the glenohumeral cartilages from MR imaging is not at the same level compared to the weight-bearing knee and hip joint cartilages despite the potential applications with respect to clinical investigation of shoulder disorders. In this work, the authors present a fully automated segmentation method for the glenohumeral cartilages using MR images of healthy shoulders. Methods: The method involves automated segmentation of the humerus and scapula bones using 3D active shape models, the extraction of the expected bone–cartilage interface, and cartilage segmentation using a graph-based method. The cartilage segmentation uses localization, patient specific tissue estimation, and a model of the cartilage thickness variation. The accuracy of this method was experimentally validated using a leave-one-out scheme on a database of MR images acquired from 44 asymptomatic subjects with a true fast imaging with steady state precession sequence on a 3 T scanner (Siemens Trio) using a dedicated shoulder coil. The automated results were compared to manual segmentations from two experts (an experienced radiographer and an experienced musculoskeletal anatomist) using the Dice similarity coefficient (DSC) and mean absolute surface distance (MASD) metrics. Results: Accurate and precise bone segmentations were achieved with mean DSC of 0.98 and 0.93 for the humeral head and glenoid fossa, respectively. Mean DSC scores of 0.74 and 0.72 were obtained for the humeral and glenoid cartilage volumes, respectively. The manual interobserver reliability evaluated by DSC was 0.80 ± 0.03 and 0.76 ± 0.04 for the two cartilages, implying that the automated results were within an acceptable 10% difference. The MASD between the automatic and the corresponding manual cartilage segmentations was less than 0.4 mm (previous studies reported mean cartilage thickness of 1.3 mm). Conclusions: This work shows the feasibility of volumetric segmentation and separation of the glenohumeral cartilages from MR images. To their knowledge, this is the first fully automated algorithm for volumetric segmentation of the individual glenohumeral cartilages from MR images. The approach was validated against manual segmentations from experienced analysts. In future work, the approach will be validated on imaging datasets acquired with various MR contrasts in patients.

60 APPLIED LIFE SCIENCES↗

SU-E-J-108: Solving the Chinese Postman Problem for Effective Contour Deformation

Purpose: To develop a practical approach for accurate contour deformation when deformable image registration (DIR) is used for atlas-based segmentation or contour propagation in image-guided radiotherapy. Methods: A contour deformation approach was developed on the basis of 3D mesh operations. The 2D contours represented by a series of points in each slice were first converted to a 3D triangular mesh, which was deformed by the deformation vectors resulting from DIR. A set of parallel 2D planes then cut through the deformed 3D mesh, generating unordered points and line segments, which should be reorganized into a set of 2D contour points. It was realized that the reorganization problem was equivalent to solving the Chinese Postman Problem (CPP) by traversing a graph built from the unordered points with the least cost. Alternatively, deformation could be applied to a binary mask converted from the original contours. The deformed binary mask was then converted back into contours at the CT slice locations. We performed a qualitative comparison to validate the mesh-based approach against the image-based approach. Results: The DIR could considerably change the 3D mesh, making complicated 2D contour representations after deformation. CPP was able to effectively reorganize the points in 2D planes no matter how complicated the 2D contours were. The mesh-based approach did not require a post-processing of the contour, thus accurately showing the actual deformation in DIR. The mesh-based approach could keep some fine details and resulted in smoother contours than the image-based approach did, especially for the lung structure. Image-based approach appeared to over-process contours and suffered from image resolution limits. The mesh-based approach was integrated into in-house DIR software for use in routine clinic and research. Conclusion: We developed a practical approach for accurate contour deformation. The efficiency of this approach was demonstrated in both clinic and research applications. This work was partially supported by Cancer Prevention & Research Institute of Texas (CPRIT) RP110562.

60 APPLIED LIFE SCIENCES↗

Automatic Point Cloud Building Envelope Segmentation (AutoCuBES)

The Auto-CuBES algorithm is based on unsupervised machine learning that automatically labels 3D point cloud data and reduces the time spent in manual segmentation. The algorithm can process high-resolution point clouds and generate a wire-frame building envelope model with a small set of calibration parameters. The algorithm inputs a 3D point cloud generated by commonly available surveying equipment and outputs a wire-frame model of the building envelope. Unsupervised machine learning methods were used to identify facades, windows, and doors while minimizing the number of calibration parameters.

Puente, BryanMaldonado↗

Influence of Standard Image Processing of 3D X-ray Microscopy on Morphology, Topology and Effective Properties

Estimating porous media properties is a vital component of geosciences and the physics of porous media. Until now, imaging techniques have focused on methodologies to match image-derived flows or geomechanical parameters with experimentally identified values. Less emphasis has been placed on the compromise between image processing techniques and the consequences on topological and morphological characteristics and on computed properties such as permeability. The effects of some of the most popular image processing techniques (filtering and segmentation) available in open source on 3D X-ray Microscopy (micro-XRM) images are qualitatively and quantitatively discussed. We observe the impacts of various filters such as erosion-dilation and compare the efficiency of Otsu’s method of thresholding and the machine-learning-based software Ilastik for segmentation.

58 GEOSCIENCES↗

TU-H-207A-03: CT Hounsfield Unit Accuracy: Effect of Beam Hardening On Phantom and Clinical Whole-Body CT Images

Purpose: To assess the effect of beam hardening on measured CT HU values. Methods: An anthropomorphic knee phantom was scanned with the CT component of a GE Discovery 690 PET/CT scanner (120kVp, 300mAs, 40?0.625mm collimation, pitch=0.984, FOV=500mm, matrix=512?512) with four different scan setups, each of which induces different degrees of beam hardening by introducing additional attenuation media into the field of view. Homogeneous voxels representing “soft tissue” and “bone” were segmented by HU thresholding followed by a 3D morphological erosion operation which removes the non-homogenous voxels located on the interface of thresholded tissue mask. HU values of segmented “soft tissue” and “bone” were compared.Additionally, whole-body CT data with coverage from the skull apex to the end of toes were retrospectively retrieved from seven PET/CT exams to evaluate the effect of beam hardening in vivo. Homogeneous bone voxels were segmented with the same method previously described. Total In-Slice Attenuation (TISA) for each CT slice, defined as the summation of HU values over all voxels within a CT slice, was calculated for all slices of the seven whole-body CT datasets and evaluated against the mean HU values of homogeneous bone voxels within that slice. Results: HU values measured from the phantom showed that while “soft tissue” HU values were unaffected, added attenuation within the FOV caused noticeable decreases in the measured HU values of “bone” voxels. A linear relationship was observed between bone HU and TISA for slices of the torso and legs, but not of the skull. Conclusion: Beam hardening effect is not an issue of concern for voxels with HU in the soft tissue range, but should not be neglected for bone voxels. A linear relationship exists between bone HU and the associated TISA in non-skull CT slices, which can be exploited to develop a correction strategy.

60 APPLIED LIFE SCIENCES↗