Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “3D segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Automated quantitative 3D analysis of aorta size, morphology, and mural calcification distributions

Purpose: The purpose of this work is to develop a fully automated pipeline to compute aorta morphology and calcification measures in large cohorts of CT scans that can be used to investigate the potential of these measures as imaging biomarkers of cardiovascular disease. Methods: The first step of the automated pipeline is aorta segmentation. The algorithm the authors propose first detects an initial aorta boundary by exploiting cross-sectional circularity of aorta in axial slices and aortic arch in reformatted oblique slices. This boundary is then refined by a 3D level-set segmentation that evolves the boundary to the location of nearby edges. The authors then detect the aortic calcifications with thresholding and filter out the false positive regions due to nearby high intensity structures based on their anatomical location. The authors extract the centerline and oblique cross sections of the segmented aortas and compute the aorta morphology and calcification measures of the first 2500 subjects from COPDGene study. These measures include volume and number of calcified plaques and measures of vessel morphology such as average cross-sectional area, tortuosity, and arch width. Results: The authors computed the agreement between the algorithm and expert segmentations on 45 CT scans and obtained a closest point mean error of 0.62 ± 0.09 mm and a Dice coefficient of 0.92 ± 0.01. The calcification detection algorithm resulted in an improved true positive detection rate of 0.96 compared to previous work. The measurements of aorta size agreed with the measurements reported in previous work. The initial results showed associations of aorta morphology with calcification and with aging. These results may indicate aorta stiffening and unwrapping with calcification and aging. Conclusions: The authors have developed an objective tool to assess aorta morphology and aortic calcium plaques on CT scans that may be used to provide information about the presence of cardiovascular disease and its clinical impact in smokers.

60 APPLIED LIFE SCIENCES↗

Structural switching dynamically controls the doubly pseudoknotted Rous sarcoma virus–programmed ribosomal frameshifting element

A hallmark of retrovirus replication is the translation of two different polyproteins from one RNA through programmed –1 frameshifting. This is a mechanism in which the actively translating ribosome is induced to slip in the 5′ direction at a defined codon and then continues translating in the new reading frame. Programmed frameshifting controls the stoichiometry of viral proteins and is therefore under stringent evolutionary selection. Forty years ago, the first frameshifting stimulatory element was discovered in the Rous sarcoma virus. The ~120 nt RNA segment was predicted to contain a pseudoknot, but its 3D structure has remained elusive. Now, we have determined cryoEM and X-ray crystallographic structures of this classic retroviral element, finding that it adopts a butterfly-like double-pseudoknot fold. One “wing” contains a dynamic pyrimidine-rich helix, observed crystallographically in two conformations and in a third conformation via cryoEM. The other wing encompasses the predicted pseudoknot, which interacts with a second unexpected pseudoknot through a toggle residue, A2546. This key purine switches conformations between structural states and tunes the stability of interacting residues in the two wings. We find that its mutation can modulate frameshifting by as much as 50-fold, likely by altering the relative abundance of different structural states in the conformational ensemble of the RNA. Taken together, our structure–function analyses reveal how a dynamic double pseudoknot junction stimulates frameshifting by taking advantage of conformational heterogeneity, supporting a multistate model in which high Shannon entropy enhances frameshifting efficiency.

Science & Technology - Other Topics↗

Three Dimensional Urban Characterization by IFSAR Measurements

In this paper a machine vision approach is applied to Interferometric Synthetic Aperture Radars (IFSAR) data to extract the most relevant built structures in a dense urban environment. The algorithm tries to cluster primitives (line segments) into more complex surfaces (planes) to approximate the 3D shape of these objects. Very interesting results starting from TOPSAR data recorded over S, Monica are presented.

Gamba, P.↗

Dual X-ray computed tomography-aided classification of melt pool boundaries and flaws in crept additively manufactured parts

In metal additive manufacturing (AM), understanding the process-structure-performance relationships requires a combination of multi-scale characterization techniques that allows for the measurement of the melt pool shape and boundary and classifying various defects and flaws in the AM parts. Such approaches can be destructive, only 2D in nature, or have a small field of view and can be complex to co-register and analyze. Here, in this work, we present a non-destructive 3D inspection technique that employs dual-energy X-ray computed tomography (XCT) along with a model-based iterative reconstruction (MBIR) and a new segmentation algorithm. The proposed approach and algorithm are not only capable of classifying and quantifying flaws such as pores, cracks, and inclusions, but they also allow for the extraction of microstructural features such as melt pool boundaries (MPB) and melt pool regions (MPR), that can help understand process-structure-performance relationships for alloys under study. As an exemplar application, we employed the method for characterization of an additively manufactured aluminum alloy crept under tensile stress at 300 °C for 1064 h. Our results demonstrate high quality segmentation and classification of various flaws and MPB and MPR, for the first time, using 3D X-ray CT inspection. The delineated MPB and MPR in the crept samples reveal the preferential growth paths of cracks that formed during creep deformation. The technique was used for successfully quantifying the characteristics (number of defects, their density, volume fraction, etc.) of the manufacturing-induced pores and creep-induced cracks, which is necessary to better understand the creep failure mechanisms of the material.

36 MATERIALS SCIENCE↗

Quantitative Analysis Of Three-dimensional Branching Systems From X-ray Computed Microtomography Data

Branching structures such as lungs, blood vessels and plant roots play a critical role in life. Growth, structure, and function of these branching structures have an immense effect on our lives. Therefore, quantitative size information on such structures in their native environment is invaluable for studying their growth and the effect of the environment on them. X-ray computed tomography (XCT) has been an effective tool for in situ imaging and analysis of branching structures. We developed a costless tool that approximates the surface and volume of branching structures. Our methodology of noninvasive imaging, segmentation and extraction of quantitative information is demonstrated through the analysis of a plant root in its soil medium from 3D tomography data. XCT data collected on a grass specimen was used to visualize its root structure. A suite of open-source software was employed to segment the root from the soil and determine its isosurface, which was used to calculate its volume and surface. This methodology of processing 3D data is applicable to other branching structures even when the structure of interest is of similar x-ray attenuation to its environment and difficulties arise with sample segmentation.

Environmental Molecular Sciences Laboratory↗

SU-F-J-140: Using Handheld Stereo Depth Cameras to Extend Medical Imaging for Radiation Therapy Planning

Purpose: A correct body contour is essential for the accuracy of dose calculation in radiation therapy. While modern medical imaging technologies provide highly accurate representations of body contours, there are times when a patient’s anatomy cannot be fully captured or there is a lack of easy access to CT/MRI scanning. Recently, handheld cameras have emerged that are capable of performing three dimensional (3D) scans of patient surface anatomy. By combining 3D camera and medical imaging data, the patient’s surface contour can be fully captured. Methods: A proof-of-concept system matches a patient surface model, created using a handheld stereo depth camera (DC), to the available areas of a body contour segmented from a CT scan. The matched surface contour is then converted to a DICOM structure and added to the CT dataset to provide additional contour information. In order to evaluate the system, a 3D model of a patient was created by segmenting the body contour with a treatment planning system (TPS) and fabricated with a 3D printer. A DC and associated software were used to create a 3D scan of the printed phantom. The surface created by the camera was then registered to a CT model that had been cropped to simulate missing scan data. The aligned surface was then imported into the TPS and compared with the originally segmented contour. Results: The RMS error for the alignment between the camera and cropped CT models was 2.26 mm. Mean distance between the aligned camera surface and ground truth model was −1.23 +/−2.47 mm. Maximum deviations were < 1 cm and occurred in areas of high concavity or where anatomy was close to the couch. Conclusion: The proof-of-concept study shows an accurate, easy and affordable method to extend medical imaging for radiation therapy planning using 3D cameras without additional radiation. Intel provided the camera hardware used in this study.

60 APPLIED LIFE SCIENCES↗

Scaling deep learning for material imaging with a pseudo 3D model for domain transfer

The recent introduction of deep learning methods for image processing has greatly advanced the characterization of materials using three-dimensional (3D) X-ray imaging techniques. However, deep learning models often have difficulty performing consistently across images owing to unavoidable variations in imaging conditions, which create inconsistencies even for the same material. As a result, networks must frequently be retrained for new datasets, limiting their applicability and generalization. Thus, it is critical to reduce the variations between images to enable a single model to process multiple datasets. Herein, we introduce P3T-Net, a pseudo-3D domain transfer network that transfers diverse 3D images into a uniform domain before processing using deep learning models. Remarkably, P3T-Net enables the reuse of previously trained networks for processing new images and considerably reduces the computational cost of transferring 3D images across domains. These unique capabilities were demonstrated in the following scenarios: (i) image enhancement of fast scans for geological rock and hydrogen fuel cells, (ii) enhancement of images to match the quality of multi-source imaging for lithium-ion batteries, (iii) accurate segmentation of images captured under different conditions, and (iv) tera-scale 3D transfer (10 11 voxels) on a single GPU. Overall, the proposed approach addresses cross-domain inconsistencies across various materials and conditions, thereby enabling more robust and generalizable deep learning solutions for a wide range of material imaging tasks.

25 ENERGY STORAGE↗

A VR-based volumetric medical image segmentation and visualization system with natural human interaction

Volume rendering produces informative two-dimensional (2D) images from a 3-dimensional (3D) volume. It highlights the region of interest and facilitates a good comprehension of the entire data set. However, volume rendering faces a few challenges. First, a high-dimensional transfer function is usually required to differentiate the target from its neighboring objects with subtle variance. Unfortunately, designing such a transfer function is a strenuously trial-and-error process. Second, manipulating/visualizing a 3D volume with a traditional 2D input/output device suffers dimensional limitations. To address all the challenges, we design NUI-VR 2 , a natural user interface-enabled volume rendering system in the virtual reality space. NUI-VR 2 marries volume rendering and interactive image segmentation. It transforms the original volume into a probability map with image segmentation. A simple linear transfer function will highlight the target well in the probability map. More importantly, we set the entire image segmentation and volume rendering pipeline in an immersive virtual reality environment with a natural user interface. NUI-VR 2 eliminates the dimensional limitations in manipulating and perceiving 3D volumes and dramatically improves the user experience.

42 ENGINEERING↗

A knowledge-based object recognition system for applications in the space station

A knowledge-based three-dimensional (3D) object recognition system is being developed. The system uses primitive-based hierarchical relational and structural matching for the recognition of 3D objects in the two-dimensional (2D) image for interpretation of the 3D scene. At present, the pre-processing, low-level preliminary segmentation, rule-based segmentation, and the feature extraction are completed. The data structure of the primitive viewing knowledge-base (PVKB) is also completed. Algorithms and programs based on attribute-trees matching for decomposing the segmented data into valid primitives were developed. The frame-based structural and relational descriptions of some objects were created and stored in a knowledge-base. This knowledge-base of the frame-based descriptions were developed on the MICROVAX-AI microcomputer in LISP environment. The simulated 3D scene of simple non-overlapping objects as well as real camera data of images of 3D objects of low-complexity have been successfully interpreted.

Dhawan, Atam P.↗

TomoEncoders: 3D Autoencoders for feature extraction in X-ray tomography

Real-time steering of time-resolved or in-situ X-ray tomography requires capturing changes in morphological descriptors in a sample (e.g., porosity, particle size, and crack width) during continuous data acquisition. Image segmentation (2D or3D) followed by quantitative measurement is the conventional method for tracking changes in these descriptors with respect to a previous time-step or a 3D search in a volume. However, image segmentation is expensive. As a faster and unsupervised alternative, a feature-extraction approach using a convolutional autoencoders was developed, where the latent space of the encoder responds to relative changes in morphology with-out prior knowledge of the morphological descriptors.

TEKAWADE, ANIKET↗

A primitive-based 3D object recognition system

An intermediate-level knowledge-based system for decomposing segmented data into three-dimensional primitives was developed to create an approximate three-dimensional description of the real world scene from a single two-dimensional perspective view. A knowledge-based approach was also developed for high-level primitive-based matching of three-dimensional objects. Both the intermediate-level decomposition and the high-level interpretation are based on the structural and relational matching; moreover, they are implemented in a frame-based environment.

Dhawan, Atam P.↗

2D-to-3D image translation of complex nanoporous volumes using generative networks

Image-based characterization offers a powerful approach to studying geological porous media at the nanoscale and images are critical to understanding reactive transport mechanisms in reservoirs relevant to energy and sustainability technologies such as carbon sequestration, subsurface hydrogen storage, and natural gas recovery. Nanoimaging presents a trade off, however, between higher-contrast sample-destructive and lower-contrast sample-preserving imaging modalities. Furthermore, high-contrast imaging modalities often acquire only 2D images, while 3D volumes are needed to characterize fully a source rock sample. In this work, we present deep learning image translation models to predict high-contrast focused ion beam-scanning electron microscopy (FIB-SEM) image volumes from transmission X-ray microscopy (TXM) images when only 2D paired training data is available. We introduce a regularization method for improving 3D volume generation from 2D-to-2D deep learning image models and apply this approach to translate 3D TXM volumes to FIB-SEM fidelity. We then segment a predicted FIB-SEM volume into a flow simulation domain and calculate the sample apparent permeability using a lattice Boltzmann method (LBM) technique. Results show that our image translation approach produces simulation domains suitable for flow visualization and allows for accurate characterization of petrophysical properties from non-destructive imaging data.

58 GEOSCIENCES↗

Data for "High-resolution microCT reveals relationships between stomata and interior leaf anatomy in Sorghum"

Includes three different types of stacks, in two folders: "REC_RAW_STACKS.zip" contains: (1) Raw gray-scale reconstructed microCT x-ray scans, in the form of individual stacks per sample. "ML_STACKS.zip" contains: (2) Stacks that have been labeled using a machine-learning mask-RCNN pipeline identifying epidermis, mesophyll, airspace, vascular bundle, and background. (3) Stacks that have stomata locations labeled using a small point. The three types of stacks were used to calculate a variety of anatomical and physiological traits, using ImageJ Macros provided on Github: https://github.com/leakey-lab/microCT-Macros-Fischer. Young leaves from WT and transgenic Sorghum plants. CSV "microCT_REC2_META.csv" contains metadata, including sample/sub-sample labels.

3D↗

Pixel Array Germanium Detectors for Nuclear Physics (Final Technical Report)

The Department of Energy (DOE) Office of Nuclear Physics supports the development and maintenance of germanium gamma-ray detector arrays at national laboratories and universities. Germanium gamma-ray detectors provide state-of-the-art gamma-ray energy resolution, making them critical for gamma-ray and x-ray spectroscopy in Nuclear Physics. Furthermore, detector segmentation and charge-signal waveform processing enables 3-dimensional (3D) measurement of gamma-ray interaction locations needed for the highest-fidelity Nuclear Physics experiments. Attaining and maintaining excellent gamma-ray energy resolution depends largely on the naturally excellent charge-collection properties of germanium crystals. However, the optimal method for achieving the best practical 3D spatial resolution within the detector volume at high counting rates is less clear.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Differentiated mouse kidney tubuloids as a novel in vitro model to study collecting duct physiology

Kidney tubuloids are cell models that are derived from human or mouse renal epithelial cells and show high similarities with their in vivo counterparts. Tubuloids grow polarized in 3D, allow for long-term expansion, and represent multiple segments of the nephron, as shown by their gene expression pattern. In addition, human tubuloids form tight, functional barriers and have been succesfully used for drug testing. Our knowledge of mouse tubuloids, on the other hand, is only minimal. In this study, we further characterized mouse tubuloids and differentiated them towards the collecting duct, which led to a significant upregulation of collecting duct-specific mRNAs of genes and protein expression, including the water channel AQP2 and the sodium channel ENaC. Differentiation resulted in polarized expression of collecting duct water channels AQP2 and AQP3. Also, a physiological response to desmopressin and forskolin stimulation by translocation of AQP2 to the apical membrane was demonstrated. Furthermore, amiloride-sensitive ENaC-mediated sodium uptake was shown in differentiated tubuloids using radioactive tracer sodium. This study demonstrates that mouse tubuloids can be differentiated towards the collecting duct and exhibit collecting duct-specific function. This illustrates the potential use of mouse kidney tubuloids as novel in vitro models to study (patho)physiology of kidney diseases.

59 BASIC BIOLOGICAL SCIENCES↗

Three-Dimensional Imaging and Numerical Reconstruction of Graphite/Epoxy Composite Microstructure Based on Ultra-High Resolution X-Ray Computed Tomography

A combined experimental and computational study aimed at high-resolution 3D imaging, visualization, and numerical reconstruction of fiber-reinforced polymer microstructures at the fiber length scale is presented. To this end, a sample of graphite/epoxy composite was imaged at sub-micron resolution using a 3D X-ray computed tomography microscope. Next, a novel segmentation algorithm was developed, based on concepts adopted from computer vision and multi-target tracking, to detect and estimate, with high accuracy, the position of individual fibers in a volume of the imaged composite. In the current implementation, the segmentation algorithm was based on Global Nearest Neighbor data-association architecture, a Kalman filter estimator, and several novel algorithms for virtualfiber stitching, smoothing, and overlap removal. The segmentation algorithm was used on a sub-volume of the imaged composite, detecting 508 individual fibers. The segmentation data were qualitatively compared to the tomographic data, demonstrating high accuracy of the numerical reconstruction. Moreover, the data were used to quantify a) the relative distribution of individual-fiber cross sections within the imaged sub-volume, and b) the local fiber misorientation relative to the global fiber axis. Finally, the segmentation data were converted using commercially available finite element (FE) software to generate a detailed FE mesh of the composite volume. The methodology described herein demonstrates the feasibility of realizing an FE-based, virtual-testing framework for graphite/fiber composites at the constituent level.

Czabaj, M. W.↗

Automated bone segmentation from dental CBCT images using patch-based sparse representation and convex optimization

Purpose: Cone-beam computed tomography (CBCT) is an increasingly utilized imaging modality for the diagnosis and treatment planning of the patients with craniomaxillofacial (CMF) deformities. Accurate segmentation of CBCT image is an essential step to generate three-dimensional (3D) models for the diagnosis and treatment planning of the patients with CMF deformities. However, due to the poor image quality, including very low signal-to-noise ratio and the widespread image artifacts such as noise, beam hardening, and inhomogeneity, it is challenging to segment the CBCT images. In this paper, the authors present a new automatic segmentation method to address these problems. Methods: To segment CBCT images, the authors propose a new method for fully automated CBCT segmentation by using patch-based sparse representation to (1) segment bony structures from the soft tissues and (2) further separate the mandible from the maxilla. Specifically, a region-specific registration strategy is first proposed to warp all the atlases to the current testing subject and then a sparse-based label propagation strategy is employed to estimate a patient-specific atlas from all aligned atlases. Finally, the patient-specific atlas is integrated into amaximum a posteriori probability-based convex segmentation framework for accurate segmentation. Results: The proposed method has been evaluated on a dataset with 15 CBCT images. The effectiveness of the proposed region-specific registration strategy and patient-specific atlas has been validated by comparing with the traditional registration strategy and population-based atlas. The experimental results show that the proposed method achieves the best segmentation accuracy by comparison with other state-of-the-art segmentation methods. Conclusions: The authors have proposed a new CBCT segmentation method by using patch-based sparse representation and convex optimization, which can achieve considerably accurate segmentation results in CBCT segmentation based on 15 patients.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Advancements in 3D Structural Analysis of Geothermal Systems

Robust geothermal activity in the Great Basin, USA is a product of both anomalously high regional heat flow and active fault-controlled extension. Elevated permeability associated with some fault systems provides pathways for circulation of geothermal fluids. Constraining the local-scale 3D geometry of these structures and their roles as fluid flow conduits is crucial in order to mitigate both the costs and risks of geothermal exploration and to identify blind (no surface expression) geothermal resources. Ongoing studies have indicated that much of the robust geothermal activity in the Great Basin is associated with high density faulting at structurally complex fault intersection/interaction areas, such as accommodation/transfer zones between discrete fault systems, step-overs or relay ramps in fault systems, intersection zones between faults with different strikes or different senses of slip, and horse-tailing fault terminations. These conceptualized models are crucial for locating and characterizing geothermal systems in a regional context. At the local scale, however, pinpointing drilling targets and characterizing resource potential within known or probable geothermal areas requires precise 3D characterization of the system. Employing a variety of surface and subsurface data sets, we have conducted detailed 3D geologic analyses of two Great Basin geothermal systems. Using EarthVision (Dynamic Graphics Inc., Alameda, CA) we constructed 3D geologic models of both the actively producing Brady’s geothermal system and a ‘greenfield’ geothermal prospect at Astor Pass, NV. These 3D models allow spatial comparison of disparate data sets in 3D and are the basis for quantitative structural analyses that can aid geothermal resource assessment and be used to pinpoint discrete drilling targets. The relatively abundant data set at Brady’s, ~80 km NE of Reno, NV, includes 24 wells with lithologies interpreted from careful analysis of cuttings and core, a 1:24,000 scale detailed geologic map and cross-sections, 2D seismic reflection profiles and other geophysical data, and downhole temperature data. The 3D geologic model based on these data consists of 61 fault planes, 25 distinct stratigraphic units, and 2 intrusive bodies. Geothermal fluids are produced from a left step-over/relay ramp within the Brady’s Fault Zone (BFZ). Under local stress conditions, fault segments that strike NNE-to-NE are most likely to slip and/or dilate, and therefore transmit geothermal fluids. The 3D model defines the locations of discrete fault intersections within the BFZ and indicates that the densest zones of structurally controlled fracture permeability are ~10-to-10s of meters in diameter and plunge ~55° NW-NNW beneath the heart of the BFZ step over. The locations of high intersection density, high fault slip and dilation tendency, high subsurface temperature, and lithologies known to support high fracture permeability are combined to produce 3D ‘fairway’ maps useful in both assessments of geothermal resource potential and for defining drilling targets. Astor Pass is located on the Pyramid Lake Paiute Reservation, ~80 km north of Reno, NV. It is a prospective ‘greenfield’ geothermal area, and thus subsurface data are relatively sparse. Available data include: two relatively deep wells (~1400 m) and one shallower well (~500 m) with lithologies interpreted from drill cuttings, several 2D seismic reflection profiles, a 1:24,000 scale geologic map and cross-section, a shallow temperature survey, and downhole temperature data. 3D modeling based on these data has defined 19 distinct fault planes and 16 stratigraphic units. Based on the stress field calculated from borehole breakouts, drilling induced tensile cracks and petal-centerline cracks in the two relatively deep wells, 3D slip and dilation tendency analysis indicates that northerly striking fault segments are most likely to slip and/or dilate, and therefore transmit geothermal fluids. Analysis of fault intersection density indicates that the highest density of structurally controlled permeability within the field lies in a narrow (10-to-10s of m) zone plunging moderately (~35°) to the NNW beneath Pleistocene tufa deposits. This zone of increased fracture density, which we interpret as the primary upflow zone, is controlled by the intersection of N-to-NNW striking normal faults and a WNW striking dextral fault zone and represents the most promising target for future drilling. Construction of a 3D geologic model involves integration of a variety of data into an internally consistent framework. A robust model allows for spatial comparison between the various types of data (structural, stratigraphic, geophysical, temperature, etc.) that are commonly used independently to site geothermal wells. Furthermore, highly detailed 3D geologic models provide the basis for additional quantitative analysis, including 3D fault slip and dilation tendency analysis and the precise location of structurally controlled permeability pathways. These analyses provide detailed information relating to the internal dynamics of geothermal systems and can mitigate the costs and risks of geothermal exploration and development by contributing to better well targeting and more accurate evaluations of resource potential.

15 GEOTHERMAL ENERGY↗