Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

WE-AB-303-05: Breathing Motion of Liver Segments From Fiducial Tracking During Robotic Radiosurgery and Comparison with 4D-CT-Derived Fiducial Motion

Purpose: To quantify respiratory-induced motion of liver segments using the positions of implanted fiducials during robotic radiosurgery. This study also compared fiducial motion derived from four-dimensional computed tomography (4D-CT) maximum intensity projections (MIP) with motion derived from imaging during treatment. Methods: Forty-two consecutive liver patients treated with liver ablative radiotherapy were accrued to an ethics approved retrospective study. The liver segment in which each fiducial resided was identified. Fiducial positions throughout each treatment fraction were determined using orthogonal kilovoltage images. Any data due to patient repositioning or motion was removed. Mean fiducial positions were calculated. Fiducial positions beyond two standard deviations of the mean were discarded and remaining positions were fit to a line segment using least squares minimization (LSM). For eight patients, fiducial motion was derived from 4D-CT MIPs by calculating the CT number weighted mean position of the fiducial on each slice and fitting a line segment to these points using LSM. Treatment derived fiducial trajectories were corrected for patient rotation and compared to MIP derived trajectories. Results: The mean total magnitude of fiducial motion across all liver segments in left-right, anteroposterior, and superoinferior (SI) directions were 3.0 ± 0.2 mm, 9.3 ± 0.4 mm, and 20.5 ± 0.5 mm, respectively. Differences in per-segment mean fiducial motion were found with SI motion ranging from 12.6 ± 0.8 mm to 22.6 ± 0.9 mm for segments 3 and 8, respectively. Large, varied differences between treatment and MIP derived motion at simulation were found with the mean difference for SI motion being 2.6 mm (10.8 mm standard deviation). Conclusion: The magnitude of liver fiducial motion was found to differ by liver segment. MIP derived liver fiducial motion differed from motion observed during treatment, implying that 4D-CTs may not accurately capture the range of liver motion across fractions and during treatment. Author V. Nair was funded by the Cushing estate for a SABR clinical research fellowship.

60 APPLIED LIFE SCIENCES↗

A new paradigm in electron microscopy: Automated microstructure analysis utilizing a dynamic segmentation convolutional neutral network

Over the past half century, the transmission electron microscope enabled insight into the fundamental arrangements and structures of materials. State-of-the-art electron microscopes can acquire large image datasets across multiple imaging modalities. However, the manual annotation process for feature or defect quantification may not be feasible with the modern microscope. Convolutional neural networks emerged to characterize individual microstructural features from an image in a cost-effective, consistent manner. However, many of these neural network approaches rely on thousands to hundreds of thousands of manual annotations of each feature type across hundreds of images to train the network for adequate performance. This work focused on the development and application of a pixel-wise defect detection machine-learning dynamic segmentation convolutional neural network with associated automated acquisition and postprocessing to identify microstructural features rapidly and quantitatively from a small initial dataset incorporating multiple imaging modes. The approach was demonstrated for characterization of superalloy 718 from both single image acquisition on multiple detectors to in-situ evolution captured with a single detector on a standard desktop computer to demonstrate the low barrier to entry required for widespread adoption. Pixel-by-pixel class identification was excellent with strong identification of chemically distinct phases, structurally distinct phases, and defect structures, thus demonstrating the new paradigm of machine learning-assisted characterization.

36 MATERIALS SCIENCE↗

Annular beam with segmented phase gradients

An annular beam with a single uniform-intensity ring and multiple segments of phase gradients is proposed in this paper. Different from the conventional superposed vortices, such as the modulated optical vortices and the collinear superposition of multiple orbital angular momentum modes, the designed annular beam has a doughnut intensity distribution whose radius is independent of the phase distribution of the beam in the imaging plane. The phase distribution along the circumference of the doughnut beam can be segmented with different phase gradients. Similar to a vortex beam, the annular beam can also exert torques and rotate a trapped particle owing to the orbital angular momentum of the beam. As the beam possesses different phase gradients, the rotation velocity of the trapped particle can be varied along the circumference. The simulation and experimental results show that an annular beam with three segments of different phase gradients can rotate particles with controlled velocities. The beam has potential applications in optical trapping and optical information processing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques

Digital video is rapidly becoming important for education, entertainment, and a host of multimedia applications. With the size of the video collections growing to thousands of hours, technology is needed to effectively browse segments in a short time without losing the content of the video. We propose a method to extract the significant audio and video information and create a "skim" video which represents a very short synopsis of the original. The goal of this work is to show the utility of integrating language and image understanding techniques for video skimming by extraction of significant information, such as specific objects, audio keywords and relevant video structure. The resulting skim video is much shorter, where compaction is as high as 20:1, and yet retains the essential content of the original segment.

IMAGE PROCESSING↗

2D-to-3D image translation of complex nanoporous volumes using generative networks

Image-based characterization offers a powerful approach to studying geological porous media at the nanoscale and images are critical to understanding reactive transport mechanisms in reservoirs relevant to energy and sustainability technologies such as carbon sequestration, subsurface hydrogen storage, and natural gas recovery. Nanoimaging presents a trade off, however, between higher-contrast sample-destructive and lower-contrast sample-preserving imaging modalities. Furthermore, high-contrast imaging modalities often acquire only 2D images, while 3D volumes are needed to characterize fully a source rock sample. In this work, we present deep learning image translation models to predict high-contrast focused ion beam-scanning electron microscopy (FIB-SEM) image volumes from transmission X-ray microscopy (TXM) images when only 2D paired training data is available. We introduce a regularization method for improving 3D volume generation from 2D-to-2D deep learning image models and apply this approach to translate 3D TXM volumes to FIB-SEM fidelity. We then segment a predicted FIB-SEM volume into a flow simulation domain and calculate the sample apparent permeability using a lattice Boltzmann method (LBM) technique. Results show that our image translation approach produces simulation domains suitable for flow visualization and allows for accurate characterization of petrophysical properties from non-destructive imaging data.

58 GEOSCIENCES↗

Automated detection of vessel lumen and stent struts in intravascular optical coherence tomography to evaluate stent apposition and neointimal coverage

Purpose: Intravascular optical coherence tomography (IV-OCT) is a high-resolution imaging method used to visualize the microstructure of arterial walls in vivo. IV-OCT enables the clinician to clearly observe and accurately measure stent apposition and neointimal coverage of coronary stents, which are associated with side effects such as in-stent thrombosis. In this study, the authors present an algorithm for quantifying stent apposition and neointimal coverage by automatically detecting lumen contours and stent struts in IV-OCT images. Methods: The algorithm utilizes OCT intensity images and their first and second gradient images along the axial direction to detect lumen contours and stent strut candidates. These stent strut candidates are classified into true and false stent struts based on their features, using an artificial neural network with one hidden layer and ten nodes. After segmentation, either the protrusion distance (PD) or neointimal thickness (NT) for each strut is measured automatically. In randomly selected image sets covering a large variety of clinical scenarios, the results of the algorithm were compared to those of manual segmentation by IV-OCT readers. Results: Stent strut detection showed a 96.5% positive predictive value and a 92.9% true positive rate. In addition, case-by-case validation also showed comparable accuracy for most cases. High correlation coefficients (R > 0.99) were observed for PD and NT between the algorithmic and the manual results, showing little bias (0.20 and 0.46 μm, respectively) and a narrow range of limits of agreement (36 and 54 μm, respectively). In addition, the algorithm worked well in various clinical scenarios and even in cases with a low level of stent malapposition and neointimal coverage. Conclusions: The presented automatic algorithm enables robust and fast detection of lumen contours and stent struts and provides quantitative measurements of PD and NT. In addition, the algorithm was validated using various clinical cases to demonstrate its reliability. Therefore, this technique can be effectively utilized for clinical trials on stent-related side effects, including in-stent thrombosis and in-stent restenosis.

60 APPLIED LIFE SCIENCES↗

SU-F-J-211: Scatter Correction for Clinical Cone-Beam CT System Using An Optimized Stationary Beam Blocker with a Single Scan

Purpose: X-ray scatter photons result in significant image quality degradation of cone-beam CT (CBCT). Measurement based algorithms using beam blocker directly acquire the scatter samples and achieve significant improvement on the quality of CBCT image. Within existing algorithms, single-scan and stationary beam blocker proposed previously is promising due to its simplicity and practicability. Although demonstrated effectively on tabletop system, the blocker fails to estimate the scatter distribution on clinical CBCT system mainly due to the gantry wobble. In addition, the uniform distributed blocker strips in our previous design results in primary data loss in the CBCT system and leads to the image artifacts due to data insufficiency. Methods: We investigate the motion behavior of the beam blocker in each projection and design an optimized non-uniform blocker strip distribution which accounts for the data insufficiency issue. An accurate scatter estimation is then achieved from the wobble modeling. Blocker wobble curve is estimated using threshold-based segmentation algorithms in each projection. In the blocker design optimization, the quality of final image is quantified using the number of the primary data loss voxels and the mesh adaptive direct search algorithm is applied to minimize the objective function. Scatter-corrected CT images are obtained using the optimized blocker. Results: The proposed method is evaluated using Catphan@504 phantom and a head patient. On the Catphan©504, our approach reduces the average CT number error from 115 Hounsfield unit (HU) to 11 HU in the selected regions of interest, and improves the image contrast by a factor of 1.45 in the high-contrast regions. On the head patient, the CT number error is reduced from 97 HU to 6 HU in the soft tissue region and image spatial non-uniformity is decreased from 27% to 5% after correction. Conclusion: The proposed optimized blocker design is practical and attractive for CBCT guided radiation therapy. This work is supported by grants from Guangdong Innovative Research Team Program of China (Grant No. 2011S013), National 863 Programs of China (Grant Nos. 2012AA02A604 and 2015AA043203), the National High-tech R&D Program for Young Scientists by the Ministry of Science and Technology of China (Grant No. 2015AA020917)

60 APPLIED LIFE SCIENCES↗

NASA Today: Mars Observer Segment

The NASA news format primarily focuses on the 3 month orbit of Mars and the images obtained by the Observer spacecraft. The spacecraft orbits 310 miles from the surface and rotates once every 100 minutes. Other topics include the MODE mini-lab, Goddard student programs, and Pluto.

Source record↗

SU-E-I-87: Automated Liver Segmentation Method for CBCT Dataset by Combining Sparse Shape Composition and Probabilistic Atlas Construction

Purpose: The aiming of this study was to extract liver structures for daily Cone beam CT (CBCT) images automatically. Methods: Datasets were collected from 50 intravenous contrast planning CT images, which were regarded as training dataset for probabilistic atlas and shape prior model construction. Firstly, probabilistic atlas and shape prior model based on sparse shape composition (SSC) were constructed by iterative deformable registration. Secondly, the artifacts and noise were removed from the daily CBCT image by an edge-preserving filtering using total variation with L1 norm (TV-L1). Furthermore, the initial liver region was obtained by registering the incoming CBCT image with the atlas utilizing edge-preserving deformable registration with multi-scale strategy, and then the initial liver region was converted to surface meshing which was registered with the shape model where the major variation of specific patient was modeled by sparse vectors. At the last stage, the shape and intensity information were incorporated into joint probabilistic model, and finally the liver structure was extracted by maximum a posteriori segmentation.Regarding the construction process, firstly the manually segmented contours were converted into meshes, and then arbitrary patient data was chosen as reference image to register with the rest of training datasets by deformable registration algorithm for constructing probabilistic atlas and prior shape model. To improve the efficiency of proposed method, the initial probabilistic atlas was used as reference image to register with other patient data for iterative construction for removing bias caused by arbitrary selection. Results: The experiment validated the accuracy of the segmentation results quantitatively by comparing with the manually ones. The volumetric overlap percentage between the automatically generated liver contours and the ground truth were on an average 88%–95% for CBCT images. Conclusion: The experiment demonstrated that liver structures of CBCT with artifacts can be extracted accurately for following adaptive radiation therapy. This work is supported by National Natural Science Foundation of China (No. 61201441), Research Fund for Excellent Young and Middle-aged Scientists of Shandong Province (No. BS2012DX038), Project of Shandong Province Higher Educational Science and Technology Program (No. J12LN23), Jinan youth science and technology star (No.20120109)

60 APPLIED LIFE SCIENCES↗

THE DYNAMICALLY DISRUPTED GAP IN HD 142527

The vestiges of planet formation have been observed in debris disks harboring young and massive gaseous giants. The process of giant planet formation is terminated by the dissipation of gas in the protoplanetary disk. The gas-rich disk around HD 142527 features a small inner disk, a large gap from {approx}10 to {approx}140 AU, and a massive outer disk extending out to {approx}300 AU. The gap could have been carved out by a giant planet. We have imaged the outer regions of this gap using the adaptive optics camera NICI on Gemini South. Our images reveal that the disk is dynamically perturbed. The outer boundary of the roughly elliptical gap appears to be composed of several segments of spiral arms. The stellar position is offset by 0.''17 {+-} 0.''02 from the centroid of the cavity, consistent with earlier imaging at coarser resolutions. These transient morphological features are expected in the context of disk evolution in the presence of a perturbing body located inside the cavity. We perform hydrodynamical simulations of the dynamical clearing of a gap in a disk. A 10 M{sub jup} body in a circular orbit at r = 90 AU perturbs the whole disks, even after thousands of orbits. By then the model disk has an eccentric and irregular cavity, flanked by tightly wound spiral arms, but it is still evolving far from steady state. A particular transient configuration that is a qualitative match to HD 142527 is seen at 1.7 Myr.

79 ASTRONOMY AND ASTROPHYSICS↗

RadioGalaxyNET: Dataset and novel computer vision algorithms for the detection of extended radio galaxies and infrared hosts

Abstract Creating radio galaxy catalogues from next-generation deep surveys requires automated identification of associated components of extended sources and their corresponding infrared hosts. In this paper, we introduce RadioGalaxyNET, a multimodal dataset, and a suite of novel computer vision algorithms designed to automate the detection and localization of multi-component extended radio galaxies and their corresponding infrared hosts. The dataset comprises 4 155 instances of galaxies in 2 800 images with both radio and infrared channels. Each instance provides information about the extended radio galaxy class, its corresponding bounding box encompassing all components, the pixel-level segmentation mask, and the keypoint position of its corresponding infrared host galaxy. RadioGalaxyNET is the first dataset to include images from the highly sensitive Australian Square Kilometre Array Pathfinder (ASKAP) radio telescope, corresponding infrared images, and instance-level annotations for galaxy detection. We benchmark several object detection algorithms on the dataset and propose a novel multimodal approach to simultaneously detect radio galaxies and the positions of infrared hosts.

Astronomy & Astrophysics↗

Multispectral and geomorphic studies of processed Voyager 2 images of Europa

High resolution images of Europa taken by the Voyager 2 spacecraft were used to study a portion of Europa's dark lineations and the major white line feature Agenor Linea. Initial image processing of images 1195J2-001 (violet filter), 1198J2-001 (blue filter), 1201J2-001 (orange filter), and 1204J2-001 (ultraviolet filter) was performed at the U.S.G.S. Branch of Astrogeology in Flagstaff, Arizona. Processing was completed through the stages of image registration and color ratio image construction. Pixel printouts were used in a new technique of linear feature profiling to compensate for image misregistration through the mapping of features on the printouts. In all, 193 dark lineation segments were mapped and profiled. The more accurate multispectral data derived by this method was plotted using a new application of the ternary diagram, with orange, blue, and violet relative spectral reflectances serving as end members. Statistical techniques were then applied to the ternary diagram plots. The image products generated at LPI were used mainly to cross-check and verify the results of the ternary diagram analysis.

Meier, T. A.↗

Multimodal Nanoscale Tomographic Imaging for Battery Electrodes

Accurate representations of the 3D structure within a lithium-ion battery are key to understanding performance limitations. However, obtaining exact reconstructions of electrodes, where the active particles, the carbon black and polymeric binder domain, and the pore space are visualized is challenging. In this work, it is shown that multimodal imaging can be used to overcome this challenge. High-resolution ptychographic X-ray computed tomography are combined with lower resolution but higher contrast transmission X-ray tomographic microscopy to obtain 3D reconstructions of pristine and cycled graphite-silicon composite electrodes. This cross-correlation enables quantitative analysis of the surface of active particles, including the heterogeneity of carbon-black and binder domain and solid-electrolyte interphase coverage. Capturing the active particles as well as the carbon black-binder domain allows using these segmented structures for electrochemical simulations to highlight the influence of the particle embedding on local state of charge heterogeneities.

25 ENERGY STORAGE↗

The James Webb Space Telescope Mission: Optical Telescope Element Design, Development, and Performance

The James Webb Space Telescope (JWST) is a large, infrared space telescope that has recently started its science program which will enable breakthroughs in astrophysics and planetary science. Notably, JWST will provide the very first observations of the earliest luminous objects in the universe and start a new era of exoplanet atmospheric characterization. This transformative science is enabled by a 6.6 m telescope that is passively cooled with a 5 layer sunshield. The primary mirror is comprised of 18 controllable, low areal density hexagonal segments, that were aligned and phased relative to each other in orbit using innovative image-based wave front sensing and control algorithms. This revolutionary telescope took more than two decades to develop with a widely distributed team across engineering disciplines. We present an overview of the telescope requirements, architecture, development, superb on-orbit performance, and lessons learned. JWST successfully demonstrates a segmented aperture space telescope and establishes a path to building even larger space telescopes.

Infrared observatories↗

Dynamic Pupil Masking for Phasing Telescope Mirror Segments

A method that would notably include dynamic pupil masking has been proposed as an enhanced version of a prior method of phasing the segments of a primary telescope mirror. The method would apply, more specifically, to a primary telescope mirror that comprises multiple segments mounted on actuators that can be used to tilt the segments and translate them along the nominal optical axis to affect wavefront control in increments as fine as a fraction of a wavelength of light. An apparatus (see figure) for implementing the proposed method would be denoted a dispersed-fringe-sensor phasing camera system (DPCS). The prior method involves the use of a dispersed-fringe sensor (DFS). The prior method was reported as part of a more comprehensive method in Coarse Alignment of a Segmented Telescope Mirror (NPO-20770), NASA Tech Briefs, Vol. 25, No. 4 (April 2001), page 15a. The pertinent parts of the prior method are the following: The telescope would be aimed at a bright distant point source of light (e.g., a star) and form a broadband image on an imaging detector array placed at the telescope focal plane. The construction and use of a dispersed-fringe sensor would begin with insertion of a grism (a right-angle prism with a transmission grating on the hypotenuse face) into the optical path. With other segments tilted away from the investigating region of the detector, a dispersed-fringe image would be formed by use of a designated reference segment and a selected mirror segment. The modulation period and orientation of the fringe would be analyzed to determine the magnitude and sign of the piston error (displacement along the nominal optical axis) between the two segments. The error would be used to perform a coarse-phase piston adjustment of the affected mirror segment. This determination and removing of piston error is what is meant by phasing as used above. The procedure as described thus far would be repeated until all segments had been phased.

Shi, Fang↗

3D-Stereoscopic Analysis of Solar Active Region Loops: SoHo/EIT Observations at Temperatures of 1.5-2.5 MK - 2

In this paper we study the three-dimensional (3D) structure of hot (T(sub e) approximately equals 1.5 - 2.5 MK) loops in solar active region NOAA 7986, observed on 1996 August 30 with the Extreme-ultraviolet Imaging Telescope (EIT) onboard the Solar and Heliospheric Observatory (SoHO). This complements a first study on cooler (T(sub e) approximately equals 1.0 - 1.5 MK) loops of the same active region, using the same method of Dynamic Stereoscopy to reconstruct the 3D geometry. We reconstruct the 3D-coordinates x(s), y(s), z(s), the density n(sub e)(s), and temperature profile T(sub e)(s) of 35 individual loop segments (as function of the loop coordinate s) using EIT 195 A and 284 A images. The major findings are: (1) All loops are found to be in hydrostatic equilibrium, in the entire temperature regime of T(sub e) = 1.0 - 2.5 MK; (2) The analyzed loops have a height of 2-3 scale heights, and thus only segments extending over about one vertical scale height have sufficient emission measure contrast for detection; (3) The temperature gradient over the lowest scale height is of order dT/ds is approximately 1 - 4 K/km; (4) The radiative loss rate is found to exceed the conductive loss rate by about two orders or magnitude, making thermal conduction negligible to explain the temperature structure of the loops; (5) A steady-state can only be achieved when the heating rate E(sub H) matches the radiative loss rate in hydrostatic equilibrium, requiring a heat deposition length lambda(sub H) of the half density scale height lambda, predicting a scaling law with the loop base pressure, EH varies as p(sub 0 exp 2). This favors coronal heating mechanisms that operate near the loop footpoints; (6) We find a reciprocal correlation between the loop pressure p(sub 0) and loop length L, i.e. p(sub 0) varies as 1/L, implying a scaling law of the steady-state requirement with loop length, i.e. E(sub H ) varies as 1/L(exp 2). The heating rate shows no correlation with the loop-aligned magnetic field component B(sub z) at the footpoints, but is correlated with the azimuthal field B(sub phi) = Bz(RDelta Phi/L) of a twisted loop, and is thus consistent with heating mechanisms based on field-aligned currents.

Aschwanden, Markus J.↗

Fracture length data for geothermal applications

Fracture lengths govern permeability and are unknowns in geothermal assessment. Along their lengths, fracture widths vary due to growth by linkage. Under the influence of diagenesis, narrow widths seal, breaking porosity continuity and reducing open length. The largest range of widths and thus susceptibility to fill occurs where fractures are linked by narrow segments. Outcrops of a geothermal target, Cambrian Potsdam quartz arenite, contain opening-mode fractures having lengths spanning five orders of magnitude from 0.082 mm to 17.9 m. Combined lengths measured at a range of scales can be described by power laws, but at a given image resolution, lengths are best fit by exponential functions. Owing to preferential sealing of small fractures, open fractures follow exponential functions, but values depend on rules for designating fractures as continuous. En échelon segments, offset 10 mm, are connected by narrow fractures or microfractures (hard linked) not evident on outcrop 1 m-elevation LiDAR or 30 m-height drone images. A rule that identifies where narrow and likely connected segments are located can yield lengths meaningful for flow simulation. Depending on diagenesis, continuity rules can halve or double average and maximum length values. Length values from outcrop for geothermal applications should be adjusted based on wellsite-specific diagenesis information.

15 GEOTHERMAL ENERGY↗

TestDose: A nuclear medicine software based on Monte Carlo modeling for generating gamma camera acquisitions and dosimetry

Purpose: The TestDose platform was developed to generate scintigraphic imaging protocols and associated dosimetry by Monte Carlo modeling. TestDose is part of a broader project (www.dositest.com) whose aim is to identify the biases induced by different clinical dosimetry protocols. Methods: The TestDose software allows handling the whole pipeline from virtual patient generation to resulting planar and SPECT images and dosimetry calculations. The originality of their approach relies on the implementation of functional segmentation for the anthropomorphic model representing a virtual patient. Two anthropomorphic models are currently available: 4D XCAT and ICRP 110. A pharmacokinetic model describes the biodistribution of a given radiopharmaceutical in each defined compartment at various time-points. The Monte Carlo simulation toolkit GATE offers the possibility to accurately simulate scintigraphic images and absorbed doses in volumes of interest. The TestDose platform relies on GATE to reproduce precisely any imaging protocol and to provide reference dosimetry. For image generation, TestDose stores user’s imaging requirements and generates automatically command files used as input for GATE. Each compartment is simulated only once and the resulting output is weighted using pharmacokinetic data. Resulting compartment projections are aggregated to obtain the final image. For dosimetry computation, emission data are stored in the platform database and relevant GATE input files are generated for the virtual patient model and associated pharmacokinetics. Results: Two samples of software runs are given to demonstrate the potential of TestDose. A clinical imaging protocol for the Octreoscan™ therapeutical treatment was implemented using the 4D XCAT model. Whole-body “step and shoot” acquisitions at different times postinjection and one SPECT acquisition were generated within reasonable computation times. Based on the same Octreoscan™ kinetics, a dosimetry computation performed on the ICRP 110 model is also presented. Conclusions: The proposed platform offers a generic framework to implement any scintigraphic imaging protocols and voxel/organ-based dosimetry computation. Thanks to the modular nature of TestDose, other imaging modalities could be supported in the future such as positron emission tomography.

60 APPLIED LIFE SCIENCES↗