Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

Planetary studies; Proceedings of the Topical Meeting C3, Workshop III, and Symposium 8 of the Twenty-sixth COSPAR Plenary Meeting, Toulouse, France, June 30-July 11, 1986

Topics discussed in this issue include the atmospheres and ionospheres of planets and comets, future planetary missions, and latest results on Venus and Uranus missions. Papers are presented on the structure of the atmospheres of Mars and Venus below 100 kilometers, the structure of the atmospheres of Mars and Venus from the analysis of Fourier spectrometer measurements aboard Venera 15, physical parameters for the Saturn atmosphere computed by using Voyager data, hot hydrogen and deuterium in the exosphere of Venus, the theory and observations of cometary ionospheres, and the scientific goals of the Phobos mission. Additional papers are on the geological interpretation of a segment of Venus from radar images of the USSR spacecrafts Venera-15 and -16, the low-energy plasma in the Uranian magnetosphere, the initial estimates of Venus winds from ground-based radio tracking of the Vega balloons, the results of the Vega 1 balloon nephelometer experiment, and meteorological variations in the middle clouds of Venus from Vega balloon in situ measurements.

Keating, G. M.↗

Two generalizations of Kohonen clustering

The relationship between the sequential hard c-means (SHCM), learning vector quantization (LVQ), and fuzzy c-means (FCM) clustering algorithms is discussed. LVQ and SHCM suffer from several major problems. For example, they depend heavily on initialization. If the initial values of the cluster centers are outside the convex hull of the input data, such algorithms, even if they terminate, may not produce meaningful results in terms of prototypes for cluster representation. This is due in part to the fact that they update only the winning prototype for every input vector. The impact and interaction of these two families with Kohonen's self-organizing feature mapping (SOFM), which is not a clustering method, but which often leads ideas to clustering algorithms is discussed. Then two generalizations of LVQ that are explicitly designed as clustering algorithms are presented; these algorithms are referred to as generalized LVQ = GLVQ; and fuzzy LVQ = FLVQ. Learning rules are derived to optimize an objective function whose goal is to produce 'good clusters'. GLVQ/FLVQ (may) update every node in the clustering net for each input vector. Neither GLVQ nor FLVQ depends upon a choice for the update neighborhood or learning rate distribution - these are taken care of automatically. Segmentation of a gray tone image is used as a typical application of these algorithms to illustrate the performance of GLVQ/FLVQ.

Bezdek, James C.↗

Optical Amplifier for Space Applications

We describe an optical amplifier designed to amplify a spatially sampled component of an optical wavefront to kilowatt average power. The goal is means for implementing a strategy of spatially segmenting a large aperture wavefront, amplifying the individual segments, maintaining the phase coherence of the segments by active means, and imaging the resultant amplified coherent field. Applications of interest are the transmission of space solar power over multi-megameter distances, as to distant spacecraft, or to remote sites with no preexisting power grid.

Fork, Richard L.↗

Modeling Deformable Linear Objects for Autonomous Robotic Outfitting of Lunar Surface Systems

This paper presents structural models of deformable linear objects (DLOs). DLOs are a subclass of deformable objects that encompasses common outfitting elements such as cables and ropes. Models are validated through hardware experiments, and integration in a robotic autonomy architecture for space environments is discussed. A persistent human presence on the lunar surface is one of the next major milestones in space exploration. This requires the development of robust extraplanetary construction technologies including structures and materials modeling and robotic systems. Previous robotic construction technology development has primarily focused on structural assembly, with significantly less focus on robotically performed outfitting tasks to instantiate subsystems providing power, data, life support, etc. These tasks involve manipulation of highly flexible elements, which are difficult to model, such as cable harnesses, ropes, and hoses. Robotic manipulation of DLOs, especially cable harnesses, is an active area of research as cable harnesses are essential for providing power and data to space assets. DLO models that can be used for robot manipulator trajectory generation are necessary for autonomous operation of lunar infrastructure. There are many proposed methods for modeling DLOs, and they primarily fall into three types: 1) discrete model-based, 2) continuum model-based, and 3) Neural Network-based. These types each have pros and cons, and the tradeoff between model accuracy and computational speed informs which type should be used. An understanding of this trade-off is imperative for real-time control of autonomous systems. High computational requirements reduce the speed of the model, making real-time control difficult, while accuracy is critical to preventing collisions. Discrete models, such as a mass-spring multibody representation, require relatively few calculations, and accuracy is directly tied to the step size of the discretization. Continuum models, such as a B-spline representation or a Cosserat rod model (a mix of continuous and discrete), are more informed of the structural properties of the cable and are much more accurate than a rigid body mass-spring model, but at significant computational cost. A Neural Network approach can provide an online solution with very few computational steps, but properly generating training data can be difficult and validation for an in-space application is not trivial. This paper explores the trade-off between different modeling approaches and compares accuracy and computational speed/complexity of the three types mentioned above. Model accuracy is evaluated using a cable in a static configuration. True cable shape is obtained using a depth camera for RGB images and point-cloud segmentation. The purpose of this experiment is to evaluate the trade-offs of different approaches to the DLO modeling problem. Understanding the tradeoffs between different cable modeling techniques paves the way for developing robotic control and planning architectures necessary for real-time manipulation of DLOs for lunar infrastructure outfitting. Real-time control is required for robotic systems to be able to actively manipulate a cable in a harsh environment where model and sensor errors compound, and environmental conditions can cause significant disturbances. Cable routing must be performed in areas with high density of objects/obstacles: through truss structures, near solar panels or mirror arrays, next to bundles of electrical equipment. Understanding the best way to plan and manipulate a cable without disrupting the environment or damaging the cable is imperative to robotic outfitting operations on the lunar surface.

Amy M Quartaro↗

Single-Pol Synthetic Aperture Radar Terrain Classification using Multiclass Confidence for One-Class Classifiers

Except in the most extreme conditions, Synthetic aperture radar (SAR) is a remote sensing technology that can operate day or night. A SAR can provide surveillance over a long time period by making multiple passes over a wide area. For object-based intelligence it is convenient to segment and classify the SAR images into objects that identify various terrains and man-made structures that we call “static features.” In this paper we introduce a novel SAR image product that captures how different regions decorrelate at different rates. Using superpixels and their first two moments we develop a series of one-class classification algorithms using a goodness-of-fit metric. P-value fusion is used to combine the results from different classes. We also show how to combine multiple one-class classifiers to get a confidence about a classification. This can be used by downstream algorithms such as a conditional random field to enforce spatial constraints.

Koch, Mark William↗

ADVANCED-STEM-BASED DEEP LEARNING FOR SEMANTIC SEGMENTATION OF DEFECTS IN STEELS

In this work, we developed a novel deep convolutional neural network (DCNN) model, called DefectNet, for robust and automated semantic segmentation of three crystallographic defects including line dislocations, precipitates and voids commonly observed in structural metals and alloys. In previous work, we established an experimental protocol for a diffraction contrast imaging scanning transmission electron microscopy (DCI STEM) technique and tailored it specifically for imaging defects in popular iron-based structural alloy. Thus, the DefectNet was trained over a small but high-quality DCI STEM defect image sets of a HT-9 martensitic steel before and after neutron irradiation for 111.8 dpa at 412°C. For the defect quantification that typically takes at least half an hour even for an expert, with a good model the machine learning algorithm can produce more reproducible and reliable quantification in a few seconds. This work demonstrates the feasibility of using deep learning algorithms for fast and accurate defect quantitative analysis.

Machine Learning, Radiation effects, Image analysi↗

Wavefront Compensation Segmented Mirror Sensing and Control

The primary mirror of very large submillimeter-wave telescopes will necessarily be segmented into many separate mirror panels. These panels must be continuously co-phased to keep the telescope wavefront error less than a small fraction of a wavelength, to ten microns RMS (root mean square) or less. This performance must be maintained continuously across the full aperture of the telescope, in all pointing conditions, and in a variable thermal environment. A wavefront compensation segmented mirror sensing and control system, consisting of optical edge sensors, Wavefront Compensation Estimator/Controller Soft ware, and segment position actuators is proposed. Optical edge sensors are placed two per each segment-to-segment edge to continuously measure changes in segment state. Segment position actuators (three per segment) are used to move the panels. A computer control system uses the edge sensor measurements to estimate the state of all of the segments and to predict the wavefront error; segment actuator commands are computed that minimize the wavefront error. Translational or rotational motions of one segment relative to the other cause lateral displacement of the light beam, which is measured by the imaging sensor. For high accuracy, the collimator uses a shaped mask, such as one or more slits, so that the light beam forms a pattern on the sensor that permits sensing accuracy of better than 0.1 micron in two axes: in the z or local surface normal direction, and in the y direction parallel to the mirror surface and perpendicular to the beam direction. Using a co-aligned pair of sensors, with the location of the detector and collimated light source interchanged, four degrees of freedom can be sensed: transverse x and y displacements, as well as two bending angles (pitch and yaw). In this approach, each optical edge sensor head has a collimator and an imager, placing one sensor head on each side of a segment gap, with two parallel light beams crossing the gap. Two sets of optical edge sensors are used per segment-to-segment edge, separated by a finite distance along the segment edge, for four optical heads, each with an imager and a collimator. By orienting the beam direction of one edge sensor pair to be +45 away from the segment edge direction, and the other sensor pair to be oriented -45 away from the segment edge direction, all six degrees of freedom of relative motion between the segments can be measured with some redundancy. The software resides in a computer that receives each of the optical edge sensor signals, as well as telescope pointing commands. It feeds back the edge sensor signals to keep the primary mirror figure within specification. It uses a feed-forward control to compensate for global effects such as decollimation of the primary and secondary mirrors due to gravity sag as the telescope pointing changes to track science objects. Three segment position actuators will be provided per segment to enable controlled motions in the piston, tip, and tilt degrees of freedom. These actuators are driven by the software, providing the optical changes needed to keep the telescope phased.

Redding, David C.↗

Cholecystokinin-Assisted Hydrodissection of the Gallbladder Fossa during FDG PET/CT-guided Liver Ablation

A 68-year-old female with colorectal cancer developed a metachronous isolated fluorodeoxyglucose-avid (FDG-avid) segment 5/6 gallbladder fossa hepatic lesion and was referred for percutaneous ablation. Pre-procedure computed tomography (CT) images demonstrated a distended gallbladder abutting the segment 5/6 hepatic metastasis. In order to perform ablation with clear margins and avoid direct puncture and aspiration of the gallbladder, cholecystokinin was administered intravenously to stimulate gallbladder contraction before hydrodissection. Subsequently, the lesion was ablated successfully with sufficient margins, of greater than 1.0 cm, using microwave with ultrasound and FDG PET/CT guidance. The patient tolerated the procedure very well and was discharged home the next day.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SU-D-207A-05: Investigating Sparse-Sampled MRI for Motion Management in Thoracic Radiotherapy

Purpose: Sparse sampling and reconstruction-based MRI techniques represent an attractive strategy to achieve sufficiently high image acquisition speed while maintaining image quality for the task of radiotherapy guidance. In this study, we examine rapid dynamic MRI using a sparse sampling sequence k-t BLAST in capturing motion-induced, cycle-to-cycle variations in tumor position. We investigate the utility of long-term MRI-based motion monitoring as a means of better characterizing respiration-induced tumor motion compared to a single-cycle 4DCT. Methods: An MRI-compatible, programmable, deformable lung motion phantom with eleven 1.5 ml water marker tubes was placed inside a 3.0 T whole-body MR scanner (Philips Ingenia). The phantom was programmed with 10 lung tumor motion traces previously recorded using the Synchrony system. 2D+t image sequences of a coronal slice were acquired using a balanced-SSFP sequence combined with k-t BLAST (accn=3, resolution=0.66×0.66×5 mm3; acquisition time = 110 ms/slice). kV fluoroscopic (ground truth) and 4DCT imaging was performed with the same phantom setup and motion trajectories. Marker positions in all three modalities were segmented and tracked using an opensource deformable image registration package, NiftyReg. Results: Marker trajectories obtained from rapid MRI exhibited <1 mm error compared to kv Fluoro trajectories in the presence of complex motion including baseline shifts and changes in respiratory amplitude, indicating the ability of MRI to monitor motion with adequate geometric fidelity for the purpose of radiotherapy guidance. In contrast, the trajectory derived from 4DCT exhibited significant errors up to 6 mm due to cycle-to-cycle variations and baseline shifts. Consequently, 4DCT was found to underestimate the range of marker motion by as much as 50%. Conclusion: Dynamic MRI is a promising tool for radiotherapy motion management as it permits for longterm, dose-free, soft-tissue-based monitoring of motion, yielding richer and more accurate information about tumor position and motion range compared to the current state-of-the-art, 4DCT. This work was partially supported through research funding from National Institutes of Health (R01CA169102).

60 APPLIED LIFE SCIENCES↗

Synthetic aperture radar imaging from an inclined geosynchronous orbit

Images of earth can be produced with an assumed synthetic aperture radar (SAR) on a satellite platform undergoing a nutating relative motion from geosynchronous altitude. From a 50 deg inclined circular orbit, the contiguous United States can be imaged in about 3 h of segmented operation at 100-m resolution with 4-azimuth-look averaging. The 2450-MHz transmitter radiates 1312 W of average power from a steerable 15-m-diam antenna. The SAR can image daily an area bounded longitudinally and latitudinally.

Tomiyasu, K.↗

WE-EF-BRA-04: Evaluation of Dosimetric Uncertainties in Individualized Targeted Radionuclide Therapy (TRT) Treatment Planning Using Pre-Clinical Data

Purpose: Dosimetry for targeted radionuclide therapy (TRT) is moving away from conventional model-based methods towards patient-specific approaches. To address this need, a Monte Carlo (MC) dosimetry platform was developed to estimate patient-specific therapeutic 3D dose distributions based on pre-treatment imaging. However, because a standard practice for patient-specific internal dosimetry has not yet been established, there are many sources of dosimetric uncertainties. The goal of this work was to quantify the sensitivity of various parameters on MC dose estimations. Methods: The ‘diapeutic’ agent, CLR1404, was used as a proof-of-principle compound in this work. CLR1404 can be radiolabeled with either {sup 124}I for PET imaging or {sup 131}I for radiotherapy or SPECT imaging. PET/CT images of 5 mice were acquired out to 240 hrs post-injection of {sup 124}I-CLR1404. The therapeutic {sup 131}I-CLR1404 absorbed dose (AD) distribution was calculated using a Geant4-based MC dosimetry platform. A series of sensitivity studies were performed. The variables that were investigated included the PET/CT voxel resolution, partial volume corrections (PVC), material segmentation, inter-observer contouring variability, and the pre-treatment image acquisition frequency. Results: Resampling the PET/CT voxel size between 0.2–0.8 mm resulted in up to a 13% variation in the mean AD. Application of the PVC increased the mean AD by 0.5–11.2%. Less than 1% differences in ROI mean AD were observed between the tissue segmentation schemes using 4 and 27 different material compositions. Inter-observer contouring variability led to up to a 20% CoV (stdev/mean) in the mean AD between the users. Varying the number and frequency of pre-treatment images used resulted in changes in mean AD up to 176% compared to the case using all 12 images. Conclusion: Voxel resolution, contour segmentation, the image acquisition protocol most significantly impacted patient-specific TRT dosimetry. Further work is needed to develop a standard protocol that optimizes accuracy and efficiency for patient-specific internal dosimetry. BT and JG are affiliated with Cellectar Biosciences which owns the licensing rights to CLR1404 and related compounds.

60 APPLIED LIFE SCIENCES↗

PIPS: A Procedure for Interactive Pyramid Segmentation

The Procedure for Interactive Pyramid Segementation was designed to identify regions of spatially connected and spectrally homogeneous pixels in multispectral image data, and to allow these regions to be interactively manipulated without the use of processing parameters. The objective is to provide the user with the capability to easily extract and identify regions corresponding to target objects of interest. The approach is to segment a multispectral image into a set of regions and to allow the analyst to interactively refine the segmentation by direct manipulation. The user can elect to: interactively display maps of the spatial distribution of regions for any designated image subset; display the statistics of a given region; and label, merge, or split regions.

Wharton, S. W.↗

Interferometric Characterization of Keck Segment Edge Errors

The Keck telescope segments were manufactured by stressed mirror polishing of large circular pieces of Zerodur that were then cut into hexagons and finished by Ion Beam Figuring (IBF). It has long been believed that this process results in segments with little or no edge effects. As a result, this same general approach is planned for segment manufacturing for the Thirty Meter Telescope (TMT) and the European Extremely Large Telescope (E-ELT). However, recent measurements at the Keck telescope suggest that at least some of the Keck segments have significant aberrations within 60 mm of the edge. These aberrations impact the telescope phasing and the overall telescope image quality. We present interferometric measurements of multiple Keck segments, characterizing the surface errors near the edges over spatial periods from 5 cm down to 1 mm. We show that the largest phasing and image quality effects are due to plateaus of unremoved material, left behind after IBF as a result of obscuration by the IBF supports. Apart from these plateaus, the edge quality is relatively good, though not as good as in the segment interiors. Some residual phasing and image quality effects remain, and these are not currently understood.

Martinek, Stephen J.↗

Let’s Unleash the Network Judgment: A Self-Supervised Approach for Cloud Image Analysis

Accurate cloud type identification and coverage analysis are crucial in understanding the Earth’s radiative budget. Traditional computer vision methods rely on low-level visual features of clouds for estimating cloud coverage or sky conditions. Several handcrafted approaches have been proposed; however, scope for improvement still exists. Newer deep neural networks (DNNs) have demonstrated superior performance for cloud segmentation and categorization. These methods, however, need expert engineering intervention in the preprocessing steps—in the traditional methods—or human assistance in assigning cloud or clear sky labels to a pixel for training DNNs. Such human mediation imposes considerable time and labor costs. We present the application of a new self-supervised learning approach to autonomously extract relevant features from sky images captured by ground-based cameras, for the classification and segmentation of clouds. We evaluate a joint embedding architecture that uses self-knowledge distillation plus regularization. We use two datasets to demonstrate the network’s ability to classify and segment sky images—one with ~85,000 images collected from our ground-based camera and another with 400 labeled images from the WSISEG database. We find that this approach can discriminate full-sky images based on cloud coverage, diurnal variation, and cloud base height. Additionally, it semantically segments the cloud areas without labels. The approach shows competitive performance in all tested tasks, suggesting a new alternative for cloud characterization.

54 ENVIRONMENTAL SCIENCES↗

An Iris Segmentation Algorithm based on Edge Orientation for Off-angle Iris Recognition

Iris recognition is known as one of the most accurate and reliable biometrics. However, the accuracy of iris recognition systems depends on the quality of data capture and is negatively affected by several factors such as angle, occlusion, and dilation. In this paper, we present a segmentation algorithm for off-angle iris images that uses edge detection, edge elimination, edge classification, and ellipse fitting techniques. In our approach, we first detect all candidate edges in the iris image by using the canny edge detector; this collection contains edges from the iris and pupil boundaries as well as eyelash, eyelids, iris texture etc. Edge orientation is used to eliminate the edges that cannot be part of the iris or pupil. Then, we classify the remaining edge points into two sets as pupil edges and iris edges. Finally, we randomly generate subsets of iris and pupil edge points, fit ellipses for each subset, select ellipses with similar parameters, and average to form the resultant ellipses. Based on the results from real experiments, the proposed method shows effectiveness in segmentation for off-angle iris images.

Karakaya, Mahmut↗

3D sorghum reconstructions from depth images identify QTL regulating shoot architecture

Dissecting the genetic basis of complex traits is aided by frequent and nondestructive measurements. Advances in range imaging technologies enable the rapid acquisition of three-dimensional (3D) data from an imaged scene. A depth camera was used to acquire images of sorghum (Sorghum bicolor), an important grain, forage, and bioenergy crop, at multiple developmental time points from a greenhouse-grown recombinant inbred line population. A semiautomated software pipeline was developed and used to generate segmented, 3D plant reconstructions from the images. Automated measurements made from 3D plant reconstructions identified quantitative trait loci for standard measures of shoot architecture, such as shoot height, leaf angle, and leaf length, and for novel composite traits, such as shoot compactness. The phenotypic variability associated with some of the quantitative trait loci displayed differences in temporal prevalence; for example, alleles closely linked with the sorghum Dwarf3 gene, an auxin transporter and pleiotropic regulator of both leaf inclination angle and shoot height, influence leaf angle prior to an effect on shoot height. Furthermore, variability in composite phenotypes that measure overall shoot architecture, such as shoot compactness, is regulated by loci underlying component phenotypes like leaf angle. As such, depth imaging is an economical and rapid method to acquire shoot architecture phenotypes in agriculturally important plants like sorghum to study the genetic basis of complex traits.

59 BASIC BIOLOGICAL SCIENCES↗

SU-E-J-141: Comparison of Dose Calculation On Automatically Generated MRBased ED Maps and Corresponding Patient CT for Clinical Prostate EBRT Plans

Purpose: To analyze the effect of computing radiation dose on automatically generated MR-based simulated CT images compared to true patient CTs. Methods: Six prostate cancer patients received a regular planning CT for RT planning as well as a conventional 3D fast-field dual-echo scan on a Philips 3.0T Achieva, adding approximately 2 min of scan time to the clinical protocol. Simulated CTs (simCT) where synthesized by assigning known average CT values to the tissue classes air, water, fat, cortical and cancellous bone. For this, Dixon reconstruction of the nearly out-of-phase (echo 1) and in-phase images (echo 2) allowed for water and fat classification. Model based bone segmentation was performed on a combination of the DIXON images. A subsequent automatic threshold divides into cortical and cancellous bone. For validation, the simCT was registered to the true CT and clinical treatment plans were re-computed on the simCT in pinnacle{sup 3}. To differentiate effects related to the 5 tissue classes and changes in the patient anatomy not compensated by rigid registration, we also calculate the dose on a stratified CT, where HU values are sorted in to the same 5 tissue classes as the simCT. Results: Dose and volume parameters on PTV and risk organs as used for the clinical approval were compared. All deviations are below 1.1%, except the anal sphincter mean dose, which is at most 2.2%, but well below clinical acceptance threshold. Average deviations are below 0.4% for PTV and risk organs and 1.3% for the anal sphincter. The deviations of the stratifiedCT are in the same range as for the simCT. All plans would have passed clinical acceptance thresholds on the simulated CT images. Conclusion: This study demonstrated the clinical usability of MR based dose calculation with the presented Dixon acquisition and subsequent fully automatic image processing. N. Schadewaldt, H. Schulz, M. Helle and S. Renisch are employed by Phlips Technologie Innovative Techonologies, a subsidiary of Royal Philips NV.

60 APPLIED LIFE SCIENCES↗

Machine learning models for segmentation and classification of cyanobacterial cells

Abstract Timelapse microscopy has recently been employed to study the metabolism and physiology of cyanobacteria at the single-cell level. However, the identification of individual cells in brightfield images remains a significant challenge. Traditional intensity-based segmentation algorithms perform poorly when identifying individual cells in dense colonies due to a lack of contrast between neighboring cells. Here, we describe a newly developed software package called Cypose which uses machine learning (ML) models to solve two specific tasks: segmentation of individual cyanobacterial cells, and classification of cellular phenotypes. The segmentation models are based on the Cellpose framework, while classification is performed using a convolutional neural network named Cyclass. To our knowledge, these are the first developed ML-based models for cyanobacteria segmentation and classification. When compared to other methods, our segmentation models showed improved performance and were able to segment cells with varied morphological phenotypes, as well as differentiate between live and lysed cells. We also found that our models were robust to imaging artifacts, such as dust and cell debris. Additionally, the classification model was able to identify different cellular phenotypes using only images as input. Together, these models improve cell segmentation accuracy and enable high-throughput analysis of dense cyanobacterial colonies and filamentous cyanobacteria.

Huffine, Clair A.↗