Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Two generalizations of Kohonen clustering

The relationship between the sequential hard c-means (SHCM), learning vector quantization (LVQ), and fuzzy c-means (FCM) clustering algorithms is discussed. LVQ and SHCM suffer from several major problems. For example, they depend heavily on initialization. If the initial values of the cluster centers are outside the convex hull of the input data, such algorithms, even if they terminate, may not produce meaningful results in terms of prototypes for cluster representation. This is due in part to the fact that they update only the winning prototype for every input vector. The impact and interaction of these two families with Kohonen's self-organizing feature mapping (SOFM), which is not a clustering method, but which often leads ideas to clustering algorithms is discussed. Then two generalizations of LVQ that are explicitly designed as clustering algorithms are presented; these algorithms are referred to as generalized LVQ = GLVQ; and fuzzy LVQ = FLVQ. Learning rules are derived to optimize an objective function whose goal is to produce 'good clusters'. GLVQ/FLVQ (may) update every node in the clustering net for each input vector. Neither GLVQ nor FLVQ depends upon a choice for the update neighborhood or learning rate distribution - these are taken care of automatically. Segmentation of a gray tone image is used as a typical application of these algorithms to illustrate the performance of GLVQ/FLVQ.

Bezdek, James C.↗

Optical Amplifier for Space Applications

We describe an optical amplifier designed to amplify a spatially sampled component of an optical wavefront to kilowatt average power. The goal is means for implementing a strategy of spatially segmenting a large aperture wavefront, amplifying the individual segments, maintaining the phase coherence of the segments by active means, and imaging the resultant amplified coherent field. Applications of interest are the transmission of space solar power over multi-megameter distances, as to distant spacecraft, or to remote sites with no preexisting power grid.

Fork, Richard L.↗

Modeling Deformable Linear Objects for Autonomous Robotic Outfitting of Lunar Surface Systems

This paper presents structural models of deformable linear objects (DLOs). DLOs are a subclass of deformable objects that encompasses common outfitting elements such as cables and ropes. Models are validated through hardware experiments, and integration in a robotic autonomy architecture for space environments is discussed. A persistent human presence on the lunar surface is one of the next major milestones in space exploration. This requires the development of robust extraplanetary construction technologies including structures and materials modeling and robotic systems. Previous robotic construction technology development has primarily focused on structural assembly, with significantly less focus on robotically performed outfitting tasks to instantiate subsystems providing power, data, life support, etc. These tasks involve manipulation of highly flexible elements, which are difficult to model, such as cable harnesses, ropes, and hoses. Robotic manipulation of DLOs, especially cable harnesses, is an active area of research as cable harnesses are essential for providing power and data to space assets. DLO models that can be used for robot manipulator trajectory generation are necessary for autonomous operation of lunar infrastructure. There are many proposed methods for modeling DLOs, and they primarily fall into three types: 1) discrete model-based, 2) continuum model-based, and 3) Neural Network-based. These types each have pros and cons, and the tradeoff between model accuracy and computational speed informs which type should be used. An understanding of this trade-off is imperative for real-time control of autonomous systems. High computational requirements reduce the speed of the model, making real-time control difficult, while accuracy is critical to preventing collisions. Discrete models, such as a mass-spring multibody representation, require relatively few calculations, and accuracy is directly tied to the step size of the discretization. Continuum models, such as a B-spline representation or a Cosserat rod model (a mix of continuous and discrete), are more informed of the structural properties of the cable and are much more accurate than a rigid body mass-spring model, but at significant computational cost. A Neural Network approach can provide an online solution with very few computational steps, but properly generating training data can be difficult and validation for an in-space application is not trivial. This paper explores the trade-off between different modeling approaches and compares accuracy and computational speed/complexity of the three types mentioned above. Model accuracy is evaluated using a cable in a static configuration. True cable shape is obtained using a depth camera for RGB images and point-cloud segmentation. The purpose of this experiment is to evaluate the trade-offs of different approaches to the DLO modeling problem. Understanding the tradeoffs between different cable modeling techniques paves the way for developing robotic control and planning architectures necessary for real-time manipulation of DLOs for lunar infrastructure outfitting. Real-time control is required for robotic systems to be able to actively manipulate a cable in a harsh environment where model and sensor errors compound, and environmental conditions can cause significant disturbances. Cable routing must be performed in areas with high density of objects/obstacles: through truss structures, near solar panels or mirror arrays, next to bundles of electrical equipment. Understanding the best way to plan and manipulate a cable without disrupting the environment or damaging the cable is imperative to robotic outfitting operations on the lunar surface.

Amy M Quartaro↗

Wavefront Compensation Segmented Mirror Sensing and Control

The primary mirror of very large submillimeter-wave telescopes will necessarily be segmented into many separate mirror panels. These panels must be continuously co-phased to keep the telescope wavefront error less than a small fraction of a wavelength, to ten microns RMS (root mean square) or less. This performance must be maintained continuously across the full aperture of the telescope, in all pointing conditions, and in a variable thermal environment. A wavefront compensation segmented mirror sensing and control system, consisting of optical edge sensors, Wavefront Compensation Estimator/Controller Soft ware, and segment position actuators is proposed. Optical edge sensors are placed two per each segment-to-segment edge to continuously measure changes in segment state. Segment position actuators (three per segment) are used to move the panels. A computer control system uses the edge sensor measurements to estimate the state of all of the segments and to predict the wavefront error; segment actuator commands are computed that minimize the wavefront error. Translational or rotational motions of one segment relative to the other cause lateral displacement of the light beam, which is measured by the imaging sensor. For high accuracy, the collimator uses a shaped mask, such as one or more slits, so that the light beam forms a pattern on the sensor that permits sensing accuracy of better than 0.1 micron in two axes: in the z or local surface normal direction, and in the y direction parallel to the mirror surface and perpendicular to the beam direction. Using a co-aligned pair of sensors, with the location of the detector and collimated light source interchanged, four degrees of freedom can be sensed: transverse x and y displacements, as well as two bending angles (pitch and yaw). In this approach, each optical edge sensor head has a collimator and an imager, placing one sensor head on each side of a segment gap, with two parallel light beams crossing the gap. Two sets of optical edge sensors are used per segment-to-segment edge, separated by a finite distance along the segment edge, for four optical heads, each with an imager and a collimator. By orienting the beam direction of one edge sensor pair to be +45 away from the segment edge direction, and the other sensor pair to be oriented -45 away from the segment edge direction, all six degrees of freedom of relative motion between the segments can be measured with some redundancy. The software resides in a computer that receives each of the optical edge sensor signals, as well as telescope pointing commands. It feeds back the edge sensor signals to keep the primary mirror figure within specification. It uses a feed-forward control to compensate for global effects such as decollimation of the primary and secondary mirrors due to gravity sag as the telescope pointing changes to track science objects. Three segment position actuators will be provided per segment to enable controlled motions in the piston, tip, and tilt degrees of freedom. These actuators are driven by the software, providing the optical changes needed to keep the telescope phased.

Redding, David C.↗

Synthetic aperture radar imaging from an inclined geosynchronous orbit

Images of earth can be produced with an assumed synthetic aperture radar (SAR) on a satellite platform undergoing a nutating relative motion from geosynchronous altitude. From a 50 deg inclined circular orbit, the contiguous United States can be imaged in about 3 h of segmented operation at 100-m resolution with 4-azimuth-look averaging. The 2450-MHz transmitter radiates 1312 W of average power from a steerable 15-m-diam antenna. The SAR can image daily an area bounded longitudinally and latitudinally.

Tomiyasu, K.↗

PIPS: A Procedure for Interactive Pyramid Segmentation

The Procedure for Interactive Pyramid Segementation was designed to identify regions of spatially connected and spectrally homogeneous pixels in multispectral image data, and to allow these regions to be interactively manipulated without the use of processing parameters. The objective is to provide the user with the capability to easily extract and identify regions corresponding to target objects of interest. The approach is to segment a multispectral image into a set of regions and to allow the analyst to interactively refine the segmentation by direct manipulation. The user can elect to: interactively display maps of the spatial distribution of regions for any designated image subset; display the statistics of a given region; and label, merge, or split regions.

Wharton, S. W.↗

Interferometric Characterization of Keck Segment Edge Errors

The Keck telescope segments were manufactured by stressed mirror polishing of large circular pieces of Zerodur that were then cut into hexagons and finished by Ion Beam Figuring (IBF). It has long been believed that this process results in segments with little or no edge effects. As a result, this same general approach is planned for segment manufacturing for the Thirty Meter Telescope (TMT) and the European Extremely Large Telescope (E-ELT). However, recent measurements at the Keck telescope suggest that at least some of the Keck segments have significant aberrations within 60 mm of the edge. These aberrations impact the telescope phasing and the overall telescope image quality. We present interferometric measurements of multiple Keck segments, characterizing the surface errors near the edges over spatial periods from 5 cm down to 1 mm. We show that the largest phasing and image quality effects are due to plateaus of unremoved material, left behind after IBF as a result of obscuration by the IBF supports. Apart from these plateaus, the edge quality is relatively good, though not as good as in the segment interiors. Some residual phasing and image quality effects remain, and these are not currently understood.

Martinek, Stephen J.↗

Microstructure Segmentation with Deep Learning Encoders Pre-Trained on a Large Microscopy Dataset

This study examined the improvement of microscopy segmentation accuracy by transfer learning from a large dataset of microscopy images called MicroNet. Many neural network encoder architectures, including VGG, Inception, and ResNet, were trained on over 100,000 labelled microscopy images from 54 classes. These pre-trained encoders were then embedded into multiple segmentation architectures including U-Net and DeepLabV3+ to evaluate segmentation performance on newly created benchmark microscopy datasets. Compared to ImageNet pre-training, models pre-trained on MicroNet generalized better to out-of-distribution micrographs taken under different imaging and sample conditions and were more accurate with less training data. When training with only a single Ni-superalloy image, pre-training on MicroNet produced a 72.2 percent reduction in relative segmentation error. These results suggest that transfer learning from large in-domain datasets generate models with learned feature representations that are more useful for downstream tasks and will likely improve any microscopy image analysis technique that can leverage pre-trained encoders.

machine learning↗

Image understanding and the man-machine interface II; Proceedings of the Meeting, Los Angeles, CA, Jan. 17, 18, 1989

Image understanding concepts and models, image understanding systems and applications, advanced digital processors and software tools, and advanced man-machine interfaces are among the topics discussed. Particular papers are presented on such topics as neural networks for computer vision, object-based segmentation and color recognition in multispectral images, the application of image algebra to image measurement and feature extraction, and the integration of modeling and graphics to create an infrared signal processing test bed.

Barrett, Eamon B.↗

Exoplanet Yield Sensitivity for the Hybrid Lyot Coronagraph from end-to-end modeling for LUVOIR-A

NASA's future direct imaging flagship mission will require telescope mirror segmentation to survey a statistically significant population of nearby stellar systems by increasing aperture size beyond that achieved by traditional space-borne monolithic apertures thus far. Segmentation is a path for the size expansion, but it entails a challenge due to the introduction of temporal pupil discontinuities in terms of both phase and amplitude. Modeling of the integrated performance of the coronagraph with the expected dynamical profile of the telescope is an important step toward realistic estimates of the mission's science yields. We present results of a study using the hybrid Lyot coronagraph with a 15-m on-axis, segmented optical telescope assembly (OTA), akin to that of the Large UV / Optical /Infrared (LUVOIR) mission. We have developed a high-fidelity, end-to-end model as part of the Segmented Coronagraph Design and Analysis (SCDA) study that includes diffractive optical propagations at the 1e-10 contrast level across the optical train including the OTA and intermediate re-imaging optics inside the coronagraph instrument. We perform a sensitivity analysis to assess the contrast sensitivity to wavefront perturbations for a set of key telescope terms including segment-level low-order and mid-spatial frequency aberrations and evaluate expected exoplanet yields obtained in the presence of these sets of aberrations. Industry-provided segment-level wavefront aberration datasets involving the following mechanisms are input to the end-to-end model: (1) thermal gradients and accelerations, and (2) telescope dynamics including line-of-sight and segment jitter. Dynamically averaged PSFs in the presence of aberrations are fed into AYO (Altruistic Yield Optimization), a mission design reference simulator, that then assesses the scientific yield sensitivities.

high-contrast imaging↗

Wavefront Control and Image Restoration with Less Computing

PseudoDiversity is a method of recovering the wavefront in a sparse- or segmented- aperture optical system typified by an interferometer or a telescope equipped with an adaptive primary mirror consisting of controllably slightly moveable segments. (PseudoDiversity should not be confused with a radio-antenna-arraying method called pseudodiversity.) As in the cases of other wavefront- recovery methods, the streams of wavefront data generated by means of PseudoDiversity are used as feedback signals for controlling electromechanical actuators of the various segments so as to correct wavefront errors and thereby, for example, obtain a clearer, steadier image of a distant object in the presence of atmospheric turbulence. There are numerous potential applications in astronomy, remote sensing from aircraft and spacecraft, targeting missiles, sighting military targets, and medical imaging (including microscopy) through such intervening media as cells or water. In comparison with prior wavefront-recovery methods used in adaptive optics, PseudoDiversity involves considerably simpler equipment and procedures and less computation. For PseudoDiversity, there is no need to install separate metrological equipment or to use any optomechanical components beyond those that are already parts of the optical system to which the method is applied. In Pseudo- Diversity, the actuators of a subset of the segments or subapertures are driven to make the segments dither in the piston, tilt, and tip degrees of freedom. Each aperture is dithered at a unique frequency at an amplitude of a half wavelength of light. During the dithering, images on the focal plane are detected and digitized at a rate of at least four samples per dither period. In the processing of the image samples, the use of different dither frequencies makes it possible to determine the separate effects of the various dithered segments or apertures. The digitized image-detector outputs are processed in the spatial-frequency (Fourier-transform) domain to obtain measures of the piston, tip, and tilt errors over each segment or subaperture. Once these measures are known, they are fed back to the actuators to correct the errors. In addition, measures of errors that remain after correction by use of the actuators are further utilized in an algorithm in which the image is phase-corrected in the spatial-frequency domain and then transformed back to the spatial domain at each time step and summed with the images from all previous time steps to obtain a final image having a greater signal-to-noise ratio (and, hence, a visual quality) higher than would otherwise be attainable.

Lyon, Richard G.↗

Design and performance analysis of a PIAACMC coronagraph on a segmented aperture

The Phase-Induced Amplitude Apodization Complex Mask Coronagraph (PIAACMC) offers high throughput and small inner working angle (IWA) for direct imaging of exoplanets. PIAACMC is also compatible with segmented apertures, which is important for the success of future large telescopes, such as the Large UV / Optical/ Infrared (LUVOIR) concept currently under way to inform NASA's2020 decadal survey. We present a design of PIAACMC for one of the segmented apertures considered for LUVOIR and simulate its performance with wavefront control, in monochromatic as well as broadband light. We characterize its performance in terms of throughput, inner working angle, contrast, area of the dark zone, and sensitivity to low order aberrations, in particular tip/tilt. In addition, we study the resilience to large stellar angular sizes and polarization. Finally, we compute the "performance map", which is a recently introduced figure of merit for coronagraphs

Exoplanets↗

Recent Developments to the Porous Microstructure Analysis (PuMA) Software

Introduction The Porous Microstructure Analysis (PuMA) software is an open source framework for image-based simulation, primarily used to determine effective properties based on material microstructure. PuMA was originally developed for the study of NASA thermal protection materials; however, many of the solvers in PuMA have applicability to a broad range of materials science applications. PuMA version 3.2 computes material surface area, pore diameters, effective thermal conductivity, continuum and rarefied tortuosity, and permeability. For anisotropic materials, PuMA can estimate material orientation and compute anisotropic thermal conductivity and elasticity. In this talk, a brief overview of the PuMA software and underlying methods will be presented, as well as some recent and ongoing developments, including the use of immersed boundary methods for image-based simulation and the development of a new weave segmentation tool, called TomoSAM. Cut-Cell method for heat and mass transfer For simulations on complex microstructures, traditional unstructured meshing techniques often prove to be difficult and time-intensive. Voxel-based solvers, which represent the surface as a staircase structure, are relatively simple to implement but can lose accuracy when feature resolution is poor. In this work, we present a novel 3D cut-cell method for solving the variable coefficient Poisson equation on complex microstructures, suitable for the determination of effective thermal conductivity or tortuosity of a material. The method uses a Marching Cubes/Marching Squares surface reconstruction to create cut-cells and determine geometric quantities. A flux-correction method is extended to 3D, with least squares gradient reconstruction, to solve for the boundary fluxes in the cut-cells. Verification cases show the solver achieves globally 2nd order accuracy on complex microstructures. TomoSAM TomoSAM, a module of the PuMA software, has been developed as a plugin for 3D Slicer, a software platform used for 3D image processing and visualization. It utilizes the Segment Anything Model (SAM), a deep learning model capable of identifying objects and generating image masks based on minimal user input. This feature enables efficient segmentation of complex 3D datasets, particularly of woven materials, from tomography or similar imaging methods, reducing the need for manual segmentation.

Tomography↗

Recent Developments to the Porous Microstructure Analysis (PuMA) Software

The Porous Microstructure Analysis (PuMA) software is an open source framework for image-based simulation, primarily used to determine effective properties based on material microstructure. PuMA was originally developed for the study of NASA thermal protection materials; however, many of the solvers in PuMA have applicability to a broad range of materials science applications. PuMA version 3.2 computes material surface area, pore diameters, effective thermal conductivity, continuum and rarefied tortuosity, and permeability. For anisotropic materials, PuMA can estimate material orientation and compute anisotropic thermal conductivity and elasticity. In this talk, a brief overview of the PuMA software and underlying methods will be presented, as well as some recent and ongoing developments, including the use of immersed boundary methods for image-based simulation and the development of a new weave segmentation tool, called TomoSAM. Cut-Cell method for heat and mass transfer For simulations on complex microstructures, traditional unstructured meshing techniques often prove to be difficult and time-intensive. Voxel-based solvers, which represent the surface as a staircase structure, are relatively simple to implement but can lose accuracy when feature resolution is poor. In this work, we present a novel 3D cut-cell method for solving the variable coefficient Poisson equation on complex microstructures, suitable for the determination of effective thermal conductivity or tortuosity of a material. The method uses a Marching Cubes/Marching Squares surface reconstruction to create cut-cells and determine geometric quantities. A flux-correction method is extended to 3D, with least squares gradient reconstruction, to solve for the boundary fluxes in the cut-cells. Verification cases show the solver achieves globally 2nd order accuracy on complex microstructures. TomoSAM TomoSAM, a module of the PuMA software, has been developed as a plugin for 3D Slicer, a software platform used for 3D image processing and visualization. It utilizes the Segment Anything Model (SAM), a deep learning model capable of identifying objects and generating image masks based on minimal user input. This feature enables efficient segmentation of complex 3D datasets, particularly of woven materials, from tomography or similar imaging methods, reducing the need for manual segmentation.

Tomography↗

Analytical Tools for Cloudscope Ice Measurement

The cloudscope is a ground or aircraft instrument for viewing ice crystals impacted on a sapphire window. It is essentially a simple optical microscope with an attached compact CCD video camera whose output is recorded on a Hi-8 mm video cassette recorder equipped with digital time and date recording capability. In aircraft operation the window is at a stagnation point of the flow so adiabatic compression heats the window to sublimate the ice crystals so that later impacting crystals can be imaged as well. A film heater is used for ground based operation to provide sublimation, and it can also be used to provide extra heat for aircraft operation. The compact video camera can be focused manually by the operator, and a beam splitter - miniature bulb combination provide illumination for night operation. Several shutter speeds are available to accommodate daytime illumination conditions by direct sunlight. The video images can be directly used to qualitatively assess the crystal content of cirrus clouds and contrails. Quantitative size spectra are obtained with the tools described in this report. Selected portions of the video images are digitized using a PCI bus frame grabber to form a short movie segment or stack using NIH (National Institute of Health) Image software with custom macros developed at DRI. The stack can be Fourier transform filtered with custom, easy to design filters to reduce most objectionable video artifacts. Particle quantification of each slice of the stack is performed using digital image analysis. Data recorded for each particle include particle number and centroid, frame number in the stack, particle area, perimeter, equivalent ellipse maximum and minimum radii, ellipse angle, and pixel number. Each valid particle in the stack is stamped with a unique number. This output can be used to obtain a semiquantitative appreciation of the crystal content. The particle information becomes the raw input for a subsequent program (FORTRAN) that synthesizes each slice and separates the new from the sublimating particles. The new particle information is used to generate quantitative particle concentration, area, and mass size spectra along with total concentration, solar extinction coefficient, and ice water content. This program directly creates output in html format for viewing with a web browser.

Arnott, W. Patrick↗

Low-level processing for real-time image analysis

A system that detects object outlines in television images in real time is described. A high-speed pipeline processor transforms the raw image into an edge map and a microprocessor, which is integrated into the system, clusters the edges, and represents them as chain codes. Image statistics, useful for higher level tasks such as pattern recognition, are computed by the microprocessor. Peak intensity and peak gradient values are extracted within a programmable window and are used for iris and focus control. The algorithms implemented in hardware and the pipeline processor architecture are described. The strategy for partitioning functions in the pipeline was chosen to make the implementation modular. The microprocessor interface allows flexible and adaptive control of the feature extraction process. The software algorithms for clustering edge segments, creating chain codes, and computing image statistics are also discussed. A strategy for real time image analysis that uses this system is given.

Eskenazi, R.↗

Qualitative and quantitative effects of harmonic echocardiographic imaging on endocardial edge definition and side-lobe artifacts

Harmonic imaging is a new ultrasonographic technique that is designed to improve image quality by exploiting the spontaneous generation of higher frequencies as ultrasound propagates through tissue. We studied 51 difficult-to-image patients with blinded side-by-side cineloop evaluation of endocardial border definition by harmonic versus fundamental imaging. In addition, quantitative intensities from cavity versus wall were compared for harmonic versus fundamental imaging. Harmonic imaging improved left ventricular endocardial border delineation over fundamental imaging (superior: harmonic = 71.1%, fundamental = 18.7%; similar: 10.2%; P <.001). Quantitative analysis of 100 wall/cavity combinations demonstrated brighter wall segments and more strikingly darker cavities during harmonic imaging (cavity intensity on a 0 to 255 scale: fundamental = 15.6 +/- 8.6; harmonic = 6.0 +/- 5.3; P <.0001), which led to enhanced contrast between the wall and cavity (1.89 versus 1.19, P <.0001). Harmonic imaging reduces side-lobe artifacts, resulting in a darker cavity and brighter walls, thereby improving image contrast and endocardial delineation.

NASA Discipline Cardiopulmonary↗

Digital processing of stereoscopic image pairs.

The problem under consideration is concerned with scene analysis during robot navigation on the surface of Mars. In this mode, the world model of the robot must be continuously updated to include sightings of new obstacles and scientific samples. In order to describe the content of a particular scene, it is first necessary to segment it into known objects. One technique for accomplishing this segmentation is by analyzing the pair of images produced by the stereoscopic cameras mounted on the robot. A heuristic method is presented for determining the range for each point in the two-dimensional scene under consideration. The method is conceptually based on a comparison of corresponding points in the left and right images of the stereo pair. However, various heuristics which are adaptive in nature are used to make the algorithm both efficient and accurate. Examples are given of the use of this so-called range picture for the purpose of scene segmentation.

Levine, M. D.↗