Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
NASA NTRS1979

Robotic vision

Robotic vision, involving the use of a vision system to control a process, is discussed. Design and selection of active sensors employing radiation of radio waves, sound waves, and laser light, respectively, to light up unobservable features in the scene are considered, as are design and selection of passive sensors, which rely on external sources of illumination. The segmentation technique by which an image is separated into different collections of contiguous picture elements having such common characteristics as color, brightness, or texture is examined, with emphasis on the edge detection technique. The IMFEX (image feature extractor) system performing edge detection and thresholding at 30 frames/sec television frame rates is described. The template matching and discrimination approach to recognize objects are noted. Applications of robotic vision in industry for tasks too monotonous or too dangerous for the workers are mentioned.

Williams, D. S.↗
NASA NTRS1987

Planetary studies; Proceedings of the Topical Meeting C3, Workshop III, and Symposium 8 of the Twenty-sixth COSPAR Plenary Meeting, Toulouse, France, June 30-July 11, 1986

Topics discussed in this issue include the atmospheres and ionospheres of planets and comets, future planetary missions, and latest results on Venus and Uranus missions. Papers are presented on the structure of the atmospheres of Mars and Venus below 100 kilometers, the structure of the atmospheres of Mars and Venus from the analysis of Fourier spectrometer measurements aboard Venera 15, physical parameters for the Saturn atmosphere computed by using Voyager data, hot hydrogen and deuterium in the exosphere of Venus, the theory and observations of cometary ionospheres, and the scientific goals of the Phobos mission. Additional papers are on the geological interpretation of a segment of Venus from radar images of the USSR spacecrafts Venera-15 and -16, the low-energy plasma in the Uranian magnetosphere, the initial estimates of Venus winds from ground-based radio tracking of the Vega balloons, the results of the Vega 1 balloon nephelometer experiment, and meteorological variations in the middle clouds of Venus from Vega balloon in situ measurements.

Keating, G. M.↗
NASA NTRS1993

Two generalizations of Kohonen clustering

The relationship between the sequential hard c-means (SHCM), learning vector quantization (LVQ), and fuzzy c-means (FCM) clustering algorithms is discussed. LVQ and SHCM suffer from several major problems. For example, they depend heavily on initialization. If the initial values of the cluster centers are outside the convex hull of the input data, such algorithms, even if they terminate, may not produce meaningful results in terms of prototypes for cluster representation. This is due in part to the fact that they update only the winning prototype for every input vector. The impact and interaction of these two families with Kohonen's self-organizing feature mapping (SOFM), which is not a clustering method, but which often leads ideas to clustering algorithms is discussed. Then two generalizations of LVQ that are explicitly designed as clustering algorithms are presented; these algorithms are referred to as generalized LVQ = GLVQ; and fuzzy LVQ = FLVQ. Learning rules are derived to optimize an objective function whose goal is to produce 'good clusters'. GLVQ/FLVQ (may) update every node in the clustering net for each input vector. Neither GLVQ nor FLVQ depends upon a choice for the update neighborhood or learning rate distribution - these are taken care of automatically. Segmentation of a gray tone image is used as a typical application of these algorithms to illustrate the performance of GLVQ/FLVQ.

Bezdek, James C.↗
NASA NTRS1999

Optical Amplifier for Space Applications

We describe an optical amplifier designed to amplify a spatially sampled component of an optical wavefront to kilowatt average power. The goal is means for implementing a strategy of spatially segmenting a large aperture wavefront, amplifying the individual segments, maintaining the phase coherence of the segments by active means, and imaging the resultant amplified coherent field. Applications of interest are the transmission of space solar power over multi-megameter distances, as to distant spacecraft, or to remote sites with no preexisting power grid.

Fork, Richard L.↗
NASA NTRSDate not supplied

Modeling Deformable Linear Objects for Autonomous Robotic Outfitting of Lunar Surface Systems

This paper presents structural models of deformable linear objects (DLOs). DLOs are a subclass of deformable objects that encompasses common outfitting elements such as cables and ropes. Models are validated through hardware experiments, and integration in a robotic autonomy architecture for space environments is discussed. A persistent human presence on the lunar surface is one of the next major milestones in space exploration. This requires the development of robust extraplanetary construction technologies including structures and materials modeling and robotic systems. Previous robotic construction technology development has primarily focused on structural assembly, with significantly less focus on robotically performed outfitting tasks to instantiate subsystems providing power, data, life support, etc. These tasks involve manipulation of highly flexible elements, which are difficult to model, such as cable harnesses, ropes, and hoses. Robotic manipulation of DLOs, especially cable harnesses, is an active area of research as cable harnesses are essential for providing power and data to space assets. DLO models that can be used for robot manipulator trajectory generation are necessary for autonomous operation of lunar infrastructure. There are many proposed methods for modeling DLOs, and they primarily fall into three types: 1) discrete model-based, 2) continuum model-based, and 3) Neural Network-based. These types each have pros and cons, and the tradeoff between model accuracy and computational speed informs which type should be used. An understanding of this trade-off is imperative for real-time control of autonomous systems. High computational requirements reduce the speed of the model, making real-time control difficult, while accuracy is critical to preventing collisions. Discrete models, such as a mass-spring multibody representation, require relatively few calculations, and accuracy is directly tied to the step size of the discretization. Continuum models, such as a B-spline representation or a Cosserat rod model (a mix of continuous and discrete), are more informed of the structural properties of the cable and are much more accurate than a rigid body mass-spring model, but at significant computational cost. A Neural Network approach can provide an online solution with very few computational steps, but properly generating training data can be difficult and validation for an in-space application is not trivial. This paper explores the trade-off between different modeling approaches and compares accuracy and computational speed/complexity of the three types mentioned above. Model accuracy is evaluated using a cable in a static configuration. True cable shape is obtained using a depth camera for RGB images and point-cloud segmentation. The purpose of this experiment is to evaluate the trade-offs of different approaches to the DLO modeling problem. Understanding the tradeoffs between different cable modeling techniques paves the way for developing robotic control and planning architectures necessary for real-time manipulation of DLOs for lunar infrastructure outfitting. Real-time control is required for robotic systems to be able to actively manipulate a cable in a harsh environment where model and sensor errors compound, and environmental conditions can cause significant disturbances. Cable routing must be performed in areas with high density of objects/obstacles: through truss structures, near solar panels or mirror arrays, next to bundles of electrical equipment. Understanding the best way to plan and manipulate a cable without disrupting the environment or damaging the cable is imperative to robotic outfitting operations on the lunar surface.

Amy M Quartaro↗
NASA NTRS2012

Wavefront Compensation Segmented Mirror Sensing and Control

The primary mirror of very large submillimeter-wave telescopes will necessarily be segmented into many separate mirror panels. These panels must be continuously co-phased to keep the telescope wavefront error less than a small fraction of a wavelength, to ten microns RMS (root mean square) or less. This performance must be maintained continuously across the full aperture of the telescope, in all pointing conditions, and in a variable thermal environment. A wavefront compensation segmented mirror sensing and control system, consisting of optical edge sensors, Wavefront Compensation Estimator/Controller Soft ware, and segment position actuators is proposed. Optical edge sensors are placed two per each segment-to-segment edge to continuously measure changes in segment state. Segment position actuators (three per segment) are used to move the panels. A computer control system uses the edge sensor measurements to estimate the state of all of the segments and to predict the wavefront error; segment actuator commands are computed that minimize the wavefront error. Translational or rotational motions of one segment relative to the other cause lateral displacement of the light beam, which is measured by the imaging sensor. For high accuracy, the collimator uses a shaped mask, such as one or more slits, so that the light beam forms a pattern on the sensor that permits sensing accuracy of better than 0.1 micron in two axes: in the z or local surface normal direction, and in the y direction parallel to the mirror surface and perpendicular to the beam direction. Using a co-aligned pair of sensors, with the location of the detector and collimated light source interchanged, four degrees of freedom can be sensed: transverse x and y displacements, as well as two bending angles (pitch and yaw). In this approach, each optical edge sensor head has a collimator and an imager, placing one sensor head on each side of a segment gap, with two parallel light beams crossing the gap. Two sets of optical edge sensors are used per segment-to-segment edge, separated by a finite distance along the segment edge, for four optical heads, each with an imager and a collimator. By orienting the beam direction of one edge sensor pair to be +45 away from the segment edge direction, and the other sensor pair to be oriented -45 away from the segment edge direction, all six degrees of freedom of relative motion between the segments can be measured with some redundancy. The software resides in a computer that receives each of the optical edge sensor signals, as well as telescope pointing commands. It feeds back the edge sensor signals to keep the primary mirror figure within specification. It uses a feed-forward control to compensate for global effects such as decollimation of the primary and secondary mirrors due to gravity sag as the telescope pointing changes to track science objects. Three segment position actuators will be provided per segment to enable controlled motions in the piston, tip, and tilt degrees of freedom. These actuators are driven by the software, providing the optical changes needed to keep the telescope phased.

Redding, David C.↗
NASA NTRS1983

Synthetic aperture radar imaging from an inclined geosynchronous orbit

Images of earth can be produced with an assumed synthetic aperture radar (SAR) on a satellite platform undergoing a nutating relative motion from geosynchronous altitude. From a 50 deg inclined circular orbit, the contiguous United States can be imaged in about 3 h of segmented operation at 100-m resolution with 4-azimuth-look averaging. The 2450-MHz transmitter radiates 1312 W of average power from a steerable 15-m-diam antenna. The SAR can image daily an area bounded longitudinally and latitudinally.

Tomiyasu, K.↗
NASA NTRS1988

PIPS: A Procedure for Interactive Pyramid Segmentation

The Procedure for Interactive Pyramid Segementation was designed to identify regions of spatially connected and spectrally homogeneous pixels in multispectral image data, and to allow these regions to be interactively manipulated without the use of processing parameters. The objective is to provide the user with the capability to easily extract and identify regions corresponding to target objects of interest. The approach is to segment a multispectral image into a set of regions and to allow the analyst to interactively refine the segmentation by direct manipulation. The user can elect to: interactively display maps of the spatial distribution of regions for any designated image subset; display the statistics of a given region; and label, merge, or split regions.

Wharton, S. W.↗
NASA NTRS2018

Interferometric Characterization of Keck Segment Edge Errors

The Keck telescope segments were manufactured by stressed mirror polishing of large circular pieces of Zerodur that were then cut into hexagons and finished by Ion Beam Figuring (IBF). It has long been believed that this process results in segments with little or no edge effects. As a result, this same general approach is planned for segment manufacturing for the Thirty Meter Telescope (TMT) and the European Extremely Large Telescope (E-ELT). However, recent measurements at the Keck telescope suggest that at least some of the Keck segments have significant aberrations within 60 mm of the edge. These aberrations impact the telescope phasing and the overall telescope image quality. We present interferometric measurements of multiple Keck segments, characterizing the surface errors near the edges over spatial periods from 5 cm down to 1 mm. We show that the largest phasing and image quality effects are due to plateaus of unremoved material, left behind after IBF as a result of obscuration by the IBF supports. Apart from these plateaus, the edge quality is relatively good, though not as good as in the segment interiors. Some residual phasing and image quality effects remain, and these are not currently understood.

Martinek, Stephen J.↗
DOE OSTI2023

Let’s Unleash the Network Judgment: A Self-Supervised Approach for Cloud Image Analysis

Accurate cloud type identification and coverage analysis are crucial in understanding the Earth’s radiative budget. Traditional computer vision methods rely on low-level visual features of clouds for estimating cloud coverage or sky conditions. Several handcrafted approaches have been proposed; however, scope for improvement still exists. Newer deep neural networks (DNNs) have demonstrated superior performance for cloud segmentation and categorization. These methods, however, need expert engineering intervention in the preprocessing steps—in the traditional methods—or human assistance in assigning cloud or clear sky labels to a pixel for training DNNs. Such human mediation imposes considerable time and labor costs. We present the application of a new self-supervised learning approach to autonomously extract relevant features from sky images captured by ground-based cameras, for the classification and segmentation of clouds. We evaluate a joint embedding architecture that uses self-knowledge distillation plus regularization. We use two datasets to demonstrate the network’s ability to classify and segment sky images—one with ~85,000 images collected from our ground-based camera and another with 400 labeled images from the WSISEG database. We find that this approach can discriminate full-sky images based on cloud coverage, diurnal variation, and cloud base height. Additionally, it semantically segments the cloud areas without labels. The approach shows competitive performance in all tested tasks, suggesting a new alternative for cloud characterization.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Machine learning models for segmentation and classification of cyanobacterial cells

Abstract Timelapse microscopy has recently been employed to study the metabolism and physiology of cyanobacteria at the single-cell level. However, the identification of individual cells in brightfield images remains a significant challenge. Traditional intensity-based segmentation algorithms perform poorly when identifying individual cells in dense colonies due to a lack of contrast between neighboring cells. Here, we describe a newly developed software package called Cypose which uses machine learning (ML) models to solve two specific tasks: segmentation of individual cyanobacterial cells, and classification of cellular phenotypes. The segmentation models are based on the Cellpose framework, while classification is performed using a convolutional neural network named Cyclass. To our knowledge, these are the first developed ML-based models for cyanobacteria segmentation and classification. When compared to other methods, our segmentation models showed improved performance and were able to segment cells with varied morphological phenotypes, as well as differentiate between live and lysed cells. We also found that our models were robust to imaging artifacts, such as dust and cell debris. Additionally, the classification model was able to identify different cellular phenotypes using only images as input. Together, these models improve cell segmentation accuracy and enable high-throughput analysis of dense cyanobacterial colonies and filamentous cyanobacteria.

Huffine, Clair A.↗
NASA NTRS2022

Microstructure Segmentation with Deep Learning Encoders Pre-Trained on a Large Microscopy Dataset

This study examined the improvement of microscopy segmentation accuracy by transfer learning from a large dataset of microscopy images called MicroNet. Many neural network encoder architectures, including VGG, Inception, and ResNet, were trained on over 100,000 labelled microscopy images from 54 classes. These pre-trained encoders were then embedded into multiple segmentation architectures including U-Net and DeepLabV3+ to evaluate segmentation performance on newly created benchmark microscopy datasets. Compared to ImageNet pre-training, models pre-trained on MicroNet generalized better to out-of-distribution micrographs taken under different imaging and sample conditions and were more accurate with less training data. When training with only a single Ni-superalloy image, pre-training on MicroNet produced a 72.2 percent reduction in relative segmentation error. These results suggest that transfer learning from large in-domain datasets generate models with learned feature representations that are more useful for downstream tasks and will likely improve any microscopy image analysis technique that can leverage pre-trained encoders.

machine learning↗
NASA NTRS1989

Image understanding and the man-machine interface II; Proceedings of the Meeting, Los Angeles, CA, Jan. 17, 18, 1989

Image understanding concepts and models, image understanding systems and applications, advanced digital processors and software tools, and advanced man-machine interfaces are among the topics discussed. Particular papers are presented on such topics as neural networks for computer vision, object-based segmentation and color recognition in multispectral images, the application of image algebra to image measurement and feature extraction, and the integration of modeling and graphics to create an infrared signal processing test bed.

Barrett, Eamon B.↗
DOE OSTI2026

Gaia: segmented germanium detector for high-energy X-ray fluorescence and spectroscopic imaging

We present Gaia, a monolithic array of 96 high-purity germanium pixel detectors integrated with a custom low-noise application-specific integrated circuit (ASIC) and a field-programmable gate array (FPGA)-based data acquisition system. The sensor operates at ∼100 K using a commercial closed-cycle cryocooler, with the in-vacuum electronics thermally isolated from the cold finger to ensure thermal stability. The system demonstrates an average energy resolution of 711 eV at 122 keV, measured using a 57 Co source, and 253 eV at 5.89 keV, measured with 55 Fe across all channels. The readout architecture incorporates a high-performance FPGA paired with a dual-core ARM processor, forming a complete embedded Linux-based computing platform. Communication between the processor and FPGA is handled via memory-mapped I/O, and data are streamed over high-speed gigabit Ethernet. A full-scale 384-pixel Gaia detector, based on this 96-element module, is currently under fabrication.

36 MATERIALS SCIENCE↗
NASA NTRSDate not supplied

Exoplanet Yield Sensitivity for the Hybrid Lyot Coronagraph from end-to-end modeling for LUVOIR-A

NASA's future direct imaging flagship mission will require telescope mirror segmentation to survey a statistically significant population of nearby stellar systems by increasing aperture size beyond that achieved by traditional space-borne monolithic apertures thus far. Segmentation is a path for the size expansion, but it entails a challenge due to the introduction of temporal pupil discontinuities in terms of both phase and amplitude. Modeling of the integrated performance of the coronagraph with the expected dynamical profile of the telescope is an important step toward realistic estimates of the mission's science yields. We present results of a study using the hybrid Lyot coronagraph with a 15-m on-axis, segmented optical telescope assembly (OTA), akin to that of the Large UV / Optical /Infrared (LUVOIR) mission. We have developed a high-fidelity, end-to-end model as part of the Segmented Coronagraph Design and Analysis (SCDA) study that includes diffractive optical propagations at the 1e-10 contrast level across the optical train including the OTA and intermediate re-imaging optics inside the coronagraph instrument. We perform a sensitivity analysis to assess the contrast sensitivity to wavefront perturbations for a set of key telescope terms including segment-level low-order and mid-spatial frequency aberrations and evaluate expected exoplanet yields obtained in the presence of these sets of aberrations. Industry-provided segment-level wavefront aberration datasets involving the following mechanisms are input to the end-to-end model: (1) thermal gradients and accelerations, and (2) telescope dynamics including line-of-sight and segment jitter. Dynamically averaged PSFs in the presence of aberrations are fed into AYO (Altruistic Yield Optimization), a mission design reference simulator, that then assesses the scientific yield sensitivities.

high-contrast imaging↗
NASA NTRS2010

Wavefront Control and Image Restoration with Less Computing

PseudoDiversity is a method of recovering the wavefront in a sparse- or segmented- aperture optical system typified by an interferometer or a telescope equipped with an adaptive primary mirror consisting of controllably slightly moveable segments. (PseudoDiversity should not be confused with a radio-antenna-arraying method called pseudodiversity.) As in the cases of other wavefront- recovery methods, the streams of wavefront data generated by means of PseudoDiversity are used as feedback signals for controlling electromechanical actuators of the various segments so as to correct wavefront errors and thereby, for example, obtain a clearer, steadier image of a distant object in the presence of atmospheric turbulence. There are numerous potential applications in astronomy, remote sensing from aircraft and spacecraft, targeting missiles, sighting military targets, and medical imaging (including microscopy) through such intervening media as cells or water. In comparison with prior wavefront-recovery methods used in adaptive optics, PseudoDiversity involves considerably simpler equipment and procedures and less computation. For PseudoDiversity, there is no need to install separate metrological equipment or to use any optomechanical components beyond those that are already parts of the optical system to which the method is applied. In Pseudo- Diversity, the actuators of a subset of the segments or subapertures are driven to make the segments dither in the piston, tilt, and tip degrees of freedom. Each aperture is dithered at a unique frequency at an amplitude of a half wavelength of light. During the dithering, images on the focal plane are detected and digitized at a rate of at least four samples per dither period. In the processing of the image samples, the use of different dither frequencies makes it possible to determine the separate effects of the various dithered segments or apertures. The digitized image-detector outputs are processed in the spatial-frequency (Fourier-transform) domain to obtain measures of the piston, tip, and tilt errors over each segment or subaperture. Once these measures are known, they are fed back to the actuators to correct the errors. In addition, measures of errors that remain after correction by use of the actuators are further utilized in an algorithm in which the image is phase-corrected in the spatial-frequency domain and then transformed back to the spatial domain at each time step and summed with the images from all previous time steps to obtain a final image having a greater signal-to-noise ratio (and, hence, a visual quality) higher than would otherwise be attainable.

Lyon, Richard G.↗
NASA NTRSDate not supplied

Design and performance analysis of a PIAACMC coronagraph on a segmented aperture

The Phase-Induced Amplitude Apodization Complex Mask Coronagraph (PIAACMC) offers high throughput and small inner working angle (IWA) for direct imaging of exoplanets. PIAACMC is also compatible with segmented apertures, which is important for the success of future large telescopes, such as the Large UV / Optical/ Infrared (LUVOIR) concept currently under way to inform NASA's2020 decadal survey. We present a design of PIAACMC for one of the segmented apertures considered for LUVOIR and simulate its performance with wavefront control, in monochromatic as well as broadband light. We characterize its performance in terms of throughput, inner working angle, contrast, area of the dark zone, and sensitivity to low order aberrations, in particular tip/tilt. In addition, we study the resilience to large stellar angular sizes and polarization. Finally, we compute the "performance map", which is a recently introduced figure of merit for coronagraphs

Exoplanets↗
NASA NTRSDate not supplied

Recent Developments to the Porous Microstructure Analysis (PuMA) Software

Introduction The Porous Microstructure Analysis (PuMA) software is an open source framework for image-based simulation, primarily used to determine effective properties based on material microstructure. PuMA was originally developed for the study of NASA thermal protection materials; however, many of the solvers in PuMA have applicability to a broad range of materials science applications. PuMA version 3.2 computes material surface area, pore diameters, effective thermal conductivity, continuum and rarefied tortuosity, and permeability. For anisotropic materials, PuMA can estimate material orientation and compute anisotropic thermal conductivity and elasticity. In this talk, a brief overview of the PuMA software and underlying methods will be presented, as well as some recent and ongoing developments, including the use of immersed boundary methods for image-based simulation and the development of a new weave segmentation tool, called TomoSAM. Cut-Cell method for heat and mass transfer For simulations on complex microstructures, traditional unstructured meshing techniques often prove to be difficult and time-intensive. Voxel-based solvers, which represent the surface as a staircase structure, are relatively simple to implement but can lose accuracy when feature resolution is poor. In this work, we present a novel 3D cut-cell method for solving the variable coefficient Poisson equation on complex microstructures, suitable for the determination of effective thermal conductivity or tortuosity of a material. The method uses a Marching Cubes/Marching Squares surface reconstruction to create cut-cells and determine geometric quantities. A flux-correction method is extended to 3D, with least squares gradient reconstruction, to solve for the boundary fluxes in the cut-cells. Verification cases show the solver achieves globally 2nd order accuracy on complex microstructures. TomoSAM TomoSAM, a module of the PuMA software, has been developed as a plugin for 3D Slicer, a software platform used for 3D image processing and visualization. It utilizes the Segment Anything Model (SAM), a deep learning model capable of identifying objects and generating image masks based on minimal user input. This feature enables efficient segmentation of complex 3D datasets, particularly of woven materials, from tomography or similar imaging methods, reducing the need for manual segmentation.

Tomography↗