Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Dense, continuous membrane labeling and expansion microscopy visualization of ultrastructure in tissues

Abstract Lipid membranes are key to the nanoscale compartmentalization of biological systems, but fluorescent visualization of them in intact tissues, with nanoscale precision, is challenging to do with high labeling density. Here, we report ultrastructural membrane expansion microscopy (umExM), which combines an innovative membrane label and optimized expansion microscopy protocol, to support dense labeling of membranes in tissues for nanoscale visualization. We validate the high signal-to-background ratio, and uniformity and continuity, of umExM membrane labeling in brain slices, which supports the imaging of membranes and proteins at a resolution of ~60 nm on a confocal microscope. We demonstrate the utility of umExM for the segmentation and tracing of neuronal processes, such as axons, in mouse brain tissue. Combining umExM with optical fluctuation imaging, or iterating the expansion process, yields ~35 nm resolution imaging, pointing towards the potential for electron microscopy resolution visualization of brain membranes on ordinary light microscopes.

Science & Technology - Other Topics↗

Development of low temperature fuel cell holders for Operando x-ray micro and nano computed tomography to visualize water distribution

Abstract Synchrotron x-ray imaging techniques, like x-ray computed tomography (CT) and radiography have proven instrumental in expanding the communities knowledge of complex transport and reaction kinetics in electrochemical devices such as fuel cells and electrolyzers. This work presents the development of novel x-ray CT imaging techniques for operando visualization of water within low temperature fuel cells at spatial resolutions spanning the micro and nano scales. The design of operando sample holders, for both micro x-ray CT and nano CT experiments is described in depth, and prototypes of these sample holders were evaluated across a set of requirements, the most important of which are x-ray transmissibility, electrical conductivity and mechanical stability. Water segmentation from micro x-ray CT data was enabled by an image subtraction method, where the image without water is subtracted from the one with water. Through iterative experimentations, the operando nano CT cell was developed to optimize mechanical compression, electric conductivity and gas flow. While three-dimensional fuel cell reconstructions were shown possible, there remain challenges to overcome at typical lower energies (8 keV) due to beam damage, whereas it is not as significant for higher energies (>17.5 keV).

Kulkarni, Devashish↗

Demonstration of Multi-Star Wavefront Control for WFIRST, Habex, and LUVOIR

Coronagraphic instruments will enable direct imaging of dim planetary companions around nearby stars. The majority of nearby FGK stars are located in multi-star systems, including the Alpha Centauri stars, which may represent the best quality targets available for spectroscopic characterization due to their proximity and brightness. However, a binary system exhibits additional leakage from the o -axis companion star that may be brighter than the target exoplanet. Multi-Star Wavefront Control (MSWC) is a wavefront-control technique that allows simultaneous suppression of starlight of both stars in a binary system. MSWC would thus enable direct imaging of circumstellar planets in binary star systems such as Alpha Centauri. MSWC is compatible with a wide suite of planned coronagraphic instruments for future space missions. As part of the technology demonstration e orts for MSWC, the rst milestone results are presented here demonstrating (via computer simulations), high-contrast imaging capabilities of multi-star systems for several instruments including: [1] the upcoming WFIRST and its CGI demonstrator, [2] the HABitable Worlds EXplorer (Habex) mission concept, [3] the segmented Large UV/Optical/IR (LUVOIR) mission concept, and [4] a small-aperture Alpha Centauri direct-imager mission concept. For each of these missions, a baseline coronagraph option planned for the mission will be adopted and instrument baseline performance will be compared for single-star wavefront control.

Sirbu, Dan↗

Generalization Across Experimental Parameters in Neural Network Analysis of High-Resolution Transmission Electron Microscopy Datasets

Neural networks are promising tools for high-throughput and accurate transmission electron microscopy (TEM) analysis of nanomaterials, but are known to generalize poorly on data that is “out-of-distribution” from their training data. Given the limited set of image features typically seen in high-resolution TEM imaging, it is unclear which images are considered out-of-distribution from others. Here, we investigate how the choice of metadata features in the training dataset influences neural network performance, focusing on the example task of nanoparticle segmentation. We train and validate neural networks across curated, experimentally collected high-resolution TEM image datasets of nanoparticles under various imaging and material parameters, including magnification, dosage, nanoparticle diameter, and nanoparticle material. Overall, we find that our neural networks are not robust across microscope parameters, but do generalize across certain sample parameters. Additionally, data preprocessing can have unintended consequences on neural network generalization. Our results highlight the need to understand how dataset features affect deployment of data-driven algorithms.

42 ENGINEERING↗

Investigation of Primary Mirror Segment's Residual Errors for the Thirty Meter Telescope

The primary mirror segment aberrations after shape corrections with warping harness have been identified as the single largest error term in the Thirty Meter Telescope (TMT) image quality error budget. In order to better understand the likely errors and how they will impact the telescope performance we have performed detailed simulations. We first generated unwarped primary mirror segment surface shapes that met TMT specifications. Then we used the predicted warping harness influence functions and a Shack-Hartmann wavefront sensor model to determine estimates for the 492 corrected segment surfaces that make up the TMT primary mirror. Surface and control parameters, as well as the number of subapertures were varied to explore the parameter space. The corrected segment shapes were then passed to an optical TMT model built using the Jet Propulsion Laboratory (JPL) developed Modeling and Analysis for Controlled Optical Systems (MACOS) ray-trace simulator. The generated exit pupil wavefront error maps provided RMS wavefront error and image-plane characteristics like the Normalized Point Source Sensitivity (PSSN). The results have been used to optimize the segment shape correction and wavefront sensor designs as well as provide input to the TMT systems engineering error budgets.

warping harness↗

NASA Today - Mars Observer Segment (Part 4 of 6)

This videotape consists of eight segments from the NASA Today News program. The first segment is an announcement that there was no date set for the launch of STS-51, which had been postponed due to mechanical problems. The second segment describes the MidDeck Dynamic Experiment Facility. The third segment is about the scheduled arrival of the Mars Observer at Mars, it shows an image of Mars as seen from the approaching Observer spacecraft, and features an animation of the approach to Mars, including the maneuvers that are planned to put the spacecraft in the desired orbit. The fourth segment describes a discovery from an infrared spectrometer that there is nitrogen ice on Pluto. The fifth segment discusses the Aerospace for Kids (ASK) program at the Goddard Space Flight Center (GSFC). The sixth segment is about the high school and college summer internship programs at GSFC. The seventh segment announces a science symposium being held at Johnson Space Center. The last segment describes the National Air and Space Museum and NASA's cooperation with the Smithsonian Institution.

Source record↗

Computer Vision Pipeline for Image Analysis for Freeze‐Fracture Electron Microscopy: Rosette Cellulose Synthase Complexes Case

In materials science, plant biology, agriculture, and environmental research, the automated analysis of high-magnification, complex microscopy images, such as those generated by freeze-fracture electron microscopy (FF-TEM), remains a critical challenge that limits the scalability of data interpretation. We present a deep learning computer vision pipeline for high-throughput detection and morphological characterization analysis of cellulose synthase complexes (CSCs, or rosettes) in FF-TEM images. The pipeline integrates preprocessing, detection, human-in-the-loop verification, and semantic segmentation to quantify features such as rosette diameter and inter-lobe spacing. The approach was trained and tested on a curated dataset of high-resolution FF-TEM micrographs of Physcomitrium patens, expanded via strategic tiling and augmentation to over 650 images. We compare YOLOv8 and YOLOv9 architectures and demonstrate that YOLOv9 achieves superior performance in both localization accuracy (mAP50-95 = 0.854) and inference speed. The resulting distributions revealed biological variability consistent with prior manual studies, validating the approach for high-throughput applications. Our results show that the pipeline achieves human-expert level accuracy while dramatically reducing analysis time, enabling scalable, reproducible structural characterization of intramembrane protein complexes. The pipeline is broadly applicable to other domains requiring precise interpretation of complex microscopy data and establishes a foundation for future artificial intelligence (AI)-assisted workflows in biological imaging.

59 BASIC BIOLOGICAL SCIENCES↗

A software-based system which produces SEASAT SAR imagery

A digital processing algorithm and its associated system design for producing images from SEASAT synthetic aperture radar (SAR) data is described. The proposed system uses the fast Fourier transform approach to perform the two dimensional correlation process. The range migration problem can be alleviated by approximating the locus of echoes from a point target by several linear segments. Data corresponding to each segment are correlated separately and the results are coherently summed to produce full resolution images. This processing approach exhibits high computation efficiency and simple processing control functions. It is particularly attractive for software implementation based on general purpose computers. Results of this implementation and examples of digitally correlated SEASAT SAR imagery are discussed.

Wu, C.↗

Thematic Mapper geometric correction processing

The Thematic Mapper Image Processing System is described from the point of view of geometric correction. The system performance requirements are discussed, and the Landsat-D flight segment is described. The ground processing and overall geometric system performance is addressed. Those aspects of the Thematic Mapper Image Processing System that differ significantly from those of the MSS System are emphasized.

Beyer, E. P.↗

Segmentation of tomography datasets using 3D convolutional neural networks

Dendritic microstructures are ubiquitous in nature and are the primary solidification morphologies in metallic materials. Techniques such as X-ray computed tomography (XCT) have provided new insights into dendritic phase transformation phenomena. However, manual identification of dendritic morphologies in microscopy data can be both labor intensive and potentially ambiguous. The analysis of 3D datasets is particularly challenging due to their large sizes (terabytes) and the presence of artifacts scattered within the imaged volumes. Here, in this study, we trained 3D convolutional neural networks (CNNs) to segment 3D datasets. Three CNN architectures were investigated, including a new version of FCDenseNet which we extended to 3D. We show that using hyperparameter optimization (HPO) and fine-tuning techniques, both 2D and 3D CNN architectures outperform the previous state of the art. The 3D U-Net architecture trained in this study produced the best segmentations according to quantitative metrics (intersection-over-union of 95.56% and a boundary displacement error of 0.58 pixels), while 3D FCDense produced the smoothest boundaries and best segmentations according to visual inspection. The trained 3D CNNs are able to segment entire 852 × 852 × 250 voxel 3D volumes in only ~60 s, thus hastening the progress towards a deeper understanding of phase transformation phenomena such as dendritic solidification.

36 MATERIALS SCIENCE↗

Developmental Cryogenic Active Telescope Testbed, a Wavefront Sensing and Control Testbed for the Next Generation Space Telescope

As part of the technology validation strategy of the next generation space telescope (NGST), a system testbed is being developed at GSFC, in partnership with JPL and Marshall Space Flight Center (MSFC), which will include all of the component functions envisioned in an NGST active optical system. The system will include an actively controlled, segmented primary mirror, actively controlled secondary, deformable, and fast steering mirrors, wavefront sensing optics, wavefront control algorithms, a telescope simulator module, and an interferometric wavefront sensor for use in comparing final obtained wavefronts from different tests. The developmental. cryogenic active telescope testbed (DCATT) will be implemented in three phases. Phase 1 will focus on operating the testbed at ambient temperature. During Phase 2, a cryocapable segmented telescope will be developed and cooled to cryogenic temperature to investigate the impact on the ability to correct the wavefront and stabilize the image. In Phase 3, it is planned to incorporate industry developed flight-like components, such as figure controlled mirror segments, cryogenic, low hold power actuators, or different wavefront sensing and control hardware or software. A very important element of the program is the development and subsequent validation of the integrated multidisciplinary models. The Phase 1 testbed objectives, plans, configuration, and design will be discussed.

Leboeuf, Claudia M.↗

Semantic Segmentation of High-Resolution Satellite Imagery using Generative Adversarial Networks with Progressive Growing

With increase in urbanization and Earth Sciences research into urban areas, the need to quickly and accurately segment urban rooftop maps has never been greater. Cur-rent machine learning techniques struggle to produce high accuracy maps in dense urban zones where there is high image noise and foot print overlap. In this paper, we evaluate a training methodology for pixel-wise segmentation for high resolution satellite imagery using progressive growing of generative adversarial networks as a solution. We apply our model to segmenting building rooftops and compare these results to conventional methods for rooftop segmentation. We evaluate our approach using the SpaceNet version 2 and xView datasets. Our experiments show that for SpaceNet, progressive Generative Adversarial Network (GAN) training achieved a test accuracy of 93% compared to 89% for traditional GAN training and 87% for U-Net architecture, while for xView, we achieved 71% accuracy using progressive GAN training compared to 69% through traditional GAN training and 65% using U-Net.

Semantic↗

Overcoming Dynamic Disturbances in Imaging Systems

We develop and discuss a methodology with the potential to yield a significant reduction in complexity, cost, and risk of space-borne optical systems in the presence of dynamic disturbances. More robust systems almost certainly will be a result as well. Many future space-based and ground-based optical systems will employ optical control systems to enhance imaging performance. The goal of the optical control subsystem is to determine the wavefront aberrations and remove them. Ideally reducing an aberrated image of the object under investigation to a sufficiently clear (usually diffraction-limited) image. Control will likely be distributed over several elements. These elements may include telescope primary segments, telescope secondary, telescope tertiary, deformable mirror(s), fine steering mirror(s), etc. The last two elements, in particular, may have to provide dynamic control. These control subsystems may become elaborate indeed. But robust system performance will require evaluation of the image quality over a substantial range and in a dynamic environment. Candidate systems for improvement in the Earth Sciences Enterprise could include next generation Landsat systems or atmospheric sensors for dynamic imaging of individual, severe storms. The technology developed here could have a substantial impact on the development of new systems in the Space Science Enterprise; such as the Next Generation Space Telescope(NGST) and its follow-on the Next NGST. Large Interferometric Systems of non-zero field, such as Planet Finder and Submillimeter Probe of the Evolution of Cosmic Structure, could benefit. These systems most likely will contain large, flexible optomechanical structures subject to dynamic disturbance. Furthermore, large systems for high resolution imaging of planets or the sun from space may also benefit. Tactical and Strategic Defense systems will need to image very small targets as well and could benefit from the technology developed here. We discuss a novel speckle imaging technique with the potential to separate dynamic aberrations from static aberrations. Post-processing of a set of image data, using an algorithm based on this technique, should work for all but the lowest light levels and highest frequency dynamic environments. This technique may serve to reduce the complexity of the control system and provide for robust, fault-tolerant, reduced risk operation. For a given object, a short exposure image is "frozen" on the focal plane in the presence of the environmental disturbance (turbulence, jitter, etc.). A key factor is that this imaging data exhibits frame-to-frame linear shift invariance. Therefore, although the Point Spread Function is varying from frame to frame, the source is fixed; and each short exposure contains object spectrum data out to the diffraction limit of the imaging system. This novel speckle imaging technique uses the Knox-Thompson method. The magnitude of the complex object spectrum is straightforward to determine by well-established approaches. The phase of the complex object spectrum is decomposed into two parts. One is a single-valued function determined by the divergence of the optical phase gradient. The other is a multi-valued function determined by the circulation of the optical phase gradient-"hidden phase." Finite difference equations are developed for the phase. The novelty of this approach is captured in the inclusion of this "hidden phase." This technique allows the diffraction-limited reconstruction of the object from the ensemble of short exposure frames while simultaneously estimating the phase as a function of time from a set of exposures.

Young, Eric W.↗

Overcoming Dynamic Disturbances in Imaging Systems

We develop and discuss a methodology with the potential to yield a significant reduction in complexity, cost, and risk of space-borne optical systems in the presence of dynamic disturbances. More robust systems almost certainly will be a result as well. Many future space-based and ground-based optical systems will employ optical control systems to enhance imaging performance. The goal of the optical control subsystem is to determine the wavefront aberrations and remove them. Ideally reducing an aberrated image of the object under investigation to a sufficiently clear (usually diffraction-limited) image. Control will likely be distributed over several elements. These elements may include telescope primary segments, telescope secondary, telescope tertiary, deformable mirror(s), fine steering mirror(s), etc. The last two elements, in particular, may have to provide dynamic control. These control subsystems may become elaborate indeed. But robust system performance will require evaluation of the image quality over a substantial range and in a dynamic environment. Candidate systems for improvement in the Earth Sciences Enterprise could include next generation Landsat systems or atmospheric sensors for dynamic imaging of individual, severe storms. The technology developed here could have a substantial impact on the development of new systems in the Space Science Enterprise; such as the Next Generation Space Telescope(NGST) and its follow-on the Next NGST. Large Interferometric Systems of non-zero field, such as Planet Finder and Submillimeter Probe of the Evolution of Cosmic Structure, could benefit. These systems most likely will contain large, flexible optormechanical structures subject to dynamic disturbance. Furthermore, large systems for high resolution imaging of planets or the sun from space may also benefit. Tactical and Strategic Defense systems will need to image very small targets as well and could benefit from the technology developed here. We discuss a novel speckle imaging technique with the potential to separate dynamic aberrations from static aberrations. Post-processing of a set of image data, using an algorithm based on this technique, should work for all but the lowest light levels and highest frequency dynamic environments. This technique may serve to reduce the complexity of the control system and provide for robust, fault-tolerant, reduced risk operation. For a given object, a short exposure image is "frozen" on the focal plane in the presence of the environmental disturbance (turbulence, jitter, etc.). A key factor is that this imaging data exhibits frame-to-frame linear shift invariance. Therefore, although the Point Spread Function is varying from frame to frame, the source is fixed; and each short exposure contains object spectrum data out to the diffraction limit of the imaging system. This novel speckle imaging technique uses the Knox-Thompson method. The magnitude of the complex object spectrum is straightforward to determine by well-established approaches. The phase of the complex object spectrum is decomposed into two parts. One is a single-valued function determined by the divergence of the optical phase gradient. The other is a multi-valued function determined by, the circulation of the optical phase gradient-"hidden phase." Finite difference equations are developed for the phase. The novelty of this approach is captured in the inclusion of this "hidden phase." This technique allows the diffraction-limited reconstruction of the object from the ensemble of short exposure frames while simultaneously estimating the phase as a function of time from a set of exposures.

Young, Eric W.↗

JWST NIRCam Defocused Imaging Photometric Stability Performance and How It Can Sense Mirror Tilts

We use JWST NIRCam short-wavelength photometry to capture a transit lightcurve of the exoplanet HAT-P-14 b to assess performance as part of instrument commissioning. The short-wavelength precision is 152 ppm per 27 s integration as measured over the full time series compared to a theoretical limit of 107 ppm, after corrections to spatially correlated 1/f noise. Persistence effects from charge trapping are well fit by an exponential function with short characteristic timescales, settling on the order of 5–15 minutes. The short-wavelength defocused photometry is also uniquely well suited to measure the real-time wave-front error of JWST. Analysis of the images and reconstructed wave-front maps indicates that two different hexagonal primary mirror segments exhibited “tilt events,” where they changed orientation rapidly in less than ∼1.4 s. In some cases, the magnitude and timing of the flux jumps caused by tilt events can be accurately predicted with a telescope model. These tilt events can be sensed by simultaneous longer-wavelength NIRCam grism spectral images alone in the form of changes to the point-spread function, diagnosed from the full width at half maximum. They can also be sensed with the fine guidance sensor instrument from difference images. Tilt events possibly from sudden releases of stress in the backplane structure behind the mirrors were expected during the commissioning period because they were found in ground-based testing. Tilt events have shown signs of decreasing in frequency but have not disappeared completely. The detectors exhibit some minor (less than 1%) deviations from linear behavior in the first few groups of each integration, potentially impacting absolute fluxes and transit depths on bright targets, where only a handful of groups are possible. Overall, the noise is within 50% of the theoretical photon noise and read noise. This bodes well for high-precision measurements of transiting exoplanets and other time variable targets.

Everett Schlawin↗

GraphEM

An unsupervised segmentation method for structural analysis of Scanning Transmission Electron Microscopy (STEM) images

Pope, Jenna↗

Geometric error characterization and error budgets

Procedures used in characterizing geometric error sources for a spaceborne imaging system are described using the LANDSAT D thematic mapper ground segment processing as the prototype. Software was tested through simulation and is undergoing tests with the operational hardware as part of the prelaunch system evaluation. Geometric accuracy specifications, geometric correction, and control point processing are discussed. Cross track and along track errors are tabulated for the thematic mapper, the spacecraft, and ground processing to show the temporal registration error budget in pixel (42.5 microrad) 90%.

Beyer, E.↗