Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Uncertainty-aware particle segmentation for electron microscopy at varied length scales

Electron microscopy is indispensable for examining the morphology and composition of solid materials at the sub-micron scale. To study the powder samples that are widely used in materials development, scanning electron microscopes (SEMs) are increasingly used at the laboratory scale to generate large datasets with hundreds of images. Parsing these images to identify distinct particles and determine their morphology requires careful analysis, and automating this process remains challenging. In this work, we enhance the Mask R-CNN architecture to develop a method for automated segmentation of particles in SEM images. We address several challenges inherent to measurements, such as image blur and particle agglomeration. Moreover, our method accounts for prediction uncertainty when such issues prevent accurate segmentation of a particle. Recognizing that disparate length scales are often present in large datasets, we use this framework to create two models that are separately trained to handle images obtained at low or high magnification. By testing these models on a variety of inorganic samples, our approach to particle segmentation surpasses an established automated segmentation method and yields comparable results to the predictions of three domain experts, revealing comparable accuracy while requiring a fraction of the time. These findings highlight the potential of deep learning in advancing autonomous workflows for materials characterization.

36 MATERIALS SCIENCE↗

Understanding the Influence of Receptive Field and Network Complexity in Neural Network-Guided TEM Image Analysis

Abstract Trained neural networks are promising tools to analyze the ever-increasing amount of scientific image data, but it is unclear how to best customize these networks for the unique features in transmission electron micrographs. Here, we systematically examine how neural network architecture choices affect how neural networks segment, or pixel-wise separate, crystalline nanoparticles from amorphous background in transmission electron microscopy (TEM) images. We focus on decoupling the influence of receptive field, or the area of the input image that contributes to the output decision, from network complexity, which dictates the number of trainable parameters. For low-resolution TEM images which rely on amplitude contrast to distinguish nanoparticles from background, we find that the receptive field does not significantly influence segmentation performance. On the other hand, for high-resolution TEM images which rely on both amplitude and phase-contrast changes to identify nanoparticles, receptive field is an important parameter for increased performance, especially in images with minimal amplitude contrast. Rather than depending on atom or nanoparticle size, the ideal receptive field seems to be inversely correlated to the degree of nanoparticle contrast in the image. Our results provide insight and guidance as to how to adapt neural networks for applications with TEM datasets.

42 ENGINEERING↗

Next Generation Geostationary Operational Environmental Satellite (GOES-R Series): A Space Segment Overview

The next-generation National Oceanic and Atmospheric Administration (NOAA) Geostationary Operational Environmental Satellite (GOES-R series) is currently being developed by NOAA in cooperation with the National Aeronautics and Space Administration (NASA). The GOES-R series satellites represents a significant improvement in spatial, temporal, and spectral observations (several orders of magnitude) over the capabilities of the currently operational GOES-1 series and the about to be launched GOES-N series satellite. The GOES-R series will incorporate technically advanced third-generation instruments and spacecraft enhancements to meet evolving observational requirements of forecasting for the era 2012-2025. The GOES-R instrument complement being developed includes a Advanced Baseline Imager (ABI), a Hyperspectral Environmental Suite (HES), a GEO Lighting Mapper (GLM), a Solar Imaging Suite (SIS) and a Space Environment In-Situ Suite (SEISS). Also, candidates for a number of GOES-R Pre-Planned Product Improvements (P(sup 3)Is) includes a Geo microwave Sounder, a Coronograph, a Hyperspectral Imager, and a Solar Irradiance Sensor. Currently, the GOES-R Space Segment architecture is being evaluated as part of a GOES-R system end-to-end architecture study. The GOES-R notional baseline architecture is a constellation of two satellites (A-sat and B-sat) each nominally located at 75 degrees west longitude and at 135 degrees west longitude at geostationary altitude, 0 degrees inclination. The primary mission of the A-sat is to provide imaging from the ABI. The A-sat will also contain the SIS and the GLM. The primary mission of the B-sat is to provide sounding of the hemispherical disk of the earth from the HES. The B-sat also contains the SEISS. Both satellites have mesoscale capabilities for severe weather sounding or imaging. This paper overviews the GOES-R Space Segment development including satellite constellation trade-off, improvements and differences between the current and future instrument and spacecraft capabilities, and technology infusion.

Krimchansky, Alexander↗

Open Data and Deep Semantic Segmentation for Automated Extraction of Building Footprints

Advances in machine learning and computer vision, combined with increased access to unstructured data (e.g., images and text), have created an opportunity for automated extraction of building characteristics, cost-effectively, and at scale. These characteristics are relevant to a variety of urban and energy applications, yet are time consuming and costly to acquire with today’s manual methods. Several recent research studies have shown that in comparison to more traditional methods that are based on features engineering approach, an end-to-end learning approach based on deep learning algorithms significantly improved the accuracy of automatic building footprint extraction from remote sensing images. However, these studies used limited benchmark datasets that have been carefully curated and labeled. How the accuracy of these deep learning-based approach holds when using less curated training data has not received enough attention. The aim of this work is to leverage the openly available data to automatically generate a larger training dataset with more variability in term of regions and type of cities, which can be used to build more accurate deep learning models. In contrast to most benchmark datasets, the gathered data have not been manually curated. Thus, the training dataset is not perfectly clean in terms of remote sensing images exactly matching the ground truth building’s foot-print. A workflow that includes data pre-processing, deep learning semantic segmentation modeling, and results post-processing is introduced and applied to a dataset that include remote sensing images from 15 cities and five counties from various region of the USA, which include 8,607,677 buildings. The accuracy of the proposed approach was measured on an out of sample testing dataset corresponding to 364,000 buildings from three USA cities. The results favorably compared to those obtained from Microsoft’s recently released US building footprint dataset.

97 MATHEMATICS AND COMPUTING↗

Effects of diffraction and static wavefront errors on high-contrast imaging from the Thirty Meter Telescope

High-contrast imaging, particularly direct detection of extrasolar planets, is a major science driver for the next generation of extremely large telescopes such as the segmented Thirty Meter Telescope. This goal requires more than merely diffraction-limited imaging, but also attention to residual scattered light from wavefront errors and diffraction effects at the contrast level of 10-8-10-9. Using a wave-optics simulation of adaptive optics and a diffraction suppression system we investigate diffraction from the segmentation geometry, intersegment gaps, obscuration by the secondary mirror and its supports. We find that the large obscurations pose a greater challenge than the much smaller segment gaps. In addition the impact of wavefront errors from the primary mirror, including segment alignment and figure errors, are analyzed. Segment-to-segment reflectivity variations and residual segment figure error will be the dominant error contributors from the primary mirror. Strategies to mitigate these errors are discussed.

segmented mirrors↗

NanoPSD: A software for automatic detection of Nano-Particle Shape Distribution in electron microscopy images

Accurate quantification of the size and morphology of nanoparticles from electron microscopy (EM) images is essential to understand growth mechanisms, surface reactivity, and functional behavior in nanoscale materials. Manual analysis remains slow, subjective, and difficult to reproduce in large datasets. We introduce NanoPSD (Nano-Particle Shape Distribution), an open-source and fully automated framework for quantitative particle detection and morphology analysis from EM images. NanoPSD integrates adaptive contrast enhancement, polarity-agnostic scale-bar detection, Optical Character Recognition (OCR)-based calibration, and classical segmentation via Otsu thresholding with morphological refinement. Particle contours are used to extract geometric descriptors, including equivalent circular diameter, aspect ratio, circularity, and solidity, enabling automated classification into spherical, rod-like, and aggregate morphologies. The framework supports both single-image and batch processing, generating publication-quality visualizations, LaTeX-ready tables, and structured comma-separated values (CSV) datasets. As a demonstration, we applied NanoPSD to plasma-synthesized nanoparticle samples diagnosed via transmission electron microscopy (TEM). The code produced statistically robust size and morphology distributions spanning a few to tens of nanometers with minimal user supervision. The pipeline demonstrates high reproducibility and scalability, processing large image collections with consistent calibration and output formatting. Its modular design enables seamless integration of future deep-learning-based segmentation models, providing a pathway toward intelligent, data-driven electron microscopy analysis.

36 MATERIALS SCIENCE↗

Leveraging unlabeled SEM datasets with self-supervised learning for enhanced particle segmentation

Scanning Electron Microscopes (SEMs) are widely used in experimental science laboratories, often requiring cumbersome and repetitive user analysis. Automating SEM image analysis processes is highly desirable to address this challenge. In particle sample analysis, Machine Learning (ML) has emerged as the most effective approach for particle segmentation. However, the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches. Self-Supervised Learning (SSL) offers a promising alternative by enabling knowledge extraction from raw, unlabeled data. This study presents a framework for evaluating SSL techniques in SEM image analysis, focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection. A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods. The results demonstrate that ConvNeXtV2 models, with varying parameter counts, consistently outperform other techniques in particle detection across different length scales, achieving up to a 34% reduction in relative error compared to established SSL methods. Furthermore, an ablation study explores the relationship between dataset size and SSL performance, providing actionable insights for practitioners regarding model selection and resource efficiency. This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.

Rettenberger, Luca↗

A deep learning model for automatic analysis of cavities in irradiated materials

Transmission electron microscopy (TEM) is a commonly used technique in materials science for defect investigation. Quantitative analysis of defects is important for understanding the properties of a material, but manual analysis of TEM micrographs can be time-consuming and prone to error, especially when the defects have irregular shapes rather than spherical shapes. Many existing methods or deep learning models do not handle a wide range of sizes for the same object type within a single image. In this work, we present a framework that enables users to train an instance segmentation model called Mask R- CNN on any microstructure dataset, perform multi-detection on the same image at different scales, and obtain properties (e.g., size, area) of the objects based on the desired shape (e.g., circle, ellipse, rectangle). Additionally, we have developed a parallel detection module that uses multiple GPUs to increase the efficiency of the object detection process. We demonstrate the capabilities of our framework using a set of TEM images of cavities with different shapes, size distributions, and background contrasts. Finally, we show that the performance of our model in terms of density, size, and swelling of the cavities is comparable to the human average and that our model achieves the highest recall value compared to existing methods due to the use of image multi-rescaling.

36 MATERIALS SCIENCE↗

Electric field enhanced diffusion welding of alloy 617: Microstructural characteristics and mechanical properties

This study investigated the microstructural characteristics and mechanical behavior of diffusion welded nickel-based Alloy 617 obtained by electric field-assisted sintering (EFAS) using various parameters. The interfacial microstructure exhibited different characteristics including good grain boundary (GB) migration across the interface in the samples diffusion-welded at 1100 °C and a flat interface in the samples joined at 1000 °C and 1050 °C. The interface consisted of fine Al 2 O 3 oxides, while precipitation of interfacial M 23 C 6 carbides was not observed. Grain boundaries migrated across the Al 2 O 3 oxides, leaving these oxides within the grains. Graded grain size was observed, with grain coarsening being more significant near the sample surface due to the temperature gradient induced by EFAS. Tensile testing revealed that the specimens fractured in the matrix away from the interface, indicting strong diffusion-welded joints. Further, the peak tensile strength of 807 MPa was obtained in the samples welded at 1000 °C due to minimal grain growth. The materials obtained at 1100 °C exhibited reduced tensile strength but improved ductility. Strain maps revealed by digital image correlation showed alternating high and low strain segments in the samples produced at 1000 °C and 1050 °C, indicating that the flat interfaces with no GB migration were less ductile compared to the matrix. A greater strain uniformity was observed along the bond interfaces with improved GB migration. The hardness reduced near the sample surfaces due to enlarged grains induced by temperature gradient. This study demonstrates that GB migration and enhanced mechanical strength can be achieved in diffusion-welded Alloy 617.

36 MATERIALS SCIENCE↗

Measuring thermal curing induced shrinkage of material extrusion based additive manufacturing silicone elastomer lattices by X-ray computed tomography

Thermal curing induces shrinkage in material extrusion based additive manufacturing silicone elastomer samples, resulting in discrepancies between as printed and final geometries. Knowing the extent to which the samples change in shape and size allows us to make appropriate modifications to the printing design to better control the geometry of the samples. We present an X-ray computed tomography (CT) based approach to determine filament-level shrinkage due to thermal curing of silicone elastomer samples printed with direct ink writing (DIW). The approach relies on custom-designed build plates that are resistant to the elevated curing temperatures and that have sufficiently distinct X-ray absorption characteristics from the silicone elastomer to ensure adequate segmentation of the latter in X-ray imaging data. We implement the approach to evaluate shrinkage in DIW ‘log pile’ samples with three distinct strand arrangements and demonstrate of how filament-level information can be extracted from the X-ray CT data.

Additive manufacturing↗

Bragg Spot Finder (BSF): a new machine-learning-aided approach to deal with spot finding for rapidly filtering diffraction pattern images

Macromolecular crystallography contributes significantly to understanding diseases and, more importantly, how to treat them by providing atomic resolution 3D structures of proteins. This is achieved by collecting X-ray diffraction images of protein crystals from important biological pathways. Spotfinders are used to detect the presence of crystals with usable data, and the spots from such crystals are the primary data used to solve the relevant structures. Having fast and accurate spot finding is essential, but recent advances in synchrotron beamlines used to generate X-ray diffraction images have brought us to the limits of what the best existing spotfinders can do. This bottleneck must be removed so spotfinder software can keep pace with the X-ray beamline hardware improvements and be able to see the weak or diffuse spots required to solve the most challenging problems encountered when working with diffraction images. In this paper, we first present Bragg Spot Detection (BSD), a large benchmark Bragg spot image dataset that contains 304 images with more than 66 000 spots. We then discuss the open source extensible U-Net-based spotfinder Bragg Spot Finder (BSF), with image pre-processing, a U-Net segmentation backbone, and post-processing that includes artifact removal and watershed segmentation. Finally, we perform experiments on the BSD benchmark and obtain results that are (in terms of accuracy) comparable to or better than those obtained with two popular spotfinder software packages ( Dozor and DIALS ), demonstrating that this is an appropriate framework to support future extensions and improvements.

36 MATERIALS SCIENCE↗

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗

Expanded genetic variation (SNP) and phenomics (image based) dataset for Populus trichocarpa

The image dataset consists of 11,791 images representing 1,219 genotypes of Populus trichocarpa undergoing in planta regeneration. Genotypes were imaged with a median of four weekly timepoints and a median of two replicates each. A representative and diverse subset of 249 images was annotated using the IDEAS annotation interface (ideas.eecs.oregonstate.edu) and these annotated images were used to train a deep semantic segmentation model (PSPNet), which was deployed for inference over the entire dataset. Annotated classes include specific stages of regeneration (callus and shoot) in addition to unregenerated plant material and background. Statistics of relative tissue area were extracted and used for downstream genetic association mapping in a genome-wide association study. The SNP dataset consists of over 40 million single-nucleotide polymorphisms across 1,323 wild accessions of Populus trichocarpa

09 BIOMASS FUELS↗

NASA TM processing system description and status

An overview of the processing system for LANDSAT 4 imagery is given. Charts show system requirements; the LANDSAT 4 ground segment with its elements, configurations, and data flow; image generation requirements; and the major functions, interfaces, and hardware of the image generation facility and the image processing systems for the TM and MSS. The laser beam film recorder and the high density digital recorder are covered as well as the data available at EDC.

Watt, W.↗

Model-based orientation-independent 3-D machine vision techniques

Orientation-dependent techniques for the identification of a three-dimensional object by a machine vision system are represented in parts. In the first part, the data consist of intensity images of polyhedral objects obtained by a single camera, while in the second part, the data consist of range images of curved objects obtained by a laser scanner. In both cases, the attributed graphic representation of the object surface is used to drive the respective algorithm. In this representation, a graph node represents a surface patch and a link represents the adjacency between two patches. The attributes assigned to nodes are moment invariants of the corresponding face for polyhedral objects. For range images, the Gaussian curvature is used as a segmentation criterion for providing symbolic shape attributes. Identification is achieved by an efficient graph-matching algorithm used to match the graph obtained from the data to a subgraph of one of the model graphs stored in the commputer memory.

De Figueiredo, R. J. P.↗

Unsupervised Segmentation Of Polarimetric SAR Data

Method of unsupervised segmentation of polarimetric synthetic-aperture-radar (SAR) image data into classes involves selection of classes on basis of multidimensional fuzzy clustering of logarithms of parameters of polarimetric covariance matrix. Data in each class represent parts of image wherein polarimetric SAR backscattering characteristics of terrain regarded as homogeneous. Desirable to have each class represent type of terrain, sea ice, or ocean surface distinguishable from other types via backscattering characteristics. Unsupervised classification does not require training areas, is nearly automated computerized process, and provides nonsubjective selection of image classes naturally well separated by radar.

Rignot, Eric J.↗

Segmentation Of Polarimetric SAR Data

Report presents one in continuing series of studies of segmentation of polarimetric synthetic-aperture-radar, SAR, image data into regions. Studies directed toward refinement of method of automated analysis of SAR data.

Rignot, Eric J. M.↗

Neural networks: Application to medical imaging

The research mission is the development of computer assisted diagnostic (CAD) methods for improved diagnosis of medical images including digital x-ray sensors and tomographic imaging modalities. The CAD algorithms include advanced methods for adaptive nonlinear filters for image noise suppression, hybrid wavelet methods for feature segmentation and enhancement, and high convergence neural networks for feature detection and VLSI implementation of neural networks for real time analysis. Other missions include (1) implementation of CAD methods on hospital based picture archiving computer systems (PACS) and information networks for central and remote diagnosis and (2) collaboration with defense and medical industry, NASA, and federal laboratories in the area of dual use technology conversion from defense or aerospace to medicine.

Clarke, Laurence P.↗