Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Ultra-Structural Imaging Provides 3D Organization of 46 Chromosomes of a Human Lymphocyte Prophase Nucleus

Three dimensional (3D) ultra-structural imaging is an important tool for unraveling the organizational structure of individual chromosomes at various stages of the cell cycle. Performing hitherto uninvestigated ultra-structural analysis of the human genome at prophase, we used serial block-face scanning electron microscopy (SBFSEM) to understand chromosomal architectural organization within 3D nuclear space. Acquired images allowed us to segment, reconstruct, and extract quantitative 3D structural information about the prophase nucleus and the preserved, intact individual chromosomes within it. Our data demonstrate that each chromosome can be identified with its homolog and classified into respective cytogenetic groups. Thereby, we present the first 3D karyotype built from the compact axial structure seen on the core of all prophase chromosomes. The chromosomes display parallel-aligned sister chromatids with familiar chromosome morphologies with no crossovers. Furthermore, the spatial positions of all 46 chromosomes revealed a pattern showing a gene density-based correlation and a neighborhood map of individual chromosomes based on their relative spatial positioning. A comprehensive picture of 3D chromosomal organization at the nanometer level in a single human lymphocyte cell is presented.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Deep Learning Segmentation of Complex Features in Atomic-Resolution Phase-Contrast Transmission Electron Microscopy Images

Phase-contrast transmission electron microscopy (TEM) is a powerful tool for imaging the local atomic structure of materials. TEM has been used heavily in studies of defect structures of two-dimensional materials such as monolayer graphene due to its high dose efficiency. However, phase-contrast imaging can produce complex nonlinear contrast, even for weakly scattering samples. It is, therefore, difficult to develop fully automated analysis routines for phase-contrast TEM studies using conventional image processing tools. For automated analysis of large sample regions of graphene, one of the key problems is segmentation between the structure of interest and unwanted structures such as surface contaminant layers. In this study, we compare the performance of a conventional Bragg filtering method with a deep learning routine based on the U-Net architecture. We show that the deep learning method is more general, simpler to apply in practice, and produces more accurate and robust results than the conventional algorithm. We provide easily adaptable source code for all results in this paper and discuss potential applications for deep learning in fully automated TEM image analysis.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Tree, Shrub, and Grass Classification Using Only RGB Images

In this work, a semantic segmentation-based deep learning method, DeepLabV3+, is applied to classify three vegetation land covers, which are tree, shrub, and grass using only three band color (RGB) images. DeepLabV3+’s detection performance has been studied on low and high resolution datasets that both contain tree, shrub, and grass and some other land cover types. The two datasets are heavily imbalanced where shrub pixels are much fewer than tree and grass pixels. A simple weighting strategy known as median frequency weighting was incorporated into DeepLabV3+ to mitigate the data imbalance issue, which originally used uniform weights. The tree, shrub, grass classification performances are compared when all land cover types are included in the classification and also when classification is limited to the three vegetation classes with both uniform and median frequency weights. Among the three vegetation types, shrub is found to be the most challenging one to classify correctly whereas correct classification accuracy was highest for tree. It is observed that even though the median frequency weighting did not improve the overall accuracy, it resulted in better classification accuracy for the underrepresented classes such as shrub in our case and it also significantly increased the average class accuracy. The classification performance and computation time comparison of DeepLabV3+ with two other pixel-based classification methods on sampled pixels of the three vegetation classes showed that DeepLabV3+ achieves significantly higher accuracy than these methods with a trade-off for longer model training time.

58 GEOSCIENCES↗
DOE OSTI2025

Improving microstructures segmentation via pretraining with synthetic data

Image analysis of material microstructures through microscopy is an integral capability in the field of materials science. The topological and chemical information obtained through microscopy allow us to draw vital connections between material microstructures, properties, and processing. While scanning electron microscopy (SEM) is able to yield a considerable wealth of information interpretable by the intuition of experts, there has been considerable interest in using machine learning, convolutional neural networks (CNNs) in particular, for such image analysis task. Training CNNs for an image analysis task requires a large annotated dataset. However, in many materials science applications, obtaining a large annotated dataset is cost and labor intensive. In this work, we study the use of synthetic data to enlarge the available annotated experimental data of uranium oxide. We utilize a modified Potts model to simulate uranium oxide particles with morphologies similar to those observed experimentally. We then leverage an image-to-image translation model to synthesize the simulated particles as if they are acquired with SEM. Through this process, we obtain pairs of particle images and their corresponding SEM representations, which corresponds to pairs of annotations and images. Unlike previous works, we leverage synthetic data for pretraining a CNN model prior, and finetune that model further with experimental data. We experimentally demonstrate that using synthetic data as incremental learning process benefits the overall performance compared to training a model on combined synthetic and experimental data.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Overcoming small minirhizotron datasets using transfer learning

Minirhizotron technology is widely used to study root growth and development. Yet, standard approaches for tracing roots in minirhiztron imagery is extremely tedious and time consuming. Machine learning approaches can help to automate this task. However, lack of enough annotated training data is a major limitation for the application of machine learning methods. Transfer learning is a useful technique to help with training when available datasets are limited. In this paper, we investigated the effect of pre-trained features from the massives-cale, irrelevant ImageNet dataset and a relatively moderate-scale, but relevant peanut root dataset on switchgrass root imagery segmentation applications. We compiled two minirhizotron image datasets to accomplish this study: one with 17,550 peanut root images and another with 28 switchgrass root images. Both datasets were paired with manually labeled ground truth masks. Deep neural networks based on the U-net architecture were used with different pre-trained features as initialization for automated, precise pixel-wise root segmentation in minirhizotron imagery. We observed that features pre-trained on a closely related but relatively moderate size dataset like our peanut dataset were more effective than features pre-trained on the large but unrelated ImageNet dataset. Here, we achieved high quality segmentation on peanut root dataset with 99.04% accuracy at the pixel-level and overcame errors in human-labeled ground truth masks. By applying transfer learning technique on limited switchgrass dataset with features pre-trained on peanut dataset, we obtained 99% segmentation accuracy in switchgrass imagery using only 21 images for training (fine tuning). Furthermore, the peanut pre-trained features can help the model converge faster and have much more stable performance.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Geometrical-Based Generative Adversarial Network to Enhance Digital Rock Image Quality

X-ray microcomputed tomography (micro-CT) is a common tool for the study of porous media structures and properties. High-quality micro-CT data are required to accurately capture pore structures. Acquiring high-quality micro-CT data, however, is not always possible, owing to application limitations and experimental constraints. Therefore, we propose a geometrical-based generative adversarial network (GAN) to rapidly restore noisy micro-CT images to their clean counterparts. The training data and related ground-truth (GT) data are scanned for 7 min and 9.5 h, respectively. To evaluate the performance of the geometrical-based GAN, a 6003 voxel image that has never been used for training is reconstructed and compared with the corresponding GT image. Histogram matching and linear normalization are implemented to adjust the histogram of the reconstructed image to that of the GT image. A watershed-based segmentation method is then applied to delineate pore and solid phases. Lastly, we measure the Minkowski functionals and petrophysical properties, including absolute permeability, pore size distribution, drainage capillary pressure-saturation curve, and imbibition relative permeability, to estimate the physical accuracy of the denoised image. The results show that the proposed geometrical-based GAN can accurately restore noisy micro-CT data. By reducing the scanning time from 9.5 h to 7 min, the expenditure of collecting micro-CT can be decreased significantly. This is particularly important for applications where time-lapse images of a dynamic process are required, high-throughput imaging is necessary for real-time data analysis, or where the quantification of large sample volumes is required.

58 GEOSCIENCES↗
DOE OSTI2021

Automated CT registration, segmentation, and quantification (AutoCT) v1.0

Processing and analyzing brain imaging is crucial in both scientific development and clinical field. In this software package, we build a pipeline that integrates automatic registration, segmentation, and quantitative analysis for subjects' CT scans. Leveraging diffeomorphic transformations, we enable optimized forward and inverse mappings between an image and the reference. Furthermore, we extract localized features from deformation field based on an online template process, which advances statistical learning downstream. The created templates, atlas as well as our methods provide the brain imaging community tools for AI implementations.

Essiari, Abdelilah↗
DOE OSTI2021

Automated CT registration, segmentation, and quantification (AutoCT) v1.1

Processing and analyzing brain imaging is crucial in both scientific development and clinical field. In this software package, we build a pipeline that integrates automatic registration, segmentation, and quantitative analysis for subjects' CT scans. Leveraging diffeomorphic transofrmations, we enable optimized forward and inverse mappings between an image and the reference. Furthermore, we extract localized features from deformation field based on an online template process, which advances statistical learning downstream. The created templates, atlas as well as our methods provide the brain imaging community tools for AI implementations

Bai, Zhe↗
DOE OSTI2025

automesh: Automatic mesh generation in Rust

automesh is an open-source Rust software program that uses a segmentation, typically generated from a 3D image stack, to create a finite element mesh, composed either of hexahedral (volumetric) or triangular (isosurface) elements. automesh converts between segmentation formats (.npy, .spn) and mesh formats (.exo, .inp, .mesh, .stl, .vtk). automesh can defeature voxel domains, apply Laplacian and Taubin smoothing, and output mesh quality metrics. automesh uses an internal octree for fast performance.

Hovey, Chad Brian [Sandia National Laboratories (S↗
DOE OSTI2023

Model-based image change quantification

A system is provided for identifying and quantizing a change in a scene having objects based on comparison of features representing a target object derived from a first image and a second image that includes the target object. The system segments, based on a scene model of the scene, a second image that includes the target object to identify a second area representing the target object within the second image. The system extracts, from the second image, second features for the target object based on the second area. The system determines a second effectiveness of the second features indicating effectiveness of the second features in representing the target object. The system detects a change based on a difference between first features and the second features factoring in a first effectiveness and the second effectiveness.

Roberts, Randy S.↗
DOE OSTI2021

Discovery of segmented Fermi surface induced by Cooper pair momentum

Imaging a peculiar Fermi surface Running a current through a superconductor can cause the superconducting gap to close on a section of the Fermi surface. However, observing this segmented Fermi surface directly is tricky. To do so, Zhu et al . worked with a thin film of the topological insulator bismuth telluride placed on top of superconducting niobium diselenide. A small applied magnetic field caused a screening current, which in turn led to a segmented Fermi surface in the topological insulator layer. Using a scanning tunneling microscope, the researchers were able to map out this Fermi surface. —JS

Science & Technology - Other Topics↗
DOE OSTI2026

Deep generative learning of magnetic frustration in artificial spin ice from magnetic force microscopy images

Increasingly large datasets of microscopic images with nanoscale resolution facilitate the development of machine learning methods to identify and analyze subtle physical phenomena embedded within the images. In this work, microscopic images of honeycomb lattice spin-ice samples serve as datasets from which we automate the calculation of net magnetic moments and directional orientations of spin-ice configurations. In the first stage of our workflow, machine learning models are trained to accurately predict magnetic moments and directions within spin-ice structures. Variational Autoencoders (VAEs), an emergent unsupervised deep learning technique, are employed to generate high-quality synthetic magnetic force microscopy (MFM) images and extract latent feature representations, thereby reducing experimental and segmentation errors. The second stage of proposed methodology enables precise identification and prediction of frustrated vertices and nanomagnetic segments, effectively correlating structural and functional aspects of microscopic images. This facilitates the design of optimized spin-ice configurations with controlled frustration patterns, enabling potential on-demand synthesis.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A New Workflow of X-ray CT Image Processing and Data Analysis of Structural Features in Rock Using Open-Source Software

X-ray computed tomography (CT) images of rock specimens often contain artifacts which must be corrected before scientific analyses are performed. Here, we present a new workflow of automated image processing to utilize poor-quality X-ray CT scan images. The workflow runs on the open-source image analysis software and efficiently separates desired features from low-contrast scanned images. The new workflow is a two-step technique using contrast enhancement and automated feature segmentation to generate noise-free binary images. The results of binary images using the proposed workflow and using a conventional thresholding technique are analyzed to show the quality of the proposed method. The paper also presents a workflow of estimating the structural geometries of features in two and three dimensions. The results of the structural feature analyses and computational time were compared between the open-source (ImageJ) and commercial image analysis software (Bruker Computed Tomography Analyzer). The commercial software was more computationally efficient, but the task-specific macros in open-source software enabled the user-desired automation in image processing and data extraction of desired structural features of comparable quality.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Historic Context, Character-Defining Elements, And Photographic Record For A 26.45-Mile Segment Of The 138-Kilovolt Power Transmission System, Areas 3, 5, 6, And 23, Nevada National Security Site, Nye County, Nevada

The subject of this report is the 138-kilovolt (kV) power transmission line on the Nevada National Security Site (NNSS) (see Figure 1). The NNSS, formerly the Nevada Test Site (NTS), was the main continental nuclear test site for the United States between 1951 and 1992. Known as the battleground of the Cold War, the NNSS hosted a total of 928 nuclear tests during that period. It also served as the location of numerous scientific advancements in the fields of rocketry, big-hole drilling, nuclear waste management, and defense. From its construction in the 1960s through the present day, the 138 kV line has provided electrical power to the numerous buildings, facilities, experiments, and tests on the NNSS. The Department of Energy (DOE), in consultation with the Nevada State Historic Preservation Officer (SHPO), has determined that it may contribute to the character and significance of the Mercury Historic District (MHD) on the NNSS, as well as other historic districts that have not been recorded or evaluated yet. The purpose of this report is to fulfill two of the stipulations in the Memorandum of Agreement DEGM58-22NA25553 between the U.S. Department of Energy and the Nevada State Historic Preservation Officer Regarding Installation of a 138-kilovolt Transmission Line from the Mercury Switching Station to the U1a Facility and the Removal of the Historic 138-kilovolt Transmission Line from the Mercury Switching Station to the U1a Facility in Areas 1, 3, 5, 6, and 23 of the Nevada National Security Site (MOA). The MOA was executed as part of the DOE’s obligations under Section 106 of the National Historic Preservation Act (NHPA) to mitigate the adverse effects of two undertakings on historic properties. In particular, this report fulfills MOA Stipulations III.C.1-3, which state that the Department of Energy (DOE) will prepare the following: A historic context for the 138 kV transmission line and identification of the line’s characterdefining elements; High-quality digital images of the 26.45-mile segment of the 138 kV transmission line that is subject to the two undertakings for which the MOA was executed; and Photograph catalogs and map keys showing photograph viewpoints and directions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Automated Bacterial Identification and Morphological Feature Analysis in Low‐Dose Cryo‐EM Using YOLOv11

Bacteria rapidly adapt to environmental cues through morphological and ultrastructural changes that correlate with physiology and behavior. Cryogenic transmission electron microscopy (cryo‐TEM) can capture these phenotypic changes in near‐native, vitrified states, but manual analysis of low‐dose micrographs is labor intensive and limits throughput. Here, we present an end‐to‐end workflow that combines low‐dose cryo‐TEM imaging with a YOLOv11‐based instance‐segmentation model to automatically identify bacteria and quantify key structural features directly from the micrographs. This workflow enables (i) robust bacterial localization and counting from low‐magnification atlas/montage images, (ii) automated measurements of cell‐envelope (outer–inner membrane) thickness and anisotropy from higher‐magnification views, and (iii) detection and quantification of bacteria–flagella interactions, including overlap length and curvature metrics for interacting versus noninteracting flagella. Using Pantoea sp. YR343 grown under distinct media conditions, we show that the automated measurements agree with manual annotations while substantially reducing analysis time. Together, these tools provide a practical framework for scalable bacterial identification and quantitative phenotyping in low‐dose cryo‐TEM datasets and establish a foundation for extending cryo‐TEM image analysis toward higher‐throughput studies of microbial heterogeneity and biointerfaces.

YOLOv11↗
DOE OSTI2023

Multimodal Few-Shot Segmentation of Electron Micrographs

Scanning transmission electron microscopy (STEM) is one of the most used methods of analyzing the chemistry and composition of materials. By analyzing microstructures, these microscopes can help scientists better understand the molecular underpinnings of microelectronics, batteries, and more. However, STEM data can be difficult to interpret, so recent developments have been made in applications of machine learning to analyze these images. The PNNL-developed pyCHIP Classifier has achieved results in segmenting STEM these images via few-shot learning, a method which requires little data and human input, perfect for quickly analysis. In my internship I (Eli Meyers) investigated a multimodal improvement of this classifier by incorporating energy dispersive x-ray spectroscopy (EDS) data into the classification process for a more accurate segmentation. Furthermore, I encoded the spectral data by training a mass spectrometry encoder on the EDS data to extract a more meaningful representation of the data.

36 MATERIALS SCIENCE↗
DOE OSTI2022

MusMorph, a database of standardized mouse morphology data for morphometric meta-analyses

Complex morphological traits are the product of many genes with transient or lasting developmental effects that interact in anatomical context. Mouse models are a key resource for disentangling such effects, because they offer myriad tools for manipulating the genome in a controlled environment. Unfortunately, phenotypic data are often obtained using laboratory-specific protocols, resulting in self-contained datasets that are difficult to relate to one another for larger scale analyses. To enable meta-analyses of morphological variation, particularly in the craniofacial complex and brain, we created MusMorph, a database of standardized mouse morphology data spanning numerous genotypes and developmental stages, including E10.5, E11.5, E14.5, E15.5, E18.5, and adulthood. To standardize data collection, we implemented an atlas-based phenotyping pipeline that combines techniques from image registration, deep learning, and morphometrics. Alongside stage-specific atlases, we provide aligned micro-computed tomography images, dense anatomical landmarks, and segmentations (if available) for each specimen (N = 10,056). Our workflow is open-source to encourage transparency and reproducible data collection.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Three-Dimensional Ultrastructure of Arabidopsis Cotyledons Infected with Colletotrichum higginsianum

We used serial block-face scanning electron microscopy (SBF-SEM) to study the host–pathogen interface between Arabidopsis cotyledons and the hemibiotrophic fungus Colletotrichum higginsianum. By combining high-pressure freezing and freeze-substitution with SBF-SEM, followed by segmentation and reconstruction of the imaging volume using the freely accessible software IMOD, we created 3D models of the series of cytological events that occur during the Colletotrichum–Arabidopsis susceptible interaction. We found that the host cell membranes underwent massive expansion to accommodate the rapidly growing intracellular hypha. As the fungal infection proceeded from the biotrophic to the necrotrophic stage, the host cell membranes went through increasing levels of disintegration culminating in host cell death. Intriguingly, we documented autophagosomes in proximity to biotrophic hyphae using transmission electron microscopy (TEM) and a concurrent increase in autophagic flux between early to mid/late biotrophic phase of the infection process. Occasionally, we observed osmiophilic bodies in the vicinity of biotrophic hyphae using TEM only and near necrotrophic hyphae under both TEM and SBF-SEM. Overall, we established a method for obtaining serial SBF-SEM images, each with a lateral ( x-y) pixel resolution of 10 nm and an axial ( z) resolution of 40 nm, that can be reconstructed into interactive 3D models using the IMOD. Application of this method to the Colletotrichum–Arabidopsis pathosystem allowed us to more fully understand the spatial arrangement and morphological architecture of the fungal hyphae after they penetrate epidermal cells of Arabidopsis cotyledons and the cytological changes the host cell undergoes as the infection progresses toward necrotrophy. [Formula: see text] Copyright © 2024 The Author(s). This is an open access article distributed under the CC BY 4.0 International license .

Biochemistry & Molecular Biology↗