Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Automated Segmentation of Porous Thermal Spray Material CT Scans with Geometric Uncertainty Estimation

Thermal sprayed metal coatings are used in many industrial applications, and characterizing the structure and performance of these materials is vital to understanding their behavior in the field. X-ray Computed Tomography (CT) machines enable volumetric, nondestructive imaging of these materials, but precise segmentation of this grayscale image data into discrete material phases is necessary to calculate quantities of interest related to material structure. In this work, we present a methodology to automate the CT segmentation process as well as quantify uncertainty in segmentations via deep learning. Neural networks (NNs) are shown to accurately segment full resolution CT scans of thermal sprayed materials and provide maps of uncertainty that conservatively bound the predicted geometry. These bounds are propagated through calculations of material properties such as porosity that may provide an understanding of anticipated behavior in the field.

36 MATERIALS SCIENCE↗
NASA NTRS2021

Results From The Laboratory Demonstration Of A PIAACMC Coronagraph With A Segmented Aperture

The phase-induced amplitude apodization complex mask coronagraph (PIAACMC) provides high throughput and small inner working angle with little loss in image quality. Coronagraph compatibility with segmented apertures is essential for the success of habitable planet characterization with future large aperture space telescopes, such as the Large UV/Optical/Infrared (LUVOIR) and HabEx telescope mission concepts. The PIAACMC is compatible with such segmented telescope apertures with little loss of performance. We report the contrast and other performance results of a PIAACMC coronagraph with a LUVOIR-like pupil mask assembled and tested in a vacuum chamber at the JPL high contrast imaging testbed (HCIT). The goals of the demonstration were to achieve 1e-9 mean contrast over a semi-annular field of view from 2 λ/D to 8 λ/D, first with monochromatic light at 650nm, and then over a 10% spectral bandwidth. In addition, the measurement of jitter and its effect on PIAACMC performance will be discussed. As the success of electric field conjugation (EFC) to achieve best contrast on the testbed is dependent upon a diffraction model of the coronagraph, we will also discuss variations of the testbed and its diffraction model with the PIAACMC design, including suspected sources of knowledge error in the EFC diffraction model.

Wilson, Daniel↗
NASA NTRS1993

Segmentation Of Multifrequency, Multilook SAR Data

Segmentation of multifrequency, multilook synthetic-aperture radar (SAR) image intensity data into regions, within each of which backscattering characteristics of target scene considered homogeneous, enhanced by use of two statistical models. One represents statistics of multifrequency, multilook speckled intensities of SAR picture elements; other represents statistics of labels applied to regions into which picture elements grouped. Each region represents different type of terrain, terrain cover, or other surface; e.g., forest, agricultural land, sea ice, or water. Segmentation of image into regions of neighboring picture elements accomplished by method similar to that described in "Algorithms For Segmentation Of Complex-Amplitude SAR Data" (NPO-18524).

Rignot, Eric J.↗
NASA NTRS2017

Coronagraph Design Optimization for Segmented Aperture Telescopes

The goal of directly imaging Earth-like planets in the habitable zone of other stars has motivated the design of coronagraphs for use with large segmented aperture space telescopes. In order to achieve an optimal trade-o between planet light throughput and di racted starlight suppression, we consider coronagraphs comprised of a stage of phase control implemented with deformable mirrors (or other optical elements), pupil plane apodization masks (gray scale or complex valued), and focal plane masks (either amplitude only or complex-valued, including phase only such as the vector vortex coronagraph). The optimization of these optical elements, with the goal of achieving 10 or more orders of magnitude in the suppression of on-axis (starlight) di racted light, represents a challenging non-convex optimization problem with a nonlinear dependence on control degrees of freedom. We develop a new algorithmic approach to the design optimization problem, which we call the "Auxiliary Field Optimization" (AFO) algorithm. The central idea of the algorithm is to embed the original optimization problem, for either phase or amplitude (apodization) in various planes of the coronagraph, into a problem containing additional degrees of freedom, speci cally ctitious "auxiliary" electric elds which serve as targets to inform the variation of our phase or amplitude parameters leading to good feasible designs. We present the algorithm, discuss details of its numerical implementation, and prove convergence to local minima of the objective function (here taken to be the intensity of the on-axis source in a "dark hole" region in the science focal plane). Finally, we present results showing application of the algorithm to both unobscured o -axis and obscured on-axis segmented telescope aperture designs. The application of the AFO algorithm to the coronagraph design problem has produced solutions which are capable of directly imaging planets in the habitable zone, provided end-to-end telescope system stability requirements can be met. Ongoing work includes advances of the AFO algorithm reported here to design in additional robustness to a resolved star, and other phase or amplitude aberrations to be encountered in a real segmented aperture space telescope.

Redding, Dave↗
DOE OSTI2025

SwinCell: a 3D transformer and flow-based framework for improved cell segmentation

Segmentation of three-dimensional (3D) cellular images is fundamental for studying and understanding cell structure and function. However, 3D cellular segmentation is challenging, particularly for dense cells and tissues. This challenge arises mainly from the complex contextual information within 3D images, anisotropic properties, and the sensitivity to internal cellular structures, which often lead to incorrect segmentation. In this work, we introduce SwinCell, a 3D transformer-based framework that leverages Swin-transformer to predict flow and differentiate individual cell instances. We demonstrate SwinCell’s utility in the segmentation of nuclei, colon tissue cells, and densely cultured cells. SwinCell strikes a balance between maintaining detailed local feature recognition and understanding broader contextual information. Through extensive testing with both public and in-house 3D cell imaging datasets, SwinCell shows utility in segmenting dense cells, making it a valuable tool for 3D segmentation in cellular analysis that could expedite research in cell biology and tissue engineering.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Unsupervised learning-enabled pulsed infrared thermographic microscopy of subsurface defects in stainless steel

Metallic structures produced with laser powder bed fusion (LPBF) additive manufacturing method (AM) frequently contain microscopic porosity defects, with typical approximate size distribution from one to 100 microns. Presence of such defects could lead to premature failure of the structure. In principle, structural integrity assessment of LPBF metals can be accomplished with nondestructive evaluation (NDE). Pulsed infrared thermography (PIT) is a non-contact, one-sided NDE method that allows for imaging of internal defects in arbitrary size and shape metallic structures using heat transfer. PIT imaging is performed using compact instrumentation consisting of a flash lamp for deposition of a heat pulse, and a fast frame infrared (IR) camera for measuring surface temperature transients. However, limitations of imaging resolution with PIT include blurring due to heat diffusion, sensitivity limit of the IR camera. We demonstrate enhancement of PIT imaging capability with unsupervised learning (UL), which enables PIT microscopy of subsurface defects in high strength corrosion resistant stainless steel 316 alloy. PIT images were processed with UL spatial–temporal separation-based clustering segmentation (STSCS) algorithm, refined by morphology image processing methods to enhance visibility of defects. The STSCS algorithm starts with wavelet decomposition to spatially de-noise thermograms, followed by UL principal component analysis (PCA), fine-tuning optimization, and neural learning-based independent component analysis (ICA) algorithms to temporally compress de-noised thermograms. The compressed thermograms were further processed with UL-based graph thresholding K-means clustering algorithm for defects segmentation. The STSCS algorithm also includes online learning feature for efficient re-training of the model with new data. For this study, metallic specimens with calibrated microscopic flat bottom hole defects, with diameters in the range from 203 to 76 µm, were produced using electro discharge machining (EDM) drilling. While the raw thermograms do not show any material defects, using STSCS algorithm to process PIT images reveals defects as small as 101 µm in diameter. To the best of our knowledge, this is the smallest reported size of a sub-surface defect in a metal imaged with PIT, which demonstrates the PIT capability of detecting defects in the size range relevant to quality control requirements of LPBF-printed high-strength metals.

36 MATERIALS SCIENCE↗
NASA NTRS2006

Dynamic Aperture-based Solar Loop Segmentation

A new method to automatically segment arc-like loop structures from intensity images of the Sun's corona is introduced. The method constructively segments credible loop structures by exploiting the Gaussian-like shape of loop cross-sectional intensity profiles. The experimental results show that the method reasonably segments most of the well-defined loops in coronal images. The method is only the second published automated solar loop segmentation method. Its advantage over the other published method is that it operates independently of supplemental time specific data.

Lee, Jon Kwan↗
DOE OSTI2023

MATBOX, an Open-Source Microstructure Analysis Toolbox for Meshing, Generation, Segmentation, and Characterization of 3D Heterogenous Volumes

Battery performance is strongly correlated with electrode microstructural properties. To account for its impact, lithium-ion battery (LIB) models either abstract the microstructural heterogeneity of composite electrodes using effective macroscopic properties (macro- or meso- scale models) or directly solve the system of equations on the microstructure geometry or mesh (microstructure-scale models). Therefore, to be adequate, both families of models require information from the microstructure geometry, which can be provided by the numerical tool presented in this work. MATBOX is a MATLAB open-source application [1] developed by NREL for performing various microstructure-related tasks including microstructure numerical generation, image filtering and microstructure segmentation, microstructure characterization and correlation, visualization, and microstructure meshing. MATBOX was originally developed for the analysis of LIB electrode microstructures; however, the algorithms provided by the toolbox are widely applicable to other heterogeneous materials. The toolbox provides a user-friendly experience thanks to a Graphical-User Interface, requires no coding by the user, and is well documented. This presentation will illustrate various MATBOX features for the characterization of a LIB electrode, including a fully automated Representative Volume Element (RVE) analysis, the numerical generation of complex 'virtual' microstructure, including dual-layer electrodes and carbon-binder additive phase, and the meshing of a complex NMC/graphite full cell microstructure suitable for 3D finite-element modeling. Other modules (segmentation, visualization, and correlation) will be briefly presented. Thanks to its modular, open-source approach, MATBOX can easily incorporate third-party algorithms to eventually build a standard in the field that will benefit the whole scientific community. Effective diffusion coefficient [2], additive phase numerical generation [3], and meshing [4] third-party algorithms have been already integrated in the toolbox with more to come.

DIRECT ENERGY CONVERSION,MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Anatomical Fraction segmentation in the biomass bales

The U.S. Department of Energy Bioenergy Technologies Office (BETO) is committed to the development of sustainable, nationwide, commercial biofuel production to displace petroleum-derived fuels, increase domestic energy production, and encourage the creation of a domestic bioenergy and bioproducts industry. Operating a commercial-scale bioenergy operation requires significant technological advancements for determining biomass feedstock quality during the preprocessing stage. Usage of non-food feedstocks- e.g., corn-stover, pine residue, and forest residue - at the biorefineries reduces strain on the food supply chain. But the non-food feedstock heterogeneity- physical size, shape, and chemical composition-poses a significant challenge during milling, conveyance, feeding, and biofuel conversion processes. 3D X-Ray imaging (CT) is capable of distinguishing material features by detecting density and compositional differences. But the inherent complexity introduced during harvesting and bailing makes the reconstruction and interpretation of baled biomass materials from x-ray data time consuming, laborious, and expensive. Feedstocks are low-density materials that produce small contrast differences in the x-ray images. This paper focuses on using the shape and texture properties, using 3D image processing techniques like 3D skeletonization, directional statistics to characterize and extract volumetric content of the different tissue samples in the biomass bales.

09 BIOMASS FUELS↗
DOE OSTI2025

Hyperspectral segmentation of plants in fabricated ecosystems

Hyperspectral imaging provides a powerful tool for analyzing above-ground plant characteristics in fabricated ecosystems, offering rich spectral information across diverse wavelengths. This study presents an efficient workflow for hyperspectral data segmentation and subsequent data analytics, minimizing the need for user annotation through the use of ensembles of sparse mixed scale convolution neural networks. The segmentation process leverages the diversity of ensembles to achieve high accuracy with minimal labeled data, reducing labor-intensive annotation efforts. To further enhance robustness, we incorporate image alignment techniques to address spatial variability in the dataset. Downstream analysis focuses on using the segmented data for processing spectral data, enabling monitoring of plant health. This approach provides a scalable solution for spectral segmentation, and facilitates actionable insights into plant conditions in complex, controlled environments. Our results demonstrate the utility of combining advanced machine learning techniques with hyperspectral analytics for high-throughput plant monitoring.

Zwart, Petrus H.↗
DOE OSTI2025

Nondestructive In Operando Imaging of Thin Film Composite Membrane Compaction Enhanced by AI-Based Segmentation

Reverse osmosis (RO) membranes are essential for desalination and water reuse, yet their permeability declines in high-pressure applications due to membrane compaction. This study investigates the structural and functional responses of commercial brackish, seawater, and high-pressure RO membranes at applied pressures up to 120 bar using a multiscale, nondestructive in operando scanning electron microscopy (iSEM) imaging platform. The iSEM technique reveals progressive densification across the composite membrane structure, which correlates with observed declines in water and solute permeance. To quantify these structural changes with greater fidelity, we combined X-ray computed tomography with AI-based segmentation enabling precise analysis of pore size distribution and thickness of the polysulfone support layer. Compared to traditional thresholding, AI segmentation accurately delineates material phases and void spaces, enhancing the reproducibility and resolution of morphological assessments. The results demonstrate that compaction-induced reductions in porosity and thickness strongly impact membrane transport properties. These findings provide mechanistic insights into the compaction behavior of RO membranes and underscore the potential for advanced imaging and AI-driven data analysis to guide the design of next-generation membranes with improved mechanical resilience and operational longevity.

13 HYDRO ENERGY↗
NASA NTRS2012

Dispersed Fringe Sensing Analysis - DFSA

Dispersed Fringe Sensing (DFS) is a technique for measuring and phasing segmented telescope mirrors using a dispersed broadband light image. DFS is capable of breaking the monochromatic light ambiguity, measuring absolute piston errors between segments of large segmented primary mirrors to tens of nanometers accuracy over a range of 100 micrometers or more. The DFSA software tool analyzes DFS images to extract DFS encoded segment piston errors, which can be used to measure piston distances between primary mirror segments of ground and space telescopes. This information is necessary to control mirror segments to establish a smooth, continuous primary figure needed to achieve high optical quality. The DFSA tool is versatile, allowing precise piston measurements from a variety of different optical configurations. DFSA technology may be used for measuring wavefront pistons from sub-apertures defined by adjacent segments (such as Keck Telescope), or from separated sub-apertures used for testing large optical systems (such as sub-aperture wavefront testing for large primary mirrors using auto-collimating flats). An experimental demonstration of the coarse-phasing technology with verification of DFSA was performed at the Keck Telescope. DFSA includes image processing, wavelength and source spectral calibration, fringe extraction line determination, dispersed fringe analysis, and wavefront piston sign determination. The code is robust against internal optical system aberrations and against spectral variations of the source. In addition to the DFSA tool, the software package contains a simple but sophisticated MATLAB model to generate dispersed fringe images of optical system configurations in order to quickly estimate the coarse phasing performance given the optical and operational design requirements. Combining MATLAB (a high-level language and interactive environment developed by MathWorks), MACOS (JPL s software package for Modeling and Analysis for Controlled Optical Systems), and DFSA provides a unique optical development, modeling and analysis package to study current and future approaches to coarse phasing controlled segmented optical systems.

Sigrist, Norbert↗
NASA NTRS1992

Thermal and range fusion for a planetary rover

This paper describes how fusion between thermal and range imaging allows us to discriminate different types of materials in outdoor scenes. First, we analyze how pure vision segmentation algorithms applied to thermal images allow discriminating materials such as rock and sand. Second, we show how combining thermal and range information allows us to better discriminate rocks from sand. Third, as an application, we examine how an autonomous legged robot can use these techniques to explore other planets.

Caillas, Claude↗
NASA NTRS2003

Design of a Borescope for Extravehicular Non-Destructive Applications

Anomalies such as corrosion, structural damage, misalignment, cracking, stress fiactures, pitting, or wear can be detected and monitored by the aid of a borescope. A borescope requires a source of light for proper operation. Today s current lighting technology market consists of incandescent lamps, fluorescent lamps and other types of electric arc and electric discharge vapor lamp. Recent advances in LED technology have made LEDs viable for a number of applications, including vehicle stoplights, traffic lights, machine-vision-inspection, illumination, and street signs. LEDs promise significant reduction in power consumption compared to other sources of light. This project focused on comparing images taken by the Olympus IPLEX, using two different light sources. One of the sources is the 50-W internal metal halide lamp and the other is a 1 W LED placed at the tip of the insertion tube. Images acquired using these two light sources were quantitatively compared using their histogram, intensity profile along a line segment, and edge detection. Also, images were qualitatively compared using image registration and transformation [l]. The gray-level histogram, edge detection, image profile and image registration do not offer conclusive results. The LED light source, however, produces good images for visual inspection by an operator. Analysis using pattern recognition using Eigenfaces and Gaussian Pyramid in face recognition may be more useful.

Bachnak, Rafic↗
DOE OSTI2026

Comparison of automated chemical-guided segmentation and human annotation of soil organic matter in X-ray microcomputed tomography imaging in contrasted soil types

Soil organic matter (OM) formation and persistence is strongly influenced by the spatial distribution of organic substrates and microscale soil heterogeneity by dictating OM accessibility to microorganisms. However, traditional size and/or density fractionation techniques disrupt aggregate architecture, eliminating spatial information needed to fully understand intra-aggregate OM distribution. To quantify three-dimensional OM spatial distribution and automate segmentation in X-ray microcomputed tomography (µCT) imaging without human annotation bias, we developed an iodine gas vapor (I2) based staining workflow that eliminates labor-intensive manual annotation while maintaining segmentation accuracy, using aggregates from four taxonomically diverse soils (Xerofluvent, Haploxeroll Sphagnofibrist, Palehumult) with an 8-fold range of soil organic carbon. Human annotation of 10 µCT slices by the experienced and inexperienced annotators resulted in variations up to 3% in the Dice similarity coefficient (DSC), reflecting a degree of inherent subjectivity of manual labeling. Such inconsistencies are expected to compound as the number of manually annotated slices increases. Dual-energy µCT imaging at 33.1 keV (below the iodine (I) K-edge) and 33.2 keV (above the I K-edge) was used to resolve aggregate microstructure following I2 staining. The automated image subtraction pipeline identified OM regions by the I Kedge induced brightness increases, achieving DSC values of 0.58–0.83 relative to an experienced annotator. Sensitivity analyses revealed that the reconstruction alpha value—optimized via the open-source tool TomocuPy—and the 3D registration slice count were the primary determinants of accuracy, providing a novel benchmark for dual-energy soil imaging. The pipeline without GPU acceleration achieved 9.6 to 43.2 times faster than manual annotation. Using GPU-accelerated image post-processing and affine transformation matrices, the pipeline successfully segmented OM elements for large-scale datasets (3232×3232 pixel, 2048 slices) within ~5200 s from raw file acquisition to segmented output. The high-throughput approach enables the quantification of OM spatial distribution across diverse and heterogeneous soil.

Soil microbial biomass↗
DOE OSTI2020

Root identification in minirhizotron imagery with multiple instance learning

In this study, multiple instance learning (MIL) algorithms to automatically perform root detection and segmentation in minirhizotron imagery using only image-level labels are proposed. Root and soil characteristics vary from location to location, and thus, supervised machine learning approaches that are trained with local data provide the best ability to identify and segment roots in minirhizotron imagery. However, labeling roots for training data (or otherwise) is an extremely tedious and time-consuming task. This paper aims to address this problem by labeling data at the image level (rather than the individual root or root pixel level) and train algorithms to perform individual root pixel level segmentation using MIL strategies. Three MIL methods (multiple instance adaptive cosine coherence estimator, multiple instance support vector machine, multiple instance learning with randomized trees) were applied to root detection and compared to non-MIL approaches. The results show that MIL methods improve root segmentation in challenging minirhizotron imagery and reduce the labeling burden. In our results, multiple instance support vector machine outperformed other methods. The multiple instance adaptive cosine coherence estimator algorithm was a close second with an added advantage that it learned an interpretable root signature which identified the traits used to distinguish roots from soil and did not require parameter selection.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2004

Optical Modeling Activities for the James Webb Space Telescope (JWST) Project: Determining Image Motion and Wavefront Error Over an Extended Field of View with a Segmented Optical System - II

This is part two of a series on the optical modeling activities for JWST. Starting with the linear optical model discussed in part one, we develop centroid and wavefront error sensitivities for the special case of a segmented optical system such as JWST, where the primary mirror consists of 18 individual segments. Our approach extends standard sensitivity matrix methods used for systems consisting of monolithic optics, where the image motion is approximated by averaging ray coordinates at the image and residual wavefront error is determined with global tip/tilt removed. We develop an exact formulation using the linear optical model, and extend it to cover multiple field points for performance prediction at each instrument aboard JWST. This optical model is then driven by thermal and dynamic structural perturbations in an integrated modeling environment. Results are presented.

Howard, Joseph M.↗
DOE OSTI2022

Understanding the role of segmentation on process-structure–property predictions made via machine learning

Here, the present study investigated the effect of porosity surface determination methods on performance of machine learning models used to predict the tensile properties of AlSi10Mg processed by laser powder bed fusion from micro-computed tomography data. Machine learning models applied in this work include support vector machines, neural networks, decision trees, and Bayesian classifiers. The effects of isosurface thresholding and local gradient approaches for porosity segmentation, as well as image filtering schemes, on model precision were evaluated for samples produced under differing levels of global energy density.

36 MATERIALS SCIENCE↗