Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Reducing the Parameter Dependency of Phase-Picking Neural Networks with Dice Loss

Training a neural network for picking seismic phase arrivals has been commonly posed as a segmentation problem. It is a highly imbalanced segmentation problem in the sense that the background vastly dominates the foreground because we are trying to pick the optimal single sample point that represents the arrival of a seismic phase in a many seconds long time window. Here, we test the Dice loss, which is a preferred loss function for highly imbalanced image segmentation problems. We show that phase-picking neural networks trained on the Dice loss behave in a binary fashion for which the prediction output is almost always either nearly 1 or nearly 0. This feature removes the strong dependence of data processing workflows on the prediction score threshold, which is an otherwise critical parameter to determine when using neural networks trained on the cross-entropy loss. When strategically used, models trained on the Dice loss can reduce the parameter dependency of machine learning-based seismic monitoring.

58 GEOSCIENCES↗
DOE OSTI2022

In situ laser profilometry for material segmentation and digital reconstruction of a multicomponent additively manufactured part

In addition to its ability to produce geometrically complex parts, additive manufacturing offers a unique opportunity to collect data about a component while it is being fabricated. However, there has only been limited effort to characterize parts morphologically and compositionally in situ. In this article, we present a layer-by-layer, laser profilometry-based in situ characterization technique as a method to digitally reconstruct a multi-material part. Data collected by the laser profilometer yields height maps and grayscale images which are voxelized using purpose-built software to volumetrically reconstruct the part. Additionally, the same part was also analyzed using X-ray computed tomography (CT) which was not able to resolve the different compositional regions within the part, but captured the filament morphology. The part was then bisected to compare the digital reconstruction to the actual part morphology and composition. Overall, the digital reconstruction was in good agreement with both the CT and bisected images. Deviations between the digital reconstruction and the CT/bisected images are likely the result of image segmentation settings or material shifts after data was collected. The in situ characterization method demonstrated here sets the stage for real time process monitoring and paves the way for additively manufactured parts that are “born qualified.”

36 MATERIALS SCIENCE↗
DOE OSTI2022

Automated Defect Identification for Tri-structural Isotropic Fuels (AUDIT)

During the manufacture of tri-structural isotropic (TRISO)-coated nuclear fuel particles, the potential exists for the formation of internal fissure defects in the uranium oxycarbide (UCO) kernels. These fissures result in a defective fuel particle that can fracture during subsequent fuel processing. Therefore, it is necessary to detect the presence of fissured kernels in a batch to determine if the batch meets specification prior to blending with other batches and upgrading processes. Previous attempts at identifying fissures involved manual inspection of micrographs of UCO fuel kernel cross-sections. This process is tedious, time-consuming and may introduce counting errors making it a good candidate for automation. This work presents a method for the automated detection of fissures in UCO kernels. Image segmentation is used for the extraction of relevant features in the micrographs which then serve as the input to a convolutional neural network used to automatically distinguish between fissured and non-fissured kernels.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Modeling inter‐reader variability in clinical target volume delineation for soft tissue sarcomas using diffusion model

Abstract Background Accurate delineation of the clinical target volume (CTV) is essential in the radiotherapy treatment of soft tissue sarcomas. However, this process is subject to inter‐reader variability due to the need for clinical assessment of risk and extent of potential microscopic spread. This can lead to inconsistencies in treatment planning, potentially impacting treatment outcomes. Most existing automatic CTV delineation methods do not account for this variability and can only generate a single CTV for each case. Purpose This study aims to develop a deep learning‐based technique to generate multiple CTV contours for each case, simulating the inter‐reader variability in the clinical practice. Methods We employed a publicly available dataset consisting of fluorodeoxyglucose positron emission tomography (FDG‐PET), x‐ray computed tomography (CT), and pre‐contrast T1‐weighted magnetic resonance imaging (MRI) scans from 51 patients with soft tissue sarcoma, along with an independent validation set containing five additional patients. An experienced reader drew a contour of the gross tumor volume (GTV) for each patient based on multi‐modality images. Subsequently, two additional readers, together with the first one, were responsible for contouring three CTVs in total based on the GTV. We developed a diffusion model‐based deep learning method that is capable of generating arbitrary number of different and plausible CTVs to mimic the inter‐reader variability in CTV delineation. The proposed model incorporates a separate encoder to extract features from the GTV masks, leveraging the critical role of GTV information in accurate CTV delineation. Results The proposed diffusion model demonstrated superior performance with the highest Dice Index (0.902 compared to values below 0.881 for state‐of‐the‐art models) and the best generalized energy distance (GED) (0.209 compared to values exceeding 0.221 for state‐of‐the‐art models). It also achieved the second‐highest recall and precision metrics among the compared ambiguous image segmentation models. Results from both datasets exhibited consistent trends, reinforcing the reliability of our findings. Additionally, ablation studies exploring different model structures and input configurations highlighted the significance of incorporating prior GTV information for accurate CTV delineation. Conclusions The proposed diffusion model successfully generates multiple plausible CTV contours for soft tissue sarcomas, effectively capturing inter‐reader variability in CTV delineation.

Dong, Yafei [Yale Biomedical Imaging Institute Yal↗
DOE OSTI2025

Tracking Dendritic Growth in Hydrogen-Based Hematite Reduction via Computer Vision

The reduction of hematite to metallic iron using hydrogen (H2) as a reducing agent presents a promising pathway for decarbonizing steel production. In this study, we employ a combination of in situ confocal scanning laser microscopy (CSLM) and advanced computer vision techniques to quantitatively analyze dendritic growth of ferrite during H2-based reduction of iron oxide at high temperatures. A workflow integrating Watershed Image Segmentation (WIS) and Lucas-Kanade Optical Flow (LKOF) is developed to extract both global and local kinetic information from time-resolved micrograph sequences. H2 reduction experiments conducted at 1400 degrees C and 1500 degrees C demonstrate a clear correlation between temperature and reduction rate, as evidenced by accuracy of fitted Johnson-Mehl-Avrami-Kolmogorov (JMAK) parameters. Optical flow analysis further elucidates the anisotropic and branched nature of dendritic growth, providing spatially resolved velocity fields that correlate well with global transformation kinetics. The proposed methodology demonstrates strong agreement with experimental measurements and literature values, offering a robust framework for automated image-based analysis to study kinetics through microstructural evolution in the reduction of iron ore, and likely other reaction-diffusion phenomena.

08 HYDROGEN↗
DOE OSTI2024

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

Agriculture↗
DOE OSTI2022

Cross-scale sensing of field-level crop residue cover: Integrating field photos, airborne hyperspectral imaging, and satellite data

Conservation tillage practices can bring benefits to agricultural sustainability. Accurate spatial and temporal resolved information of field-scale crop residue cover, which reflects tillage intensity, is highly valuable for evaluating the outcomes of government conservation programs and voluntary ecosystem service markets, as well as facilitating agroecosystem modeling to quantify cropland biogeochemical processes. Remote sensing has the potential to cost-effectively detect crop residue cover, however, existing regional-scale studies were limited by insufficient ground truth data, scale mismatch between coarse satellite pixels and ground data, and the lack of key spectral data for detecting crop residues. Therefore, this study developed an innovative cross-sensing framework to integrate proximal sensing, airborne hyperspectral imaging, and satellite Earth Observation through deep learning to quantify field-level crop residue cover fractions at the regional scale. Specifically, we have collected intensive ground orthographic photos and conducted airborne hyperspectral surveys at corn and soybean fields of Champaign and nearby counties in Illinois, the heartland of the U.S. Corn Belt. Through semi-automatic labeling aided by ResNet-50 and superpixel image segmentation, we obtained 6719 records of ground residue fractions. With these ground data, we developed the 1-dimensional convolution neural network (CNN) model using airborne hyperspectral reflectance, which has 0.5m spatial resolution and 3–5 nm spectral resolution from 400 to 2400 nm, to predict residue fractions. By applying the CNN model to airborne pixels, we augmented “ground truth” data of crop residues and further combined them with Harmonized Landsat and Sentinel-2 (HLS) satellite data to quantify regional residue fractions at 30 m resolution. Results show that airborne hyperspectral imagery with CNN can accurately detect residue fractions (R 2 = 0.82, relative RMSE = 11.73%) to effectively generate quasi “ground truth” data to support satellite upscaling to all fields. With independent ground data for testing, we found that the ground-airborne-satellite integrative framework achieved better predictions in estimating crop residue cover (R 2 = 0.67, relative RMSE = 17.53%) than the conventional ground-satellite upscaling (R 2 = 0.22, relative RMSE = 32.09%). Here we also found that the shortwave infrared wavelengths, particularly 2100–2300 nm, are vital for predicting crop residue cover. Sentinel-2 and Landsat-8 data have a comparable capability to track residue fractions due to similar shortwave infrared wavelengths. This study highlights the high accuracy of hyperspectral imaging to detect agroecosystem tillage management practices and the advantages of cross-scale sensing to cost-effectively integrate multi-source data to quantify field-level agroecosystem variables across scales.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Nanometer Scale Imaging to Develop Quantitative Descriptors of Bipolar Membrane Junction Structure

Swings in pH can be achieved by electrically polarizing a bipolar membrane (BPM) to drive water dissociation at the BPM junction for electrochemical conversion and separation processes. BPM junction design is critical to tailor performance for specific applications; however, characterization techniques capable of resolving the nanometer scale physical structure of the junction are limited. We present sample preparation, imaging, and analysis workflows that are adaptable to a variety of BPM junction architectures. Atomic force microscopy produces BPM junction images with nanometer scale lateral resolution for samples with and without a graphene oxide water dissociation catalyst in the junction. Subsequent image segmentation and analysis quantify line edge roughness and catalyst layer thickness as descriptors of junction structure. Comparison of pre- and post-electrodialysis junctions suggests electric field-induced alignment of catalyst particles during electrodialysis. This characterization workflow can inform manufacturing protocols, computational modeling, and failure mode analysis for next-generation BPMs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Exploring Physics of Ferroelectric Domain Walls in Real Time: Deep Learning Enabled Scanning Probe Microscopy

The functionality of ferroelastic domain walls in ferroelectric materials is explored in real-time via the in situ implementation of computer vision algorithms in scanning probe microscopy (SPM) experiment. The robust deep convolutional neural network (DCNN) is implemented based on a deep residual learning framework (Res) and holistically nested edge detection (Hed), and ensembled to minimize the out-of-distribution drift effects. The DCNN is implemented for real-time operations on SPM, converting the data stream into the semantically segmented image of domain walls and the corresponding uncertainty. Further the pre-defined experimental workflows perform piezoresponse spectroscopy measurement on thus discovered domain walls, and alternating high- and low-polarization dynamic (out-of-plane) ferroelastic domain walls in a PbTiO 3 (PTO) thin film and high polarization dynamic (out-of-plane) at short ferroelastic walls (compared with long ferroelastic walls) in a lead zirconate titanate (PZT) thin film is reported. This work establishes the framework for real-time DCNN analysis of data streams in scanning probe and other microscopies and highlights the role of out-of-distribution effects and strategies to ameliorate them in real time analytics.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Using X-ray radiography to study oxygen flow in a proton exchange membrane electrolyzer operating under balanced pressure conditions

Of the various water electrolyzer technologies, the proton exchange membrane electrolyzer (PEMWE) is one of the best solutions for producing clean hydrogen without releasing CO 2 . In order to allow for widespread use of clean hydrogen, it is necessary to decrease its cost, which is intrinsically related to system operation. Current PEMWE plants operate in differential mode, directly pressurizing hydrogen and benefiting from thermodynamic compression, which increases overall system efficiency. However, high differential pressure above 30 bar can cause membrane stress, resulting in membrane creeping and failure. Pressurizing the water and operating at balanced pressure allows hydrogen to be produced at higher pressures while preserving the integrity of the membrane and porous layers. Nevertheless, the impact of pressurizing water on PEMWE performance must be better understood to maximize performance under balanced pressure conditions. Here, this study examined the impact of water pressure on two-phase flow. A high-pressure electrolyzer setup was developed to perform operando X-ray radiography and examine oxygen transport with high temporal resolution. The imaging segmentation process, developed to capture bubble properties in the channel, was applied to a specific experiment. The results clearly showed that as pressure increased up to 30 bars, the initial bubbly flow transitioned to slug flow, which led to channel saturation with oxygen. This work demonstrates that two-phase flow in an electrolyzer can be studied using X-ray radiography, which has the advantages of fast measurements and the ability to probe dense materials, such as those required for pressurized electrolyzers.

Balanced high pressure operation↗
DOE OSTI2026

Methods development towards automated, physics-informed, quantitative quality control of TRISO-SiC

Tristructural-isotropic (TRISO) fuel particles have been developed as a high-performance fuel for use in high-temperature gas-cooled reactor (HTGR) systems due to their high efficiency and stability under both normal and off-normal conditions. Broader deployment of this technology in advanced nuclear applications may benefit from quantitative quality assurance and quality control (QA/QC) methods that directly link TRISO properties to downstream performance. A key TRISO property is the SiC layer microstructure, which influences fission product retention during irradiation. However, existing QA/QC for the TRISO-SiC microstructure comprises only a qualitative visual inspection; therefore, there is a clear opportunity for the development of quantitative methods for TRISO QA/QC. Here, to this end, previous work has demonstrated an image processing approach to grain boundary (GB) identification and subsequent extraction of microstructural metrics; however, extensive twinning within the SiC layer complicates such analyses because twin GBs significantly influence microstructural metrics but are not expected to contribute to fission product transport. This study presents the initial development, training, and testing of an ML-based image segmentation algorithm designed to identify and remove twin GBs from standard backscattered electron micrographs, providing an industrially applicable, quantitative, and physically meaningful QA/QC approach for the TRISO-SiC microstructure. Although pixel-wise performance metrics for the twin predictions are low, the change in grain area and the number of GB pixels after twin removal predicted by the ML workflow are within 1% of the true values calculated using crystallographic data. This suggests that the model is well capable of predicting overall twin boundary structures and grain morphology, and continued advancement of this approach could enable automated, scalable, and physics-informed QA/QC for TRISO-SiC microstructures, supporting the reliable qualification of coated particle fuels for next-generation reactor systems.

Computer vision↗
DOE OSTI2020

Recent advances in computational mathematics and applications

We are honored to bring you this special issue dedicated to recent advances in computational mathematics and applications in science and engineering. The papers in this special issue were presented in ”Conference on Computational Mathematics and Applications (CCMA)” held at the University of Nevada Las Vegas (UNLV) during October 25–27, 2019. The conference has attracted about 90 attendees from six countries. The 15 papers in the special issue comprise a diverse collection of theoretical numerical analysis as well as applications in various subjects. Topics cover optimal control of PDEs, discontinuous Galerkin methods, fluid flow in porous media, turbulence flow, static and moving interface problems, complex fluids composed by the mixture of Newtonian fluid and nematic (liquid crystal) flows, modeling of ocean–atmosphere system, image segmentation algorithm, uncertainty quantification problems for turbulence model and Maxwell’s equations, iterative solver for systems resulting from mixed methods, and novel methods for solving systems of nonlinear equations. As the Guest Editors we would like to thank Dr. Leland Jameson at NSF (National Science Foundation) for kindly supporting our conference proposal which made this conference possible. We would also like to thank Darren Sugrue from Elsevier who provided partial support for our conference, and Thennarasu Gunasekaran and his production team from Elsevier who produced this nice special issue. We are grateful to many people (Dr. Zhijian Wu, Lori Ornelas, Elsa Juarez, and many Ph.D. students) at the Department of Mathematical Sciences of UNLV who provided tremendous support for the conference. Finally, we very much appreciate all authors who contributed their precious results to this special issue.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Toward In Situ Synchrotron Mapping of Crystal Selection Processes during Crystal Growth

In this work, we present an automated and rapid method for non-destructive mapping of crystal grains in a rod-shaped sample. The approach was designed for application to in situ float-zone crystal growth experiments at an x-ray synchrotron source, but could be useful in other applications. The methods have been tested on a TiO 2 boule grown in an optical float zone furnace. The approach applies a statistical filter to polycrystalline diffraction patterns on 2D detectors to rapidly determine the degree of powder-quality 1of the signal. When larger crystals emerge in the growth, their position, size and shape can be tracked using an automated blob-tracking algorithm that follows individual Bragg peaks as a function of position in a grid-scan, even when multiple crystals are contributing spots to diffraction images. This method is found to be robust as the same crystal shape can be independently reconstructed using different sets of Bragg reflections. Image segmentation methods are then used to map out the polycrystalline grains. We also note that other information about crystal quality, such as mosaicity or strain state, may be inferred and mapped from the intensity variation of the Bragg peaks at different locations within the sample.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Defect detection in atomic-resolution images via unsupervised learning with translational invariance

Abstract Crystallographic defects can now be routinely imaged at atomic resolution with aberration-corrected scanning transmission electron microscopy (STEM) at high speed, with the potential for vast volumes of data to be acquired in relatively short times or through autonomous experiments that can continue over very long periods. Automatic detection and classification of defects in the STEM images are needed in order to handle the data in an efficient way. However, like many other tasks related to object detection and identification in artificial intelligence, it is challenging to detect and identify defects from STEM images. Furthermore, it is difficult to deal with crystal structures that have many atoms and low symmetries. Previous methods used for defect detection and classification were based on supervised learning, which requires human-labeled data. In this work, we develop an approach for defect detection with unsupervised machine learning based on a one-class support vector machine (OCSVM). We introduce two schemes of image segmentation and data preprocessing, both of which involve taking the Patterson function of each segment as inputs. We demonstrate that this method can be applied to various defects, such as point and line defects in 2D materials and twin boundaries in 3D nanocrystals.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Ultraviolet Fluorescence Imaging for Photovoltaic Module Metrology: Best Practices and Survey of Features Observed in Fielded Modules

As the photovoltaics (PV) industry grows in sophistication, so must the extent to which systems are characterized. UV Fluorescence (UVF) imaging is a valuable, easy-to-perform, high-throughput, nonintrusive technique for characterizing modules in the field and in the lab. However, UVF is still a relatively new technique, and many in the PV industry are still unaware of its potential. We provide a guideline for obtaining, processing, and interpreting UVF images. We have provided a list of considerations for imaging hardware and settings, a suggested pipeline for image processing, and details on a survey of features shown in UVF images. As a result, a new database with UVF images of 7190 modules and another database curated by BrightSpot Automation are publicly available.

14 SOLAR ENERGY↗
DOE OSTI2020

Distributed-Memory Parallel Symmetric Nonnegative Matrix Factorization

We develop the first distributed-memory parallel implementation of Symmetric Nonnegative Matrix Factorization (SymNMF), a key data analytics kernel for clustering and dimensionality reduction. Our implementation includes two different algorithms for SymNMF, which give comparable results in terms of time and accuracy. The first algorithm is a parallelization of an existing sequential approach that uses solvers for non symmetric NMF. The second algorithm is a novel approach based on the Gauss-Newton method. It exploits second-order information without incurring large computational and memory costs. We evaluate the scalability of our algorithms on the Summit system at Oak Ridge National Laboratory, scaling up to 128 nodes (4,096 cores) with 70% efficiency. Additionally, we demonstrate our software on an image segmentation task.

Eswar, Srinivas↗
DOE OSTI2021

Graphene U-Net v1

Graphene U-Net is a library that provides a simplified platform for training deep neural networks for the task of microscopy image segmentation. It contains functions and classes that make the process of training a neural network simple such that non-ML experts can train and evaluate models on their own datasets. It uses Pytorch as a backend and can run on both CUDA-enable GPUs and CPUs. It contains the main library file Microscopy_Unet.py as well as unet.py which contains the UNET model used for this software. This can be replaced with any other fully convolutional deep learning architecture with relative ease.

Sadre, Robbie↗
DOE OSTI2024

pvcracks

SAND2024-00922O This software uses electroluminescence images to predict power loss due to cell cracks in photovoltaic modules. The software will incorporate trained variational autoencoder(s) to parameterize cell cracks detected in electroluminescence images of photovoltaic modules and relate cracks to electrical properties; reduced-order models of finite element simulations of electrical behavior of photovoltaic modules under thermomechanical stresses; reduced-order models of stress distributions; inside photovoltaic modules resulting from x-ray topography experiments; and image segmentation and splining methods to analyze x-ray topography measurements of cracked photovoltaic cells. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Hartley, James↗