Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A reference tissue atlas for the human kidney

Kidney Precision Medicine Project (KPMP) is building a spatially specified human kidney tissue atlas in health and disease with single-cell resolution. Here, we describe the construction of an integrated reference map of cells, pathways, and genes using unaffected regions of nephrectomy tissues and undiseased human biopsies from 56 adult subjects. We use single-cell/nucleus transcriptomics, subsegmental laser microdissection transcriptomics and proteomics, near-single-cell proteomics, 3D and CODEX imaging, and spatial metabolomics to hierarchically identify genes, pathways, and cells. Integrated data from these different technologies coherently identify cell types/subtypes within different nephron segments and the interstitium. These profiles describe cell-level functional organization of the kidney following its physiological functions and link cell subtypes to genes, proteins, metabolites, and pathways. They further show that messenger RNA levels along the nephron are congruent with the subsegmental physiological activity. This reference atlas provides a framework for the classification of kidney disease when multiple molecular mechanisms underlie convergent clinical phenotypes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Quantitative Insight to Fission Gas Bubble Distribution in Irradiated Annular U-10Zr Metallic Fuel Using Deep Learning

U-10Zr Metal fuel is a promising nuclear fuel candidate for next-generation sodium-cooled fast spectrum reactors. Porosity is one of the key facts to impact the performance of metallic fuel. Additionally, a mechanical understanding of fission gas bubbles evolution behavior is a prerequisite for fuel development and qualification. Previous study of fission gas bubbles relied on a simple threshold method working on low resolution optical microscopy images, which has challenges in recognizing bubble boundaries, and caused inaccurate statistics of bubble properties. In this paper, a pre-trained deep learning model on Scanning Electron Microscopy (SEM) images from an annular U-10Zr fuel (AF1), was applied to another U-10Zr annular fuel (AF2). More accurate fission gas bubble segmentation results were generated, which leads to more precise qualitative analysis on the morphology, size, density, and orientation of bubbles. Furthermore, we investigated the lanthanide movement along the radial temperature gradient and obtained conclusive findings.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Correlative Surface Imaging Reveals Chemical Signatures for Bacterial Hotspots on Plant Roots

The rhizosphere is arguably the most complex microbial habitat on earth, comprising an integrated network of plant roots, soil and a highly diverse microbial community (the rhizosphere microbiome)1. Understanding, predicting and controlling plant-microbe interactions in the rhizosphere will allow us to harness the plant microbiome as a means to increase or restore plant ecosystem productivity, improve plant responses to a wide range of environmental perturbations, and mitigate effects of climate change by designing ecosystems for long-term soil carbon storage1. To this end, it is imperative to develop new molecular approaches with high spatial resolution to capture interactions at the plant-microbe, microbe-microbe, and plant-plant interfaces. In this work, we designed an imaging sample holder that allows integrated surface imaging tools to map the same locations of a plant root-microbe interface with submicron lateral resolutions, providing novel in vivo analysis of root-microbe interactions. Specifically, confocal fluorescence microscopy, time-of-flight secondary ion mass spectrometry (ToF-SIMS), X-ray photoelectron spectroscopy (XPS), and scanning electron microscope (SEM) were used for the first time for correlative imaging of the Brachypodium distachyon root and its interaction with Pseudomonas SW25, a typical plant growth-promoting soil bacterium. Imaging data suggest that the root surface is inhomogeneous and that the interaction between Pseudomonas and Brachypodium roots was confined to only few spots along the sampled root segments and that the bacterial attachment spots were enriched in Na- and S-related and high-mass organic species. We conclude that attachment of the Pseudomonas cells to the root surface is outcompeted by strong root-soil mineral interactions but facilitated by formation of extracellular polymeric substances (EPS).

Plant root, Plant growth-promoting bacteria, soil,↗
DOE OSTI2022

A reusable neural network pipeline for unidirectional fiber segmentation

Abstract Fiber-reinforced ceramic-matrix composites are advanced, temperature resistant materials with applications in aerospace engineering. Their analysis involves the detection and separation of fibers, embedded in a fiber bed, from an imaged sample. Currently, this is mostly done using semi-supervised techniques. Here, we present an open, automated computational pipeline to detect fibers from a tomographically reconstructed X-ray volume. We apply our pipeline to a non-trivial dataset by Larson et al . To separate the fibers in these samples, we tested four different architectures of convolutional neural networks. When comparing our neural network approach to a semi-supervised one, we obtained Dice and Matthews coefficients reaching up to 98%, showing that these automated approaches can match human-supervised methods, in some cases separating fibers that human-curated algorithms could not find. The software written for this project is open source, released under a permissive license, and can be freely adapted and re-used in other domains.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Report on DIC Cyclic Dryout Testing of ATF Cladding Materials

Boiling water reactors can experience anticipated operational occurrences, where an expected deviation from normal operating conditions is witnessed for short time scales. One example of such transients arises from cladding dryout, where stable boiling becomes unstable, resulting in cladding heat up before re-wetting occurs. To understand the impact of such transients on fuel cladding lifetime and performance, cyclic dryout conditions were imposed upon fresh fuel cladding in the absence of irradiation. Pressurized cladding tube segments were exposed to rapid temperature increases to intermediate temperatures below a cladding rupture threshold and deformation was monitored in situ via 3-D digital image correlation. The impact of cycle frequency on cladding deformation was assessed. A clear understanding of elastic and plastic strain responses were developed for Zr alloy deformation under temperature transients, and these results can be used to support material model development and validate fuel performance codes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Microcomputed X-Ray Tomographic Imaging and Image Processing for Microstructural Characterization of Explosives

Microstructural characterization of composite high explosives (HEs) has become increasingly important over the last several decades in association with the development of high fidelity mesoscale modeling and an improved understanding of ignition and detonation processes. HE microstructure influences not only typical material properties (e.g., thermal, mechanical) but also reactive behavior (e.g., shock sensitivity, detonation wave shape). A detailed nondestructive 3D examination of the microstructure has generally been limited to custom-engineered samples or surrogates due to poor contrast between the composite constituents. Highly loaded (>90 wt%) HE composites such as plastic-bonded explosives (PBX) are especially difficult. Here, we present efforts to improve measurement quality by using single and dual-energy microcomputed X-ray tomography and state-of-the-art image processing techniques to study a broad set of HE materials. Some materials, such as PBX 9502, exhibit suitable contrast and resolution for an automatic segmentation of the HE from the polymer binder and the voids. Other composite HEs had varying levels of success in segmentation. Post-processing techniques that used commercially available algorithms to improve the segmentation quality of PBX 9501 as well as zero-density defects such as cracks and voids could be easily segmented for all samples. Aspects of the materials that lend themselves well to this type of measurement are discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4ml

In this paper, we investigate how field programmable gate arrays can serve as hardware accelerators for real-time semantic segmentation tasks relevant for autonomous driving. Considering compressed versions of the ENet convolutional neural network architecture, we demonstrate a fully-on-chip deployment with a latency of 4.9 ms per image, using less than 30% of the available resources on a Xilinx ZCU102 evaluation board. The latency is reduced to 3 ms per image when increasing the batch size to ten, corresponding to the use case where the autonomous vehicle receives inputs from multiple cameras simultaneously. We show, through aggressive filter reduction and heterogeneous quantization-aware training, and an optimized implementation of convolutional layers, that the power consumption and resource utilization can be significantly reduced while maintaining accuracy on the Cityscapes dataset.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Tomographic X-ray particle tracking velocimetry

We investigate the feasibility of in-laboratory tomographic X-ray particle tracking velocimetry (TXPTV) and consider creeping flows with nearly density matched flow tracers. Specifically, in these proof-of-concept experiments we examined a Poiseuille flow, flow through porous media and a multiphase flow with a Taylor bubble. For a full 360° computed tomography (CT) scan we show that the specially selected 60 micron tracer particles could be imaged in less than 3 seconds with a signal-to-noise ratio between the tracers and the fluid of 2.5, sufficient to achieve proper volumetric segmentation at each time step. In the pipe flow, continuous Lagrangian particle trajectories were obtained, after which all the standard techniques used for PTV or PIV (taken at visible wave lengths) could also be employed for TXPTV data. And, with TXPTV we can examine flows inaccessible with visible wave lengths due to opaque media or numerous refractive interfaces. In the case of opaque porous media we were able to observe material accumulation and pore clogging, and for flow with Taylor bubble we can trace the particles and hence obtain velocities in the liquid film between the wall and bubble, with thickness of liquid film itself also simultaneously obtained from the volumetric reconstruction after segmentation. While improvements in scan speed are anticipated due to continuing improvements in CT system components, we show that for the flows examined even the presently available CT systems could yield quantitative flow data with the primary limitation being the quality of available flow tracers.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Catalyst-Vision (PEM Catalyst Layer Image Analysis Tool) [SWR-25-100]

Catalyst-Vision (PEM Catalyst Layer Image Analysis Tool) provides an advanced Python-based tool, primarily designed for use in a Jupyter/Colab notebook, for the quantitative morphological analysis of pre-segmented shapes. While developed for analyzing PEM catalyst layers from microscopy, its methodology is suitable for characterizing any grayscale object provided on a uniform white background. The tool uses a robust computer vision pipeline based on the Euclidean Distance Transform and skeletonization to accurately measure local thickness and tortuosity, providing a comprehensive characterization of an object's geometry and internal texture. If you find this code useful, please cite our preprint as: Chan, Ai-Lin and Hayden, Steven and Harvey, Steven P. and Smeaton, Michelle and Okrucky, Caleb and Watt, John and Ulična, Soňa and Spurgeon, Steven and Jungjohann, Katherine and Alia, Shaun, Mechanism-informed breakdown: understanding degradation by controlling voltage hold patterns in PEM water electrolyzers. Preprint (2025).

Spurgeon, Steven [National Laboratory of the Rocki↗
DOE OSTI2024

Unpaired image translation to mitigate domain shift in liquid argon time projection chamber detector responses

Deep learning algorithms often are developed and trained on a training dataset and deployed on test datasets. Any systematic difference between the training and a test dataset may severely degrade the final algorithm performance on the test dataset—what is known as the domain shift problem . This issue is prevalent in many scientific domains where algorithms are trained on simulated data but applied to real-world datasets. Typically, the domain shift problem is solved through various domain adaptation (DA) methods. However, these methods are often tailored for a specific downstream task, such as classification or semantic segmentation, and may not easily generalize to different tasks. This work explores the feasibility of using an alternative way to solve the domain shift problem that is not specific to any downstream algorithm. The proposed approach relies on modern Unpaired Image-to-Image (UI2I) translation techniques, designed to find translations between different image domains in a fully unsupervised fashion. In this study, the approach is applied to a domain shift problem commonly encountered in Liquid Argon Time Projection Chamber (LArTPC) detector research when seeking a way to translate samples between two differently distributed LArTPC detector datasets deterministically. This translation allows for mapping real-world data into the simulated data domain where the downstream algorithms can be run with much less domain-shift-related performance degradation. Conversely, using the translation from the simulated data to a real-world domain can increase the realism of the simulated dataset and reduce the magnitude of any systematic uncertainties. To evaluate the quality of the translations, we use both pixel-wise metrics and a downstream task to measure the effectiveness of UI2I methods for mitigating the domain shift problem. We adapted several popular UI2I translation algorithms to work on scientific data and demonstrated the viability of these techniques for solving the domain shift problem with LArTPC detector data. To facilitate further development of DA techniques for scientific datasets, the ‘Simple Liquid-Argon Track Samples’ dataset used in this study is also published.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A versatile machine learning workflow for high-throughput analysis of supported metal catalyst particles

Accurate and efficient characterization of nanoparticles (NPs), particularly regarding particle size distribution, is essential for advancing our understanding of their structure-property relationship and facilitating their design for various applications. In this study, we introduce a novel two-stage artificial intelligence (AI)-driven workflow for NP analysis that leverages prompt engineering techniques from state-of-the-art single-stage object detection and large-scale vision transformer (ViT) architectures. This methodology is applied to transmission electron microscopy (TEM) and scanning TEM (STEM) images of heterogeneous catalysts, enabling high-resolution, high-throughput analysis of particle size distributions for supported metal catalyst NPs. The model's performance in detecting and segmenting NPs is validated across diverse heterogeneous catalyst systems, including various metals (Ru, Cu, PtCo, and Pt), supports (silica (SiO 2 ), γ-alumina (γ-Al 2 O 3 ), and carbon black), and particle diameter size distributions with mean and standard deviations ranging from 1.6 ± 0.2 nm to 9.7 ± 4.6 nm. The proposed machine learning (ML) methodology achieved an average F1 overlap score of 0.91 ± 0.01 and demonstrated the ability to disentangle overlapping NPs anchored on catalytic support materials. The segmentation accuracy is further validated using the Hausdorff distance and robust Hausdorff distance metrics, with the 90th percent of the robust Hausdorff distance showing errors within 0.4 ± 0.1 nm to 1.4 ± 0.6 nm. In conclusion, our AI-assisted NP analysis workflow demonstrates robust generalization across diverse datasets and can be readily applied to similar NP segmentation tasks without requiring costly model retraining.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Light Detecting and Ranging (LIDAR) for in-situ heliostat optical error assessment

A system and method for optical assessment of a heliostat includes obtaining a point cloud data representing an image of the heliostat; isolating the data; filtering and fitting the filtered heliostat data to a bounding box; translating the heliostat data to a plane to aid in segmentation; segmenting a plurality of facets of the heliostat fitting each of the segmented facets to a respective plane; generating normal vectors characterizing each of the plurality of facets; and calculating a canting angle associated with each respective facet of the plurality of facets. A heliostat with mirrored facets and a scanner are provided. The scanner captures point cloud data representing the heliostat, which is segmented for each facet. Normal vectors characterize the facets and a canting angle is calculated for the respective facet.

Small, Daniel E.↗
DOE OSTI2025

Genetic control of morphological transitions in a coacervating protein template

Nature routinely exploits liquid–liquid phase separation (LLPS) of proteins to control the assembly and mineralization of hybrid materials. Here, we show that fusion of the Car9 silica-binding peptide to an elastin-like polypeptide (ELP) yields temperature- and sequence-programmable soft matter templates for the synthesis of silicified architectures ranging in size from nanometers to micrometers. Specifically, we demonstrate unprecedented control over the diameter of silica nanoparticles (SiNP) in the 30–60 nm range with 4 nm precision, show that a single arginine residue (R4) in the Car9 sequence underpins the transition from micelles to proteinosomes, and find that substitutions in other basic residues modulate electrostatic repulsion and solvation to enable access to kinetically trapped species. These structures, which include interconnected micelles, small (∼200 nm) and large (>5 µm) vesicles, are readily visualized by SEM imaging following silicification. Molecular dynamics (MD) simulations and AlphaFold predictions reveal that mutations in positively charged residues alter interfacial packing, hydration, and conformational freedom of the silica-binding segments. Overall, our results establish sequence and thermal energy as synergistic levers for morphological control across length scales using solid-binding ELPs and establish mineralization as a powerful tool to visualize the structure of dynamic soft matter assemblies.

hierarchy↗
DOE OSTI2025

Crack Identification and Characterization in Deformed Nb3Sn Rutherford Cable Stacks Using Machine Learning

An investigation of instance segmentation of cracks in Nb3Sn 4-stack 40-strand Rutherford cables using machine learning is presented. Three samples were uniaxially and biaxially loaded before metallographic inspections were performed. The Mask R-CNN model was used in the Detectron2 framework with pre-trained weights but fine-tuned to detect and segment cracks. The model detected cracks with bounding box and mask average precisions (AP) of 42.8 and 27.9, respectively, and was used for instance segmentation of all cracks in the three samples. More cracks were found in the sample pre-loaded along the z-axis (i.e., along the cable length). Pre-loading along the x-axis (i.e., on the cables edges) reduced the number of cracks and changed the crack orientation distribution, away from being highly aligned with the y-axis (i.e., normal to the cables broad faces), i.e., the direction with the highest applied load. Fine-tuning of the Segment Anything Model (SAM) was also studied but performed poorly without human-provided prompts. However, the zero-shot capability of SAM showed high promises to accelerate the image annotation process for applications beyond this study.

Croteau, Jean-Francois↗
DOE OSTI2021

Time-Resolved Geometric Feature Tracking Elucidates Laser-Induced Keyhole Dynamics

In this report, during laser melting of metals, localized metal evaporation resulting in the formation of a keyhole shaped cavity can occur if processing conditions are chosen with high power density. An unstable keyhole can have deleterious effects in certain applications (e.g., laser powder bed fusion) as it increases the likelihood of producing defects such as porosity. In this work, we propose a pipeline that enables complete segmentation and extraction of various geometric features in keyholing conditions. In situ synchrotron high-speed X-ray visualization at the Advanced Photon Source provides large datasets of experimental images with a high spatio-temporal resolution across a range of laser parameters for Ti-6Al- 4 V. Computer vision image processing techniques were used to extract time-resolved quantitative geometric features (e.g., depth, width, front wall angle) throughout keyhole evolution which were subsequently analyzed to understand the relationship between the variation of local keyhole geometry and processing conditions. This analysis is the first to employ a data-driven approach to further our understanding of the keyholing process regime.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Supplementary material for manuscript: Microcomputed X-ray Tomographic Imaging and Image Processing for Microstructural Characterization of Explosives

This data contains the supplemental information that will be accessible to the public from the paper “Microcomputed X-ray Tomographic Imaging and Image Processing for Microstructural Characterization of Explosives”. The data set contains the reconstructed slices for the 3D images of three different high explosives including: HMX-HTPB, PBX 9501 and PBX 9502. The data sets are folders of reconstructed tiffs showing the microstructure (crystals, binder, voids) and a segmented data set of each. Finally, a .gif movie is also present that plays the slices sequentially. The folders contain the voxel size information. See the manuscript for more details.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Operation of a Modular 3D-Pixelated Liquid Argon Time-Projection Chamber in a Neutrino Beam

The 2x2 Demonstrator, a prototype for the Deep Underground Neutrino Experiment (DUNE) liquid argon (LAr) Near Detector, was exposed to the Neutrinos from the Main Injector (NuMI) neutrino beam at Fermi National Accelerator Laboratory (Fermilab). This detector is a prototype of a new modular design for a liquid argon time-projection chamber (LArTPC), comprising a two-by-two array of four modules, each further segmented into two optically isolated LArTPCs. The 2x2 Demonstrator features a number of pioneering technologies, including a low-profile resistive field shell to establish drift fields, native 3D ionization pixelated imaging, and a high-coverage dielectric light readout system. The 2.4-tonne active mass detector is flanked upstream and downstream by supplemental solid-scintillator tracking planes, repurposed from the MINERvA experiment, which track ionizing particles exiting the argon volume. The antineutrino beam data collected by the detector over a 4.5 day period in 2024 include over 30,000 neutrino interactions in the LAr active volume—the first neutrino interactions reported by a DUNE detector prototype. During its physics-quality run, the 2x2 Demonstrator operated at a nominal drift field of 500 V/cm and maintained good LAr purity, with a stable electron lifetime of approximately 1.25 ms. This paper describes the detector and supporting systems, summarizes the installation and commissioning, and presents the initial validation of collected NuMI beam and off-beam self-triggers. In addition, it highlights observed interactions in the detector volume, including candidate muon antineutrino events.

47 OTHER INSTRUMENTATION↗