Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

DLSIA: Deep Learning for Scientific Image Analysis

DLSIA (Deep Learning for Scientific Image Analysis) is a Python-based machine learning library that empowers scientists and researchers across diverse scientific domains with a range of customizable convolutional neural network (CNN) architectures for a wide variety of tasks in image analysis to be used in downstream data processing. DLSIA features easy-to-use architectures, such as autoencoders, tunable U-Nets and parameter-lean mixed-scale dense networks (MSDNets). Additionally, this article introduces sparse mixed-scale networks (SMSNets), generated using random graphs, sparse connections and dilated convolutions connecting different length scales. For verification, several DLSIA-instantiated networks and training scripts are employed in multiple applications, including inpainting for X-ray scattering data using U-Nets and MSDNets, segmenting 3D fibers in X-ray tomographic reconstructions of concrete using an ensemble of SMSNets, and leveraging autoencoder latent spaces for data compression and clustering. As experimental data continue to grow in scale and complexity, DLSIA provides accessible CNN construction and abstracts CNN complexities, allowing scientists to tailor their machine learning approaches, accelerate discoveries, foster interdisciplinary collaboration and advance research in scientific image analysis.

97 MATHEMATICS AND COMPUTING↗

FIRM image analysis: A machine learning workflow for quantifying extracellular matrix components from electron microscopy images

The extracellular matrix (ECM) is a complex network of biomolecules that plays an integral role in the structure, processes, and signaling mechanisms of cells and tissues. Identifying and quantifying changes in these matrix components provides insight into the mechanisms behind specific tissue remodeling processes; however, quantifying these changes is challenging due to difficult imaging conditions, complexity of the ECM, and the subtlety of these changes. Current imaging techniques allow us to visualize these critical remodeling events and developments in image analysis have employed a combination of analysis software and machine learning techniques to improve the efficiency and accuracy with which features are measured. Although image analysis has seen much improvement in recent years, there has been no technique developed to address ambiguity in feature edges in electron microscopy images. Presented here is a new machine learning-based workflow for the analysis of microscopy images named FIRM (Feature Identification from Raw Microscopy) that uses a random forest classifier to identify ECM features of interest and generate binary segmentation masks for quantification with ImageJ-FIJI. FIRM performed with an F1 score of 0.794 and greater than 80% accuracy for number and size of features detected. FIRM had similar deviation from the ground truth in the number of identified fibrils, fibril size, and size distributions when compared to human analyses. The results suggest that FIRM performs as well as manual analysis and requires a fraction of the time. This analysis technique is more efficient, eliminates user bias, and can be easily optimized to identify a variety of features, making it useful for any discipline requiring image analysis.

Science & Technology - Other Topics↗

Morphology and particle size (MaPS) exercise: testing the applications of image analysis and morphology descriptions for nuclear forensics

Image analysis techniques have been applied and shown to be a valuable tool in nuclear forensics analysis. The interlaboratory exercise reported here has tested quantitative and qualitative approaches for characterizing nuclear materials. Particle size, surface features and morphology descriptions were compared by four laboratories on a common image set generated by Scanning Electron Microscopy and Digital Light Microscopy. Quantitative analysis of the image sets through the Morphological Analysis for MAterials software highlighted the strength of image analysis, but also that the application of the software alone can introduce significant bias in the analysis. Qualitative morphology descriptions following the process outlined by Tamasi et al. (J Radioanal Nuclear Chem 307:1611–1619, 2015) were compared with a discussion on the robustness and reproducibility of the results. Finally, future work should continue to focus on proficiency and standardization of image analysis through continued exercises within the extended nuclear forensics community.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantitative investigation of sooting dynamics in droplet combustion using an automated image analysis algorithm

This paper reports an image analysis approach using a newly-developed open-source program to extract quantitative measurements of soot volume fraction (SVF) from digital video images of burning n-heptane droplets. The automated program developed in this work can analyze images of fixed and untethered droplets to quantify sooting dynamics. The images analyzed in the program were taken from experiments carried out in the Multi-user Droplet Combustion Apparatus (MDCA) onboard the International Space Station (ISS). In these experiments, video imaging of burning droplets was obtained using backlighting by a laser diode with a wavelength of 653 nm. Here, the light was collimated before it passed through the droplet and soot-containing region, after which the light was then attenuated and projected onto the camera’s sensors. This technique facilitates the measurements of SVF based on the principles of the full field light extinction method (FFLEM). The measurements provide quantitative data that reveal the sooting dynamics of liquid fuels during droplet combustion processes. The analyses of a soot-attenuating image (ISS n-heptane, untethered droplet) at an instant during the burning show that the SVF distribution has a peak at the soot shell location. It then decreases due to soot oxidation when the location is further away from the burning droplet. Regarding temporal effects on the maximum SVF (SVF max ), results show that SVF max first increases after the burning is initiated until a peak value is reached, after which SVF max decreases. The SVF max values identified in this study for n-heptane are quantitatively consistent with previously reported values for fiber-supported droplets and are reached relatively early in the burning history. n-Heptane images are also analyzed to show the effects of initial droplet sizes on the maximum soot volume fraction. Results show that SVF max decreases with increasing initial droplet size, which is consistent with visual observations of less soot formed and dimmer flame brightness as Do increases.

42 ENGINEERING↗

Robust measurement of microbial reduction of graphene oxide nanoparticles using image analysis

ABSTRACT Shewanella oneidensis ( S. oneidensis ) has the capacity to reduce electron acceptors within a medium and is thus used frequently in microbial fuel generation, pollutant breakdown, and nanoparticle fabrication. Microbial fuel setups, however, often require costly or labor-intensive components, thus making optimization of their performance onerous. For rapid optimization of setup conditions, a model reduction assay can be employed to allow simultaneous, large-scale experiments at lower cost and effort. Since S. oneidensis uses different extracellular electron transfer pathways depending on the electron acceptor, it is essential to use a reduction assay that mirrors the pathways employed in the microbial fuel system. For microbial fuel setups that use nanoparticles to stimulate electron transfer, reduction of graphene oxide provides a more accurate model than other commonly used assays as it is a bulk material that forms flocculates in solutions with a large ionic component. However, graphene oxide flocculates can interfere with traditional absorbance-based measurement techniques. This study introduces a novel image analysis method for quantifying graphene oxide reduction, showing improved performance and statistical accuracy over traditional methods. A comparative analysis shows that the image analysis method produces smaller errors between replicates and reveals more statistically significant differences between samples than traditional plate reader measurements under conditions causing graphene oxide flocculation. Image analysis can also detect reduction activity at earlier time points due to its use of larger solution volumes, enhancing color detection. These improvements in accuracy make image analysis a promising method for optimizing microbial fuel cells that use nanoparticles or bulk substrates. IMPORTANCE Shewanella oneidensis ( S. oneidensis ) is widely used in reduction processes such as microbial fuel generation due to its capacity to reduce electron acceptors. Often, these setups are labor-intensive to operate and require days to produce results, so use of a model assay would reduce the time and expenses needed for optimization. Our research developed a novel digital analysis method for analysis of graphene oxide flocculates that may be utilized as a model assay for reduction platforms featuring nanoparticles. Use of this model reduction assay will enable rapid optimization and drive improvements in the microbial fuel generation sector.

Bennett, Danielle T. (ORCID:0009000188748827)↗

Quantitative multi-image analysis in metals research

Abstract Quantitative multi-image analysis (QMA) is the systematic extraction of new information and insight through the simultaneous analysis of multiple, related images. We present examples illustrating the potential for QMA to advance materials research in multi-image characterization, automatic feature identification, and discovery of novel processing-structure–property relationships. We conclude by discussing opportunities and challenges for continued advancement of QMA, including instrumentation development, uncertainty quantification, and automatic parsing of literature data. Graphical abstract

36 MATERIALS SCIENCE↗

Rapid spatial analysis of surrogate TRISO fuel particles using laser-induced breakdown spectroscopy image analysis

Laser-induced breakdown spectroscopy (LIBS) mapping enables rapid elemental and spatial analysis of solid samples. In this work, surrogate TRi-structural ISOtropic (TRISO) particles with various layers consisting of Zr, W, C, and Si were used to demonstrate the use of a new thickness measurement tool developed to analyze elemental images generated from LIBS maps. Zr particles with varying outer-layer thicknesses ranging from 16 to 32 μm were measured with scanning electron microscopy with energy dispersive spectroscopy (SEM-EDS) and LIBS with both a complementary metal-oxide-semiconductor (CMOS) detector and an intensified charged coupled device (ICCD) detector. LIBS maps of particles were completed using CMOS and ICCD spectrometers with effective spatial resolutions of 4 and 2 μm, respectively. The novel thickness measurement tool identified layer regions within a LIBS map and then identified the locations of the boundaries between these layers. The tool then generated up to 1000 random profiles stemming radially from the center region, which were used to measure the layer thickness/radius. This image analysis tool demonstrated LIBS's ability to provide values comparable with SEM-EDS (3.7% relative difference) along with a 95% reduction in measurement time. Furthermore, the precision of these measurements was on par with the SEM-EDS measurements at <15% relative standard deviation. Following the analysis of the Zr particles, W particles with increased complexity (e.g., five versus three layers) were analyzed using both the CMOS and ICCD spectrometers simultaneously. The spatial dimensions were extracted with an average relative difference of 2.7% and an average relative standard deviation of 9%.

Andrews, Hunter B. [Oak Ridge National Laboratory ↗

Variability and associated uncertainty in image analysis for soiling characterization in solar energy systems

The accumulation of soiling on photovoltaic modules and on the mirrors of concentrating solar power systems causes non-negligible energy losses with economic consequences. These challenges can be mitigated, or even prevented, through appropriate actions if the magnitude of soiling is known. Particle counting analysis is a common procedure to characterize soiling, as it can be easily performed on micrographs of glass coupons or solar devices that have been exposed to the environment. Particle counting does not, however, yield invariant results across institutions. The particle size distribution analysis is affected by the operator of the image analysis software and the methodology utilized. The results of a round-robin study are presented in this work to explore and elucidate the uncertainty related to particle counting and its effect on the characterization of the soiling of glass surfaces used in solar energy conversion systems. An international group of soiling experts analyzed the same 8 micrographs using the same open-source ImageJ software package. The variation in the particle analyses results were investigated to identify specimen characteristics with the lowest coefficient of variation (CV) and the least uncertainty among the various operators. The mean particle diameter showed the lowest CV among the investigated characteristics, whereas the number of particles exhibited the largest CV. Additional parameters, such as the fractional area coverage by particles and parameters related to the distribution's shape yielded intermediate CV values. These results can provide insights on the magnitude inter-lab variability and uncertainty for optical and microscope-based soiling monitoring and characterization.

14 SOLAR ENERGY↗

MedNAS: Multiscale Training-Free Neural Architecture Search for Medical Image Analysis

Deep neural networks have demonstrated impressive results in medical image analysis, but designing suitable architectures for each specific task is expertise dependent and time consuming. Neural architecture search (NAS) offers an effective means of discovering architectures. It has been highly successful in numerous applications, particularly in natural image classification. Yet, medical images possess unique characteristics, such as small regions and a wide variety of lesion sizes, that differentiate them from natural images. Furthermore, most current NAS methods struggle with high computational costs, especially when dealing with high-resolution image datasets. In this article, we present a novel evolutionary NAS method called multiscale training-free neural architecture search (MSTF-NAS) to address these challenges. Specifically, to accommodate the broad range of lesion region sizes in disease diagnosis, we develop a new reduction cell search space that enables the search algorithm to explicitly identify the optimal scale combination for multiscale feature extraction. Further, to overcome the issue of high computational costs, we utilize training-free indicators as performance measures for candidate architectures, which allows us to search for the optimal architecture more efficiently. More specifically, by considering the capability and simplicity of various networks, we formulate a multiobjective optimization problem that involves two training-free indicators and model complexity for candidate architectures. Extensive experiments on a large medical image benchmark and a publicly available breast cancer detection dataset are conducted. The empirical results demonstrate that our MSTF-NAS outperforms both human-designed architectures and current state-of-the-art NAS algorithms on both datasets, indicating the effectiveness of our proposed method.

60 APPLIED LIFE SCIENCES↗

Testing the LSST Difference Image Analysis Pipeline Using Synthetic Source Injection Analysis

Abstract We evaluate the performance of the Legacy Survey of Space and Time Science Pipelines Difference Image Analysis (DIA) on simulated images. By adding synthetic sources to galaxies on images, we trace the recovery of injected synthetic sources to evaluate the pipeline on images from the Dark Energy Science Collaboration Data Challenge 2. The pipeline performs well, with efficiency and flux accuracy consistent with the signal-to-noise ratio of the input images. We explore different spatial degrees of freedom for the Alard–Lupton polynomial-Gaussian image subtraction kernel and analyze for trade-offs in efficiency versus artifact rate. Increasing the kernel spatial degrees of freedom reduces the artifact rate without loss of efficiency. The flux measurements with different kernel spatial degrees of freedom are consistent. We also here provide a set of DIA flags that substantially filter out artifacts from the DIA source table. We explore the morphology and possible origins of the observed remaining subtraction artifacts and suggest that given the complexity of these artifact origins, a convolution kernel with a set of flexible bases with spatial variation may be needed to yield further improvements.

Liu, S. (ORCID:0000000244612143)↗

Catalyst-Vision (PEM Catalyst Layer Image Analysis Tool) [SWR-25-100]

Catalyst-Vision (PEM Catalyst Layer Image Analysis Tool) provides an advanced Python-based tool, primarily designed for use in a Jupyter/Colab notebook, for the quantitative morphological analysis of pre-segmented shapes. While developed for analyzing PEM catalyst layers from microscopy, its methodology is suitable for characterizing any grayscale object provided on a uniform white background. The tool uses a robust computer vision pipeline based on the Euclidean Distance Transform and skeletonization to accurately measure local thickness and tortuosity, providing a comprehensive characterization of an object's geometry and internal texture. If you find this code useful, please cite our preprint as: Chan, Ai-Lin and Hayden, Steven and Harvey, Steven P. and Smeaton, Michelle and Okrucky, Caleb and Watt, John and Ulična, Soňa and Spurgeon, Steven and Jungjohann, Katherine and Alia, Shaun, Mechanism-informed breakdown: understanding degradation by controlling voltage hold patterns in PEM water electrolyzers. Preprint (2025).

Spurgeon, Steven [National Laboratory of the Rocki↗

Data Mining – Image Analysis of Radiography for Zr Redistribution

The research effort described in this report represents a first attempt to investigate the radial redistribution of Zr in ternary fuel alloys U-xPu-10Zr (x = 0, 8, 19) irradiated in the in-reactor fuel experiments during the operation of the U.S. Department of Energy’s (DOE’s) Experimental Breeder Reactor II (EBR-II) at Idaho National Laboratory (INL) using methods of image processing on post-irradiation neutron radiographs. Approximately 130,000 metal fuel pins were irradiated in EBR-II during its 30 years of operation to develop and characterize existing and prospective fuels. For many of the metal fuel irradiation experiments, neutron radiography imaging was performed historically now allowing application of modern image analysis techniques to characterize fuel behavior, such as fuel swelling, fluff formation, and now, fuel alloy constituent redistribution. The redistribution of fuel components depends on the temperature field, radially, within the fuel. Specifically, Zr is expected to redistribute radially towards the center of the pin, as well as towards the outer zones. Currently, direct imaging of a pin cross-section through optical methods or scanning electron microscopy (SEM) is used to study the constituents’ redistribution, which is very time-consuming and can only be applied to a limited number of pins. An automated image processing technique allowing for the investigation of fuel radial redistribution zones would significantly accelerate data analysis. In general, if the fuel temperature is hot enough, three redistribution zones are expected, corresponding to the main fuel components (e.g., U, Pu, Zr). While more assessment will be performed in fiscal year (FY)-2023, it seems possible to differentiate the pins according to their fuel composition using image analysis techniques on neutron radiographs of metallic fuel pins based on the analysis to date.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Integrating Flow Imaging Analysis and Single-Particle ICP-TOFMS for Comprehensive Micro- and Nanoplastic Characterization

Flow imaging analysis (FIA), provides composition-agnostic morphological characterization. These measurements of particle size and shape are valuable to mass-based analysis, such as single particle inductively coupled plasma time-of-flight mass spectrometry (sp-ICP-TOFMS), which provides quantitative data on elements within particles. Using these two methods together enables informed use of geometric assumptions required by sp-ICP-TOFMS, as particle mass is typically converted to a particle diameter using assumed-spherical geometry. To validate this concept, parallel measurements to determine particle diameters were performed by FIA and sp-ICP-TOFMS on four particle suspensions: 300 nm polystyrene Eu-doped nanoparticles, 1 μm Fe-rich beads, 3 μm four element calibration polystyrene beads and 5 μm polystyrene beads. The Fe-particles obtained the highest percent difference from the manufacturer’s nominal diameter, as the mean diameter obtained by FIA was overestimated by 21% and sp-ICP-TOFMS underestimated the mean diameter by 20.7%. Two types of particles were selected to test the effect of varying the particle number concentrations (PNC) on sizing accuracy, and both methods accurately sized each particle population at the PNC expected. Single particle analysis of carbon has continued to be a popular research topic, with direct applications to environmental pollutants in terms of nano- and micro- plastics. Real-world plastic particles were studied, and FIA’s measured circularity values demonstrated that the particles deviated from spherical geometries, therefore sp-ICP-TOFMS data should be interpreted as mass-based rather than size-based. Combining these techniques enables improved interpretation of particle populations and evaluation of particle sizes.

Szakas, Sarah [ORNL] (ORCID:0000000241332197)↗

Cross-correlation image analysis for real-time single particle tracking

Accurately measuring the translations of objects between images is essential in many fields, including biology, medicine, chemistry, and physics. One important application is tracking one or more particles by measuring their apparent displacements in a series of images. Popular methods, such as the center of mass, often require idealized scenarios to reach the shot noise limit of particle tracking and, therefore, are not generally applicable to multiple image types. More general methods, such as maximum likelihood estimation, reliably approach the shot noise limit, but are too computationally intense for use in real-time applications. These limitations are significant, as real-time, shot-noise-limited particle tracking is of paramount importance for feedback control systems. To fill this gap, we introduce a new cross-correlation-based algorithm that approaches shot-noise-limited displacement detection and a graphics processing unit-based implementation for real-time image analysis of a single particle.

Instruments & Instrumentation↗

High-performance data management for whole slide image analysis in digital pathology

When dealing with giga-pixel digital pathology in whole-slide imaging, a notable proportion of data records holds relevance during each analysis operation. For instance, when deploying an image analysis algorithm on whole-slide images (WSI), the computational bottleneck often lies in the input-output (I/O) system. This is particularly notable as patch-level processing introduces a considerable I/O load onto the computer system. However, this data management process could be further paralleled, given the typical independence of patch-level image processes across different patches. This paper details our endeavors in tackling this data access challenge by implementing the Adaptable IO System version 2 (ADIOS2). Our focus has been constructing and releasing a digital pathology-centric pipeline using ADIOS2, which facilitates streamlined data management across WSIs. Additionally, we’ve developed strategies aimed at curtailing data retrieval times. The performance evaluation encompasses two key scenarios: (1) a pure CPU-based image analysis scenario (“CPU scenario”), and (2) a GPU-based deep learning framework scenario (“GPU scenario”). Our findings reveal noteworthy outcomes. Under the CPU scenario, ADIOS2 showcases an impressive two-fold speed-up compared to the brute-force approach. In the GPU scenario, its performance stands on par with the cutting-edge GPU I/O acceleration framework, NVIDIA Magnum IO GPU Direct Storage (GDS). From what we know, this appears to be among the initial instances, if any, of utilizing ADIOS2 within the field of digital pathology. The source code has been made publicly available at https://github.com/hrlblab/adios.

Wang, Xiao↗

Coupling of multiscale imaging analysis and computational modeling for understanding thick cathode degradation mechanisms

Here, using a thick NMC811 (LiNi 0.8 Mn 0.1 Co 0.1 O 2 ) electrode as an example, we present a macro- to nanoscale 2D and 3D imaging analysis approach coupled with 4D (space + time) computational modeling to probe its degradation mechanism in a lithium-ion battery cell. Particle cracking increases and contact loss between particles and carbon-binder domain are observed to correlate with the cell degradation. This study unravels that the reaction heterogeneity within the thick cathode caused by the unbalanced electron conduction is the main cause of the battery degradation over cycling. The increased heterogeneity in the system will entail more cathode regions where the degree of active material utilization is uneven, leading to higher probabilities of particle cracking. These findings shed light on the crucial role of the electronic and ionic transportation networks in the performance deterioration of the thick cathode. They also provide guidance for cathode architecture optimization and performance improvement.

25 ENERGY STORAGE↗

Image analysis reveals differences in tumor multinucleations in Black and White patients with human papillomavirus‐associated oropharyngeal squamous cell carcinoma

Background Understanding biological differences between different racial groups of human papillomavirus (HPV)‐associated oropharyngeal squamous cell carcinoma (OPSCC) patients, who have differences in terms of incidence, survival, and tumor morphology, can facilitate accurate prognostic biomarkers, which can help develop personalized treatment strategies. Methods This study evaluated whether there were morphologic differences between HPV‐associated tumors from Black and White patients in terms of multinucleation index (MuNI), an image analysis‐derived metric that measures density of multinucleated tumor cells within epithelial regions on hematoxylin–eosin images and previously has been prognostic in HPV‐associated OPSCC patients. In this study, the authors specifically evaluated whether the same MuNI cutoff that was prognostic of overall survival (OS) and disease‐free survival in their previous study, T TR , is valid for Black and White patients, separately. We also evaluated population‐specific cutoffs, T B for Blacks and T W for Whites, for risk stratification. Results MuNI was statistically significantly different between Black (mean, 3.88e–4; median, 3.67e–04) and White patients (mean, 3.36e–04; median, 2.99e–04), with p = .0078. Using T TR , MuNI was prognostic of OS in the entire population with hazard ratio (HR) of 1.71 ( p = .002; 95% confidence interval [CI], 1.21–2.43) and in White patients with HR of 1.72 ( p = .005; 95% CI, 1.18–2.51). Population‐specific cutoff, T W , yielded improved HR of 1.77 ( p = .003; 95% CI, 1.21–2.58) for White patients, whereas T B did not improve risk‐stratification in Black patients with HR of 0.6 ( p = .3; HR, 0.6; 95% CI, 0.2–1.80). Conclusions Histological difference between White and Black patient tumors in terms of multinucleated tumor cells suggests the need for considering population‐specific prognostic biomarkers for personalized risk stratification strategies for HPV‐associated OPSCC patients.

Koyuncu, Can F.↗

Physics-based reward driven image analysis in microscopy

The rise of electron microscopy has expanded our ability to acquire nanometer and atomically resolved images of complex materials. The resulting vast datasets are typically analyzed by human operators, an intrinsically challenging process due to the multiple possible analysis steps and the corresponding need to build and optimize complex analysis workflows. We present a methodology based on the concept of a Reward Function coupled with Bayesian Optimization, to optimize image analysis workflows dynamically. The Reward Function is engineered to closely align with the experimental objectives and broader context and is quantifiable upon completion of the analysis. Here, cross-section, high-angle annular dark field (HAADF) images of ion-irradiated (Y, Dy)Ba 2 Cu 3 O 7–δ thin-films were used as a model system. The reward functions were formed based on the expected materials density and atomic spacings and used to drive multi-objective optimization of the classical Laplacian-of-Gaussian (LoG) method. These results can be benchmarked against the DCNN segmentation. This optimized LoG* compares favorably against DCNN in the presence of the additional noise. We further extend the reward function approach towards the identification of partially-disordered regions, creating a physics-driven reward function and action space of high-dimensional clustering. We pose that with correct definition, the reward function approach allows real-time optimization of complex analysis workflows at much higher speeds and lower computational costs than classical DCNN-based inference, ensuring the attainment of results that are both precise and aligned with the human-defined objectives.

47 OTHER INSTRUMENTATION↗