Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “microscopy automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Ultraviolet digital holographic microscopy (DHM) of micron-scale particles from shocked Sn ejecta

A cloud of very fast, O (km/s), and very fine, O (µm), particles may be ejected when a strong shock impacts and possibly melts the free surface of a solid metal. To quantify these dynamics, this work develops an ultraviolet, long-working distance, two-pulse Digital Holographic Microscopy (DHM) configuration and is the first to replace film recording with digital sensors for this challenging application. A proposed multi-iteration DHM processing algorithm is demonstrated for automated measures of the sizes, velocities, and three-dimensional positions of non-spherical particles. Ejecta as small as 2 µm diameter are successfully tracked, while uncertainty simulations indicate that particle size distributions are accurately quantified for diameters ≥4 µm. These techniques are demonstrated on three explosively driven experiments. Measured ejecta size and velocity statistics are shown to be consistent with prior film-based recording, while also revealing spatial variations in velocities and 3D positions that have yet to be widely investigated. Having eliminated time-consuming analog film processing, the methodologies proposed here are expected to significantly accelerate future experimental investigation of ejecta physics.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Toward Decoding the Relationship between Domain Structure and Functionality in Ferroelectrics via Hidden Latent Variables

Polarization switching mechanisms in ferroelectric materials are fundamentally linked to local domain structure and the presence of the structural defects, which both can act as nucleation and pinning centers and create local electrostatic and mechanical depolarization fields affecting wall dynamics. However, the general correlative mechanisms between domain structure and polarization dynamics are only weakly explored, precluding insight into the associated physical mechanisms. In this work, the correlation between local domain structures and switching behavior in ferroelectric materials is explored using convolutional encoder–decoder networks, enabling image to spectral (im2spec) and spectral to image (spec2im) translations via encoding of latent variables. The latter reflect the assumption that the relationship between domain structure and polarization switching is parsimonious, i.e., is based upon a small number of local mechanisms. The analysis of latent variables distributions and their real-space representations provides insight into the predictability of the local switching behavior and hence associated physical mechanisms. We further pose that the regions where these correlative relationships are violated, i.e., predictability of the polarization dynamics from domain structure is reduced, represent the obvious target for detailed studies, e.g., in the context of automated experiments. This approach provides a workflow to establish the presence of correlation between local spectral responses and local structure and can be universally applied to spectral imaging techniques such as piezoresponse force microscopy (PFM), scanning tunneling microscopy (STM) and spectroscopy, and electron energy loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM).

36 MATERIALS SCIENCE↗
DOE OSTI2022

Seeking regularity from irregularity: unveiling the synthesis–nanomorphology relationships of heterogeneous nanomaterials using unsupervised machine learning

Nanoscale morphology of functional materials determines their chemical and physical properties. However, despite increasing use of transmission electron microscopy (TEM) to directly image nanomorphology, it remains challenging to quantify the information embedded in TEM data sets, and to use nanomorphology to link synthesis and processing conditions to properties. We develop an automated, descriptor-free analysis workflow for TEM data that utilizes convolutional neural networks and unsupervised learning to quantify and classify nanomorphology, and thereby reveal synthesis–nanomorphology relationships in three different systems. While TEM records nanomorphology readily in two-dimensional (2D) images or three-dimensional (3D) tomograms, we advance the analysis of these images by identifying and applying a universal shape fingerprint function to characterize nanomorphology. After dimensionality reduction through principal component analysis, this function then serves as the input for morphology grouping through unsupervised learning. We demonstrate the wide applicability of our workflow to both 2D and 3D TEM data sets, and to both inorganic and organic nanomaterials, including tetrahedral gold nanoparticles mixed with irregularly shaped impurities, hybrid polymer-patched gold nanoprisms, and polyamide membranes with irregular and heterogeneous 3D crumple structures. In each of these systems, unsupervised nanomorphology grouping identifies both the diversity and the similarity of the nanomaterial across different synthesis conditions, revealing how synthetic parameters guide nanomorphology development. Our work opens possibilities for enhancing synthesis of nanomaterials through artificial intelligence and for understanding and controlling complex nanomorphology, both for 2D systems and in the far less explored case of 3D structures, such as those with embedded voids or hidden interfaces.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

2025 Intern Poster

The Hot Fuel Examination Facility (HFEF) at the Materials and Fuels Complex (MFC) houses the largest U.S. inert atmosphere hot cell for nuclear material research. Key features include the precision gamma scanning (PGS), Fuel Accident Condition Simulator (FACS), Neutron Radiography Reactor (NRAD), and the focus of this project, the Metallograph Loading Cell (MET Cell). The MET Cell performs tests on spent nuclear fuel, such as microhardness testing, microscopy, and neutron radiography. However, the MET Cell’s existing pressure and lighting control systems are outdated and inefficient, with inadequate documentation for system changes over time. This project aims to design a new automated control system for the MET Cell, ensuring longevity (minimum ten years), ease of troubleshooting/repair, and integration into the building monitoring system. The design process addressed challenges such as space restrictions, varied voltages within enclosures, sourcing new components, and security limitations. Compliance with NFPA 70, UL508A, MFC Physical Security, and INL Engineering standards was essential. The project involves repurposing an existing PLC to manage lighting and pressure control using digital and analog signals, simplifying wiring, and ensuring thorough documentation for future reference.

42 - ENGINEERING↗
DOE OSTI2020

Imaging mechanism for hyperspectral scanning probe microscopy via Gaussian process modelling

We investigate the ability to reconstruct and derive spatial structure from sparsely sampled 3D piezoresponse force microcopy data, captured using the band-excitation (BE) technique, via Gaussian Process (GP) methods. Even for weakly informative priors, GP methods allow unambiguous determination of the characteristic length scales of the imaging process both in spatial and frequency domains. We further show that BE data set tends to be oversampled in the spatial domains, with ~30% of original data set sufficient for high-quality reconstruction, potentially enabling faster BE imaging. At the same time, reliable reconstruction along the frequency domain requires the resonance peak to be within the measured band. This behavior suggests the optimal strategy for the BE imaging on unknown samples. Finally, we discuss how GP can be used for automated experimentation in SPM, by combining GP regression with non-rectangular scans.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

UEMtomaton: A Source-Available Platform to Aid in Start-up of Ultrafast Electron Microscopy Labs

The steady rise in the number of ultrafast electron microscopy (UEM) labs, in addition to the opacity and lack of detailed descriptions of current approaches that would enable point-by-point construction, has created an opportunity for sharing common methods and instrumentation for (for example) automating data acquisition to assist in efficient lab start-up and to learn about common and robust protocols. In the spirit of open sharing of methods, we provide here a description of an entry-level method and user interface (UI) for automating UEM experiments, and we provide access to the source code and scripts (source-available) for ease of implementation or as a starting reference point for those entering or seeking to enter the field (https://github.com/CEMSFlannigan/UEMtomaton/releases/tag/v1.0). Core instrumentation and physical connections in the UEM lab at Minnesota are described. Interface communication schemes consisting of duo server-client pairs between critical components – the optical delay stage and the UEM digital camera – are presented, with emphasis placed on describing the logic and communications sequence designed to conduct automated series acquisitions. An application designed and programmed with C++/CLI as Windows Forms in Microsoft Visual Studio – dubbed UEMtomaton – is also presented. Key to the UI layout is centralization of the automation tasks and establishment of communication within the software rather than by interfacing with each individual workstation. It is our hope that this note provides useful insight for current and future UEM researchers, particularly with respect to generalizability and portability of the approach to emerging labs. Here, we note that while this basic, entry-level approach is certainly not the most sophisticated or comprehensive of those currently in use, we feel there is nevertheless value in clearly communicating a proven straightforward method to hopefully lower the barrier to entry into the field.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Integrating AlphaFold and deep learning for atomistic interpretation of cryo-EM maps

Abstract Interpretation of cryo-electron microscopy (cryo-EM) maps requires building and fitting 3D atomic models of biological molecules. AlphaFold-predicted models generate initial 3D coordinates; however, model inaccuracy and conformational heterogeneity often necessitate labor-intensive manual model building and fitting into cryo-EM maps. In this work, we designed a protein model-building workflow, which combines a deep-learning cryo-EM map feature enhancement tool, CryoFEM (Cryo-EM Feature Enhancement Model) and AlphaFold. A benchmark test using 36 cryo-EM maps shows that CryoFEM achieves state-of-the-art performance in optimizing the Fourier Shell Correlations between the maps and the ground truth models. Furthermore, in a subset of 17 datasets where the initial AlphaFold predictions are less accurate, the workflow significantly improves their model accuracy. Our work demonstrates that the integration of modern deep learning image enhancement and AlphaFold may lead to automated model building and fitting for the atomistic interpretation of cryo-EM maps.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Uncertainty-aware particle segmentation for electron microscopy at varied length scales

Electron microscopy is indispensable for examining the morphology and composition of solid materials at the sub-micron scale. To study the powder samples that are widely used in materials development, scanning electron microscopes (SEMs) are increasingly used at the laboratory scale to generate large datasets with hundreds of images. Parsing these images to identify distinct particles and determine their morphology requires careful analysis, and automating this process remains challenging. In this work, we enhance the Mask R-CNN architecture to develop a method for automated segmentation of particles in SEM images. We address several challenges inherent to measurements, such as image blur and particle agglomeration. Moreover, our method accounts for prediction uncertainty when such issues prevent accurate segmentation of a particle. Recognizing that disparate length scales are often present in large datasets, we use this framework to create two models that are separately trained to handle images obtained at low or high magnification. By testing these models on a variety of inorganic samples, our approach to particle segmentation surpasses an established automated segmentation method and yields comparable results to the predictions of three domain experts, revealing comparable accuracy while requiring a fraction of the time. These findings highlight the potential of deep learning in advancing autonomous workflows for materials characterization.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Automated identification of deformation twin systems in Mg WE43 from SEM DIC

In this study, the application of machine learning and computer vision approaches to microscale deformation data for the automated identification of deformation twinning systems, and their associated twin area, is introduced. Deformation data was obtained during in-situ SEM compression testing of a WE43 Mg alloy using digital image correlation (DIC) modified for use with electron microscopy. A 5.7 mm × 3.4 mm area of interest was analyzed, generating ~100 million data points of deformation. Experimental twin trace directions were determined by applying k-means clustering, morphological thinning, and Hough transforms to the deformation data. The identification of deformation twinning was achieved by consideration of the twin trace direction, its strain value, and its evolution. The deformation map was divided into areas corresponding to individual active twin systems, enabling the analysis of microstructure dependence of deformation behavior and twinning activity. The performance of the proposed twinning identification approach was evaluated by accuracy, precision, and sensitivity metrics. The effect of the tuning parameters used in the algorithm on the performance is also discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Three-dimensional high-content imaging of unstained soft tissue with subcellular resolution using a laboratory-based X-ray microscope

With increasing interest in studying biological systems across spatial scales—from centimeters down to nanometers—histology continues to be the gold standard for tissue imaging at cellular resolution, providing an essential bridge between macroscopic and nanoscopic analysis. However, its inherently destructive and two-dimensional nature limits its ability to capture the full three-dimensional complexity of tissue architecture. Here, we show that phase-contrast X-ray microscopy can enable three-dimensional virtual histology with subcellular resolution. This technique provides direct quantification of electron density without restrictive assumptions, allowing for direct characterization of cellular nuclei in a standard laboratory setting. By combining high spatial resolution and soft tissue contrast, with automated segmentation of cell nuclei, we demonstrated virtual Hematoxylin and Eosin (H&E) staining using machine learning-based style transfer, yielding volumetric datasets compatible with existing histopathological analysis tools. Furthermore, by integrating electron density and the sensitivity to nanometric features of the dark field contrast channel, we achieve stain-free, high-content imaging capable of distinguishing nuclei and extracellular matrix.

3D virtual histology↗
DOE OSTI2023

Multi-Scale Characterization of Porosity and Cracks in Silicon Carbide Cladding after Transient Reactor Test Facility Irradiation

Silicon carbide (SiC) ceramic matrix composite (CMC) cladding is currently being pursued as one of the leading candidates for accident-tolerant fuel (ATF) cladding for light water reactor applications. The morphology of fabrication defects, including the size and shape of voids, is one of the key challenges that impacts cladding performance and guarantees reactor safety. Therefore, quantification of defects’ size, location, distribution, and leak paths is critical to determining SiC CMC in-core performance. This research aims to provide quantitative insight into the defect’s distribution under multi-scale characterization at different length scales before and after different Transient Reactor Test Facility (TREAT) irradiation tests. A non-destructive multi-scale evaluation of irradiated SiC will help to assess critical microstructural defects from production and/or experimental testing to better understand and predict overall cladding performance. X-ray computed tomography (XCT), a non-destructive, data-rich characterization technique, is combined with lower length scale electronic microscopic characterization, which provides microscale morphology and structural characterization. This paper discusses a fully automatic workflow to detect and analyze SiC-SiC defects using image processing techniques on 3D X-ray images. Following the XCT data analysis, advanced characterizations from focused ion beam (FIB) and transmission electron microscopy (TEM) were conducted to verify the findings from the XCT data, especially quantitative results from local nano-scale TEM 3D tomography data, which were utilized to complement the 3D XCT results. In this work, three SiC samples (two irradiated and one unirradiated) provided by General Atomics are investigated. The irradiated samples were irradiated in a way that was expected to induce cracking, and indeed, the automated workflow developed in this work was able to successfully identify and characterize the defects formation in the irradiated samples while detecting no observed cracking in the unirradiated sample. These results demonstrate the value of automated XCT tools to better understand the damage and damage propagation in SiC-SiC structures for nuclear applications.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

Synthetic data-driven deep learning for label-free autonomous atomic force microscopy

Atomic force microscopy (AFM) is a widely used tool for nanoscale characterization across materials science, energy research, and biology. However, its adoption in high-throughput materials discovery and statistically driven studies remains limited by a strong dependence on expert operator input and by the scarcity of annotated experimental AFM datasets needed to enable data-driven automation. Here, we introduce SimuScan, a synthetic-data–driven framework that enables reliable AFM feature identification, segmentation, and targeted imaging without requiring large manually labeled experimental datasets. SimuScan generates tunable, high-fidelity synthetic AFM images of defined morphologies while incorporating realistic experimental artifacts, including tip–sample convolution, noise, flattening distortions, and surface debris. These datasets are shown to support scalable, label-free training of modern deep learning models for AFM analysis. When integrated into data-driven AFM workflows, SimuScan-trained models can locate and analyze nanoscale structures across large datasets and guide targeted follow-up imaging. We validate this approach on nanostructured surfaces, DNA assemblies, and bacterial cells, demonstrating robust generalization across diverse sample types with minimal operator intervention. More broadly, this work establishes a general strategy for generating explicitly conditioned, task-relevant synthetic data to improve the reliability of downstream models in autonomous microscopy.

Millan-Solsona, Ruben [Oak Ridge National Laborato↗
DOE OSTI2021

Community-Driven Methods for Open and Reproducible Software Tools for Analyzing Datasets from Atom Probe Microscopy

Atom probe tomography, and related methods, probe the three-dimensional architecture of a material. The software tools that microscopists use, and how these tools are connected into workflows, makes a substantial contribution to the accuracy and precision of such a material characterization experiment. Typically, we adapt methods from other communities like mathematics, data science, computational geometry, artificial intelligence, or scientific computing. We also realize that improving on research data management is a challenge when it comes to align with the FAIR data stewardship principles. Faced with this global challenge, we are convinced that collaborating is useful. Here, we report the results and challenges with an inter-laboratory call for developing test cases for several types of atom probe software tools. The results support why defining detailed recipes of software workflows and sharing these recipes is necessary and rewarding: Open source tools and (meta)data exchange can help to make our day-to-day data processing tasks become more efficient, the training of new users and knowledge transfer become easier, and assist us with automated quantification of uncertainties to gain access to substantiated results.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Development of Multimodal Few-Shot Analytics for Electron Micrographs

Recent advances in materials data analytics have provided new avenues for determining process-structure-property (PSP) linkages in a variety of materials. Machine learning techniques including few-shot learning have increased the efficiency of classifying microscopy images for the purposes of material characterization. Attempts at creating a multimodal approach can provide further improvements to current models and help extract more salient features from data. In this vein, raw spectrum data was taken to provide an additional modality to our current pyCHIP classifier. Modifications in segmentation also show potential in improving the accuracy of the pyCHIP classifier. Classifier output was analyzed using network graphs and unsupervised clustering algorithms such as spectral clustering to detect better segmentation methods than the current “chipping” approach. We suggest that the chip selection process can be automated in the future using a combination of these techniques to enable high-throughput analyses.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Analysis of Interpretable Data Representations for 4D-STEM Using Unsupervised Learning

Abstract Understanding the structure of materials is crucial for engineering devices and materials with enhanced performance. Four-dimensional scanning transmission electron microscopy (4D-STEM) is capable of mapping nanometer-scale local crystallographic structure over micron-scale field of views. However, 4D-STEM datasets can contain tens of thousands of images from a wide variety of material structures, making it difficult to automate detection and classification of structures. Traditional automated analysis pipelines for 4D-STEM focus on supervised approaches, which require prior knowledge of the material structure and cannot describe anomalous or deviant structures. In this article, a pipeline for engineering 4D-STEM feature representations for unsupervised clustering using non-negative matrix factorization (NMF) is introduced. Each feature is evaluated using NMF and results are presented for both simulated and experimental data. It is shown that some data representations more reliably identify overlapping grains. Additionally, real space refinement is applied to identify spatially distinct sample regions, allowing for size and shape analysis to be performed. This work lays the foundation for improved analysis of nanoscale structural features in materials that deviate from expected crystallographic arrangement using 4D-STEM.

Bruefach, Alexandra (ORCID:0000000209323477)↗
DOE OSTI2024

Fine-tuning TrailMap: The utility of transfer learning to improve the performance of deep learning in axon segmentation of light-sheet microscopy images

Light-sheet microscopy has made possible the 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual undertaking. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through optimizing transfer learning. We fine-tuned the existing TrailMap model using expert-labeled data from noradrenergic axonal structures in the mouse brain. By changing the cross-entropy weights and using augmentation, we demonstrate a generally improved adjusted F1-score over using the originally trained TrailMap model within our test datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Deep-learning-aided extraction of optical constants in scanning near-field optical microscopy

Scanning near-field optical microscopy is one of the most effective techniques for spectroscopy of nanoscale systems. However, inferring optical constants from the measured near-field signal can be challenging because of a complicated and highly nonlinear interaction between the scanned probe and the sample. Conventional fitting methods applied to this problem often suffer from the lack of convergence or require human intervention. Here, we develop an alternative approach where the optical parameter extraction is automated by a deep learning network. The network provides an initial estimate that is subsequently refined by a traditional fitting algorithm. In conclusion, we show that this method demonstrates superior accuracy, stability against noise, and computational speed when applied to simulated near-field spectra.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Determination of the Maturation Status of Dendritic Cells by Applying Pattern Recognition to High-Resolution Images

The maturation or activation status of dendritic cells (DCs) directly correlates with their behavior and immunofunction. A common means to determine the maturity of dendritic cells is from high-resolution images acquired via scanning electron microscopy (SEM) or atomic force microscopy (AFM). While direct and visual, the determination has been made by directly looking at the images by researchers. Here we report a machine learning approach using pattern recognition in conjunction with cellular biophysical knowledge of dendritic cells to determine the maturation status of dendritic cells automatically. The determination from AFM images reaches 100% accuracy. The results from SEM images reaches 94.9%. The results demonstrate the accuracy of using machine learning for accelerating data analysis, extracting information, and drawing conclusions from high-resolution cellular images, paving the way for future applications requiring high-throughput and automation, such as cellular sorting and selection based on morphology, quantification of cellular structure, and DC-based immunotherapy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗