Engineering Papers⌕ Search
Home/Archive/DOE OSTI

DOE OSTI · 1827921

Real-Time Interactive 4D-STEM Phase-Contrast Imaging From Electron Event Representation Data: Less computation with the right representation

Pelz, Philipp M.·Johnson, Ian·Ophus, Colin·Ercius, Peter·Scott, Mary C.
View original source ↗Read source document ↗Export metadata ↓

Abstract

The arrival of direct electron detectors (DED) with high frame-rates in the field of scanning transmission electron microscopy has enabled many experimental techniques that require collection of a full diffraction pattern at each scan position, a field which is subsumed under the name four dimensional-scanning transmission electron microscopy (4D-STEM). DED frame rates approaching 100 kHz require data transmission rates and data storage capabilities that exceed commonly available computing infrastructure. Current commercial DEDs allow the user to make compromises in pixel bit depth, detector binning or windowing to reduce the per-frame file size and allow higher frame rates. This change in detector specifications requires decisions to be made before data acquisition that may reduce or lose information that could have been advantageous during data analysis. The 4D Camera, a DED with 87 kHz frame-rate developed at Lawrence Berkeley National Laboratory, reduces the raw data to a linear-index encoded electron event representation (EER). Here we show with experimental data from the 4D Camera that linear-index encoded EER and its direct use in 4D-STEM phase contrast imaging methods enables real-time, interactive phase-contrast from large-area 4D-STEM datasets. Furthermore, we detail the computational complexity advantages of the EER and the necessary computational steps to achieve real-time interactive ptychography and center-of-mass differential phase contrast using commonly available hardware accelerators.

Explore related subjects

4D-STEM72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDScodesdata integritydetectorsgraphic processing unitsmicroscopyphase contrast imagingscanning electron microscopysparse data representationtransmission electron microscopy

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Pelz, Philipp M., Johnson, Ian, Ophus, Colin, Ercius, Peter, Scott, Mary C.. 2022-01-01. Real-Time Interactive 4D-STEM Phase-Contrast Imaging From Electron Event Representation Data: Less computation with the right representation. https://doi.org/10.1109/msp.2021.3120981

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

DOE OSTI2026

4D-STEM Coupled with Unsupervised Machine Learning to Reveal at Large-Scale the Microstructural Evolution in Li- and Mn-Rich Cathodes

Li- and Mn-rich (LMR) layered oxides are known to exhibit a thin surface reconstruction layer, which grows during electrochemical cycling in a manner that depends on exposed crystallographic facets, cycling conditions, and electrolyte chemistry. Direct characterization of this layer has traditionally relied on high-resolution electron microscopy, which is inherently limited to small fields of view. Here, we employ four-dimensional scanning transmission electron microscopy (4D-STEM) combined with unsupervised machine-learning clustering to quantitatively map phase distributions over large areas and track their evolution in LMR cathodes during electrochemical aging. Our results show that the surface reconstruction layer consists predominantly of a rocksalt phase, whose thickness varies across different facets following activation cycling and becomes substantially thicker and more uniform during calendar aging. In contrast, a spinel-like phase is observed within the particle bulk. Large-area phase mapping and correlative high-resolution imaging reveal that this spinel-like phase preferentially nucleates at bulk crystallographic defects, including boundaries between 60°-rotated layered domains and associated mixed-phase regions, rather than exclusively at the particle surface. Our findings establish a mechanistic distinction between surface-driven rocksalt formation and bulk-defect-mediated spinel nucleation while demonstrating the unique capability of 4D-STEM to provide statistically robust, mesoscale insight into complex phase-evolution processes in LMR cathodes.

4D-STEM↗
DOE OSTI2026

Unsupervised Segmentation and Clustering Workflow for Efficient Processing of 4D-STEM and 5D-STEM Data

Four-dimensional scanning transmission electron microscopy (4D-STEM) enables mapping of diffraction information with nanometer-scale spatial resolution, offering detailed insight into local structure, orientation, and strain. However, as data dimensionality and sampling density increase, particularly for in situ scanning diffraction experiments (5D-STEM), robust segmentation of structurally consistent behavior across sequential measurements becomes essential for efficient and physically meaningful analysis. Here, we introduce a clustering framework that identifies crystallographically distinct domains from 4D-STEM datasets. By using local diffraction-pattern similarity as a metric, the method extracts closed contours delineating spatially contiguous regions. This approach produces cluster-averaged diffraction patterns that improve signal quality while reducing data volume by orders of magnitude, enabling rapid and accurate orientation, phase, and strain mapping. We demonstrate the applicability of this approach to in situ liquid-cell 4D-STEM data of gold nanoparticle growth. Our method provides a scalable and generalizable route for spatially coherent segmentation, data compression, and quantitative structure–strain mapping across diverse 4D-STEM modalities. The full analysis code and example workflows are publicly available to support reproducibility and reuse.

4D-STEM↗
DOE OSTI2026

Structural and Mechanical Analysis of Individual Mineralized Collagen Fibrils Using In Situ Transmission Electron Microscopy

Bone serves as an example of nature’s architectured material with its characteristic blend of strength and toughness, all at a lightweight design. Given the hierarchical nature of these materials, it is essential to understand the governing mechanisms and organization of their constituents across length scales for bioinspired structural design. Despite recent advances in transmission electron microscopy (TEM) that have allowed us to witness the hierarchical arrangement of bone at micro-down to the nanoscale, we are still missing the details about the structural organization and mechanical properties of the main building blocks of bone─mineralized collagen fibrils (MCFs). Here, we present a method to extract individual MCFs from nature’s model material, mineralized turkey leg tendon, using a dropcasting procedure. By isolating the MCFs onto TEM supporting grids, we visualized the arrangement of organic and mineral phases within individual MCFs at the nanoscale. Using a four-dimensional scanning transmission electron microscopy (4D-STEM) approach, the orientation of individual mineral crystals within the MCFs was examined. Furthermore, we conducted in situ tensile experiments, revealing exceptional tensile strains of at least 8%, demonstrating the intricate relationship between structural organization and the mechanical behavior of MCFs. These insights into the ultrastructure of mineralized tissue building blocks, as well as the proposed sample-extraction method compatible with in situ mechanical testing, provide a strong basis for research into nature-inspired material design.

4D-STEM↗