Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ptychography”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Efficient phase contrast imaging in STEM using a pixelated detector. Part 1: Experimental demonstration at atomic resolution

In this paper, we demonstrate a method to achieve high efficiency phase contrast imaging in aberration corrected scanning transmission electron microscopy (STEM) with a pixelated detector. The pixelated detector is used to record the Ronchigram as a function of probe position which is then analyzed with ptychography. Ptychography has previously been used to provide super-resolution beyond the diffraction limit of the optics, alongside numerically correcting for spherical aberration. Here we rely on a hardware aberration corrector to eliminate aberrations, but use the pixelated detector data set to utilize the largest possible volume of Fourier space to create high efficiency phase contrast images. The use of ptychography to diagnose the effects of chromatic aberration is also demonstrated. In conclusion, the four dimensional dataset is used to compare different bright field detector configurations from the same scan for a sample of bilayer graphene. Our method of high efficiency ptychography produces the clearest images, while annular bright field produces almost no contrast for an in-focus aberration-corrected probe.

36 MATERIALS SCIENCE↗

Achieving high spatial resolution in a large field-of-view using lensless x-ray imaging

X-ray ptychography, a powerful scanning lensless imaging technique, has become attractive for nondestructively imaging internal structures at nanoscale. Stage positioning overhead in conventional step-scan ptychography is one of the limiting factors on the imaging throughput. In this work, we demonstrate the use of advanced fly scan ptychography to achieve high-resolution ptychograms of modern integrated circuits on a large field-of-view at millimeter scale. By completely removing stage overheads between scan points, the imaging time for millimeter-size sample can be significantly reduced. Furthermore, we implement the orthogonal probe relaxation technique to overcome the variation of illumination across the large scan area as well as local vibrations. The capability of x-ray ptychography shown here is broadly applicable for various studies, which requires both high spatial resolution and large scan area.

47 OTHER INSTRUMENTATION↗

Simultaneous cryo X-ray ptychographic and fluorescence microscopy of green algae

Trace metals play important roles in normal and in disease-causing biological functions. X-ray fluorescence microscopy reveals trace elements with no dependence on binding affinities (unlike with visible light fluorophores) and with improved sensitivity relative to electron probes. However, X-ray fluorescence is not very sensitive for showing the light elements that comprise the majority of cellular material. Here we show that X-ray ptychography can be combined with fluorescence to image both cellular structure and trace element distribution in frozen-hydrated cells at cryogenic temperatures, with high structural and chemical fidelity. Ptychographic reconstruction algorithms deliver phase and absorption contrast images at a resolution beyond that of the illuminating lens or beam size. Using 5.2-keV X-rays, we have obtained sub-30-nm resolution structural images and similar to 90-nm-resolution fluorescence images of several elements in frozen-hydrated green algae. This combined approach offers a way to study the role of trace elements in their structural context.

Deng, Junjing↗

SHARP: a distributed GPU-based ptychographic solver

Ever brighter light sources, fast parallel detectors and advances in phase retrieval methods have made ptychography a practical and popular imaging technique. Compared to previous techniques, ptychography provides superior robustness and resolution at the expense of more advanced and time-consuming data analysis. Therefore, by taking advantage of massively parallel architectures, high-throughput processing can expedite this analysis and provide microscopists with immediate feedback. These advances allow real-time imaging at wavelength-limited resolution, coupled with a large field of view. This article describes a set of algorithmic and computational methodologies used at the Advanced Light Source and US Department of Energy light sources. These are packaged as a CUDA-based software environment named SHARP, aimed at providing state-of-the-art high-throughput ptychography reconstructions for the coming era of diffraction-limited light sources.

47 OTHER INSTRUMENTATION↗

Development and characterization of monolithic multilayer Laue lens nanofocusing optics

We have developed an experimental approach to bond two independent linear Multilayer Laue Lenses (MLLs) together. A monolithic MLL structure was characterized using ptychography at 12 keV photon energy, and we demonstrated 12 nm and 24 nm focusing in horizontal and vertical directions, respectively. Fabrication of 2D MLL optics allows installation of these focusing elements in more conventional microscopes suitable for x-ray imaging using zone plates, and opens easier access to 2D imaging with high spatial resolution in the hard x-ray regime.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Real-time sparse-sampled Ptychographic imaging through deep neural networks

Ptychography has rapidly grown in the fields of X-ray and electron imaging for its unprecedented ability to achieve nano or atomic scale resolution while simultaneously retrieving chemical or magnetic information from a sample. A ptychographic reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data, which typically precludes real-time imaging due to computational cost involved in solving this inverse problem. In this work we propose PtychoNN, a novel approach to solve the ptychography reconstruction problem based on deep convolutional neural networks. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. The presented results demonstrate how PtychoNN can effectively be used on experimental data, being able to generate high quality reconstructions of a sample up to hundreds of times faster than state-of-the-art ptychography reconstruction solutions once trained. By surpassing the typical constraints of iterative model-based methods, we can significantly relax the data acquisition sampling conditions and produce equally satisfactory reconstructions. Besides drastically accelerating acquisition and analysis, this capability can enable new imaging scenarios that were not possible before, in cases of dose sensitive, dynamic and extremely voluminous samples.

Cherukara, Mathew J↗

4D Imaging of ZnO-Coated Nanoporous Al 2 O 3 Aerogels by Chemically Sensitive Ptychographic Tomography: Implications for Designer Catalysts

The 3D chemical structure (4D spectromicroscopy) of nanoporous Al 2 O 3 aerogels coated with ZnO by atomic layer deposition (ALD) was studied by multienergy scanning transmission X-ray microscopy. These materials are representative of a class of designer catalysts in which the nanoporous support is prepared separately from the active catalyst material, which is subsequently introduced by ALD, thereby allowing independent optimization of the morphology, chemistry, and spatial distribution of the support and catalyst. The samples studied were prepared by Ga ion and Xe plasma focused ion beam (FIB) milling as well as drop casting from water suspension. Zn L and Al K edge spectra of six samples with three different ZnO loadings were measured to investigate how loading and different sample preparation methods affect the 3D distribution of the ZnO and Al 2 O 3 . Scanning transmission X-ray microscopy (STXM) and ptychographic imaging at two energies each at the Zn L 3 and Al K edge were measured. The ptychography data were analyzed by using the SHARP reconstruction code to generate quantitative 2D chemical maps of the Al 2 O 3 and the ZnO. The STXM and ptychography maps were then measured at a sequence of tilt angles, covering up to 160° of rotation. The 3D structure of the ZnO and Al 2 O 3 was derived from the tilt series data by tomographic reconstruction using a compressed sensing algorithm. A twodimensional spatial resolution (half-period) of 6 nm, measured by Fourier ring correlation, and a 3D spatial resolution (half-period) of 9 nm, measured by Fourier shell correlation, were achieved when using the COSMIC beamline at the Advanced Light Source (ALS). The results show that for all of the ZnO loadings studied there is nonuniform coverage of the ZnO on the Al 2 O 3 aerogel framework. In addition, we found that both FIB methods create sample artifacts, although the distortion was less with Xe plasma than Ga ion FIB.

36 MATERIALS SCIENCE↗

Confined Growth of DNA-Assembled Superlattice Films

Here, we study the assembly of DNA-functionalized nanocubes under lateral confinement in microscale square trenches on a DNA-functionalized substrate. Microfocus small-angle X-ray scattering (SAXS) and scanning electron microscopy (SEM) are used to characterize the superlattices (SLs). The results indicate that nanocubes form simple-cubic SLs with square-prism morphology and a (100) out-of-plane orientation to maximize DNA bonding. In-plane, SLs align with the template, exposing their {100} side facets, and the degree of alignment depends on trench size. Interestingly, the distribution of in-plane orientations determined from SAXS and SEM do not agree, indicating that the internal and external structures of the SLs differ. To understand this discrepancy, X-ray ptychography is employed to image the internal structures of the SLs, revealing that SLs which appear to be single-crystalline in SEM may have subsurface grain boundaries, depending on trench size. SEM reveals that the SLs grow via nucleation and growth of randomly oriented domains, which then coalesce; this mechanism explains the observed dependence of alignment and defect structure on size. Interestingly, crystallization occurs via an unusual growth mode, whereby continuous SL layers grow on top of several misoriented islands. Overall, this work elucidates the effect of lateral confinement on the crystallization of DNA-functionalized nanoparticles and shows how X-ray ptychography can be used to gain insight into nanoparticle crystallization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

X-ray Fluorescence Nanotomography of Single Bacteria with a Sub-15 nm Beam

Abstract X-ray Fluorescence (XRF) microscopy is a growing approach for imaging the trace element concentration, distribution, and speciation in biological cells at the nanoscale. Moreover, three-dimensional nanotomography provides the added advantage of imaging subcellular structure and chemical identity in three dimensions without the need for staining or sectioning of cells. To date, technical challenges in X-ray optics, sample preparation, and detection sensitivity have limited the use of XRF nanotomography in this area. Here, XRF nanotomography was used to image the elemental distribution in individual E . coli bacterial cells using a sub-15 nm beam at the Hard X-ray Nanoprobe beamline (HXN, 3-ID) at NSLS-II. These measurements were simultaneously combined with ptychography to image structural components of the cells. The cells were embedded in small (3–20 µm) sodium chloride crystals, which provided a non-aqueous matrix to retain the three-dimensional structure of the E . coli while collecting data at room temperature. Results showed a generally uniform distribution of calcium in the cells, but an inhomogeneous zinc distribution, most notably with concentrated regions of zinc at the polar ends of the cells. This work demonstrates that simultaneous two-dimensional ptychography and XRF nanotomography can be performed with a sub-15 nm beam size on unfrozen biological cells to co-localize elemental distribution and nanostructure simultaneously.

59 BASIC BIOLOGICAL SCIENCES↗

AI-enabled high-resolution scanning coherent diffraction imaging

Ptychographic imaging is a powerful means of imaging beyond the resolution limits of typical x-ray optics. Capturing recovered images from raw ptychographic data, however, requires the solution of an inverse problem, namely, phase retrieval. Phase retrieval algorithms are computationally expensive, which precludes real-time imaging. In this work, we propose PtychoNN, an approach to solve the ptychography data inversion problem based on a deep convolutional neural network. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. Our results demonstrate the practical application of machine learning to recover high fidelity amplitude and phase contrast images of a real sample hundreds of times faster than current ptychography reconstruction packages. Furthermore, by overcoming the constraints of iterative model-based methods, we can significantly relax sampling constraints on data acquisition while still producing an excellent image of the sample. Besides drastically accelerating acquisition and analysis, this capability has profound implications for the imaging of dose sensitive, dynamic, and extremely voluminous samples.

47 OTHER INSTRUMENTATION↗

Three-dimensional hard X-ray ptychographic reflectometry imaging on extended mesoscopic surface structures

Many nanodevices and quantum devices, with their sizes often spanning from millimeters down to sub-nanometer, have intricate low-dimensional, non-uniform, or hierarchical structures on surfaces and interfaces. Since their functionalities are dependent on these structures, high-resolution surface-sensitive characterization becomes imperative to gain a comprehensive understanding of the function–structure relationship. We thus developed hard x-ray ptychographic reflectometry imaging, a new technique that merges the high-resolution two-dimensional imaging capabilities of hard x-ray ptychography for extended objects, with the high-resolution depth profiling capabilities of x-ray reflectivity for layered structures. The synergy of these two methods fully leverages both amplitude and phase information from ptychography reconstruction to not only reveal surface topography and localized structures, such as shapes and electron densities, but also yields statistical details, such as interfacial roughness that is not readily accessible through coherent imaging solely. The hard x-ray ptychographic reflectometry imaging is well-suited for three-dimensional imaging of mesoscopic samples, particularly those comprising planar or layered nanostructures on opaque supports, and could also offer a high-resolution surface metrology and defect analysis on semiconductor devices, such as integrated nanocircuits and lithographic photomasks for microchip fabrications.

47 OTHER INSTRUMENTATION↗

Multi-slice electron ptychographic tomography for three-dimensional phase-contrast microscopy beyond the depth of focus limits

Electron ptychography is a powerful computational method for atomic-resolution imaging with high contrast for weakly and strongly scattering elements. Modern algorithms coupled with fast and efficient detectors allow imaging specimens with tens of nanometers thicknesses with sub-0.5 Ångstrom lateral resolution. However, the axial resolution in these approaches is currently limited to a few nanometers, limiting their ability to solve novel atomic structures ab initio. Here, we experimentally demonstrate multi-slice ptychographic electron tomography, which allows atomic resolution three-dimensional phase-contrast imaging in a volume surpassing the depth of field limits. We reconstruct tilt-series 4D-STEM measurements of a $\mathrm{Co_3O_4}$ nanocube, yielding 2 Å axial and 0.7 Å transverse resolution in a reconstructed volume of $\mathrm{(18.2\,nm)^3}$. Our results demonstrate a 13.5-fold improvement in axial resolution compared to multi-slice ptychography while retaining the atomic lateral resolution and the capability to image volumes beyond the depth of field limit. Multi-slice ptychographic electron tomography significantly expands the volume of materials accessible using high-resolution electron microscopy. We discuss further experimental and algorithmic improvements necessary to also resolve single weakly scattering atoms in 3D.

36 MATERIALS SCIENCE↗

A computational framework for ptychographic reconstructions

Ptychography is now a well-established X-ray microscopy tool for synchrotron end-stations equipped with a scanning stage and a pixelated detector. Ptychographic phasing algorithms use information from coherent diffraction to deliver quantitative images of the specimen at a resolution higher than the scanning resolution. These algorithms have traditionally been implemented in software on a per-instrument basis in various degrees of user-friendliness and sophistication. Here, we present Ptypy, a ptychography software written with the intention to serve as a framework across the diverse sets of available instruments and usage cases. A distinctive feature of the software is its formalism, which provides a convenient abstraction of the physical model, thus allowing for concise algorithmic implementations and portability across set-up geometries. We give an overview of the supported usage cases, explain the abstraction layer and design principles, and provide a step-by-step guide describing how an algorithm may be realized in a concise and readable manner. The software capabilities are illustrated with reconstructions from visible light and X-ray data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Blind Ptychographic Phase Retrieval via Convergent Alternating Direction Method of Multipliers

Ptychography has risen as a reference X-ray imaging technique: it achieves resolutions of one billionth of a meter, macroscopic field of view, or the capability to retrieve chemical or magnetic contrast, among other features. A ptychographic reconstruction is normally formulated as a blind phase retrieval problem, where both the image (sample) and the probe (illumination) have to be recovered from phaseless measured data. In this article we address a nonlinear least squares model for the blind ptychography problem with constraints on the image and the probe by maximum likelihood estimation of the Poisson noise model. We formulate a variant model that incorporates the information of phaseless measurements of the probe to eliminate possible artifacts. Next, we propose a generalized alternating direction method of multipliers designed for the proposed nonconvex models with convergence guarantee under mild conditions, where their subproblems can be solved by fast el-ementwise operations. Numerically, the proposed algorithm outperforms state-of-the-art algorithms in both speed and image quality.

47 OTHER INSTRUMENTATION↗

Multigrid Optimization for Large-Scale Ptychographic Phase Retrieval

Ptychography is a popular imaging technique that combines diffractive imaging with scanning microscopy. The technique consists of a coherent beam that is scanned across an object in a series of overlapping positions, leading to reliable and improved reconstructions. Ptychographic microscopes allow for large fields to be imaged at high resolution at the cost of additional computational expense. Herein, we propose a multigrid-based optimization framework to reduce the computational burdens of large-scale ptychographic phase retrieval. Our proposed method exploits the inherent hierarchical structures in ptychography through tailored restriction and prolongation operators for the object and data domains. Our numerical results show that our proposed scheme accelerates the convergence of its underlying solver and outperforms the ptychographical iterative engine, a workhorse in the optics community.

97 MATHEMATICS AND COMPUTING↗

Single-frame far-field diffractive imaging with randomized illumination

Contains a transmission ptychography dataset collected from a chrome on glass Siemens star under optical illumination. The probe is generated by a randomized zone plate under illumination from a spatially filtered green laser. A single diffraction pattern was removed from the dataset and reported in a separate cxi file. In addition, a single exposure collected after manually defocusing the probe is reported. The ptychography dataset is used for calibration of the probe function, and the remaining diffraction patterns can be reconstructed via randomized probe imaging.

Ptychography, Randomized Probe Imaging↗

Single-frame far-field diffractive imaging with randomized illumination

Contains two transmission ptychography datasets, one collected from a Siemens star, and the second from an Fe/Gd multilayer. Both samples are under illumination from the same randomized zone plate. Each dataset has a single diffraction pattern removed, and these patterns are reported in a separate cxi file. Either ptychography dataset can be used for calibration of the probe function, and the remaining diffraction patterns can be reconstructed via randomized probe imaging.

BESSY II↗

Deep learning at the edge enables real-time streaming ptychographic imaging

Abstract Coherent imaging techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent imaging methods like ptychography are poised to revolutionize nanoscale materials characterization. However, these advancements are accompanied by significant increase in data and compute needs, which precludes real-time imaging, feedback and decision-making capabilities with conventional approaches. Here, we demonstrate a workflow that leverages artificial intelligence at the edge and high-performance computing to enable real-time inversion on X-ray ptychography data streamed directly from a detector at up to 2 kHz. The proposed AI-enabled workflow eliminates the oversampling constraints, allowing low-dose imaging using orders of magnitude less data than required by traditional methods.

36 MATERIALS SCIENCE↗