Engineering Papers⌕ Search

Engineering topics

Cossairt, Oliver

Publications and source records attributed to Cossairt, Oliver.

EXSCLAIM!: Harnessing materials science literature for self-labeled microscopy datasets

This work introduces the EXSCLAIM! toolkit for the automatic extraction, separation, and caption-based natural language annotation of images from scientific literature. EXSCLAIM! is used to show how rule-based natural language processing and image recognition can be leveraged to construct an electron microscopy data set containing thousands of keyword-annotated nanostructure images. Moreover, it is demonstrated how a combination of statistical topic modeling and semantic word similarity comparisons can be used to increase the number and variety of keyword annotations on top of the standard annotations from EXSCLAIM! With large-scale imaging datasets constructed from scientific literature, users are well positioned to train neural networks for classification and recognition tasks specific to microscopy-tasks often otherwise inhibited by a lack of sufficient annotated training data.

36 MATERIALS SCIENCE↗

Plot2Spectra: an automatic spectra extraction tool

Scientists cannot easily make use of numerical data encoded in plot images, such as of spectroscopy data, in scientific literature. Plot2Spectra was developed to use computer vision tools to automatically digitize plot images.

Jiang, Weixin↗

Systems and methods for interferometric multifocus microscopy

A system to generate image representations includes a first objective that receives a first light beam emitted from a sample and a second objective that receives a second light beam emitted from the sample, where the first light beam and the second light beam have conjugate phase. The system also includes a first diffractive element to receive the first light beam and separate it into a first plurality of diffractive light beams that are spatially distinct, and a second diffractive element to receive the second light beam and separate it into a second plurality of diffractive light beams that are spatially distinct. The system further includes a detector that receives the first and second plurality of diffractive light beams. The first plurality of diffractive light beams and the second plurality of diffractive light beams are simultaneously directed and focused onto different portions of an image plane of the detector.

He, Kuan↗

Broadband X-ray ptychography using multi-wavelength algorithm

Ptychography is a rapidly developing scanning microscopy which is able to view the internal structures of samples at a high resolution beyond the illumination size. The achieved spatial resolution is theoretically dose-limited. A broadband source can provide much higher flux compared with a monochromatic source; however, it conflicts with the necessary coherence requirements of this coherent diffraction imaging technique. In this paper, a multi-wavelength reconstruction algorithm has been developed to deal with the broad bandwidth in ptychography. Compared with the latest development of mixed-state reconstruction approach, this multi-wavelength approach is more accurate in the physical model, and also considers the spot size variation as a function of energy due to the chromatic focusing optics. Therefore, this method has been proved in both simulation and experiment to significantly improve the reconstruction when the source bandwidth, illumination size and scan step size increase. It is worth mentioning that the accurate and detailed information of the energy spectrum for the incident beam is not required in advance for the proposed method. Further, we combine multi-wavelength and mixed-state approaches to jointly solve temporal and spatial partial coherence in ptychography so that it can handle various disadvantageous experimental effects. The significant relaxation in coherence requirements by our approaches allows the use of high-flux broadband X-ray sources for high-efficient and high-resolution ptychographic imaging.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Constructing Self-Labeled Materials Imaging Datasets from Open Access Scientific Journals with EXSCLAIM!

Due to recent improvements in image resolution and acquisition speeds, materials microscopy is experiencing an explosion in imaging data. Yet, despite the volume of images generated, the overall accessibility landscape is highly fragmented, as researchers who do release images to the public, often only do so as snapshots of their larger private dataset in context of scientific journal publications. The effort to automatically consolidate images and descriptive information from web-based platforms has garnered broad attention from the computer vision, language technologies, and chemistry/materials informatics communities. However, these methods are problematic for scientific figures because over 30% of figures are compound in nature, and it is the individual images themselves, paired with relevant context, that are necessary for construction a proper labeled dataset. To this end, we outline in this paper the design of a software pipeline for the automatic EXtraction, Separation, and Caption-based natural Language Annotation of IMages from scientific figures (EXSCLAIM!). Successful consolidation of materials imaging across literature sources will enhance navigation and searchability of materials microscopy images for both novice and experienced researchers, as well as establish the framework necessary for users to search by images, text, or some combination of both.

36 MATERIALS SCIENCE↗

Snapshot multifocal light field microscopy

Light field microscopy (LFM) is an emerging technology for high-speed wide-field 3D imaging by capturing 4D light field of 3D volumes. However, its 3D imaging capability comes at a cost of lateral resolution. In addition, the lateral resolution is not uniform across depth in the light field dconvolution reconstructions. To address these problems, here, we propose a snapshot multifocal light field microscopy (MFLFM) imaging method. The underlying concept of the MFLFM is to collect multiple focal shifted light fields simultaneously. We show that by focal stacking those focal shifted light fields, the depth-of-field (DOF) of the LFM can be further improved but without sacrificing the lateral resolution. Also, if all differently focused light fields are utilized together in the deconvolution, the MFLFM could achieve a high and uniform lateral resolution within a larger DOF. We present a house-built MFLFM system by placing a diffractive optical element at the Fourier plane of a conventional LFM. The optical performance of the MFLFM are analyzed and given. Both simulations and proof-of-principle experimental results are provided to demonstrate the effectiveness and benefits of the MFLFM. We believe that the proposed snapshot MFLFM has potential to enable high-speed and high resolution 3D imaging applications.

He, Kuan↗

Optimized illumination for high-throughput ptychography

As a scanning version of coherent diffraction imaging (CDI), X-ray ptychography has become a popular and very successful method for high-resolution quantitative imaging of extended specimens. The requirements of mostly coherent illumination and the scanning mechanism limit the throughput of ptychographic imaging. In this paper, we will introduce the methods we use at the Advanced Photon Source (APS) to achieve high-throughput ptychography by optimizing the parameters of the illumination beam. One work we have done is increasing the illumination flux by using a double-multilayer monochromator (DMM) optics with about 0.8% bandwidth. Compared with our double-crystal monochromator (DCM) optics with 0.01% bandwidth, this DMM optics provides around 20 times more flux. A multi-wavelength reconstruction method has been implemented to deal with the consequential degraded temporal coherence from such an illumination to ensure high-quality reconstruction. In the other work, we adopt a novel use of flat-top focusing optics to generate a flat-top beam with the diameter of about 1.5 µm on the focal plane. The better uniformity of the probe and the large beam size allow one to significantly increase the step size in ptychography scans and thereby the imaging efficiency.

Broad bandwidth↗

Rapid alignment of nanotomography data using joint iterative reconstruction and reprojection

As x-ray and electron tomography is pushed farther into the nanoscale, the limitations of rotation stages become more apparent leading to challenges in the alignment of the acquired projection images. Here we present an approach for rapid post-acquisition alignment of these projections to obtain high quality 3D images. Our approach is based on a joint estimation of alignment errors, and the object, using an iterative refinement procedure. We characterize convergence in simulations, and show its application in x-ray and electron nanotomography.

47 OTHER INSTRUMENTATION↗

Spatial-Spectral Representation for X-Ray Fluorescence Image Super-Resolution

X-ray fluorescence (XRF) scanning of works of art is becoming an increasing popular nondestructive analyticalmethod. The high quality XRF spectra is necessary to obtain significant information on both major and minor elements used for characterization and provenance analysis. However, there is a tradeoff between the spatial resolution of an XRF scan and the signalto- noise ratio (SNR) of each pixel’s spectrum, due to the limited scanning time. In this project, we propose an XRF image super-resolution method to address this tradeoff; thus, obtaining a high spatial resolution XRF scan with high SNR. We fuse a lowresolution XRF image and a conventional RGB high-resolution image into a product of both high spatial and high spectral resolution XRF image. There is no guarantee of a one to one mapping between XRF spectrum and RGB color since, for instance, paintings with hidden layers cannot be detected in visible but can in X-ray wavelengths. We separate the XRF image into the visible and nonvisible components. The spatial resolution of the visible component is increased utilizing the high-resolution RGB image, whereas the spatial resolution of the non-visible component is increased using a total variation super-resolution method. Finally, the visible and nonvisible components are combined to obtain the final result.

Dai, Qiqin↗