SEARCH · Engineering Papers

Results for “MICROSCOPY”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Learning the right channel in multimodal imaging: automated experiment in piezoresponse force microscopy

We report the development and experimental implementation of the automated experiment workflows for the identification of the best predictive channel for a phenomenon of interest in spectroscopic measurements. The approach is based on the combination of ensembled deep kernel learning for probabilistic predictions and a basic reinforcement learning policy for channel selection. It allows the identification of which of the available observational channels, sampled sequentially, are most predictive of selected behaviors, and hence have the strongest correlations. We implement this approach for multimodal imaging in piezoresponse force microscopy (PFM), with the behaviors of interest manifesting in piezoresponse spectroscopy. We illustrate the best predictive channel for polarization-voltage hysteresis loop and frequency-voltage hysteresis loop areas is amplitude in the model samples. The same workflow and code are applicable for any multimodal imaging and local characterization methods.

36 MATERIALS SCIENCE↗

DOE OSTI2024

AI-enabled Lorentz microscopy for quantitative imaging of nanoscale magnetic spin textures

The manipulation and control of nanoscale magnetic spin textures are of rising interest as they are potential foundational units in next-generation computing paradigms. Achieving this requires a quantitative understanding of the spin texture behavior under external stimuli using in situ experiments. Lorentz transmission electron microscopy (LTEM) enables real-space imaging of spin textures at the nanoscale, but quantitative characterization of in situ data is extremely challenging. Here, we present an AI-enabled phase-retrieval method based on integrating a generative deep image prior with an image formation forward model for LTEM. Our approach uses a single out-of-focus image for phase retrieval and achieves significantly higher accuracy and robustness to noise compared to existing methods. Furthermore, our method is capable of isolating sample heterogeneities from magnetic contrast, as shown by application to simulated and experimental data. This approach allows quantitative phase reconstruction of in situ data and can also enable near real-time quantitative magnetic imaging.

36 MATERIALS SCIENCE↗

DOE OSTI2024

A robust synthetic data generation framework for machine learning in high-resolution transmission electron microscopy (HRTEM)

Machine learning techniques are attractive options for developing highly-accurate analysis tools for nanomaterials characterization, including high-resolution transmission electron microscopy (HRTEM). However, successfully implementing such machine learning tools can be difficult due to the challenges in procuring sufficiently large, high-quality training datasets from experiments. In this work, we introduce Construction Zone, a Python package for rapid generation of complex nanoscale atomic structures which enables fast, systematic sampling of realistic nanomaterial structures and can be used as a random structure generator for large, diverse synthetic datasets. Using Construction Zone, we develop an end-to-end machine learning workflow for training neural network models to analyze experimental atomic resolution HRTEM images on the task of nanoparticle image segmentation purely with simulated databases. Further, we study the data curation process to understand how various aspects of the curated simulated data—including simulation fidelity, the distribution of atomic structures, and the distribution of imaging conditions—affect model performance across three benchmark experimental HRTEM image datasets. Using our workflow, we are able to achieve state-of-the-art segmentation performance on these experimental benchmarks and, further, we discuss robust strategies for consistently achieving high performance with machine learning in experimental settings using purely synthetic data. Construction Zone and its documentation are available at https://github.com/lerandc/construction_zone.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Autonomous fabrication of tailored defect structures in 2D materials using machine learning-enabled scanning transmission electron microscopy

Materials with tailored quantum properties can be engineered from atomic-scale assembly techniques, but existing methods often lack the agility and accuracy to precisely and intelligently control the manufacturing process. Here, we demonstrate a fully autonomous approach for fabricating atomic-level defects using electron beams in scanning transmission electron microscopy (STEM) that combines advanced machine learning and automated beam control. As a proof of concept, we achieved controlled fabrication of MoS-nanowire (MoS-NW) edge structures by iterative and targeted exposure of MoS 2 monolayer to a focused electron beam to selectively eject sulfur atoms, utilizing high-angle annular dark-field (HAADF) imaging for feedback-controlled monitoring of structural evolution of defects. A machine learning framework combining a random forest model and a convolutional neural network (CNN) was developed to decode the HAADF image and accurately identify atomic positions and species. This atomic-level information was then integrated into an autonomous decision-making platform, which applied predefined fabrication strategies to instruct beam control about atomic sites to be ejected. The selected sites were subsequently exposed to a localized electron beam using an FPGA-controlled scan routine with precise control over beam positioning and duration. While the MoS-NW edge structures produced exhibit promising mechanical and electronic properties, the proposed methods to build the autonomous fabrication framework is material-agnostic and can be extended to other 2D materials for the creation of diverse defect structures and heterostructures beyond Mo S2 .

Engineering↗

DOE OSTI2026

Machine learning pipeline for denoising low signal-to-noise ratio and out-of-distribution transmission electron microscopy datasets

High-resolution transmission electron microscopy (HRTEM) is crucial for observing material’s structural and morphological evolution at Angstrom scales, but the electron beam can alter these processes. Devices such as CMOS-based direct-electron detectors operating in electron-counting mode can be utilized to substantially reduce the electron dosage. However, the resulting images often lead to a low signal-to-noise ratio, which requires frame integration that sacrifices temporal resolution. Several machine learning (ML) models have been recently developed to successfully denoise HRTEM images. Yet, these models are often computationally expensive, and their inference speeds on GPUs are outpaced by the imaging speed of advanced detectors, precluding in situ analysis. Furthermore, the performance of these denoising models on datasets with imaging conditions that deviate from the training datasets has not been evaluated. To mitigate these gaps, we propose a new self-supervised ML denoising pipeline specifically designed for time-series HRTEM images. This pipeline integrates a blind-spot convolution neural network with pre-processing and post-processing steps, including drift correction and low-pass filtering. Results demonstrate that our model outperforms various other ML and non-ML denoising methods in noise reduction and contrast enhancement, leading to improved visual clarity of atomic features. Additionally, the model is drastically faster than U-Net-based ML models and demonstrates excellent out-of-distribution generalization. The model’s computational inference speed is in the order of milliseconds per image, rendering it suitable for application in in-situ HRTEM experiments.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Operando microscopy for neuromorphic hardware

Microscopy techniques can uncover the physical properties and dynamic behaviours of materials, driving the discovery of emergent phenomena and guiding the design of next-generation computing hardware. As artificial intelligence becomes pervasive, the demand for high-performance materials to support sustainable information technologies is growing. Here, this Review highlights state-of-the-art imaging from electron and X-ray to optical techniques to probe the dynamics of neuromorphic materials, including operando characterization of devices. We examine design principles for neuromorphic materials, along with obstacles that hinder their development. Emphasis is placed on spatially and temporally resolved approaches that capture state changes including phase transitions, ferroic switching and spin-wave propagation that emulate biological components such as neurons, synapses and their connectivity. We discuss challenges in operando characterization and the integration of artificial intelligence-driven analysis for feedback-guided material discovery. Finally, we outline opportunities for real-time imaging of neuromorphic systems, paving the way towards adaptive, brain-inspired hardware.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2025

Complex water networks visualized by cryogenic electron microscopy of RNA

The stability and function of biomolecules are directly influenced by their myriad interactions with water. Here we investigated water through cryogenic electron microscopy (cryo-EM) on a highly solvated molecule: the Tetrahymena ribozyme. By using segmentation-guided water and ion modelling (SWIM), an approach combining resolvability and chemical parameters, we automatically modelled and cross-validated water molecules and Mg 2+ ions in the ribozyme core, revealing the extensive involvement of water in mediating RNA non-canonical interactions. Unexpectedly, in regions where SWIM does not model ordered water, we observed highly similar densities in both cryo-EM maps. In many of these regions, the cryo-EM densities superimpose with complex water networks predicted by molecular dynamics, supporting their assignment as water and suggesting a biophysical explanation for their elusiveness to conventional atomic coordinate modelling. Our study demonstrates an approach to unveil both rigid and flexible waters that surround biomolecules through cryo-EM map densities, statistical and chemical metrics, and molecular dynamics simulations.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

REMBI: Recommended Metadata for Biological Images—enabling reuse of microscopy data in biology

Bioimaging data have significant potential for reuse, but unlocking this potential requires systematic archiving of data and metadata in public databases. Here, we propose draft metadata guidelines to begin addressing the needs of diverse communities within light and electron microscopy. We hope this publication and the proposed Recommended Metadata for Biological Images (REMBI) will stimulate discussions about their implementation and future extension.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Image processing tools for petabyte-scale light sheet microscopy data

Light sheet microscopy is a powerful technique for high-speed three-dimensional imaging of subcellular dynamics and large biological specimens. However, it often generates datasets ranging from hundreds of gigabytes to petabytes in size for a single experiment. Conventional computational tools process such images far slower than the time to acquire them and often fail outright due to memory limitations. To address these challenges, we present PetaKit5D, a scalable software solution for efficient petabyte-scale light sheet image processing. This software incorporates a suite of commonly used processing tools that are optimized for memory and performance. Notable advancements include rapid image readers and writers, fast and memory-efficient geometric transformations, high-performance Richardson–Lucy deconvolution and scalable Zarr-based stitching. These features outperform state-of-the-art methods by over one order of magnitude, enabling the processing of petabyte-scale image data at the full teravoxel rates of modern imaging cameras. The software opens new avenues for biological discoveries through large-scale imaging experiments.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Adaptive optical correction for in vivo two-photon fluorescence microscopy with neural fields

Adaptive optics restore ideal imaging performance in complex samples by measuring and correcting optical aberrations but often require custom-built microscopes with carefully aligned wavefront sensing/shaping devices and can be susceptible to sample motion. Here we describe NeAT, a computational framework using neural fields for adaptive optics two-photon fluorescence microscopy. NeAT estimates wavefront aberration and recovers sample structure from a 3D image stack without requiring external datasets for training. Incorporating motion correction in learning and correcting conjugation errors commonly found in commercial microscopes, NeAT is designed for deployment in biological laboratories for in vivo imaging. We validate NeAT’s performance using a custom-built microscope with a wavefront sensor under varying signal-to-noise ratios, aberration and motion conditions. With a commercial microscope, we demonstrate real-time aberration correction for in vivo morphological and functional imaging in the living mouse brain, with NeAT improving the signal and accuracy of glutamate and calcium imaging of synapses and neurons.

Kang, Iksung↗

DOE OSTI2020

Measurement of moisture-dependent ion diffusion constants in wood cell wall layers using time-lapse micro X-ray fluorescence microscopy

Our future bioeconomy depends on increased utilization of renewable lignocellulosic biomass. Controlling the diffusion of chemicals, such as inorganic ions, within secondary plant cell walls is central to many biomass applications. However, insufficient understanding of intra-cell-wall diffusion within secondary plant cell walls is hindering the advancement of many lignocellulosic biomass applications. In this work, X-ray fluorescence microscopy was used to measure diffusion constants of K + , Cu 2+ , and Cl - diffusing through loblolly pine (Pinus taeda) cell wall layers under 70%, 75%, or 80% relative humidity (RH). Results revealed that diffusion constants increased with RH, the larger Cu 2+ diffused more slowly than the K + , and the Cl - diffusion constant was the same as that for the counter cation, indicating cations and anions diffused together to maintain charge neutrality. Comparison with electrical conductivity measurements showed that conductivity is being controlled by ion mobility over these RH. The results further support that intra-cell-wall diffusion of inorganic ions is a Fickian diffusion process occurring through rubbery amorphous polysaccharides, which contradicts previous assertions that intra-cell-wall diffusion is an aqueous process occurring through water pathways. Researchers can now utilize polymer science approaches to engineer the molecular architecture of lignocellulosic biomass to optimize properties for specific end uses.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Elucidating nanoscale mechanical properties of diabetic human adipose tissue using atomic force microscopy

Abstract Obesity-related type 2 diabetes (DM) is a major public health concern. Adipose tissue metabolic dysfunction, including fibrosis, plays a central role in DM pathogenesis. Obesity is associated with changes in adipose tissue extracellular matrix (ECM), but the impact of these changes on adipose tissue mechanics and their role in metabolic disease is poorly defined. This study utilized atomic force microscopy (AFM) to quantify difference in elasticity between human DM and non-diabetic (NDM) visceral adipose tissue. The mean elastic modulus of DM adipose tissue was twice that of NDM adipose tissue (11.50 kPa vs. 4.48 kPa) to a 95% confidence level, with significant variability in elasticity of DM compared to NDM adipose tissue. Histologic and chemical measures of fibrosis revealed increased hydroxyproline content in DM adipose tissue, but no difference in Sirius Red staining between DM and NDM tissues. These findings support the hypothesis that fibrosis, evidenced by increased elastic modulus, is enhanced in DM adipose tissue, and suggest that measures of tissue mechanics may better resolve disease-specific differences in adipose tissue fibrosis compared with histologic measures. These data demonstrate the power of AFM nanoindentation to probe tissue mechanics, and delineate the impact of metabolic disease on the mechanical properties of adipose tissue.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Topography inversion in scanning tunneling microscopy of single-atom-thick materials from penetrating substrate states

Scanning tunneling microscopy (STM) is one of the indispensable tools to characterize surface structures, but the distinction between atomic geometry and electronic effects based on the measured tunneling current is not always straightforward. In particular, for single-atomic-thick materials (graphene or boron nitride) on metallic substrates, counterintuitive phenomena such as a larger tunneling current for insulators than for metal and a topography opposite to the atomic geometry are reported. Using first-principles density functional theory calculations combined with analytical modeling, we reveal the critical role of penetrating states of metallic substrates that surpass 2D material states, hindering the measurement of intrinsic 2D materials states and leading to topography inversion. Our finding should be instrumental in the interpretation of STM topographies of atomic-thick materials and in the development of 2D material for (opto)electronic and various quantum applications.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2022

Nanoscale defect evaluation framework combining real-time transmission electron microscopy and integrated machine learning-particle filter estimation

Observation of dynamic processes by transmission electron microscopy (TEM) is an attractive technique to experimentally analyze materials’ nanoscale phenomena and understand the microstructure-properties relationships in nanoscale. Even if spatial and temporal resolutions of real-time TEM increase significantly, it is still difficult to say that the researchers quantitatively evaluate the dynamic behavior of defects. Images in TEM video are a two-dimensional projection of three-dimensional space phenomena, thus missing information must be existed that makes image’s uniquely accurate interpretation challenging. Therefore, even though they are still a clustering high-dimensional data and can be compressed to two-dimensional, conventional statistical methods for analyzing images may not be powerful enough to track nanoscale behavior by removing various artifacts associated with experiment; and automated and unbiased processing tools for such big-data are becoming mission-critical to discover knowledge about unforeseen behavior. We have developed a method to quantitative image analysis framework to resolve these problems, in which machine learning and particle filter estimation are uniquely combined. The quantitative and automated measurement of the dislocation velocity in an Fe-31Mn-3Al-3Si autunitic steel subjected to the tensile deformation was performed to validate the framework, and an intermittent motion of the dislocations was quantitatively analyzed. The framework is successfully classifying, identifying and tracking nanoscale objects; these are not able to be accurately implemented by the conventional mean-path based analysis.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Deep learning-based noise filtering toward millisecond order imaging by using scanning transmission electron microscopy

Application of scanning transmission electron microscopy (STEM) to in situ observation will be essential in the current and emerging data-driven materials science by taking STEM’s high affinity with various analytical options into account. As is well known, STEM’s image acquisition time needs to be further shortened to capture a targeted phenomenon in real-time as STEM’s current temporal resolution is far below the conventional TEM’s. However, rapid image acquisition in the millisecond per frame or faster generally causes image distortion, poor electron signals, and unidirectional blurring, which are obstacles for realizing video-rate STEM observation. Here we show an image correction framework integrating deep learning (DL)-based denoising and image distortion correction schemes optimized for STEM rapid image acquisition. By comparing a series of distortion corrected rapid scan images with corresponding regular scan speed images, the trained DL network is shown to remove not only the statistical noise but also the unidirectional blurring. This result demonstrates that rapid as well as high-quality image acquisition by STEM without hardware modification can be established by the DL. The DL-based noise filter could be applied to in-situ observation, such as dislocation activities under external stimuli, with high spatio-temporal resolution.

47 OTHER INSTRUMENTATION↗

DOE OSTI2023

Proof of principle study: synchrotron X-ray fluorescence microscopy for identification of previously radioactive microparticles and elemental mapping of FFPE tissues

Biobanks containing formalin-fixed, paraffin-embedded (FFPE) tissues from animals and human atomic-bomb survivors exposed to radioactive particulates remain a vital resource for understanding the molecular effects of radiation exposure. These samples are often decades old and prepared using harsh fixation processes which limit sample imaging options. Optical imaging of hematoxylin and eosin (H&E) stained tissues may be the only feasible processing option, however, H&E images provide no information about radioactive microparticles or radioactive history. Synchrotron X-ray fluorescence microscopy (XFM) is a robust, non-destructive, semi-quantitative technique for elemental mapping and identifying candidate chemical element biomarkers in FFPE tissues. Still, XFM has never been used to uncover distribution of formerly radioactive micro-particulates in FFPE canine specimens collected more than 30 years ago. In this work, we demonstrate the first use of low-, medium-, and high-resolution XFM to generate 2D elemental maps of ~ 35-year-old, canine FFPE lung and lymph node specimens stored in the Northwestern University Radiobiology Archive documenting distribution of formerly radioactive micro-particulates. Additionally, we use XFM to identify individual microparticles and detect daughter products of radioactive decay. The results of this proof-of-principle study support the use of XFM to map chemical element composition in historic FFPE specimens and conduct radioactive micro-particulate forensics.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2024

Label-free functional analysis of root-associated microbes with dynamic quantitative oblique back-illumination microscopy

The increasing global demand for food, coupled with concerns about the environmental impact of synthetic fertilizers, underscores the urgency of developing sustainable agricultural practices. Nitrogen-fixing bacteria, known as diazotrophs, offer a potential solution by converting atmospheric nitrogen into bioavailable forms, reducing the reliance on synthetic fertilizers. However, a deeper understanding of their interactions with plants and other microbes is needed. In this study, we introduce a recently developed label-free 3D quantitative phase imaging technology called dynamic quantitative oblique back-illumination microscopy (DqOBM) to assess the functional dynamic activity of diazotrophs in vitro and in situ. Our experiments involved three different diazotrophs (Sinorhizobium meliloti, Azotobacter vinelandii, and Rahnella aquatilis) cultured on media with amendments of carbon and nitrogen sources. Over 5 days, we observed increased dynamics in nutrient-amended media. These results suggest that the observed bacterial dynamics correlate with their metabolic activity. Furthermore, we applied qOBM to visualize microbial dynamics within the root cap and elongation zone of Arabidopsis thaliana primary roots. This allowed us to identify distinct areas of microbial infiltration in plant roots without the need for fluorescent markers. Our findings demonstrate that DqOBM can effectively characterize microbial dynamics and provide insights into plant-microbe interactions in situ, offering a valuable tool for advancing our understanding of sustainable agriculture.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Multiscale in-situ characterization of static recrystallization using dark-field X-ray microscopy and high-resolution X-ray diffraction

Abstract Dark-field X-ray microscopy (DFXM) is a high-resolution, X-ray-based diffraction microstructure imaging technique that uses an objective lens aligned with the diffracted beam to magnify a single Bragg reflection. DFXM can be used to spatially resolve local variations in elastic strain and orientation inside embedded crystals with high spatial (~ 60 nm) and angular (~ 0.001°) resolution. However, as with many high-resolution imaging techniques, there is a trade-off between resolution and field of view, and it is often desirable to enrich DFXM observations by combining it with a larger field-of-view technique. Here, we combine DFXM with high-resolution X-ray diffraction (HR-XRD) applied to an in-situ investigation of static recrystallization in an 80% hot-compressed Mg–3.2Zn–0.1Ca wt.% (ZX30) alloy. Using HR-XRD, we track the relative grain volume of > 8000 sub-surface grains during annealing in situ. Then, at several points during the annealing process, we “zoom in” to individual grains using DFXM. This combination of HR-XRD and DFXM enables multiscale characterization, used here to study why particular grains grow to consume a large volume fraction of the annealed microstructure. This technique pairing is particularly useful for small and/or highly deformed grains that are often difficult to resolve using more standard diffraction microstructure imaging techniques.

36 MATERIALS SCIENCE↗