Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “microscopy automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Protein identification from electron cryomicroscopy maps by automated model building and side-chain matching

Using single-particle electron cryo-microscopy (cryo-EM), it is possible to obtain multiple reconstructions showing the 3D structures of proteins imaged as a mixture. Here, it is shown that automatic map interpretation based on such reconstructions can be used to create atomic models of proteins as well as to match the proteins to the correct sequences and thereby to identify them. This procedure was tested using two proteins previously identified from a mixture at resolutions of 3.2 Å, as well as using 91 deposited maps with resolutions between 2 and 4.5 Å. The approach is found to be highly effective for maps obtained at resolutions of 3.5 Å and better, and to have some utility at resolutions as low as 4 Å.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Dynamic Manipulation in Piezoresponse Force Microscopy: Creating Nonequilibrium Phases with Large Electromechanical Response

We discuss how domain walls and topological defects in ferroelectric materials have emerged as a powerful tool for functional electronic devices including memory and logic. Similarly, wall interactions and dynamics underpin a broad range of mesoscale phenomena ranging from giant electromechanical responses to memory effects. Exploring the functionalities of individual domain walls, their interactions, and controlled modifications of the domain structures is crucial for applications and fundamental physical studies. However, the dynamic nature of these features severely limits studies of their local physics since application of local biases or pressures in piezoresponse force microscopy induce wall displacement as a primary response. Here, we introduce an approach for the control and modification of domain structures based on automated experimentation, whereby real-space image-based feedback is used to control the tip bias during ferroelectric switching, allowing for modification routes conditioned on domain states under the tip. This automated experiment approach is demonstrated for the exploration of domain wall dynamics and creation of metastable phases with large electromechanical response.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Semi-Automated, Object-Based Tomography of Dislocation Structures

The characterization of the three-dimensional arrangement of dislocations is important for many analyses in materials science. Dislocation tomography in transmission electron microscopy is conventionally accomplished through intensity-based reconstruction algorithms. Although such methods work successfully, a disadvantage is that they require many images to be collected over a large tilt range. Here, we present an alternative, semi-automated object-based approach that reduces the data collection requirements by drawing on the prior knowledge that dislocations are line objects. Our approach consists of three steps: (1) initial extraction of dislocation line objects from the individual frames, (2) alignment and matching of these objects across the frames in the tilt series, and (3) tomographic reconstruction to determine the full three-dimensional configuration of the dislocations. Drawing on innovations in graph theory, we employ a node-line segment representation for the dislocation lines and a novel arc-length mapping scheme to relate the dislocations to each other across the images in the tilt series. We demonstrate the method for a dataset collected from a dislocation network imaged by diffraction-contrast scanning transmission electron microscopy. Based on these results and a detailed uncertainty analysis for the algorithm, we discuss opportunities for optimizing data collection and further automating the method.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Bayesian Conavigation: Dynamic Designing of the Material Digital Twins via Active Learning

Scientific advancement is universally based on the dynamic interplay between theoretical insights, modeling, and experimental discoveries. However, this feedback loop is often slow, including delayed community interactions and the gradual integration of experimental data into theoretical frameworks. This challenge is particularly exacerbated in domains dealing with high-dimensional object spaces, such as molecules and complex microstructures. Hence, the integration of theory within automated and autonomous experimental setups, or theory in the loop-automated experiment, is emerging as a crucial objective for accelerating scientific research. The critical aspect is to use not only theory but also on-the-fly theory updates during the experiment. Furthermore, we introduce a method for integrating theory into the loop through Bayesian conavigation of theoretical model space and experimentation. Our approach leverages the concurrent development of surrogate models for both simulation and experimental domains at the rates determined by latencies and costs of experiments and computation, alongside the adjustment of control parameters within theoretical models to minimize epistemic uncertainty over the experimental object spaces. This methodology facilitates the creation of digital twins of material structures, encompassing both the surrogate model of behavior that includes the correlative part and the theoretical model itself. While being demonstrated here within the context of functional responses in ferroelectric materials, our approach holds promise for broader applications, such as the exploration of optical properties in nanoclusters, microstructure-dependent properties in complex materials, and properties of molecular systems.

Microscopy↗
DOE OSTI2026

NanoPSD: A software for automatic detection of Nano-Particle Shape Distribution in electron microscopy images

Accurate quantification of the size and morphology of nanoparticles from electron microscopy (EM) images is essential to understand growth mechanisms, surface reactivity, and functional behavior in nanoscale materials. Manual analysis remains slow, subjective, and difficult to reproduce in large datasets. We introduce NanoPSD (Nano-Particle Shape Distribution), an open-source and fully automated framework for quantitative particle detection and morphology analysis from EM images. NanoPSD integrates adaptive contrast enhancement, polarity-agnostic scale-bar detection, Optical Character Recognition (OCR)-based calibration, and classical segmentation via Otsu thresholding with morphological refinement. Particle contours are used to extract geometric descriptors, including equivalent circular diameter, aspect ratio, circularity, and solidity, enabling automated classification into spherical, rod-like, and aggregate morphologies. The framework supports both single-image and batch processing, generating publication-quality visualizations, LaTeX-ready tables, and structured comma-separated values (CSV) datasets. As a demonstration, we applied NanoPSD to plasma-synthesized nanoparticle samples diagnosed via transmission electron microscopy (TEM). The code produced statistically robust size and morphology distributions spanning a few to tens of nanometers with minimal user supervision. The pipeline demonstrates high reproducibility and scalability, processing large image collections with consistent calibration and output formatting. Its modular design enables seamless integration of future deep-learning-based segmentation models, providing a pathway toward intelligent, data-driven electron microscopy analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Report Outlining Computed Tomography Strategy and Microscopy Approach to Qualifying AM 316 Materials

This report is part of work package CR-22OR0406012, Automated, High-Throughput Materials Characterization Techniques , under the Advanced Materials and Manufacturing Technologies program (AMMT). The project’s primary objective is to leverage our AI-based rapid and high-throughput automated characterization framework to qualify additively manufactured 316 materials comprehensively, focusing on optimizing the additive manufacturing process and evaluating the performance of 3D-printed stainless steel components. This report outlines our strategy for leveraging the automated characterization process for qualifying 316H materials.

36 MATERIALS SCIENCE↗
DOE OSTI2024

The Phenix‐AlphaFold webservice: Enabling AlphaFold predictions for use in Phenix

Abstract Advances in machine learning have enabled sufficiently accurate predictions of protein structure to be used in macromolecular structure determination with crystallography and cryo‐electron microscopy data. The Phenix software suite has AlphaFold predictions integrated into an automated pipeline that can start with an amino acid sequence and data, and automatically perform model‐building and refinement to return a protein model fitted into the data. Due to the steep technical requirements of running AlphaFold efficiently, we have implemented a Phenix‐AlphaFold webservice that enables all Phenix users to run AlphaFold predictions remotely from the Phenix GUI starting with the official 1.21 release. This webservice will be improved based on how it is used by the research community and the future research directions for Phenix.

Poon, Billy K.↗
DOE OSTI2024

Guided combinatorial synthesis and automated characterization expedites the discovery of hard, electrically conductive Pt x Au 1-x films

Sputter-deposited Pt-Au thin films have been reported to develop a hard, stable, nanocrystalline structure, yet little is known about how these characteristics vary with Pt x Au 1-x composition and process conditions. Toward this end, this document describes an extensive, combinatorial Pt-Au thin film library including characterized film compositions, structure, and properties. Complemented by kinematic Monte Carlo simulations of codeposition, a broad range of Pt x Au 1-x compositions (from x ~ 0.02 to 0.93) was first established by sputtering with varied magnetron powers and gun tilt angles. Further, the produced films were subsequently interrogated using automated nanoindentation, x-ray reflectivity, x-ray diffraction, atomic force microscopy, surface profilometry, four-point probe sheet resistance techniques, and wavelength dispersive spectroscopy in order to determine how hardness, modulus, density, surface roughness, structure, and resistivity vary with film stoichiometry and process parameters. Combinatorial films displayed an assortment of properties with the hardness of some films exceeding values reported previously for this material system. High hardness, high modulus, and low resistivity were generally attained when using increased deposition energy and reduced angle-of-incidence processes. Overall, the research identified promising, new Pt x Au 1-x compositions for future study and pinpointed strategies for improved deposition.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Measuring the dynamic response of the thylakoid architecture in plant leaves by electron microscopy

The performance of the photosynthesis machinery in plants, including light harvesting, electron transport, and protein repair is controlled by structural changes of the thylakoid membrane system inside the chloroplasts. In particular, the structure of the stacked grana area of thylakoid membranes is highly dynamic, changing in response to different environmental cues such as light intensity. For example, the aqueous thylakoid lumen enclosed by thylakoid membranes in grana has been documented to swell in the presence of light. However, light-induced alteration of the stromal gap in the stacked grana (partition gap) and of the unstacked stroma lamellae have not been well characterized. Light-induced changes of the entire thylakoid membrane system including the lumen in both stacked and unstacked domains as well as the partition gap are presented here, and the functional implications are discussed. This structural analysis was made possible by development of a robust semi-automated image analysis method combined with optimized plant tissue fixation techniques for transmission electron microscopy generating quantitative structural results for the analysis of thylakoid ultrastructure.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Unraveling the impact of initial choices and in-loop interventions on learning dynamics in autonomous scanning probe microscopy

The current focus in Autonomous Experimentation (AE) is on developing robust workflows to conduct the AE effectively. This entails the need for well-defined approaches to guide the AE process, including strategies for hyperparameter tuning and high-level human interventions within the workflow loop. This paper presents a comprehensive analysis of the influence of initial experimental conditions and in-loop interventions on the learning dynamics of Deep Kernel Learning (DKL) within the realm of AE in scanning probe microscopy. We explore the concept of the “seed effect,” where the initial experiment setup has a substantial impact on the subsequent learning trajectory. Additionally, we introduce an approach of the seed point interventions in AE allowing the operator to influence the exploration process. Using a dataset from Piezoresponse Force Microscopy on PbTiO 3 thin films, we illustrate the impact of the “seed effect” and in-loop seed interventions on the effectiveness of DKL in predicting material properties. The study highlights the importance of initial choices and adaptive interventions in optimizing learning rates and enhancing the efficiency of automated material characterization. This work offers valuable insights into designing more robust and effective AE workflows in microscopy with potential applications across various characterization techniques.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Deep Learning Segmentation of Complex Features in Atomic-Resolution Phase-Contrast Transmission Electron Microscopy Images

Phase-contrast transmission electron microscopy (TEM) is a powerful tool for imaging the local atomic structure of materials. TEM has been used heavily in studies of defect structures of two-dimensional materials such as monolayer graphene due to its high dose efficiency. However, phase-contrast imaging can produce complex nonlinear contrast, even for weakly scattering samples. It is, therefore, difficult to develop fully automated analysis routines for phase-contrast TEM studies using conventional image processing tools. For automated analysis of large sample regions of graphene, one of the key problems is segmentation between the structure of interest and unwanted structures such as surface contaminant layers. In this study, we compare the performance of a conventional Bragg filtering method with a deep learning routine based on the U-Net architecture. We show that the deep learning method is more general, simpler to apply in practice, and produces more accurate and robust results than the conventional algorithm. We provide easily adaptable source code for all results in this paper and discuss potential applications for deep learning in fully automated TEM image analysis.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Hypothesis Learning in Automated Experiment: Application to Combinatorial Materials Libraries

Machine learning is rapidly becoming an integral part of experimental physical discovery via automated and high-throughput synthesis, and active experiments in scattering and electron/probe microscopy. This, in turn, necessitates the development of active learning methods capable of exploring relevant parameter spaces with the smallest number of steps. In this work, an active learning approach based on conavigation of the hypothesis and experimental spaces is introduced. This is realized by combining the structured Gaussian processes containing probabilistic models of the possible system's behaviors (hypotheses) with reinforcement learning policy refinement (discovery). This approach closely resembles classical human-driven physical discovery, when several alternative hypotheses realized via models with adjustable parameters are tested during an experiment. This approach is demonstrated for exploring concentration-induced phase transitions in combinatorial libraries of Sm-doped BiFeO 3 using piezoresponse force microscopy, but it is straightforward to extend it to higher-dimensional parameter spaces and more complex physical problems once the experimental workflow and hypothesis generation are available.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Quality Control Methods for Measurement of UCO Kernel Composition and SiC Microstructure

Quality control (QC) is critically important to tristructural-isotropic (TRISO) particle fuels owing to the complexity of and reliance on the fuel form to contain fission products during irradiation. Characterization methods for particle fuel QC have decades of history and have continued to develop as new insights into fuel performance inform revised fuel specifications and as advances in underlying technologies expand the possibilities of what may be characterized. Two relatively new methods for characterization of TRISO fuels have been published in open literature: optical microscopy image analysis for mixed uranium carbide/uranium oxide (UCO) kernel composition analysis and automated grain boundary detection in backscattered electron (BSE) images of the silicon carbide (SiC) layer in TRISO particles for grain size characterization. Suggestions and guidelines for the application of these methods to TRISO fuel qualification are provided in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Towards FAIR Workflows for Federated Experimental Sciences

A de-centralized, peer-to-peer AI metadata framework is demonstrated which can enable end-to-end metadata & lineage tracking for distributed Machine Learning pipelines spanning edge, High Performance Computing, and cloud environments. With a specific example of end-to-end microscopy algorithm and datasets, the proposed method shows how to enable reproducibility, audit trail, provenance of metadata artifacts. The emerging needs of automation in experimental sciences, ML-centric workflows, and FAIR metadata management across federated compute environments is addressed.

machine learning↗
DOE OSTI2023

Sample Preparation Methods for Targeted Single-Cell Proteomics

We compared three cell isolation and two proteomic sample preparation methods for single-cell and near-single-cell analysis. Whole blood was used to quantify hemoglobin (Hb) and glycated-Hb (gly-Hb) in erythrocytes using targeted mass spectrometry and stable isotope-labeled standard peptides. Each method differed in cell isolation and sample preparation as follows: 1) FACS and automated preparation in one-pot for trace samples (autoPOTS); 2) limited dilution via microscopy and a novel rapid one-pot sample preparation method that circumvented the need for the solid-phase extraction, low-volume liquid handling instrumentation and humidified incubation chamber; and 3) CellenONE-based cell isolation and the same one-pot sample preparation method used for limited dilution. Only the CellenONE device routinely isolated single-cells from which Hb was measured to be 540–660 amol per red blood cell (RBC), which was comparable to the calculated SI reference range for mean corpuscular hemoglobin (390–540 amol/RBC). FACSAria sorter and limited dilution could routinely isolate single-digit cell numbers, to reliably quantify CMV-Hb heterogeneity. Finally, we observed that repeated measures, using 5–25 RBCs obtained from N = 10 blood donors, could be used as an alternative and more efficient strategy than single RBC analysis to measure protein heterogeneity, which revealed multimodal distribution, unique for each individual.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Automated Energy-Dispersive X-ray Spectroscopy Analysis for Multi-Modal Few-Shot Learning

Scanning transmission electron microscopy (STEM) is a powerful tool that allows for the atomic-scale analysis of a materials’ structure, chemistry, and defect domains (Akers et al. 2021). The current generation of microscopes generate vast amounts of data, surpassing the limits of effective manual analysis traditionally performed by domain experts (Spurgeon et al. 2021). While recent strides in machine learning have significantly enhanced the processing of large and intricate datasets acquired through electron microscopy, the prevalent use of proprietary software packages for initial data collection poses a challenge. In many cases, these software packages act as a ‘black box’, constraining user functionality and hindering the output of data in a format that is conducive to seamless integration into machine learning models. This work addresses these challenges by adapting HyperSpy, an open-source Python library, for the analysis and quantification of raw energy dispersive spectroscopy (EDS) data acquired through STEM. The modified HyperSpy code successfully facilitates user-defined segmentation of the data, enabling the integration of atomic %, weight %, and raw EDS spectra for each segmented region into an existing few-shot machine learning model. While initial results reveal discrepancies in quantified atomic and weight percentages when compared to proprietary software, ongoing efforts aim to rectify this issue by refining the fit of the HyperSpy model to the EDS spectra. Overall, this research underscores the potential of open-source tools like HyperSpy to enhance the accessibility of analytical tools, fostering a transparent and user-friendly environment for seamlessly incorporating electron microscopy data into machine learning models.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Deep learning for electron and scanning probe microscopy: From materials design to atomic fabrication

Machine learning and artificial intelligence (ML/AI) are rapidly becoming an indispensable part of physics research, with applications ranging from theory and materials prediction to high-throughput data analysis. In parallel, the recent successes in applying ML/AI methods for autonomous systems from robotics through self-driving cars to organic and inorganic synthesis are generating enthusiasm for the potential of these techniques to enable automated and autonomous experiment in imaging. Here, we discuss recent progress in application of machine learning methods in scanning transmission electron microscopy and scanning probe microscopy, from applications such as data compression and exploratory data analysis to physics learning to atomic fabrication.

36 MATERIALS SCIENCE↗