Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “microscopy automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Robust design of semi-automated clustering models for 4D-STEM datasets

Materials discovery and design require characterizing material structures at the nanometer and sub-nanometer scale. Four-Dimensional Scanning Transmission Electron Microscopy (4D-STEM) resolves the crystal structure of materials, but many 4D-STEM data analysis pipelines are not suited for the identification of anomalous and unexpected structures. This work introduces improvements to the iterative Non-Negative Matrix Factorization (NMF) method by implementing consensus clustering for ensemble learning. We evaluate the performance of models during parameter tuning and find that consensus clustering improves performance in all cases and is able to recover specific grains missed by the best performing model in the ensemble. The methods introduced in this work can be applied broadly to materials characterization datasets to aid in the design of new materials.

Bruefach, Alexandra (ORCID:0000000209323477)↗

Enabling Autonomous Electron Microscopy for Networked Computation and Steering

Advanced electron microscopy workflows require an ecosystem of microscope instruments and computing systems possibly located at different sites to conduct remotely steered and automated experiments. Current workflow executions involve manual operations for steering and measurement tasks, which are typically performed from control workstations co-located with microscopes; consequently, their operational tempo and effectiveness are limited. We propose an approach based on separate data and control channels for such an ecosystem of Scanning Transmission Electron Microscopes (STEM) and computing systems, for which no general solutions presently exist, unlike the neutron and light source instruments. We demonstrate automated measurement transfers and remote steering of Nion STEM physical instruments over site networks. We propose a Virtual Infrastructure Twin (VIT) of this ecosystem, which is used to develop and test our steering software modules without requiring access to the physical instrument infrastructure. Additionally, we develop a VIT for a multiple laboratory scenario, which illustrates the applicability of this approach to ecosystems connected over wide-area networks, for the development and testing of software modules and their later field deployment.

Al Najjar, Anees↗

Nuclear recoil detection with color centers in bulk lithium fluoride

We present initial results on the detection of nuclear recoils in lithium fluoride (LiF) through the fluorescence of color centers created by particle interactions in the crystal lattice. Using light-sheet fluorescence microscopy, we image nuclear recoil tracks from both fast and thermal neutron interactions deep within a cubic-centimeter-scale sample. Automated three-dimensional feature extraction based on machine-learning tools enables the identification and classification of individual events. We observe that the fluorescence response of LiF to gamma irradiation is strongly suppressed, by a factor of 30–50 compared to neutron exposure, demonstrating intrinsic insensitivity to electromagnetic backgrounds. The observed and simulated event characteristics are consistent, including their number, size, and topology. These results establish the feasibility of LiF as a scalable detection medium for rare nuclear-recoil events and constitute a first step toward 10–1000 g scale detectors with single-event sensitivity for applications in reactor-neutrino detection, neutron spectroscopy, and dark matter searches.

Aroujo, G R [University of Zurich]↗

Describing Point Defect Topology in 2D Energy Materials Through Computer Vision

Point defects such as vacancies and impurity atoms strongly impact the performance of 2D materials. Traditional efforts often rely on manual detection, a process that is time-intensive, prone to human error, and challenging to scale. Here we leverage machine learning (ML) methods to identify and quantify vacancies within 2D transition metal carbides (Ti3C2, MXenes), aiming to expedite detection while improving accuracy. MXenes exhibit valuable defect-defined electrochemical properties, but we currently lack statistical understanding of defect topology needed to fully harness these materials. Here we employ a convolutional neural network for semantic segmentation of experimental MXene images, opening an opportunity to conduct a rigorous statistical study on defect hierarchy while investigating local relaxation in the lattice. We show how the integration of ML can yield fundamental insight into point defects, providing a powerful tool that will play an increasingly crucial role in the future of materials science. ML is often not just a matter of straightforward application, and pretrained models proved ineffective in this case. Instead, we trained our own neural network (NN) and applied data augmentation techniques and fine-tuning to the training dataset. Since labeled microscopy data is often scarce, we developed training data from a previously published wide-frame MXene image, using customized Gaussian fitting to locate atomic positions. Our trained model was then applied to a large dataset of experimental images, enabling a statistical study of defect configurations across three samples prepared with different HF etchant concentrations (5%, 9.1%, and 12.5%), as shown in Fig. 1. This also allowed us to investigate local strain around vacancies, though we find that we are limited by the precision of measurements using high-angle annular dark field (HAADF) images, as shown in Fig. 2. This study demonstrates how ML enables large-scale, quantitative analysis of atomic defects - an otherwise infeasible task with traditional methods. While our NN was specialized for Ti3C2 MXenes, the pipeline we developed provides a foundation for future ML models tailored to other materials. Ultimately, we envision embedding the NN onto the microscope to give real-time feedback to the user. To make this a reality, continued work is necessary to fully understand the NN's capabilities and limitations. This study gets one step closer to our goals of automated experimentation moving away from traditional methods of manual labeling. As ML capabilities advance, we hope to continue adapting and applying these techniques in microscopy.

2D materials↗

Automated Experiments of Local Non–Linear Behavior in Ferroelectric Materials

An automated experiment in multimodal imaging to probe structural, chemical, and functional behaviors in complex materials and elucidate the dominant physical mechanisms that control device function is developed and implemented. Here, the emergence of non-linear electromechanical responses in piezoresponse force microscopy (PFM) is explored. Non-linear responses in PFM can originate from multiple mechanisms, including intrinsic material responses often controlled by domain structure, surface topography that affects the mechanical phenomena at the tip-surface junction, and the presence of surface contaminants. Using an automated experiment to probe the origins of non-linear behavior in ferroelectric lead titanate (PTO) and ferroelectric Al 0.93 B 0.07 N films, it is found that PTO shows asymmetric nonlinear behavior across a/c domain walls and a broadened high nonlinear response region around c/c domain walls. In contrast, for Al 0.93 B 0.07 N, well-poled regions show high linear piezoelectric responses, when paired with low non-linear responses regions that are multidomain show low linear responses and high nonlinear responses. It is shown that formulating dissimilar exploration strategies in deep kernel learning as alternative hypotheses allows for establishing the preponderant physical mechanisms behind the non-linear behaviors, suggesting that automated experiments can potentially discern between competing physical mechanisms. Furthermore, this technique can also be extended to electron, probe, and chemical imaging.

36 MATERIALS SCIENCE↗

A Workflow for Accelerating Multimodal Data Collection for Electrodeposited Films

Abstract Future machine learning strategies for materials process optimization will likely replace human capital-intensive artisan research with autonomous and/or accelerated approaches. Such automation enables accelerated multimodal characterization that simultaneously minimizes human errors, lowers costs, enhances statistical sampling, and allows scientists to allocate their time to critical thinking instead of repetitive manual tasks. Previous acceleration efforts to synthesize and evaluate materials have often employed elaborate robotic self-driving laboratories or used specialized strategies that are difficult to generalize. Herein we describe an implemented workflow for accelerating the multimodal characterization of a combinatorial set of 915 electroplated Ni and Ni–Fe thin films resulting in a data cube with over 160,000 individual data files. Our acceleration strategies do not require manufacturing-scale resources and are thus amenable to typical materials research facilities in academic, government, or commercial laboratories. The workflow demonstrated the acceleration of six characterization modalities: optical microscopy, laser profilometry, X-ray diffraction, X-ray fluorescence, nanoindentation, and tribological (friction and wear) testing, each with speedup factors ranging from 13–46x. In addition, automated data upload to a repository using FAIR data principles was accelerated by 64x.

36 MATERIALS SCIENCE↗

An Electron Backscatter Diffraction (EBSD)-Based Automated Tool for Ceramic Capacitor Grain Size Analysis

Ceramic capacitors continue to be recurring problem parts for NASA, despite best efforts to screen out potential defects and failures through environmental and electrical testing and nondestructive inspection techniques such as acoustic microscopy. The physical properties of ceramic capacitors necessitates thin dielectric layers capable of withstanding significant electric fields. Any defects in those ceramic layers can result in reduced insulation resistance failure modes including short circuit failures, so the quality and consistency of the dielectric material is critical. The size of the individual ceramic grains in the dielectric material is a critical parameter. However, judging “grain size” is not so simple—in a single capacitor there can be wide variation in grain sizes observed. It is theorized that by studying the grain size distributions of “known good” and “known bad” lots of capacitors, some conclusions could be drawn that would allow us to better predict to the reliability of future lots based on grain size distributions. The initial goal of this effort was to find or develop an automated tool that could inspect a capacitor and return grain size distribution results.

Robert Hodson↗

Mic-hackathon 2024: hackathon on machine learning for electron and scanning probe microscopy

Microscopy is one of the primary sources of information on materials structure and functionality at the nanometer and atomic scales. The data generated through microscopy is often contained in well-structured datasets, enriched with extensive metadata and sample histories, although not always with the same level of detail or storage format. The broad incorporation of data management plans by major funding agencies ensures the preservation and accessibility of this data. However, deriving insights from these rich datasets remains challenging due to the lack of established code ecosystems, standardized benchmarks, and integration strategies. Correspondingly, the efficiency of data usage is very low, and time expenditures at the analysis stage are enormous. In addition to post-acquisition data analysis, the emergence of application programming interfaces by major microscope manufacturers now creates opportunities for real-time ML-based data analytics to enable automated decision making, and particularly ML-agent controlled real-time microscope operation. Despite these opportunities, there is a significant gap in integrating the ML community with the broader microscopy community, limiting the value that these methods bring to physics and materials discovery and materials optimization. Hackathons address these challenges by fostering collaboration between ML experts and microscopy professionals, encouraging the development of innovative solutions that leverage ML for microscopy and preparing the workforce of the future both for microscopy-intensive domains areas, instrument manufacturers, and ML scientists interested in real world applications for fundamental research, materials optimization, and manufacturing. The hackathon generated benchmark datasets and digital twins of microscopes that further contribute to the development of the field and establish data analysis ecosystems. All the codes can be found at GitHub(https://github.com/KalininGroup/Mic-hackathon-2024-codes-publication/tree/1.0.0.1) and Zenodo (https://zenodo.org/records/15579940).

97 MATHEMATICS AND COMPUTING↗

Rapid and flexible segmentation of electron microscopy data using few-shot machine learning

Abstract Automatic segmentation of key microstructural features in atomic-scale electron microscope images is critical to improved understanding of structure–property relationships in many important materials and chemical systems. However, the present paradigm involves time-intensive manual analysis that is inherently biased, error-prone, and unable to accommodate the large volumes of data produced by modern instrumentation. While more automated approaches have been proposed, many are not robust to a high variety of data, and do not generalize well to diverse microstructural features and material systems. Here, we present a flexible, semi-supervised few-shot machine learning approach for segmentation of scanning transmission electron microscopy images of three oxide material systems: (1) epitaxial heterostructures of SrTiO 3 /Ge, (2) La 0.8 Sr 0.2 FeO 3 thin films, and (3) MoO 3 nanoparticles. We demonstrate that the few-shot learning method is more robust against noise, more reconfigurable, and requires less data than conventional image analysis methods. This approach can enable rapid image classification and microstructural feature mapping needed for emerging high-throughput characterization and autonomous microscope platforms.

36 MATERIALS SCIENCE↗

Face-Sheet Quality Analysis and Thermo-Physical Property Characterization of OOA and Autoclave Panels

Increased application of polymer matrix composite (PMC) materials in large vehicle structures requires consideration of non-autoclave manufacturing technology. The NASA Composites for Exploration project, and its predecessor, Lightweight Spacecraft Structures and Materials project, were tasked with the development of materials and manufacturing processes for structures that will perform in a heavy-lift-launch vehicle environment. Both autoclave and out of autoclave processable materials were considered. Large PMC structures envisioned for such a vehicle included the payload shroud and the interstage connector. In this study, composite sandwich panels representing 1/16th segments of the barrel section of the Ares V rocket fairing were prepared as 1.8 m x 2.4 m sections of the 10 m diameter arc segment. IM7/977-3 was used as the face-sheet prepreg of the autoclave processed panels and T40-800B/5320-1 for the out of autoclave panels. The core was 49.7 kilograms per square meters (3.1 pounds per cubic feet (pcf)) aluminum honeycomb. Face-sheets were fabricated by automated tape laying 153 mm wide unidirectional tape. This work details analysis of the manufactured panels where face-sheet quality was characterized by optical microscopy, cured ply thickness measurements, acid digestion, and thermal analysis.

Miller, Sandi G.↗

Face-Sheet Quality Analysis and Thermo-Physical Property Characterization of OOA and Autoclave Panels

Increased application of polymer matrix composite (PMC) materials in large vehicle structures requires consideration of non-autoclave manufacturing technology. The NASA Composites for Exploration project, and its predecessor, Lightweight Spacecraft Structures and Materials project, were tasked with the development of materials and manufacturing processes for structures that will perform in a heavy-lift-launch vehicle environment. Both autoclave and out of autoclave processable materials were considered. Large PMC structures envisioned for such a vehicle included the payload shroud and the interstage connector. In this study, composite sandwich panels representing 1/16th segments of the barrel section of the Ares V rocket fairing were prepared as 1.8 m x 2.4 m sections of the 10 m diameter arc segment. IM7/977-3 was used as the face-sheet prepreg of the autoclave processed panels and T40-800B/5320-1 for the out of autoclave panels. The core was 49.7 kg/sq m (3.1 lb/cu ft (pcf)) aluminum honeycomb. Face-sheets were fabricated by automated tape laying 153 mm wide unidirectional tape. This work details analysis of the manufactured panels where face-sheet quality was characterized by optical microscopy, cured ply thickness measurements, acid digestion, and thermal analysis.

Miller, Sandi G.↗

Building workflows for an interactive human-in-the-loop automated experiment (hAE) in STEM-EELS

Exploring the structural, chemical, and physical properties of matter on the nano- and atomic scales has become possible with the recent advances in aberration-corrected electron energy-loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM). However, the current paradigm of STEM-EELS relies on the classical rectangular grid sampling, in which all surface regions are assumed to be of equal a priori interest. However, this is typically not the case for real-world scenarios, where phenomena of interest are concentrated in a small number of spatial locations, such as interfaces, structural and topological defects, and multi-phase inclusions. One of the foundational problems is the discovery of nanometer- or atomic-scale structures having specific signatures in EELS spectra. Herein, we systematically explore the hyperparameters controlling deep kernel learning (DKL) discovery workflows for STEM-EELS and identify the role of the local structural descriptors and acquisition functions in experiment progression. In agreement with the actual experiment, we observe that for certain parameter combinations the experiment path can be trapped in the local minima. We demonstrate the approaches for monitoring the automated experiment in the real and feature space of the system and knowledge acquisition of the DKL model. Based on these, we construct intervention strategies defining the human-in-the-loop automated experiment (hAE). This approach can be further extended to other techniques including 4D STEM and other forms of spectroscopic imaging. The hAE library is available on Github at https://github.com/utkarshp1161/hAE/tree/main/hAE.

Pratiush, Utkarsh [Univ. of Tennessee, Knoxville, ↗

Automating Bayesian inference and design to quantify acoustic particle levitation

Self-propulsion of micro- and nanoparticles powered by ultrasound provides an attractive strategy for the remote manipulation of colloidal matter using biocompatible energy inputs. Quantitative understanding of particle motion and its dependence on size, shape, and composition requires accurate characterization of the acoustic field, which depends sensitively on the experimental setup. Here, we show how automated experiments based on Bayesian inference and design can accurately and efficiently characterize the acoustic field within resonant chambers used to propel acoustic nanomotors. Repeated cycles of observation, inference, and design (OID) are guided by a physical model that describes the rate at which levitating particles approach the nodal plane. Using video microscopy, we observe the relaxation of tracer particles to this plane following the application of the acoustic field. We use sequential Monte Carlo methods to infer model parameters such as the amplitude and frequency of the resonant chamber while accounting for particle-level measurement noise and population-level heterogeneity in the field. Guided by simulated outcomes, we select the optimal design for the next experiment as to maximize the information gain in the relevant parameters. We show how this iterative process serves to discriminate between competing hypotheses and efficiently converges to accurate parameter estimates using only few automated experiments. We discuss the need for model criticism to ensure the validity of the guiding model throughout automated cycles of observation, inference, and design. Furthermore, this work demonstrates how Bayesian methods can learn the parameters of nonlinear, hierarchical models used to describe video microscopy data of active colloids.

42 ENGINEERING↗

Data Mining – Image Analysis of Radiography for Zr Redistribution

The research effort described in this report represents a first attempt to investigate the radial redistribution of Zr in ternary fuel alloys U-xPu-10Zr (x = 0, 8, 19) irradiated in the in-reactor fuel experiments during the operation of the U.S. Department of Energy’s (DOE’s) Experimental Breeder Reactor II (EBR-II) at Idaho National Laboratory (INL) using methods of image processing on post-irradiation neutron radiographs. Approximately 130,000 metal fuel pins were irradiated in EBR-II during its 30 years of operation to develop and characterize existing and prospective fuels. For many of the metal fuel irradiation experiments, neutron radiography imaging was performed historically now allowing application of modern image analysis techniques to characterize fuel behavior, such as fuel swelling, fluff formation, and now, fuel alloy constituent redistribution. The redistribution of fuel components depends on the temperature field, radially, within the fuel. Specifically, Zr is expected to redistribute radially towards the center of the pin, as well as towards the outer zones. Currently, direct imaging of a pin cross-section through optical methods or scanning electron microscopy (SEM) is used to study the constituents’ redistribution, which is very time-consuming and can only be applied to a limited number of pins. An automated image processing technique allowing for the investigation of fuel radial redistribution zones would significantly accelerate data analysis. In general, if the fuel temperature is hot enough, three redistribution zones are expected, corresponding to the main fuel components (e.g., U, Pu, Zr). While more assessment will be performed in fiscal year (FY)-2023, it seems possible to differentiate the pins according to their fuel composition using image analysis techniques on neutron radiographs of metallic fuel pins based on the analysis to date.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A large expert-curated cryo-EM image dataset for machine learning protein particle picking

Cryo-electron microscopy (cryo-EM) is a powerful technique for determining the structures of biological macromolecular complexes. Picking single-protein particles from cryo-EM micrographs is a crucial step in reconstructing protein structures. However, the widely used template-based particle picking process is labor-intensive and time-consuming. Though machine learning and artificial intelligence (AI) based particle picking can potentially automate the process, its development is hindered by lack of large, high-quality labelled training data. To address this bottleneck, we present CryoPPP, a large, diverse, expert-curated cryo-EM image dataset for protein particle picking and analysis. It consists of labelled cryo-EM micrographs (images) of 34 representative protein datasets selected from the Electron Microscopy Public Image Archive (EMPIAR). The dataset is 2.6 terabytes and includes 9,893 high-resolution micrographs with labelled protein particle coordinates. The labelling process was rigorously validated through 2D particle class validation and 3D density map validation with the gold standard. The dataset is expected to greatly facilitate the development of both AI and classical methods for automated cryo-EM protein particle picking.

42 ENGINEERING↗

Probing individual single atom electrocatalyst sites by advanced analytical scanning transmission electron microscopy

Single atom electrocatalysts (SAEs) are promising next-generation materials for promoting a variety of important reactions, such as the oxygen reduction, nitrogen reduction, and CO 2 reduction reactions. While bulk characterization techniques such as X-ray absorption spectroscopy and Mössbauer spectroscopy have significantly enhanced our understanding of these catalysts, direct probing of individual single metal atom sites at the atomic scale is necessary to understand local variations in the properties of these sites and accelerate design and synthesis of improved SAEs. Aberration-corrected scanning transmission electron microscopy (STEM) has become a powerful tool for providing this type of atomic-scale information about SAE metal sites. These sites are typically unstable under the electron beam, however, which, in combination with conventional acquisition methods and detectors, has limited the type and quantity of information obtainable by spectroscopic STEM techniques. Here, we map multiple individual SAE metal sites in a nitrogen-doped carbon containing atomically dispersed Fe and Re (FeReNC) at the atomic scale by direct electron detection electron energy-loss spectroscopy (EELS). Direct electron detection provides an improved signal-to-noise ratio over conventional scintillator-based detectors and enables detection and real space localization of weak signals. In addition, we demonstrate an automated method for identification of metal atom positions, placement of the probe on these sites, and simultaneous EELS and energy dispersive X-ray spectroscopic (EDS) signal acquisition. This simultaneous acquisition of EELS and EDS provides access to the composition and bonding of a wide range of SAE metal sites. In this study, focusing the probe directly on the metal sites also increases the relevant data acquisition rate by more than an order of magnitude over two-dimensional mapping, enabling improved statistical measurements of site properties. The versatility, sensitivity, and speed that these techniques provide enhances our ability to probe the local elemental and chemical environment of a large number of individual SAE metal site structures at the atomic scale, enabling an improved understanding of the variations in the local properties of these electrocatalysts to be gained. As a result, significantly increased information about individual metal sites will be available to future electrochemical studies through these techniques, accelerating the development of advanced SAEs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Plasma Surface Functionalization of AFP Manufactured Composites for Improved Adhesive Bond Performance

Application of carbon fiber reinforced polymer (CFRP) as a high-performance structural material has widespread application in the present aerospace industry. However, as-processed composite materials require a comprehensive surface treatment prior to bonding to remove contaminants and impart surface functionality and topography to overcome their poor adhesion properties. Atmospheric pressure plasma jet treatment (APPJT) has been increasingly garnering attention as an alternate method for surface preparation of CFRP. This method has been reported to achieve success in imparting favorable polar functional groups into the composite surfaces enhancing wettability and surface energy of the bonded surfaces. In some cases, APPJT has been demonstrated to remove contaminants or, in the case of silicones, convert them to silica. In this study, an atmospheric pressure plasma jet (APPJ) system was used for surface activation of a composite laid-up by an automated fiber placement (AFP) machine. Surface modifications prior to and after treatment were characterized using water contact angle (WCA) measurements, X-ray photoelectron spectroscopy (XPS), scanning electron microscopy (SEM), and atomic force microscopy (AFM). Double cantilever beam (DCB) tests were performed to quantify the bonding performance of the composites. The results show a marked enhancement of the mode I interlaminar fracture toughness with the application of APPJT.

Sarikaya, Ibrahim↗

Automated Grain Yield Behavior Classification

A method for classifying grain stress evolution behaviors using unsupervised learning techniques is presented. The method is applied to analyze grain stress histories measured in-situ using high-energy X-ray diffraction microscopy (HEDM) from the aluminum-lithium alloy Al-Li 2099 at the elastic-plastic transition (yield). The unsupervised learning process automatically classified the grain stress histories into four groups: major softening, no work-hardening or softening, moderate work-hardening, and major work-hardening. The orientation and spatial dependence of these four groups are discussed. In addition, the generality of the classification process to other samples is explored.

Pagan, Darren C↗