Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “microscopy automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Guided combinatorial synthesis and automated characterization expedites the discovery of hard, electrically conductive Pt x Au 1-x films

Sputter-deposited Pt-Au thin films have been reported to develop a hard, stable, nanocrystalline structure, yet little is known about how these characteristics vary with Pt x Au 1-x composition and process conditions. Toward this end, this document describes an extensive, combinatorial Pt-Au thin film library including characterized film compositions, structure, and properties. Complemented by kinematic Monte Carlo simulations of codeposition, a broad range of Pt x Au 1-x compositions (from x ~ 0.02 to 0.93) was first established by sputtering with varied magnetron powers and gun tilt angles. Further, the produced films were subsequently interrogated using automated nanoindentation, x-ray reflectivity, x-ray diffraction, atomic force microscopy, surface profilometry, four-point probe sheet resistance techniques, and wavelength dispersive spectroscopy in order to determine how hardness, modulus, density, surface roughness, structure, and resistivity vary with film stoichiometry and process parameters. Combinatorial films displayed an assortment of properties with the hardness of some films exceeding values reported previously for this material system. High hardness, high modulus, and low resistivity were generally attained when using increased deposition energy and reduced angle-of-incidence processes. Overall, the research identified promising, new Pt x Au 1-x compositions for future study and pinpointed strategies for improved deposition.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Measuring the dynamic response of the thylakoid architecture in plant leaves by electron microscopy

The performance of the photosynthesis machinery in plants, including light harvesting, electron transport, and protein repair is controlled by structural changes of the thylakoid membrane system inside the chloroplasts. In particular, the structure of the stacked grana area of thylakoid membranes is highly dynamic, changing in response to different environmental cues such as light intensity. For example, the aqueous thylakoid lumen enclosed by thylakoid membranes in grana has been documented to swell in the presence of light. However, light-induced alteration of the stromal gap in the stacked grana (partition gap) and of the unstacked stroma lamellae have not been well characterized. Light-induced changes of the entire thylakoid membrane system including the lumen in both stacked and unstacked domains as well as the partition gap are presented here, and the functional implications are discussed. This structural analysis was made possible by development of a robust semi-automated image analysis method combined with optimized plant tissue fixation techniques for transmission electron microscopy generating quantitative structural results for the analysis of thylakoid ultrastructure.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Unraveling the impact of initial choices and in-loop interventions on learning dynamics in autonomous scanning probe microscopy

The current focus in Autonomous Experimentation (AE) is on developing robust workflows to conduct the AE effectively. This entails the need for well-defined approaches to guide the AE process, including strategies for hyperparameter tuning and high-level human interventions within the workflow loop. This paper presents a comprehensive analysis of the influence of initial experimental conditions and in-loop interventions on the learning dynamics of Deep Kernel Learning (DKL) within the realm of AE in scanning probe microscopy. We explore the concept of the “seed effect,” where the initial experiment setup has a substantial impact on the subsequent learning trajectory. Additionally, we introduce an approach of the seed point interventions in AE allowing the operator to influence the exploration process. Using a dataset from Piezoresponse Force Microscopy on PbTiO 3 thin films, we illustrate the impact of the “seed effect” and in-loop seed interventions on the effectiveness of DKL in predicting material properties. The study highlights the importance of initial choices and adaptive interventions in optimizing learning rates and enhancing the efficiency of automated material characterization. This work offers valuable insights into designing more robust and effective AE workflows in microscopy with potential applications across various characterization techniques.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Deep Learning Segmentation of Complex Features in Atomic-Resolution Phase-Contrast Transmission Electron Microscopy Images

Phase-contrast transmission electron microscopy (TEM) is a powerful tool for imaging the local atomic structure of materials. TEM has been used heavily in studies of defect structures of two-dimensional materials such as monolayer graphene due to its high dose efficiency. However, phase-contrast imaging can produce complex nonlinear contrast, even for weakly scattering samples. It is, therefore, difficult to develop fully automated analysis routines for phase-contrast TEM studies using conventional image processing tools. For automated analysis of large sample regions of graphene, one of the key problems is segmentation between the structure of interest and unwanted structures such as surface contaminant layers. In this study, we compare the performance of a conventional Bragg filtering method with a deep learning routine based on the U-Net architecture. We show that the deep learning method is more general, simpler to apply in practice, and produces more accurate and robust results than the conventional algorithm. We provide easily adaptable source code for all results in this paper and discuss potential applications for deep learning in fully automated TEM image analysis.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Hypothesis Learning in Automated Experiment: Application to Combinatorial Materials Libraries

Machine learning is rapidly becoming an integral part of experimental physical discovery via automated and high-throughput synthesis, and active experiments in scattering and electron/probe microscopy. This, in turn, necessitates the development of active learning methods capable of exploring relevant parameter spaces with the smallest number of steps. In this work, an active learning approach based on conavigation of the hypothesis and experimental spaces is introduced. This is realized by combining the structured Gaussian processes containing probabilistic models of the possible system's behaviors (hypotheses) with reinforcement learning policy refinement (discovery). This approach closely resembles classical human-driven physical discovery, when several alternative hypotheses realized via models with adjustable parameters are tested during an experiment. This approach is demonstrated for exploring concentration-induced phase transitions in combinatorial libraries of Sm-doped BiFeO 3 using piezoresponse force microscopy, but it is straightforward to extend it to higher-dimensional parameter spaces and more complex physical problems once the experimental workflow and hypothesis generation are available.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Quality Control Methods for Measurement of UCO Kernel Composition and SiC Microstructure

Quality control (QC) is critically important to tristructural-isotropic (TRISO) particle fuels owing to the complexity of and reliance on the fuel form to contain fission products during irradiation. Characterization methods for particle fuel QC have decades of history and have continued to develop as new insights into fuel performance inform revised fuel specifications and as advances in underlying technologies expand the possibilities of what may be characterized. Two relatively new methods for characterization of TRISO fuels have been published in open literature: optical microscopy image analysis for mixed uranium carbide/uranium oxide (UCO) kernel composition analysis and automated grain boundary detection in backscattered electron (BSE) images of the silicon carbide (SiC) layer in TRISO particles for grain size characterization. Suggestions and guidelines for the application of these methods to TRISO fuel qualification are provided in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Towards FAIR Workflows for Federated Experimental Sciences

A de-centralized, peer-to-peer AI metadata framework is demonstrated which can enable end-to-end metadata & lineage tracking for distributed Machine Learning pipelines spanning edge, High Performance Computing, and cloud environments. With a specific example of end-to-end microscopy algorithm and datasets, the proposed method shows how to enable reproducibility, audit trail, provenance of metadata artifacts. The emerging needs of automation in experimental sciences, ML-centric workflows, and FAIR metadata management across federated compute environments is addressed.

machine learning↗
DOE OSTI2023

Sample Preparation Methods for Targeted Single-Cell Proteomics

We compared three cell isolation and two proteomic sample preparation methods for single-cell and near-single-cell analysis. Whole blood was used to quantify hemoglobin (Hb) and glycated-Hb (gly-Hb) in erythrocytes using targeted mass spectrometry and stable isotope-labeled standard peptides. Each method differed in cell isolation and sample preparation as follows: 1) FACS and automated preparation in one-pot for trace samples (autoPOTS); 2) limited dilution via microscopy and a novel rapid one-pot sample preparation method that circumvented the need for the solid-phase extraction, low-volume liquid handling instrumentation and humidified incubation chamber; and 3) CellenONE-based cell isolation and the same one-pot sample preparation method used for limited dilution. Only the CellenONE device routinely isolated single-cells from which Hb was measured to be 540–660 amol per red blood cell (RBC), which was comparable to the calculated SI reference range for mean corpuscular hemoglobin (390–540 amol/RBC). FACSAria sorter and limited dilution could routinely isolate single-digit cell numbers, to reliably quantify CMV-Hb heterogeneity. Finally, we observed that repeated measures, using 5–25 RBCs obtained from N = 10 blood donors, could be used as an alternative and more efficient strategy than single RBC analysis to measure protein heterogeneity, which revealed multimodal distribution, unique for each individual.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Automated Energy-Dispersive X-ray Spectroscopy Analysis for Multi-Modal Few-Shot Learning

Scanning transmission electron microscopy (STEM) is a powerful tool that allows for the atomic-scale analysis of a materials’ structure, chemistry, and defect domains (Akers et al. 2021). The current generation of microscopes generate vast amounts of data, surpassing the limits of effective manual analysis traditionally performed by domain experts (Spurgeon et al. 2021). While recent strides in machine learning have significantly enhanced the processing of large and intricate datasets acquired through electron microscopy, the prevalent use of proprietary software packages for initial data collection poses a challenge. In many cases, these software packages act as a ‘black box’, constraining user functionality and hindering the output of data in a format that is conducive to seamless integration into machine learning models. This work addresses these challenges by adapting HyperSpy, an open-source Python library, for the analysis and quantification of raw energy dispersive spectroscopy (EDS) data acquired through STEM. The modified HyperSpy code successfully facilitates user-defined segmentation of the data, enabling the integration of atomic %, weight %, and raw EDS spectra for each segmented region into an existing few-shot machine learning model. While initial results reveal discrepancies in quantified atomic and weight percentages when compared to proprietary software, ongoing efforts aim to rectify this issue by refining the fit of the HyperSpy model to the EDS spectra. Overall, this research underscores the potential of open-source tools like HyperSpy to enhance the accessibility of analytical tools, fostering a transparent and user-friendly environment for seamlessly incorporating electron microscopy data into machine learning models.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Deep learning for electron and scanning probe microscopy: From materials design to atomic fabrication

Machine learning and artificial intelligence (ML/AI) are rapidly becoming an indispensable part of physics research, with applications ranging from theory and materials prediction to high-throughput data analysis. In parallel, the recent successes in applying ML/AI methods for autonomous systems from robotics through self-driving cars to organic and inorganic synthesis are generating enthusiasm for the potential of these techniques to enable automated and autonomous experiment in imaging. Here, we discuss recent progress in application of machine learning methods in scanning transmission electron microscopy and scanning probe microscopy, from applications such as data compression and exploratory data analysis to physics learning to atomic fabrication.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Fractal analysis on Ag 2 O thin film using a data-driven approach

The synthesis of fractal Ag oxide (Ag 2 O) on the surface of Ag thin film has been achieved at room temperature by using Synchrotron X-ray irradiation. We have performed an automated quantitative analysis of a batch of 1879 fractal Ag 2 O patterns in a scanning electron microscopy (SEM) image within a radius of 2000 mm outward from the center of the X-ray beam. The morphology is similar to that of the diffusion-limited cluster aggregation (DLCA) model. The fractal dimension (D) of Ag 2 O is between 1.7 and 1.5 from the center to the edge. The area distribution density of fractal Ag 2 O follows a quadratic function with radius R. It is found that the branches’ number of fractal Ag 2 O is a key factor affecting the fractal dimension. The more branches the fractal has, the greater the D is. This is the first time that Ag fractal has been investigated by combining automated data analysis methods with batch experimental data. This data-driven approach provides a new research perspective for rationally regulating materials’ fractal morphology and performance.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Spectro-Microscopic Analysis of Soot Particle Composition and Source Attribution

Ambient soot particles significantly impact Earth’s radiative balance, human health, and atmospheric visibility. Their microstructural properties depend on formation and aging mechanisms, which vary by emission source and atmospheric processes. Hence, accurately identifying sources of soot enhances our understanding of their physicochemical properties and atmospheric implications. This study used a multi-modal approach to characterize and attribute sources of submicron soot particles collected in Israel during new particle formation events, biomass burning episodes, and background atmospheric conditions. Synchrotron-based X-ray microscopy was used to map soot (elemental carbon), organic carbon, and inorganic species. Implemented atomic force microscopy showed highly diverse phase states, with soot consistently exhibiting a solid-like phase. Automated µ-Raman analysis was subsequently performed on ~690 particles, identifying three soot classes based on spectral features corresponding to the "Defect" (D) and "Graphite" (G) bands of soot. We applied two-peak and five-peak fitting approaches to deconvolute the “Defect” peaks (D1, D2, D3, and D4) and G band from average Raman, revealing varying degrees of graphitic order. The degree of graphitic order was determined from metrics such as the D3 peak area, often observed when soot was internally mixed with organic material. Raman spectral features, along with temporal variations in particle classes contributions, suggest that Particle Type 1 corresponds to traffic related soot and Particle Type 2 to less graphitic soot from biomass burning, while Particle Type 3 is associated with more heterogeneous particulate representative of soot-OC mixtures emitted during new particle formation and biomass burning episodes.

Rivera-Adorno, Felipe (ORCID:0000000273557999)↗
NASA NTRS2004

Light Microscopy Module Imaging Tested and Demonstrated

The Fluids Integrated Rack (FIR), a facility-class payload, and the Light Microscopy Module (LMM), a subrack payload, are integrated research facilities that will fly in the U.S. Laboratory module, Destiny, aboard the International Space Station. Both facilities are being engineered, designed, and developed at the NASA Glenn Research Center by Northrop Grumman Information Technology. The FIR is a modular, multiuser scientific research facility that is one of two racks that make up the Fluids and Combustion Facility (the other being the Combustion Integrated Rack). The FIR has a large volume dedicated for experimental hardware; easily reconfigurable diagnostics, power, and data systems that allow for unique experiment configurations; and customizable software. The FIR will also provide imagers, light sources, power management and control, command and data handling for facility and experiment hardware, and data processing and storage. The first payload in the FIR will be the LMM. The LMM integrated with the FIR is a remotely controllable, automated, on-orbit microscope subrack facility, with key diagnostic capabilities for meeting science requirements--including video microscopy to observe microscopic phenonema and dynamic interactions, interferometry to make thin-film measurements with nanometer resolution, laser tweezers to manipulate micrometer-sized particles, confocal microscopy to provide enhanced three-dimensional visualization of structures, and spectrophotometry to measure the photonic properties of materials. Vibration disturbances were identified early in the LMM development phase as a high risk for contaminating the science microgravity environment. An integrated FIR-LMM test was conducted in Glenn's Acoustics Test Laboratory to assess mechanical sources of vibration and their impact to microscopic imaging. The primary purpose of the test was to characterize the LMM response at the sample location, the x-y stage within the microscope, to vibration emissions from the FIR and LMM support structures.

Gati, Frank↗
DOE OSTI2022

Exploring Physics of Ferroelectric Domain Walls in Real Time: Deep Learning Enabled Scanning Probe Microscopy

The functionality of ferroelastic domain walls in ferroelectric materials is explored in real-time via the in situ implementation of computer vision algorithms in scanning probe microscopy (SPM) experiment. The robust deep convolutional neural network (DCNN) is implemented based on a deep residual learning framework (Res) and holistically nested edge detection (Hed), and ensembled to minimize the out-of-distribution drift effects. The DCNN is implemented for real-time operations on SPM, converting the data stream into the semantically segmented image of domain walls and the corresponding uncertainty. Further the pre-defined experimental workflows perform piezoresponse spectroscopy measurement on thus discovered domain walls, and alternating high- and low-polarization dynamic (out-of-plane) ferroelastic domain walls in a PbTiO 3 (PTO) thin film and high polarization dynamic (out-of-plane) at short ferroelastic walls (compared with long ferroelastic walls) in a lead zirconate titanate (PZT) thin film is reported. This work establishes the framework for real-time DCNN analysis of data streams in scanning probe and other microscopies and highlights the role of out-of-distribution effects and strategies to ameliorate them in real time analytics.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Adaptively driven X-ray diffraction guided by machine learning for autonomous phase identification

Machine learning (ML) has become a valuable tool to assist and improve materials characterization, enabling automated interpretation of experimental results with techniques such as X-ray diffraction (XRD) and electron microscopy. Because ML models are fast once trained, there is a key opportunity to bring interpretation in-line with experiments and make on-the-fly decisions to achieve optimal measurement effectiveness, which creates broad opportunities for rapid learning and information extraction from experiments. Here, we demonstrate such a capability with the development of autonomous and adaptive XRD. By coupling an ML algorithm with a physical diffractometer, this method integrates diffraction and analysis such that early experimental information is leveraged to steer measurements toward features that improve the confidence of a model trained to identify crystalline phases. We validate the effectiveness of an adaptive approach by showing that ML-driven XRD can accurately detect trace amounts of materials in multi-phase mixtures with short measurement times. The improved speed of phase detection also enables in situ identification of short-lived intermediate phases formed during solid-state reactions using a standard in-house diffractometer. Our findings showcase the advantages of in-line ML for materials characterization and point to the possibility of more general approaches for adaptive experimentation.

36 MATERIALS SCIENCE↗
NASA NTRS2004

Fossil Signatures Using Elemental Abundance Distributions and Bayesian Probabilistic Classification

Elemental abundances (C6, N7, O8, Na11, Mg12, Al3, P15, S16, Cl17, K19, Ca20, Ti22, Mn25, Fe26, and Ni28) were obtained for a set of terrestrial fossils and the rock matrix surrounding them. Principal Component Analysis extracted five factors accounting for the 92.5% of the data variance, i.e. information content, of the elemental abundance data. Hierarchical Cluster Analysis provided unsupervised sample classification distinguishing fossil from matrix samples on the basis of either raw abundances or PCA input that agreed strongly with visual classification. A stochastic, non-linear Artificial Neural Network produced a Bayesian probability of correct sample classification. The results provide a quantitative probabilistic methodology for discriminating terrestrial fossils from the surrounding rock matrix using chemical information. To demonstrate the applicability of these techniques to the assessment of meteoritic samples or in situ extraterrestrial exploration, we present preliminary data on samples of the Orgueil meteorite. In both systems an elemental signature produces target classification decisions remarkably consistent with morphological classification by a human expert using only structural (visual) information. We discuss the possibility of implementing a complexity analysis metric capable of automating certain image analysis and pattern recognition abilities of the human eye using low magnification optical microscopy images and discuss the extension of this technique across multiple scales.

Hoover, Richard B.↗
DOE OSTI2022

Dynamic Measurements of the Structural Evolution of Material Defects at the Mesoscale

This is a technical report to be published as part of the FY2021 annual overview package. We have designed experiments and developed analytical methods using images from x-ray and electron microscopy in order to quantify the behavior of crystal dislocation defects at their native nanometer-length and micro-length scales. The results of these analyses are used to directly inform theoretical physics models and guide interpretation of dark field x-ray microscopy (DFXM) images that offer spatial resolution surpassing the resolution of beamline optics. Additionally, we developed new analytical methods to automate the alignment of optics hardware used in both synchrotron and x-ray free electron laser beamline facilities. The tools and workflows developed for this project are now being deployed as proof-of-concept in reaction history analysis (RHA) for future programmatic integration.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗