Engineering Papers⌕ Search

Engineering topics

Park, Chiwoo

Publications and source records attributed to Park, Chiwoo.

Data association algorithm for large-scale multi-object tracking with complex interactions

We present an online multi-object tracking algorithm to track multiple objects across a large number of image frames. Our work is motivated by the need to study evolution of nanoscale objects by transmission electron microscopy. The proposed approach is based on the existing multi-way data association tracking algorithm that is capable of tracking interacting objects with complex behaviors (i.e., merge, split, overlap, and appearance or disappearance). The multi-way data association is an offline algorithm to associate objects across all image frames at one step with a global optimization, which does not scale very well for large number of image frames. The proposed online tracking algorithm processes image frames as they arrive by detecting all objects in the newly arrived image frame and making the associations of the objects to those detected from the previous frame by the multi-way data association. This frameby-frame association scheme can cause fragmented traces of the objects that are occasionally misdetected for some image frames. We overcome this issue by allowing previously unassociated objects to be associated when the objects reappear within a fixed number of future image frames, namely the frame-delayed association. We combine the multi-way data association with the frame-delayed association to be able to track interacting objects with accurate handling of object disappearance events. The proposed method is validated through applications to simulated multi-object tracking problem and a real multi-object tracking problem. Here, the outcome of the proposed method is compared with four state-of-the-art algorithms.

36 MATERIALS SCIENCE↗

Autonomous experimentation systems for materials development: A community perspective

Solutions to many of the world's problems depend upon materials research and development. However, advanced materials can take decades to discover and decades more to fully deploy. Humans and robots have begun to partner to advance science and technology orders of magnitude faster than humans do today through the development and exploitation of closed-loop, autonomous experimentation systems. This review discusses the specific challenges and opportunities related to materials discovery and development that will emerge from this new paradigm. Our perspective incorporates input from stakeholders in academia, industry, government laboratories, and funding agencies. We outline the current status, barriers, and needed investments, culminating with a vision for the path forward. We intend the article to spark interest in this emerging research area and to motivate potential practitioners by illustrating early successes. We also aspire to encourage a creative reimagining of the next generation of materials science infrastructure. To this end, we frame future investments in materials science and technology, hardware and software infrastructure, artificial intelligence and autonomy methods, and critical workforce development for autonomous research.

36 MATERIALS SCIENCE↗

Directional Statistics of Preferential Orientations of Two Shapes in Their Aggregate and Its Application to Nanoparticle Aggregation

Nanoscientists have long conjectured that adjacent nanoparticles aggregate with one another in certain preferential directions during chemical syntheses of nanoparticles, which is so called the oriented attachment. For the study of the oriented attachment phenomenon, the microscopy and nanoscience community have used dynamic electron microscopy for direct observations of nanoparticle aggregation and have been so far relying on the manual and qualitative analysis of the observations. In this paper, we present a statistical approach for studying the oriented attachment phenomenon with multiple aggregation examples observed by dynamic microscope data. We abstract a nanoparticle aggregation by an event of two primary geometric objects merging into a secondary geometric object. We define a metric space for geometrical bodies, and the endowed metric in the space allows us to define the likelihood function of the orientation angles of two primary objects within the corresponding secondary object. We maximize the likelihood to estimate the orientation angles. We fit a mixture of bivariate von Mises distributions to the estimated orientation angles for the density estimation. By analyzing the density estimate, we are able to demonstrate that nanoparticles of certain geometries have indeed preferential orientations in their aggregates.

Mixture of bivariate von Mises distributions, Bi-a↗

The role of electron irradiation history in liquid cell transmission electron microscopy

In situ liquid cell transmission electron microscopy (LC-TEM) allows dynamic nanoscale characterization of systems in a hydrated state. Although powerful, this technique remains impaired by issues of repeatability that limit experimental fidelity and hinder the identification and control of some variables underlying observed dynamics. We detail new LC-TEM devices that improve experimental reproducibility by expanding available imaging area and providing a platform for investigating electron flux history on the sample. Irradiation history is an important factor influencing LC-TEM results that has, to this point, been largely qualitatively and not quantitatively described. We use these devices to highlight the role of cumulative electron flux history on samples from both nanoparticle growth and biological imaging experiments and demonstrate capture of time zero, low-dose images on beam-sensitive samples. In particular, the ability to capture pristine images of biological samples, where the acquired image is the first time that the cell experiences significant electron flux, allowed us to determine that nanoparticle movement compared to the cell membrane was a function of cell damage and therefore an artifact rather than visualizing cell dynamics in action. Lastly, these results highlight just a subset of the new science that is accessible with LC-TEM through the new multiwindow devices with patterned focusing aides.

59 BASIC BIOLOGICAL SCIENCES↗

Two-level structural sparsity regularization for identifying lattices and defects in noisy images

Here, this paper presents a regularized regression model with a two-level structural sparsity penalty applied to locate individual atoms in a noisy scanning transmission electron microscopy image (STEM). In crystals, the locations of atoms is symmetric, condensed into a few lattice groups. Therefore, by identifying the underlying lattice in a given image, individual atoms can be accurately located. We propose to formulate the identification of the lattice groups as a sparse group selection problem. Furthermore, real atomic scale images contain defects and vacancies, so atomic identification based solely on a lattice group may result in false positives and false negatives. To minimize error, model includes an individual sparsity regularization in addition to the group sparsity for a within-group selection, which results in a regression model with a two-level sparsity regularization. We propose a modification of the group orthogonal matching pursuit (gOMP) algorithm with a thresholding step to solve the atom finding problem. The convergence and statistical analyses of the proposed algorithm are presented. The proposed algorithm is also evaluated through numerical experiments with simulated images. The applicability of the algorithm on determination of atom structures and identification of imaging distortions and atomic defects was demonstrated using three real STEM images. In conclusion, we believe this is an important step toward automatic phase identification and assignment with the advent of genomic databases for materials.

36 MATERIALS SCIENCE↗

Directly Observing Micelle Fusion and Growth in Solution by Liquid-Cell Transmission Electron Microscopy

Amphiphilic small molecules and polymers form commonplace nanoscale macromolecular compartments and bilayers, and as such are truly essential components in all cells and in many cellular processes. The nature of these architectures, including their formation, phase changes, and stimuli-response behaviors, is necessary for the most basic functions of life, and over the past half-century, these natural micellar structures have inspired a vast diversity of industrial products, from biomedicines to detergents, lubricants, and coatings. The importance of these materials and their ubiquity have made them the subject of intense investigation regarding their nanoscale dynamics with increasing interest in obtaining sufficient temporal and spatial resolution to directly observe nanoscale processes. However, the vast majority of experimental methods involve either bulk-averaging techniques including light, neutron, and X-ray scattering, or are static in nature including even the most advanced cryogenic transmission electron microscopy techniques. Here, we employ in situ liquid-cell transmission electron microscopy (LCTEM) to directly observe the evolution of individual amphiphilic block copolymer micellar nanoparticles in solution, in real time with nanometer spatial resolution. These observations, made on a proof-of-concept bioconjugate polymer amphiphile, revealed growth and evolution occurring by unimer addition processes and by particle-particle collision-and-fusion events. In conclusion, the experimental approach, combining direct LCTEM observation, quantitative analysis of LCTEM data, and correlated in silico simulations, provides a unique view of solvated soft matter nanoassemblies as they morph and evolve in time and space, enabling us to capture these phenomena in solution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The Impact of Li Grain Size on Coulombic Efficiency in Li Batteries

One of the most promising means to increase the energy density of state-of-the-art lithium (Li)-ion batteries is to replace the graphite anode with a Li metal anode1, 2, 3. While the direct use of Li metal may be highly advantageous4,5, at present its practical application is limited by issues related to dendrite growth and low Coulombic efficiency (CE)6. Here operando electrochemical scanning transmission electron microscopy (STEM) is used to directly image the deposition/stripping of Li at the anode-electrolyte interface in a Li-based battery. A non-aqueous electrolyte containing small amounts of H 2 O as an additive results in remarkably different deposition/stripping properties as compared to the "dry" electrolyte when operated under identical electrochemical conditions. The electrolyte with the additive deposits more Li during the first cycle, with the grain sizes of the Li deposits being significantly larger and more variable. Here, the stripping of the Li upon discharge is also more complete, i.e., there is a higher cycling CE. This suggests that larger grain sizes are indicative of better performance by leading to more uniform Li deposition and an overall decrease in the formation of Li dendrites and side reactions with electrolyte components, thus potentially paving the way for the direct use of Li metal in battery technologies.

25 ENERGY STORAGE↗

Understanding the Role of Solvation Forces on the Preferential Attachment of Nanoparticles in Liquid

Optimization of colloidal nanoparticle synthesis techniques requires an understanding of underlying particle growth mechanisms. Non-classical growth mechanisms are particularly important as they affect nanoparticle size and shape distributions which in turn influence functional properties. For example, preferential attachment of nanoparticles is known to lead to the formation of mesocrystals, although the formation mechanism is currently not well understood. Here we employ in situ liquid cell scanning transmission electron microscopy (STEM) and steered molecular dynamics (SMD) simulations to demonstrate that the experimentally observed preference for end-to-end attachment of silver nanorods is a result of weaker solvation forces occurring at rod ends. SMD reveals that when the side of a nanorod approaches another rod, perturbation in the surface bound water at the nanorod surface creates significant energy barriers to attachment. Additionally, rod morphology (i.e. facet shape) effects can explain the majority of the side attachment effects that are observed experimentally.

Environmental Molecular Sciences Laboratory↗

Quantification of Electrochemical Nanoscale Processes in Lithium Batteries By OperandoEC-(S)TEM

Lithium (Li)-ion batteries are currently used for a wide variety of portable electronic devices, electric vehicles and renewable energy applications. In addition, extensive worldwide research efforts are now being devoted to more advanced “beyond Li-ion” battery chemistries - such as lithium-sulfur (Li-S) and lithium-air (Li-O2) - in which the carbon anode is replaced with Li metal. However, the practical application of Li metal anode systems has been highly problematic. The main challenges involve controlling the formation of a solid-electrolyte interphase (SEI) layer and the suppression of Li dendrite growth during the charge/discharge process (achieving “dendrite-free” cycling). The SEI layer formation continuously consumes the electrolyte components creating highly resistive layer, which leads to the rapid decrease of cycling performance and degradation of the Li anode. The growth of Li metal dendrites at the anode contributes to rapid capacity fading (the presence of “dead Li” created during the discharge leads to an increased overpotential) and, in the case of continuous growth, leads to internal short circuits and extreme safety issues. Here we demonstrate the application of an operando electrochemical scanning transmission electron microscopy (ec-(S)TEM) cell to study the SEI layer formation and the initial stages of Li dendrite growth - the goal is to develop a mechanism for mitigating the degradation processes and increasing safety. Bright field (BF) STEM images in Figure 1 A-C show Li metal deposition and dissolution processes at the interface between the Pt working electrode and the lithium hexafluorophosphate (LiPF6) in propylene carbonate (PC) electrolyte during three charge/discharge cycles. A contrast reversal caused by Li metal being lighter/less dense than surrounding electrolyte (Li appears brighter than the background in BF STEM images) allows Li to be uniquely identified from the other components in the system - the only solid material that is less dense than the electrolyte is Li metal. Using these images, we can precisely quantify the total volume of Li deposition, the thickness of the SEI layer (observed as a ring of positive contrast around the electrode) and alloy formation due to Li+ ion insertion during each cycle. Furthermore, at the end of each discharge cycle we can quantify the presence of “dead Li” detached from the Pt electrode, thereby demonstrating the degree of irreversibility (and degradation of Pt electrode) associated with insertion/removal of Li+during this process with direct correlation to electrochemical performance. Such analyses provide significant insights into Li metal dendrite growth, which is critical to understand the complex interfacial reactions needed to be controlled for future Li-based and next generation energy storage systems.

batteries↗

Observing the Growth of Metal-Organic Frameworks by In-Situ Liquid Cell Transmission Electron Microscopy

Liquid Cell Transmission Electron Microscopy (LCTEM) can provide direct observations of solution phase nanoscale materials, and holds great promise as a tool for monitoring dynamic self assembly processes. Control over particle behavior within the liquid cell, and under electron beam irradiation, is of paramount importance for this technique to contribute to our understanding of chemistry and materials science at the nanoscale. However, this type of control has not been demonstrated for complex, organic macromolecular materials, which form the basis for all biological systems, all of polymer science, and encompass important classes of advanced porous materials. Here we show that by controlling the liquid cell surface chemistry and electron beam effects, the dynamics and self-assembly of metal-organic frameworks (MOFs) can be observed. Our results demonstrate that hybrid organic/inorganic beam sensitive materials can be analyzed with LCTEM and at least in the case of Zif-8 dynamics, the results correlate with observations from bulk growth or other standard synthetic conditions. We anticipate that direct, nanoscale imaging by LCTEM of MOF nucleation and growth mechanisms, may provide insight into controlled MOF crystal morphology, domain composition, and processes influencing defect formation.

Environmental Molecular Sciences Laboratory↗

Observation and Quantification of Nanoscale Processes in Lithium Batteries by Operando Electrochemical (S)TEM

An operando electrochemical stage for the transmission electron microscope has been configured to form a “Li battery” that is used to quantify the electrochemical processes that occur at the anode during charge/discharge cycling. Of particular importance for these observations is the identification of an image contrast reversal that originates from solid Li being less dense than the surrounding liquid electrolyte and electrode surface. This contrast allows Li to be identified from Li containing compounds that make up the solid-electrolyte interphase (SEI) layer. By correlating images showing the sequence of Li electrodeposition and the evolution of the SEI layer with simultaneously acquired and calibrated cyclic voltammograms (CV), electrodeposition and electrolyte breakdown processes can be quantified directly on the nanoscale. This approach opens up intriguing new possibilities to rapidly visualize and test the electrochemical performance of a wide range of electrode/electrolyte combinations for next generation battery systems.

Environmental Molecular Sciences Laboratory↗

Minimum Cost Multi-way Data Association for Optimizing Multitarget Tracking of Interacting Objects

This paper presents a general formulation for a minimum cost data association problem which associates data features via one-to-one, m-to-one and one-to-n links with minimum total cost of the links. A motivating example is a problem of tracking multiple interacting nanoparticles imaged on video frames, where particles can aggregate into one particle or a particle can be split into multiple particles. Many existing multitarget tracking methods are capable of tracking non-interacting targets or tracking interacting targets of restricted degrees of interactions. The proposed formulation solves a multitarget tracking problem for general degrees of inter-object interactions. The formulation is in the form of a binary integer programming problem. We propose a polynomial time solution approach that can obtain a good relaxation solution of the binary integer programming, so the approach can be applied for multitarget tracking problems of a moderate size (for hundreds of targets over tens of time frames). The resulting solution is always integral and obtains a better duality gap than the simple linear relaxation solution of the corresponding problem. The proposed method was validated through applications to simulated multitarget tracking problems and a real multitarget tracking problem.

Binary Integer Programming↗

Probing the Degradation Mechanisms in Electrolyte Solutions for Li-ion Batteries by In-Situ Transmission Electron Microscopy

One of the goals in the development of new battery technologies is to find new electrolytes with increased electrochemical stability. In-situ (scanning) transmission electron microscopy ((S)TEM) using an electrochemical fluid cell provides the ability to rapidly and directly characterize electrode/electrolyte interfacial reactions under battery relevant electrochemical conditions. Furthermore, as the electron beam itself causes a localized electrochemical reaction when it interacts with the electrolyte, the breakdown products that occur during the first stages of battery operation can potentially be simulated and characterized using a straightforward in-situ liquid stage (without electrochemical biasing capabilities). In this paper, we have studied the breakdown of a range of inorganic/salt complexes that are used in state-of-the-art Li-ion battery systems. The results of the in-situ (S)TEM experiments matches with previous stability tests performed during battery operation and the breakdown products and mechanisms are also consistent with known mechanisms. This analysis indicates that in-situ liquid stage (S)TEM observations can be used to directly test new electrolyte designs and provide structural insights into the origin of the solid electrolyte interphase (SEI) formation mechanism.

25 ENERGY STORAGE↗

Direct Observation of Aggregative Nanoparticle Growth: Kinetic Modeling of the Size Distribution and Growth Rate

Direct observations of solution-phase nanoparticle growth using in situ liquid transmission electron microscopy (TEM) have demonstrated the importance of “non-classical” growth mechanisms, such as aggregation and coalescence, on the growth and final morphology of nanocrystals at the atomic and single nanoparticle scales. To date, groups have quantitatively interpreted the mean growth rate of nanoparticles in terms of the Lifshitz-Slyozov-Wagner (LSW) model for Ostwald ripening, but less attention has been paid to modeling the corresponding particle size distribution. Here we use in situ fluid stage scanning TEM to demonstrate that silver nanoparticles grow by a length-scale dependent mechanism, where individual nanoparticles grow by monomer attachment but ensemble-scale growth is dominated by aggregation. Although our observed mean nanoparticle growth rate is consistent with the LSW model, we show that the corresponding particle size distribution is broader and more symmetric than predicted by LSW. Following direct observations of aggregation, we interpret the ensemble-scale growth using Smoluchowski kinetics and demonstrate that the Smoluchowski model quantitatively captures the mean growth rate and particle size distribution.

77 NANOSCIENCE AND NANOTECHNOLOGY↗