The Differential Image Transform: Using Image Processing to Verify Printed Circuit Boards.
Abstract not provided.
Bowman, David↗
SEARCH · Engineering Papers
Results for “Image Transforms”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Advanced Photovoltaic Module Characterization: Using Image Transformers for Current–Voltage Curve Prediction From Electroluminescence Images
Individual photovoltaic (PV) module health monitoring can be a daunting task for operation and maintenance of solar farms. Modules can be inspected through luminescence, thermal imaging, and current–voltage (I–V) curve analyzes for identification of damage and power loss. I–V curves provide easily interpretable data to determine module health as they directly provide electrical performance metrics. However, in order to obtain these curves, modules must be disconnected from the array and either removed to a solar simulator or characterized in situ with corrections for module temperature, the incident solar spectrum, and intensity. Luminescence or thermal images of a module are relatively easy to acquire in situ. Electroluminescence (EL) images highlight physical defects in the modules but do not provide easily interpretable features to correlate with electrical performance. This work presents a SWin transformer network to predict I–V curves for PV modules from their corresponding EL images. The predicted I–V curves allow the accurate prediction of the maximum power point (MPP), short-circuit current I sc , and open-circuit voltage V oc with a mean error less of than 1%. Comparing single diode model (SDM) parameters extracted from the predicted curves to those extracted from the true curves, the series resistance R s demonstrates a mean error of 5.19%, and the photocurrent I a mean error of 0.197%. The shunt resistance R sh and dark current Io parameters are predicted with larger errors because of their sensitivity to small changes in the I–V curve.
Byford, Brandon K. [New Mexico State Univ., Las Cr↗
Image transformers for classifying acute lymphoblastic leukemia
Cancer is the leading cause of death by disease in American children. Each year, nearly 16,000 children in the United States and over 300,000 children globally are diagnosed with cancer. Leukemia is a form of blood cancer that originates in the bone marrow and accounts for one-third of pediatric cancers. This disease occurs when the bone marrow contains 20% or more immature white blood cell blasts. Acute lymphoblastic leukemia is the most prevalent leukemia type found in children, with half of all annual cases in the U.S. diagnosed for subjects under 20 years of age. To diagnose acute lymphoblastic leukemia, pathologists often conduct a morphological bone marrow assessment. This assessment determines whether the immature white blood cell blasts in bone marrow display the correct morphological characteristics, such as size and appearance of nuclei. Pathologists also use immunophenotyping via multi-channel flow cytometry to test whether certain antigens are present on the surface of blast cells; the antigens are used to identify the cell lineage of acute lymphoblastic leukemia. These manual processes require well-trained personnel and medical professionals, thus being costly in time and expenses. Computerized decision support via machine learning can accelerate the diagnosis process and reduce the cost. Training a reliable classification model to distinguish between mature and immature white blood cells is essential to the decision support system. Here, we adopted the Vision Transformer model to classify white blood cells. The Vision Transformer achieved superb classification performance compared to state-of-the-art convolutional neural networks while requiring less computational resources for training. Additionally, the latent self-attention architecture provided attention maps for a given image, providing clues as to which portion(s) of the image were significant in decision-making. We applied the Vision Transformer model and a convolutional neural network model to an acute lymphoblastic leukemia classification dataset of 12,528 samples and achieved accuracies of 88.4% and 86.2%.
Cho, Priscilla↗
Efficient Distributed Sequence Parallelism for Transformer-Based Image Segmentation
We introduce an efficient distributed sequence parallel approach for training transformer-based deep learning image segmentation models. The neural network models are comprised of a combination of a Vision Transformer encoder with a convolutional decoder to provide image segmentation mappings. The utility of the distributed sequence parallel approach is especially useful in cases where the tokenized embedding representation of image data are too large to fit into standard computing hardware memory. To demonstrate the performance and characteristics of our models trained in sequence parallel fashion compared to standard models, we evaluate our approach using a 3D MRI brain tumor segmentation dataset. We show that training with a sequence parallel approach can match standard sequential model training in terms of convergence. Furthermore, we show that our sequence parallel approach has the capability to support training of models that would not be possible on standard computing resources.
Lyngaas, Isaac↗
Complex-valued universal linear transformations and image encryption using spatially incoherent diffractive networks
As an optical processor, a diffractive deep neural network (D2NN) utilizes engineered diffractive surfaces designed through machine learning to perform all-optical information processing, completing its tasks at the speed of light propagation through thin optical layers. With sufficient degrees of freedom, D2NNs can perform arbitrary complex-valued linear transformations using spatially coherent light. Similarly, D2NNs can also perform arbitrary linear intensity transformations with spatially incoherent illumination; however, under spatially incoherent light, these transformations are nonnegative, acting on diffraction-limited optical intensity patterns at the input field of view. Here, we expand the use of spatially incoherent D2NNs to complex-valued information processing for executing arbitrary complex-valued linear transformations using spatially incoherent light. Through simulations, we show that as the number of optimized diffractive features increases beyond a threshold dictated by the multiplication of the input and output space-bandwidth products, a spatially incoherent diffractive visual processor can approximate any complex-valued linear transformation and be used for all-optical image encryption using incoherent illumination. The findings are important for the all-optical processing of information under natural light using various forms of diffractive surface-based optical processors.
36 MATERIALS SCIENCE↗
Transforming Electroluminescence Images to Current-Voltage (IV) Curves Using Deep Learning
Presentation for 2024 PVSC 52 on EL images to IV curves
Byford, Brandon Kyle↗
Transforming Electroluminescence Images to Current-Voltage (IV)Curves Using Deep Learning
3 page evaluation abstract for PVSC 52
Byford, Brandon Kyle↗
Sequence length scaling in vision transformers for scientific images on frontier
Vision Transformers (ViTs) are pivotal for foundational models in scientific imagery, including Earth science applications, due to their capability to process large sequence lengths. While transformers for text have inspired scaling sequence lengths in ViTs, adapting these for ViTs introduces unique challenges. We develop distributed sequence parallelism for ViTs, enabling them to handle up to 1M tokens. Our approach, leveraging DeepSpeed-Ulysses and Long-Sequence-Segmentation with model sharding, is the first to apply sequence parallelism in ViT training, achieving a 94% batch scaling efficiency on 2,048 AMD-MI250X GPUs. Evaluating sequence parallelism in ViTs, particularly in models up to 10B parameters, highlighted substantial bottlenecks. We countered these with hybrid sequence, pipeline, and flash attention strategies, to scale beyond single GPU memory limits. Our method significantly enhances climate modeling accuracy by 20% in temperature predictions, marking the first training of a vision transformer model to convergence with a sequence length of 188K tokens, using full self-attention.
Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
Adaptive Patching for High-resolution Image Segmentation with Transformers
Attention-based models are proliferating in the space of image analytics, including segmentation. The standard method of feeding images to transformer encoders is to divide the images into patches and then feed the patches to the model as a linear sequence of tokens. For high-resolution images, e.g. microscopic pathology images, the quadratic compute and memory cost prohibits the use of an attention-based model, if we are to use smaller patch sizes that are favorable in segmentation. The solution is to either use custom complex multi-resolution models or approximate attention schemes. We take inspiration from Adapative Mesh Refinement (AMR) methods in HPC by adaptively patching the images, as a pre-processing step, based on the image details to reduce the number of patches being fed to the model, by orders of magnitude. This method has a negligible overhead, and works seamlessly with any attention-based model, i.e. it is a pre-processing step that can be adopted by any attention-based model without friction. We demonstrate superior segmentation quality over SoTA segmentation models for realworld pathology datasets while gaining a geomean speedup of 6.9× for resolutions up to 64K2, on up to 2, 048 GPUs.
Zhang, Enzhi↗
Device and method for constructing and displaying high quality images from imaging data by transforming a data structure utilizing machine learning techniques
Constructing a computer image from raw imaging data or encoded imaging data by transforming a first data structure in which the raw imaging data or the encoded imaging data is stored into a second data structure storing reorganized imaging data. The raw imaging data or the encoded imaging data is received, stored in the first data structure. The computer reorganizes the raw imaging data or the encoded imaging data into the reorganized data and stores the reorganized data in the second data structure, which is a multi-dimensional array having subarrays containing local information needed by a convolutional neural network for processing the reorganized data. Other portions of the multi-dimensional array store other portions of the raw imaging data or the encoded imaging data. The computer also processes the reorganized data using the convolutional neural network to construct the image, whereby a constructed image is formed.
Korbin, John P.↗
Comparative Analysis of Radial and Random Microstructures of Mesophase Pitch Carbon Fibers
Carbon fibers (CF) with radial and random microstructures are produced. Here, these fibers are subjected to identical treatment before being mechanically tested and analyzed with Weibull analysis, with the results revealing a statistically significant difference in tensile strengths of 2.23 GPa for random CF and 1.69 GPa for radial CF. Raman mapping probed the crystalline structure perpendicular to the fiber axis and found a uniform structure, while wide‐angle X‐ray diffraction showed a significant difference of 7.5 Å in the crystallites’ basal lengths parallel to the fiber. Small‐angle X‐ray scattering is completed parallel to the fiber for the first time. A cross‐section Guinier plot of the 1D azimuthal integration is generated assuming symmetric scattering, and the parallel scatterers are found to have a similar length scale to the crystallite's length, validating the testing method. Finally, transmission electron microscopy is completed on the longitudinal cross‐section of each fiber. The radial carbon fiber is found to have a core–shell structure, as evidenced further by fast Fourier transform images. Through all studies, it is shown that the structure developed during mesophase pitch spinning altered the microstructure, thus impacting the mechanical properties, confirming a direct relationship between processing, structure, and properties.
Scherschel, Alexander [Univ. of Virginia, Charlott↗
Improving Non-Destructive Detection Technology Through SAVY Feature Detection
Surveillance of special nuclear material (SNM) storage containers is required by the DOE to assess their integrity across the Complex. This work aims to improve the task of container inspections by leveraging automation through machine learning (ML) tools to reduce the human-intensive effort and expert-level knowledge needed to assess container status. A field-deployable, non-destructive technology was designed using off-the-shelf components to collect multiple images from different perspectives of containers in storage to detect both spatial features of interest and anomalies of concern. Nine ML models were generated using unique training datasets and parameters. Learned features include SAVY surface regions including the body side wall, collar, lid, filter, and printed/etched information. Average Precision (AP) is used to calculate detection performance when both viewing previously seen environments and previously unseen environments. The application of image transformations and resolution scaling while training greatly improved the detection performance in unseen environments, and significantly increasing the number of computation iterations improved detection performance on previously seen environments. Additional capabilities were developed including the novel detection of procedural non-compliance and the ability to localize anomalies relative to SAVY surface features.
97 MATHEMATICS AND COMPUTING↗
Multimodal imaging of hemorrhagic transformation biomarkers in an ischemic stroke model.
Abstract Hemorrhagic transformation of ischemic stroke has devastating consequences, with high mortality and poor functional outcomes. Animal models of ischemic stroke also demonstrate the potential for hemorrhagic transformation, which complicates biochemical characterization, treatment studies, and hinders poststroke functional outcomes in affected subjects. The incidence of hemorrhagic transformation of ischemic stroke in animal model research is not commonly reported. The postmortem brain of such cases presents a complex milieu of biomarkers due to the presence of healthy cells, regions of varying degrees of ischemia, dead and dying cells, dysregulated metabolites, and blood components (especially reactive Fe species released from lysed erythrocytes). To improve the characterization of hemorrhage biomarkers on an ischemic stroke background, we have employed a combination of histology, X-ray fluorescence imaging (XFI), and Fourier transform infrared (FTIR) spectroscopic imaging to assess 122 photothrombotic (ischemic) stroke brains. Rapid freezing preserves brain biomarkers in situ and minimizes metabolic artifacts due to postmortem ischemia. Analysis revealed that 25% of the photothrombotic models had clear signs of hemorrhagic transformation. The XFI and FTIR metabolites provided a quantitative method to differentiate key metabolic regions in these models. Across all hemorrhage cases, it was possible to consistently differentiate otherwise healthy tissue from other metabolically distinct regions, including the ischemic infarct, the ischemic penumbra, blood vessels, sites of hemorrhage, and a region surrounding the hemorrhage core that contained elevated lipid oxidation. Chemical speciation of deposited Fe demonstrates the presence of heme-Fe and accumulation of ferritin.
Pushie, M. J. (ORCID:0000000174945427)↗
Imaging the Phase Transformation in Single Particles of Lithium Titanate Anode for Lithium-ion Batteries
Lithium uptake and release in lithium titanate (LTO) anode materials during a discharge and charge cycle is one of the fundamental processes of a Lithium-ion battery (LIB), still not fully understood at the microscopic level.During discharge cycle, LTO undergoes a phase transformation between Li 4 Ti 5 O 12 and Li 7 Ti 5 O 12 states within a cubic crystal lattice. To reveal the details of the microscopic mechanism,it is necessary to track the sequence of phase transformation sat different discharge/charge states under operating conditions.Here we use in-situ Bragg Coherent Diffraction Imaging (BCDI) and in-situ X-ray diffraction (XRD) experiments to examine the lithium insertion-induced materials phase transformation within a single LTO particle anda bulk battery analogue,respectively. BCDI analysis from (111) Bragg peak, shows the two-phase transformation manifesting as a distinct image phase modulation within a single LTO nanoparticle occurring in the middle of the discharge region then subsiding towards the end of the discharge cycle. We observe the biggest phase variation at the two-phase stage,indicating the formation of phase domains of 200 nm in size during the discharge process. Additionally, we also observe a lattice contraction of >0.2% in a single LTO nanoparticle at the (400) Bragg peak measurement, larger than that in the corresponding bulk material. Our observation of this phase transformation at a single particle level has implications for the understanding of the microscopic/mesoscale picture of the phase transformation in anode and cathode LIBs materials.
25 ENERGY STORAGE↗
Unsupervised machine learning discovery of structural units and transformation pathways from imaging data
We show that unsupervised machine learning can be used to learn chemical transformation pathways from observational Scanning Transmission Electron Microscopy (STEM) data. To enable this analysis, we assumed the existence of atoms, a discreteness of atomic classes, and the presence of an explicit relationship between the observed STEM contrast and the presence of atomic units. With only these postulates, we developed a machine learning method leveraging a rotationally invariant variational autoencoder (VAE) that can identify the existing molecular fragments observed within a material. The approach encodes the information contained in STEM image sequences using a small number of latent variables, allowing the exploration of chemical transformation pathways by tracing the evolution of atoms in the latent space of the system. The results suggest that atomically resolved STEM data can be used to derive fundamental physical and chemical mechanisms involved, by providing encodings of the observed structures that act as bottom-up equivalents of structural order parameters. The approach also demonstrates the potential of variational (i.e., Bayesian) methods in the physical sciences and will stimulate the development of more sophisticated ways to encode physical constraints in the encoder–decoder architectures and generative physical laws and causal relationships in the latent space of VAEs.
97 MATHEMATICS AND COMPUTING↗
Image Processing Pipeline for Fluoroelastomer Crystallite Detection in Atomic Force Microscopy Images
Phase transformations in materials systems can be tracked using atomic force microscopy (AFM), enabling the examination of surface properties and macroscale morphologies. In situ measurements investigating phase transformations generate large datasets of time-lapse image sequences. The interpretation of the resulting image sequences, guided by domain-knowledge, requires manual image processing using handcrafted masks. Here this approach is time-consuming and restricts the number of images that can be processed. Her in this study, we developed an automated image processing pipeline which integrates image detection and segmentation methods. We examine five time-series AFM videos of various fluoroelastomer phase transformations. The number of image sequences per video ranges from a hundred to a thousand image sequences. The resulting image processing pipeline aims to automatically classify and analyze images to enable batch processing. Using this pipeline, the growth of each individual fluoroelastomer crystallite can be tracked through time. We incorporated statistical analysis into the pipeline to investigate trends in phase transformations between different fluoroelastomer batches. Understanding these phase transformations is crucial, as it can provide valuable insights into manufacturing processes, improve product quality, and possibly lead to the development of more advanced fluoroelastomer formulations.
36 MATERIALS SCIENCE↗