Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Fusing Quantitative-Phase Imaging with Airy Light- Sheet Microscopy

We report the integration of quantitative-phase imaging (QPI) with light-sheet (LS) fluorescent microscopy on to a standard inverted microscope that retains compatibility with microfluidics. QPI enables label-free imaging and number-density quantification of single cells and their organelles. Conversely, LS yields considerable speed and phototoxicity gains in quantifying the 4D dynamics of gene-encoded fluorescent biomarkers. We will detail the system design that relied on spatial light interferometry for QPI and an accelerating Airy- beam light-sheet for fluorescence, its performance, as well as results of a representative multivariate imaging analysis of single-cell metabolism.

imaging, lattice light sheet, Yarrowia lipolytica,↗

Understanding kinetics of defect annihilation in chemoepitaxy-directed self-assembly.

Directed self-assembly (DSA) of block copolymers (BCP) has attracted considerable interest from the semiconductor industry because it can achieve semiconductor-relevant structures with a relatively simple process and low cost. However, the self-assembling structures can become kinetically trapped into defective states, which greatly impedes the implementation of DSA in high-volume manufacturing. Understanding the kinetics of defect annihilation is crucial to optimizing the process and eventually eliminating defects in DSA. Such kinetic experiments, however, are not commonly available in academic laboratories. To address this challenge, we perform a kinetic study of chemoepitaxy DSA in a 300 mm wafer fab, where the complete defectivity information at various annealing conditions can be readily captured. Through extensive statistical analysis, we reveal the statistical model of defect annihilation in DSA for the first time. The annihilation kinetics can be well described by a power law model, indicating that all dislocations can be removed by sufficiently long annealing time. We further develop image analysis algorithms to analyze the distribution of dislocation size and configurations and discover that the distribution stays relatively constant over time. The defect distribution is determined by the role of the guiding stripe, which is found to stabilize the defects. Although this study is based on polystyrene-b-poly(methyl methacrylate) (PS-b-PMMA), we anticipate that these findings can be readily applied to other BCP platforms as well.

block copolymer↗

Methods—Kintsugi Imaging of Battery Electrodes: Distinguishing Pores from the Carbon Binder Domain using Pt Deposition

The mesostructure of porous electrodes used in lithium-ion batteries strongly influences cell performance. Accurate imaging of the distribution of phases in these electrodes would allow this relationship to be better understood through simulation. However, imaging the nanoscale features in these components is challenging. While scanning electron microscopy is able to achieve the required resolution, it has well established difficulties imaging porous media. This is because the flat imaging planes prepared using focused ion beam milling will intersect with the pores, which makes the images hard to interpret as the inside walls of the pores are observed. It is common to infiltrate porous media with resin prior to imaging to help resolve this issue, but both the nanoscale porosity and the chemical similarity of the resins to the battery materials undermine the utility of this approach for most electrodes. In this study, a technique is demonstrated which uses in situ infiltration of platinum to fill the pores and thus enhance their contrast during imaging. Reminiscent of the Japanese art of repairing cracked ceramics with precious metals, this technique is referred to as the kintsugi method. The images resulting from applying this technique to a conventional porous cathode are presented and then segmented using a multi-channel convolutional method. We show that while some cracks in active material particles were empty, others appear to be filled (perhaps with the carbon binder phase), which will have implications for the rate performance of the cell. Energy dispersive X-ray spectroscopy was used to validate the distribution of phases resulting from image analysis, which also suggested a graded distribution of the binder relative to the carbon additive. The equipment required to use the kintsugi method is commonly available in major research facilities and so we hope that this method will be rapidly adopted to improve the imaging of electrode materials and porous media in general.

25 ENERGY STORAGE↗

Large-scale analysis of structural brain asymmetries in schizophrenia via the ENIGMA consortium

Left–right asymmetry is an important organizing feature of the healthy brain that may be altered in schizophrenia, but most studies have used relatively small samples and heterogeneous approaches, resulting in equivocal findings. We carried out the largest case–control study of structural brain asymmetries in schizophrenia, with MRI data from 5,080 affected individuals and 6,015 controls across 46 datasets, using a single image analysis protocol. Asymmetry indexes were calculated for global and regional cortical thickness, surface area, and subcortical volume measures. Differences of asymmetry were calculated between affected individuals and controls per dataset, and effect sizes were meta-analyzed across datasets. Small average case–control differences were observed for thickness asymmetries of the rostral anterior cingulate and the middle temporal gyrus, both driven by thinner left-hemispheric cortices in schizophrenia. Analyses of these asymmetries with respect to the use of antipsychotic medication and other clinical variables did not show any significant associations. Assessment of age- and sex-specific effects revealed a stronger average leftward asymmetry of pallidum volume between older cases and controls. Case–control differences in a multivariate context were assessed in a subset of the data (N = 2,029), which revealed that 7% of the variance across all structural asymmetries was explained by case–control status. Subtle case–control differences of brain macrostructural asymmetry may reflect differences at the molecular, cytoarchitectonic, or circuit levels that have functional relevance for the disorder. Reduced left middle temporal cortical thickness is consistent with altered left-hemisphere language network organization in schizophrenia.

60 APPLIED LIFE SCIENCES↗

Using Ultrasound Image Augmentation and Ensemble Predictions to Prevent Machine-Learning Model Overfitting

Deep learning predictive models have the potential to simplify and automate medical imaging diagnostics by lowering the skill threshold for image interpretation. However, this requires predictive models that are generalized to handle subject variability as seen clinically. Here, we highlight methods to improve test accuracy of an image classifier model for shrapnel identification using tissue phantom image sets. Using a previously developed image classifier neural network—termed ShrapML—blind test accuracy was less than 70% and was variable depending on the training/test data setup, as determined by a leave one subject out (LOSO) holdout methodology. Introduction of affine transformations for image augmentation or MixUp methodologies to generate additional training sets improved model performance and overall accuracy improved to 75%. Further improvements were made by aggregating predictions across five LOSO holdouts. This was done by bagging confidences or predictions from all LOSOs or the top-3 LOSO confidence models for each image prediction. Top-3 LOSO confidence bagging performed best, with test accuracy improved to greater than 85% accuracy for two different blind tissue phantoms. This was confirmed by gradient-weighted class activation mapping to highlight that the image classifier was tracking shrapnel in the image sets. Overall, data augmentation and ensemble prediction approaches were suitable for creating more generalized predictive models for ultrasound image analysis, a critical step for real-time diagnostic deployment.

60 APPLIED LIFE SCIENCES↗

Training Ultrasound Image Classification Deep-Learning Algorithms for Pneumothorax Detection Using a Synthetic Tissue Phantom Apparatus

Ultrasound (US) imaging is a critical tool in emergency and military medicine because of its portability and immediate nature. However, proper image interpretation requires skill, limiting its utility in remote applications for conditions such as pneumothorax (PTX) which requires rapid intervention. Artificial intelligence has the potential to automate ultrasound image analysis for various pathophysiological conditions. Training models require large data sets and a means of troubleshooting in real-time for ultrasound integration deployment, and they also require large animal models or clinical testing. Here, we detail the development of a dynamic synthetic tissue phantom model for PTX and its use in training image classification algorithms. The model comprises a synthetic gelatin phantom cast in a custom 3D-printed rib mold and a lung mimicking phantom. When compared to PTX images acquired in swine, images from the phantom were similar in both PTX negative and positive mimicking scenarios. We then used a deep learning image classification algorithm, which we previously developed for shrapnel detection, to accurately predict the presence of PTX in swine images by only training on phantom image sets, highlighting the utility for a tissue phantom for AI applications.

Boice, Emily N. (ORCID:0000000171802842)↗

Analysis of streaked images of x-ray self-emission in laser-driven spherical implosions

Imaging of x-ray self-emission provides a powerful in situ measurement of the spatial and temporal evolution of high-energy-density plasmas. However, interpretation of these measurements requires detailed understanding of the data-generating process. This work presents a case study in the interpretation of x-ray self-emission data for the specific application of streaked one-dimensional slit imaging of spherical laser-driven implosions. A comprehensive generative model of the streaked slit-imaging diagnostic is developed including detailed treatments of the radiation transfer, photometrics, and photostatistics associated with the measurement. The model is used to generate realistic synthetic streaked images and to analyze experimental streaked images to extract important physical quantities of interest. An example analysis of streaked images from implosion experiments on the OMEGA laser is presented, where the model developed in this work is used to constrain the trajectory and peak velocity of the implosion using Bayesian inference.

Bayesian inference↗

Imaging how thermal capillary waves and anisotropic interfacial stiffness shape nanoparticle supracrystals

Abstract Development of the surface morphology and shape of crystalline nanostructures governs the functionality of various materials, ranging from phonon transport to biocompatibility. However, the kinetic pathways, following which such development occurs, have been largely unexplored due to the lack of real-space imaging at single particle resolution. Here, we use colloidal nanoparticles assembling into supracrystals as a model system, and pinpoint the key role of surface fluctuation in shaping supracrystals. Utilizing liquid-phase transmission electron microscopy, we map the spatiotemporal surface profiles of supracrystals, which follow a capillary wave theory. Based on this theory, we measure otherwise elusive interfacial properties such as interfacial stiffness and mobility, the former of which demonstrates a remarkable dependence on the exposed facet of the supracrystal. The facet of lower surface energy is favored, consistent with the Wulff construction rule. Our imaging–analysis framework can be applicable to other phenomena, such as electrodeposition, nucleation, and membrane deformation.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Domain Adaptation for Measurements of Strong Gravitational Lenses

Upcoming surveys are predicted to discover galaxy-scale strong lenses on the order of 10\textsuperscript{5}, making deep learning methods necessary in lensing data analysis. Currently, there is insufficient real lensing data to train deep learning algorithms, but the alternative of training only on simulated data results in poor performance on real data. Domain Adaptation may be able to bridge the gap between simulated and real datasets. We utilize domain adaptation for the estimation of Einstein radius ($\Theta_E$) in simulated galaxy-scale gravitational lensing images with different levels of observational realism. We evaluate two domain adaptation techniques - Domain Adversarial Neural Networks (DANN) and Maximum Mean Discrepancy (MMD). We train on a source domain of simulated lenses and apply it to a target domain of lenses simulated to emulate noise conditions in the Dark Energy Survey (DES). We show that both domain adaptation techniques can significantly improve the model performance on the more complex target domain dataset. This work is the first application of domain adaptation for a regression task in strong lensing imaging analysis. Our results show the potential of using domain adaptation to perform analysis of future survey data with a deep neural network trained on simulated data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Domain Adaptation for Measurements of Strong Gravitational Lenses

Upcoming surveys are predicted to discover galaxy-scale strong lenses on the order of $10^5$, making deep learning methods necessary in lensing data analysis. Currently, there is insufficient real lensing data to train deep learning algorithms, but the alternative of training only on simulated data results in poor performance on real data. Domain Adaptation may be able to bridge the gap between simulated and real datasets. We utilize domain adaptation for the estimation of Einstein radius ($\Theta_E$) in simulated galaxy-scale gravitational lensing images with different levels of observational realism. We evaluate two domain adaptation techniques - Domain Adversarial Neural Networks (DANN) and Maximum Mean Discrepancy (MMD). We train on a source domain of simulated lenses and apply it to a target domain of lenses simulated to emulate noise conditions in the Dark Energy Survey (DES). We show that both domain adaptation techniques can significantly improve the model performance on the more complex target domain dataset. This work is the first application of domain adaptation for a regression task in strong lensing imaging analysis. Our results show the potential of using domain adaptation to perform analysis of future survey data with a deep neural network trained on simulated data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Smartphone-based Dual-channel Immunochromatographic Test Strip with Polymer Quantum Dot Labels for Simultaneous Detection of Cypermethrin and 3-phenoxybenzoic acid

Currently, gas chromatography-mass spectrometry (GC-MS) and liquid chromatography-mass spectrometry (LC-MS) are the primary methods used to detect pesticides and their metabolites for biomonitoring of exposure. Although GC-MS and LC-MS can provide accurate and sensitive measurements, these techniques are not suitable for point-of-care or in-field biomonitoring applications. The objective of this work is to develop a smartphone-based dual-channel immunochromatographic test strip (ICTS) for on-site biomonitoring of exposure to cypermethrin by simultaneous detection of cypermethrin and its metabolite, 3-phenoxybenzoic acid (3-PBA). Polymer carbon dots (PCDs) with ultra-high fluorescent brightness were synthesized and used as signal amplifier in ICTS assay. Cypermethrin (a representative pyrethroid pesticide) and its major metabolite 3-PBA were simultaneously detected to provide more comprehensive analysis of cypermethrin exposure. After competitive immunoreactions between the target sample and the coating antigens preloaded on the test line, the tracer antibody (PCDs conjugated antibody) was quantitatively captured on the test lines. The captured PCDs were inversely proportional to the amount of the target compound in sample. The red fluorescence on the test line then was recorded by a smartphone-based device capable of conducting image analysis and recording. Under optimal conditions, the sensor showed excellent linear responses for detecting cypermethrin and 3-PBA ranging from 1 ng/mL to 100 ng/mL and from 0.1 ng/mL to 100 ng/mL, the limits of detection were calculated to be ~0.35 ng/mL for cypermethrin and ~0.04 ng/mL for 3-PBA, respectively. The results demonstrate that the ICTS device is promising for accurate point-of-care biomonitoring of pesticide exposure.

Zhao, Yuting↗

Understanding important features of deep learning models for segmentation of high-resolution transmission electron microscopy images

Cutting edge deep learning techniques allow for image segmentation with great speed and accuracy. However, application to problems in materials science is often difficult since these complex models may have difficultly learning meaningful image features that would enable extension to new datasets. In situ electron microscopy provides a clear platform for utilizing automated image analysis. In this work, we consider the case of studying coarsening dynamics in supported nanoparticles, which is important for understanding, for example, the degradation of industrial catalysts. By systematically studying dataset preparation, neural network architecture, and accuracy evaluation, we describe important considerations in applying deep learning to physical applications, where generalizable and convincing models are required. With a focus on unique challenges that arise in high-resolution images, we propose methods for optimizing performance of image segmentation using convolutional neural networks, critically examining the application of complex deep learning models in favor of motivating intentional process design.

36 MATERIALS SCIENCE↗

Correction and verification of x-ray imaging crystal spectrometer analysis on Wendelstein 7-X through x-ray ray tracing

X-ray ray tracing is used to develop ion-temperature corrections for the analysis of the X-ray Imaging Crystal Spectrometer (XICS) used at Wendelstein 7-X (W7-X) and perform verification on the analysis methods. The XICS is a powerful diagnostic able to measure ion-temperature, electron-temperature, plasma flow, and impurity charge state densities. While these systems are relatively simple in design, accurate characterization of the instrumental response and validation of analysis techniques are difficult to perform experimentally due to the requirement of extended x-ray sources. For this reason, a ray tracing model has been developed that allows characterization of the spectrometer and verification of the analysis methods while fully considering the real geometry of the XICS system and W7-X plasma. Through the use of ray tracing, several important corrections have been found that must be accounted for in order to accurately reconstruct the ion-temperature profiles. The sources of these corrections are described along with their effect on the analyzed profiles. The implemented corrections stem from three effects: (1) effect of sub-pixel intensity distribution during de-curving and spatial binning, (2) effect of sub-pixel intensity distribution during forward model evaluation and generation of residuals, and (3) effect of defocus and spherical aberrations on the instrumental response. Possible improvements to the forward model and analysis procedures are explored, along with a discussion of trade-offs in terms of computational complexity. Finally, the accuracy of the tomographic inversion technique in stellarator geometry is investigated, providing for the first time a verification exercise for inversion accuracy in stellarator geometry and a complete XICS analysis tool-chain.

47 OTHER INSTRUMENTATION↗

Investigation of Nanoparticle Degradation in Hydrogen Fuel Cell Systems through Automated Electron Microscopy

Proton exchange membrane fuel cells (PEMFC) are promising devices for the deployment of hydrogen-powered heavy-duty vehicles, providing a higher efficiency for similar driving range and fueling time than the existing ones. However, PEMFCs still encounter durability challenges mainly due to catalyst degradation in the cathode. Mitigating these performance losses requires a better understanding of the degradation mechanisms under heavy-duty accelerated stress tests (ASTs) [1]. Scanning transmission electron microscopy (STEM) combined with energy dispersive X-ray spectroscopy (EDS) are key tools for the analysis of Pt and PtCo nanoparticle size, spatial distribution and composition [2]. Electron tomography is also used to determine the rate and type of degradation of catalyst nanoparticles as a function of their position on the carbon support. In this work, automated data acquisition software, paired with a custom Python code, have been used to study the effect of different accelerated stress tests (ASTs) on nanoparticle coarsening [2]. Figure 1 shows high-angle annular dark-field (HAADF)-STEM images and EDS maps comparing the cathodes of membrane electrode assemblies (MEAs) following an electrocatalyst AST performed under H2/N2 with that of the heavy-duty AST performed under H2/air. We will discuss how AST conditions affect considerably the spatial distribution of the nanoparticles across the electrode between the membrane and microporous layer. Although the median particle size increased more in the MEA aged under the heavy-duty AST, as determined using a high-throughput image analysis, the quantitative EDS measurements demonstrate that the electrocatalyst AST resulted in more Pt and Co dissolution from the cathode, which is another important indicator of electrocatalyst degradation. We will further present the impact of the relative humidity (% RH) on the degradation mechanisms demonstrated using the same approach. Electron tomography has been used to distinguish the Pt nanoparticles residing on the carbon support surface (exterior) from those within the pore structure (interior) in order to determine the relative stability of interior and exterior nanoparticles. As shown in Figure 2, we will compare the Pt catalyst particle size at the beginning of test (BOT) and end of test (EOT), and discuss the importance of automating the electron tomography workflow, i.e. acquisition, reconstruction, and visualization, to increase sampling and determine the standard deviation of these measurement. The outlook for utilizing low-dose cryo-tomography for limiting damage to the catalyst, support, and especially proton-conducting ionomer will also be discussed [3].

Amichi, Lynda↗

Mapping of Benthic Habitats at Marine Renewable Energy Sites Using Multibeam Echosounder and Sediment Profile Imaging Technologies

Objectives/Scope: The goal of this work was to develop a consistent and semi-automated seafloor survey method for generating high-resolution, benthic habitat maps for environmental assessments and monitoring of marine renewable energy sites. Sediment profile and plan view imaging (SPI/PV) technology was combined with multibeam bathymetry and acoustic backscatter methods to demonstrate a rapid, cost-effective benthic mapping protocol. A key technical innovation of this project was the development of an image processing platform that automatically measures key features from the images. Methods: Multibeam echosounder (MBES) acoustic and SPI/PV surveys were conducted at three coastal areas off the U.S. west coast, including the PacWave South energy test site off of Newport, Oregon. Point data on physical and biological sediment conditions obtained from the SPI/PV imagery were used to efficiently ground-truth the high-resolution MBES bathymetry and backscatter mosaics. The SPI camera is an optical corer that obtains an undisturbed 21 by 15 cm, high-resolution, cross-sectional image of the sediment–water interface and upper sediment column. The plan view camera attached to the SPI camera frame captures a downward looking view of the seabed immediately before the SPI image is obtained. As part of this project, we developed a computer vision image processing platform (iSPI) that uses deep convolutional neural networks and other approaches to automatically identify and measure key features in the images, such as grain size and surface relief. Results: Detailed benthic habitat maps were generated using this mapping approach for three different marine settings. The sites mapped included a silt-dominated embayment; a sloping, nearshore, transitional very fine to coarse sand bottom; and a medium, sand-dominated continental shelf marine energy test site. In each case, acoustic and imaging surveys were completed in less than week, and detailed benthic habitat maps were generated within 60 days. The results were placed within the Coastal and Marine Ecological Classification Standard (CMECS) habitat mapping framework, and various combinations of the bathymetry, backscatter, and SPI and PV data were used to generate CMECS component maps. Novel Information: This project developed and demonstrated a repeatable and cost-effective approach for efficiently mapping benthic habitat conditions over broad areas of the seafloor by combining state-of-the-art acoustic and imaging techniques. The primary survey tools used in this project have been used previously in both the offshore renewable (wind) and oil and gas sectors to map and monitor benthic environments. This project’s innovations include 1) the focused use of high-resolution SPI/PV imagery to ground-truth acoustic mosaics, and 2) the development of a computer automated image analysis processing tool that both streamlines and standardizes the generation of data from the imagery and makes the data extraction process more cost-effective and repeatable.

13 HYDRO ENERGY↗

Electron Tomography and Machine Learning for Understanding the Highly Ordered Structure of Leafhopper Brochosomes

Insects known as leafhoppers (Hemiptera: Cicadellidae) produce hierarchically structured nanoparticles known as brochosomes that are exuded and applied to the insect cuticle, thereby providing camouflage and anti-wetting properties to aid insect survival. Although the physical properties of brochosomes are thought to depend on the leafhopper species, the structure–function relationships governing brochosome behavior are not fully understood. Brochosomes have complex hierarchical structures and morphological heterogeneity across species, due to which a multimodal characterization approach is required to effectively elucidate their nanoscale structure and properties. In this work, we study the structural and mechanical properties of brochosomes using a combination of atomic force microscopy (AFM), electron microscopy (EM), electron tomography, and machine learning (ML)-based quantification of large and complex scanning electron microscopy (SEM) image data sets. This suite of techniques allows for the characterization of internal and external brochosome structures, and ML-based image analysis methods of large data sets reveal correlations in the structure across several leafhopper species. Our results show that brochosomes are relatively rigid hollow spheres with characteristic dimensions and morphologies that depend on leafhopper species. Nanomechanical mapping AFM is used to determine a characteristic compression modulus for brochosomes on the order of 1–3 GPa, which is consistent with crystalline proteins. Altogether, this work provides an improved understanding of the structural and mechanical properties of leafhopper brochosomes using a new set of ML-based image classification tools that can be broadly applied to nanostructured biological materials.

Chemical structure↗

A physically unclonable function using NV diamond magnetometry and micromagnet arrays

A physically unclonable function (PUF) is an embedded hardware security measure that provides protection against counterfeiting. In this article, we present our work on using an array of randomly magnetized micrometer-sized ferromagnetic bars (micromagnets) as a PUF. We employ a 4μm thick surface layer of nitrogen-vacancy (NV) centers in diamond to image the magnetic field from each micromagnet in the array, after which we extract the magnetic polarity of each micromagnet using image analysis techniques. Finally, after evaluating the randomness of the micromagnet array PUF and the sensitivity of the NV readout, we conclude by discussing the possible future enhancements for improved security and magnetic readout.

Electromagnetism↗

Hygrothermal Aging and Thermomechanical Characterization of As-Manufactured Tidal Turbine Blade Composites

This study investigates the hygrothermal aging behavior and thermomechanical properties of as-manufactured glass fiber-reinforced epoxy and thermoplastic composite tidal turbine blades. The blades were previously deployed in a marine environment and subsequently analyzed through a comprehensive suite of material characterization techniques, including hygrothermal aging, dynamic mechanical analysis (DMA), tensile testing and X-ray computed tomography (XCT). Hygrothermal aging experiments revealed that while thermoplastic composites exhibited lower overall water absorption (0.78% vs. 0.47%), they had significantly higher diffusion coefficients than epoxy (2.1 vs. 12.1 × 10 −13 m 2 s −1 ), suggesting faster saturation in operational environments. DMA results demonstrated that water ingress caused plasticization in epoxy matrices, reducing the glass transition temperature and increasing damping (112 °C to 104 °C), while thermoplastic composites showed more stable thermal behavior (87 °C glass transition temperature). Tensile testing revealed substantial reductions in ultimate strength (>40%) for both materials after prolonged water exposure, with minimal change in elastic modulus, highlighting the role of matrix degradation over fiber reinforcement. XCT image analysis showed that both composites were manufactured with high quality: no large voids or cracks were present, and the degree of misalignment was low. These findings inform future marine renewable energy composite designs by emphasizing the critical influence of moisture on long-term structural integrity and the need for optimized material systems in harsh marine environments. This work provides a rare real-world comparison of epoxy and recyclable thermoplastic tidal turbine blades, showing how laboratory aging tests and advanced imaging reveal the influence of material and manufacturing choices on long-term marine durability.

16 TIDAL AND WAVE POWER↗