Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

In situ visualization of multicomponents coevolution in a battery pouch cell

Lithium-ion battery (LIB) is a broadly adopted technology for energy storage. With increasing demands to improve the rate capability, cyclability, energy density, safety, and cost efficiency, it is crucial to establish an in-depth understanding of the detailed structural evolution and cell-degradation mechanisms during battery operation. Here, we present a laboratory-based high-resolution and high-throughput X-ray micro–computed laminography approach, which is capable of in situ visualizing of an industry-relevant lithium-ion (Li-ion) pouch cell with superior detection fidelity, resolution, and reliability. This technique enables imaging of the pouch cell at a spatial resolution of 0.5 μm in a laboratory system and permits the identification of submicron features within cathode and anode electrodes. We also demonstrate direct visualization of the lithium plating in the imaged pouch cell, which is an important phenomenon relevant to battery fast charging and low-temperature cycling. Our development presents an avenue toward a thorough understanding of the correlation among multiscale structures, chemomechanical degradation, and electrochemical behavior of industry-scale battery pouch cells.

25 ENERGY STORAGE↗

Non-Blind Deblurring for Fluorescence: A Deformable Latent Space Approach with Kernel Parameterization

We report N\non-blind deblurring (NBD) is a modeling method of the image deblurring problem in computer vision, where the blurring kernel is known or can be externally estimated. In this paper, we attempt to solve a parametric NBD problem, inspired by the simultaneous acquisition of ptychography and fluorescent imaging (FI). Ptychography is an imaging method that favors larger probes, i.e. convolutional kernels, while FI relies on a small probe for high resolution. Also, the kernel can be solved during ptychographic reconstruction. With Ptycho-FI using the same larger kernel, we can perform NBD on the blurred fluorescent images to achieve high-resolution FI, and thus speed up the experiments. To this end, we design a deep latent space deformation network that is directly parameterized by the kernel. The network consists of three components: encoder, deformer, and decoder, where the deformer is specifically meant to rectify the latent space representations of blurred images to a standard latent space, regardless of the kernel. The deformation network is trained with a two-stage training scheme. We conduct extensive experiments to confirm that our parametric model can adapt to drastically different blurring kernels and perform robust deblurring.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Multiphysics Meshfree Degradation Modeling of Energy Storage Materials with Kernel Enrichment

Energy storage materials exhibit strong electro-chemo-mechanical coupling and highly anisotropic material properties, contributing to the formation and propagation of micro-cracking during charge/discharge cycling and ultimately diminishing performance and service life. With microstructural images supplied by the National Renewable Energy Laboratory (NREL), pixel-based meshfree model construction by the reproducing kernel particle method (RKPM) is used to represent the complex material microstructures that dictate the coupled physics of these systems. Traditional electro-chemo-mechanical models rely on mesh-based finite element methods, which can lead to difficulties in meshing such complex geometries and capturing crack propagation due to mesh dependency. The first kernel enrichment discussed will be the interface modified reproducing kernel (IM-RK) [1, 2], constructed by scaling a smooth kernel function with an interface-distance function to achieve strategic discontinuity types (i.e. weak discontinuities for strain discontinuities and strong discontinuities for cracks) and alleviate Gibbs oscillations near these transition zones. The IM-RK is especially useful for areas in which a known discontinuity-type is expected a priori. The second kernel enrichment to be discussed is a neural network-enhanced reproducing kernel (NN-RK) [3, 4], which is introduced to effectively model non-obvious damage and crack propagation in the material microstructures; the location, orientation, and solution transition near a localization are automatically captured by superimposed block-level NN optimizations. This NN enrichment approach allows for effective modeling of localizations via a fixed background discretization, relieving tedious efforts for adaptive refinement in traditional mesh-based methods. Applications to the heterogeneous microstructures of Li-ion battery cathodes will be presented to demonstrate the effectiveness of the proposed methods. NN-RK is additionally used to inform how crack opening and closure in turn affect the electro-chemo-mechanical responses in the material microstructure. Reference: [1] Wang, Y., Baek, J., Tang, Y. et al. "Support vector machine guided reproducing kernel particle method for image-based modeling of microstructures," Comput Mech 73, 907-942 (2024). https://doi.org/10.1007/s00466-023-02394-9. [2] Susuki, K., Allen, J. & Chen, J. S.. "Image-based modeling of coupled electro-chemo-mechanical behavior of Li-ion battery cathode using an interface-modified reproducing kernel particle method," Engineering with Computers (2024). https://doi.org/10.1007/s00366-024-02016-9. [3] Baek, J., Chen, J. S., Susuki, K., "Neural Network enhanced Reproducing Kernel Particle Method for Modeling Localizations," International Journal for Numerical Methods in Engineering, Vol. 123, 4422-4454 (2022). https://doi.org/10.1002/nme.7040.

25 ENERGY STORAGE↗

RU-net for automatic characterization of TRISO fuel cross sections

During irradiation, phenomena such as kernel swelling and buffer densification may impact the performance of tristructural isotropic (TRISO) particle fuel. Post-irradiation microscopy is often used to identify these irradiation-induced morphologic changes. However, each fuel compact generally contains thousands of TRISO particles. Manually performing the work to get statistical information on these phenomena is cumbersome and subjective. Here, to reduce the subjectivity inherent in that process and to accelerate data analysis, we used convolutional neural networks (CNNs) to automatically segment cross-sectional images of microscopic TRISO layers. CNNs are a class of machine-learning algorithms specifically designed for processing structured grid data. They have gained popularity in recent years due to their remarkable performance in various computer vision tasks, including image classification, object detection, and image segmentation. In this research, we generated a large irradiated TRISO layer dataset with more than 2,000 microscopic images of cross-sectional TRISO particles and the corresponding annotated images. Based on these annotated images, we used different CNNs to automatically segment different TRISO layers. These CNNs include RU-Net (developed in this study), as well as three existing architectures: U-Net, Residual Network (ResNet), and Attention U-Net. The preliminary results show that the model based on RU-Net performs best in terms of Intersection over Union (IoU). Using CNN models, we can expedite the analysis of TRISO particle cross sections, significantly reducing the manual labor involved and improving the objectivity of the segmentation results.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

RU Net for Automatic Characterization of TRISO Fuel Cross Sections

TRistructural ISOtropic (TRISO) particle fuel is a type of nuclear fuel known for its high-temperature and high-burnup performance. Each sub-millimeter diameter TRISO particle consists of uranium-oxycarbide (UCO) or UO2 fuel kernel, coated with buffer, inner pyrolytic carbon (IPyC), silicon carbide (SiC), and outer pyrolytic carbon (OPyC) layers. The SiC layer acts as the main containment barrier for the TRISO particle to retain the fission products, while the IPyC and OPyC layers provide additional barriers to the release of fission products, especially fission gases. During irradiation, phenomena like kernel swelling, buffer densification, and IPyC fracture may impact fuel performance. Post-irradiation microscopy on entire compact cross sections or samples of individual particles deconsolidated from compacts is often used to identify these irradiation-induced changes in morphology. However, each fuel compact generally contains thousands of TRISO particles. To get statistical information on these phenomena, it is cumbersome work if done manually. For example, to get information about swelling/densification behaviors of different layers or kernels after irradiation, researchers previously manually measured the perimeter of each TRISO layer in hundreds of particles after four rounds of iterative grinding and polishing encompassing more than 2000 cross-section images for a total of four fuel compacts. To attempt to reduce the subjectivity inherent in that process and accelerate data analysis, we conducted a study on the automatic TRISO layer segmentation on cross-sectional microscopic images using Convolutional Neural Networks (CNNs). CNNs are a class of machine learning algorithms specifically designed for processing structured grid data that have gained popularity in recent years due to their remarkable performance in various computer vision tasks, including image classification, object detection, and image segmentation. In this research, we have generated the large irradiated TRISO layer dataset with more than 2000 cross-section TRISO microscopic images and the corresponding annotated images. Based on these annotated images, we have employed different CNNs for automatic segmentation of different TRISO layers. These include RU-Net (developed in this study), as well as three existing architectures: U-Net, Residual Network (ResNet), and Attention U-Net. The preliminary results show that the model based on RU-Net has the best performance in terms of intersection-over-union (IoU). Through the aid of these CNN models, we can expedite the analysis of TRISO particle cross-sections, significantly reducing the manual labor involved and improving the objectivity of the segmentation results.

Convolutional Neural Networks↗

Machine learning pipeline for denoising low signal-to-noise ratio and out-of-distribution transmission electron microscopy datasets

High-resolution transmission electron microscopy (HRTEM) is crucial for observing material’s structural and morphological evolution at Angstrom scales, but the electron beam can alter these processes. Devices such as CMOS-based direct-electron detectors operating in electron-counting mode can be utilized to substantially reduce the electron dosage. However, the resulting images often lead to a low signal-to-noise ratio, which requires frame integration that sacrifices temporal resolution. Several machine learning (ML) models have been recently developed to successfully denoise HRTEM images. Yet, these models are often computationally expensive, and their inference speeds on GPUs are outpaced by the imaging speed of advanced detectors, precluding in situ analysis. Furthermore, the performance of these denoising models on datasets with imaging conditions that deviate from the training datasets has not been evaluated. To mitigate these gaps, we propose a new self-supervised ML denoising pipeline specifically designed for time-series HRTEM images. This pipeline integrates a blind-spot convolution neural network with pre-processing and post-processing steps, including drift correction and low-pass filtering. Results demonstrate that our model outperforms various other ML and non-ML denoising methods in noise reduction and contrast enhancement, leading to improved visual clarity of atomic features. Additionally, the model is drastically faster than U-Net-based ML models and demonstrates excellent out-of-distribution generalization. The model’s computational inference speed is in the order of milliseconds per image, rendering it suitable for application in in-situ HRTEM experiments.

36 MATERIALS SCIENCE↗

Multigrid Optimization for Large-Scale Ptychographic Phase Retrieval

Ptychography is a popular imaging technique that combines diffractive imaging with scanning microscopy. The technique consists of a coherent beam that is scanned across an object in a series of overlapping positions, leading to reliable and improved reconstructions. Ptychographic microscopes allow for large fields to be imaged at high resolution at the cost of additional computational expense. Herein, we propose a multigrid-based optimization framework to reduce the computational burdens of large-scale ptychographic phase retrieval. Our proposed method exploits the inherent hierarchical structures in ptychography through tailored restriction and prolongation operators for the object and data domains. Our numerical results show that our proposed scheme accelerates the convergence of its underlying solver and outperforms the ptychographical iterative engine, a workhorse in the optics community.

97 MATHEMATICS AND COMPUTING↗

Computational microscopy for fast widefield deep-tissue fluorescence imaging using a commercial dual-cannula probe

A solid-glass cannula serves as a micro-endoscope that can deliver excitation light deep inside tissue while also collecting emitted fluorescence. Then, we utilize deep neural networks to reconstruct images from the collected intensity distributions. By using a commercially available dual-cannula probe, and training a separate deep neural network for each cannula, we effectively double the field of view compared to prior work. We demonstrated ex vivo imaging of fluorescent beads and brain slices and in vivo imaging from whole brains. We clearly resolved 4 µm beads, with FOV from each cannula of 0.2 mm (diameter), and produced images from a depth of ∼1.2 mm in the whole brain, currently limited primarily by the labeling. Since no scanning is required, fast widefield fluorescence imaging limited primarily by the brightness of the fluorophores, collection efficiency of our system, and the frame rate of the camera becomes possible.

42 ENGINEERING↗

Out of distribution evaluation for neural image compression

Official code for the NeurIPS 2023 paper "Neural Image Compression: Generalization, Robustness, and Spectral Biases". This code can be used to: - Computing spectral distortion errors of images compressed with traditional codes or neural image compression models (as proposed in the aformentioned paper) - Visualize power spectral densities and fourier heatmaps (as proposed in the aformentioned paper) - Train and test a variety of neural image compression models

Lieberman, KelseyA↗

Infrared intrusion detection system (IRIDS)

A system and method for intrusion detection includes an imager directed towards an object in an interior space. The imager is in data communication with a computer. The computer is arranged to process digital three-dimensional image data received from the imager and programmed to execute a change detection algorithm in response to the processed three-dimensional data to determine movement of the object. The computer generates an alarm output in response to detecting movement of the object above a predetermined threshold. The method includes providing an imager directed towards an object in an interior space; receiving Time of Flight signals by the imager; processing digital three-dimensional image data received from the imager; and executing a change detection algorithm in response to the processed three-dimensional data to determine movement of the object.

Russell, John L.↗

Satellite Image Algorithms

Presented by Conner Hatton at SIAM UQ Conference in Trieste, Italy, on February 27th, 2024. Conference details available online at https://www.siam.org/conferences/cm/conference/uq24

97 MATHEMATICS AND COMPUTING↗

Systems and methods for point-of-care positron emission tomography

A positron emission tomography (PET) system is provided. The system includes a first detector panel including a first array of detectors, a second detector panel including a second array of detectors, said second detector panel being moveable relative to a point between the first detector panel and the second detector panel, a tracking system configured to detect a position of said second detector panel relative to the first detector panel while imaging a subject, a computing device in communication with the first detector panel, the second detector panel, and the tracking system, the computing device configured to receive coincidence data from the first and second detector panels, receive position data from the tracking system, wherein each coincidence datum of the received coincidence data is associated with a unique position datum of the received position data, and reconstruct a plurality of images based on the received coincidence data and the received position data.

Tai, Yuan-Chuan↗

Using Direct Numerical Simulation of Pore-Level Events to Improve Pore-Network Models for Prediction of Residual Trapping of CO2

Direct numerical simulation and pore-network modeling are common approaches to study the physics of two-phase flow through natural rocks. For assessment of the long-term performance of geological sequestration of CO 2 , it is important to model the full drainage-imbibition cycle to provide an accurate estimate of the trapped CO 2 . While direct numerical simulation using pore geometry from micro-CT rock images accurately models two-phase flow physics, it is computationally prohibitive for large rock volumes. On the other hand, pore-network modeling on networks extracted from micro-CT rock images is computationally efficient but utilizes simplified physics in idealized geometric pore elements. This study uses the lattice-Boltzmann method for direct numerical simulation of CO 2 -brine flow in idealized pore elements to develop a new set of pore-level flow models for the pore-body filling and snap-off events in pore-network modeling of imbibition. Lattice-Boltzmann simulations are conducted on typical idealized pore-network configurations, and the interface evolution and local capillary pressure are evaluated to develop modified equations of local threshold capillary pressure of pore elements as a function of shape factor and other geometrical parameters. The modified equations are then incorporated into a quasi-static pore-network flow solver. The modified model is applied on extracted pore-network of sandstone samples, and saturation of residual trapped CO 2 is computed for a drainage-imbibition cycle. The modified model yields different statistics of pore-level events compared with the original model; in particular, the occurrence of snap-off in pore-throats is reduced resulting in a more frontal displacement pattern along the main injection direction. Compared to the original model, the modified model is in closer agreement with the residual trapped CO 2 obtained from core flow experiments and direct numerical simulation.

Kohanpur, Amir H.↗

FIRM: federated image reconstruction using multimodal tomographic data

Here, we propose a federated algorithm for reconstructing images using multimodal tomographic data sourced from dispersed locations, addressing the challenges of traditional unimodal approaches that are prone to noise and reduced image quality, as well as the limitations of centralized multimodal approaches that require extensive data transfer, leading to significant communication overhead, storage demands, and potential data privacy concerns. Our approach formulates a joint inverse optimization problem incorporating multimodality constraints and solves it in a federated framework through local gradient computations complemented by lightweight central operations, thereby ensuring data decentralization. Leveraging the connection between our federated algorithm and the quadratic penalty method, we introduce an adaptive step-size rule with guaranteed sublinear convergence. Numerical results demonstrate superior computational efficiency and improved image reconstruction quality compared to existing approaches.

federated algorithm↗

Integrated and dynamic multi-spectroscopic in situ imaging of plant metabolism at the level of subcellular compartments. Final Report

The goals of this project was to develop integrated multi-spectral molecular imaging technologies (Raman, fluorescence, and mass spectrometry), that can assess, and image metabolic processes at the cellular and subcellular levels of plant organs. These imaging technologies were developed in the context of computational capabilities that integrated multi-spectral images with genome scale models of metabolism. The integrated molecular imaging technologies were developed in the biological context of autophagy that remodels membrane lipid topologies, which control spatially defined subcellular regions within plant cells and optimizes plant biomass productivity during environmental stresses that can limit biomass productivity.

09 BIOMASS FUELS↗

Rapid macrovoid characterization in membranes prepared via nonsolvent-induced phase separation: A comparison between 2D and 3D techniques

Optimizing the performance of asymmetric membranes prepared via nonsolvent-induced phase separation (NIPS) requires a quantitative understanding of how processing variables influence membrane morphology. Presently, the most useful structural quantification techniques require 3D visualization of the membrane structure and are best suited for studies seeking detailed information on small datasets. This study proposes and validates a rapid and accurate technique for quantifying macroporosity (i.e., D m ), a simple descriptor of sublayer macrovoid content in asymmetric membranes D m . values measured from segmented cross-sectional imaging performed via X-ray computed tomography (XCT) and scanning electron microscopy (SEM) are presented and compared for three asymmetric membranes prepared from commercial polymers. Importantly, analyses of 3D XCT membrane reconstructions reveal that D m is described by a single, centralized mean, which demonstrates that macrovoid content is spatially homogenous. Thus, D m can be approximated from limited sampling of the 2D cross-sectional membrane structure via SEM. A proposed 2D SEM sampling method provides D m estimates within ±6% of corresponding 3D XCT values with 30 independent measurements for the three membranes. Further sensitivity is achieved using complementary descriptors such as macrovoid count density (i.e., C m ). This technique is thus a useful tool for characterizing macroporosity from a broad selection of membrane samples.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Rapid simulations of hyperspectral near-field images of three-dimensional heterogeneous surfaces

The scattering-type scanning near-field optical microscope (s-SNOM) has emerged as a powerful tool for resolving nanoscale inhomogeneities in laterally heterogeneous samples. However, most analytical models used to predict the scattering near-field signals are assuming homogenous landscapes (bulk materials), resulting in inconsistencies when applied to samples with more complex configurations. In this work, we combine the point-dipole model (PDM) to the finite-element method (FEM) to account for the lateral and vertical heterogeneities while keeping the computation time manageable. Full images, spectra, or hyperspectral line profiles can be simulated by calculating the self-consistent dipole radiation demodulated at higher harmonics of the tip oscillation, mimicking real experimental procedures. Using this formalism, we clarify several important yet puzzling experimental observations in near-field images on samples with rich typography and complex material compositions, heterostructures of two-dimensional material flakes, and plasmonic antennas. The developed method serves as a basis for future investigations of nano-systems with nontrivial topography.

36 MATERIALS SCIENCE↗