Wavelet-transform-based speckle vector tracking method for X-ray phase imaging
Not Available
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
SEARCH · Engineering Papers
Results for “Image Transforms”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Optimizing cloud motion estimation on the edge with phase correlation and optical flow
Abstract. Phase correlation (PC) is a well-known method for estimating cloud motion vectors (CMVs) from infrared and visible spectrum images. Commonly, phase shift is computed in the small blocks of the images using the fast Fourier transform. In this study, we investigate the performance and the stability of the blockwise PC method by changing the block size, the frame interval, and combinations of red, green, and blue (RGB) channels from the total sky imager (TSI) at the United States Atmospheric Radiation Measurement user facility's Southern Great Plains site. We find that shorter frame intervals, followed by larger block sizes, are responsible for stable estimates of the CMV, as suggested by the higher autocorrelations. The choice of RGB channels has a limited effect on the quality of CMVs, and the red and the grayscale images are marginally more reliable than the other combinations during rapidly evolving low-level clouds. The stability of CMVs was tested at different image resolutions with an implementation of the optimized algorithm on the Sage cyberinfrastructure test bed. We find that doubling the frame rate outperforms quadrupling the image resolution in achieving CMV stability. The correlations of CMVs with the wind data are significant in the range of 0.38–0.59 with a 95 % confidence interval, despite the uncertainties and limitations of both datasets. A comparison of the PC method with constructed data and the optical flow method suggests that the post-processing of the vector field has a significant effect on the quality of the CMV. The raindrop-contaminated images can be identified by the rotation of the TSI mirror in the motion field. The results of this study are critical to optimizing algorithms for edge-computing sensor systems.
54 ENVIRONMENTAL SCIENCES↗
Deep-ultraviolet ptychographic pocket-scope (DART): mesoscale lensless molecular imaging with label-free spectroscopic contrast
The mesoscale characterization of biological specimens has traditionally required compromises between resolution, field-of-view, depth-of-field, and molecular specificity, with most approaches relying on external labels. Here we present the Deep-ultrAviolet ptychogRaphic pockeT-scope (DART), a handheld platform that transforms label-free molecular imaging through intrinsic deep-ultraviolet spectroscopic contrast. By leveraging biomolecules’ natural absorption fingerprints and combining them with lensless ptychographic microscopy, DART resolves down to 308-nm linewidths across centimeter-scale areas while maintaining millimeter-scale depth-of-field. The system’s virtual error-bin methodology effectively eliminates artifacts from limited temporal coherence and other optical imperfections, enabling high-fidelity molecular imaging without lenses. Through differential spectroscopic imaging at deep-ultraviolet wavelengths, DART quantitatively maps nucleic acid and protein distributions with femtogram sensitivity, providing an intrinsic basis for explainable virtual staining. We demonstrate DART’s capabilities through imaging of tissue sections, cytopathology specimens, blood cells, and neural populations, revealing detailed molecular contrast without external labels. The combination of high-resolution molecular mapping and broad mesoscale imaging in a portable platform opens new possibilities from rapid clinical diagnostics, tissue analysis, to biological characterization in space exploration.
60 APPLIED LIFE SCIENCES↗
Image registration for accurate electrode deformation analysis in operando microscopy of battery materials
Operando imaging techniques have become increasingly valuable in both battery research and manufacturing. However, the reliability of these methods can be compromised by instabilities in the imaging setup and operando cells, particularly when utilizing high-resolution imaging systems. The acquired imaging data often include features arising from both undesirable system vibrations and drift, as well as the scientifically relevant deformations occurring in the battery sample during cell operation. For meaningful analysis, it is crucial to distinguish and separately evaluate these two factors. To address these challenges, we employ a suite of advanced image-processing techniques. These include fast Fourier transform analysis in the frequency domain, power spectrum-based assessments for image quality, as well as rigid and non-rigid image-registration methods. These techniques allow us to identify and exclude blurred images, correct for displacements caused by motor vibrations and sample holder drift and, thus, prevent unwanted image artifacts from affecting subsequent analyses and interpretations. Additionally, we apply optical flow analysis to track the dynamic deformation of battery electrode materials during electrochemical cycling. This enables us to observe and quantify the evolving mechanical responses of the electrodes, offering deeper insights into battery degradation. Together, these methods ensure more accurate image analysis and enhance our understanding of the chemomechanical interplay in battery performance and longevity.
Sun, Tianxiao↗
Color Transformations of Photometric Measurements of Galaxies in Optical and Near-infrared Wide-field Imaging Surveys*
Abstract Over the past 2 decades, wide-field photometric surveys in optical and infrared domains reached a nearly all-sky coverage thanks to numerous observational facilities operating in both hemispheres. However, subtle differences among exact realizations of Johnson and SDSS photometric systems require one to convert photometric measurements into the same system prior to analysis of composite data sets originating from multiple surveys. It turns out that the published photometric transformations lead to substantial biases when applied to integrated photometry of galaxies from the corresponding catalogs. Here we present photometric transformations based on piece-wise linear approximations of integrated photometry of galaxies in the optical surveys SDSS, DECaLS, BASS, MzLS, DES, DELVE, KiDS, VST ATLAS, and the near-infrared surveys UKIDSS, UHS, VHS, and VIKING. We validate our transformations by constructing k -corrected color–magnitude diagrams of non-active galaxies and measuring the position and tightness of the “red sequence.” We also provide transformations for aperture magnitudes and show how they are affected by the image quality difference among the surveys. We present the implementation of the derived transformations in python and idl and also a web-based color transformation calculator for galaxies. By comparing DECaLS and DES, we identified systematic issues in DECaLS photometry for extended galaxies, which we attribute to the photometric software package used by DECaLS. As an application of our method, we compiled two multi-wavelength photometric catalogs for over 200,000 low- and intermediate-redshift galaxies originating from CfA FAST and Hectospec spectral archives.
Astronomy & Astrophysics↗
Time‐Lapse Image Classification Using a Diffractive Neural Network
Diffractive deep neural networks (D 2 NNs), comprised of spatially engineered passive surfaces, collectively process optical input information at the speed of light propagation through a thin diffractive volume, without any external computing power. Diffractive networks were demonstrated to achieve all‐optical object classification and perform universal linear transformations. Herein, a “time‐lapse” image classification scheme using a diffractive network is demonstrated for the first time, significantly advancing its classification accuracy and generalization performance on complex input objects by using the lateral movements of the input objects and/or the diffractive network, relative to each other. In a different context, such relative movements of the objects and/or the camera are routinely being used for image super‐resolution applications; inspired by their success, a time‐lapse diffractive network is designed to benefit from the complementary information content created by controlled or random lateral shifts. The design space and performance limits of time‐lapse diffractive networks are numerically explored, revealing a blind testing accuracy of 62.03% on the optical classification of objects from the CIFAR‐10 dataset. This constitutes the highest inference accuracy achieved so far using a single diffractive network on the CIFAR‐10 dataset. Time‐lapse diffractive networks will be broadly useful for the spatiotemporal analysis of input signals using all‐optical processors.
36 MATERIALS SCIENCE↗
Ultrafast Bragg coherent diffraction imaging of epitaxial thin films using deep complex-valued neural networks
Abstract Domain wall structures form spontaneously due to epitaxial misfit during thin film growth. Imaging the dynamics of domains and domain walls at ultrafast timescales can provide fundamental clues to features that impact electrical transport in electronic devices. Recently, deep learning based methods showed promising phase retrieval (PR) performance, allowing intensity-only measurements to be transformed into snapshot real space images. While the Fourier imaging model involves complex-valued quantities, most existing deep learning based methods solve the PR problem with real-valued based models, where the connection between amplitude and phase is ignored. To this end, we involve complex numbers operation in the neural network to preserve the amplitude and phase connection. Therefore, we employ the complex-valued neural network for solving the PR problem and evaluate it on Bragg coherent diffraction data streams collected from an epitaxial La 2-x Sr x CuO 4 (LSCO) thin film using an X-ray Free Electron Laser (XFEL). Our proposed complex-valued neural network based approach outperforms the traditional real-valued neural network methods in both supervised and unsupervised learning manner. Phase domains are also observed from the LSCO thin film at an ultrafast timescale using the complex-valued neural network.
77 NANOSCIENCE AND NANOTECHNOLOGY↗
DECT-MULTRA: Dual-Energy CT Image Decomposition With Learned Mixed Material Models and Efficient Clustering
Dual-energy computed tomography (DECT) imaging plays an important role in advanced imaging applications due to its material decomposition capability. Image-domain decomposition operates directly on CT images using linear matrix inversion, but the decomposed material images can be severely degraded by noise and artifacts. This paper proposes a new method dubbed DECT-MULTRA for image-domain DECT material decomposition that combines conventional penalized weighted-least squares (PWLS) estimation with regularization based on a mixed union of learned transforms (MULTRA) model. Our proposed approach pre-learns a union of common-material sparsifying transforms from patches extracted from all the basis materials, and a union of cross-material sparsifying transforms from multi-material patches. The common-material transforms capture the common properties among different material images, while the cross-material transforms capture the cross-dependencies. The proposed PWLS formulation is optimized efficiently by alternating between an image update step and a sparse coding and clustering step, with both of these steps having closed-form solutions. The effectiveness of our method is validated with both XCAT phantom and clinical head data. The results demonstrate that our proposed method provides superior material image quality and decomposition accuracy compared to other competing methods.
47 OTHER INSTRUMENTATION↗
Deep image reconstruction for background subtraction in heavy-ion collisions
Jet reconstruction in an ultrarelativistic heavy-ion collision suffers from a notoriously large, fluctuating thermal background. Traditional background‐subtraction methods struggle to remove this soft background while preserving the jet's hard substructure. In this Letter, we present DeepSub, a machine-learning-based approach for full-event background‐subtraction. DeepSub utilizes a model based on Swin Transformer layers to denoise jet images and disentangle hard jets from the heavy-ion background. DeepSub significantly outperforms existing subtraction techniques by reproducing key jet observables such as jet 𝑝 T and mass, and substructure observables such as girth and the energy correlation function, at the subpercent to percent level. As such, DeepSub paves the way for precision heavy-ion measurements in hitherto inaccessible kinematic regimes.
Qureshi, Umar Sohail [Stanford University, CA (Uni↗
Deep Learning and Structural Imaging of Materials
Deep learning has had a transformative effect on numerous domains and is actively utilized by many scientists in data-intensive fields such as high-energy physics and cosmology. Materials science, and in particular, the structural imaging of materials with electrons and X-rays are projected to enter the age of scientific data torrents, positioning them as new application spaces for modern artificial intelligence. In this contribution, we provide a synopsis on the foundations and latest progress in deep learning and present an in-depth application of utilizing modern deep artificial neural networks in scanning transmission electron microscopy to extract structural material properties. We use this case study to expose the strengths of deep learning-based models and discuss their current limitations, in the process highlighting their potential use in other data-intensive structural imaging modalities.
Laanait, Nouamane↗
Remote sensing images, DEM, and point clouds associated with “Accuracy evaluation of cost-effective 3D reconstruction approaches for hydrobiogeochemical processes in non-perennial stream riverbeds”
This data package is associated with the publication “Accuracy evaluation of cost-effective 3D reconstruction approaches for hydrobiogeochemical processes in non-perennial stream riverbeds” published in Frontiers in Environmental Science, Environmental Informatics and Remote Sensing (Bao et al., 2026; doi: 10.3389/fenvs.2026.1725258). This data package includes the drone photos for a section of Umtanum Creek in Washington, Unted States. The photos were used to reconstruct the 3-dimensional (3D) digital elevation model (DEM) of the riverbed for the investigated stream section. The reconstruction results from four approaches are provided: (1) unoccupied aerial vehicle (UAV, colloquially known as drone) imagery-based Structure-from-Motion (SfM), (2) a machine learning-based 3D reconstruction model, Visual Geometry Grounded Deep Structure from Motion (VGGSfM), (3) Visual Geometry Grounded Transformer for long sequence of images (VGGT-Long), and (4) handheld smartphone LiDAR scanning. The ground truth measurements by tripod-mounted optical level kit and ground control points GPS locations for evaluating the accuracy of the four reconstruction approaches are also provided in this data package. A preliminary version of this data package was published in October 2025 at the time of manuscript submission. It was updated in March 2026, at the time of manuscript acceptance, to include additional metadata (this readme, data dictionary, and file level metadata). The data did not change. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) 8 folders; (2) the detailed flight configuration html files; (3) field metadata; (4) a readme; (5) a data dictionary; and (6) file-level metadata. The folders “2024_10_18_d01” and “2024_10_18_d02” contain the original drone photos for the two drone flights (d01 and d02) on October 18, 2024. The reconstruction results from each of the approaches are in the folders called “ODM_SfM”, “VGGSfM”, “VGGTLong”, and “LiDAR”. The ground truth measurements are in the folder called “optical_level_kit”. Lastly, results comparing the different approaches are in the folder called “comparisons”. All files are .csv, .html, .jpg, .obj, .txt, and .npy. For information on using the .obj and .npy files, see the readme files within the same folder as the files.
54 ENVIRONMENTAL SCIENCES↗
High-speed quantitative X-ray multi-contrast imaging with deep learning based modulated pattern analysis
The advent of X-ray multi-contrast imaging methods, providing absorption, phase, and dark-field images, holds tremendous promise for complementary and non-destructive visualization of inner structures within materials and bio-samples. However, the low efficiency in measuring and analyzing X-ray modulated patterns has hindered their application in high-resolution in situ imaging. In this work, the Enhanced Scanning Pattern-based Imaging Neural Network (ESPINNet) is introduced as a powerful tool for achieving high-speed, high-resolution quantitative imaging. ESPINNet is faster than correlation-based speckle tracking methods such as XSVT and UMPA, and provides a balanced performance in terms of resolution and speed for data collection by using fewer scanning images. In comparison with our previously developed neural network, ESPINNet introduces the capability to generate dark-field images, further enhancing its versatility. By leveraging scanning patterns, ESPINNet significantly improves resolution and measurement precision. Furthermore, its adaptability to various modulation patterns, including those produced by sandpaper, coded masks, or gratings, ensures broad applicability. These features enable real-time 2D and 3D multi-contrast imaging, positioning ESPINNet as a transformative solution for applications in materials science and biomedical research, particularly for high-speed and in situ measurements.
X-ray at-wavelength metrology↗
Modeling and experimental validation of dynamical effects in Bragg coherent x-ray diffractive imaging of finite crystals
Bragg coherent diffractive imaging (BCDI) is a noninvasive microscopy technique that can visualize the shape and internal lattice deviations of crystals with nanoscale spatial resolution and picometer deformation sensitivity. Its strain imaging capability relies on Fourier transform–based iterative phase retrieval algorithms, which are mostly developed under the kinematical approximation. Such approximation prohibits the application of BCDI on larger crystals, which are commonly seen in most emerging functional materials. Understanding the dynamical effect in BCDI, as well as developing a validated method for modeling BCDI at the dynamical diffraction limit, is crucial for applying BCDI to hierarchical systems that contain micron-sized crystals and grains. Thus we report a comparative study on the impact of dynamical diffraction effects by comparing the reconstruction results from two measurements of the same crystal. Forward simulation is implemented to show subtle changes of interference fringes in the diffraction pattern due to the dynamical diffraction, and is compared directly with the experimental data.
36 MATERIALS SCIENCE↗
Wavefront distortion correction in scanning tunneling microscope image
Here, we report an algorithm to identify and correct distorted wavefronts in atomic resolution scanning tunneling microscope images. This algorithm can be used to correct nonlinear in-plane distortions without prior knowledge of the physical scanning parameters, the characteristics of the piezoelectric actuator, or individual atom positions. The 2D image is first defined as a sum of sinusoidal plane waves, where a nonlinear distortion renders a curve for an otherwise ideal linear wavefront. Using the Fourier transforms of local areas of the image, the algorithm generates a wavefront vector field. The identified wavefronts are subsequently linearized for each plane wave without changing lattice orders, giving rise to distortion corrections. Our algorithm is complementary to conventional post-processing algorithms that require prior detection of real space features, which can also be used to correct nonlinear distortions in 2D images acquired by other microscopy techniques.
47 OTHER INSTRUMENTATION↗
Decoding the Mechanisms of Phase Transitions from In Situ Microscopy Observations
Abstract Analysis of the temperature‐ and stimulus‐dependent imaging data toward elucidation of the physical transformations is an ubiquitous problem in multiple fields. Here, temperature‐induced phase transition in BaTiO 3 is explored using the machine learning analysis of domain morphologies visualized via variable‐temperature scanning transmission electron microscopy (STEM) imaging data. This approach is based on the multivariate statistical analysis of the time or temperature dependence of the statistical descriptors of the system, derived in turn from the categorical classification of observed domain structures or projection on the continuous parameter space of the feature extraction‐dimensionality reduction transform. The proposed workflow offers a powerful tool for the exploration of the dynamic data based on the statistics of image representation as a function of the external control variable to visualize the transformation pathways during phase transitions and chemical reactions. This can include the mesoscopic STEM data as demonstrated here, but also optical, chemical imaging, etc., data. It can further be extended to the higher dimensional spaces, for example, analysis of the combinatorial libraries of materials compositions.
Valleti, Sai Mani Prudhvi↗
Thermal Stability of Quasi-1D NbS 3 Nanoribbons and Their Transformation to 2D NbS 2 : Insights from in Situ Electron Microscopy and Spectroscopy
Here in situ electron microscopy imaging and spectroscopy enabled us to study the evolution of quasi-1D NbS 3 -IV nanoribbons with respect to morphology and chemical structure at temperatures between room temperature and 1000 °C. Scanning transmission electron microscopy (STEM) experiments included imaging in the secondary electron, (transmitted) bright field, and high-angle annular dark-field modes while operating in the low kV regime. The results showed that NbS 3 -IV samples transform dramatically from smooth nanoribbons into highly textured configurations featuring polyhedral divots and steps. Similar in situ heating experiments conducted with aberration-corrected STEM revealed that bilayers of NbS 3 -IV chains convert topotactically into aligned 2H-NbS 2 sheets upon loss of sulfur. Atomic resolution imaging, fast Fourier transform analysis, and electron energy loss spectroscopy confirmed these chemical changes, from which we propose an atomistic mechanism for the NbS 3 -IV → 2H-NbS 2 conversion.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Enhanced Spatial Proteomics and Metabolomics from a Single Tissue Section Using MALDI-MSI and LCM-microPOTS Platforms
Spatially resolved mass spectrometry (MS)-based multi-omics workflows are becoming more utilized for revealing the complex biology that occurs within tissues. However, these approaches commonly require multiple independent tissue sections to analyze the metabolite and protein compositions of these samples. This poses a significant challenge in preserving cell- or region-specific molecular fidelity, as variations between tissue sections can compromise the accurate correlation of molecular data. Here, in this study, we developed workflows for comprehensive multi-omics profiling from a single tissue section (STS) using different MS modalities. We enhanced the functionality of an electrically insulated substrate by employing metal-assisted approaches that enabled both MS-based untargeted spatial metabolomics and proteomics from STS. This allowed metabolite imaging using matrix-assisted laser desorption/ionization-MS imaging (MALDI-MSI), without compromising it for subsequent proteome profiling with laser capture microdissection (LCM)-based technology. Specifically, implementing copper tape as a backing for polyethylene naphthalate (PEN) slides enabled the detection of >140 metabolites across a poplar root tissue section using MALDI-trapped ion mobility spectrometry time of flight (timsTOF)-MS. Afterwards, we detected 6,571 unique proteins from two distinct root regions by leveraging LCM technology coupled to our microdroplet based sample preparation approach. We also developed an alternative workflow utilizing gold-coated PEN substrates for imaging with MALDI-Fourier-transform ion cyclotron resonance (FTICR)-MS, which permitted the profiling of >170 metabolites and the identification of 6,542 unique proteins across a single poplar root tissue section. These results were comparable to using each assay independently without modifications. These approaches offer new opportunities for high-resolution molecular profiling of multiple omics-levels across biological tissues.
Veličković, Marija [Pacific Northwest National Lab↗
Advanced nanoscale characterization of aluminum nanoparticles with modified surface morphology via atmospheric helium and carbon monoxide plasmas
Aluminum nanoparticles (nAl) have the potential as energetic additives in explosive/propellant formulations. Scalable methodologies must be pursued to mitigate the inactive amorphous alumina shell surrounding the active aluminum (Al) core with modified surface morphology and chemistry for increased combustion effects. This work explores the feasibility of making reactive core/shell nAl with thinned oxide shells and modified surface coatings via a two-step atmospheric plasma surface treatment process in a custom dielectric barrier discharge plasma reactor. The commercial nAl of nominal average size similar to 40-60nm was first treated with helium (He) followed by He/carbon monoxide (CO) plasmas for different durations. The resultant samples were characterized via high-resolution transmission electron microscopy (HRTEM) and Fourier transform IR (FTIR) spectra. HRTEM images revealed sporadic patchy gamma -alumina deposits on particle surfaces and in gaps among particles for all samples, suggesting the non-uniform plasma effects of the He/CO glow. Nanoscale chemical analyses via scanning transmission electron microscopy elemental mapping and x-ray energy dispersive spectroscopy were further performed. Although no carbon-associated structure appeared in electron energy loss spectroscopy (EELS) spectra, the presence of carbonaceous materials was confirmed as a thin dispersive layer evenly distributed on the nAl surface suggesting either its amorphous nature or is present at a level insufficient to generate satisfactory EELS spectra. The trend of intensity profiles for key elements acquired by drawing lines across a single particle on the elemental maps confirmed that carbonaceous materials only existed on the surface and they were most likely carboxylates that increased with increased He/CO treatment duration, as evident by FTIR results. Finally, this work demonstrated the success of atmospheric plasma-treated reactive nAl with comprehensively characterized surface features via advanced microscopy and spectroscopy.
36 MATERIALS SCIENCE↗