Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Transforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Atom-by-atom imaging of moiré transformations in 2D transition metal dichalcogenides

Understanding the atomic-scale mechanisms that govern the structure of interfaces is critical across materials systems but particularly so for two-dimensional (2D) moiré materials. Here, we image, atom-by-atom, the thermally induced structural evolution of twisted bilayer transition metal dichalcogenides using in situ transmission electron microscopy. We observe low-temperature, local conversion of moiré superlattice into nanoscale aligned domains. Unexpectedly, this process occurs by nucleating a new grain within one monolayer, whose crystal orientation is templated by the other. The aligned domains grow through collective rotation of moiré supercells and hopping of 5|7 defect pairs at moiré boundaries. This provides mechanistic insight into the atomic-scale interactions controlling moiré structures and illustrates the potential to pattern interfacial structure and properties of 2D materials at the nanoscale.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Positron Emission Tomography Imaging of Functional Transforming Growth Factor β (TGFβ) Activity and Benefit of TGFβ Inhibition in Irradiated Intracranial Tumors

Transforming growth factor β (TGFβ) promotes cell survival by endorsing DNA damage repair and mediates an immunosuppressive tumor microenvironment. Thus, TGFβ activation in response to radiation therapy is potentially targetable because it opposes therapeutic control. Strategies to assess this potential in the clinic are needed.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

Snapshot multispectral imaging using a diffractive optical network

Abstract Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum, and at the same time, routes a pre-determined set of spectral channels onto an array of pixels at the output plane, converting a monochrome focal-plane array or image sensor into a multispectral imaging device without any spectral filters or image recovery algorithms. Furthermore, the spectral responsivity of this diffractive multispectral imager is not sensitive to input polarization states. Through numerical simulations, we present different diffractive network designs that achieve snapshot multispectral imaging with 4, 9 and 16 unique spectral bands within the visible spectrum, based on passive spatially-structured diffractive surfaces, with a compact design that axially spans ~72 λ m , where λ m is the mean wavelength of the spectral band of interest. Moreover, we experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network that creates at its output image plane a spatially repeating virtual spectral filter array with 2 × 2 = 4 unique bands at terahertz spectrum. Due to their compact form factor and computation-free, power-efficient and polarization-insensitive forward operation, diffractive multispectral imagers can be transformative for various imaging and sensing applications and be used at different parts of the electromagnetic spectrum where high-density and wide-area multispectral pixel arrays are not widely available.

36 MATERIALS SCIENCE↗
DOE OSTI2024

AstroCLIP: a cross-modal foundation model for galaxies

ABSTRACT We present AstroCLIP, a single, versatile model that can embed both galaxy images and spectra into a shared, physically meaningful latent space. These embeddings can then be used – without any model fine-tuning – for a variety of downstream tasks including (1) accurate in-modality and cross-modality semantic similarity search, (2) photometric redshift estimation, (3) galaxy property estimation from both images and spectra, and (4) morphology classification. Our approach to implementing AstroCLIP consists of two parts. First, we embed galaxy images and spectra separately by pre-training separate transformer-based image and spectrum encoders in self-supervised settings. We then align the encoders using a contrastive loss. We apply our method to spectra from the Dark Energy Spectroscopic Instrument and images from its corresponding Legacy Imaging Survey. Overall, we find remarkable performance on all downstream tasks, even relative to supervised baselines. For example, for a task like photometric redshift prediction, we find similar performance to a specifically trained ResNet18, and for additional tasks like physical property estimation (stellar mass, age, metallicity, and specific-star-formation rate), we beat this supervised baseline by 19 per cent in terms of R2. We also compare our results with a state-of-the-art self-supervised single-modal model for galaxy images, and find that our approach outperforms this benchmark by roughly a factor of two on photometric redshift estimation and physical property prediction in terms of R2, while remaining roughly in-line in terms of morphology classification. Ultimately, our approach represents the first cross-modal self-supervised model for galaxies, and the first self-supervised transformer-based architectures for galaxy images and spectra.

Parker, Liam (ORCID:0009000749521674)↗
DOE OSTI2025

A bi-channel aided stitching of atomic force microscopy images

Microscopy is an essential tool in scientific research, enabling the visualization of structures at micro- and nanoscale resolutions. However, the field of microscopy often encounters limitations in field-of-view (FOV), restricting the amount of sample that can be imaged in a single capture. To overcome this limitation, image stitching techniques have been developed to seamlessly merge multiple overlapping images into a single, high-resolution composite. The images collected from microscope need to be optimally stitched before accurate physical information can be extracted from post analysis. However, the existing stitching tools either struggle to stitch images together when the microscopy images are feature sparse or cannot address all the transformations of images when performing image stitching. To address these issues, we propose a bi-channel aided feature-based image stitching method and demonstrate its use on Atomic Force Microscopy (AFM) generated Pantoea sp. YR343 biofilm and PTO thin film sample images as experimental data. The topographical channel image of AFM data captures the morphological details of the sample, and a stitched topographical image is desired for researchers. We utilize the amplitude and phase channels of AFM data to maximize the matching features and to estimate the position of the original topographical images and show that the proposed bi-channel aided stitching method outperforms the traditional direct stitching approach in AFM topographical image stitching task. Here, we demonstrated the application on AFM, but similar approaches could be employed of optical microscopy with brightfield and fluorescence channels. We believe this proposed workflow can serve as a valuable augmentation strategy for microscopy image stitching tasks and will benefit the experimentalist to avoid erroneous analysis and discovery due to incorrect stitching.

Atomic force microscopy↗
DOE OSTI2020

General approaches for shear-correcting coordinate transformations in Bragg coherent diffraction imaging. Part II

X-ray Bragg coherent diffraction imaging (BCDI) has been demonstrated as a powerful 3D microscopy approach for the investigation of sub-micrometre-scale crystalline particles. The approach is based on the measurement of a series of coherent Bragg diffraction intensity patterns that are numerically inverted to retrieve an image of the spatial distribution of the relative phase and amplitude of the Bragg structure factor of the diffracting sample. This 3D information, which is collected through an angular rotation of the sample, is necessarily obtained in a non-orthogonal frame in Fourier space that must be eventually reconciled. To deal with this, the approach currently favored by practitioners (detailed in Part I) is to perform the entire inversion in conjugate non-orthogonal real- and Fourier-space frames, and to transform the 3D sample image into an orthogonal frame as a post-processing step for result analysis. In this article, which is a direct follow-up of Part I, two different transformation strategies are demonstrated, which enable the entire inversion procedure of the measured data set to be performed in an orthogonal frame. The new approaches described here build mathematical and numerical frameworks that apply to the cases of evenly and non-evenly sampled data along the direction of sample rotation ( i.e. the rocking curve). The value of these methods is that they rely on the experimental geometry, and they incorporate significantly more information about that geometry into the design of the phase-retrieval Fourier transformation than the strategy presented in Part I. Finally, two important outcomes are (1) that the resulting sample image is correctly interpreted in a shear-free frame and (2) physically realistic constraints of BCDI phase retrieval that are difficult to implement with current methods are easily incorporated. Computing scripts are also given to aid readers in the implementation of the proposed formalisms.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Operando real-space imaging of a structural phase transformation in the high-voltage electrode LixNi0.5Mn1.5O4

Abstract Discontinuous solid-solid phase transformations play a pivotal role in determining the properties of rechargeable battery electrodes. By leveraging operando Bragg Coherent Diffractive Imaging (BCDI), we investigate the discontinuous phase transformation in Li x Ni 0.5 Mn 1.5 O 4 within an operational Li metal coin cell. Throughout Li-intercalation, we directly observe the nucleation and growth of the Li-rich phase within the initially charged Li-poor phase in a 500 nm particle. Supported by the microelasticity model, the operando imaging unveils an evolution from a curved coherent to a planar semi-coherent interface driven by dislocation dynamics. Our data indicates negligible kinetic limitations from interface propagation impacting the transformation kinetics, even at a discharge rate of C/2 (80 mA/g). This study highlights BCDI’s capability to decode complex operando diffraction data, offering exciting opportunities to study nanoscale phase transformations with various stimuli.

Sun, Yifei (ORCID:0000000295625120)↗
DOE OSTI2023

Oracle-Preserving Latent Flows

A fundamental task in data science is the discovery, description, and identification of any symmetries present in the data. We developed a deep learning methodology for the simultaneous discovery of multiple non-trivial continuous symmetries across an entire labeled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function, ensuring the desired symmetry properties. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to invariant transformations with respect to high-dimensional oracles. The method is demonstrated with several examples on the MNIST digit dataset, where the oracle is provided by the 10-dimensional vector of logits of a trained classifier. We find classes of symmetries that transform each image from the dataset into new synthetic images while conserving the values of the logits. We illustrate these transformations as lines of equal probability (“flows”) in the reduced latent space. These results show that symmetries in the data can be successfully searched for and identified as interpretable non-trivial transformations in the equivalent latent space.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Pxl

The code consists of several scripts. The image is fetched from a predefined URL, downloaded, and is displayed in the virtual environment at a predefined location. The image is also dynamically scaled to fit in the virtual environment depending on its size. The image is sent to have each pixel's value written to a CSV file. While the CSV is being written, a dictionary is populated with values that map each pixel to a temperature reading. The image's height, width, position and references to its corners are sent to make a button that is the same size as the image and placed right behind the image in the virtual scene. The button defines behavior that should be triggered when the user pushes the image. Unity provides visual cues that alert the user when they are about to touch something in the virtual environment. The code holds references to the cues for the left and right hands. The button queries the cue tracker and receives the position of the active cue in the form of a 3D vector. The 3D vector is compared to the bottom left corner of the image to transform the world space coordinates of the cue to the pixel space of the image. The specific pixel is approximated relative to how far left and up the user touched from the bottom left corner of the image. The approximated pixel value, which is represented as a coordinate in 2D space, is used to retrieve the temperature value associated with the approximated pixel. A window of text is then updated to display the temperature reading.

. Otis, KrystianeS [Idaho National Laboratory (INL↗
DOE OSTI2020

General approaches for shear-correcting coordinate transformations in Bragg coherent diffraction imaging. Part I

This two-part article series provides a generalized description of the scattering geometry of Bragg coherent diffraction imaging (BCDI) experiments, the shear distortion effects inherent in the 3D image obtained from presently used methods and strategies to mitigate this distortion. Part I starts from fundamental considerations to present the general real-space coordinate transformation required to correct this shear, in a compact operator formulation that easily lends itself to implementation with available software packages. Such a transformation, applied as a final post-processing step following phase retrieval, is crucial for arriving at an undistorted, correctly oriented and physically meaningful image of the 3D crystalline scatterer. As the relevance of BCDI grows in the field of materials characterization, the available sparse literature that addresses the geometric theory of BCDI and the subsequent analysis methods are generalized here. This geometrical aspect, specific to coherent Bragg diffraction and absent in 2D transmission CDI experiments, gains particular importance when it comes to spatially resolved characterization of 3D crystalline materials in a reliable nondestructive manner. This series of articles describes this theory, from the diffraction in Bragg geometry to the corrections needed to obtain a properly rendered digital image of the 3D scatterer. Part I of this series provides the experimental BCDI community with the general form of the 3D real-space distortions in the phase-retrieved object, along with the necessary post-retrieval correction method. Part II builds upon the geometric theory developed in Part I with the formalism to correct the shear distortions directly on an orthogonal grid within the phase-retrieval algorithm itself, allowing more physically realistic constraints to be applied. Taken together, Parts I and II provide the X-ray science community with a set of generalized BCDI shear-correction techniques crucial to the final rendering of a 3D crystalline scatterer and for the development of new BCDI methods and experiments.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Rotational Millimeter-Wave Shoe Scanner Using the Discrete Fourier Transform for Backprojection-Based Image Reconstruction

An active 3D microwave / millimeter-wave shoe scanner was previously developed at the Pacific Northwest National Laboratory (PNNL) using two linear arrays scanned over a rectilinear aperture. The radar system chirps a frequency sweep from 10-40 GHz. These frequencies allow imaging through optically opaque material such as leather, rubber, plastics, and other dielectrics. The system was designed to detect concealed items in the soles of shoes while allowing people to leave their shoes on through a security checkpoint. To shrink the footprint of the system, a new iteration of the design has been developed that scans the two linear arrays over a circular aperture. This new footprint opens the possibility of it being installed in the floor of a cylindrical millimeter-wave body scanner. The backprojection-based multilayer dielectric image reconstruction developed at PNNL can easily handle arbitrary spatial sampling, accommodating the new rotational shoe scanner design. Commonly, the fast Fourier transform (FFT) is used to efficiently compute the range response from the data collected by the system as a preprocessing step to the backprojection algorithm. It was found that converting to range using the discrete Fourier transform (DFT) directly has some advantages over the FFT. For example, nonlinear and non-uniform frequency sweeps can easily be compensated for during the computation of the DFT and only the range bins of interest need to be computed and their spacing can be chosen arbitrarily. Because the range conversion step of the image reconstruction is the fastest part of the process there is very little speed penalty for using the DFT over the FFT and it can even increase the speed of image reconstruction when the ranges of interest are fewer than the total span that is calculated in the FFT.

Millimeter-wave imaging, microwave imaging, shoe s↗
DOE OSTI2023

Using Ultrasound Image Augmentation and Ensemble Predictions to Prevent Machine-Learning Model Overfitting

Deep learning predictive models have the potential to simplify and automate medical imaging diagnostics by lowering the skill threshold for image interpretation. However, this requires predictive models that are generalized to handle subject variability as seen clinically. Here, we highlight methods to improve test accuracy of an image classifier model for shrapnel identification using tissue phantom image sets. Using a previously developed image classifier neural network—termed ShrapML—blind test accuracy was less than 70% and was variable depending on the training/test data setup, as determined by a leave one subject out (LOSO) holdout methodology. Introduction of affine transformations for image augmentation or MixUp methodologies to generate additional training sets improved model performance and overall accuracy improved to 75%. Further improvements were made by aggregating predictions across five LOSO holdouts. This was done by bagging confidences or predictions from all LOSOs or the top-3 LOSO confidence models for each image prediction. Top-3 LOSO confidence bagging performed best, with test accuracy improved to greater than 85% accuracy for two different blind tissue phantoms. This was confirmed by gradient-weighted class activation mapping to highlight that the image classifier was tracking shrapnel in the image sets. Overall, data augmentation and ensemble prediction approaches were suitable for creating more generalized predictive models for ultrasound image analysis, a critical step for real-time diagnostic deployment.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

FTIR imaging identifies alterations in lung tissue structure and biochemical composition in human idiopathic pulmonary fibrosis

Idiopathic Pulmonary Fibrosis (IPF) is a chronic, progressive, and fatal lung disease characterized by damage to the epithelial tissue and a reduced ability of the alveoli to repair themselves. This impaired repair process leads to abnormal accumulation of extracellular matrix (ECM), resulting in scarring and stiffening of lung tissue. Fourier transform infrared imaging (FTIRI) is a promising technique for imaging the biochemical changes related to fibrotic changes in a label-free and non-destructive manner, which can be analyzed to mark the progression of IPF. In this study, FTIRI was used to image human lung tissue biopsies with IPF and control biopsies without disease. In-depth spectral analyses were performed to observe the biochemical changes in the tissue composition using FTIRI. The parameters that were analyzed included collagen structure, total lipid content, lipid chain length, and phospholipids. Results showed a significant increase in lipid content in IPF compared to control, where long chain lipids dominated and phospholipids were reduced. Minor changes in collagen structure were also observed in IPF, likely attributed to the excess formation of extracellular matrix in the disease. These findings indicate that FTIRI has the potential to be a promising diagnostic technique to understand the molecular changes during IPF, as analysis of infrared data can reveal detailed biochemical information regarding disease progression and provide spatial insights on the molecular changes across the IPF lung tissue.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Contaminant Investigation and Pre‐Processing Opportunities for Textile‐To‐Textile Recycling

Millions of metric tons of textiles are landfilled or incinerated each year in the United States, with less than 1% of textiles recycled into new clothing or fabrics. To counter this trend, a growing number of companies and researchers are exploring how a circular economy can be applied to support textile‐to‐textile recycling. A significant barrier they face comes down to quickly and efficiently extracting pure feedstock material from post‐consumer garments that feature a mix of natural and synthetic fibers. Textile recyclers prefer pure feedstocks, as working with mixed sources typically means lower throughput, higher risk of equipment failure, and diminished business margins. To facilitate a circular economy for textiles, methods, and technologies are needed that can efficiently separate out materials and contaminants from end‐of‐life textiles to increase the flow of pure feedstocks to recyclers. This paper summarizes findings from interviews with a cross section of textile recyclers and from a review of literature to define basic feedstock requirements. In addition to our qualitative research, we deconstruct a bale of post‐consumer textiles and analyze them using computer‐vision imaging, Fourier transform infrared spectroscopy (FTIR), and machine learning. The resulting data are used to set system‐level design inputs for an automated contaminant removal system to process post‐consumer clothing into appropriate feedstocks for recycling. To set the system's levels for automated real‐time near‐infrared analysis, we identify the minimum percentage of primary material that any single garment in a load of used clothing must contain for the average of the full output stream to meet the target purity levels of recyclers. Here, the envisioned automated system can also address undesirable trace materials that might contaminate the processed stream by using imaging cameras coupled with artificial intelligence to identify sections of clothing for de‐trimming. Proof‐of‐concept machine learning algorithms are evaluated to locate and identify trims or garment areas with hidden contaminant materials. Integrating these methods into automated textile cutting systems can provide a cost‐effective means for increasing feedstock purity from used clothing, which can advance circularity for textiles by helping recyclers to reach production volumes and quality targets that were not possible solely with manual dismantling operations.

Parsons, Ryan [Rochester Institute of Technology, ↗
DOE OSTI2021

Converting tabular data into images for deep learning with convolutional neural networks

Abstract Convolutional neural networks (CNNs) have been successfully used in many applications where important information about data is embedded in the order of features, such as speech and imaging. However, most tabular data do not assume a spatial relationship between features, and thus are unsuitable for modeling using CNNs. To meet this challenge, we develop a novel algorithm, image generator for tabular data (IGTD), to transform tabular data into images by assigning features to pixel positions so that similar features are close to each other in the image. The algorithm searches for an optimized assignment by minimizing the difference between the ranking of distances between features and the ranking of distances between their assigned pixels in the image. We apply IGTD to transform gene expression profiles of cancer cell lines (CCLs) and molecular descriptors of drugs into their respective image representations. Compared with existing transformation methods, IGTD generates compact image representations with better preservation of feature neighborhood structure. Evaluated on benchmark drug screening datasets, CNNs trained on IGTD image representations of CCLs and drugs exhibit a better performance of predicting anti-cancer drug response than both CNNs trained on alternative image representations and prediction models trained on the original tabular data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Osteoporosis Treatments Affect Bone Matrix Maturation in a Rat Model of Induced Cortical Remodeling

ABSTRACT To test how osteoporosis drugs affect bone matrix maturation during cortical bone remodeling, 72 pregnant rats were switched from a 0.4% to a 0.01% calcium diet at parturition for a 23‐day lactation period. At weaning, eight dams were sacrificed to establish baseline values, while the remaining dams were returned to 0.4% calcium and treated with vehicle (saline), sodium fluoride (NaF), zoledronic acid (ZA), or sclerostin antibody (Scl‐Ab) for either 7 or 28 days (eight animals per group per time point). Femora were examined by μCT, dynamic histomorphometry, Fourier transform infrared imaging, and three‐point bending of notched specimens. Cortical porosity decreased in all groups from baseline to day 28. Intracortical mineralizing surface (MS/BS) and mineral apposition rate (MAR), as well as the mineral‐to‐matrix ratio were unaffected by treatment, but intracortical crystallinity was increased in the ZA group at day 10 compared with vehicle. Cortical area increased in all groups over 28 days mainly because of an addition of bone at the endocortical surface. Endocortical MS/BS did not vary among the groups, but endocortical MAR was suppressed in the NaF group at day 2 and elevated in the Scl‐Ab group at day 4 compared with vehicle. Endocortical mineral‐to‐matrix ratio was increased at days 5 and 10 following NaF treatment and endocortical crystallinity was increased at day 5 following ZA treatment compared with vehicle. Fracture toughness did not differ among the groups. Thus, the treatments affected matrix maturation more strongly at the endocortical then intracortical envelope. In this model of induced remodeling, the bone formation phase is synchronized at multiple sites, facilitating study of the effects of drugs or other bone‐targeting agents on matrix maturation independent of their effects on the initiation of remodeling. © 2020 The Authors. JBMR Plus published by Wiley Periodicals, Inc. on behalf of American Society for Bone and Mineral Research.

59 BASIC BIOLOGICAL SCIENCES↗