Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Transforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Toward accurate measurement of electromagnetic field by retrieving and refining the center position of non-uniform diffraction disks in Lorentz 4D-STEM

Recent advancement in scanning transmission electron microscopy (STEM) allows the use of 4D-STEM, a technique that captures an electron diffraction pattern at each scan point in STEM, to measure electrostatic and magnetic potential and field in materials. However, accurate measurement, separation of the magnetic and electric signals, and removal of artifacts remain challenging, especially in the presence of complex non-uniform diffraction contrast within the disks. In this work, based on dynamic simulations of 4D-STEM patterns built upon superstructures consisting of millions of atoms to account for different sample thickness and edge geometries, we show how the shape and intensity distribution of the central disk are affected by multiple scattering. We propose a robust refinement procedure through iteration of the spin-sensitive peak position of the disk-center in the circular Hough transform filtered images from experimental Lorentz 4D-STEM dataset after minimizing the possible artifacts, such as those due to the change of thickness, dynamic scattering, and scanning process. We verify that caution must be taken as in practice the rigid-disk-shift model used to reconstruct induction maps can easily break down due to disk-protrusion when there exists a nonconstant phase gradient or thickness within the width of the probe. Through quantitative analysis and comparing experiment with calculation the effect of the non-spin-related intensity distribution inside the disk as well as that causes the disk shift due to the intensity-protrusion can be removed, and high-quality magnetic field mapping is possible.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Spectral Performance of Multilayer Amorphous Selenium and Selenium–Tellurium Photodetectors

The ability to robustly and with scalability detect single photons in the visible spectrum with wavelength resolution would transform many imaging applications. Theoretical studies propose an array of carbon nanotubes (CNTs) functionalized with semiconductor quantum dots (QDs) as a physical realization of such photon sensors. In this work, we report approaches to synthesize these CNT-QD nanostructures using DNA as a smart glue to connect CNTs to QDs.

36 MATERIALS SCIENCE↗
DOE OSTI2026

3D reconstruction and neural rendering for adversarial machine learning

While evasion attacks on computer vision systems have been widely studied, creating attacks that remain effective under significant changes in viewpoint continues to be challenging. Traditional approaches often rely on affine transformations of images, but these approaches degrade at larger perspective shifts and often produce unrealistic or ineffective perturbations. Recent methods use differentiable renderers to improve viewpoint robustness, but they typically depend on manually constructed 3D models. We introduce a semi-automated pipeline that generates physically printable and perspective-invariant adversarial patches using only a small set of 2D images. Our method integrates 3D reconstruction, neural rendering, adversarial patch optimization, and an object detection victim model into a unified workflow. We use 2D Gaussian Splatting for high fidelity mesh reconstruction and FlexPara for surface parameterization that produces texture maps suitable for patch editing. Together, these components form a fully differentiable pipeline in PyTorch3D that links texture modification to model outputs, enabling efficient optimization of patches that remain effective across many viewpoints. The complete process, from image capture to patch printing and physical evaluation, can be completed within a few hours. We demonstrate the effectiveness of the resulting patches through attacks on the YOLOv8 object detection model and discuss remaining challenges and opportunities for improving robustness and scalability.

Singhvi, Vivaan [ORNL] (ORCID:0009000586288221)↗
DOE OSTI2025

Topology-imprinting in nonlinear metasurfaces

Flat optical components, or metasurfaces, have transformed optical imaging, data storage, information processing, and biomedical applications by providing unprecedented control over light-matter interactions. These nano-engineered structures enable compact, multidimensional manipulation of light’s amplitude, phase, polarization, and wavefront, producing scalar and vector beams with unique properties such as orbital angular momentum and knotted topologies. This flexibility has potential applications in optical communication and imaging, particularly in complex environments such as atmospheric turbulence and undersea scattering. However, designing metasurfaces for shorter wavelengths, such as visible and ultraviolet light, remains challenging due to fabrication limitations and material absorption. Here, we introduce an innovative concept called topology imprinting using judiciously designed all-dielectric nonlinear optical metasurfaces to replicate desired waveforms at fundamental and harmonic frequencies, opening promising avenues for advanced photonic applications.

42 ENGINEERING↗
DOE OSTI2024

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗
DOE OSTI2023

Synthetic Promoter Screening Using Poplar Mesophyll Protoplast Transformation

Plant protoplasts are useful to study both transcriptional regulation and protein subcellular localization in rapid screens. Protoplast transformation can be used in automated platforms for design-build-test cycles of plant promoters, including synthetic promoters. A notable application of protoplasts comes from recent successes in dissecting synthetic promoter activity with poplar mesophyll protoplasts. For this purpose, we constructed plasmids with TurboGFP driven by a synthetic promoter together with TurboRFP constitutively controlled by a 35S promoter, to monitor transformation efficiency, allowing versatile screening of high numbers of cells by monitoring green fluorescent protein expression in transformed protoplasts. Herein, we introduce a protocol for poplar mesophyll protoplast isolation followed by protoplast transformation and image analysis for the selection of valuable synthetic promoters.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Boundary detection evaluation

Illustrative embodiments are directed to a method and apparatus for evaluating boundary detection in an image. A processed image is received, wherein a detected boundary of an image of an object is identified in the processed image. A Radon transform is applied to the processed image for a plurality of angles to form a processed image histogram corresponding to the detected boundary for each of the plurality of angles. The processed image histogram for each of the plurality of angles and a corresponding ground truth histogram for each of the plurality of angles is normalized to provide a normalized processed image histogram and a normalized ground truth histogram for each of the plurality of angles, wherein the ground truth histogram corresponds to a ground truth boundary of the object for a corresponding angle. An indication of the edges of the normalized processed image histogram for each of the plurality of angles is plotted to form a boundary detection evaluation visualization.

Wantuch, Andrew C.↗
DOE OSTI2024

Boundary detection evaluation

Illustrative embodiments are directed to a method and apparatus for evaluating boundary detection in an image. A processed image is received, wherein a detected boundary of an image of an object is identified in the processed image. A Radon transform is applied to the processed image for a plurality of angles to form a processed image histogram corresponding to the detected boundary for each of the plurality of angles. The processed image histogram for each of the plurality of angles and a corresponding ground truth histogram for each of the plurality of angles is normalized to provide a normalized processed image histogram and a normalized ground truth histogram for each of the plurality of angles, wherein the ground truth histogram corresponds to a ground truth boundary of the object for a corresponding angle. An indication of the edges of the normalized processed image histogram for each of the plurality of angles is plotted to form a boundary detection evaluation visualization.

Wantuch, Andrew C.↗
DOE OSTI2020

Analysis of laser-induced modification of collagen structure using nonlinear optical microscopy

Nonlinear optical microscopy is used to monitor changes in the collagen structure of patellar ligament after IR laser heating up to a temperature of 60 °C. Pre-denaturation modification of the tissue matrix exhibits specific properties and consists in splitting of initially parallel fibre bundles into array of divergent fibres. Image processing employing Fast Fourier transform analysis is used for characterising images of the fibre structure and determining the collagen orientation index. An increase in manifestation of laser-induced disordering with an increase in IR laser radiation power from 0.3 to 2 W is accompanied by a decrease in the collagen orientation index. The specific disorganisation of the collagen tissue structure during laser heating is supposed to be due to fast speed and local action of the laser heating, which leads to mechanical distortions of the structural elements of tissue matrix. (paper)

36 MATERIALS SCIENCE↗
DOE OSTI2021

A VR-based volumetric medical image segmentation and visualization system with natural human interaction

Volume rendering produces informative two-dimensional (2D) images from a 3-dimensional (3D) volume. It highlights the region of interest and facilitates a good comprehension of the entire data set. However, volume rendering faces a few challenges. First, a high-dimensional transfer function is usually required to differentiate the target from its neighboring objects with subtle variance. Unfortunately, designing such a transfer function is a strenuously trial-and-error process. Second, manipulating/visualizing a 3D volume with a traditional 2D input/output device suffers dimensional limitations. To address all the challenges, we design NUI-VR 2 , a natural user interface-enabled volume rendering system in the virtual reality space. NUI-VR 2 marries volume rendering and interactive image segmentation. It transforms the original volume into a probability map with image segmentation. A simple linear transfer function will highlight the target well in the probability map. More importantly, we set the entire image segmentation and volume rendering pipeline in an immersive virtual reality environment with a natural user interface. NUI-VR 2 eliminates the dimensional limitations in manipulating and perceiving 3D volumes and dramatically improves the user experience.

42 ENGINEERING↗
DOE OSTI2022

Facile alignment estimation in carbon nanotube films using image processing

Whether a macroscopic assembly of carbon nanotubes can exhibit the one-dimensional properties expected from individual nanotubes critically depends on how well the nanotubes are aligned inside the assembly. Therefore, a simple and accurate method for assessing the degree of alignment is desired for the rapid characterization of carbon nanotube films and fibers. Here, we present an end-to-end solution for determining the global and local spatial orientation of carbon nanotubes in films within a short amount of time using a fast, precise, and economical approach based on an image processing method applied to scanning electron microscopy images. Further, we first use Laplacian edge enhancement filtering for improving the appearance of edge regions, which is followed by image partitioning into multiple blocks to capture the nanoscale orientation characteristics and total variation-based image decomposition of these image blocks. We then perform a 2D-fast Fourier transform on the image decomposed textural components of these edge-enhanced image blocks to determine the orientation distribution, which is utilized to estimate the 2D nematic order parameter. To show the effectiveness of our method, we corroborated our results against results obtained with other state-of-the-art image processing and experimental techniques.

2D-FFT↗
DOE OSTI2025

Broadband Fourier-Transform Optical Photothermal Infrared Spectroscopy and Imaging

Infrared (IR) spectroscopy is a powerful method for mapping chemical heterogeneity on the microscale. Synchrotron IR radiation uniquely provides a high brightness and broad bandwidth to further extend the capabilities of IR spectroscopic imaging. However, the diffraction-limited spatial resolution of IR spectroscopy is insufficient for studies requiring submicrometer spatial differentiation. Optical photothermal IR (O-PTIR) microscopy is a powerful, emerging method that overcomes the IR diffraction limit in IR hyperspectral imaging by employing a modulated IR beam and a visible probe laser beam to detect local temperature-induced modulation at the visible diffraction limit. In this work, we extend the spectral range of photothermal infrared measurements by incorporating a synchrotron IR source, demonstrating a combined synchrotron-based O-PTIR modality that enables high spatial resolution far-field chemical imaging spanning the entire mid-IR range. Both optical- and fluorescence-detected photothermal modalities were performed using a step-scan interferometer, demonstrating improved spectral range (541-4000 cm-1) when compared to optical photothermal microscopy with commercial laser sources (800-1800 cm-1 for this particular source) and improved spatial resolution, when compared to synchrotron microspectroscopy measurements. Following these initial validation studies, synchrotron Fourier-transform fluorescence-detected photothermal IR spectroscopy in combination with synchrotron microspectroscopy measurements was used to differentiate cells in mouse brain tissue sections, which requires submicron spatial resolutions beyond those accessible by IR spectroscopy alone.

Razumtcev, Aleksandr↗
DOE OSTI2024

Correlative multimodal chemical imaging via machine learning

Machine learning approach can combine mass spectral imaging (MSI) techniques, one with low spatial resolution but intact molecular spectra and the other with nanometer spatial resolution but fragmented molecular signatures, to predict molecular MSI spectra with submicron spatial resolution. The machine learning approach can perform transformations on the spectral image data of the two MSI techniques to reduce dimensionality, and using a correlation technique, find relationships between the transformed spectral image data. The determined relationships can be used to generate MSI spectra of desired resolution.

Ovchinnikova, Olga S.↗
DOE OSTI2021

Imaging, understanding, and control of nanoscale materials transformations

The development of liquid cells for transmission electron microscopy has enabled breakthroughs in our ability to follow nanoscale structural, morphological, or chemical changes during materials growth and applications. Time-resolved high-resolution imaging and chemical analysis through liquids opened the opportunity to capture nanoscale dynamic processes of materials, including reaction intermediates and the transformation pathways. In this article, a series of work is highlighted with topics ranging from liquid cell developments to in situ studies of nanocrystal growth and transformations, dendrite formation, and suppression of lithium dendrites through in situ characterization of the solid–electrolyte interphase chemistry. The understanding garnered is expected to accelerate the discovery of novel materials for applications in energy storage, catalysis, sensors, and other functional devices.

36 MATERIALS SCIENCE↗
DOE OSTI2025

SHF: Symmetrical Hierarchical Forest with Pretrained Vision Transformer Encoder for High-Resolution Medical Segmentation

This paper presents a novel approach to addressing the long-sequence problem in high-resolution medical images for Vision Transformers (ViTs). Using smaller patches as tokens can enhance ViT performance, but quadratically increases computation and memory requirements. Therefore, the common practice for applying ViTs to high-resolution images is either to: (a) employ complex sub-quadratic attention schemes or (b) use large to medium-sized patches and rely on additional mechanisms within the model to capture the spatial hierarchy of details. We propose Symmetrical Hierarchical Forest (SHF), a lightweight approach that adaptively patches the input image to increase token information density and encode hierarchical spatial structures into the input embedding. We then apply a reverse depatching scheme to the output embeddings of the transformer encoder, eliminating the need for convolution-based decoders. Unlike previous methods that modify attention mechanisms or use a complex hierarchy of interacting models, SHF can be retrofitted to any ViT model to allow it to learn the hierarchical structure of details in high-resolution images without requiring architectural changes. Experimental results demonstrate significant gains in computational efficiency and performance: on the PAIP WSI dataset, we achieved a 3∼32×speedup or a 2.95%∼7.03% increase in accuracy (measured by Dice score) at a 64K2 resolution with the same computational budget, compared to state-of-the-art production models. On the 3D medical datasets BTCV and KiTS, training was 6×faster, with accuracy gains of 6.93% and 5.9%, respectively, compared to models without SHF.

Zhang, Enzhi [Hokkaido University, Japan]↗
DOE OSTI2024

All-optical image denoising using a diffractive visual processor

Abstract Image denoising, one of the essential inverse problems, targets to remove noise/artifacts from input images. In general, digital image denoising algorithms, executed on computers, present latency due to several iterations implemented in, e.g., graphics processing units (GPUs). While deep learning-enabled methods can operate non-iteratively, they also introduce latency and impose a significant computational burden, leading to increased power consumption. Here, we introduce an analog diffractive image denoiser to all-optically and non-iteratively clean various forms of noise and artifacts from input images – implemented at the speed of light propagation within a thin diffractive visual processor that axially spans <250 × λ, where λ is the wavelength of light. This all-optical image denoiser comprises passive transmissive layers optimized using deep learning to physically scatter the optical modes that represent various noise features, causing them to miss the output image Field-of-View (FoV) while retaining the object features of interest. Our results show that these diffractive denoisers can efficiently remove salt and pepper noise and image rendering-related spatial artifacts from input phase or intensity images while achieving an output power efficiency of ~30–40%. We experimentally demonstrated the effectiveness of this analog denoiser architecture using a 3D-printed diffractive visual processor operating at the terahertz spectrum. Owing to their speed, power-efficiency, and minimal computational overhead, all-optical diffractive denoisers can be transformative for various image display and projection systems, including, e.g., holographic displays.

36 MATERIALS SCIENCE↗