Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Transforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

MultiTaskDeltaNet: change detection-based image segmentation for operando ETEM with application to carbon gasification kinetics

Transforming in situ transmission electron microscopy (TEM) imaging into a tool for spatially-resolved operando characterization of solid-state reactions requires automated, high-precision semantic segmentation of dynamically evolving features. However, traditional deep learning methods for semantic segmentation often face limitations due to the scarcity of labeled data, visually ambiguous features of interest, and scenarios involving small objects. To tackle these challenges, we introduce MultiTaskDeltaNet (MTDN), a novel deep learning architecture that creatively reconceptualizes the segmentation task as a change detection problem. By implementing a unique Siamese network with a U-Net backbone and using paired images to capture feature changes, MTDN effectively leverages minimal data to produce high-quality segmentations. Furthermore, MTDN utilizes a multi-task learning strategy to exploit correlations between physical features of interest. In an evaluation using data from in situ environmental TEM (ETEM) videos of filamentous carbon gasification, MTDN demonstrated a significant advantage over conventional segmentation models, particularly in accurately delineating fine structural features. Notably, MTDN achieved a 10.22% performance improvement over conventional segmentation models in predicting small and visually ambiguous physical features. This work bridges key gaps between deep learning and practical TEM image analysis, advancing automated characterization of nanomaterials in complex experimental settings.

08 HYDROGEN↗
DOE OSTI2025

Physics-constrained superresolution diffusion for six-dimensional phase space diagnostics

Adaptive physics-constrained superresolution diffusion is developed for noninvasive virtual diagnostics of the six-dimensional (6D) phase space density of charged particle beams. An adaptive variational autoencoder embeds initial beam condition images and scalar measurements to a low-dimensional latent space from which a 32 6 pixel 6D tensor representation of the beam's 6D phase space density is generated. Projecting from a 6D tensor generates physically consistent two-dimensional projections. Physics-guided superresolution diffusion transforms low-resolution images of the 6D density to high resolution 256 × 256 pixel images. Unsupervised adaptive latent space tuning enables tracking of time-varying beams without knowledge of time-varying initial conditions. The method is demonstrated with experimental data and multiparticle simulations at the HiRES UED. The general approach is applicable to a wide range of complex dynamic systems evolving in high-dimensional phase space. The method is shown to be robust to distribution shift without retraining. Published by the American Physical Society 2025

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

Experimental and theoretical examination of shock-compressed copper through the fcc to bcc to melt phase transitions

Recent studies show a face-centered cubic (fcc) to body-centered cubic (bcc) transformation along the shock Hugoniot for several metals (i.e., Cu, Au, and Ag). Here, we combine laser-shock compression of Cu foils on nanosecond timescales with in situ x-ray diffraction (XRD) to examine the microstructural changes with stress. We study the fcc phase and the phase transition from fcc to bcc (pressures greater than 180 GPa). Textural analysis of the azimuthal intensities from the XRD images is consistent with transformation into the bcc phase through the Pitsch-distortion mechanism. We use embedded atom model molecular dynamics simulations to determine the stability of the bcc phase in pressure–temperature space. Finally, our results indicate that the bcc phase is stabilized only at high temperatures and remains stable at pressures greater than 500 GPa.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Windowed Fourier transform and cross-correlation algorithms for molecular tagging velocimetry

In this study, simulated and experimental molecular tagging velocimetry (MTV) images have been analyzed with a technique commonly used to process grid images on surfaces, the windowed Fourier transform with local spectrum analysis (WFT-LSA). A systematic synthetic image study of the modulation transfer function (MTF) and error tendencies of the WFT-LSA was performed and compared with a PIV-style cross-correlation algorithm to see if advanced strategies such as iterative image deformation can improve analysis of gridded images with high noise levels. Testing of single-pass algorithms showed that in typical MTV images, the WFT-LSA yields significantly lower bias errors than cross-correlation (CC) at displacements greater than 1 pixel but slightly higher random error at all displacements and image conditions. Analysis of the MTF shows that CC provided better resolution of spatial fluctuations than the WFT-LSA in many combinations of grid size and interrogation window. Tests of image deformation algorithms showed that the gap in performance between CC and WFT-LSA is maintained even as both methods improve. Additionally, WFT-LSA and CC methods are applied to real MTV experiments in high-speed gas jet flows. A preliminary analysis of phosphorescence lifetime provided by acetone vapor excited at 266 nm is used for assessing the required gas speeds for making MTV application feasible. The application of WFT-LSA to real MTV images demonstrates the ability of the algorithm to handle further real-world effects that could not be considered in the synthetic image analysis, like reduced signal-to-noise ratio and non-uniform intensity of the tagging grid across the image introduced by the actual laser beam energy distribution. With experimental images, CC is more accurate with shear flows but less robust to high noise levels than WFT-LSA, as predicted by the synthetic image analysis.

42 ENGINEERING↗
DOE OSTI2022

BioTransformer 3.0 – A Web Server for Accurately Predicting Metabolic Transformation Products

BioTransformer 3.0 is a freely available web server that supports accurate, rapid and comprehensive in silico metabolism prediction. It combines machine learning approaches with a rule-based system to predict small-molecule metabolism in human tissues, the human gut as well as the external environment (soil and water microbiota). Simply stated, BioTransformer takes a molecular structure as input (SMILES or SDF) and outputs an interactively viewable/sortable table of the predicted metabolites or transformation products (SMILES, PNG images) along with the enzymes that are predicted to be responsible for those reactions and richly annotated downloadable files (CSV and JSON). The entire process typically takes a few seconds. Previous versions of BioTransformer focused exclusively on predicting the metabolism of xenobiotics (such as plant natural products, drugs, cosmetics and other synthetic compounds) using a limited number of pre-defined steps and somewhat limited rule-based methods. BioTransformer 3.0, uses much more sophisticated methods and incorporates new databases, new constraints and new prediction modules to not only more accurately predict the metabolic transformation products of exogenous xenobiotics but also the transformation products of endogenous metabolites, such as amino acids, peptides, carbohydrates, organic acids, and lipids. BioTransformer 3.0 can also support customized sequential combinations of these transformations along with multiple iterations to simulate multi-step human and/or environmental biotransformation events. Performance tests indicate that BioTransformer 3.0 is 40-50% more accurate, much less prone to combinatorial “explosions” and far more comprehensive in terms of metabolite coverage/capabilities than previous versions of BioTransformer.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Kinetics of moisture-induced phase transformation in inorganic halide perovskite

The high-temperature (high-T) phase of cesium lead iodide (CsPbI 3 ) presents great promise for photovoltaic applications; however, exposure to ambient moisture at room temperature transforms it into its less-desirable low-temperature (low-T) phase with a larger band gap. While there have been theoretical predictions on the influence of moisture level on the phase transformation kinetics, the corresponding quantitative experimental evidence has remained limited. Tracking CsPbI 3 phase transformation under controlled relative humidity (RH), we find that rising RH increases the nucleation rate of low-T CsPbI 3 exponentially, but has a weak effect on its growth. The overall transformation is nucleation limited, with higher RH leading to a lower nucleation barrier. Finally, we find that heating between 40°C and 80°C facilitates water desorption and suppresses phase transformation. Our findings elucidate the relationship between moisture and the phase energetics of CsPbI 3 , which can serve as references for thin film applications of CsPbI 3 and future designs of stable photovoltaics systems.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Plasma Imaging, LOcal Measurement, and Tomographic Experiment (PILOT): A Mission Concept for Transformational Multi-Scale Observations of Mass and Energy Flow Dynamics in Earth’s Magnetosphere

We currently do not understand the fundamental physical processes that govern mass and energy flow through the Earth’s magnetosphere. Knowledge of these processes is critical to understanding the mass loss rate of Earth’s atmosphere, as well as for determining the role that a planetary magnetic field plays in atmospheric retention, and therefore habitability, for Earth-like planets beyond the solar system. Mass and energy flow processes are challenging to determine at Earth in part because Earth’s planetary magnetic field creates a complex “system of systems” composed of interdependent plasma populations and overlapping spatial regions that perpetually exchange mass and energy across a broad range of temporal and spatial scales. Further, the primary mass carrier in the magnetosphere is cold plasma (as cold as ~0.1 eV), which is invisible to many space-borne instruments that operate in the inner magnetosphere. The Plasma Imaging LOcal and Tomographic experiment (PILOT) mission concept, described here, provides the transformational multi-scale observations required to answer fundamental open questions about mass and energy flow dynamics in the Earth’s magnetosphere. PILOT uses a constellation of spacecraft to make radio tomographic, remote sensing, and in-situ measurements simultaneously, fully capturing cold plasma mass dynamics and its impact on magnetospheric systems over an unprecedented range of spatial and temporal scales. This article details the scientific motivation for the PILOT mission concept as well as a potential mission implementation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

In-Situ Atomic-Scale Revelation of Amorphous Metallic Iron Formation during Hydrogen-Driven Reduction of Iron Oxides

The transition to hydrogen as a green reductant in metal production is critical for decarbonizing the metallurgical industry, yet atomic-scale mechanisms governing reduction pathways and phase evolution remain unresolved. Using in-situ environmental transmission electron microscopy, we identify a hidden pathway that reveals dynamic formation of amorphous metallic iron (Fe) during the hydrogen-driven reduction of ferrous oxides of Fe 3 O 4 and FeO. Real-time imaging uncovers three coexisting transformation routes: (i) Fe 3 O 4 → FeO, (ii) Fe 3 O 4 → amorphous Fe, and (iii) FeO → amorphous Fe. The resulting amorphous Fe exhibits fluid-like mobility, enabling its rapid aggregation and crystallization into core-shell nanostructures, with a crystalline core enveloped by an amorphous shell. Complementary ab initio molecular dynamics simulations trace the amorphous Fe formation to interfacial strain at the metal/oxide interfaces, where large lattice mismatches destabilize the metal lattice during initial metallization. This interplay between thermodynamics and kinetics governs phase evolution: thermodynamics favors a self-limiting amorphous Fe overlayer, while rapid oxide reduction kinetics drives amorphous overgrowth. Our findings demonstrate that amorphous intermediates bypass rate-limiting crystalline steps, providing mechanistic insights to optimize H 2 -based processes for sustainable steelmaking. In conclusion, these insights bridge the gap between macroscopic process engineering and atomic-scale dynamics, with broader implications for catalysis and nanostructured material synthesis, where oxide reduction pathways critically shape functional phases and microstructures.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Size and Structural Control of Mechanoluminescent ZnS:Mn 2+ Nanocrystals for Optogenetic Neuromodulation

Mechanoluminescent materials hold immense potential for various transformative applications, from medical imaging and diagnostics to health monitoring and wearable displays. Conventionally produced as bulk powders or microparticles, they face significant size limitations for advanced applications, particularly in biological systems and microscale devices. Here, this work presents an approach to ZnS:Mn 2+ nanocrystal synthesis that involves self-assembly and subsequent calcination. In addition to effective size control within the nanoscale, this approach promotes the formation of abundant stacking faults, significantly enhancing piezoelectric and mechanoluminescent properties by increasing trap density and reducing trap depth. Unlike mechanoluminescent materials produced using conventional methods, these nanocrystals demonstrate strong mechanoluminescence without requiring UV pre-excitation, and the light emission persists even after mechanical stress is removed. These advantageous properties make them promising candidates for optogenetic neuromodulation, as they can effectively trigger electrical signals in neurons upon ultrasound stimulation both with and without UV pre-excitation. The persistent mechanoluminescence prolongs the duration of neuronal electrical activity, providing an extended temporal window for neuromodulation compared to conventional mechanoluminescent materials. This study provides a scalable method for producing efficient mechanoluminescent nanoparticles and reveals the crucial role of particle size and defect structures in determining their mechanoluminescent behavior.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Deep Multimodal Networks for M-type Star Classification with Paired Spectrum and Photometric Image

Abstract Traditional stellar classification methods include spectral and photometric classification separately. Although satisfactory results can be achieved, the accuracy could be improved. In this paper, we pioneer a novel approach to deeply fuse the spectra and photometric images of the sources in an advanced multimodal network to enhance the model’s discriminatory ability. We use Transformer as the fusion module and apply a spectrum–image contrastive loss function to enhance the consistency of the spectrum and photometric image of the same source in two different feature spaces. We perform M-type stellar subtype classification on two data sets with high and low signal-to-noise ratio (S/N) spectra and corresponding photometric images, and the F1-score achieves 95.65% and 90.84%, respectively. In our experiments, we prove that our model effectively utilizes the information from photometric images and is more accurate than advanced spectrum and photometric image classifiers. Our contributions can be summarized as follows: (1) We propose an innovative idea for stellar classification that allows the model to simultaneously consider information from spectra and photometric images. (2) We discover the challenge of fusing low-S/N spectra and photometric images in the Transformer and provide a solution. (3) The effectiveness of Transformer for spectral classification is discussed for the first time and will inspire more Transformer-based spectral classification models.

Astronomy & Astrophysics↗
DOE OSTI2020

Modeling thin layers of analytes on substrates for spectral analysis: use of solid/liquid n and k values to model reflectance spectra

Since solids are only sometimes seen en masse in a pure bulk form, and for liquids other than water almost never, a capability to model reflectance spectra from analytes deposited on various substrates would be highly advantageous. If available, the real, n ( ν ) , and imaginary, k ( ν ) , components of the complex refractive index, n n + i k , can be used to simulate infrared spectra, accounting for reflection, refraction, and absorption phenomena as a function of wavelength. We focus on using the Pacific Northwest National Laboratory (PNNL) derived n / k vectors for solid and liquid analytes deposited as thin layers on different types of substrates including conductors, such as aluminum, and inorganic dielectrics, such as glass. The model is an adaptation of the Monte Carlo ray trace modeling program, TracePro, extended through the use of its macrolanguage. The model is tested using thin films of organic liquids including silicone oil and no. 2 diesel fuel, as well as organic solids such as caffeine and acetaminophen on aluminum and glass. The predicted spectra for the solid films were compared to experimental hemispherical reflectance data measured using a Fourier transform spectrometer with an integrating sphere. The thickness of the calculated layer is a parameter for predicting the (transflectance) spectra and is obtained using the areal density measured from gravimetric methods to generate the thin-layer samples. Comparison of the calculated spectra with experimental hemispherical reflectance data shows excellent agreement, indicating promise for the use of measured n / k data to synthesize reference spectral data. In particular, accounting for the inhomogeneity of the deposits greatly improved the match with experimental data. Finally, the theoretical modeling shows that for thicker layers (ca. 20 to 100 μm) of typical organics possessing moderately strong k values, the longwave infrared features are often saturated and better spectral contrast is obtained from the overtone/combination bands in the shortwave infrared.

42 ENGINEERING↗
DOE OSTI2025

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2024

Provable Repair of Vision Transformers

Vision Transformers have emerged as state-of-the-art image recognition tools, but may still exhibit incorrect behavior. Incorrect image recognition can have disastrous consequences in safety-critical real-world applications such as self-driving automobiles. In this paper, we present Provable Repair of Vision Transformers (PRoViT), a provable repair approach that guarantees the correct classification of images in a repair set for a given Vision Transformer without modifying its architecture. PRoViT avoids negatively affecting correctly classified images (drawdown) by minimizing the changes made to the Vision Transformer’s parameters and original output. Here, we observe that for Vision Transformers, unlike for other architectures such as ResNet or VGG, editing just the parameters in the last layer achieves correctness guarantees and very low drawdown. We introduce a novel method for editing these last-layer parameters that enables PRoViT to efficiently repair state-of-the-art Vision Transformers for thousands of images, far exceeding the capabilities of prior provable repair approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Quantification of MagLIF morphology using the Mallat scattering transformation

The morphology of the stagnated plasma resulting from magnetized liner inertial fusion is measured by imaging the self-emission x rays coming from the multi-keV plasma. Equivalent diagnostic responses can be generated by integrated radiation-magnetohydrodynamic (rad-MHD) simulations from programs such as HYDRA and GORGON. There have been only limited quantitative ways to compare the image morphology, that is the texture, of simulations and experiments. We have developed a metric of image morphology based on the Mallat scattering transformation (MST), a transformation that has proved to be effective at distinguishing textures, sounds, and written characters. This metric is designed, demonstrated, and refined by classifying ensembles (i.e., classes) of synthetic stagnation images and by regressing an ensemble of synthetic stagnation images to the morphology (i.e., model) parameters used to generate the synthetic images. We use this metric to quantitatively compare simulations to experimental images, experimental images to each other, and to estimate the morphological parameters of the experimental images with uncertainty. This coordinate space has proved to be very adept at doing a sophisticated relative background subtraction in the MST space. This was needed to compare the experimental self-emission images to the rad-MHD simulation images.

Glinsky, Michael E. (ORCID:0000000324933326)↗
DOE OSTI2025

Nanodiffraction imaging of ionically driven phase separation in cobaltite heterostructures

Controlling the anionic stoichiometry and distribution of perovskite cobaltites presents a powerful method for tailoring the magnetic and electronic properties for magneto-ionic applications. Nevertheless, the influence of nanoscale morphology, including phase separation and defects in cobaltite heterostructures, remains largely unexplored. We used x-ray nanodiffraction to directly image the nanoscale topotactic phase transformation in La 1−x Sr x CoO 3 (LSCO) heterostructures capped with a reactive aluminum (Al) layer (i.e., oxygen “getter”) of varying thicknesses (0.5, 3, and 7 nm). Nanodiffraction images reveal the formation of highly elongated BM filaments extending over mesoscopic lengths (>67 μm), indicating a strong tendency toward oxygen vacancy ordering in both P and BM phases in all heterostructures. Local strain and strain gradient analysis shows a strong correlation between the depletion of the P phase and strain gradients. Our measurements suggest that elongation of the BM filaments is the predominant mechanism for topotactic transformation in LSCO/Al heterostructures, preferred over coarsening, branching, and fractal growth. Our study provides a detailed nanoscale analysis of ionically driven phase transitions in LSCO/Al heterostructures, which is crucial for tailoring the functional properties of cobaltites for magneto-ionic devices.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Vision Transformers Explained Series

Since their introduction in 2017 with Attention is All You Need¹, transformers have established themselves as the state of the art for natural language processing (NLP). In 2021, An Image is Worth 16x16 Words successfully adapted transformers for computer vision tasks. Since then, numerous transformer-based architectures have been proposed for computer vision. This article walks through the Vision Transformer (ViT) as laid out in An Image is Worth 16x16 Words.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

An x-ray penumbral imager for measurements of electron–temperature profiles in inertial confinement fusion implosions at OMEGA

Hot-spot shape and electron temperature (T e ) are key performance metrics used to assess the efficiency of converting shell kinetic energy into hot-spot thermal energy in inertial confinement fusion implosions. X-ray penumbral imaging offers a means to diagnose hot-spot shape and T e , where the latter can be used as a surrogate measure of the ion temperature (T i ) in sufficiently equilibrated hot spots. We have implemented a new x-ray penumbral imager on OMEGA. We demonstrate minimal line-of-sight variations in the inferred T e for a set of implosions. Furthermore, we demonstrate spatially resolved T e measurements with an average uncertainty of 10% with 6 μm spatial resolution.

47 OTHER INSTRUMENTATION↗