Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Transforms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

Context Modeler for Wavelet Compression of Spectral Hyperspectral Images

A context-modeling sub-algorithm has been developed as part of an algorithm that effects three-dimensional (3D) wavelet-based compression of hyperspectral image data. The context-modeling subalgorithm, hereafter denoted the context modeler, provides estimates of probability distributions of wavelet-transformed data being encoded. These estimates are utilized by an entropy coding subalgorithm that is another major component of the compression algorithm. The estimates make it possible to compress the image data more effectively than would otherwise be possible. The following background discussion is prerequisite to a meaningful summary of the context modeler. This discussion is presented relative to ICER-3D, which is the name attached to a particular compression algorithm and the software that implements it. The ICER-3D software is summarized briefly in the preceding article, ICER-3D Hyperspectral Image Compression Software (NPO-43238). Some aspects of this algorithm were previously described, in a slightly more general context than the ICER-3D software, in "Improving 3D Wavelet-Based Compression of Hyperspectral Images" (NPO-41381), NASA Tech Briefs, Vol. 33, No. 3 (March 2009), page 7a. In turn, ICER-3D is a product of generalization of ICER, another previously reported algorithm and computer program that can perform both lossless and lossy wavelet-based compression and decompression of gray-scale-image data. In ICER-3D, hyperspectral image data are decomposed using a 3D discrete wavelet transform (DWT). Following wavelet decomposition, mean values are subtracted from spatial planes of spatially low-pass subbands prior to encoding. The resulting data are converted to sign-magnitude form and compressed. In ICER-3D, compression is progressive, in that compressed information is ordered so that as more of the compressed data stream is received, successive reconstructions of the hyperspectral image data are of successively higher overall fidelity.

Kiely, Aaron↗
DOE OSTI2025

HAMscope: a snapshot Hyperspectral Autofluorescence Miniscope for real-time molecular imaging

We introduce HAMscope, a compact, snapshot hyperspectral autofluorescence miniscope that enables real-time, label-free molecular imaging in a wide range of biological systems. By integrating a thin polymer diffuser into a widefield miniscope, HAMscope spectrally encodes each frame and employs a probabilistic deep learning framework to reconstruct 30-channel hyperspectral stacks (452-703 nm) or directly infer molecular composition maps from single images. A scalable multi-pass U-Net architecture with transformer-based attention and per pixel uncertainty estimation enables high spatio-spectral fidelity (mean absolute error ∼0.0048) at video rates. While initially demonstrated in plant systems, including lignin, chlorophyll, and suberin imaging in intact poplar and cork tissues, the platform is readily adaptable to other applications such as neural activity mapping, metabolic profiling, and histopathology. We show that the system generalizes to out-of-distribution tissue types and supports direct molecular mapping without the need for spectral unmixing. HAMscope establishes a general framework for compact, uncertainty-aware spectral imaging that combines minimal optics with advanced deep learning, offering broad utility for real-time biochemical imaging across neuroscience, environmental monitoring, and biomedicine.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1990

Separability of soils in a tallgrass prairie using SPOT and DEM data

An investigation is conducted which uses a canonical transformation technique to reduce the features from SPOT and DEM data and evaluates the statistical separability of several prairie soils from the canonically transformed variables. Both SPOT and DEM data was gathered for a tallgrass prairie near Manhattan, Kansas, and high resolution SPOT satellite images were integrated with DEM data. Two canonical variables derived from training samples were selected and it is suggested that canonically transformed data were superior to combined SPOT and DEM data. High resolution SPOT images and DEM data can be used to aid second-order soil surveys in grasslands.

Su, Haiping↗
DOE OSTI2026

In-situ sensor monitoring of multi-class gas porosity formation in laser powder bed fusion using convolutional neural network

In-situ monitoring of defect formation remains a significant challenge in the laser powder bed fusion (LPBF) process. Recent advances have enabled real-time defect detection with machine learning and in-situ sensing technologies; however, most studies focus on binary classification of keyhole pores, limiting nuanced multi-class pore differentiation and formation mechanisms. This work introduces a multi-class pore detection framework (no pore, small pores < 15 µm, and large pores > 15 µm) by leveraging photodiode sensor data alongside high-fidelity synchrotron X-ray imaging. The 15 µm threshold is selected to distinguish between two fundamentally different defect mechanisms, following the physical size-mechanism boundary established by prior high-resolution synchrotron X-ray characterization of Al6061 LPBF. Distinguishing these classes is critical because large keyhole pores are structurally detrimental, whereas small gas pores are often benign, requiring different process control strategies. Thermal emission monitoring data collected simultaneously with high-speed X-ray imaging at the Stanford Synchrotron Radiation Lightsource (SSRL), are correlated with subsurface melt pool dynamics to establish ground truth. Continuous Wavelet Transform (CWT) with optimized parameters converts the photodiode time-series signals into time–frequency images, facilitating feature extraction. Convolutional Neural Networks (CNN) are then applied for real-time multi-class pore classification in an average inference time of 1 ms per signal window. It achieves 79% accuracy and an Area Under the Receiver Operating Characteristic curve (AUC ROC) score of 0.89 with five-fold cross-validation. The results demonstrate that coupling CWT-based feature engineering with CNN architecture enables reliable multi-class pore detection in Al6061 builds using affordable in-situ sensors. This approach advances scalable and affordable quality assurance in additive manufacturing by moving beyond binary defect detection toward more nuanced classification of porosity mechanisms with in-situ sensors and machine learning.

Laser powder bed fusion, Multi-class pores, In-sit↗
DOE OSTI2022

An efficient and broadly applicable method for transient transformation of plants using vertically aligned carbon nanofiber arrays

Transient transformation in plants is a useful process for evaluating gene function. However, there is a scarcity of minimally perturbing methods for gene delivery that can be used on multiple organs, plant species, and non-excised tissues. We pioneered and demonstrated the use of vertically aligned carbon nanofiber (VACNF) arrays to efficiently perform transient transformation of different tissues with DNA constructs in multiple plant species. The VACNFs permeabilize plant tissue transiently to allow molecules into cells without causing a detectable stress response. We successfully delivered DNA into leaves, roots and fruit of five plant species (Arabidopsis, poplar, lettuce, Nicotiana benthamiana , and tomato) and confirmed accumulation of the encoded fluorescent proteins by confocal microscopy. Using this system, it is possible to transiently transform plant cells with both small and large plasmids. The method is successful for species recalcitrant to Agrobacterium -mediated transformation. VACNFs provide simple, reliable means of DNA delivery into a variety of plant organs and species.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Permeability Prediction Using Vision Transformers

Accurate permeability predictions remain pivotal for understanding fluid flow in porous media, influencing crucial operations across petroleum engineering, hydrogeology, and related fields. Traditional approaches, while robust, often grapple with the inherent heterogeneity of reservoir rocks. With the advent of deep learning, convolutional neural networks (CNNs) have emerged as potent tools in image-based permeability estimation, capitalizing on micro-CT scans and digital rock imagery. This paper introduces a novel paradigm, employing vision transformers (ViTs)—a recent advancement in computer vision—for this crucial task. ViTs, which segment images into fixed-sized patches and process them through transformer architectures, present a promising alternative to CNNs. We present a methodology for implementing ViTs for permeability prediction, its results on diverse rock samples, and a comparison against conventional CNNs. The prediction results suggest that, with adequate training data, ViTs can match or surpass the predictive accuracy of CNNs, especially in rocks exhibiting significant heterogeneity. This study underscores the potential of ViTs as an innovative tool in permeability prediction, paving the way for further research and integration into mainstream reservoir characterization workflows.

58 GEOSCIENCES↗
DOE OSTI2025

Review: Recent advances of ToF-SIMS for environmental analysis and imaging

Background: Time-of-flight secondary ion mass spectrometry (ToF-SIMS) is a powerful surface analysis technique, initially developed and applied in inorganic materials and semiconductors. In past decades, ToF-SIMS has attracted more attention in its analysis capabilities of organic materials, with increased applications in biology, medical, and health development. It has also become a versatile and effective tool in environmental analysis due to its high mass resolution, mass accuracy, and depth profiling. Results: In this review, we first give an overview of the principle of ToF-SIMS and follow with recent ToF-SIMS applications in exemplary environmental study cases, including atmospheric aerosol, soil, water, plant, and organic solvent analysis. Moreover, sample preparation techniques are summarized in relation to corresponding environmental applications. Specifically, we call attention to ToF-SIMS investigations showcasing studies in surface chemical compositions, images, and depth profile analysis. These findings emphasize the important role of interfacial chemistry in environmental processes and provide valuable insights into dynamic processes, such as chemical transformation, particle formation, plant biology, and microbial inspired biotechnology development. The mass spectral imaging results acquired by ToF-SIMS offer a deeper understanding of intermediate stages and transient phases for environmental specimens. Significance: In situ and operando imaging offer new possibilities in studying phenomena in real time with high spatial resolution. Furthermore, it is anticipated that more research groups will use ToF-SIMS in environmental research given recent advances in measurement capabilities and surging needs in chemical mapping of complex analytes and systems.

Aerosol↗
NASA NTRS2006

Symmetric Phase Only Filtering for Improved DPIV Data Processing

The standard approach in Digital Particle Image Velocimetry (DPIV) data processing is to use Fast Fourier Transforms to obtain the cross-correlation of two single exposure subregions, where the location of the cross-correlation peak is representative of the most probable particle displacement across the subregion. This standard DPIV processing technique is analogous to Matched Spatial Filtering, a technique commonly used in optical correlators to perform the crosscorrelation operation. Phase only filtering is a well known variation of Matched Spatial Filtering, which when used to process DPIV image data yields correlation peaks which are narrower and up to an order of magnitude larger than those obtained using traditional DPIV processing. In addition to possessing desirable correlation plane features, phase only filters also provide superior performance in the presence of DC noise in the correlation subregion. When DPIV image subregions contaminated with surface flare light or high background noise levels are processed using phase only filters, the correlation peak pertaining only to the particle displacement is readily detected above any signal stemming from the DC objects. Tedious image masking or background image subtraction are not required. Both theoretical and experimental analyses of the signal-to-noise ratio performance of the filter functions are presented. In addition, a new Symmetric Phase Only Filtering (SPOF) technique, which is a variation on the traditional phase only filtering technique, is described and demonstrated. The SPOF technique exceeds the performance of the traditionally accepted phase only filtering techniques and is easily implemented in standard DPIV FFT based correlation processing with no significant computational performance penalty. An "Automatic" SPOF algorithm is presented which determines when the SPOF is able to provide better signal to noise results than traditional PIV processing. The SPOF based optical correlation processing approach is presented as a new paradigm for more robust cross-correlation processing of low signal-to-noise ratio DPIV image data."

Wernet, Mark P.↗
NASA NTRS1997

Registration assisted mosaic generation

This paper presents a general strategy for assembling mosaics from numerous individual images where uncertainty exists in the position and orientation of those images. Both of the presented applications relate to remotely operated camera platforms, the first being the Galileo solid state imaging (SSI) camera presently in orbit around Jupiter, and the second being the Imager for Mars Pathfinder (IMP) stereo camera on Mars. A basic strategy in both applications is to determine the correct relative camera pointing followed by direct map projection of the images. It is assumed that approximate camera pointing exists sufficient to locate adjacent images and to place initial tiepoints within reach of the correlator. Spatial correlation is used to fix tiepoints whose initial locations are predicted by the camera pointing. We use either an fast fourier transform (fft) algorithm or a variant of Gruen's scheme permitting limited image rotation and skew. The Gruen correlator has three hierarchical modes: 1) A classical spatial least squares correlation on integral pixel boundaries used when rotation is small. 2) An annealing non-deterministic search used when rotations are unknown. A simplex deterministic search used for the end game. The correlation operation can be performed either interactively or autonomously. The final camera pointing solution relies upon a simplex downhill search in 2n or 3n dimensions where n is the number of images comprising the mosaic and the objective function to be minimized is the disagreement between tiepoint locations predicted from the camera pointing with those observed by the correlator. For Galileo the 3n unknowns are euler angles defining camera pointing in planet coordinates, and for Mars Pathfinder they are 2n unknowns representing commanded azimuth and elevation in the Lander coordinate system.

Lorre, Jean J.↗
NASA NTRS1974

Use of feature extraction techniques for the texture and context information in ERTS imagery: Spectral and textural processing of ERTS imagery

The author has identified the following significant results. A procedure was developed to extract cross-band textural features from ERTS MSS imagery. Evolving from a single image texture extraction procedure which uses spatial dependence matrices to measure relative co-occurrence of nearest neighbor grey tones, the cross-band texture procedure uses the distribution of neighboring grey tone N-tuple differences to measure the spatial interrelationships, or co-occurrences, of the grey tone N-tuples present in a texture pattern. In both procedures, texture is characterized in such a way as to be invariant under linear grey tone transformations. However, the cross-band procedure complements the single image procedure by extracting texture information and spectral information contained in ERTS multi-images. Classification experiments show that when used alone, without spectral processing, the cross-band texture procedure extracts more information than the single image texture analysis. Results show an improvement in average correct classification from 86.2% to 88.8% for ERTS image no. 1021-16333 with the cross-band texture procedure. However, when used together with spectral features, the single image texture plus spectral features perform better than the cross-band texture plus spectral features, with an average correct classification of 93.8% and 91.6%, respectively.

Haralick, R. H.↗
DOE OSTI2019

Chemical Imaging of Atmospheric Particles

Airborne particles are very dynamic and highly reactive components of the Earth’s atmosphere. Their high surface area and water content provide a unique reaction environment for multiphase chemistry that continually modifies particle composition and properties that consequently impact air quality as well as concentrations of gas-phase species. By absorbing and scattering solar and terrestrial radiation, particles directly influence the planet’s radiative balance. Their indirect effects include modifying the nucleation, lifetime, and physical properties of clouds. Due to the sensitivity of the atmospheric environment to all these variables, fundamental studies of chemical transformations of atmospheric particles, their sources, continuously evolving composition, and physical properties are of highest research priority. Accurate descriptions of particles and their effects in the atmosphere require comprehensive information not only on the particle-type populations and their size distributions and concentrations, but also on the diversity and the spatial heterogeneity of chemical components within individual particles. Developments and applications of modern chemical imaging approaches for off-line characterization of atmospheric particles have been at the forefront of modern experimental studies and have resulted in a transformative impact in atmospheric chemistry and physics. This Account presents a synopsis of recent advances in chemical imaging of atmospheric particles collected on substrates during field and laboratory experiments. The unique advantage of chemical imaging methods is that they simultaneously provide two analytical measurements: imaging of particles to assess variability in their individual sizes and morphology, as well as particle specific speciation of their composition and spatial heterogeneity of different chemical components within individual particles. We also highlight analytical chemistry approaches that enable chemical imaging of particles with different levels of elemental and molecular specificity, including applications of multimodal methodologies where the same or similar groups of particles are probed by two or more complementary techniques. These approaches provide unique experimental insights on the nature and sources of particles, understanding their physical properties, atmospheric reactivity, and transformations. Chemical imaging data provide unique experimental input for atmospheric models that simulate aging and changes in particle-type populations, internal composition, and their associated optical and cloud forming properties. Here, we highlight applications of chemical imaging in selected recent studies, discuss their existing limitations, and forecast future research directions for this area.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

A Deep Look Into the Future of Quantitative Imaging in Oncology: A Statement of Working Principles and Proposal for Change

The adoption of enterprise digital imaging, along with the development of quantitative imaging methods and the re-emergence of statistical learning, has opened the opportunity for more personalized cancer treatments through transformative data science research. In the last 5 years, accumulating evidence has indicated that noninvasive advanced imaging analytics (i.e., radiomics) can reveal key components of tumor phenotype for multiple lesions at multiple time points over the course of treatment. Many groups using homegrown software have extracted engineered and deep quantitative features on 3-dimensional medical images for better spatial and longitudinal understanding of tumor biology and for the prediction of diverse outcomes. These developments could augment patient stratification and prognostication, buttressing emerging targeted therapeutic approaches. Unfortunately, the rapid growth in popularity of this immature scientific discipline has resulted in many early publications that miss key information or use underpowered patient data sets, without production of generalizable results. Quantitative imaging research is complex, and key principles should be followed to realize its full potential. The fields of quantitative imaging and radiomics in particular require a renewed focus on optimal study design and reporting practices, standardization, interpretability, data sharing, and clinical trials. Standardization of image acquisition, feature calculation, and statistical analysis (i.e., machine learning) are required for the field to move forward. A new data-sharing paradigm enacted among open and diverse participants (medical institutions, vendors and associations) should be embraced for faster development and comprehensive clinical validation of imaging biomarkers. In this review and critique of the field, we propose working principles and fundamental changes to the current scientific approach, with the goal of high-impact research and development of actionable prediction models that will yield more meaningful applications of precision cancer medicine.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
NASA NTRS1983

A parallel-pipeline architecture of the fast polynomial transform for computing a two-dimensional cyclic convolution

It is pointed out that the two-dimensional cyclic convolution is a useful tool for many two-dimensional digital signal processing applications. Two important applications are related to spaceborne high-resolution synthetic aperture radar (SAR) processing and image processing. Nussbaumer and Quandalle (1978) showed that a radix-2 polynomial transform analogous to the conventional radix-2 FFT algorithm can be used to compute a two-dimensional cyclic convolution. On the basis of results reported by Arambepola and Rayner (1979), a radix-2 polynomial transform can be defined to compute a multidimensional cyclic convolution. Truong et al. (1981) used the considered ideas together with the Chinese Theorem to further reduce the complexity of the radix-2 fast polynomial transform (FPT). Reed et al. (1981) demonstrated that such a new FPT algorithm is significantly faster than the FFT algorithm for computing a two-dimensional convolution. In the present investigation, a parallel-pipeline architecture is considered for implementing the FPT developed by Truong et al.

Truong, T. K.↗
DOE OSTI2018

Photonic crystals for nano-light in moiré graphene superlattices

Graphene is an atomically thin plasmonic medium that supports highly confined plasmon polaritons, or nano-light, with very low loss. Electronic properties of graphene can be drastically altered when it is laid upon another graphene layer, resulting in a moiré superlattice. The relative twist angle between the two layers is a key tuning parameter of the interlayer coupling in thus-obtained twisted bilayer graphene (TBG). We studied the propagation of plasmon polaritons in TBG by infrared nano-imaging. We discovered that the atomic reconstruction occurring at small twist angles transforms the TBG into a natural plasmon photonic crystal for propagating nano-light. This discovery points to a pathway for controlling nano-light by exploiting quantum properties of graphene and other atomically layered van der Waals materials, eliminating the need for arduous top-down nanofabrication.

charge transport↗
DOE OSTI2022

Deep Neural Network Algorithm for CMC Microstructure Characterization and Variability Quantification

Microstructure characterization and variability quantification are crucial for understanding ceramic matrix composites (CMCs) mechanical behavior and deformation mechanisms across length scales. Traditionally, analyses of the micrographs obtained from microscopy are labor-intensive. However, with the vast improvement in computer vision (CV) and deep learning (DL), an automated algorithm can be designed to extract essential microstructure variability from micrographs which can then be used to construct a statistically representative volume element (SRVE). The DL-based algorithm spans the taxonomy of microstructure analyses, including semantic segmentation of microstructure constituents, secondary phases, matrix/fiber interface, and defects, and quantifying the microstructure variability in terms of probability distributions. In this work, C/SiNC and SiC/SiNC CMCs microstructures are semantically segmented through a deep convolutional neural network, followed by variability quantification through the implementation of a fully connected regression layer, hence forming a deep regression network. The deep regression network operates in a feedforward regime, in which the neuron output signal traverses through the network in a unidirectional manner. The weight tensor associated with each layer is updated through a backpropagation stochastic gradient descent approach. The input gray-scale image obtained through in-house scanning electron microscope and confocal microscope micrographs is augmented through affine transformations to increase the training set size, which is then processed through four strided convolutional layers. This compresses the image resolution by half at each layer while increasing the image depth by applying different filters (image encoding). The class activation maps (CAMs) corresponding to the applied filters highlight the key architectural features and assist with the semantic segmentation of the microstructure.

Hamza, Mohamed H.↗
DOE OSTI2019

Influence of Substrates on the Long-Range Order of Photoelectrodeposited Se–Te Nanostructures

The long-range order of anisotropic phototropic Se–Te films grown electrochemically at room temperature under uniform-intensity, polarized, incoherent, near-IR illumination has been investigated using crystalline (111)-oriented Si substrates doped degenerately with either p- or n-type dopants. Fourier-transform (FT) analysis was performed on large-area images obtained with a scanning electron microscope, and peak shapes in the FT spectra were used to determine the pattern fidelity in the deposited Se–Te films. Under nominally identical illumination conditions, phototropic films grown on p + -Si(111) exhibited a higher degree of anisotropy and a more well-defined pattern period than phototropic films grown on n + -Si(111). Similar differences in the phototropic Se–Te deposit morphology and pattern fidelity on p + -Si versus n + -Si were observed when the deposition rate and current densities were controlled for by adjusting the deposition parameters and illumination conditions. The doping-related effects of the Si substrate on the pattern fidelity of the phototropic Se–Te deposits are ascribable to an electrical effect produced by the different interfacial junction energetics between Se–Te and p + -Si versus n+-Si that influences the dynamic behavior during phototropic growth at the Se–Te/Si interface.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Multimodal Chemical Characterization of Brown Carbon in Atmosphere and Snowpack during SAIL Field Campaign Report

The main goal of this field project was to characterize the chemical and physical properties of light-absorbing particles (LAP) present in the atmosphere and snowpack. The specific field efforts included: 1) online measurement and sampling of light-absorbing particles using a Magee Scientific model AE33 aethalometer (AE33) and a time-resolved aerosol collector (TRAC); and 2) sampling of snowpack during observed events of LAP deposition on snow, confirmed by onsite U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility measurements and meteorological data. The ongoing research objectives of our follow-up sample and data analysis include: 1) Characterization of aerosol regimes and sources, identifying particle-type populations, mixing states, and atmospheric transformations based on correlative analysis of our detailed chemical imaging and chemical characterization measurements and real-time records from the second ARM Mobile Facility (AMF2) and other instruments available from the Surface Atmosphere Integrated Field Laboratory (SAIL) experiment; 2) Assessment of the optical and chemical properties of snowpack deposits to investigate how aerosol deposition influences snowpack lifetime.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Computer vision-based rock bolt detection in orthomosaic imagery obtained in the Waste Isolation Pilot Plant underground facility

Assessing structural integrity of large underground tunnel facilities is often a time consuming and human-labor intensive task. Thus, research using various modes of sensing and automated detection of key structural components in mines is posed to aid in safety assessments and establishing overall structural health. We propose an approach utilizing off-the-shelf camera and lidar technology fixed to a custom sensing platform, image stitching techniques, fine-tuned object detection models, and specialized model-inference methods to automatically detect, count, and map roof bolts for assessment of structural safety in man-made underground tunnels. Results show a novel workflow for effective object counting in orthomosaic tunnel ceiling images generated from collections in GPS-denied mining environments. Additionally, we demonstrate effective fine-tuning of EfficientDet object detectors utilizing state-of-the-art image augmentation techniques known as the mosaic and mixup transformations. Our work is demonstrated on sensed data and imagery collected from the Department of Energy (DOE) Waste Isolation Pilot Plant (WIPP) where miles of tunnel ceiling must be assessed for structural integrity.

42 ENGINEERING↗