Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “hyperspectral imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Toward Intelligent Multimodal Holography for Real-Time Chemical Imaging of Dynamic Ion Separation

Molecular-level visualization of ion transport and separation dynamics in complex environments is crucial for advancing energy systems, water purification, and critical materials recovery. Achieving this requires imaging platforms that combine structural sensitivity, chemical specificity, and real-time operation. Digital off-axis holography (DOAH) provides high-throughput, label-free quantitative phase imaging but inherently lacks chemical selectivity. Integrating DOAH with complementary spectroscopic channels such as fluorescence or hyperspectral imaging introduces the needed molecular specificity, while also creating challenges in multimodal data fusion, synchronization, and computational throughput. Artificial intelligence offers a powerful route to address these limitations by uniting physics-based reconstruction with data-driven interpretation. In this Perspective, we outline a framework for intelligent multimodal holography and demonstrate its potential using a preliminary AI-driven test case. Raw DOAH holograms of lanthanide solutions subjected to magnetic field gradients were analyzed using multi-agent AI workflows that autonomously selected reconstruction tools, extracted NMF components, and generated scientific claims consistent with true paramagnetic and diamagnetic behavior. This demonstration shows how AI-enabled reasoning can deliver real-time chemical–structural interpretation directly from raw holograms. Together, these advances define a path toward adaptive, intelligent holography platforms capable of supporting in situ chemical separations, dynamic ion transport analysis, and next-generation interfacial science.

Ricchiuti, Giovanna↗
DOE OSTI2024

Hyperspectral Detection of the Fluorescence Shift between Chirality-Sorted Empty and Water-Filled Single-Wall Carbon Nanotube Enantiomers

Single-wall carbon nanotubes (SWCNTs) have extraordinary electronic and optical properties that depend strongly on their exact chiral structure and their interaction with their inner and outer environment. The fluorescence (PL) of semiconducting SWCNTs, for instance, will shift depending on the molecules with which the SWCNT’s hollow core is filled. These interaction-induced shifts are challenging to resolve on the ensemble level in samples containing a mixture of different filling contents due to the relatively large inhomogeneous line width of the ensemble SWCNT PL compared to the size of these shifts. To circumvent this inhomogeneous broadening, single-tube spectroscopy and hyperspectral imaging are often applied, which until now required time-consuming statistical studies. Here, we present hyperspectral PL microscopy combined with automated SWCNT segmenting based on either principal component analysis or a convolutional neural network, capable of both spatially and spectrally resolving the PL along the length of many individual SWCNTs at the same time and automatically fitting peak positions and line widths of individual SWCNTs. The methodology is demonstrated by accurately determining the emission shifts and line widths of thousands of left- and right-handed empty and water-filled SWCNTs coated with a chiral surfactant, resulting in four statistical distributions which cannot be resolved in ensemble spectroscopy of unsorted samples. The results demonstrate a robust method to quickly probe ensemble properties with single-enantiomer spectral resolution. Moreover, it promises to be an absolute quantitative method to characterize the relative abundances of SWCNTs with different handedness or filling content in macroscopic samples, simply by counting individual species.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Fast Data Processing for Hyperspectral Sensors on Small Platforms

Hyperspectral imaging is a very promising technology for nuclear proliferation detection. However, due to size and weight restrictions, small hyperspectral platforms such as satellites and small drones lack the on-board computing resources for accurate, real-time analysis of the enormous flow of data that a continuously operating hyperspectral sensor generates. This severely limits satellite systems, which can collect far more data than what they can telemeter, and hinders the ability of all platforms to adapt their missions on the fly in response to observations. This program addresses the hyperspectral data processing challenge through development of new, fast and accurate algorithms that produce data products in real time. The algorithms circumvent the major computational bottlenecks in existing processing streams, and would be incorporated in lightweight, power-efficient single-board computer systems. The toolkit of fast algorithms will be immediately useful in current and future hyperspectral systems being built by the Government and by private industry, including drone-based systems and satellite constellations that acquire timely global imagery.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2024

In-line, High-Throughput Quality Monitoring for Fuel Cell and Electrolyzer Components Based on Transmission and Reflection Imaging

During the manufacturing of fuel cell and electrolyzer membranes and membrane electrode assemblies (MEAs), real-time, in-line, high-throughput optical-based quality monitoring methods are essential for detecting defects and monitoring thickness variations, thus improving the performance and increasing the durability of fuel cell and electrolyzer in the hydrogen industry. For the MEAs with very opaque coatings, optical transmission-based imaging has been developed and applied in the Roll-to-Roll system using a flashlight and a high-sensitivity CCD camera. We observed high signal-to-noise ratio images while the Roll-to-Roll system ran at 5 ft/min. The entire sample image could quickly be recovered from the discrete frames using customized Python codes for automatic frame cropping and stitching. We detected significant non-uniformities in our experimental MEAs specimen. For fuel cell and low-temperature electrolysis (LTE) transparent membranes, we used optical reflectance hyperspectral imaging with interference fringe-based thickness mapping. We set up a hyperspectral camera to measure various rolls of commercial membranes. The measurement results are analyzed to find the thickness distribution of each roll and to check for defects. Transmission and reflection imaging-based quality monitoring techniques demonstrated in this project can be widely used in the mass production environment to improve the production yield and performance of hydrogen devices.

DIRECT ENERGY CONVERSION,ENGINEERING↗
DOE OSTI2021

Randomized Algorithms for Scientific Computing (RASC)

Randomized algorithms have propelled advances in artificial intelligence (AI) and represent a foundational research area in advancing AI for Science. Future advancements in DOE Office of Science priority areas such as climate science, astrophysics, fusion, advanced materials, combustion, and quantum computing all require randomized algorithms for surmounting challenges of complexity, robustness, and scalability. Advances in data collection and numerical simulation have changed the dynamics of scientific research and motivate the need for randomized algorithms. For instance, advances in imaging technologies such as X-ray ptychography, electron microscopy, electron energy loss spectroscopy, or adaptive optics lattice light-sheet microscopy collect hyperspectral imaging and scattering data in terabytes, at breakneck speed enabled by state-of-the-art detectors. The data collection is exceptionally fast compared with its analysis. Likewise, advances in high-performance architectures have made exascale computing a reality and changed the economies of scientific computing in the process. Floating-point operations that create data are essentially free in comparison with data movement. Thus far, most approaches have focused on creating faster hardware. Ironically, this faster hardware has exacerbated the problem by making data still easier to create. Under such an onslaught, scientists often resort to heuristic deterministic sampling schemes (e.g., low-precision arithmetic, sampling every nth element) and sacrifice potentially valuable accuracy. Dramatically better results can be achieved via randomized algorithms, reducing the data size as much as or more than naive deterministic subsampling can achieve, while retaining the high accuracy of computing on the full data set. By randomized algorithms we mean those algorithms that employ some form of randomness in internal algorithmic decisions to accelerate time to solution, increase scalability, or improve reliability. Examples include matrix sketching for solving large-scale least-squares problems (see Figure 1) and stochastic gradient descent for training machine learning models. We are not recommending heuristic methods but rather randomized algorithms that have certificates of correctness and probabilistic guarantees of optimality and near-optimality. Such approaches can be useful beyond acceleration, for example, in understanding how to avoid measure zero worst-case scenarios that plague methods such as QR matrix factorization.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Hyperspectral segmentation of plants in fabricated ecosystems

Hyperspectral imaging provides a powerful tool for analyzing above-ground plant characteristics in fabricated ecosystems, offering rich spectral information across diverse wavelengths. This study presents an efficient workflow for hyperspectral data segmentation and subsequent data analytics, minimizing the need for user annotation through the use of ensembles of sparse mixed scale convolution neural networks. The segmentation process leverages the diversity of ensembles to achieve high accuracy with minimal labeled data, reducing labor-intensive annotation efforts. To further enhance robustness, we incorporate image alignment techniques to address spatial variability in the dataset. Downstream analysis focuses on using the segmented data for processing spectral data, enabling monitoring of plant health. This approach provides a scalable solution for spectral segmentation, and facilitates actionable insights into plant conditions in complex, controlled environments. Our results demonstrate the utility of combining advanced machine learning techniques with hyperspectral analytics for high-throughput plant monitoring.

Zwart, Petrus H.↗
DOE OSTI2022

Wildfires Temperature Estimation by Complementary Use of Hyperspectral PRISMA and Thermal (ECOSTRESS & L8)

This paper deals with detection and temperature analysis and of wildfires using PRISMA imagery. Precursore IperSpettrale della Missione Applicativa (Hyperspectral Precursor of the Application Mission, PRISMA) is a new hyperspectral mission by ASI (Agenzia Spaziale Italiana, Italian Space Agency) launched in 2019. This mission provides hyperspectral images with a spectral range of 400–2,500 nm and an average spectral resolution less than 12 nm and a spatial resolution of 30 m/pixel. This study focuses on the wildfire temperature estimation over the Bootleg Fire, US 2021. The analysis starts by considering the Hyperspectral Fire Detection Index (HFDI) which is used to analyze the informative content of the images, along with the analysis of some specific visible, near-infrared and shortwave-infrared bands. This first analysis is used as input to perform a temperature estimation of the areas with active wildfire. Surface temperature is retrieved using PRISMA radiance and a linear mixing model based on two background components (vegetation and burn scar) and two active fire components. PRISMA temperatures are compared with LST (Land Surface Temperature) products from NASA's ECOSTRESS and Landsat 8 which imaged the Bootleg Fire before and after PRISMA. A critical discussion of the results obtained with PRISMA is presented, followed by the advantages and limitation of the proposed approach.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2024

Near-field imaging of optical resonances in silicon metasurfaces using photoelectron microscopy

Precise control of light–matter interactions at the nanoscale lies at the heart of nanophotonics. However, experimental examination at this length scale is challenging since the corresponding electromagnetic near-field is often confined within volumes below the resolution of conventional optical microscopy. In semiconductor nanophotonics, electromagnetic fields are further restricted within the confines of individual subwavelength resonators, limiting access to critical light–matter interactions in these structures. In this work, we demonstrate that photoelectron emission microscopy (PEEM) can be used for polarization-resolved near-field spectroscopy and imaging of electromagnetic resonances supported by broken-symmetry silicon metasurfaces. We find that the photoemission results, enabled through an in situ potassium surface layer, are consistent with full-wave simulations and far-field reflectance measurements across visible and near-infrared wavelengths. In addition, we uncover a polarization-dependent evolution of collective resonances near the metasurface array edge taking advantage of the far-field excitation and full-field imaging of PEEM. Here, we deduce that coupling between eight resonators or more establishes the collective excitations of this metasurface. All told, we demonstrate that the high-spatial resolution hyperspectral imaging and far-field illumination of PEEM can be leveraged for the metrology of collective, non-local, optical resonances in semiconductor nanophotonic structures.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

NASA's surface biology and geology designated observable: A perspective on surface imaging algorithms

The 2017-2027 National Academies' Decadal Survey, Thriving on Our Changing Planet, recommended Surface Biology and Geology (SBG) as a "Designated Targeted Observable" (DO). The SBG DO is based on the need for capabilities to acquire global, high spatial resolution, visible to shortwave infrared (VSWIR; 380 - 2500 nm; ~30 m pixel resolution) hyperspectral (imaging spectroscopy) and multispectral midwave and thermal infrared (MWIR: 3-5 µm; TIR: 8-12 µm; ~60 m pixel resolution) measurements with sub-monthly temporal revisits over terrestrial, freshwater, and coastal marine habitats. To address the various mission design needs, an SBG Algorithms Working Group of multidisciplinary researchers has been formed to review and evaluate the algorithms applicable to the SBG DO across a wide range of Earth science disciplines, including terrestrial and aquatic ecology, atmospheric science, geology, and hydrology. Here, we summarize current state-of-the-practice VSWIR and TIR algorithms that use airborne or orbital spectral imaging observations to address the SBG DO priorities identified by the Decadal Survey: (i) terrestrial vegetation physiology, functional traits, and health; (ii) inland and coastal aquatic ecosystems physiology, functional traits, and health; (iii) snow and ice accumulation, melting, and albedo; (iv) active surface composition (eruptions, landslides, evolving landscapes, hazard risks); (v) effects of changing land use on surface energy, water, momentum, and carbon fluxes; and (vi) managing agriculture, natural habitats, water use/quality, and urban development. We review existing algorithms in the following categories: snow/ice, aquatic environments, geology, and terrestrial vegetation, and summarize the community-state-of-practice in each category. Finally, this effort synthesizes the findings of more than 130 scientists.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Broadband Fourier-Transform Optical Photothermal Infrared Spectroscopy and Imaging

Infrared (IR) spectroscopy is a powerful method for mapping chemical heterogeneity on the microscale. Synchrotron IR radiation uniquely provides a high brightness and broad bandwidth to further extend the capabilities of IR spectroscopic imaging. However, the diffraction-limited spatial resolution of IR spectroscopy is insufficient for studies requiring submicrometer spatial differentiation. Optical photothermal IR (O-PTIR) microscopy is a powerful, emerging method that overcomes the IR diffraction limit in IR hyperspectral imaging by employing a modulated IR beam and a visible probe laser beam to detect local temperature-induced modulation at the visible diffraction limit. In this work, we extend the spectral range of photothermal infrared measurements by incorporating a synchrotron IR source, demonstrating a combined synchrotron-based O-PTIR modality that enables high spatial resolution far-field chemical imaging spanning the entire mid-IR range. Both optical- and fluorescence-detected photothermal modalities were performed using a step-scan interferometer, demonstrating improved spectral range (541-4000 cm-1) when compared to optical photothermal microscopy with commercial laser sources (800-1800 cm-1 for this particular source) and improved spatial resolution, when compared to synchrotron microspectroscopy measurements. Following these initial validation studies, synchrotron Fourier-transform fluorescence-detected photothermal IR spectroscopy in combination with synchrotron microspectroscopy measurements was used to differentiate cells in mouse brain tissue sections, which requires submicron spatial resolutions beyond those accessible by IR spectroscopy alone.

Razumtcev, Aleksandr↗
DOE OSTI2021

Hyperspectral interference tomography of nacre

Significance We invented an optical technique—hyperspectral interference tomography—that rapidly and nondestructively extracts nanoscale structural information across large samples of nacre (mother-of-pearl) and other layered materials by combining multiangle and polarization-resolved hyperspectral imaging with optical-interference modeling. We investigated nacre in mollusk shells from two different species, red abalone and rainbow abalone, and discovered a previously unknown relationship between the age of the mollusk and the thickness of aragonite tablets in nacre. Hyperspectral interference tomography will have applications in climate science, since nacre tablet thickness in fossil shells is a proxy for ancient seawater temperature, and in bioinspired mechanics, because the layered structure of nacre inspires engineered materials with exceptional strength and toughness.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Hyper Spectral Anomaly Detection

Anomaly detection is a common machine learning (ML) task with growing importance in the fields of imaging, quality assurance, and multiple security related disciplines. Anomaly detection is more difficult than traditional machine learning methods due to the inherent unlabeled nature of the datasets. Existing anomaly detection architectures commonly face challenges with explainability, retaining information related to the relational structure of the data, and false positive rates. Hyperspectral Imaging Anomaly Detection (HSI) is a statistical model that employs vertex and edge weighted graphs to preserve the data’s relationships on different topographical scales. The model is able to generalize from anomaly detection in 2D images to novel datasets related to cyber-security. Furthermore, the use of multi-spectral and other filtering methods results in fewer false positives and increases the explainability of model predictions. When applying HSI to cyber-security datasets, we are able to successfully detect malicious activity with a relatively high degree of accuracy.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Selective Detection in Impulsive Low-Frequency Raman Imaging Using Shaped Probe Pulses

Impulsive stimulated Raman scattering (ISRS) using a single short femtosecond pump pulse to excite molecular vibrations offers an elegant pump-probe approach to perform vibrational imaging below 200 cm –1 . One shortcoming of ISRS is its inability to offer vibrational selectivity as all the vibrational bonds whose frequencies lie within the short pump-pulse bandwidth are excited. To date, several coherent control techniques have been explored to address this issue and selectively excite a specific molecular vibration by shaping the pump pulse. There has not been any systematic work that reports an analogous shaping of the probe pulse to implement preferential detection. In this work, we focus on vibrational imaging and report vibrational selective detection by shaping the probe pulse in time. Here, we demonstrate numerically and experimentally two pulse-shaping strategies with one functioning as a vibrational notch filter and the other functioning as a vibrational low-pass filter. This enables fast (25 μs/pixel) and selective hyperspectral imaging in the low-frequency regime (< 200 cm –1 ).

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2023

Learning and Predicting Photonic Responses of Plasmonic Nanoparticle Assemblies via Dual Variational Autoencoders

In this work, the application of machine learning is demonstrated for rapid and accurate extraction of plasmonic particles cluster geometries from hyperspectral image data via a dual variational autoencoder (dual-VAE). In this approach, the information is shared between the latent spaces of two VAEs acting on the particle shape data and spectral data, respectively, but enforcing a common encoding on the shape-spectra pairs. It is shown that this approach can establish the relationship between the geometric characteristics of nanoparticles and their far-field photonic responses, demonstrating that hyperspectral darkfield microscopy can be used to accurately predict the geometry (number of particles, arrangement) of a multiparticle assemblies below the diffraction limit in an automated fashion with high fidelity (for monomers (0.96), dimers (0.86), and trimers (0.58). This approach of building structure-property relationships via shared encoding is universal and should have applications to a broader range of materials science and physics problems in imaging of both molecular and nanomaterial systems.

variational autoencoder↗
DOE OSTI2025

Tracking seasonal variability in plant traits from spaceborne PRISMA and NEON AOP across forest types and ecoregions

Plant traits serve as critical indicators of how plants adapt to environmental changes and influence ecosystem functions. While airborne hyperspectral remote sensing effectively maps plant traits through detailed reflectance properties, it is limited by cost and scale, making large-scale and temporal studies challenging. The recently launched spaceborne hyperspectral imager, PRecursore IperSpettrale della Missione Applicativa (PRISMA), offers frequent, large scale and high-fidelity observations on a spatial resolution of 30 m and a revisit time of around 29 days, making it suitable for large-scale seasonal trait mapping. However, their potential remains largely unexplored. This study developed a multi-stage framework by leveraging the PRISMA spaceborne hyperspectral data and National Ecological Observatory Network (NEON) Airborne Observation Platform (AOP) hyperspectral data to investigate the seasonal dynamics of four key plant traits — chlorophyll content, carotenoid content, equivalent water thickness, and nitrogen content — across eleven NEON sites representing diverse forest types and ecoregions in the contiguous U.S. Our results demonstrated that PRISMA hyperspectral data can reliably track seasonal variability in plant traits, achieving overall R 2 values ranging from 0.78 to 0.88 and normalized root mean square error (NRMSE) values ranging from 5.4% to 8.4% for the four traits. Seasonal patterns revealed bell-shaped trajectories for chlorophyll and carotenoids, while equivalent water thickness decreased steadily across most sites, driven by structural changes during leaf maturation and senescence. Nitrogen content exhibited less pronounced seasonal variation but followed expected nutrient resorption patterns. Analysis of environmental drivers showed that seasonal variability is primarily controlled by solar radiation and day length in northern sites, vapor pressure in semi-arid regions, and temperature in mid-southeastern sites. Spatial variability, meanwhile, was primarily driven by soil properties, particularly during the peak growing season. However, the influence of soil variables slightly declines toward the end of the season at several sites, as climatic factors become more prominent. This study highlights the capability of PRISMA, and potentially other similar spaceborne hyperspectral data for large-scale, time-series plant trait mapping and provides valuable insights into the interactions between plant traits and environmental factors. In conclusion, these findings contribute to advancing our understanding of plant functional ecology and improving predictions of ecosystem responses to environmental changes.

Environmental drivers↗
DOE OSTI2026

Microbial spies and bloggers: programming cells to convert environmental information into discernible signals

Microbes regulate their dynamic behaviors using the chemical and physical characteristics of their environment. The ability of microbes to continuously convert this physicochemical information into biochemical information and to use organic matter in the environment as a power source makes these organisms attractive as chassis for building sensors. However, most biosensors have severe limitations when considering applications in hard-to-image settings like soils, sediments, and wastewater. Emerging technologies at the interface of biomolecular design, microbiome engineering, and synthetic biology offer new tools to program cells and communities as biosensors for these settings. Here, in this review, we describe innovations in biosensor outputs that are enabling new applications in complex environments, including reporters that are read out using electrochemical, gas chromatography, hyperspectral imaging, and next-generation sequencing methods. We also discuss computational advances that are accelerating the diversification of sensing components by mining metagenomics data for new transcriptional regulators and by designing allosteric protein switches that directly regulate reporter outputs using analytes. We highlight emerging opportunities for programming undomesticated microbes in communities to function as distributed sensors in the environment. Finally, we discuss the need for responsible biosensor development and to modernize regulatory frameworks to support evidence-based assessment of environmental biosensors.

analyte↗
DOE OSTI2024

Programmable nanowrinkle-induced room-temperature exciton localization in monolayer WSe2

Abstract Localized states in two-dimensional (2D) transition metal dichalcogenides (TMDCs) have been the subject of intense study, driven by potential applications in quantum information science. Despite the rapidly growing knowledge surrounding these emitters, their microscopic nature is still not fully understood, limiting their production and application. Motivated by this challenge, and by recent theoretical and experimental evidence showing that nanowrinkles generate strain-localized room-temperature emitters, we demonstrate a method to intentionally induce wrinkles with collections of stressors, showing that long-range wrinkle direction and position are controllable with patterned array design. Nano-photoluminescence (nano-PL) imaging combined with detailed strain modeling based on measured wrinkle topography establishes a correlation between wrinkle properties, particularly shear strain, and localized exciton emission. Beyond the array-induced wrinkles, nano-PL spatial maps further reveal that the strain environment around individual stressors is heterogeneous due to the presence of fine wrinkles that are less deterministic. At cryogenic temperatures, antibunched emission is observed, confirming that the nanocone-induced strain is sufficiently large for the formation of quantum emitters. At 300 K, detailed nanoscale hyperspectral images uncover a wide range of low-energy emission peaks originating from the fine wrinkles, and show that the states can be tightly confined to regions <10 nm, even in ambient conditions. These results establish a promising potential route towards realizing room temperature quantum emission in 2D TMDC systems.

36 MATERIALS SCIENCE↗