Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “hyperspectral imagery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Spatial–spectral Schroedinger embedding for target detection in hyperspectral imagery

In this work, the Schroedinger eigenmaps (SE) algorithm using spatial and spectral information has been applied to supervised classification of hyperspectral imagery (HSI). We have previously introduced the use of SE in spectral target detection problems. The original SE-based target detector was built on the spectral information encoded in the Laplacian and Schroedinger operators. The original SE-based detector is extended such that spatial connectivity of target-like pixels is explored and encoded into the Schroedinger operator using a “knowledge propagation” scheme. The modified SE-based detector is applied to two HSI data sets that share similar target materials. Receiver operating characteristic curves and rates of detection and false alarm at object level are used as quantitative metrics to assess the detector. In addition, the Schroedinger embedding performance in target detection is compared against the performances of principal component embedding and the Laplacian embedding. Finally, results show that the SE-based detector with spatial–spectral features outperforms the other considered approaches.

36 MATERIALS SCIENCE↗

Prediction Metrics for Chemical Detection in Long-Wave Infrared Hyperspectral Imagery

A natural or anthropogenic process often generates a signature gas plume whose chemical constituents may be identified using hyperspectral imagery. A hyperspectral image is a pixel-indexed set of spectra where each spectrum reflects the chemical constituents of the plume, the atmosphere, the bounding background surface, and instrument noise. This study explored the relationship between gas absorbance and background emissivity across the long-wave infrared (LWIR) spectrum and how they affect relative gas detection sensitivity. The physics-based model for the observed radiance shows that high gas absorbance coupled with low background emissivity at a single wavenumber results in a stronger recorded radiance. Two sensitivity measures were developed to predict relative probability of detection using chemical absorbance and background emissivity: one focused on a single wavenumber while another accounted for the entire spectrum. The predictive abilities of these measures were compared to synthetic image analysis. This study simulated images with 499 distinct gases at each of 6 concentrations over 6 different background surfaces with the atmosphere and level of instrument noise held constant. The Whitened Matched Filter was used to define gas detection from an image spectrum. The estimate of a chemical’s probability of detection at a given concentration over a specific background was the proportion of detections in 500 trials. Of the 499 chemicals used in the images, 276 had estimated probabilities of detection below 0.2 across all backgrounds and concentrations; these chemicals were removed from the study. For 92.8 percent of the remaining chemicals, the single channel measure correctly predicted the background over which the chemical had the largest relative probability of detection. Further, the measure which accounted for information across all wavenumbers predicted the background over which the chemical had the largest relative probability of detection for 93.3 percent of the chemicals. These results suggest that the wavenumber with largest gas absorbance has the most influence over gas detection for this data. By furthering the in-silico experimentation with higher concentrations of gases not detectable in this experiment or by standardizing the gas absorbance spectra to unit vectors, these conclusions may be confirmed and generalized to more gases. This will help simplify image acquisition planning and the identification of unknowns in field collected images.

54 ENVIRONMENTAL SCIENCES↗

PREDICTION METRICS FOR CHEMICAL DETECTION IN LONG-WAVE INFRARED HYPERSPECTRAL IMAGERY

Natural and man-made chemical processes generate gaseous plumes that may be detected by hyperspectral imaging, which produces a matrix of spectra affected by the chemical constituents of the plume, the atmosphere, the bounding background surface and instrument noise. A physics-based model of observed radiance shows that high chemical absorbance and low background emissivity result in a larger chemical signature. Using simulated hyperspectral imagery, this study investigated two metrics which exploited this relationship. The objective was to explore how well the chosen metrics predicted when a chemical would be more easily detected when comparing one background type to another. The two predictor metrics correctly rank ordered the backgrounds for about 94% of the chemicals tested as compared to the background rank orders from Whitened Matched Filtering (a detection algorithm) of the simulated spectra. These results suggest that the metrics provide a reasonable summary of how the background emissivity and chemical absorbance interact to produce the at-sensor chemical signal. This study suggests that similarly effective predictors that account for more general physical conditions may be derived.

Chilton, M↗

Chemical signature characterization with hyperspectral imagery: novel deep learning model architectures and physically-motivated data augmentation techniques

The high spectral resolution afforded by Hyperspectral Imaging (HSI) sensors is poised to bring unprecedented advancements to signature characterization applications. Thus far, much of the research in the machine learning field devoted to HSI applications has focused on a few specific tasks like land-use land-cover classification. In land classification tasks, spatial information is very important, and model architectures are often designed to leverage spatial contexts. However, it is unclear how well these spatially-tuned models will translate to tasks where spectral information is critical, like the detection and characterization of chemicals. In this work, we compare spectral models (inputs are 1D spectra) and spatial-spectral models (inputs are 3D cubes) in the context of predicting chemical concentration maps. We find that spatial-spectral models perform the best, though we find a wide range in performance across the different architectures tested. Additionally, we find that model performance is impacted by the availability of training data, particularly in scenarios where the training data doesn't fully capture the true variance of real-world conditions. We find that data augmentation can help mitigate sparse coverage of observed parameter space (e.g., seasonal or geographic variability in ground cover), and present augmentation strategies that are tailored to hyperspectral data.

• Artificial intelligence (AI) / machine learning ↗

Weak signal detection in hyperspectral imagery using sparse matrix transform (SMT) covariance estimation

Many detection algorithms in hyperspectral image analysis, from well-characterized gaseous and solid targets to deliberately uncharacterized anomalies and anomlous changes, depend on accurately estimating the covariance matrix of the background. In practice, the background covariance is estimated from samples in the image, and imprecision in this estimate can lead to a loss of detection power. In this paper, we describe the sparse matrix transform (SMT) and investigate its utility for estimating the covariance matrix from a limited number of samples. The SMT is formed by a product of pairwise coordinate (Givens) rotations, which can be efficiently estimated using greedy optimization. Experiments on hyperspectral data show that the estimate accurately reproduces even small eigenvalues and eigenvectors. In particular, we find that using the SMT to estimate the covariance matrix used in the adaptive matched filter leads to consistently higher signal-to-noise ratios.

97 MATHEMATICS AND COMPUTING↗

One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library, which is often expanded with physics models to incorporate different spectral characteristics. In general, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop an absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML)-based methods, is susceptible to subjectivity in derived detection map quality. Here, in this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared HSI obtained from historical Mako sensor campaigns over Los Angeles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune and select PNNs to detect multiple gas targets that are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed with ML-based predictors, but less common with detection methods relying on learned latent spaces.

Hyperspectral imaging↗

Radiometric and geometric analysis of hyperspectral imagery acquired from an unmanned aerial vehicle

During the summer of 2010, an Unmanned Aerial Vehicle (UAV) hyperspectral in-flight calibration and characterization experiment of the Resonon PIKA II imaging spectrometer was conducted at the U.S. Department of Energy’s Idaho National Laboratory (INL) UAV Research Park. The purpose of the experiment was to validate the radiometric calibration of the spectrometer and determine the georegistration accuracy achievable from the on-board global positioning system (GPS) and inertial navigation sensors (INS) under operational conditions. In order for low-cost hyperspectral systems to compete with larger systems flown on manned aircraft, they must be able to collect data suitable for quantitative scientific analysis. The results of the in-flight calibration experiment indicate an absolute average agreement of 96.3%, 93.7% and 85.7% for calibration tarps of 56%, 24%, and 2.5% reflectivity, respectively. The achieved planimetric accuracy was 4.6 meters (based on RMSE).

42 ENGINEERING↗

Monitoring of Terrestrial Aquatic Ecosystems Through Analysis of Time-Variant Hyperspectral Imagery

Time-variant spectral analysis of plants can classify stress-based perturbations (e.g., dry soil or increased salination) and quantify mechanistic attributes associated with plant photosynthesis, respiration, hormone function, and plant morphology. This project will investigate the utility of hyperspectral cameras for detecting and monitoring these perturbations.

59 BASIC BIOLOGICAL SCIENCES↗

Effect of Background Emissivity on Gas Detection in Thermal Hyperspectral Imagery

Detecting and identifying weak gaseous plumes using thermal imaging data is complicated by many factors. These include variability due to atmosphere, ground and plume temper- ature, and background clutter. This paper presents an analysis of one formulation of the physics-based radiance model, which describes at-sensor observed radiance. The background emissivity and plume/ground temperatures are isolated, and their effects on net chemical signal are described. This analysis shows that the plume’s physical state, emission or absorption, is directly dependent on the background emissivity. It then describes what conditions on the background emissivity have inhibiting effects on the net chemical signal. These claims are illustrated by analyzing synthetic hyperspectral imaging data with the Adaptive Matched Filter using four chemicals and three distinct background emissivities. Two chemicals (Carbontetrachloride and Tetraflourosilane) in the analysis had a very strong relationship with the background emissivities: they exhibited absorbance over a small range of wavenumbers and the background emissivities showed a consistent ordering at these wavenumbers. Analysis of simulated hyperspectral images containing these chemicals showed complete agreement with the analysis of the physics-based model that described when the background emissivities would have inhibiting effects on gas detection. The other chemicals considered (Ammonia and Tributylphosphate) exhibited very complex absorbance structure across the longwave infrared spectrum. Analysis of images containing these chemicals revealed that the the analysis of the physics-based model did not hold completely for these complex chemicals but did suggest that gas detection was dominated by their dominant absorbance features. These results provide some explanation of the effect of the background emissivity on gas detection and a more general exploration of gas absorbance/background emissivity variability and their effects on gas detection is warranted. i

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Statistics for the Relative Detectability of Chemicals in Weak Gaseous Plumes in LWIR Hyperspectral Imagery

The detection and identification of weak gaseous plumes using thermal imaging data is complicated by many factors. These include variability due to atmosphere, ground and plume temperature, and background clutter. This paper presents an analysis of one formulation of the physics-based model that describes the at-sensor observed radiance. The motivating question for the analyses performed in this paper is as follows. Given a set of backgrounds, is there a way to predict the background over which the probability of detecting a given chemical will be the highest? Two statistics were developed to address this question. These statistics incorporate data from the long-wave infrared band to predict the background over which chemical detectability will be the highest. These statistics can be computed prior to data collection. As a preliminary exploration into the predictive ability of these statistics, analyses were performed on synthetic hyperspectral images. Each image contained one chemical (either carbon tetrachloride or ammonia) spread across six distinct background types. The statistics were used to generate predictions for the background ranks. Then, the predicted ranks were compared to the empirical ranks obtained from the analyses of the synthetic images. For the simplified images under consideration, the predicted and empirical ranks showed a promising amount of agreement. One statistic accurately predicted the best and worst background for detection in all of the images. Future work may include explorations of more complicated plume ingredients, background types, and noise structures.

54 ENVIRONMENTAL SCIENCES↗