SEARCH · Engineering Papers

Results for “multispectral imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Comparison of CNN-Based Image Classification Approaches for Implementation of Low-Cost Multispectral Arcing Detection

Camera-based sensing has benefited in recent years from developments in machine learning data processing methods, as well as improved data collection options such as Unmanned Aerial Vehicles (UAV) mounted sensors. However, cost considerations, both for the initial purchase of sensors as well as updates, maintenance, or potential replacement if damaged, can limit adoption of more expensive sensing options for some applications. To evaluate more affordable options with less expensive, more available, and more easily replaceable hardware, we examine the use of machine learning-based image classification with custom datasets, utilizing deep learning based-image classification and the use of ensemble models for sensor fusion. Utilizing the same models for each camera to reduce technical overhead, we showed that for a very representative training dataset, camera-based detection can be successful for detection of electrical arcing. We also use multiple validation datasets, based on conditions expected to be of varying difficulty, to evaluate custom data. These results show that ensemble models of different data sources can mitigate risks from gaps in training data, though the system will be less redundant for those cases unless other precautions are taken. We found that with good quality custom datasets, data fusion models can be utilized without specialization in design to the specific cameras utilized, allowing for less specialized, more accessible equipment to be utilized as multispectral camera components. This approach can provide an alternative to expensive sensing equipment for applications in which lower-cost or more easily replaceable sensing equipment is desirable.

convolutional neural networks↗

DOE OSTI2020

3D Volumetric Structural Hierarchy Induced by Colloidal Polymerization of a Quantum-Dot Ionic Liquid Monomer Conjugate

Hierarchically structured emissive quantum dot (CdS/CdSe) poly(ionic liquid) composites are synthesized through colloidal polymerization within a lyotropic liquid crystal, yielding a solvent-responsive nanoparticle (NP) composite possessing four ordered structural motifs. The composite is prepared by coassembling an amphiphilic ionic liquid (IL) monomer, 3-decyl-1-vinylimidazolium chloride, [C 10 VIm + ][Cl - ], and IL monomer, 3-(10-mercaptodecyl)-1-vinylimidazolium bromide surface-functionalized quantum dots, QD-[SC 10 VIm + ][Br - ], in 30 wt % water. Photo (UV)-initiated free radical polymerization serves to form a colloidal copolymer that collimates pairs of QDs within the core of large cylinders (average diameter = 21 nm and length = 422 nm), as evidenced by ultrasmall-angle X-ray scattering (USAXS). As revealed by continuous wave terahertz multispectral reconstructive 3-D imaging, the subsurface structure along the cylinder axis undergoes dynamic rearrangement between 2D hexagonal and cubic packing. The polymerized ionic liquid sheath surrounding the QDs is composed of concentric hexagonally perforated lamellae (HPL) with an interlamellar repeat distance of 3 nm, as determined by small-angle X-ray scattering (SAXS). The encapsulated QDs retain crystallinity (TEM and WAXS) and emission characteristics (photoluminescence spectroscopy, lambda(EM) = 638 nm). Phenomenological time-dependent Ginzburg-Landau calculations verify the mesoscale cylinders arise from the topological constraints imposed by the in-plane perforations of the polymerized ionic liquid as it wraps around the hard (unmalleable) spherical QDs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Quantifying the robustness of deep multispectral segmentation models against natural perturbations and data poisoning

In overhead image segmentation tasks, including additional spectral bands beyond the traditional RGB channels can improve model performance. However, it is still unclear how incorporating this additional data impacts model robustness to adversarial attacks and natural perturbations. For adversarial robustness, the additional in-formation could improve the model’s ability to distinguish malicious inputs, or simply provide new attack avenues and vulnerabilities. For natural perturbations, the additional information could better inform model decisions and weaken perturbation effects or have no significant influence at all. In this work, we seek to characterize the performance and robustness of a multispectral (RGB and near infrared) image segmentation model subjected to adversarial attacks and natural perturbations. While existing adversarial and natural robustness research has focused primarily on digital perturbations, we prioritize on creating realistic perturbations designed with physical world conditions in mind. For adversarial robustness, we focus on data poisoning attacks whereas for natural robustness, we focus on extending ImageNet-C common corruptions for fog and snow that coherently and self-consistently perturbs the input data. Overall, we find both RGB and multispectral models are vulnerable to data poisoning attacks regardless of input or fusion architectures and that while physically-realizable natural perturbations still degrade model performance, the impact differs based on fusion architecture and input data.

Deep learning, multispectral images, multimodal fu↗

DOE OSTI2020

Mapping Vegetation at Species Level with High-Resolution Multispectral and Lidar Data Over a Large Spatial Area: A Case Study with Kudzu

Mapping vegetation species is critical to facilitate related quantitative assessment, and mapping invasive plants is important to enhance monitoring and management activities. Integrating high-resolution multispectral remote-sensing (RS) images and lidar (light detection and ranging) point clouds can provide robust features for vegetation mapping. However, using multiple sources of high-resolution RS data for vegetation mapping on a large spatial scale can be both computationally and sampling intensive. Here, we designed a two-step classification workflow to potentially decrease computational cost and sampling effort and to increase classification accuracy by integrating multispectral and lidar data in order to derive spectral, textural, and structural features for mapping target vegetation species. We used this workflow to classify kudzu, an aggressive invasive vine, in the entire Knox County (1362 km2) of Tennessee (U.S.). Object-based image analysis was conducted in the workflow. The first-step classification used 320 kudzu samples and extensive, coarsely labeled samples (based on national land cover) to generate an overprediction map of kudzu using random forest (RF). For the second step, 350 samples were randomly extracted from the overpredicted kudzu and labeled manually for the final prediction using RF and support vector machine (SVM). Computationally intensive features were only used for the second-step classification. SVM had constantly better accuracy than RF, and the producer’s accuracy, user’s accuracy, and Kappa for the SVM model on kudzu were 0.94, 0.96, and 0.90, respectively. SVM predicted 1010 kudzu patches covering 1.29 km2 in Knox County. We found the sample size of kudzu used for algorithm training impacted the accuracy and number of kudzu predicted. The proposed workflow could also improve sampling efficiency and specificity. Our workflow had much higher accuracy than the traditional method conducted in this research, and could be easily implemented to map kudzu in other regions as well as map other vegetation species.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2026

Multispectral UAV imagery of experimental freshwater wetlands under 5 ppt saltwater intrusion, Louisiana, 2023 and 2024

Multispectral imagery was collected using an unmanned aerial vehicle (UAV) to evaluate how freshwater vegetation responds to short-term simulated saltwater intrusion events. The purpose of this data collection was to understand how plant health changes in response to acute salinity exposure, which is increasingly relevant in coastal wetland ecosystems facing sea level rise and storm surge events, such as in coastal Louisiana. Three experimental saltwater intrusions were conducted at a salinity of approximately 5 parts per thousand (ppt) for durations of 6-days, 10-days, and 17-days. UAV flights occurred both before and after each treatment. The resulting imagery was processed using Pix4DMapper software to georeference the images and generate orthomosaics. The multispectral sensor used in this study captures reflectance in five bands: blue, green, red, red-edge, and near-infrared. The uploaded data consist of georeferenced .tif orthomosaics for each spectral band, which are compatible with GIS software for vegetation analysis. This imagery can be utilized in investigations into vegetation stress, remote sensing of freshwater wetland ecosystems, and modeling of plant response to environmental changes.

EARTH SCIENCE > BIOSPHERE > ECOSYSTEMS↗

DOE OSTI2021

Multi-sensor anomalous change detection in remote sensing imagery

Combining multiple satellite remote sensing sources provides a far richer, more frequent view of the earth than that of any single source; the challenge is in distilling these petabytes of heterogeneous sensor imagery into meaningful characterizations of the imaged areas. Meeting this challenge requires effective algorithms for combining multi-modal imagery over time to identify subtle but real changes among the intrinsic data variation. Here, we implement a joint-distribution framework for multi-sensor anomalous change detection (MSACD) that can effectively account for these differences in modality, and does not require any signal resampling of the pixel measurements. This flexibility enables the use of satellite imagery from different sensor platforms and modalities. We use multi-year construction of the SoFi Stadium in California as our testbed, and exploit synthetic aperture radar imagery from Sentinel-1 and multispectral imagery from both Sentinel-2 and Landsat 8. We show results for MSACD using real imagery with implanted, measurable changes, as well as real imagery with real, observable changes, including scaling our analysis over multiple years.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Cycle-Consistent Adversarial Networks for Realistic Pervasive Change Generation in Remote Sensing Imagery

This paper introduces a new method of generating realistic pervasive changes in the context of evaluating the effectiveness of change detection algorithms in controlled settings. The method - a cycle-consistent adversarial network (CycleGAN) - requires low quantities of training data to generate realistic changes. Here we show an application of CycleGAN in creating realistic snow-covered scenes of multispectral Sentinel-2 imagery, and demonstrate how these images can be used as a test bed for anomalous change detection algorithms.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Image Collection Simulation Using High-Resolution Atmospheric Modeling

A new method is described for simulating the passive remote sensing image collection of ground targets that includes effects from atmospheric physics and dynamics at fine spatial and temporal scales. The innovation in this research is the process of combining a high-resolution weather model with image collection simulation to attempt to account for heterogeneous and high-resolution atmospheric effects on image products. The atmosphere was modeled on a 3D voxel grid by a Large-Eddy Simulation (LES) driven by forcing data constrained by local ground-based and air-based observations. The spatial scale of the atmospheric model (10–100 m) came closer than conventional weather forecast scales (10–100 km) to approaching the scale of typical commercial multispectral imagery (2 m). This approach was demonstrated through a ground truth experiment conducted at the Department of Energy Atmospheric Radiation Measurement Southern Great Plains site. In this experiment, calibrated targets (colored spectral tarps) were placed on the ground, and the scene was imaged with WorldView-3 multispectral imagery at a resolution enabling the tarps to be visible in at least 9–12 image pixels. The image collection was simulated with Digital Imaging and Remote Sensing Image Generation (DIRSIG) software, using the 3D atmosphere from the LES model to generate a high-resolution cloud mask. The high-resolution atmospheric model-predicted cloud coverage was usually within 23% of the measured cloud cover. The simulated image products were comparable to the WorldView-3 satellite imagery in terms of the variations of cloud distributions and spectral properties of the ground targets in clear-sky regions, suggesting the potential utility of the proposed modeling framework in improving simulation capabilities, as well as testing and improving the operation of image collection processes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Validation of 2D Te and ne measurements made with Helium imaging spectroscopy in the volume of the TCV divertor

Abstract Multi-spectral imaging of helium atomic emission (HeMSI) has been used to create 2D poloidal maps of T e and n e in TCV’s divertor. To achieve these measurements, TCV’s MANTIS multispectral cameras (Perek et al 2019 Rev. Sci. Instrum. 90 123514) simultaneously imaged four He I lines (two singlet and two triplet) and a He II line (468 nm) from passively present He and He + . The images, which were absolutely calibrated and covered the whole divertor region, were inverted through the assumption of toroidal symmetry to create emissivity profiles and, consequently, line-ratio profiles. A collisional-radiative model (CRM) was applied to the line-ratio profiles to produce 2D poloidal maps of T e and n e . The collisional-radiative modeling was accomplished with the Goto helium CRM code (Zholobenko et al 2018 Nucl. Fusion 58 126006, Zholobenko et al 2018 Technical Report , Goto 2003 J. Quant. Spectrosc. Radiat. Transfer 76 331–44) which accounts for electron-impact excitation (EIE) and deexcitation, and electron–ion recombination (EIR) with He + . The HeMSI T e and n e measurements were compared with co-local Thomson scattering measurements. The two sets of measurements exhibited good agreement for ionizing plasmas: ( 5 eV ⩽ T e ⩽ 60 eV , and 2 × 10 18 m − 3 ⩽ n e ⩽ 3 × 10 19 m − 3 ) in the case of majority helium plasmas, and ( 10 eV ⩽ T e ⩽ 40 eV , 2 × 10 18 m − 3 ⩽ n e ⩽ 3 × 10 19 m − 3 ) in the case of majority deuterium plasmas. However, there were instances where HeMSI measurements diverged from Thomson scattering. When T e ⩽ 10 eV in majority deuterium plasmas, HeMSI deduced inaccurately high values of T e . This disagreement cannot be rectified within the CRM’s EIE and EIR framework. Second, on sporadic occasions within the private flux region, HeMSI produced erroneously high measurements of n e . Multi-spectral imaging of Helium emission has been demonstrated to produce accurate 2D poloidal maps of T e and n e within the divertor of a tokamak for plasma conditions relevant to contemporary divertor studies.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

UAV remote sensing imagery - Miscanthus trials 2020 - Energy Farm - UIUC

Aerial imagery utilized as input in the manuscript "Deep convolutional neural networks exploit high spatial and temporal resolution aerial imagery to predict key traits in miscanthus" . Data was collected over M. Sacchariflorus and Sinensis breeding trials at the Energy Farm, UIUC in 2020. Flights were performed using a DJI M600 mounted with a Micasense Rededge multispectral sensor at 20 m altitude around solar noon. Imagery is available as tif file by field trial and date (10). The post-processing of raw images into orthophoto was performed in Agisoft Metashape software. Each crop surface model and multispectral orthophoto was stacked into an unique raster stack by date and uploaded here. Each raster stack includes 6 layers in the following order: Layer 1 = crop surface model, Layer 2 = Blue, Layer 3 = Green, Layer 4 = Red, Layer 5 = Rededge, and Layer 6 = NIR multispectral bands. Msa raster stacks were resampled to 1.67 cm spatial resolution and Msi raster stacks were resampled to 1.41 cm spatial resolution to ease their integration into further analysis. 'MMDDYYYY' is the date of data collection, 'MSA' is M. Sacchariflorus trial, 'MSI' is Miscanthus Sinensis trial, 'CSM' is crop surface model layer, and 'MULTSP' are the five multispectral bands.

bioenergy↗

DOE OSTI2022

Airborne hyperspectral imaging of cover crops through radiative transfer process-guided machine learning

Cover cropping between cash crop growing seasons is a multifunctional conservation practice. Timely and accurate monitoring of cover crop traits, notably aboveground biomass and nutrient content, is beneficial to agricultural stakeholders to improve management and understand outcomes. Currently, there is a scarcity of spatially and temporally resolved information for assessing cover crop growth. Remote sensing has a high potential to fill this need, but conventional empirical regression operated with coarse-resolution multispectral data has large uncertainties. Therefore, this study utilized airborne hyperspectral imaging techniques and developed new process-guided machine learning approaches (PGML) for cover crop monitoring. Specifically, we deployed an airborne hyperspectral system covering visible to shortwave-infrared wavelengths (400–2400 nm) to acquire high spatial (0.5 m) and spectral (3–5 nm) resolution reflectance over 23 cover crop fields across Central Illinois in March and April of 2021. Airborne hyperspectral surface reflectance with high spectral and spatial resolution can be well matched with field data to quantify cover crop traits. Furthermore, the PGML models were pre-trained by synthetic data from soil-vegetation radiative transfer modeling (one million records), and then fine-tuned with field data of cover crop biomass and nutrient content. Results show that airborne hyperspectral data with PGML can achieve high accuracy to predict cover crop aboveground biomass (R 2 = 0.72, relative RMSE = 15.16%) and nitrogen content (R 2 = 0.69, relative RMSE = 16.59%) through leave-one-field-out cross-validation. Unlike the pure data-driven approach (e.g., partial least-squares regression), PGML incorporated radiative transfer knowledge and obtained higher predictive performance with fewer field data. Meanwhile, with field data for model fine-tuning, PGML predicted biomass more accurately than the inversion of radiative transfer models. Here we also found that the red edge has a high contribution in quantifying aboveground biomass and nitrogen content, followed by green and shortwave spectra. This study demonstrated the first attempt of utilizing hyperspectral remote sensing to accurately quantify cover crop traits. We highlight the strength of PGML in exploiting sensing data to quantify ecosystem variables to advance agroecosystem monitoring for sustainable agricultural management.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2024

Plasmonic photoconductive terahertz focal-plane array with pixel super-resolution

Abstract Imaging systems operating in the terahertz part of the electromagnetic spectrum are attractive due to their ability to penetrate many opaque materials and provide unique spectral signatures of various chemicals. However, the use of terahertz imagers in real-world applications has been limited by the slow speed, large size, high cost and complexity of present systems, largely due to the lack of suitable terahertz focal-plane array detectors. Here we report a terahertz focal-plane array that can directly provide the spatial amplitude and phase distributions, along with the ultrafast temporal and spectral information of an imaged object. It consists of a two-dimensional array of ~0.3 million plasmonic photoconductive nanoantennas optimized to rapidly detect broadband terahertz radiation with a high signal-to-noise ratio. We utilized the multispectral nature of the amplitude and phase data captured by these plasmonic nanoantennas to image different objects, including super-resolved etched patterns in a silicon substrate and defects in battery electrodes. By eliminating the need for raster scanning and spatial terahertz modulation, our terahertz focal-plane array offers more than a 1,000-fold increase in the imaging speed compared with the state of the art and potentially suits a broad range of applications in industrial inspection, security screening and medical diagnosis, among others.

Optics↗

DOE OSTI2022

Sustainability Trait Modeling of Field-Grown Switchgrass (Panicum virgatum) Using UAV-Based Imagery

Unmanned aerial vehicles (UAVs) provide an intermediate scale of spatial and spectral data collection that yields increased accuracy and consistency in data collection for morphological and physiological traits than satellites and expanded flexibility and high-throughput compared to ground-based data collection. In this project, we used UAV-based multispectral imagery collected from MicaSense RedEdge-M on a DJI Matrice 600 Pro for automated phenotyping of field-grown switchgrass (Panicum virgatum), a leading bioenergy feedstock. The raw images were processed with Pix4D Mapper to create the reflectance data, and vegetation indices were calculated from a UAV-based multispectral camera. Statistical models were developed for rust disease caused by Puccinia novopanici, leaf chlorophyll, nitrogen, and lignin contents. For the first time, UAV remote sensing technology was used to explore the potential for multiple traits associated with sustainable production of switchgrass. One statistical model was developed for each individual trait based on the statistical correlation between vegetation indices and the corresponding trait.

CBI↗

DOE OSTI2025

ORBITaL-Net: A labeled training library for large-scale building feature extraction

Over the course of several years, nearly 1.5 million building outlines have been created from approximately 128,000 training tiles covering roughly 7,000 km 2 of very high-resolution multispectral overhead imagery, primarily dated between 2010 and 2020. This dataset, dubbed the Oak Ridge Building Image and TrAining Label Net (ORBITaL-Net), is designed for machine learning applications and is global in scope, with samples drawn from 72 countries across North America, South America, Africa, Europe, and Asia. ORBITaL-Net captures a great diversity in geographic setting, structural characteristics, land use (urban and rural), terrain, and imagery conditions. While the labeled building outlines are themselves valuable, the dataset’s true strength lies in the pairing of these labels with corresponding reference imagery, which is being released for open source use. Similar to SpaceNet and Replicable AI For Microplanning (ramp), this building outline dataset will allow the larger computer vision community from academia, government, and industry the opportunity to develop robust, scalable, and generalizable geospatial machine learning techniques. Unlike SpaceNet and ramp, which offer high resolution labels and imagery primarily for large urban cities, ORBITaL-Net is not focused on training samples from heavily populated areas but instead aims to capture the innate variability of conditions present in both the physical environment and imagery collections.

Geography↗

DOE OSTI2023

Multiparametric optical label-free imaging to analyze plant cell wall assembly and metabolism. (Final Report)

Plant tissues are often considered not ideal for fluorescence imaging because of the pervasive intrinsic fluorescence of many plant metabolites and the intricate interactions with light of the many semi-crystalline polymers at the cell wall. Our project aims to take advantage of this observed shortcoming by developing a label-free, optical microscopy platform for characterizing multiple fingerprints of important cell wall components and stress-related, at subcellular scale resolution. The new imaging system can collect fingerprints from both emitted and scattered light that can inform on the chemical nature, subcellular distribution, anisotropy, and molecular environment of multiple cell wall components in intact plant tissues. We are combining these imaging capabilities with computational tools that enable correlated registration, integration, and analysis. This fully integrated, multiparametric optical system will be used to address biological problems connected to cell wall assembly in grasses. This includes a focus on developmental and environmental variation of cell wall impregnation with silica, lignin, suberin, and cutin in different tissues and cell types. Our research plan comprises three main goals: (1) To develop an accessible imaging platform and associated open-source software able to extract and integrate fingerprints from fluorescence-associated (multispectral emission, lifetime, and polarization), wide-field polarimetry, second harmonic generation (SHG), and stimulated Raman scattering signals (SRS); (2) To determine unique combination of fingerprints for various cell wall components and selected metabolites; (3) To analyze the process of cell wall silicification in grasses and determine how silicification affects cell wall properties and lignin, cutin, and suberin deposition in other cell types under differ stress conditions.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Implementing Spatio-Temporal 3D-Convolution Neural Networks and UAV Time Series Imagery to Better Predict Lodging Damage in Sorghum

Unmanned aerial vehicle (UAV)-based remote sensing is gaining momentum in a variety of agricultural and environmental applications. Very-high-resolution remote sensing image sets collected repeatedly throughout a crop growing season are becoming increasingly common. Analytical methods able to learn from both spatial and time dimensions of the data may allow for an improved estimation of crop traits, as well as the effects of genetics and the environment on these traits. Multispectral and geometric time series imagery was collected by UAV on 11 dates, along with ground-truth data, in a field trial of 866 genetically diverse biomass sorghum accessions. We compared the performance of Convolution Neural Network (CNN) architectures that used image data from single dates (two spatial dimensions, 2D) versus multiple dates (two spatial dimensions + temporal dimension, 3D) to estimate lodging detection and severity. Lodging was detected with 3D-CNN analysis of time series imagery with 0.88 accuracy, 0.92 Precision, and 0.83 Recall. This outperformed the best 2D-CNN on a single date with 0.85 accuracy, 0.84 Precision, and 0.76 Recall. The variation in lodging severity was estimated by the best 3D-CNN analysis with 9.4% mean absolute error (MAE), 11.9% root mean square error (RMSE), and goodness-of-fit (R2) of 0.76. This was a significant improvement over the best 2D-CNN analysis with 11.84% MAE, 14.91% RMSE, and 0.63 R2. The success of the improved 3D-CNN analysis approach depended on the inclusion of “before and after” data, i.e., images collected on dates before and after the lodging event. The integration of geometric and spectral features with 3D-CNN architecture was also key to the improved assessment of lodging severity, which is an important and difficult-to-assess phenomenon in bioenergy feedstocks such as biomass sorghum. This demonstrates that spatio-temporal CNN architectures based on UAV time series imagery have significant potential to enhance plant phenotyping capabilities in crop breeding and Precision agriculture applications.

3D-convolution neural networks↗

DOE OSTI2020

Spectral, Compositional, and Physical Properties of the Upper Murray Formation and Vera Rubin Ridge, Gale Crater, Mars

During 2018 and 2019, the Mars Science Laboratory Curiosity rover investigated the chemistry, morphology, and stratigraphy of Vera Rubin ridge (VRR). Using orbital data from the Compact Reconnaissance Imaging Spectrometer for Mars, scientists attributed the strong 860 nm signal associated with VRR to the presence of red crystalline hematite. However, Mastcam multispectral data and CheMin X-ray diffraction (XRD) measurements show that the depth of the 860 nm absorption is negatively correlated with the abundance of red crystalline hematite, suggesting that other mineralogical or physical parameters are also controlling the 860 nm absorption. Here, we examine Mastcam and ChemCam passive reflectance spectra from VRR and other locations to link the depth, position, and presence or absence of iron-related mineralogic absorption features to the XRD-derived rock mineralogy. Correlating CheMin mineralogy to spectral parameters showed that the ~860 nm absorption has a strong positive correlation with the abundance of ferric phyllosilicates. New laboratory reflectance measurements of powdered mineral mixtures can reproduce trends found in Gale crater. We hypothesize that variations in the 860 nm absorption feature in Mastcam and ChemCam observations of VRR materials are a result of three factors: (1) variations in ferric phyllosilicate abundance due to its ~800–1,000 nm absorption; (2) variations in clinopyroxene abundance because of its band maximum at ~860 nm; and (3) the presence of red crystalline hematite because of its absorption centered at 860 nm. We also show that relatively small changes in Ca-sulfate abundance is one potential cause of the erosional resistance and geomorphic expression of VRR.

58 GEOSCIENCES↗

DOE OSTI2020

A data-driven approach to sampling matrix selection for compressive sensing

Sampling is a fundamental aspect of any implementation of compressive sensing. Typically, the choice of sampling method is guided by the reconstruction basis. However, this approach can be problematic with respect to certain hardware constraints and is not responsive to domain-specific context. We propose a method for defining an order for a sampling basis that is optimal with respect to capturing variance in data, thus allowing for meaningful sensing at any desired level of compression. We focus on the Walsh-Hadamard sampling basis for its relevance to hardware constraints, but our approach applies to any sampling basis of interest. We illustrate the effectiveness of our method on the Physical Sciences Inc. Fabry-Perot interferometer sensor multispectral dataset, the Johns Hopkins Applied Physics Lab FTIR-based longwave infrared sensor hyperspectral dataset, and a Colorado State University Swiss Ranger depth image dataset. The spectral datasets consist of simulant experiments, including releases of chemicals such as GAA and SF6. We combine our sampling and reconstruction with the adaptive coherence estimator (ACE) and bulk coherence for chemical detection and we incorporate an algorithmic threshold for ACE values to determine the presence or absence of a chemical. We compare results across sampling methods in this context. We have successful chemical detection at a compression rate of 90%. For all three datasets, we compare our sampling approach to standard orderings of sampling basis such as random, sequency, and an analog of sequency that we term `frequency.' In one instance, the peak signal to noise ratio was improved by over 30% across a test set of depth images.

compressive sensing, hyperspectral imaging, Walsh-↗