Recent Algorithm updates on Generating Weather and Climate Products from More Than 20 Years of Hyperspectral Sounders Data
Explore the source record for details and available documents.
PCRTM↗
SEARCH · Engineering Papers
Results for “Hyperspectral Data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Mapping Acid Sulfate Alteration of Basaltic Andesite with Thermal Infrared Data
Airborne thermal infrared multi- and hyperspectral data sets are used to map sulfate alteration of basaltic andesites near Reno, NV. Alteration includes quartz-alunite, jarosite and a number of clay minerals such as kaolinite and montmorillonite. Additional information is contained in the original extended abstract.
Vaughan, R. G.↗
Hyperspectral Image Classification using a Self-Organizing Map
The use of hyperspectral data to determine the abundance of constituents in a certain portion of the Earth's surface relies on the capability of imaging spectrometers to provide a large amount of information at each pixel of a certain scene. Today, hyperspectral imaging sensors are capable of generating unprecedented volumes of radiometric data. The Airborne Visible/Infrared Imaging Spectrometer (AVIRIS), for example, routinely produces image cubes with 224 spectral bands. This undoubtedly opens a wide range of new possibilities, but the analysis of such a massive amount of information is not an easy task. In fact, most of the existing algorithms devoted to analyzing multispectral images are not applicable in the hyperspectral domain, because of the size and high dimensionality of the images. The application of neural networks to perform unsupervised classification of hyperspectral data has been tested by several authors and also by us in some previous work. We have also focused on analyzing the intrinsic capability of neural networks to parallelize the whole hyperspectral unmixing process. The results shown in this work indicate that neural network models are able to find clusters of closely related hyperspectral signatures, and thus can be used as a powerful tool to achieve the desired classification. The present work discusses the possibility of using a Self Organizing neural network to perform unsupervised classification of hyperspectral images. In sections 3 and 4, the topology of the proposed neural network and the training algorithm are respectively described. Section 5 provides the results we have obtained after applying the proposed methodology to real hyperspectral data, described in section 2. Different parameters in the learning stage have been modified in order to obtain a detailed description of their influence on the final results. Finally, in section 6 we provide the conclusions at which we have arrived.
Martinez, P.↗
NASA Tech Briefs, June 2012
Topics covered include: iGlobe Interactive Visualization and Analysis of Spatial Data; Broad-Bandwidth FPGA-Based Digital Polyphase Spectrometer; Small Aircraft Data Distribution System; Earth Science Datacasting v2.0; Algorithm for Compressing Time-Series Data; Onboard Science and Applications Algorithm for Hyperspectral Data Reduction; Sampling Technique for Robust Odorant Detection Based on MIT RealNose Data; Security Data Warehouse Application; Integrated Laser Characterization, Data Acquisition, and Command and Control Test System; Radiation-Hard SpaceWire/Gigabit Ethernet-Compatible Transponder; Hardware Implementation of Lossless Adaptive Compression of Data From a Hyperspectral Imager; High-Voltage, Low-Power BNC Feedthrough Terminator; SpaceCube Mini; Dichroic Filter for Separating W-Band and Ka-Band; Active Mirror Predictive and Requirement Verification Software (AMP-ReVS); Navigation/Prop Software Suite; Personal Computer Transport Analysis Program; Pressure Ratio to Thermal Environments; Probabilistic Fatigue Damage Program (FATIG); ASCENT Program; JPL Genesis and Rapid Intensification Processes (GRIP) Portal; Data::Downloader; Fault Tolerance Middleware for a Multi-Core System; DspaceOgreTerrain 3D Terrain Visualization Tool; Trick Simulation Environment 07; Geometric Reasoning for Automated Planning; Water Detection Based on Color Variation; Single-Layer, All-Metal Patch Antenna Element with Wide Bandwidth; Scanning Laser Infrared Molecular Spectrometer (SLIMS); Next-Generation Microshutter Arrays for Large-Format Imaging and Spectroscopy; Detection of Carbon Monoxide Using Polymer-Composite Films with a Porphyrin-Functionalized Polypyrrole; Enhanced-Adhesion Multiwalled Carbon Nanotubes on Titanium Substrates for Stray Light Control; Three-Dimensional Porous Particles Composed of Curved, Two-Dimensional, Nano-Sized Layers for Li-Ion Batteries 23 Ultra-Lightweight; and Ultra-Lightweight Nanocomposite Foams and Sandwich Structures for Space Structure Applications.
Source record↗
Mapping Arid Vegetation Species Distributions in the White Mountains, Eastern California, Using AVIRIS, Topography, and Geology
Our challenge is to model plant species distributions in complex montane environments using disparate sources of data, including topography, geology, and hyperspectral data. From an ecologist's point of view, species distributions are determined by local environment and disturbance history, while spectral data are 'ancillary.' However, a remote sensor's perspective says that spectral data provide picture of what vegetation is there, topographic and geologic data are ancillary. In order to bridge the gap, all available data should be used to get the best possible prediction of species distributions using complex multivariate techniques implemented on a GIS. Vegetation reflects local climatic and nutrient conditions, both of which can be modeled, allowing predictive mapping of vegetation distributions. Geologic substrate strongly affects chemical, thermal, and physical properties of soils, while climatic conditions are determined by local topography. As elevation increases, precipitation increases and temperature decreases. Aspect, slope, and surrounding topography determine potential insolation, so that south-facing slopes are warmer and north-facing slopes cooler at a given elevation. Topographic position (ridge, slope, canyon, or meadow) and slope angle affect sediment accumulation and soil depth. These factors combine as complex environmental gradients, and underlie many features of plant distributions. Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) data, digital elevation models, digitized geologic maps, and 378 ground control points were used to predictively map species distributions in the central and southern White Mountains, along the western boundary of the Basin and Range province. Minimum Noise Fraction (MNF) bands were calculated from the visible and near-infrared AVIRIS bands, and combined with digitized geologic maps and topographic variables using Canonical Correspondence Analysis (CCA). CCA allows for modeling species 'envelopes' in multidimensional environmental space, which can then be projected across entire landscapes.
VandeVen, C.↗
Classifying Forest Type in the National Forest Inventory Context with Airborne Hyperspectral and Lidar Data
Forest structure and composition regulate a range of ecosystem services, including biodiversity, water and nutrient cycling, and wood volume for resource extraction. Forest type is an important metric measured in the US Forest Service Forest Inventory and Analysis (FIA) program, the national forest inventory of the USA. Forest type information can be used to quantify carbon and other forest resources within specific domains to support ecological analysis and forest management decisions, such as managing for disease and pests. In this study, we developed a methodology that uses a combination of airborne hyperspectral and lidar data to map FIA-defined forest type between sparsely sampled FIA plot data collected in interior Alaska. To determine the best classification algorithm and remote sensing data for this task, five classification algorithms were tested with six different combinations of raw hyperspectral data, hyperspectral vegetation indices, and lidar-derived canopy and topography metrics. Models were trained using forest type information from 632 FIA subplots collected in interior Alaska. Of the thirty model and input combinations tested, the random forest classification algorithm with hyperspectral vegetation indices and lidar-derived topography and canopy height metrics had the highest accuracy (78% overall accuracy). This study supports random forest as a powerful classifier for natural resource data. It also demonstrates the benefits from combining both structural (lidar) and spectral (imagery) data for forest type classification.
random forest↗
Evaluation of SWIR Crop Residue Bands for the Landsat Next Mission
This research reports the findings of a Landsat Next expert review panel that evaluated the use of narrow shortwave infrared (SWIR) reflectance bands to measure ligno-cellulose absorption features centered near 2100 and 2300 nm, with the objective of measuring and mapping non-photosynthetic vegetation (NPV), crop residue cover, and the adoption of conservation tillage practices within agricultural landscapes. Results could also apply to detection of NPV in pasture, grazing lands, and non-agricultural settings. Currently, there are no satellite data sources that provide narrowband or hyperspectral SWIR imagery at sufficient volume to map NPV at a regional scale. The Landsat Next mission, currently under design and expected to launch in the late 2020’s, provides the opportunity for achieving increased SWIR sampling and spectral resolution with the adoption of new sensor technology. This study employed hyperspectral data collected from 916 agricultural field locations with varying fractional NPV, fractional green vegetation, and surface moisture contents. These spectra were processed to generate narrow bands with centers at 2040, 2100, 2210, 2260, and 2230 nm, at various bandwidths, that were subsequently used to derive 13 NPV spectral indices from each spectrum. For crop residues with minimal green vegetation cover, two-band indices derived from 2210 and 2260 nm bands were top performers for measuring NPV (R^(2) = 0.81, RMSE = 0.13) using bandwidths of 30 to 50 nm, and the addition of a third band at 2100 nm increased resistance to atmospheric correction residuals and improved mission continuity with Landsat 8 Operational Land Imager Band 7. For prediction of NPV over a full range of green vegetation cover, the Cellulose Absorption Index, derived from 2040, 2100, and 2210 nm bands, was top performer (R^(2) = 0.77, RMSE = 0.17), but required a narrow (≤20 nm) bandwidth at 2040 nm to avoid interference from atmospheric carbon dioxide absorption. In comparison, broadband NPV indices utilizing Landsat 8 bands centered at 1610 and 2200 nm performed poorly in measuring fractional NPV (R^(2) = 0.44), with significantly increased interference from green vegetation
Wells Dean Hively↗
Spectral-Spatial Classification of Hyperspectral Images Using Hierarchical Optimization
A new spectral-spatial method for hyperspectral data classification is proposed. For a given hyperspectral image, probabilistic pixelwise classification is first applied. Then, hierarchical step-wise optimization algorithm is performed, by iteratively merging neighboring regions with the smallest Dissimilarity Criterion (DC) and recomputing class labels for new regions. The DC is computed by comparing region mean vectors, class labels and a number of pixels in the two regions under consideration. The algorithm is converged when all the pixels get involved in the region merging procedure. Experimental results are presented on two remote sensing hyperspectral images acquired by the AVIRIS and ROSIS sensors. The proposed approach improves classification accuracies and provides maps with more homogeneous regions, when compared to previously proposed classification techniques.
Tarabalka, Yuliya↗
Analysis Of AVIRIS Data From LEO-15 Using Tafkaa Atmospheric Correction
We previously developed an algorithm named Tafkaa for atmospheric correction of remote sensing ocean color data from aircraft and satellite platforms. The algorithm allows quick atmospheric correction of hyperspectral data using lookup tables generated with a modified version of Ahmad & Fraser s vector radiative transfer code. During the past few years we have extended the capabilities of the code. Current modifications include the ability to account for within scene variation in solar geometry (important for very long scenes) and view geometries (important for wide fields of view). Additionally, versions of Tafkaa have been made for a variety of multi-spectral sensors, including SeaWiFS and MODIS. In this proceeding we present some initial results of atmospheric correction of AVIRIS data from the 2001 July Hyperspectral Coastal Ocean Dynamics Experiment (HyCODE) at LEO-15.
Montes, Marcos J.↗
Unsupervised multimodal fusion of in-process sensor data for advanced manufacturing process monitoring
Effective monitoring of manufacturing processes is crucial for maintaining product quality and operational efficiency. Modern manufacturing environments often generate vast amounts of complementary multimodal data, including visual imagery from various perspectives and resolutions, hyperspectral data, and machine health monitoring information such as actuator positions, accelerometer readings, and temperature measurements. However, fusing and interpreting this complex, high-dimensional data presents significant challenges, particularly when labeled datasets are unavailable or impractical to obtain. This paper presents a novel approach to multimodal sensor data fusion in manufacturing processes, inspired by the Contrastive Language-Image Pre-training (CLIP) model. We leverage contrastive learning techniques to correlate different data modalities without the need for labeled data, overcoming limitations of traditional supervised machine learning methods in manufacturing contexts. Our proposed method demonstrates the ability to handle and learn encoders for five distinct modalities: visual imagery, audio signals, laser position (x and y coordinates), and laser power measurements. By compressing these high-dimensional datasets into low-dimensional representational spaces, our approach facilitates downstream tasks such as process control, anomaly detection, and quality assurance. The unsupervised nature of our method makes it broadly applicable across various manufacturing domains, where large volumes of unlabeled sensor data are common. We evaluate the effectiveness of our approach through a series of experiments, demonstrating its potential to enhance process monitoring capabilities in advanced manufacturing systems. This research contributes to the field of smart manufacturing by providing a flexible, scalable framework for multimodal data fusion that can adapt to diverse manufacturing environments and sensor configurations. The proposed method paves the way for more robust, data-driven decision-making in complex manufacturing processes.
Contrastive Learning↗
Remote Sensing Requirements Development: A Simulation-Based Approach
Earth science research and application requirements for multispectral data have often been driven by currently available remote sensing technology. Few parametric studies exist that specify data required for certain applications. Consequently, data requirements are often defined based on the best data available or on what has worked successfully in the past. Since properties such as spatial resolution, swath width, spectral bands, signal-to-noise ratio (SNR), data quantization and band-to-band registration drive sensor platform and spacecraft system architecture and cost, analysis of these criteria is important to optimize system design objectively. Remote sensing data requirements are also linked to calibration and characterization methods. Parameters such as spatial resolution, radiometric accuracy and geopositional accuracy affect the complexity and cost of calibration methods. However, few studies have quantified the true accuracies required for specific problems. As calibration methods and standards are proposed, it is important that they be tied to well-known data requirements. The Application Research Toolbox (ART) developed at the John C. Stennis Space Center provides a simulation-based method for multispectral data requirements development. The ART produces simulated datasets from hyperspectral data through band synthesis. Parameters such as spectral band shape and width, SNR, data quantization, spatial resolution and band-to-band registration can be varied to create many different simulated data products. Simulated data utility can then be assessed for different applications so that requirements can be better understood.
Zanoni, Vicki↗
Detectability of Martian Evaporites: Terrestrial Analog Studies with MASTER Data
No evaporite mineral deposits have yet been identified on Mars. We present initial results of a terrestrial analog study in Death Valley using airborne hyperspectral data to determine thresholds of detectability for evaporites in current and upcoming Mars datasets.
Moersch, J. E.↗
SANE: strategic autonomous non-smooth exploration for multiple optima discovery in multi-modal and non-differentiable black-box functions
Both computational and experimental material discovery bring forth the challenge of exploring multidimensional and multimodal parameter spaces, such as phase diagrams of Hamiltonians with multiple interactions, composition spaces of combinatorial libraries, material structure image spaces, and molecular embedding spaces. Often these systems are black-boxes and time-consuming to evaluate, which resulted in strong interest towards active learning methods such as Bayesian optimization (BO). However, these systems are often noisy which make the black box function severely multi-modal and non-differentiable, where a vanilla BO can get overly focused near a single or faux optimum, deviating from the broader goal of scientific discovery. To address these limitations, here we developed Strategic Autonomous Non-Smooth Exploration (SANE) to facilitate an intelligent Bayesian optimized navigation with a proposed cost-driven probabilistic acquisition function to find multiple global and local optimal regions, avoiding the tendency to becoming trapped in a single optimum. To distinguish between a true and false optimal region due to noisy experimental measurements, a human (domain) knowledge driven dynamic surrogate gate is integrated with SANE. We implemented the gate-SANE into pre-acquired piezoresponse spectroscopy data of a ferroelectric combinatorial library with high noise levels in specific regions, and piezoresponse force microscopy (PFM) hyperspectral data. SANE demonstrated better performance than classical BO to facilitate the exploration of multiple optimal regions and thereby prioritized learning with higher coverage of scientific values in autonomous experiments. Our work showcases the potential application of this method to real-world experiments, where such combined strategic and human intervening approaches can be critical to unlocking new discoveries in autonomous research.
Biswas, Arpan [University of Tennessee, Knoxville,↗
NASA's Experience with UV Remote Using SBUV and TOMS Instruments
This paper will discuss key features of the NASA algorithm that has been used to produce several highly popular geophysical products from the Solar Backscatter Ultraviolet (SBUV) and Total Ozone Mapping Spectrometer (TOMS) series of instruments. Since these instruments have a limited number of wavelengths, many innovative algorithmic approaches have been developed over the years to derive maximum information from these sensors. We will use Global Ozone Monitoring Experiment (GOME) data to test the assumptions made in these algorithms and show what additional information is contained in the GOME hyperspectral data. At NASA we are using this information to improve the SBUV and TOMS algorithms, as well as to develop more efficient algorithms to process GOME data.
Bhartia, P. K.↗
Surface Biology & Geology Pathfinder Data Analysis Pipeline
NASA's future global orbital mission, currently in development as the Surface Biology and Geology (SBG) Designated Observable study, will acquire relatively high resolution solar-reflected spectroscopy and thermal infrared observations. Innovative processes must be utilized for handling the high volume of data anticipated to be collected, which is anticipated to exceed 100 terabytes/day, greater than NASA's total extant airborne hyperspectral data collection. Collecting, processing/re-processing, disseminating, and exploiting this volume of data presents new challenges. To begin addressing them, NASA is drawing upon the expertise developed from its astrophysics programs to address Earth science and applications. Specifically, NASA is adapting the science processing operations technology developed for the Kepler and TESS planet-hunting missions for imaging spectroscopy data processing. This technology development has been the foundation for the remarkable scientific successes of Kepler and TESS. The Kepler/TESS data processing technology provides a scalable architecture for robust, repeatable, and replicable science and application products while enabling the Earth science community to develop, test, and implement new algorithms. Our effort to leverage this existing capability has begun by ingesting data and applying workflows from the EO-1/Hyperion 17-year mission archive that provides globally sampled visible through shortwave infrared spectra that are representative of SBG data types and volumes. This pathfinding data processing system will help define the solutions to processing SBG data volumes and will enable the scientific community to interact with the data and processing pipeline to create new science products.
Jenkins, Jon↗
Remote Sensing, Uncertainty Quantification, and a Theory of Data Systems; Workshop Report
The purpose of the workshop was to invite statisticians, applied mathematicians, computer scientists, data system architects, experts in remote sensing technology, and Climate and Earth System scientists to review, discuss, and plan research on issues related to large-scale, efficient analysis of distributed data using spatial statistical methods. Our motivation in organizing this event was to catalyze interchange among experts on the fast-emerging problem of analysis of distributed data. As part of SAMSI's 2017-2018 Program on Mathematical and Statistical Methods for Climate and the Earth System, a Working Group on Remote Sensing was established to address statistical and mathematical research problems in the analysis of remote sensing data. The Working Group has five subgroups: 1) Spatial Retrieval Methodology (the so-called \Spatial-X" subgroup); 2) Spatial Analysis for Hyperspectral Data (the so-called \Spatial-Y" subgroup); 3) Emulators for Complex Forward Models; 4) Optimization for Remote Sensing Retrievals; and 5) Theory of Data Systems (ToDS). The ToDS subgroup spent the first half of this academic year formulating a framework in which to consider the joint problem of a) optimizing statistical methods for environments where data are distributed and too large to move to a central location, and b) the design of data system infrastructures within which to implement those statistical methods. To x ideas, the Workshop focused on spatial statistical methods. To date there are many new spatial statistical methods designed with massive data sets in mind, in the literature. However, very few have been implemented for remote sensing data, and none have been implemented in operational settings like those used by NASA and NOAA. A major impediment to their use in these cases is that the data are not only massive, but are stored in different physical locations. These data must be brought together in some way in order to estimate spatial covariance functions, but moving data to a central location for analysis is tedious at best and impossible at worst. Some remote data reduction is almost certainly necessary, but how much? What are the consequences for inference? The fundamental issue underlying these questions is how to navigate the trade-space between costs and uncertainty in the estimates or inferences that are ultimately produced.
Braverman, Amy↗
Validation of Machine Learning Algorithms for Hyperspectral Inversion of Common Water Quality Indicators
The upcoming transition to a diverse suite hyperspectral airborne and orbiting optical sensors will provide an unprecedented opportunity to measure inland water quality characteristics at a fidelity not previously achievable. This presentation will assess prototype deep learning models trained on synthetic hyperspectral data and validated with collocated in-situ measurements. Synthesized data is becoming increasingly popular for use in data-driven approaches to complex problems, and can compliment real data to increase performance on complex and unusual phenomenon, reduce or test bias, and experiment to demonstrate explainability. We will present insights from hyperspectral inversions of Chlorophyl-a, Phycocyanin, and concentration of non-algal particles using selected orbiting and airborne sensors over diverse, optically complex aquatic scenarios. We analyze how various optical water types affect fidelity of results and where improvements can be made as we prototype for globally operational water quality algorithms which can be leveraged by upcoming hyperspectral missions such as the Surface Biology and Geology (SBG) mission.
Surface Biology and Geology (SBG)↗
Earth observational research using multistage EOS-like data
This grant is funded as a part of a program in which both research and educational impact are intended. Research work under this grant is directed at the understanding and use of future hyperspectral data such as that from imaging spectrometers. Specifically, the objectives of the work are (1) to prepare suitable means for analyzing data from sensors which have large numbers of spectral bands, (2) to advance the fundamental understanding of the manner in which soils and vegetative materials reflect high spectral resolution optical wavelength radiation, and (3) to maximize the impact of the results on the educational community. Over the life of the grant, the work has thus involved basic Earth science research and information system technique understanding and development in a mutually supportive way, however, more recently it has become necessary to focus the work primarily on areas (1) and (3). During the last year, the level of effort on this grant has been reduced to half its previous value. We have also been advised that this grant will end with the current year, thus this will be the penultimate semiannual progress summary.
Johannsen, C. J.↗