Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Hyperspectral image analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Advanced Multimission Operations System (ATMO)

The HiiHat toolbox developed for CAT/ENVI provides principal investigators direct, immediate, flexible, and seamless interaction with their instruments and data from any location. Offering segmentation and neutral region division, it facilitates the discovery of key endmembers and regions of interest larger than a single pixel. Crucial to the analysis of hyperspectral data from Mars or Earth is the removal of unwanted atmospheric signatures. For Mars and the Compact Reconnaissance Imaging Spectrometer for Mars (CRISM), residual atmospheric CO2 absorption is both directly problematic and indicative of processing errors with implications to the scientific utility of any particular image region. Estimating this residual error becomes key both in selecting regions of low distortion, and also to select mitigating methods, such as neutral region division. This innovation, the ATMO estimator, provides a simple, 0-1 normalized scalar that estimates this distortion (see figure). The metric is defined as the coefficient of determination of a quadratic fit in the region of distorting atmospheric absorption (approx 2 micron). This mimics the behavior of existing CRISM team mineralogical indices to estimate the presence of known, interesting mineral signatures. This facilitates the ATMO metric's assimilation into existing planetary geology workflows.

Mandrake, Lucas↗

Hyperspectral data analysis procedures with reduced sensitivity to noise

Multispectral sensor systems have become steadily improved over the years in their ability to deliver increased spectral detail. With the advent of hyperspectral sensors, including imaging spectrometers, this technology is in the process of taking a large leap forward, thus providing the possibility of enabling delivery of much more detailed information. However, this direction of development has drawn even more attention to the matter of noise and other deleterious effects in the data, because reducing the fundamental limitations of spectral detail on information collection raises the limitations presented by noise to even greater importance. Much current effort in remote sensing research is thus being devoted to adjusting the data to mitigate the effects of noise and other deleterious effects. A parallel approach to the problem is to look for analysis approaches and procedures which have reduced sensitivity to such effects. We discuss some of the fundamental principles which define analysis algorithm characteristics providing such reduced sensitivity. One such analysis procedure including an example analysis of a data set is described, illustrating this effect.

Landgrebe, David A.↗

Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC): A Payload Designed for Exploration of Terrestrial Planetary Bodies

Geological materials (indeed, all solid objects) are characterized by their crystal structure, elemental composition, and morphology. The Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC) instrument suite quantifies all three. These measurements address fundamental science questions (e.g., the origin and evolution of planetary bodies) and support the human exploration of space (e.g., the characterization of regolith for ISRU and the constraint of its geotechnical properties). METRIC comprises an X-ray Diffraction/X-ray Fluorescence instrument (XRD: mineral structure and XRF: elemental composition), an X-ray micro-Computed Tomography instrument (XCT: 3D internal micromorphology), and a hyperspectral imaging infrared spectrometer (IRS) to provide local/regional mineralogic context for these measurements. METRIC XRD/F draws heritage from the highly successful Mars Science Laboratory CheMin instrument. The METRIC XRD/F employs two separate sample cells, one optimized for XRD and one for XRF, resulting in more rapid XRD analysis (tens of minutes vs. tens of hours for CheMin) and an orders-of-magnitude improvement in XRF detection. XCT has not been deployed in space, so the METRIC XCT represents a new capability for solar system exploration. The XCT uses the same basic high-TRL components as METRIC XRD/F, decreasing its development cost for flight. The METRIC IRS is a derivative of the NASA Earth Science Technology Office funded Hyperspectral Thermal Imager instrument and utilizes the NASA Technology Transfer Program to incorporate a commercial-of-the-shelf infrared camera ruggedized for space by NASA Marshall Space Flight Center. The IRS spectral range (8–14 µm) and resolution (10.8 cm -1 ) are tailored to quantify mineralogy in rocks using their characteristic Reststrahlen bands and to characterize mineralogy of soils using the position of the Christensen Feature. The METRIC payload is currently designed for deployment to the Moon on a Commercial Lunar Payload Services (CLPS) mission, where the XRD/F and XCT would be located on a lander and the IRS would be on deployed on a companion rover to evaluate the mineralogical diversity of the landing site. A pneumatic drill designed by Honeybee Robotics would excavate regolith up to 50 cm below the lander and deliver multiple aliquots of regolith to the XRD/F and XCT. The METRIC payload could also be deployed on a rover. In this case, a sample handling system on a robotic arm could scoop regolith and/or drill rocks and deliver powder to the XRD/F and XCT located in the rover’s interior. Alternatively, METRIC instruments could be used singly or in combination on human space missions. The XRD/F and XCT could be used to characterize samples in a rover or in a science laboratory within a habitat. These data could help astronauts identify resource-enriched rocks and regolith and triage geologic samples to return samples of high interest for analysis in terrestrial laboratories. The IRS could be attached to a human-navigated rover to collect mineralogical data along a traverse and identify high-priority science samples.

E. B. Rampe↗

Calibration of the SNPP and NOAA 20 VIIRS Sensors for Continuity of the MODIS Climate Data Records

Accurate long-term sensor calibration and periodic re-processing to ensure consistency and continuity of atmospheric, land and ocean geophysical retrievals from space within the mission period and across different missions is a major requirement of climate data records. In this work, we applied the Multi-Angle Implementation of Atmospheric Correction (MAIAC)-based vicarious calibration technique over Libya-4 desert site to perform calibration analysis of Visible Infrared Imaging Radiometer Suite (VIIRS) on Suomi National Polar-orbiting Partnership (SNPP) and NOAA-20 satellites. For both VIIRS sensors we characterized residual linear calibration trends and cross-calibrated both sensors to MODerate resolution Imaging Spectroradiometer (MODIS) Aqua regarded as a calibration standard. The relative spectral response (RSR) differences were accounted for using the German Aerospace Center (DLR) Earth Sensing Imaging Spectrometer (DESIS) hyperspectral surface reflectance data. Our results agree with independent vicarious calibration results of both the MODIS/VIIRS Characterization Support Team as well as the CERES Imager and Geostationary Calibration Group within estimated uncertainty of 1–2%. Analysis of MAIAC geophysical products with the new calibration shows a high level of agreement of MAIAC aerosol, surface reflectance and NDVI records between MODIS and VIIRS. Excluding high aerosol optical depth (AOD), all three sensors agree in AOD with mean difference (MD) less than 0.01 and residual mean squared difference rmsd ∼ 0.04. Spectral geometrically normalized surface reflectance agrees within rmsd of 0.003–0.005 in the visible and 0.01–0.012 at longer wavelengths. The residual surface reflectance differences are fully explained by differences in spectral filter functions. Finally, difference in NDVI is characterized by rmsd ∼ 0.02 and MD less than 0.003 for NDVI based on VIIRS imagery bands I1/I2 and less than 0.01 for NDVI based on VIIRS radiometric bands M5/M7. In practical sense, these numbers indicate consistency and continuity in MAIAC records ensuring the smooth transition from MODIS to VIIRS.

MAIAC↗

Longitudinal Single‐Cell Imaging of Engineered Strains with Stimulated Raman Scattering to Characterize Heterogeneity in Fatty Acid Production

Abstract Understanding metabolic heterogeneity is critical for optimizing microbial production of valuable chemicals, but requires tools that can quantify metabolites at the single‐cell level over time. Here, longitudinal hyperspectral stimulated Raman scattering (SRS) chemical imaging is developed to directly visualize free fatty acids in engineered Escherichia coli over many cell cycles. Compositional analysis is also developed to estimate the chain length and unsaturation of the fatty acids in living cells. This method reveals substantial heterogeneity in fatty acid production among and within colonies that emerges over the course of many generations. Interestingly, the strains display distinct types of production heterogeneity in an enzyme‐dependent manner. By pairing time‐lapse and SRS imaging, the relationship between growth and production at the single‐cell level are examined. The results demonstrate that cell‐to‐cell production heterogeneity is pervasive and provides a means to link single‐cell and population‐level production.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Second International Airborne Remote Sensing Conference and Exhibition

The conference provided four days of displays and scientific presentations on applications, technology, a science of sub-orbital data gathering and analysis. The twelve displayed aircraft equipped with sophisticated instrumentation represented a wide range of environmental and reconnaissance missions,including marine pollution control, fire detection, Open Skies Treaty verification, thermal mapping, hydrographical measurements, military research, ecological and agricultural observations, geophysical research, atmospheric and meterological observations, and aerial photography. The U.S. Air Force and the On-Site Inspection Agency displayed the new Open Skies Treaty verification Boeing OC 135B that promotes international monitoring of military forces and activities. SRl's Jetstream uses foliage and ground penetrating SAR for forest inventories, toxic waste delineation, and concealed target and buried unexploded ordnance detection. Earth Search Sciences's Gulfstream 1 with prototype miniaturized airborne hyperspectral imaging equipment specializes in accurate mineral differentiation, low-cost hydrocarbon exploration, and nonproliferation applications. John E. Chance and the U.S. Army Corps of Engineers displayed the Bell 2 helicopter with SHOALS that performs hydrographic surveying of navigation projects, coastal environment assessment, and nautical charting surveys. Bechtel Nevada and U.S. DOE displayed both the Beech King AIR B-200 platform equipped to provide first response to nuclear accidents and routine environmental surveillance, and the MBB BO-105 helicopter used in spectral analysis for environmental assessment and military appraisal. NASA Ames Research Center's high-altitude Lockheed ER-2 assists in earth resources monitoring research in atmospheric chemistry, oceanography, and electronic sensors; ozone and greenhouse studies and satellite calibration and data validation. Ames also showcased the Learjet 24 Airborne Observatory that completed missions in Venus cloud cover analysis, Quadantid meteor shower studies, extra-solar far infrared ionic structure lines measurement, Cape Kennedy launch support, and studies in air pollution, The Products and Services Exhibit showcased new sensor and image processing technologies, aircraft data collection services, unmanned vehicle technology, platform equipment, turn-key services, software a workstations, GPS services, publications, and processing and integration systems by 58 exhibitors. The participation of aircraft users and crews provided unique dialogue between those who plan data collection a operate the remote sensing technology, and those who supply the data processing and integration equipment. Research results using hyperspectral imagery, radar and optical sensors, lidar, digital aerial photography, a integrated systems were presented. Major research and development programs and campaigns we reviewed, including CNR's LARA Project and European Space Agency's 1991-1995 Airborne Campaign. The pre-conference short courses addressed airborne video, photogrammetry, hyperspectral data analysis, digital orthophotography, imagery and GIS integration, IFSAR, GPS, and spectrometer calibration.

Source record↗

CNR LARA project, Italy: Airborne laboratory for environmental research

The increasing interest for the environmental problems and the study of the impact on the environment due to antropic activity produced an enhancement of remote sensing applications. The Italian National Research Council (CNR) established a new laboratory for airborne hyperspectral imaging, the LARA Project (Laboratorio Aero per Ricerche Ambientali - Airborne Laboratory for Environmental Research), equipping its airborne laboratory, a CASA-212, mainly with the Daedalus AA5000 MIVIS (Multispectral Infrared and Visible Imaging Spectrometer) instrument. MIVIS's channels, spectral bandwidths, and locations are chosen to meet the needs of scientific research for advanced applications of remote sensing data. MIVIS can make significant contributions to solving problems in many diverse areas such as geologic exploration, land use studies, mineralogy, agricultural crop studies, energy loss analysis, pollution assessment, volcanology, forest fire management and others. The broad spectral range and the many discrete narrow channels of MIVIS provide a fine quantization of spectral information that permits accurate definition of absorption features from a variety of materials, allowing the extraction of chemical and physical information of our environment. The availability of such a hyperspectral imager, that will operate mainly in the Mediterranean area, at the present represents a unique opportunity for those who are involved in environmental studies and land-management to collect systematically large-scale and high spectral-spatial resolution data of this part of the world. Nevertheless, MIVIS deployments will touch other parts of the world, where a major interest from the international scientific community is present.

Bianchi, R.↗

Selection of Hyperspectral Narrowbands (HNBs) and Composition of Hyperspectral Twoband Vegetation Indices (HVIs) for Biophysical Characterization and Discrimination of Crop Types Using Field Reflectance and Hyperion-EO-1 Data

The overarching goal of this study was to establish optimal hyperspectral vegetation indices (HVIs) and hyperspectral narrowbands (HNBs) that best characterize, classify, model, and map the world's main agricultural crops. The primary objectives were: (1) crop biophysical modeling through HNBs and HVIs, (2) accuracy assessment of crop type discrimination using Wilks' Lambda through a discriminant model, and (3) meta-analysis to select optimal HNBs and HVIs for applications related to agriculture. The study was conducted using two Earth Observing One (EO-1) Hyperion scenes and other surface hyperspectral data for the eight leading worldwide crops (wheat, corn, rice, barley, soybeans, pulses, cotton, and alfalfa) that occupy approx. 70% of all cropland areas globally. This study integrated data collected from multiple study areas in various agroecosystems of Africa, the Middle East, Central Asia, and India. Data were collected for the eight crop types in six distinct growth stages. These included (a) field spectroradiometer measurements (350-2500 nm) sampled at 1-nm discrete bandwidths, and (b) field biophysical variables (e.g., biomass, leaf area index) acquired to correspond with spectroradiometer measurements. The eight crops were described and classified using approx. 20 HNBs. The accuracy of classifying these 8 crops using HNBs was around 95%, which was approx. 25% better than the multi-spectral results possible from Landsat-7's Enhanced Thematic Mapper+ or EO-1's Advanced Land Imager. Further, based on this research and meta-analysis involving over 100 papers, the study established 33 optimal HNBs and an equal number of specific two-band normalized difference HVIs to best model and study specific biophysical and biochemical quantities of major agricultural crops of the world. Redundant bands identified in this study will help overcome the Hughes Phenomenon (or "the curse of high dimensionality") in hyperspectral data for a particular application (e.g., biophysical characterization of crops). The findings of this study will make a significant contribution to future hyperspectral missions such as NASA's HyspIRI. Index Terms-Hyperion, field reflectance, imaging spectroscopy, HyspIRI, biophysical parameters, hyperspectral vegetation indices, hyperspectral narrowbands, broadbands.

Vegetation↗

Randomized Algorithms for Scientific Computing (RASC)

Randomized algorithms have propelled advances in artificial intelligence (AI) and represent a foundational research area in advancing AI for Science. Future advancements in DOE Office of Science priority areas such as climate science, astrophysics, fusion, advanced materials, combustion, and quantum computing all require randomized algorithms for surmounting challenges of complexity, robustness, and scalability. Advances in data collection and numerical simulation have changed the dynamics of scientific research and motivate the need for randomized algorithms. For instance, advances in imaging technologies such as X-ray ptychography, electron microscopy, electron energy loss spectroscopy, or adaptive optics lattice light-sheet microscopy collect hyperspectral imaging and scattering data in terabytes, at breakneck speed enabled by state-of-the-art detectors. The data collection is exceptionally fast compared with its analysis. Likewise, advances in high-performance architectures have made exascale computing a reality and changed the economies of scientific computing in the process. Floating-point operations that create data are essentially free in comparison with data movement. Thus far, most approaches have focused on creating faster hardware. Ironically, this faster hardware has exacerbated the problem by making data still easier to create. Under such an onslaught, scientists often resort to heuristic deterministic sampling schemes (e.g., low-precision arithmetic, sampling every nth element) and sacrifice potentially valuable accuracy. Dramatically better results can be achieved via randomized algorithms, reducing the data size as much as or more than naive deterministic subsampling can achieve, while retaining the high accuracy of computing on the full data set. By randomized algorithms we mean those algorithms that employ some form of randomness in internal algorithmic decisions to accelerate time to solution, increase scalability, or improve reliability. Examples include matrix sketching for solving large-scale least-squares problems (see Figure 1) and stochastic gradient descent for training machine learning models. We are not recommending heuristic methods but rather randomized algorithms that have certificates of correctness and probabilistic guarantees of optimality and near-optimality. Such approaches can be useful beyond acceleration, for example, in understanding how to avoid measure zero worst-case scenarios that plague methods such as QR matrix factorization.

97 MATHEMATICS AND COMPUTING↗

NASA Tech Briefs, June 2012

Topics covered include: iGlobe Interactive Visualization and Analysis of Spatial Data; Broad-Bandwidth FPGA-Based Digital Polyphase Spectrometer; Small Aircraft Data Distribution System; Earth Science Datacasting v2.0; Algorithm for Compressing Time-Series Data; Onboard Science and Applications Algorithm for Hyperspectral Data Reduction; Sampling Technique for Robust Odorant Detection Based on MIT RealNose Data; Security Data Warehouse Application; Integrated Laser Characterization, Data Acquisition, and Command and Control Test System; Radiation-Hard SpaceWire/Gigabit Ethernet-Compatible Transponder; Hardware Implementation of Lossless Adaptive Compression of Data From a Hyperspectral Imager; High-Voltage, Low-Power BNC Feedthrough Terminator; SpaceCube Mini; Dichroic Filter for Separating W-Band and Ka-Band; Active Mirror Predictive and Requirement Verification Software (AMP-ReVS); Navigation/Prop Software Suite; Personal Computer Transport Analysis Program; Pressure Ratio to Thermal Environments; Probabilistic Fatigue Damage Program (FATIG); ASCENT Program; JPL Genesis and Rapid Intensification Processes (GRIP) Portal; Data::Downloader; Fault Tolerance Middleware for a Multi-Core System; DspaceOgreTerrain 3D Terrain Visualization Tool; Trick Simulation Environment 07; Geometric Reasoning for Automated Planning; Water Detection Based on Color Variation; Single-Layer, All-Metal Patch Antenna Element with Wide Bandwidth; Scanning Laser Infrared Molecular Spectrometer (SLIMS); Next-Generation Microshutter Arrays for Large-Format Imaging and Spectroscopy; Detection of Carbon Monoxide Using Polymer-Composite Films with a Porphyrin-Functionalized Polypyrrole; Enhanced-Adhesion Multiwalled Carbon Nanotubes on Titanium Substrates for Stray Light Control; Three-Dimensional Porous Particles Composed of Curved, Two-Dimensional, Nano-Sized Layers for Li-Ion Batteries 23 Ultra-Lightweight; and Ultra-Lightweight Nanocomposite Foams and Sandwich Structures for Space Structure Applications.

Source record↗

Inversion of multiangular polarimetric measurements from the ACEPOL campaign: an application of improving aerosol property and hyperspectral ocean color retrievals

NASA's Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission, scheduled for launch in the time frame of late 2022 to early 2023, will carry the Ocean Color Instrument (OCI), a hyperspectral scanning radiometer, and two multiangle polarimeters (MAPs), the UMBC Hyper-Angular Rainbow Polarimeter 2 (HARP2) and the SRON Spectro-Polarimeter for Planetary EXploration one (SPEXone). One purpose of the PACE MAPs is to better characterize aerosol properties, which can then be used to improve atmospheric correction for the retrieval of ocean color in coastal waters. Though this is theoretically promising, the use of MAP data in the atmospheric correction of colocated hyperspectral ocean color measurements have not yet been well demonstrated. In this work, we performed aerosol retrievals using the MAP measurements from the Research Scanning Polarimeter (RSP) and demonstrate its application to the atmospheric correction of hyperspectral radiometric measurements from SPEX airborne. Both measurements were collected on the same aircraft from the Aerosol Characterization from Polarimeter and Lidar (ACEPOL) field campaign in 2017. Two cases over ocean with small aerosol loading (aerosol optical depth ∼0.04) are identified including colocated RSP and SPEX airborne measurements and Aerosol Robotic Network (AERONET) ground-based observations. The aerosol retrievals are performed and compared with two options: one uses reflectance measurement only and the other uses both reflectance and polarization. It is demonstrated that polarization information helps reduce the uncertainties of aerosol microphysical and optical properties. The retrieved aerosol properties are then used to compute the contribution of atmosphere and ocean surface for atmospheric correction over the discrete bands from RSP measurements and the hyperspectral SPEX airborne measurements. The water-leaving signals determined this way are compared with both AERONET and Moderate Resolution Imaging Spectroradiometer (MODIS) ocean color products for performance analysis. The results and lessons learned from this work will provide a basis to fully exploit the information from the unique combination of sensors on PACE for aerosol characterization and ocean ecosystem research.

Meng Gao↗

Analysis of AOTF Hyperspectral Imagery

This paper reports results from an analysis of polarimetric hyperspectral imagery collected using a prototype acousto-optic tunable filter (AOTF) instrument in an outdoor environment. Spectra, derivative spectra, and polarization spectra in the image cube form were studied. The issue concerns spectral and polarization signatures of vegetation, contributions due to aerosol, and man-made object detection. The result illustrates potentials of the technology for a variety of remote sensing applications.

acousto-optic↗

Carrier gradients and the role of charge selective contacts in lateral heterojunction all back contact perovskite solar cells

Realizing photovoltaic devices that achieve the full potential of the metal halide perovskite material will require improved insight regarding the role of selective contacts and how key interfaces operate when mobile defects are present. However, measuring interface properties in typical device stacks where the perovskite layer is thin and sandwiched between two contacts has been a challenge. Here, we fabricate p-i-n and p-n lateral heterojunctions with nickel oxide/titanium oxide all back contacts, permitting us to employ a comprehensive analysis approach, including ultraviolet and X-ray photoemission spectroscopy (UPS/XPS), angle-resolved X-ray absorption spectroscopy (XAS), Kelvin probe force microscopy (KPFM), surface photovoltage (SPV), hyperspectral imaging (HSI), and time-resolved fluorescence lifetime imaging microscopy (TR-FLIM) to discern the role of selective contacts. Specifically, we tune the selectivity of the contacts, changing the gradient in the carrier concentration across the surface of the active layer, which is connected to carrier extraction at the buried interface, and thus the device functionality.

25 ENERGY STORAGE↗

Hyperspectral Detection of the Fluorescence Shift between Chirality-Sorted Empty and Water-Filled Single-Wall Carbon Nanotube Enantiomers

Single-wall carbon nanotubes (SWCNTs) have extraordinary electronic and optical properties that depend strongly on their exact chiral structure and their interaction with their inner and outer environment. The fluorescence (PL) of semiconducting SWCNTs, for instance, will shift depending on the molecules with which the SWCNT’s hollow core is filled. These interaction-induced shifts are challenging to resolve on the ensemble level in samples containing a mixture of different filling contents due to the relatively large inhomogeneous line width of the ensemble SWCNT PL compared to the size of these shifts. To circumvent this inhomogeneous broadening, single-tube spectroscopy and hyperspectral imaging are often applied, which until now required time-consuming statistical studies. Here, we present hyperspectral PL microscopy combined with automated SWCNT segmenting based on either principal component analysis or a convolutional neural network, capable of both spatially and spectrally resolving the PL along the length of many individual SWCNTs at the same time and automatically fitting peak positions and line widths of individual SWCNTs. The methodology is demonstrated by accurately determining the emission shifts and line widths of thousands of left- and right-handed empty and water-filled SWCNTs coated with a chiral surfactant, resulting in four statistical distributions which cannot be resolved in ensemble spectroscopy of unsorted samples. The results demonstrate a robust method to quickly probe ensemble properties with single-enantiomer spectral resolution. Moreover, it promises to be an absolute quantitative method to characterize the relative abundances of SWCNTs with different handedness or filling content in macroscopic samples, simply by counting individual species.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Onboard Classifiers for Science Event Detection on a Remote Sensing Spacecraft

Typically, data collected by a spacecraft is downlinked to Earth and pre-processed before any analysis is performed. We have developed classifiers that can be used onboard a spacecraft to identify high priority data for downlink to Earth, providing a method for maximizing the use of a potentially bandwidth limited downlink channel. Onboard analysis can also enable rapid reaction to dynamic events, such as flooding, volcanic eruptions or sea ice break-up. Four classifiers were developed to identify cryosphere events using hyperspectral images. These classifiers include a manually constructed classifier, a Support Vector Machine (SVM), a Decision Tree and a classifier derived by searching over combinations of thresholded band ratios. Each of the classifiers was designed to run in the computationally constrained operating environment of the spacecraft. A set of scenes was hand-labeled to provide training and testing data. Performance results on the test data indicate that the SVM and manual classifiers outperformed the Decision Tree and band-ratio classifiers with the SVM yielding slightly better classifications than the manual classifier.

classification↗

A Multi-Sensor Unoccupied Aerial System Improves Characterization of Vegetation Composition and Canopy Properties in the Arctic Tundra

Changes in vegetation distribution, structure, and function can modify the canopy properties of terrestrial ecosystems, with potential consequences for regional and global climate feedbacks. In the Arctic, climate is warming twice as fast as compared to the global average (known as ‘Arctic amplification’), likely having stronger impacts on arctic tundra vegetation. In order to quantify these changes and assess their impacts on ecosystem structure and function, methods are needed to accurately characterize the canopy properties of tundra vegetation types. However, commonly used ground-based measurements are limited in spatial and temporal coverage, and differentiating low-lying tundra plant species is challenging with coarse-resolution satellite remote sensing. The collection and processing of multi-sensor data from unoccupied aerial systems (UASs) has the potential to fill the gap between ground-based and satellite observations. To address the critical need for such data in the Arctic, we developed a cost-effective multi-sensor UAS (the ‘Osprey’) using off-the-shelf instrumentation. The Osprey simultaneously produces high-resolution optical, thermal, and structural images, as well as collecting point-based hyperspectral measurements, over vegetation canopies. In this paper, we describe the setup and deployment of the Osprey system in the Arctic to a tundra study site located in the Seward Peninsula, Alaska. We present a case study demonstrating the processing and application of Osprey data products for characterizing the key biophysical properties of tundra vegetation canopies. In this study, plant functional types (PFTs) representative of arctic tundra ecosystems were mapped with an overall accuracy of 87.4%. The Osprey image products identified significant differences in canopy-scale greenness, canopy height, and surface temperature among PFTs, with deciduous low to tall shrubs having the lowest canopy temperatures while non-vascular lichens had the warmest. The analysis of our hyperspectral data showed that variation in the fractional cover of deciduous low to tall shrubs was effectively characterized by Osprey reflectance measurements across the range of visible to near-infrared wavelengths. Therefore, the development and deployment of the Osprey UAS, as a state-of-the-art methodology, has the potential to be widely used for characterizing tundra vegetation composition and canopy properties to improve our understanding of ecosystem dynamics in the Arctic, and to address scale issues between ground-based and airborne/satellite observations.

54 ENVIRONMENTAL SCIENCES↗

Batch Active Learning for Multispectral and Hyperspectral Image Segmentation Using Similarity Graphs

Abstract Graph learning, when used as a semi-supervised learning (SSL) method, performs well for classification tasks with a low label rate. We provide a graph-based batch active learning pipeline for pixel/patch neighborhood multi- or hyperspectral image segmentation. Our batch active learning approach selects a collection of unlabeled pixels that satisfy a graph local maximum constraint for the active learning acquisition function that determines the relative importance of each pixel to the classification. This work builds on recent advances in the design of novel active learning acquisition functions (e.g., the Model Change approach in arXiv:2110.07739) while adding important further developments including patch-neighborhood image analysis and batch active learning methods to further increase the accuracy and greatly increase the computational efficiency of these methods. In addition to improvements in the accuracy, our approach can greatly reduce the number of labeled pixels needed to achieve the same level of the accuracy based on randomly selected labeled pixels.

97 MATHEMATICS AND COMPUTING↗

Hyperspectral segmentation of plants in fabricated ecosystems

Hyperspectral imaging provides a powerful tool for analyzing above-ground plant characteristics in fabricated ecosystems, offering rich spectral information across diverse wavelengths. This study presents an efficient workflow for hyperspectral data segmentation and subsequent data analytics, minimizing the need for user annotation through the use of ensembles of sparse mixed scale convolution neural networks. The segmentation process leverages the diversity of ensembles to achieve high accuracy with minimal labeled data, reducing labor-intensive annotation efforts. To further enhance robustness, we incorporate image alignment techniques to address spatial variability in the dataset. Downstream analysis focuses on using the segmented data for processing spectral data, enabling monitoring of plant health. This approach provides a scalable solution for spectral segmentation, and facilitates actionable insights into plant conditions in complex, controlled environments. Our results demonstrate the utility of combining advanced machine learning techniques with hyperspectral analytics for high-throughput plant monitoring.

Zwart, Petrus H.↗