Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “remote training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Hyperspectral remote sensing-based plant community map for region around NGEE-Arctic intensive research watersheds at Seward Peninsula, Alaska, 2017-2019

Using airborne hyperspectral remote sensing data from NASA Airborne Visible-Infrared Imaging Spectrometer- Next Generation (AVIRIS-NG) platforms in a region near NGEE-Arctic intensive watersheds at Seward peninsula of Alaska, high resolution (5m) maps of plant community distribution were developed and included in this data collected. AVIRIS-NG data collected over 2017-2019 period were used to develop deep neural networks, trained using vegetation plot observations collected at NGEE-Arctic watersheds at Kougarok, Council and Teller. A hierarchical vegetation classification scheme consisting of six classes at Level I, and 16 classes at Level II contained in two .txt files were used to developed the plant community maps for the region. Two geospatial raster data files (.tif) at both thematic levels are shared in this data collection. Data files in this collection use Alaska Albers Equal Area projection. Readme files available in three formats (*.html, *.md, *.pdf) and one *.png visualization map.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Low-Power Deep Learning Inference using the SpiNNaker Neuromorphic Platform

n this presentation we will discuss recent results on using the SpiNNaker neuromorphic platform (48-chip model) for deep learning neural network inference. We use the Sandia Labs developed Whet stone spiking deep learning library to train deep multi-layer perceptrons and convolutional neural networks suitable for the spiking substrate on the neural hardware architecture. By using the massively parallel nature of SpiNNaker, we are able to achieve, under certain network topologies, substantial network tiling and consequentially impressive inference throughput. Such high-throughput systems may have eventual application in remote sensing applications where large images need to be chipped, scanned, and processed quickly. Additionally, we explore complex topologies that push the limits of the SpiNNaker routing hardware and investigate how that impacts mapping software-implemented networks to on-hardware instantiations.

97 MATHEMATICS AND COMPUTING↗

Adaptive Bayes classifiers for remotely sensed data

An algorithm is developed for a learning, adaptive, statistical pattern classifier for remotely sensed data. The estimation procedure consists of two steps: (1) an optimal stochastic approximation of the parameters of interest, and (2) a projection of the parameters in time and space. The results reported are for Gaussian data in which the mean vector of each class may vary with time or position after the classifier is trained.

Raulston, H. S.↗

Effects of Traveling Magnetic Field on Dynamics of Solidification

TMF is based on imposing a controlled phase-shift in a train of electromagnets, forming a stack. Thus, the induced magnetic field can be considered to be travelling along the axis of the stack. The coupling of this traveling wave with an electrically conducting fluid results in a basic flow in a form of a single axisymmetric roll. The magnitude and direction of this flow can be remotely controlled. Furthermore, it is possible to localize the effect of this force field though activating only a number of the magnets. This force field generated in the fluid can, in principle, be used to control and modify convection in the molten material. For example, it can be used to enhance convective mixing in the melt, and thereby modify the interface shape, and macrosegregation. Alternatively, it can be used to counteract thermal and/or solutal buoyancy forces. High frequency TMF can be used in containerless processing techniques, such as float zoning, to affect the very edge of the fluid so that Marangoni flow can be counter balanced. The proposed program consists of basic fundamentals and applications. Our goal in conducting the following experiments and analyses is to establish the validity of TMF as a new tool for solidification processes. Due to its low power consumption and simplicity of design, this tool may find wide spread use in a variety of space experiments. The proposed ground based experiments are intended to establish the advantages and limitations of employing this technique. In the fundamentals component of the proposed program, we will use theoretical tools and experiments with mercury to establish the fundamental aspects of TMF-induced convection through a detailed comparison of theoretical predictions and experimental measurements of flow field. In this work, we will conduct a detailed parametric study involving the effects of magnetic field strength, frequency, wave vector, and the fluid geometry. The applications component of this work will be focused on investigating the effect of TMF on the following solidification and pre-directional solidification processes: (1) Bridgman growth of Ga:Ge with the goal of counteracting the buoyancy-driven convection; (2) Mixing of Pb-Ga and Pb-Sn alloys with the aim of initiating and maintaining a uniform melt prior to solidification processing; and (3) Float Zone growth with the aim of identifying, through simulations and model experiments, conditions needed to counteract Marangoni flow in a microgravity environment. The proposed research has strong relevance to microgravity research and the objectives of the NRA. TMF can provide a unique and accurate mechanism for generation and control of desirable flow patterns for microgravity research. These attributes have significant relevance to 1) Alloy mixing prior to solidification in a microgravity environment. TMF can provide this mixing with a low level of power consumption; (2) TMF can offset the deleterious effects of Marangoni convection in microgravity containerless processing. Thus, TMF can be instrumental in further understanding this phenomena; (3) Generation of controlled flows will allow the investigation of the effect of these flows on growth morphology and growth kinetics; and (4) On Earth, TMF has the potential to significantly counter-balance thermosolutal convection, thereby creating conditions similar to those obtained in microgravity. Once demonstrated, this new tool for use in solidification has the strong potential to find applications in a host of microgravity material research projects.

Mazuruk, Konstantin↗

Leveraging 3D CAD and Virtual Reality in Design of the Calcine Disposition Project - 20512

Fluor Idaho's Calcine Disposition Project (CDP) is leveraging the power of three-dimensional (3D) visualization, light detection and ranging (Lidar), and virtual reality to improve designs and worker safety. With the use of computer-aided design (CAD) modeling software, the CDP has created 3D models of the facility and systems to aid in the design, development, and operation of its retrieval and transfer system. This by itself is nothing new and has been done in industry for years. The CDP project however is taking this a few steps farther with the use of Lidar and virtual reality software. The CRP is tasked with removing a radioactive granular material from stainless steel bins located in concrete vaults that were constructed in the late 1950's and early 1960's. While construction drawings are available, it is not certain that the drawings are as-built or how accurate they truly are. Part of the project requires precise placement of equipment on to bins around multiple pipe, electrical lines, and bin stiffeners. Relying solely on the existing drawings and models created from these drawings is highly risky and prone to failure. The first step to determine the precise location and orientation of all obstructions in the vault the project will use a Lidar system to scan the vault structure and precisely locate all vault and bin components. Once this information is obtained, the data will be integrated into the CAD model. The model will then be verified, and a true as-built model developed. Precise component location, size, and orientation will be used for final design and placement of retrieval components. The second step will be to take the verified 3D model and scan data and import it into virtual reality software creating a virtual world. While some work on the project requires all work to be completed remotely due to high radiation fields, some areas have low enough radiation levels that personnel can enter and perform work. With the use of a virtual reality headset, operators and technicians will be able to enter our virtual world and become familiar with the surroundings and perform work prior to ever entering the radiation environment. This training is expected to pay dividends by improving worker efficiency, reducing errors, and improving confidence that the work can be performed as expected. It will play a key aspect in as low as reasonably achievable (ALARA) principles. An additional aspect in using the Lidar scans and virtual environment, is that it will give engineers and managers an opportunity to revisit the facility, especially radiation areas, at any time to obtain design information and measurements that may be costly or impossible to obtain once the facility transitions into radiation operations. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Satellite Servicer System flight demonstration program

The major hardware elements, demonstration objectives, and technical approaches, as well as existing and developing technologies for applicability to the Satellite Servicer System (SSSFD) program are presented. In a project to develop the capability of servicing satellites in remote locations, NASA and SDI have planned a series of flights to demonstrate autonomous rendezvous and docking, supervised autonomous fluid transfer, and supervised autonomous orbital replacement unit exchange. Program objectives, design reference mission, and flight demonstrations are described. The expanded capability demonstrated by the SSSFD program will provide alternatives to excessive dependence on ground operations personnel and training, increase the reach into unique space environments, and decrease the costs of managing and operating space assets.

Moore, James S.↗

Knowledge-informed deep learning for hydrological model calibration: an application to Coal Creek Watershed in Colorado

Abstract. Deep learning (DL)-assisted inverse mapping has shown promise in hydrological model calibration by directly estimating parameters from observations. However, the increasing computational demand for running the state-of-the-art hydrological model limits sufficient ensemble runs for its calibration. In this work, we present a novel knowledge-informed deep learning method that can efficiently conduct the calibration using a few hundred realizations. The method involves two steps. First, we determine decisive model parameters from a complete parameter set based on the mutual information (MI) between model responses and each parameter computed by a limited number of realizations (∼50). Second, we perform more ensemble runs (e.g., several hundred) to generate the training sets for the inverse mapping, which selects informative model responses for estimating each parameter using MI-based parameter sensitivity. We applied this new DL-based method to calibrate a process-based integrated hydrological model, the Advanced Terrestrial Simulator (ATS), at Coal Creek Watershed, CO. The calibration is performed against observed stream discharge (Q) and remotely sensed evapotranspiration (ET) from the water year 2017 to 2019. Preliminary MI analysis on 50 realizations resulted in a down-selection of 7 out of 14 ATS model parameters. Then, we performed a complete MI analysis on 396 realizations and constructed the inverse mapping from informative responses to each of the selected parameters using a deep neural network. Compared with calibration using observations covering all time steps, the new inverse mapping improves parameter estimations, thus enhancing the performance of ATS forward model runs. The Nash–Sutcliffe efficiency (NSE) of streamflow predictions increases from 0.53 to 0.8 when calibrating against Q alone. Using ET observations, on the other hand, does not show much improvement on the performance of ATS modeling mainly due to both the uncertainty of the remotely sensed product and the insufficient coverage of the model ET ensemble in capturing the observation. By using observed Q only, we further performed a multiyear analysis and show that Q is best simulated (NSE > 0.8) by including in the calibration the dry-year flow dynamics that show more sensitivity to subsurface characteristics than the other wet years. Moreover, when continuing the forward runs till the end of 2021, the calibrated models show similar simulation performances during this evaluation period as the calibration period, demonstrating the ability of the estimated parameters in capturing climate sensitivity. Our success highlights the importance of leveraging data-driven knowledge in DL-assisted hydrological model calibration.

54 ENVIRONMENTAL SCIENCES↗

Remote Sensing-Driven Hydrodynamic Modeling in Data-Scarce Regions: Integrating ICESat-2, Sentinel-2, SWOT and Re-analysis Models for Coastal Monitoring

Hydrodynamic models in coastal and estuarine systems are typically constrained by sparse bathymetry, boundary, and validation data, especially in regions where field campaigns are costly or impractical. Here we develop and test a fully satellite-driven framework for hydrodynamic modeling in South Africa’s Langebaan Lagoon without using any local in situ measurements. Bathymetry is derived by training multispectral Sentinel-2 reflectance against ICESat-2 ATL24 photon-derived depths using an XGBoost model optimized with Bayesian search. The final satellite-derived bathymetry reproduces independent ATL24 points with RMSE = 0.45 m and R 2 = 0.97. This bathymetry was used in a depth-averaged Delft3D Flexible Mesh model driven at the open boundary by TPXO tidal harmonics and by ERA5 winds. We validate modeled water surface elevation against 16 SWOT low-rate (250 m, unsmoothed) passes in 2023. SWOT–model comparisons yield an overall RMSE of 0.11 m and R 2 = 0.61, with typical point differences <0.10 m (∼7% of the 1.5 m tidal range), and showed consistent spatial gradients in water level from the offshore boundary, through Saldanha Bay, and into the lagoon. At the offshore boundary, TPXO and SWOT sea surface heights agree closely (R 2 = 0.86). A simple phase adjustment of ∼26,min between TPXO and SWOT lowers the RMSE from 0.18,m to 0.11,m, showing that phase offset accounts for some of the discrepancy, with additional errors likely linked to non-tidal signals. Our results demonstrate that combining passive optical, photon-counting LiDAR, radar interferometry, and global tidal/atmospheric models enables robust, transferrable hydrodynamic modeling in data-scarce coastal systems, offering a cost-effective pathway for monitoring.

ICESat-2↗

A Machine Learning-Based Cloud Detection and Thermodynamic Phase Classification Algorithm using Passive Spectral Observations

We trained two Random Forest (RF) machine-learning models for cloud mask and cloud thermodynamic phase detection using spectral observations from VIIRS on Suomi NPP (SNPP). Observations from CALIOP were carefully selected to provide reference labels. The two RF models were trained for all-day and daytime-only conditions using a 4-year collocated VIIRS/CALIOP dataset from 2013 to 2016. Due to the orbit difference, the collocated CALIOP and SNPP VIIRS training samples cover a broad viewing zenith angle range, which is a great benefit to overall model performance. The all-day model uses 3 VIIRS infrared (IR) bands (8.6,11, and 12 μm) and the daytime model uses 5 Near-IR (NIR) and Shortwave-IR (SWIR) bands (0.86, 1.24, 1.38, 1.64 and 2.25 μm) together with the 3 IR bands to detect clear, liquid water, and ice cloud pixels. Up to 7 surface types, namely, ocean/water, forest, cropland, grassland, snow/ice, barren/desert, and shrubland, were considered separately to enhance performance for both models. Detection of cloudy pixels and thermodynamic phase with the two RF models were compared against collocated CALIOP products from 2017. It is shown that, with a conservative screening process that excludes the most challenging cloudy pixels for passive remote sensing, the two RF models have high accuracy rates in comparison with the CALIOP reference for both cloud detection and thermodynamic phase. Other existing SNPP VIIRS and Aqua MODIS cloud mask and phase products are also evaluated, with results showing that the two RF models and the MODIS MYD06 optical property phase product are the top 3 algorithms with respect to lidar observations during the daytime. During the nighttime, the RF all-day model works best for both cloud detection and phase, in particular for pixels over snow/ice surfaces. The present RF models can be extended to other similar passive instruments if training samples can be collected from CALIOP or other lidars. However, the quality of reference labels and potential sampling issues that may impact model performance would need further attention.

cloud detection↗

MULTI-MODAL global surveillance methodology for predictive and on-demand characterization of localized processes using cube satellite platforms and deep learning techniques

This paper presents the work completed towards the development of a multi-modal global surveillance methodology using cube satellite (CubeSat) platforms and novel data analysis techniques. A CubeSat system equipped with adequate sensors and data analytics capabilities can autonomously characterize various phenomena of interest on the Earth’s surface. CubeSats are advantageous over conventional satellites in certain remote monitoring applications because of their reduced construction costs (due to the availability of commercially-off-the-shelf components) and are easier to launch. The CubeSat surveillance system developed in this paper focused on phenomena of interest surrounding the nuclear fuel cycle in support of nuclear non-proliferation and emergency response. To observe the phenomena, a constellation of 3U and 6U CubeSats deployed from the ISS with adequate components was chosen. Four different sensor configurations were identified for remote sensing: panchromatic/multispectral in the visible and near-infrared spectrum, multispectral in infrared spectrum, hyperspectral in infrared spectrum, and multispectral in ultraviolet spectrum. While a panchromatic/multispectral sensor configuration has CubeSat flight heritage at the required spatial resolutions, the other three sensor types need future 3 development to meet signature and system requirements. Once each sensor onboard the CubeSat system collects data on a target of interest, the onboard computers would then apply the deep learning-based characterization methodology developed in this paper to identify phenomena. Four surrogate datasets containing representative simplified “images” were created for each sensor type to train the characterization methodology. A convolutional neural network was applied to each dataset and produced recall rates for the phenomena between 89.7% - 99.3% and precision rates between 92.3% - 99.9%. Each phenomenon’s presence probability from each network is then combined into a final characterization solution for a target area. This paper covers multiple interdisciplinary areas to develop the foundation for a CubeSat surveillance system focused on phenomena surrounding the nuclear fuel cycle.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Machine learning-guided design of direct methanol fuel cells with a platinum group metal-free cathode

Direct methanol fuel cells (DMFCs) offer a promising solution for clean electricity generation, particularly in small electronics and remote auxiliary power units. However, optimizing their efficiency and performance is challenging due to the complex interactions between various factors. Here, we present a novel approach that integrates experiments with machine learning to model and predict the performance of these fuel cells using atomically dispersed platinum group metal (PGM)-free catalysts at the cathode. Further, our machine learning models, trained on diverse input parameters, allow for the comprehensive optimization of DMFC performance prior to fabrication and testing. Through extensive experimental validation, we demonstrate that this data-driven approach accurately predicts key performance metrics, such as maximum power output and polarization curves. By combining our models with interpretable game-theory methods, we provide deep insights into the factors governing fuel cell performance, ultimately paving the way for the design of scalable and efficient DMFC technologies.

25 ENERGY STORAGE↗

Constellations: A New Paradigm for Earth Observations

The last decade has seen a significant increase in the number and the capabilities of remote sensing satellites launched by the international community. A relatively new approach has been the launching of satellites into heterogeneous constellations. Constellations provide the scientists a capability to acquire science data, not only from specific instruments on a single satellite, but also from instruments on other satellites that fly in the same orbit. Initial results from the A-Train (especially following the CALIPSO/CloudSat launch) attest to the tremendous scientific value of constellation flying. This paper provides a history of the constellations (particularly the A-Train) and how the A-Train mission design was driven by science requirements. The A-Train has presented operational challenges which had not previously been encountered. Operations planning had to address not only how the satellites of each constellation operate safely together, but also how the two constellations fly in the same orbits without interfering with each other when commands are uplinked or data are downlinked to their respective ground stations. This paper discusses the benefits of joining an on-orbit constellation. When compared to a single, large satellite, a constellation infrastructure offers more than just the opportunities for coincidental science observations. For example, constellations reduce risks by distributing observing instruments among numerous satellites; in contrast, a failed launch or a system failure in a single satellite would lead to loss of all observations. Constellations allow for more focused, less complex satellites. Constellations distribute the development, testing, and operations costs among various agencies and organizations for example, the Morning and Afternoon Constellations involve several agencies within the U.S. and in other countries. Lastly, this paper addresses the need to plan for the long-term evolution of a constellation. Agencies need to have a replenishment strategy as some satellites age and eventually leave the constellation. This will ensure overlap of observations, thus providing continuous, calibrated science data over a much longer time period. Thoughts on the evolution of the A-Train will also be presented.

Kelly, Angelita C.↗

H31G-1596: DeepSAT's CloudCNN: A Deep Neural Network for Rapid Cloud Detection from Geostationary Satellites

Cloud and cloud shadow detection has important applications in weather and climate studies. It is even more crucial when we introduce geostationary satellites into the field of terrestrial remote sensing. With the challenges associated with data acquired in very high frequency (10-15 mins per scan), the ability to derive an accurate cloud shadow mask from geostationary satellite data is critical. The key to the success for most of the existing algorithms depends on spatially and temporally varying thresholds,which better capture local atmospheric and surface effects.However, the selection of proper threshold is difficult and may lead to erroneous results. In this work, we propose a deep neural network based approach called CloudCNN to classify cloudshadow from Himawari-8 AHI and GOES-16 ABI multispectral data. DeepSAT's CloudCNN consists of an encoderdecoder based architecture for binary-class pixel wise segmentation. We train CloudCNN on multi-GPU Nvidia Devbox cluster, and deploy the prediction pipeline on NASA Earth Exchange (NEX) Pleiades supercomputer. We achieved an overall accuracy of 93.29% on test samples. Since, the predictions take only a few seconds to segment a full multispectral GOES-16 or Himawari-8 Full Disk image, the developed framework can be used for real-time cloud detection, cyclone detection, or extreme weather event predictions.

GOES-1↗

Remote operation of an orbital maneuvering vehicle in simulated docking maneuvers

Simulated docking maneuvers were performed to assess the effect of initial velocity on docking failure rate, mission duration, and delta v (fuel consumption). Subjects performed simulated docking maneuvers of an orbital maneuvering vehicle (OMV) to a space station. The effect of the removal of the range and rate displays (simulating a ranging instrumentation failure) was also examined. Naive subjects were capable of achieving a high success rate in performing simulated docking maneuvers without extensive training. Failure rate was a function of individual differences; there was no treatment effect on failure rate. The amount of time subjects reserved for final approach increased with starting velocity. Piloting of docking maneuvers was not significantly affected in any way by the removal of range and rate displays. Radial impulse was significant both by subject and by treatment. NASA's 0.1 percent rule, dictating an approach rate no greater than 0.1 percent of the range, is seen to be overly conservative for nominal docking missions.

Brody, Adam R.↗

Quantifying neptunium oxidation states in nitric acid through spectroelectrochemistry and chemometrics

Controlled-potential in situ thin-layer spectropotentiometry was leveraged to generate visible/near-infrared (VIS/NIR) absorption spectral data sets for the development of chemometric models to quantify Np(III/IV/V/VI) oxidation states in HNO 3 . This technology would be valuable in laboratory studies and when monitoring process solutions to guide feed adjustments for radiochemical separations—the performance of which depends on oxidation state. This approach successfully isolated and stabilized Np species in pure (~99%) oxidation states without compromising solution optical properties. Multivariate curve resolution–alternating least squares models were evaluated to resolve spectral and component concentrations from a scan that sequentially produced Np(VI), Np(V), Np(IV), and Np(III) spectra with mixtures of two valences at a time. Although it provided a useful approximation, the method was not able to quantitively resolve each component likely because of rotational ambiguity. Additionally, partial least squares regression models were built from artificial and electrochemically generated VIS/NIR spectral training sets to study the effect of interionic interactions on spectral characteristics. Models built with true Bi-chemical mixtures of coexisting Np oxidation states and spectra generated from additive combinations of pure end points had similar prediction performance. This methodology can be used to directly quantify Np concentration and the ratio of Np oxidation states and other actinides in remote settings such as hot cells.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

NASA/DOD Aerospace Knowledge Diffusion Research Project. Report 35: The use of computer networks in aerospace engineering

This research used survey research to explore and describe the use of computer networks by aerospace engineers. The study population included 2000 randomly selected U.S. aerospace engineers and scientists who subscribed to Aerospace Engineering. A total of 950 usable questionnaires were received by the cutoff date of July 1994. Study results contribute to existing knowledge about both computer network use and the nature of engineering work and communication. We found that 74 percent of mail survey respondents personally used computer networks. Electronic mail, file transfer, and remote login were the most widely used applications. Networks were used less often than face-to-face interactions in performing work tasks, but about equally with reading and telephone conversations, and more often than mail or fax. Network use was associated with a range of technical, organizational, and personal factors: lack of compatibility across systems, cost, inadequate access and training, and unwillingness to embrace new technologies and modes of work appear to discourage network use. The greatest positive impacts from networking appear to be increases in the amount of accurate and timely information available, better exchange of ideas across organizational boundaries, and enhanced work flexibility, efficiency, and quality. Involvement with classified or proprietary data and type of organizational structure did not distinguish network users from nonusers. The findings can be used by people involved in the design and implementation of networks in engineering communities to inform the development of more effective networking systems, services, and policies.

Bishop, Ann P.↗

Deep spectral CNN for laser induced breakdown spectroscopy

This work proposes a spectral convolutional neural network (CNN) operating on laser induced breakdown spectroscopy (LIBS) signals to learn to (1) disentangle spectral signals from the sources of sensor uncertainty (i.e., pre-process) and (2) get qualitative and quantitative measures of chemical content of a sample given a spectral signal (i.e., calibrate). Once the spectral CNN is trained, it can accomplish either task through a single feed-forward pass, with real-time benefits and without any additional side information requirements including dark current, system response, temperature and detector-to-target range. Our experiments demonstrate that the proposed method outperforms the existing approaches used by the Mars Science Lab for pre-processing and calibration for remote sensing observations from the Mars rover, ‘Curiosity’.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Advances in Hyperspectral Image Classification Methods for Vegetation and Agricultural Cropland Studies

Hyperspectral data are becoming more widely available via sensors on airborne and unmanned aerial vehicle (UAV) platforms, as well as proximal platforms. While space-based hyperspectral data continue to be limited in availability, multiple spaceborne Earth-observing missions on traditional platforms are scheduled for launch, and companies are experimenting with small satellites for constellations to observe the Earth, as well as for planetary missions. Land cover mapping via classification is one of the most important applications of hyperspectral remote sensing and will increase in significance as time series of imagery are more readily available. However, while the narrow bands of hyperspectral data provide new opportunities for chemistry-based modeling and mapping, challenges remain. Hyperspectral data are high dimensional, and many bands are highly correlated or irrelevant for a given classification problem. For supervised classification methods, the quantity of training data is typically limited relative to the dimension of the input space. The resulting Hughes phenomenon, often referred to as the curse of dimensionality, increases potential for unstable parameter estimates, overfitting, and poor generalization of classifiers. This is particularly problematic for parametric approaches such as Gaussian maximum likelihood–based classifiers that have been the backbone of pixel-based multispectral classification methods. This issue has motivated investigation of alternatives, including regularization of the class covariance matrices, ensembles of weak classifiers, development of feature selection and extraction methods, adoption of nonparametric classifiers, and exploration of methods to exploit unlabeled samples via semi-supervised and active learning. Data sets are also quite large, motivating computationally efficient algorithms and implementations. This chapter provides an overview of the recent advances in classification methods for mapping vegetation using hyperspectral data. Three data sets that are used in the hyperspectral classification literature (e.g., Botswana Hyperion satellite data and AVIRIS airborne data over both Kennedy Space Center and Indian Pines) are described in Section 3.2 and used to illustrate methods described in the chapter. An additional high-resolution hyperspectral data set acquired by a SpecTIR sensor on an airborne platform over the Indian Pines area is included to exemplify the use of new deep learning approaches, and a multiplatform example of airborne hyperspectral data is provided to demonstrate transfer learning in hyperspectral image classification. Classical approaches for supervised and unsupervised feature selection and extraction are reviewed in Section 3.3. In particular, nonlinearities exhibited in hyperspectral imagery have motivated development of nonlinear feature extraction methods in manifold learning, which are outlined in Section 3.3.1.4. Spatial context is also important in classification of both natural vegetation with complex textural patterns and large agricultural fields with significant local variability within fields. Approaches to exploit spatial features at both the pixel level (e.g., co-occurrence–based texture and extended morphological attribute profiles [EMAPs]) and integration of segmentation approaches (e.g., HSeg) are discussed in this context in Section 3.3.2. Recently, classification methods that leverage nonparametric methods originating in the machine learning community have grown in popularity. An overview of both widely used and newly emerging approaches, including support vector machines (SVMs), Gaussian mixture models, and deep learning based on convolutional neural networks is provided in Section 3.4. Strategies to exploit unlabeled samples, including active learning and metric learning, which combine feature extraction and augmentation of the pool of training samples in an active learning framework, are outlined in Section 3.5. Integration of image segmentation with classification to accommodate spatial coherence typically observed in vegetation is also explored, including as an integrated active learning system. Exploitation of multisensor strategies for augmenting the pool of training samples is investigated via a transfer learning framework in Section 3.5.1.2. Finally, we look to the future, considering opportunities soon to be provided by new paradigms, as hyperspectral sensing is becoming common at multiple scales from ground-based and airborne autonomous vehicles to manned aircraft and space-based platforms.

Pasolli, Edoardo↗