Surveying the Machine Learning Landscape in Earth Sciences
Explore the source record for details and available documents.
Engineering topics
Publications and source records attributed to Katrina S Virts.
Explore the source record for details and available documents.
Several recent papers have investigated different challenges in applying machine learning (ML) techniques to Earth science problems. The challenges listed range from interpretability of the results to computational demand to data issues. In this paper, we focus on specific challenges listed in the review papers that are centered around training data, as the size of training data is important in applying deep learning (DL) techniques. We are in the process of conducting a literature survey to better understand these challenges as well as to understand any trends. As part of this survey, our review has encompassed Earth science papers from AGU, AMS, IEEE and SPIE journals covering the last ten years and focused on papers that utilize supervised ML techniques.
Explore the source record for details and available documents.
Recent review papers (Ball et al., 2017; Reichstein et al., 2019) have investigated the opportunities and challenges in applying supervised machine learning (ML) techniques to Earth science problems. A common challenge is the lack of training (or labeled) data. Supervised ML, and especially deep learning (DL), require large training datasets. While there are large, open access Earth science archives, the data typically require preprocessing in preparation for supervised ML, frequently including manual labeling. Our objective is to understand the landscape of supervised ML in the Earth sciences, including which research communities have most rapidly adopted supervised ML, which algorithms are applied, and what data are used to train these algorithms. We conducted a literature survey of Earth science papers published during the last 10 years in journals from the American Geophysical Union (AGU), American Meteorological Society (AMS), the Institute of Electrical and Electronics Engineers(IEEE), and the Society of Photo-Optical Instrumentation Engineers (SPIE). We identified papers containing the terms ML, DL, or the names of individual supervised ML algorithms. "Earth science" is an additional required search term for IEEE and SPIE. We investigate trends in supervised ML usage during the 10-year study period, and manually analyzed AGU papers from 2018-2019 to enable deep-dive statistics.
From disaster response and mitigation to monitoring water quality or protecting wildlife habitat, satellite Earth observation data can be applied in countless ways to meet pressing needs and benefit society. The crucial first step toward successful data application is data discovery. Potential users often know exactly what data they need--what Earth feature or phenomenon they need to observe, how frequently, and at what resolution or level of accuracy--but may still struggle to discover the existing observations that meet their needs. We have developed a pipeline to connect applications-based users to specific satellites and data collections within NASA's Earth observation program of record that are highly relevant to their data needs. This pipeline combines available information on satellite and instrument measurement characteristics with an innovative machine learning-based approach that identifies instruments that are most relevant to the feature or phenomenon of interest.
This presentation discusses the current status and ongoing work towards a low-Earth orbit (LEO) lightning climatological product that includes both Lightning Imaging Sensors (LIS) and the Optical Transient Detector (OTD). The project builds upon the work by Cecil et al. (2014) to include the LIS on the International Space Station (ISS), featuring additional inter-instrumental comparisons to more accurately depict the unique capabilities of each instrument. A closer examination of the interference from the South Atlantic Anomaly (SAA) was also conducted on all three LEO sensors. The SAA is a region of the magnetosphere roughly spanning the south-central Atlantic wherein the inner Van Allen radiation belts are closer to Earth than anywhere else, subjecting spacecraft in LEO to significantly higher radiation flux levels. This radiation can produce interference with the LIS and OTD instruments, manifesting as non-lightning luminous events. While these events can be identified easily enough, they can occur in such quantities that they overwhelm the sensors’ processors and effectively ‘blind’ them. This is called the First-In First-Out (FIFO) buffer overflow, and this blinded time reduced the instruments’ view-time as a result. The FIFO overflow and view-time can reliably be used to track the SAA interference (Clark et al. 2024), which allows for the lightning counts attributable to the SAA to be assessed. The impact that the SAA had on the quality of observations from the LEO lightning instrumentation and the significance for the resulting climatological products was investigated. Substantial areas of interference were identified for all three instruments using the view-time and quality flags, each with a unique shape and temporal evolution. The temporal evolution and general region affected are of particular importance when constructing a climatological product, as there are notable reductions to view-time over prolonged periods across a lightning-rich region. However, a temporal element also makes isolating the subsequent impact on the lightning signal significantly more challenging. Lightning counts in this region are highly seasonal and exhibit inter-annual variability, which is compounded by the nature of LEO observations. This study includes preliminary analysis of the impact that the SAA has on the lightning counts given the notable impact shown in the metadata.