Engineering PapersSearch

Engineering topics

Andrew Kupchock

Publications and source records attributed to Andrew Kupchock.

Aerosol and Cloud Detection Using Machine Learning Algorithms and Space-Based Lidar Data

Clouds and aerosols play a significant role in determining the overall atmospheric radiation budget, yet remain a key uncertainty in understanding and predicting the future climate system. In addition to their impact on the Earth’s climate system, aerosols from volcanic eruptions, wildfires, man-made pollution events, and dust storms are hazardous to aviation safety and human health. Space-based lidar systems provide critical information about the vertical distributions of clouds and aerosols that greatly improve our understanding of the climate system. However, daytime data from backscatter lidars, such as the Cloud-Aerosol Transport System (CATS) on the International Space Station (ISS), must be averaged during science processing at the expense of spatial resolution to obtain sufficient signal-to-noise ratio (SNR) for accurately detecting atmospheric features. For example, 50% of all atmospheric features reported in daytime operational CATS data products require averaging to 60 km for detection. Furthermore, the single-wavelength nature of the CATS primary operation mode makes accurately typing these features challenging in complex scenes. This paper presents machine learning (ML) techniques that, when applied to CATS data, enable detection of atmospheric features during daytime operations with a horizontal resolution of 5 km compared to the 60 km horizontal resolution often required for daytime CATS data. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime.

lidar

Aerosol and Cloud Detection Using Machine Learning Algorithms and Space-Based Lidar Data

Clouds and aerosols play a significant role in determining the overall atmospheric radiation budget, yet remain a key uncertainty in understanding and predicting the future climate system. In addition to their impact on the Earth’s climate system, aerosols from volcanic eruptions, wildfires, man-made pollution events and dust storms are hazardous to aviation safety and human health. Space-based lidar systems provide critical information about the vertical distributions of clouds and aerosols that greatly improve our understanding of the climate system. However, daytime data from backscatter lidars, such as the Cloud-Aerosol Transport System (CATS) on the International Space Station (ISS), must be averaged during science processing at the expense of spatial resolution to obtain sufficient signal-to-noise ratio (SNR) for accurately detecting atmospheric features. For example, 50% of all atmospheric features reported in daytime operational CATS data products require averaging to 60 km for detection. Furthermore, the single-wavelength nature of the CATS primary operation mode makes accurately typing these features challenging in complex scenes. This paper presents machine learning (ML) techniques that, when applied to CATS data, (1) increased the 1064 nm SNR by 75%, (2) increased the number of layers detected (any resolution) by 30%, and (3) enabled detection of 40% more atmospheric features during daytime operations at a horizontal resolution of 5 km compared to the 60 km horizontal resolution often required for daytime CATS operational data products. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime.

lidar

The Aerosol Characterization from Polarimeter and Lidar (ACEPOL) airborne field campaign

In the fall of 2017, an airborne field campaign was conducted from the NASA Armstrong Flight Research Center in Palmdale, California, to advance the remote sensing of aerosols and clouds with multi-angle polarimeters (MAP) and lidars. The Aerosol Characterization from Polarimeter and Lidar (ACEPOL) campaign was jointly sponsored by NASA and the Netherlands Institute for Space Research (SRON). Six instruments were deployed on the ER-2 high-altitude aircraft. Four were MAPs: the Airborne Hyper Angular Rainbow Polarimeter (AirHARP), the Airborne Multiangle SpectroPolarimetric Imager (AirMSPI), the Airborne Spectrometer for Planetary EXploration (SPEX airborne), and the Research Scanning Polarimeter (RSP). The remainder were lidars, including the Cloud Physics Lidar (CPL) and the High Spectral Resolution Lidar 2 (HSRL-2). The southern California base of ACEPOL enabled observation of a wide variety of scene types, including urban, desert, forest, coastal ocean, and agricultural areas, with clear, cloudy, polluted, and pristine atmospheric conditions. Flights were performed in coordination with satellite overpasses and ground-based observations, including the Ground-based Multiangle SpectroPolarimetric Imager (GroundMSPI), sun photometers, and a surface reflectance spectrometer.

SPECTRAL-RESOLUTION LIDAR

Machine Learning Algorithms for Aerosol and Cloud Detection Using CATS on the ISS

Clouds and aerosols are one of the largest uncertainties in understanding and forecasting the Earth’s changing climate system. The type and height of aerosols are important factors in determining the top-of-atmosphere (TOA) radiation budget, either direct reflection of solar radiation back to space and/or absorption of solar radiation. In addition to their impact on the Earth’s climate system, aerosols near the surface from wildfires, man-made pollution events, and dust storms are hazardous to human health. The phase and height of clouds also play a critical role in determining the role of clouds in the Earth’s climate system. Cirrus clouds in the upper troposphere can induce a significant daytime TOA warming effect, while liquid water clouds near the surface cause a large corresponding cooling effect. Lidar measurements provide accurate vertically resolved information about clouds and aerosols, including complex multi-layer scenes where passive sensors are challenged and at night, when passive sensors are unable to measure cloud and aerosol properties. The Cloud-Aerosol Transport System (CATS) is a lidar instrument that operated for 33 months on the International Space Station (ISS) at the 1064 nm wavelength to measure attenuated total backscatter and depolarization ratio. These fundamental measurements are used to derive “vertical feature mask” cloud and aerosol products, including layer top/base heights, layer geometrical thickness, aerosol type, and cloud phase. While space-based lidar systems like CATS provide cloud and aerosol vertical distributions that improve our understanding of the climate system, averaging of the daytime data from these sensors is required, at the expense of spatial resolution, to improve the daytime signal-to noise (SNR) and thus atmospheric layer detection. This presentation shows results from machine learning (ML) techniques that, when applied to CATS data: 1. improve the 1064 nm SNR 2. enable detection of atmospheric features during daytime with a horizontal resolution of 350 m or 5 km (compared to the 60 km required for standard CATS data products) 3. increase the number of atmospheric layers detected in the CATS data. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination, cloud phase, and aerosol typing compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime. The ML tools described in this paper can facilitate the development of smaller, low-cost lidar systems in the future and enable real-time accessibility of lidar data products from future lidar systems for monitoring and forecasting of hazardous events.

John Yorks

The Roscoe Lidar: Initial Results from the Upward and Downward Looking Airborne Lidar from the ACCLIP and SABRE Campaigns

Backscatter lidars are a staple of airborne remote sensing and are primarily used in determining the altitude, vertical structure, and optical properties of clouds and aerosols. These airborne lidars typically observe in a downward direction which is sufficient for most tropospheric objectives. With more scientific attention being directed to upper tropospheric/lower stratospheric (UTLS) aerosols and recent volcanic and phrocumulonimbus events in the news, developing lidar instruments that can observe the UTLS will be vital in better understanding their composition and optical properties and determining their role in the planet's radiative balance. To meet this need, the downward and upward looking Roscoe lidar was developed and flown on two recent field campaigns: Stratospheric Aerosol processes, Budget, and Radiative Effects (SABRE) and Asian Summer Monsoon Chemical and CLimate Impact Project (ACCLIP) (both 2022). Building on its extensive Cloud Physics Lidar (CPL) heritage, we show that Roscoe can deliver CPL-like products in both the up and down-looking directions providing an unmatched vertical view of the atmosphere from an airborne platform. Future work can leverage Roscoe's updward looking view to quantify the optical properties and extinction of UTLS aerosols.

Kenneth Christian