Engineering Papers⌕ Search

Engineering topics

Alexander Vasilkov

Publications and source records attributed to Alexander Vasilkov.

At least 19 records

Use of Machine Learning and Principal Component Analysis to Retrieve Nitrogen Dioxide (NO 2 ) With Hyperspectral Imagers and Reduce Noise in Spectral Fitting

Nitrogen dioxide (NO 2 ) is an important trace-gas pollutant and climate agent whose presence also leads to spectral interference in ocean color retrievals. NO 2 column densities have been retrieved with satellite UV–Vis spectrometers such as the Ozone Monitoring Instrument (OMI) and the Tropospheric Monitoring Instrument (TROPOMI) that typically have spectral resolutions of the order of 0.5 nm or better and spatial footprints as small as 3.6 km × 5.6 km. These NO 2 observations are used to estimate emissions, monitor pollution trends, and study effects on human health. Here, we investigate whether it is possible to retrieve NO 2 amounts with lower-spectral-resolution hyperspectral imagers such as the Ocean Color Instrument (OCI) that will fly on the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) satellite set for launch in early 2024. OCI will have a spectral resolution of 5 nm and a spatial resolution of ∼ 1 km with global coverage in 1–2 d. At this spectral resolution, small-scale spectral structure from NO 2 absorption is still present. We use real spectra from the OMI to simulate OCI spectra that are in turn used to estimate NO 2 slant column densities (SCDs) with an artificial neural network (NN) trained on target OMI retrievals. While we obtain good results with no noise added to the OCI simulated spectra, we find that the expected instrumental noise substantially degrades the OCI NO 2 retrievals. Nevertheless, the NO 2 information from OCI may be of value for ocean color retrievals. OCI retrievals can also be temporally averaged over timescales of the order of months to reduce noise and provide higher-spatial-resolution maps that may be useful for downscaling lower-spatial-resolution data provided by instruments such as OMI and TROPOMI; this downscaling could potentially enable higher-resolution emissions estimates and be useful for other applications. In addition, we show that NNs that use coefficients of leading modes of a principal component analysis of radiance spectra as inputs appear to enable noise reduction in NO 2 retrievals. Once trained, NNs can also substantially speed up NO 2 spectral fitting algorithms as applied to OMI, TROPOMI, and similar instruments that are flying or will soon fly in geostationary orbit.

NO2↗

Tracking aerosols and SO2 clouds from the Raikoke eruption: 3D view from satellite observations

The 21 June 2019 eruption of the Raikoke volcano (Kuril Islands, Russia; 48° N, 153° E) produced significant amounts of volcanic aerosols (sulfate and ash) and sulfur dioxide (SO2) gas that penetrated into the lower stratosphere. The dispersed SO2 and sulfate aerosols in the stratosphere were still detectable by multiple satellite sensors for many months after the eruption. For this study of SO2 and aerosol clouds we use data obtained from two of the Ozone Mapping and Profiler Suite sensors on the Suomi National Polar-orbiting Partnership satellite: total column SO2 from the Nadir Mapper and aerosol extinction profiles from the Limb Profiler as well as other satellite data sets. We evaluated the limb viewing geometry effect (the “arch effect”) in the retrieval of the LP standard aerosol extinction product at 674 nm. It was shown that the amount of SO2 decreases with a characteristic period of 8–18 d and the peak of stratospheric aerosol optical depth recorded at a wavelength of 674 nm lags the initial peak of SO2 mass by 1.5 months. Using satellite observations and a trajectory model, we examined the dynamics of an unusual atmospheric feature that was observed, a stratospheric coherent circular cloud of SO2 and aerosol from 18 July to 22 September 2019.

Eruption of the Raikoke volcano↗

Revised and extended benchmark results for Rayleigh scattering of sunlight in spherical atmospheres

While most of traditional Earth-atmosphere satellite remote sensing relies on radiative transfer in the plane parallel geometry, effects of sphericity are important at high sun and view zenith angles. Broad understanding of these effects is limited and, contrary to the plane-parallel case, finding accurate numerical results to test spherical RT codes is not easy. This paper aims to partially fill in this gap. Using the full-spherical RT code MYSTIC (Monte Carlo), and the plane-parallel RT code VLIDORT (discrete ordinates) corrected for atmospheric sphericity in the single and multiple scattering, we reproduced with better accuracy and extended the benchmark results by Adams & Kattawar [1978].

spherical atmospheres↗

TROPOMI Geometry-dependent Lambertian-Equivalent surface Reflectivity (GLER) Product for Improved Trace-Gas Retrieval

Accurate information about the reflectivity of the Earth's surface is required for most satellite retrievals of atmospheric composition, and this information is generally taken from monthly surface reflectivity climatology that neglects angular dependence. Previously we introduced Geometry-dependent Lambertian-equivalent surface reflectivity (GLER) which captures solar and satellite viewing angle dependence as well as daily and seasonal changes. GLER is calculated from simulations of Rayleigh-only top-of-atmosphere (TOA) radiances over non-Lambertian surfaces. We use NASA's Moderate Resolution Imaging Spectroradiometer (MODIS) bidirectional reflectance distribution function (BRDF) product over land and the wind-dependent Cox–Munk wave-facet slope distribution including water-leaving radiance over water to accounts for surface BRDF. We have developed global GLER product, previously for the Ozone Monitoring Instrument (OMI) and recently for Sentinel-5 Precursor (S5P) TROPOspheric Monitoring Instrument (TROPOMI) with several new improvements and updates. We have implemented the near real time daily V006 MODIS MCD43C1 BRDF data and gap-filled with a daily BRDF coefficient climatology created from 2002-2017 V006 MCD43GF data. The NASA’s Global Modelling Initiative hourly 0.25 x 0.25 deg Replay simulations are used for more accurate determination of pixel specific terrain pressure. To improve detection of seasonal snow/ice scenes, we use the 4-km snow cover product from the Interactive Multi-sensor Snow and Ice Mapping System (IMS). Finally, we use an improved version of the vector linearized discrete ordinate radiative transfer (VLIDORT) for update of the top-of-atmosphere (TOA) radiance look-up-tables (LUTs). We demonstrate how the use of GLER is beneficial to TROPOMI’s high spatial resolution (up to 3.5 km x 3.5 km) measurements to monitor atmospheric trace gas pollutants down to the sub-city scale.

TROPOMI↗

Verification of TROPOMI NO2 Product Using OMI NO2 algorithm

We evaluated S5P TROPOspheric Monitoring Instrument (TROPOMI) operational nitrogen dioxide (NO2) product by comparing with the NO2 retrievals from Ozone Monitoring Instrument (OMI) onboard NASA’s Aura satellite. We compared spatially matched NO2 vertical column density (VCD) data from OMI and TROPOMI to identify any discrepancies between the two operational products. We also applied OMI Air-Mass Factor (AMF) algorithm to TROPOMI Slant Column Density (SCD) data (v02.03.01) aiming to create long-term merged NO2 Earth Science Data Record (https://disc.gsfc.nasa.gov/datasets/TROPOMI_MINDS_NO2_1.1/summary ). The algorithm (version 4.0) uses new Geometry-dependent Lambertian Equivalent surface Reflectivity (GLER) product available for each TROPOMI pixel. GLER is pre-calculated using the vector linearized discrete ordinate radiative transfer (VLIDORT) model, which uses as input high-resolution bidirectional reflectance distribution function (BRDF) information from NASA's Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) over land and the wind-dependent Cox–Munk wave-facet slope distribution over water, the latter with a contribution from the water-leaving radiance based on MODIS gap-filled in-water chlorophyll-a data. The GLER data, combined with consistently retrieved cloud parameters, provide improved information for the calculation of the scattering weight profiles. Additional AMF improvements result from using high resolution (0.25o latitude x 0.25o longitude) a priori NO2 profile shapes and other auxiliary information from the Global Modeling Initiative (GMI) Replay simulation sampled using S5P orbital simulator. Our TROPOMI_MINDS_NO2 algorithm employs the stratosphere-troposphere separation scheme, de-striping, and surface snow/ice treatment consistently with the latest OMI NO2 re-processing (version 4). We evaluate the TROPOMI_MINDS_NO2 product by comparing with the S5P operational NO2 product as well as with independent NO2 observations from ground-based Pandora and aircraft observations. Our results indicate that the new TROPOMI_MINDS_NO2 retrievals are generally higher than the S5P operational NO2 product over polluted regions and show improved agreement with independent validation data.

TROPOMI↗

Continuing Global SO2 Data Record from OMI and SNPP/OMPS to JPSS-1/NOAA-20/OMPS

Since 2004, the Ozone Monitoring Instrument (OMI) aboard NASA's Earth Observing System (EOS) Aura spacecraft has been providing global observations that help to constrain the sources, transport, and environmental impacts of anthropogonic and volcanic SO2. The OMI SO2 data record is now being continued with the NASA/NOAA Suomi National Polar-orbiting Partnership (SNPP)/Ozone Mapping and Profiler Suite (OMPS) launched in 2011. Both OMI and SNPP/OMPS SO2 products are produced with the Goddard principal component analysis (PCA) based spectral fitting algorithm. This data-driven technique inherently accounts for various instrumental factors and geophysical interferences, leading to high-quality, consistent SO2 retrievals between OMI and SNPP/OMPS, despite coarser spectral (~0.5 nm vs. ~1 nm) and spatial (13  24 km2 vs. 50  50 km2 at nadir) resolution for the latter. In this presentation, we describe our effort to continue the long-term SO2 climate data record using measurements from the Joint Polar Satellite System (JPSS)-1/NOAA-20 (N20)/OMPS. Launched in 2017, the N20/OMPS is a follow-on for SNPP/OMPS but features a spatial resolution (17  13 km2) that is comparable with OMI. We will discuss our progress implementing the PCA SO2 algorithm with N20/OMPS, especially algorithmic improvements to further reduce retrieval noise and bias for large volcanic eruptions. We will present examples for both continuously emitting sources (e.g., power plants in India and oil/gas fields in the Middle East) and volcanic eruptions (e.g., Raikoke in 2019). We will also compare N20/OMPS SO2 retrievals with OMI and SNPP/OMPS, as well as other instruments such as the ESA Copernicus Sentinel-5 Precursor (S5P)/TROPOspheric Monitoring Instrument (TROPOMI). To assess the ability of N20/OMPS to monitor and quantify SO2 sources, we will run the level 2 retrievals through a top-down emission algorithm to estimate the SO2 emission strengths for a number of point sources. Finally, we will outline our plan for further algorithm refinement and public data release.

SO2↗

Global SO 2 Data Record from OMPS Instruments on the JPSS Constellation

NASA’s Earth Observing System (EOS) SO 2 climate data record (CDR) started in 2004, with the launch of the Aura/Ozone Monitoring Instrument (OMI) and is now being continued with the SNPP/Ozone Mapping and Profiler Suite (OMPS) launched in 2011. Both OMI and SNPP/OMPS SO 2 CDRs are produced with the Goddard principal component analysis (PCA) spectral fitting algorithm. An advantage of the data-driven PCA retrieval technique is that it enables highly consistent retrievals from different instruments, by inherently accounting for various instrumental factors. To further extend the EOS SO 2 CDR, we are implementing the PCA SO 2 retrieval algorithm with the L1B measurements from OMPS instruments flying on the Joint Polar Satellite System (JPSS) constellation. In this presentation, we will provide an update on our progress in NOAA-20 (launched in 2017) and NOAA-21 (launched in 2022) PCA SO2 retrievals. We will focus on our new NOAA-20/OMPS PCA SO 2 EOS continuity product, to be publicly released in fall of 2023. We will present statistical analyses on the quality of NOAA-20 PCA SO 2 product, including retrieval noise, biases over background areas, and long-term stability. We will compare our PCA SO 2 retrievals from NOAA-20 with those from OMI, SNPP/OMPS, and S5P/TROPOMI (TROPOspheric Monitoring Instrument) for anthropogenic sources as well as large volcanic plumes. We will also discuss the application of a new machine learning technique that helps to further reduce the noise of NOAA-20 SO 2 retrievals. In addition, we will present preliminary PCA SO 2 retrievals from NOAA-21/OMPS, including those from direct readout implementation for aviation disaster avoidance. Finally, we will share some first results applying the PCA algorithm to NASA’s geostationary TEMPO (Tropospheric Emissions: Monitoring of Pollution) instrument to obtain hourly, high resolution SO 2 data over North America.

SO2↗

Continuing Long-term Global SO 2 Data Record with JPSS OMPS Instruments

NASA’s long-term Earth Observing System (EOS) SO 2 climate data record (CDR) started with Aura/Ozone Monitoring Instrument (OMI, launched in 2004) and is now being continued with the SNPP/Ozone Mapping and Profiler Suite (OMPS, launched in 2011). Both OMI and SNPP/OMPS SO 2 CDRs are produced with the Goddard principal component analysis (PCA) spectral fitting algorithm. By inherently accounting for various instrumental factors, the PCA technique enables highly consistent retrievals between different instruments. In this presentation, we will provide an overview on our effort to further extend the EOS SO 2 CDR, by implementing the PCA SO 2 algorithm with multiple OMPS instruments flying on the Joint Polar Satellite System (JPSS) constellation, including NOAA-20 (launched in 2017) and NOAA-21 (launched in 2022). We will present results analyzing our new NOAA-20/OMPS PCA SO 2 EOS continuity product, to be publicly released in fall of 2023. We will show statistical analyses on the quality of NOAA-20 PCA SO 2 product, such as retrieval noise, biases over background areas, and long-term stability. We will employ a previously established top-down method to estimate SO2 emissions from selected large point sources, using NOAA-20 SO 2 retrievals and assimilated wind fields as input. The SO 2 emission estimates derived from NOAA-20 retrievals will be compared with those from OMI, SNPP/OMPS, and S5P/TROPOMI (TROPOspheric Monitoring Instrument). We will also demonstrate the application of a new machine learning technique that further reduces the noise of NOAA-20 SO 2 retrievals. Finally, we will present preliminary PCA SO 2 retrievals from recently launched satellite sensors, including NOAA-21/OMPS and NASA’s geostationary TEMPO (Tropospheric Emissions: Monitoring of Pollution) instrument.

SO2↗

How Can We Harness the Power of Machine Learning With TEMPO Data?

There are many potential applications of machine learning for TEMPO data that include - Improve retrievals by reducing the effect of random instrument noise - Expand coverage by producing data in moderately cloudy conditions (see also Fasnacht et al. poster) - Help diagnose impacts of instrumental artifacts - Produce value-added products quickly by training on existing products from other sensors (land and ocean) - Speed up processing by training on products produced with full-physics algorithms (e.g., NO 2 slant column fitting may take ~1 hour/orbit but with a neural net it may take only minutes)

NO2↗

Use of TEMPO as a Proxy for Hyperspectral Geostationary Ocean Color Measurements from the GeoXO OCX Instrument: Harnessing Machine Learning and Principal Component Techniques for Atmospheric and Glint Correction

Retrievals of ocean color from space are important for better understanding the ocean ecosystem. The launch of atmospheric geostationary hyperspectral sensors such as TEMPO, provides a unique opportunity to examine the diurnal variability in ocean ecology. While TEMPO does not have as high spatial resolution or full spectral coverage as planned coastal ocean sensors such as the Geosynchronous Littoral Imaging and Monitoring Radiometer (GLIMR) or GeoXO Ocean Color instrument (OCX), its hourly measurements provide coverage of regions such as Lake Erie and the Gulf of Mexico at spatial scales of approximately 5 km. These data can be useful for testing new algorithms. We will apply our newly developed machine learning based atmospheric correction approach for ocean color retrievals to TEMPO data. Our approach begins by decomposing measured radiances from hyperspectral sensors into spectral features that describe the scattering and absorption of the atmosphere as well as the underlying surface reflectance. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from collocated MODIS/VIIRS physically-based retrievals. This machine learning approach does not rely on radiative transfer modeling, and the use of MODIS/VIIRS data for training accounts for possible calibration b in hyperspectral data. Previously, we applied our approach using blue and UV wavelengths with the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can estimate ocean color properties in less-than-ideal conditions such as lightly to moderately clouded conditions as well as sun glint and thus improve the spatial coverage of ocean color measurements. TEMPO provides an opportunity to improve on this approach since it will provide collocated measurements at green and red wavelengths that were not available from OMI and TROPOMI and are important particularly for coastal waters. Additionally, our technique can be applied early in the mission and has potential to demonstrate the value of near real time ocean color products that are important for monitoring of harmful algae blooms and other oceanic phenomena.

Zachary Fasnacht↗

Principal Component and Machine Learning Approach to Gap Fill Hyperspectral Ocean Color Satellite Retrievals

Retrievals of ocean color properties from space are important for monitoring the health of the ocean ecosystem but such retrievals can be limited spatially due to conditions such as clouds, aerosols, and sun glint. Gap filling of ocean color retrievals is typically performed by combining retrievals from multiple satellites or temporally averaging multiple days of retrievals. Despite these techniques large gaps still exist posing challenges for near real time monitoring of events like harmful algae blooms. To address these limitations, we developed a spatial gap filling approach applying machine learning approach to hyperspectral instruments to learn how to perform an atmospheric correction under challenging retrieval conditions. In this approach a principal component analysis is used to decompose the hyperspectral measurements into spectral components that describe the scattering and absorption of the atmosphere mixed with the surface spectral signatures. The coefficients of the principal components are used to train a neural network to predict ocean color properties derived from a standard MODIS ocean color algorithm. We apply the approach to two hyperspectral UV/VIS sensors, the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can be used to estimate ocean color properties such as chlorophyll, remote sensing reflectance, and fluorescence line height. This method could be used as a gap-filling technique for the future Ocean Color Instrument (OCI) onboard upcoming NASA's Plankton, Aerosol Cloud, ocean Ecosystem (PACE) satellite to provide additional information for monitoring the health of our global oceans. Additionally, it could be applied to the first NASA and Smithsonian geostationary Tropospheric Emissions: Monitoring of Pollution (TEMPO) spectrometer to better understand diurnal variability in inland and coastal ocean ecology.

Zachary Fasnacht↗

A Principal Component and Machine Learning Approach to Spatially Gap Fill Hyperspectral Ocean Color Satellite Retrievals

Retrievals of ocean color properties from space are important for monitoring the health of the ocean ecosystem but such retrievals tend to be limited in spatial coverage due to conditions such as clouds, aerosols, and sun glint. Gap filling of ocean color retrievals is typically performed by combining retrievals from multiple satellites or temporally averaging multiple days of retrievals but despite these techniques large gaps still exist posing challenges for near real time monitoring of events like harmful algae blooms. To address these limitations, we propose a spatial gap filling approach using machine learning to learn how to perform an atmospheric correction under challenging retrieval conditions. In this approach a principal component analysis is used to decompose the hyperspectral measurements into spectral features that describe the scattering and absorption of the atmosphere as well as the underlying surface. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from a standard ocean color algorithm such as the MODIS atmospheric correction algorithm. This machine learning approach is independent of a priori information and does not rely on any radiative transfer modeling. We apply the approach to two hyperspectral UV/VIS instruments, the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can be used to estimate ocean color properties such as chlorophyll, remote sensing reflectance, and fluorescence line height. This method could be used as a gap-filling technique for the future Ocean Color Instrument (OCI) which will be onboard NASA's Plankton, Aerosol Cloud, ocean Ecosystem (PACE) ocean color satellite to provide additional information for monitoring the health of our global oceans. Additionally, it could be applied to the geostationary satellite Tropospheric Emissions: Monitoring of Pollution (TEMPO) to better understand diurnal variability in ocean ecology.

MODIS atmospheric correction algorithm↗