Engineering Papers⌕ Search

Engineering topics

Yongxiang Hu

Publications and source records attributed to Yongxiang Hu.

At least 73 records · Page 4

The PACE-MAPP Algorithm: Simultaneous Aerosol and Ocean Products From Combined Polarimeter and Shortwave Infrared Measurements

PACE-MAPP collaborative algorithm project - Produce accurate aerosol optical and microphysical properties and ocean properties - Use a coupled atmosphere-ocean vector radiative transfer (VRT) model - Use accurate but fast Mie/SS/T-matrix LUTs - Use scientific machine learning to speed-up retrievals by 1000x (PACE-MAPP Neural Network) - PACE-MAPP is a multi-instrument polarimeter algorithm for SPEXone, HARP2, OCI shortwave infrared channels

Snorre Alfred Moen Stamnes↗

Evaluating Combined Lidar and Polarimeter Measurements of Cloud Top Parameters (Extinction, Scattering Cross Sections, and Droplet Number Density, Liquid Water Content)

We present a new method to derive profiles of extinction from a lidar which is then combined with polarimeter measurements to derive cloud droplet number density (CDNC) in the tops of warm clouds. The method employs polarization-sensitive elastic backscatter lidar measurements to estimate attenuation of the lidar signal within the cloud and polarimeter estimates of cloud droplet size distributions. The measurements used for this demonstration are from NASA Langley Research Center’s High Spectral Resolution Lidar – Generation 2 (HSRL-2) and NASA GISS’s Research Scanning Polarimeter (RSP). The measurements were acquired on NASA’s ACTIVATE mission, during which the instruments were deployed in a down-looking mode from a high-altitude aircraft, which flew in coordination with a low-flying aircraft acquiring coincident in situ measurements of cloud droplet size and number. The high vertical (1.25 m) and horizontal (~50 m) sampling resolution of the HSRL-2 data enabled retrievals of single-scattering extinction profiles to within ~2.5 optical depths of cloud top. Another key feature of the method was the well-calibrated measurement of backscatter at cloud top due to using the HSRL technique. The RSP retrievals of cloud droplet effective radius and variance were accomplished using the “cloud-bow” technique. Overall, the technique provides extinction profile estimates for the top 2.5 optical depths of water clouds that can be used to estimate the cloud droplet number density in various types of warm clouds. The mean extinction values at cloud top (0-1 optical depth) are compared against cloud drop size and number concentration acquired from wing-mounted probes (e.g., DMT Cloud Droplet Probe - CDP, SPEC Fast Cloud Droplet Probe FCDP, and SPEC 2D Stereo Probe - 2DS) that were deployed on the low-flying aircraft. Comparisons between the effective radius and variance from the polarimeter, lidar ratio (extinction to backscatter) from the lidar and polarimeter, and LWC are also presented. All measurements were acquired over the Western North Atlantic over 3 years from 2020 to 2022.

lidar↗

AMSR-2 Daily Snow Depth Data Product Using a Neural Network Algorithm Trained by Collocated ICESat-2 Measurements

By using diffusion theory and Monte Carlo lidar radiative transfer simulations, Hu 1 et al. (2022b) has derived snow depth from the first-, second- and third-order moments of the lidar backscattering pathlength distribution. Lu 2 et al. (2022,2024) calculated the snow depth by applying the methods to the satellite ICESat-2 lidar measurements over the Arctic sea ice, as well as land surfaces of Northern Hemisphere. In this paper, a neural network (NN) algorithm, employing several channels from AMSR-2 and the humidity vertical profiles GMAO GEOS-IT, is trained to determine snow depth identified by time and geolocation matched 2019 ICESat-2 snow-depth data during winter months over the Arctic sea ice. The trained NN snow-depth was applied to 2014-2020 AMSR-2 clear pixel data, although the algorithms perform reasonably well in thinner clouds. This paper used AMSR-2 data, a passive microwave instrument to generate a wide range of snow depth data, covering extensive spatial areas in the cross-orbit direction.

Neural Network↗

Towards a Marine Stratus Climatology on Drizzle Occurrence from CALIPSO

Marine stratus are a predominant feature of our planet with the annual mean coverage exceeding 20%. They strongly reflect sunlight, yet exert only a modest effect on outgoing infrared radiation, providing a significant net cooling to the Earth’s radiative balance. Their formation is coupled to boundary layer circulations that are driven, in part, by cloud top radiative cooling and evaporative cooling from precipitation in downdrafts. Understanding how these cloud systems evolve as the climate changes is a key question that requires additional information on their lifecycle and microphysical properties to accurately represent their behavior in global circulation models. From a large-scale perspective, insight into the microphysical properties of marine stratus at cloud top can be realized through estimates of the effective radius (Re) of the droplet size distributions derived from MODIS observations. Estimates on the occurrence of rain/drizzle are available from CloudSat. Together these observations indicate that precipitation frequently occurs in clouds with higher cloud top Re. This relationship is consistent with the well documented shift in cloud top droplet size distributions towards fewer, yet larger droplets prior the onset of precipitation. Here we report on a new and complementary set observations from the CALIPSO mission. The approach derives an extinction-to-backscatter ratio (Sc, also known as the cloud lidar ratio) using an established relationship that depends on observations of the lidar attenuated backscatter and volume depolarization ratio within the cloud. Because Sc is strongly and inversely related to Re, a change in the derived Sc from higher to lower values corresponds to a change in the droplet size distribution as seen by MODIS. This change in the lidar signals at cloud top clearly identifies clouds that are capable of precipitation. The presentation provides a brief overview of the approach for deriving Sc and compares CALIOP-derived Sc with observations from other techniques. CALIOP classifications of drizzling clouds, based on the retrieved values Sc, are compared to independent, collocated assessments of drizzle occurrence reported in the standard CloudSat data products. Regional and seasonal comparisons highlight the strengths and weaknesses of the two sensors. A machine learning approach that combines information from both CALIOP and CloudSat showcases possible improvements in the global identification of scenes likely to contain rain-bearing clouds.

CALIPSO↗

Snow Depth from AMSR-2 Using Multispectral Satellite Data in an Artificial Neural Network

By using diffusion theory and Monte Carlo lidar radiative transfer simulations, Hu et al. (2022b) has derived snow depth from the first-, second- and third-order moments of the lidar backscattering pathlength distribution. Lu et al. (2022) calculated the snow depth by applying the methods to the satellite ICESat-2 lidar measurements over the Arctic sea ice, as well as land surfaces of Northern Hemisphere. In this paper, an artificial neural network (ANN) algorithm, employing several channels from Advanced Microwave Scanning Radiometer 2 (AMSR-2) and the humidity vertical profiles from Global Modeling and Assimilation Office (GMAO) Goddard Earth Observing System for Instrument Teams (GEOS-IT) product, is trained to determine snow depth identified by time and geolocation matched 2019 ICESat-2 snow-depth data during winter months over the Arctic sea ice. The trained ANN snow-depth was applied to 2018 AMSR-2 clear pixel data, although the algorithms perform reasonably well in thinner clouds. The validation data (different from the training set) of ANN snow depth from AMSR-2 showed a good agreement with time matched and co-located snow-depth values from ICESat-2. The bias was near zero, with mean absolute error (MAE) 0.05 cm and a root-mean-square-error (RMSE) 0.08 cm. Prior applying the trained ANN snow depth to AMSR-2 data, a cloud screening algorithm was developed with a similar approach. A separate ANN cloud mask was trained to determine an AMSR-2 pixel is clear or cloudy with time and geolocation matched 2015 CALIOP Vertical Feature Mask (VFM) over Arctic sea ice. The ANN cloud mask from AMSR-2 under-estimated cloud fraction by 3-6% compared to CALIOP . The additional research is needed to conclusively evaluate the ANN cloud mask accuracy. Finally, this paper will lay the foundation for a sustained long-term snowfall and snow-storm monitoring system. The future Cloud Aerosol LIdar for Global scale Observations of the ocean-Land Atmosphere system (CALIGOLA) mission will provide a means to calculate snow depth from the lidar backscattering pathlength distribution, benefiting from the UV, visible and infrared pulses. With the calculated snow depth as the truth one could develop a machine learning algorithm, as it was done in this paper, using a passive microwave instrument available at that time to generate a wide range of snow depth data, covering extensive spatial areas in the cross-orbit direction.

Neural Network↗

CALIGOLA: A New Spaceborne Lidar Mission

Agenzia Spaziale Italiana (ASI) and NASA are partnering on an exciting new spaceborne lidar mission known as CALIGOLA (i.e., the Cloud and Aerosol Lidar for Global Scale observations of the Ocean-Land-Atmosphere) that seeks to significantly advance our understanding of Earth’s coupled ocean-land-atmosphere systems. By flying an innovative multi-wavelength, polarization-sensitive Raman lidar that will simultaneously acquire elastic backscatter and fluorescence measurements, CALIGOLA will provide new insights into the processes that influence climate, weather, and air quality by vertically profiling microphysical and optical properties of clouds and aerosols. The mission will also probe phytoplankton biomass and zooplankton dynamics and provide observations of surface vegetation, ice, and snow. The mission is planned for launch early next decade and baselined to fly in an orbit that is compatible with NASA’s AOS-Sky mission. This formation flying configuration will enable synergistic retrievals between observations from CALIGOLA and the polarimeter and radar measurements planned for AOS-Sky and thus greatly enhance our ability to explore and characterize the intricate processes that govern the interactions between different components of the Earth system. The presentation will highlight CALIGOLA’s significant science objectives and describe the pioneering instrument that will enable us to achieve these objectives.

Chip Trepte↗

Parameterization of Vertical Cloud Distribution from C3M and MERRA Data Using ML Method

Clouds play a key role in regulating the hydrological cycle and the Earth's radiative energy budget. However, global climate models (GCMs) with a horizontal grid spacing on the order of 100 km have limitations in representing sub-grid cloud dynamics with spatial scales on the order of 1 km, leading to potential uncertainties in cloud radiative feedback on the global scale. In our research, we will leverage the capabilities of Deep Machine Learning (DML) methods to construct parameterizations of sub-grid volumetric cloud fraction (VCF), which is the frequency of occurrence on a grid volume accumulated in the horizontal and vertical directions. Our investigation delves into the intricate relationship between VCF obtained from the NASA CALIPSO-CloudSat-CERES-MODIS (CCCM) satellite observation data and 3-D MERRA-2 reanalysis meteorological profiling data (e.g., wind, relative humidity, temperature). Through a comprehensive one-year data training utilizing the Sequence to Sequence DML method, we have successfully disentangled the complicated cloud formation dynamics across diverse meteorological conditions through a day-to-day analysis framework. Preliminary findings reveal promising statistical agreements in geographical and vertical distributions and seasonal variations of volumetric cloud fraction between ML prediction and satellite measurements. These results underscore the aptitude of our DML model to discern underlying cloud physical processes and accurately represent sub-grid cloud formation dynamics. Additionally, we have also employed trained neural network to analyze uncertainties arising from errors in meteorological data, further enhancing the robustness of our VCF parameterization.

Shan Zeng↗

CALIGOLA: A New Multidisciplinary Spaceborne Lidar Mission (Cloud Aerosol Lidar for Global scale Observations of the ocean-Land-Atmosphere system)

Spaceborne lidars provide unique and valuable insight into the vertical structure of clouds and aerosols over the globe as well as insight into their microphysical and optical properties. Over the past two decades, lidar observations from CALIPSO, ICESAT-2 and CATS fundamentally advanced our understanding of the roles of clouds and aerosols play in weather, climate and air quality. The measurement records further served as important references for validating and improving retrieval algorithms of cloud/aerosol properties from operational weather satellites. A more recent development is the emerging awareness on how spaceborne lidar profile observations can also enhance knowledge of Earth’s coupled atmosphere-ocean-land system. Here we report on a new and powerful spaceborne lidar mission concept known as CALIGOLA (Cloud Aerosol Lidar for Global Scale Observations of the Ocean-Land Atmosphere System). The mission is multidisciplinary and will provide new insights into atmospheric processes with advance measurement capabilities beyond CALIPSO and the recently launched EarthCARE mission. CALIGOLA will further provide the first profiling of the world’s oceans to reveal unprecedented observations on the health and productivity of marine biology (phytoplankton and zooplankton) as well as provide unique observations of surface vegetation, ice, and snow. The mission will feature an innovative three-wavelength lidar, that will simultaneously acquire elastic backscatter, Raman, and fluorescence measurements, with polarization sensitivity on the elastic channels. The instrument is further designed with greater sensitivity than CALIOP and with vertical resolution on the order of a few meters near the surface. The mission is planned for launch early next decade and is baselined to fly in a polar orbit that is compatible with the previous A-Train constellation to extend the long-term measurement record. CALIGOLA is being developed through a partnership between Agenzia Spaziale Italiana (ASI) and National Aeronautics and Space Administration (NASA).

Lidar Aerosols Clouds Ocean Biology↗

PACE Microphysical Aerosol Properties from Polarimetry (PACE-MAPP)

We present the Plankton, Aerosols, Clouds and Ecosystems Microphysical Aerosol Properties from Polarimetry (PACE-MAPP) polarimetric remote sensing algorithm developed for the newly launched NASA PACE satellite observing system. The objective of PACE-MAPP is to retrieve detailed fine-mode (marine, pollution and smoke) and coarse-mode (sea-salt and dust) aerosol properties over the ocean for a range of light to heavy aerosol loadings using PACE’s polarimetric-imaging capabilities at multiple angles and wavelengths from the ultraviolet (UV) to the near-infrared (NIR). An additional objective for PACE-MAPP is to discriminate aerosols from thin clouds. The PACE-MAPP polarimetric remote sensing retrieval algorithm uses coupled atmosphere-ocean vector radiative transfer, optimal estimation, artificial intelligence and powerful inherent optical property look-up-tables for the Earth’s aerosol, cloud, and hydrosol particles. PACE-MAPP is the only retrieval algorithm designed to invert aerosol/ocean products using both polarimeters onboard PACE. We present results using PACE-MAPP to retrieve aerosol and ocean remote sensing products from measurements by the Hyper-Angular Rainbow Polarimeter #2 (HARP2) and Spectro-polarimeter for Planetary Exploration one (SPEXone) polarimeter instruments onboard PACE.

Snorre Stamnes↗

Fast Machine Learning Lidar Surrogate Simulator: Pristine Clear Sky

The simulations of lidar signals and retrievals rely on a range of optic-physical models, such as radiative transfer models, particle scattering and absorption models, along with the output data from atmospheric physical models. Integrating these different models to represent signals of a lidar system is computationally expensive, and performing backward retrievals can be complex and ambiguous. However, with the advantages of Machine Learning, there is a new potential for building effective lidar signal database linked to corresponding atmospheric profiles. For this project, we are developing a fast pre-trained neural network as the lidar surrogate simulator using simulated data for a CALIPSO-like lidar (355 nm, 532nm, and 1064nm), and a CO2 differential absorption lidar (DIAL) near 1571nm. Specifically, we utilize a long short-term memory (LSTM) model to map the relationships between atmospheric profiles (pressure, temperature, air density and CO2 mixing ratio) and lidar signals. This approach allows us to build machine learning based simulators that can reconstruct lidar signals at specific bands from MERRA reanalysis data, and perform retrievals of atmospheric profiles using lidar signals at various wavelengths. As a first step, the results show the potential of this method to establish a foundational model for sensor signals. This model offers the promise of enabling both accurate predictions and rapid retrievals, providing a more efficient approach to signal processing and analysis.

Shan Zeng↗

A Neural Network Parametrization of Volumetric Cloud Fraction Profiles Using Satellite Observations and MERRA-2 Reanalysis Meteorological Data

Clouds play a crucial role in regulating the hydrologic cycle and Earth's radiative energy budget, yet they are often poorly represented in global climate models (GCMs). This study applies deep machine learning techniques to develop a physical parameterization of volumetric cloud fraction (VCF), the fraction of a 3-D grid volume occupied by clouds using satellite lidar-radar measurements. The neural network (NN) captures the complicated relationships between observed VCF profiles and collocated meteorological variables from MERRA-2 reanalysis data. Our results show that the NN model, particularly a sequence-to-sequence long short-term memory (LSTM) network with a sixfactor loss function, effectively learns the underlying cloud physical processes. The NN model outperforms MERRA-2 reanalysis in representing low-level clouds in tropical and subtropical regions and low- and middle-level clouds over midlatitude storm-track regions, and also improves VCF histograms. These improvements are reflected in the vertical distributions of zonally, meridionally, and globally averaged VCFs, geographic distributions of low-, middle-, and high-level clouds, and seasonal variations in monthly-mean VCF. Furthermore, the NN predictions effectively capture the El Niño-Southern Oscillation (ENSO) effects and other interannual variations. The NN parameterization is further evaluated through a sensitivity analysis, in which a single predictor is perturbed at a time. This reveals that relative humidity (RH) is the dominant factor influencing variations in globally averaged VCF at low and middle altitudes, followed by temperature. At higher altitudes, temperature becomes the primary driver of VCF through its effect on RH. Changes in wind components had minimal impact on globally averaged VCF.

Shan Zeng↗