Results for “cloud type classification”

DOE OSTI2017

Cloud Type Classification (cldtype) Value-Added Product

The Cloud Type (cldtype) value-added product (VAP) provides an automated cloud type classification based on macrophysical quantities derived from vertically pointing lidar and radar. Up to 10 layers of clouds are classified into seven cloud types based on predetermined and site-specific thresholds of cloud top, base and thickness. Examples of thresholds for selected U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility sites are provided in Tables 1 and 2. Inputs for the cldtype VAP include lidar and radar cloud boundaries obtained from the Active Remotely Sensed Cloud Location (ARSCL) and Surface Meteorological Systems (MET) data. Rain rates from MET are used to determine when radar signal attenuation precludes accurate cloud detection. Temporal resolution and vertical resolution for cldtype are 1 minute and 30 m respectively and match the resolution of ARSCL. The cldtype classification is an initial step for further categorization of clouds. It was developed for use by the Shallow Cumulus VAP to identify potential periods of interest to the LASSO model and is intended to find clouds of interest for a variety of users.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Thunderstorm Cloud-Type Classification from Space-Based Lightning Imagers

The organization and structure of thunderstorms determines the extent and severity of their hazards to the general public and their consequences for the Earth system. Distinguishing vigorous convective regions that produce heavy rain and hail from adjacent regions of stratiform clouds or overhanging anvil clouds that produce light to no rainfall is valuable in operations and physical research. Cloud-type algorithms that partition convection from stratiform regions have been developed for space-based radar, passive microwave, and now Geostationary Operational Environmental Satellites (GOES) Advanced Baseline Imager (ABI) multispectral products. However, there are limitations for each of these products including temporal availability, spatial coverage, and the degree to which they based on cloud microphysics. We report we have developed a cloud-type algorithm for GOES Geostationary Lightning Mapper (GLM) observations that identifies convective/nonconvective regions in thunderstorms based on signatures of interactions with nonconvective charge structures in the lightning flash data. The GLM sensor permits a rapid (20 s) update cycle over the combined GOES-16–GOES-17 domain across all hours of the day. Storm regions that do not produce lightning will not be classified by our algorithm, however. The GLM cloud-type product is intended to provide situational awareness of electrified nonconvective clouds and to complement other cloud-type retrievals by providing a contemporary assessment tied to lightning physics. We propose that a future combined ABI–GLM cloud-type algorithm would be a valuable product that could draw from the strengths of each instrument and approach.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2018

Merged RWP-WACR-ARSCL Cloud Mask and Cloud Type

The Merged RWP-WACR-ARSCL Cloud Mask and Cloud Type PI Data Product combines the RWP calibrated radar reflectivity data with the WACR-ARSCL dataset to improve cloud mask in precipitating clouds and to provide cloud-type profile classification. WACR-ARSCL cloud profiles during substantial precipitation period where severe attenuation affects accuracy of WACR cloud-top detections were replaced with RWP profiles. The merged RWP-WACR-ARSCL cloud mask is then used to produce cloud-type profile classification. The cloud-type classification includes a total of seven cloud types: shallow cumulus, congestus, deep convective clouds, altocumulus, altostratus, cirrostratus and cirrus. See the data description for more details about the dataset.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Peak Rain Rate Sensitivity to Observed Cloud Condensation Nuclei and Turbulence in Continental Warm Shallow Clouds During CACTI

Abstract Warm clouds strongly affect Earth's energy budget but remain imperfectly represented in climate models, partly due to the complexity and covariability of relevant processes influencing warm rain. This work presents a detailed analysis of different factors affecting rain rate peak intensity (RR) in continental warm clouds. Clouds were identified with vertically pointing radar and lidar observations and categorized via a temperature‐based cloud type classification algorithm from which warm clouds were isolated. Observations and retrievals of liquid water path (LWP), cloud condensation nuclei concentration (N CCN ), cloud depth, and cloud duration of more than 3,000 separate warm clouds sampled during the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign are analyzed in this work. Multiple linear regression (MLR) and random forest (RF) models are applied to assess the relative impact of these variables on RR. Overall, RR tends to increase as cloud depth, LWP, and cloud duration increase, or N CCN decreases. Cloud depth affects RR the most while N CCN impacts it the least. When considering over 170 warm clouds observed at least 1 hr in which in‐cloud turbulence is retrieved, the effect of N CCN on RR remains most likely suppressive, but it is not significant at a 75% level for MLR and is highly uncertain for RF. The impact of in‐cloud turbulence depends on the moment and location it is sampled. Cloud base turbulence around the time of RR suppresses RR, while cloud top turbulence effects are inconclusive. Possible difficulties in isolating robust CCN and turbulence effects on RR are discussed.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Warm boundary-layer cloud properties and cloud susceptibilities product at the ARM ENA observatory

Cloud liquid water path, albedo, and cloud fraction susceptibilities for marine warm boundary-layer clouds are quantified using the Meteosat retrieved cloud microphysical properties at the ARM Eastern North Atlantic (ENA) observatory in the Azores. The Meteosat cloud retrievals are based on the methods applied by the Clouds and the Earth’s Radiant Energy System (CERES) project, which are specifically tailored to support the ARM user facility over the ARM ground-based observation sites (enavisstpx2dm11minnisX1.c1). Cloud susceptibility is quantified as the slope between cloud properties and Nd within a 1-degree-by-1-degree grid box at each satellite time step using a least-square regression. To reduce uncertainties associated with the adiabatic assumption in the Nd retrieval, for each cloud object, we exclude cloudy pixels at the cloud edge, defined as those adjacent to cloud-free pixels. To minimize influence of cloud heterogeneity and co-variability on the retrieved cloud susceptibility, cloud properties are averaged to 0.25-degree resolution using the 3-km pixel-level retrieval, and the 1-degree cloud susceptibilities are estimated using the smoothed data. Cloud type classification is applied to distinct cloud object, labeling all contiguous cloudy pixels. Marine warm boundary-layer clouds are defined as clouds with 90% of cloud tops below 3km, and Meteosat retrieved cloud phase as liquid.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Development of a Random-Forest Cloud-Regime Classification Model Based on Surface Radiation and Cloud Products

Various methods have been developed to characterize cloud type, otherwise referred to as cloud regime. These include manual sky observations, combining radiative and cloud vertical properties observed from satellite, surface-based remote sensing, and digital processing of sky imagers. While each method has inherent advantages and disadvantages, none of these cloud-typing methods actually includes measurements of surface shortwave or longwave radiative fluxes. Here, a method that relies upon detailed, surface-based radiation and cloud measurements and derived data products to train a random-forest machine-learning cloud classification model is introduced. Measurements from five years of data from the ARM Southern Great Plains site were compiled to train and independently evaluate the model classification performance. A cloud-type accuracy of approximately 80% using the random-forest classifier reveals that the model is well suited to predict climatological cloud properties. Furthermore, an analysis of the cloud-type misclassifications is performed. While physical cloud types may be misreported, the shortwave radiative signatures are similar between misclassified cloud types. From this, we assert that the cloud-regime model has the capacity to successfully differentiate clouds with comparable cloud–radiative interactions. Therefore, we conclude that the model can provide useful cloud-property information for fundamental cloud studies, inform renewable energy studies, and be a tool for numerical model evaluation and parameterization improvement, among many other applications.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Macro-physical Properties of Shallow Cumulus from Integrated ARM Observations (Final Report)

Fair-weather shallow cumuli (ShCu) play an important role in many climate-related processes. Irregular geometry of ShCu and their strong temporal and spatial variability make it challenging to observe ShCu holistically and to represent them correctly in climate models. To improve ShCu parameterizations, information on both vertically and horizontally resolved cloud properties is required. Commonly, the vertically resolved cloud properties are provided by zenith pointing lidar-radar observations with a very narrow field of view (FOV). Thus, these “pencil-beam” properties may not be representative of a larger surrounding area. Limited number of areal-averaged cloud properties, such as fractional sky cover (FSC), are offered typically by wide-FOV observations. The main goal of our project was to integrate advantages of the narrow-FOV (vertical structure of clouds) and wide-FOV (spatial arrangement of clouds) observations for an improved characterization of single-layer ShCu observed at the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site for an 18-yr period (2000-2017). There are four major accomplishments of our project, First, an updated operational cloud classification for days with ShCu has been suggested and evaluated through a detailed comparison with the manually curated records. Our classification extends successfully the latest ARM cloud type Value Added Product (VAP) based on the Active Remote Sensing of Clouds (ARSCL) cloud product by incorporating both cloud fraction (CF) provided by narrow-FOV ceilometer data and FSC from wide-FOV images offered by a Total Sky Imager (TSI). Moreover, our classification allows one to identify impact of instrumentation changes at the SGP site, namely the transition to KAZRARSCL with the updated cloud radar, on the identification of periods with single-layer ShCu. Second, a new approach that resolves cloud area distributions for a given region (up to 4x4 km 2 ) has been suggested and cloud equivalent diameters (CEDs) have been estimated for the first time. These estimations have been performed over a wide range of cloud sizes (about 0.01–3.5 km) with high temporal resolution (30s) using wide-FOV TSI images and cloud base height (CBH) provided by complementary narrow-FOV lidar measurements. Our simple and computationally inexpensive approach offers a previously unavailable dataset for process studies in the convective boundary layer and evaluation of ShCu parameterizations in cloud-resolving models. Third, a long-term integrated record of ShCu macrophysical properties has been developed. The developed record represents the longest available compilation of events with ShCu and includes (i) a novel visualization of the spatial variability in cloud cover both along- and across-wind directions, (ii) updated estimates of narrow-FOV CF and wide-FOV FSC, (iii) updated narrow-FOV CBH, and (iv) complementary data, such as wind speed and direction from the 915-MHz Radar Wind Profiler (RWP) data. The developed record has been used successfully to assess conventional observational estimates of cloud cover and their sensitivity to the following two factors: (i) instrument-dependent cloud detection and data merging criteria and (ii) FOV configuration. Fourth, co-variability of the ShCu macrophysical properties and environmental parameters has been analyzed for a 3-yr period (2016-2018). Our initial analysis includes diurnal changes of FSCs obtained for clouds with small, moderate and large CEDs and several environmental parameters, such as lifted condensation level (LCL) and mixed layer height (zi). Preliminary results of our analysis suggest that the horizontal extent of ShCu is controlled substantially by the sign and magnitude of difference between these two parameters (zi-LCL): the CED tends to grow with increase of this difference (zi exceeds LCL). We have initiated relationships between the ShCu and key atmospheric parameters that control both the development and evolution of ShCu using our new data product, which combines effectively the advantages of narrow-FOV data offered by zenith pointing cloud radars and lidars and wide-FOV TSI images. While the latest instrumentation at the ARM sites may address these challenging relationships in the future, we believe that the historical ARM data at the SGP site has not yet been fully utilized. Overall, our data product can be used by researchers working on a wide range of climate-related projects. These projects may include (i) a comprehensive evaluation of outputs from the Large-Eddy Simulation (LES) and single-column models for their future improvement, (ii) the representativeness of “short-period” results obtained from the previous model and observational studies and (iii) the planning of future field campaigns with focus on improved understanding of the diurnal cycle of cumulus convection.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Vertically Resolved Convective–Stratiform Echo-Type Identification and Convectivity Retrieval for Vertically Pointing Radars

Using data from the airborne HIAPER Cloud Radar (HCR), a partitioning algorithm (ECCO-V) that provides vertically resolved convectivity and convective versus stratiform radar-echo classification is developed for vertically pointing radars. The algorithm is based on the calculation of reflectivity and radial velocity texture fields that measure the horizontal homogeneity of cloud and precipitation features. The texture fields are translated into convectivity, a numerical measure of the convective or stratiform nature of each data point. The convective–stratiform classification is obtained by thresholding the convectivity field. Subcategories of low, mid-, and high stratiform, shallow, mid-, deep, and elevated convective, and mixed echoes are introduced, which are based on the melting-layer and divergence-level altitudes. As the algorithm provides vertically resolved classifications, it is capable of identifying different types of vertically layered echoes, and convective features that are embedded in stratiform cloud layers. Its robustness was tested on data from four HCR field campaigns that took place in different meteorological and climatological regimes. The algorithm was adapted for use in spaceborne and ground-based radars, proving its versatility, as it is adaptable not only to different radar types and wavelengths, but also different research applications.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Self-Supervised Cloud Classification

Abstract Low-level marine clouds play a pivotal role in Earth’s weather and climate through their interactions with radiation, heat and moisture transport, and the hydrological cycle. These interactions depend on a range of dynamical and microphysical processes that result in a broad diversity of cloud types and spatial structures, and a comprehensive understanding of cloud morphology is critical for continued improvement of our atmospheric modeling and prediction capabilities moving forward. Deep learning has recently accelerated our ability to study clouds using satellite remote sensing, and machine learning classifiers have enabled detailed studies of cloud morphology. A major limitation of deep learning approaches to this problem, however, is the large number of hand-labeled samples that are required for training. This work applies a recently developed self-supervised learning scheme to train a deep convolutional neural network (CNN) to map marine cloud imagery to vector embeddings that capture information about mesoscale cloud morphology and can be used for satellite image classification. The model is evaluated against existing cloud classification datasets and several use cases are demonstrated, including training cloud classifiers with very few labeled samples, interrogation of the CNN’s learned internal feature representations, cross-instrument application, and resilience against sensor calibration drift and changing scene brightness. The self-supervised approach learns meaningful internal representations of cloud structures and achieves comparable classification accuracy to supervised deep learning methods without the expense of creating large hand-annotated training datasets. Significance Statement Marine clouds heavily influence Earth’s weather and climate, and improved understanding of marine clouds is required to improve our atmospheric modeling capabilities and physical understanding of the atmosphere. Recently, deep learning has emerged as a powerful research tool that can be used to identify and study specific marine cloud types in the vast number of images collected by Earth-observing satellites. While powerful, these approaches require hand-labeling of training data, which is prohibitively time intensive. This study evaluates a recently developed self-supervised deep learning method that does not require human-labeled training data for processing images of clouds. We show that the trained algorithm performs competitively with algorithms trained on hand-labeled data for image classification tasks. We also discuss potential downstream uses and demonstrate some exciting features of the approach including application to multiple satellite instruments, resilience against changing image brightness, and its learned internal representations of cloud types. The self-supervised technique removes one of the major hurdles for applying deep learning to very large atmospheric datasets.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2019

Combining disdrometer, microscopic photography, and cloud radar to study distributions of hydrometeor types, size and fall velocity

Addressing solid precipitation poses additional challenges compared to warm rain due to complex hydrometeor shapes involved, including the dependence of fall velocity on hydrometeor sizes, hydrometeor size distributions, and hydrometeor classification. This study is an extension of our previous work (Niu et al., 2010) to address these challenges by combining measurements from a PARSIVEL disdrometer, microscope photography, and millimeter wavelength cloud radar. The combined measurements are analyzed to classify the precipitation hydrometeor types, examine the dependence of fall velocity on hydrometeor sizes for different hydrometeor types, and determine the best distributions to describe the hydrometeor size distributions of different hydrometeor types. The results show: (1) Hydrometeors can be classified to four main types of raindrop, graupel, snowflake and mixed-phase according to the dependence of terminal velocity on particle sizes, corresponding microscope photos and cloud radar observations; (2) There are significant scatters in fall velocity for a given hydrometer size velocities, and the fall velocity spread for the solid hydrometeors appear wider than that for raindrops across hydrometeor sizes, with that for the mixed-phase precipitation being largest, suggesting that the effects of hydrometeor shape on hydrometeor fall velocities; (3) Hydrometeor size distributions for the four types can all be well described by the Gamma or Weibull distribution; Weibull (Gamma) distribution performs better when skewness is less (larger) than 2.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

BFSVBF (BatFinder Smart Video BioFilter) [SWR-22-87] and Multi-class BatFinder Smart Video BioFilter Keras

Bats are notoriously difficult to study, therefore, identifying specific behavioral trends and the precise environmental conditions at the time of collision requires a monitoring solution that can reliably collect relevant data. To date, thermal infrared video surveillance has been extensively applied to study bats and has proven to be a powerful yet cumbersome tool. Current analytical approaches are time consuming because data processing data has not been fully automated. In the past, steps have been taken to record avian and bat activity in conjunction with complicated image processing techniques that separate species from other moving objects within the field of view (i.e. clouds and portions of the wind turbine). Once the videos are collected, the post-processing does not allow real time monitoring and identification, leading to a delay in both studying the behavior of these species and determining the effectiveness of any impact reduction strategy being studied. Moreover, object identification capability is lacking, thus limiting the usefulness of video data. To resolve these issues, we are using open source computer vision and machine learning techniques allowing for automatic detection of objects in real-time with the ability to correlate these objects with environmental variables and recording the flight paths of each object. The code has gone through five rounds of development with images used to train the models. This advancement allows for automated real-time data collection, identification, and tracking, thereby eliminating the need for long and tedious post-analysis processing of the videos. We will discuss the two open source and publicly available machine learning models developed within this scope of this work: 1) a binary model with a 97.5% accuracy in identifying the difference between an object and an empty scene, including wind turbine and clouds; and 2) a multiple classification model with the capability of identifying the type of object detected: bats (90% accuracy), birds (83% accuracy), insects (69% accuracy) and non-biological (99% accuracy).

Yarbrough, John↗

DOE OSTI2025

Synoptic Weather Regime Classifications for June, July, August, and September, 2022

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A). This dataset includes the data in June, July, August, and September; the last year of the data is 2022.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Synoptic Weather Regime Classifications for the whole year, from 2014 to 2015

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Synoptic Weather Regime Classifications for June, July, August, from 2000 to 2024

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

node_som_ml↗

DOE OSTI2025

Synoptic Weather Regime Classifications for March, April and May, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

node_som_ml↗

DOE OSTI2025

Synoptic Weather Regime Classifications for June, July and August, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

node_som_ml↗

DOE OSTI2025

Synoptic Weather Regime Classifications for December, January and February, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

{node_som_ml,synop_wea_reg}↗

DOE OSTI2025

Synoptic Weather Regime Classifications for September, October and November, from 2000 to 2025

The synoptic weather regime classification has become a highly demanded product for the ARM site in recent years. This type of regime classification has shown applications in various studies and topics, including aerosol-cloud interactions, land-atmosphere interactions, and cloud radiative effects. The VAP employs an unsupervised machine learning method, Self-organizing map (SOM), to classify weather regimes for each day of the AMF campaigns and fixed sites, using ERA5 data. This idea is mainly based on our published study for TRACER in Wang et al. (2022, JGR-A).

node_som_ml↗