Engineering PapersSearch

SEARCH · Engineering Papers

Results for “cloud type detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Deep Domain Adaptation based Cloud Type Detection using Active and Passive Satellite Data

Domain adaptation techniques have been developed to handle data from multiple sources or domains. Most existing domain adaptation models assume that source and target domains are homogeneous, i.e., they have the same feature space. Nevertheless, many real world applications often deal with data from heterogeneous domains that come from completely different feature spaces. In our remote sensing application, data in source domain (from an active spaceborne Lidar sensor CALIOP onboard CALIPSO satellite) contain 25 attributes, while data in target domain (from a passive spectroradiometer sensor VIIRS onboard Suomi-NPP satellite) contain 20 different attributes. CALIOP has better representation capability and sensitivity to aerosol types and cloud phase, while VIIRS has wide swaths and better spatial coverage but has inherent weakness in differentiating atmospheric objects on different vertical levels. To address this mismatch of features across the domains/sensors, we propose a novel end-to-end deep domain adaptation with domain mapping and correlation alignment (DAMA) to align the heterogeneous source and target domains in active and passive satellite remote sensing data. It can learn domain invariant representation from source and target domains by transferring knowledge across these domains, and achieve additional performance improvement by incorporating weak label information into the model (DAMA-WL). Our experiments on a collocated CALIOP and VIIRS dataset show that DAMA and DAMA-WL can achieve higher classification accuracy in predicting cloud types.

domain adaptation

Evaluating Retrieval Algorithm Climate Stability: Estimating 3D Optical Thickness Bias Distributions by Cloud Type

Detecting climate trends on large spatiotemporal scales requires accurate, stable measurements and stable retrieval algorithms. We strive to estimate how time-variant retrieval algorithm biases may impact trend detection. Here we focus on the 3D cloud optical thickness (τc) bias, which is among the largest in passive cloud retrieval algorithms. If this bias is time dependent, a possibility with potential decadal changes in cloud morphology, it may obscure genuine trends in τc. Although previous studies have evaluated the cloud- and sun-view geometry-dependent 3D τc bias on small spatial scales, before our current study none have evaluated the stability of this well-known bias on climate-relevant large spatiotemporal scales. These studies must estimate large scale distributions of the 3D τc bias by cloud type and estimate how cloud type amount may change between two climate states. We employ a novel approach to estimate large scale distributions of 3D τc using a proxy of the bias that quantifies the departure of clouds from satisfying the 1D radiative transfer assumption used in passive τc retrievals. This existing globally-distributed proxy is an angular consistency metric that was developed using fused Moderate-Resolution Imaging Spectroradiometer (MODIS) and Multi-angle Imaging Spectroradiometer (MISR) measurements. Calculating the 3D τc bias and the proxy, for known cloud fields enables us to establish statistical relationships between these two quantities, which can be used to calculate large-scale distributions of the 3D τc bias. This approach limits the number of 3D radiative transfer simulations required to only those needed to estimate a statistical relationship between the 3D τc bias for known cloud fields and a proxy of the bias. It is likely that future studies will be needed to evaluate retrieval algorithm bias stability for other geophysical variables as the community develops climate data records from satellite observations and their retrievals. This must be done in addition to monitoring and correcting measurement errors and uncertainties and understanding their impact on retrieved essential climate variables.

Yolanda Shea

Virtual Sensors: Using Data Mining to Efficiently Estimate Spectra

Detecting clouds within a satellite image is essential for retrieving surface geophysical parameters, such as albedo and temperature, from optical and thermal imagery because the retrieval methods tend to be valid for clear skies only. Thus, routine satellite data processing requires reliable automated cloud detection algorithms that are applicable to many surface types. Unfortunately, cloud detection over snow and ice is difficult due to the lack of spectral contrast between clouds and snow. Snow and clouds are both highly reflective in the visible wavelen,ats and often show little contrast in the thermal Infrared. However, at 1.6 microns, the spectral signatures of snow and clouds differ enough to allow improved snow/ice/cloud discrimination. The recent Terra and Aqua Moderate Resolution Imaging Spectro-Radiometer (MODIS) sensors have a channel (channel 6) at 1.6 microns. Presently the most comprehensive, long-term information on surface albedo and temperature over snow- and ice-covered surfaces comes from the Advanced Very High Resolution Radiometer ( AVHRR) sensor that has been providing imagery since July 1981. The earlier AVHRR sensors (e.g. AVHRR/2) did not however have a channel designed for discriminating clouds from snow, such as the 1.6 micron channel available on the more recent AVHRR/3 or the MODIS sensors. In the absence of the 1.6 micron channel, the AVHRR Polar Pathfinder (APP) product performs cloud detection using a combination of time-series analysis and multispectral threshold tests based on the satellite's measuring channels to produce a cloud mask. The method has been found to work reasonably well over sea ice, but not so well over the ice sheets. Thus, improving the cloud mask in the APP dataset would be extremely helpful toward increasing the accuracy of the albedo and temperature retrievals, as well as extending the time-series of albedo and temperature retrievals from the more recent sensors to the historical ones. In this work, we use data mining methods to construct a model of MODIS channel 6 as a function of other channels that are common to both MODIS and AVHRR. The idea is to use the model to generate the equivalent of MODIS channel 6 for AVHRR as a function of the AVHRR equivalents to MODIS channels. We call this a Virtual Sensor because it predicts unmeasured spectra. The goal is to use this virtual channel 6. to yield a cloud mask superior to what is currently used in APP . Our results show that several data mining methods such as multilayer perceptrons (MLPs), ensemble methods (e.g., bagging), and kernel methods (e.g., support vector machines) generate channel 6 for unseen MODIS images with high accuracy. Because the true channel 6 is not available for AVHRR images, we qualitatively assess the virtual channel 6 for several AVHRR images.

Srivastava, Ashok

A Bispectral Composite Threshold Approach for Automatic Cloud Detection in VIIRS Imagery

The detection of clouds in satellite imagery has a number of important applications in weather and climate studies. The presence of clouds can alter the energy budget of the Earth‐atmosphere system through scattering and absorption of shortwave radiation and the absorption and re‐emission of infrared radiation at longer wavelengths. The scattering and absorption characteristics of clouds vary with the microphysical properties of clouds, hence the cloud type. Thus, detecting the presence of clouds over a region in satellite imagery is important in order to derive atmospheric or surface parameters that give insight into weather and climate processes. For many applications however, clouds are a contaminant whose presence interferes with retrieving atmosphere or surface information. In these cases, is important to isolate cloud‐free pixels, used to retrieve atmospheric thermodynamic information or surface geophysical parameters, from cloudy ones. This abstract describes an application of a two‐channel bispectral composite threshold (BCT) approach applied to VIIRS imagery. The simplified BCT approach uses only the 10.76 and 3.75 micrometer spectral channels from VIIRS in two spectral tests; a straight‐forward infrared threshold test with the longwave channel and a shortwave - longwave channel difference test. The key to the success of this approach as demonstrated in past applications to GOES and MODIS data is the generation of temporally and spatially dependent thresholds used in the tests from a previous number of days at similar observations to the current data. The paper and subsequent presentation will present an overview of the approach and intercomparison results with other satellites, methods, and against verification data.

LaFontaine Frank J.

Identification of basic cloud types from ERTS imagery

The author has identified the following significant results. It was found that seven basic cloud types could be detected from ERTS-1 imagery. Each type exhibited characteristics that made them distinct. Suitable examples of each type were chosen, described, and a cloud identification item-index key prepared.

Morain, S. A.

Atmospheric, climatic and environmental research

Research conducted during the past year in the climate and atmospheric modeling programs was focused on the development of appropriate atmospheric and upper ocean models, and preliminary applications of these models. Prinicpal models are a one-dimensional radiative-convection model, a three-dimensional global climate model, and an upper ocean model. Principal application is the study of the impact of CO2, aerosols and the solar constant on climate. Also the performance of the International Satellite Cloud Climatology Project cloud detection algorithm was evaluated, concentrating initially on its application to geosynchronous data, with an eventual switch of the developed methodologies to data from polar orbiting satellites. In the process, a number of improvements were made, in particular: an improved technique for tracking small scale day to day variability in clear sky continental temperatures; a number of techniques for the statistical assessment of cloud detection uncertainties due to cloud types which are spatially and temporally invariant; and a method used to detect those cloudy regions which have long term spatial and temporal stability.

Broecker, W. S.

ERBE data inversion

Instruments on board the (presently two) satellites of the Earth Radiation Budget Experiment (ERBE) are collecting data for determining monthly averaged radiation exitances at the top of the atmosphere (TOA). To achieve the accuracy desired of the mission, radiances at the satellite are first calculated, with allowance made of sensor optical properties and the directionality of the TOA radiation field. The subsatellite surface type is classified to adjust for albedo changes and correction values are added for the types of cloud cover detected.

Smith, G. L.

Nighttime Cirrus Detection using Atmospheric Infrared Sounder Window Channels and Total Column Water Vapor

A method of cirrus detection at nighttime is presented that utilizes 3.8 and 10.4 (micro)m infrared (IR) window brightness temperature differences (dBT) and total column precipitable water (PW) measurements. This technique is applied to the Atmospheric Infrared Sounder (AIRS) and Advanced Microwave Sounding Unit A (AMSU-A) instrument suite on board EOS-Aqua, where dBT is determined from sets of carefully selected AIRS window channels, while PW is derived from the synergistic AIRS and AMSU-A water vapor retrievals. Simulated and observed dBT for a particular value of PW are not constant; several physical factors impact dBT, including the variability in temperature and relative humidity profiles, surface emissivity, instrument noise, and skin/ near-surface air temperature differences. We simulate clear-sky dBT over a realistic range of PWs using 8350 radiosondes that have varying temperature and relative humidity profiles. Thresholds between cloudy and uncertain sky conditions are derived once the scatter in the clear-sky dBT is determined. Simulations of optically thin cirrus indicate that this technique is most sensitive to cirrus optical depth in the 10 (micro)m window of 0.1-0.15 or greater over the tropical and subtropical oceans, where surface emissivity and skin/near-surface air temperature impacts on the IR radiances are minimal. The method at present is generally valid over oceanic regions only, specifically, the tropics and subtropics. The detection of thin cirrus, and other cloud types, is validated using observations at the Atmospheric Radiation Measurement (ARM) program site located at Manus Island in the tropical western Pacific for 89 coincident EOS-Aqua overpasses. Even though the emphasis of this work is on the detection of thin cirrus at nighttime, this technique is sensitive to a broad cloud morphology. The cloud detection technique agrees with ARM-detected clouds 82-84% of the time, which include thin cirrus, as well as other cloud types. Most of the disagreements are well explained by AIRS footprint-scale heterogeneity compared to ARM point measurements, cirrus overlying lower-layer water clouds, possible mixed phase microphysics in midlevel clouds, and significant IR channel noise for cold BT scenes over deep convective towers.

Atmospheric Radiation Measurement (RAM)

Development and Analysis of a Thick Cloud Layers Database for Lightning Launch Commit Criteria Improvement

Lightning can pose a potential threat to space launch vehicles. In response to this, rules were created called the Lightning Launch Commit Criteria (LLCC) that help weather personnel evaluate the potential for natural and rocket-triggered lightning. One of the ten LLCC with the least research is called the Thick Cloud Layers rule. To further understand electrification of thick cloud layers and potentially improve the Thick Cloud Layers rule, a database of thick cloud layers that occurred over the Eastern Range was created. This database is then used to create an algorithm for identifying and differentiating thick cloud layers from other cloud types based on radar characteristics, temperature levels in reference to cloud height, and the surface electric field. By analyzing and identifying thick cloud events, this project could help narrow down when thick clouds are occurring and potentially minimize unnecessary launch delays. Events that caused LLCC violations involving the Thick Cloud Layers rule were analyzed by hand using Level-2 NEXRAD radar data from the National Weather Service WSR-88D radar in Melbourne with the program GR2Analyst. Cases that were found to be isolated and not involved with convection were recorded (date, start/end time, location) in a database. Radar data associated with these cases was collected and gridded using Python radar packages. Once gridded, I calculated and recorded for each radar scan the following radar reflectivity driven parameters within an 11x11 km bin centered on each 1 square km grid point: the mean reflectivity colder than 0 degrees Celsius, Maximum Radar Reflectivity (MRR) colder than 0 degrees Celsius, Volume Averaged Height Integrated Radar Reflectivity (VAHIRR), Hydrometeor Identification (HID), the difference between the maximum and mean reflectivity, the cloud depth colder than 0 degrees Celsius, the overall cloud depth, the cloud top, and the cloud bottom. Soundings for each event were used to determine cloud temperature levels, and where the cloud is in relation to the freezing level. Electric field mill data collected over the Eastern Range was used to determine surface electric fields below each cloud. All parameters were analyzed in depth for several thick cloud cases to gain an understanding of typical thick cloud characteristics. Cases of thick clouds and other isolated cloud types were also recorded for training purposes to see if enough differences exist between cloud types to differentiate them with an algorithm. Each case along with its corresponding characteristics was recorded in a database, and this database was used to compare differing cloud types, as well as train the algorithm to detect thick clouds.

Lightning

Cloud particle effects on laminar flow in the NASA LEFT program - Preliminary results

Laminar flow offers the promise of significant fuel savings on future commercial transport aircraft, but laminar flow can be lost while encountering clouds or haze at cruise conditions. To quantify the effect of cloud particles on laminar flow during typical airline operating conditions, and evaluate candidate cloud particle detection instrument concepts for future laminar flow aircraft, two types of cloud particle detectors are being flown aboard a NASA JetStar aircraft in the Leading Edge Flight Test (LEFT) program. The instrumentation is described, and preliminary results and conclusions are presented.

Davis, R. E.

Participation in the Mars Orbiting Laser Altimeter Experiment

This NASA Grant, 5-4434, has covered the active participation of the Principal Investigator, Prof. Gordon Pettengill, and his Co-Investigator, Peter Ford, in the Mars Orbiting Laser Altimeter (MOLA) Experiment, over a period of five years. This participation has included attending team meetings, planning observing operations, developing data-reduction software algorithms, and processing data, as well as presenting a number of oral reports at scientific meetings and published papers in refereed journals. This research has concentrated on the various types of Martian clouds that were detected by the laser altimeter.

Pettengill, Gordon H.

CATS Version 2 Aerosol Feature Detection and Applications for Data Assimilation

The Cloud Aerosol Transport System (CATS) lidar has been operating onboard the International Space Station (ISS) since February 2015 and provides vertical observations of clouds and aerosols using total attenuated backscatter and depolarization measurements. From February March 2015, CATS operated in Mode 1, providing backscatter and depolarization measurements at 532 and 1064 nm. CATS began operation in Mode 2 in March 2015, providing backscatter and depolarization measurements at 1064 nm and has continued to operate to the present in this mode. CATS level 2 products are derived from these measurements, including feature detection, cloud aerosol discrimination, cloud and aerosol typing, and optical properties of cloud and aerosol layers. Here, we present changes to our level 2 algorithms, which were aimed at reducing several biases in our version 1 level 2 data products. These changes will be incorporated into our upcoming version 2 level 2 data release in summer 2017. Additionally, owing to the near real time (NRT) data downlinking capabilities of the ISS, CATS provides expedited NRT data products within 6 hours of observation time. This capability provides a unique opportunity for supporting field campaigns and for developing data assimilation techniques to improve simulated cloud and aerosol vertical distributions in models. We additionally present preliminary work toward assimilating CATS observations into the NASA Goddard Earth Observing System version 5 (GEOS-5) global atmospheric model and data assimilation system.

data assimilation

The EOS CERES Global Cloud Mask

To detect long-term climate trends, it is essential to produce long-term and consistent data sets from a variety of different satellite platforms. With current global cloud climatology data sets, such as the International Satellite Cloud Climatology Experiment (ISCCP) or CLAVR (Clouds from Advanced Very High Resolution Radiometer), one of the first processing steps is to determine whether an imager pixel is obstructed between the satellite and the surface, i.e., determine a cloud 'mask.' A cloud mask is essential to studies monitoring changes over ocean, land, or snow-covered surfaces. As part of the Earth Observing System (EOS) program, a series of platforms will be flown beginning in 1997 with the Tropical Rainfall Measurement Mission (TRMM) and subsequently the EOS-AM and EOS-PM platforms in following years. The cloud imager on TRMM is the Visible/Infrared Sensor (VIRS), while the Moderate Resolution Imaging Spectroradiometer (MODIS) is the imager on the EOS platforms. To be useful for long term studies, a cloud masking algorithm should produce consistent results between existing (AVHRR) data, and future VIRS and MODIS data. The present work outlines both existing and proposed approaches to detecting cloud using multispectral narrowband radiance data. Clouds generally are characterized by higher albedos and lower temperatures than the underlying surface. However, there are numerous conditions when this characterization is inappropriate, most notably over snow and ice of the cloud types, cirrus, stratocumulus and cumulus are the most difficult to detect. Other problems arise when analyzing data from sun-glint areas over oceans or lakes over deserts or over regions containing numerous fires and smoke. The cloud mask effort builds upon operational experience of several groups that will now be discussed.

Berendes, T. A.

A Machine Learning-Based Cloud Detection and Thermodynamic Phase Classification Algorithm using Passive Spectral Observations

We trained two Random Forest (RF) machine-learning models for cloud mask and cloud thermodynamic phase detection using spectral observations from VIIRS on Suomi NPP (SNPP). Observations from CALIOP were carefully selected to provide reference labels. The two RF models were trained for all-day and daytime-only conditions using a 4-year collocated VIIRS/CALIOP dataset from 2013 to 2016. Due to the orbit difference, the collocated CALIOP and SNPP VIIRS training samples cover a broad viewing zenith angle range, which is a great benefit to overall model performance. The all-day model uses 3 VIIRS infrared (IR) bands (8.6,11, and 12 μm) and the daytime model uses 5 Near-IR (NIR) and Shortwave-IR (SWIR) bands (0.86, 1.24, 1.38, 1.64 and 2.25 μm) together with the 3 IR bands to detect clear, liquid water, and ice cloud pixels. Up to 7 surface types, namely, ocean/water, forest, cropland, grassland, snow/ice, barren/desert, and shrubland, were considered separately to enhance performance for both models. Detection of cloudy pixels and thermodynamic phase with the two RF models were compared against collocated CALIOP products from 2017. It is shown that, with a conservative screening process that excludes the most challenging cloudy pixels for passive remote sensing, the two RF models have high accuracy rates in comparison with the CALIOP reference for both cloud detection and thermodynamic phase. Other existing SNPP VIIRS and Aqua MODIS cloud mask and phase products are also evaluated, with results showing that the two RF models and the MODIS MYD06 optical property phase product are the top 3 algorithms with respect to lidar observations during the daytime. During the nighttime, the RF all-day model works best for both cloud detection and phase, in particular for pixels over snow/ice surfaces. The present RF models can be extended to other similar passive instruments if training samples can be collected from CALIOP or other lidars. However, the quality of reference labels and potential sampling issues that may impact model performance would need further attention.

cloud detection

Spaceborne Radar Would Measure Rain And Clouds

Report describes conceptual design of spaceborne radar system mapping precipitation and clouds at mid-latitudes to provide data for research on global weather and climate. Radar operates at two frequencies. Lower (35 GHz) provides vertical profiles of rainfall at rates up to 20 mm/h and enables probing of cirrus clouds. Higher (94 GHz) enables detection and quantitative measurements of clouds of all types and provides rain profiles at rates up to 10 mm/h.

Im, Eastwood

OTD Observations of Continental US Ground and Cloud Flashes

Lightning optical flash parameters (e.g., radiance, area, duration, number of optical groups, and number of optical events) derived from almost five years of Optical Transient Detector (OTD) data are analyzed. Hundreds of thousands of OTD flashes occurring over the continental US are categorized according to flash type (ground or cloud flash) using US National Lightning Detection Network TM (NLDN) data. The statistics of the optical characteristics of the ground and cloud flashes are inter-compared on an overall basis, and as a function of ground flash polarity. A standard two-distribution hypothesis test is used to inter-compare the population means of a given lightning parameter for the two flash types. Given the differences in the statistics of the optical characteristics, it is suggested that statistical analyses (e.g., Bayesian Inference) of the space-based optical measurements might make it possible to successfully discriminate ground and cloud flashes a reasonable percentage of the time.

Koshak, William

Differences in the Optical Characteristics of Continental US Ground and Cloud Flashes as Observed from Space

Continental US lightning flashes observed by the Optical Transient Detector (OTD) are categorized according to flash type (ground or cloud flash) using US National Lightning Detection Network (TM) (NLDN) data. The statistics of the ground and cloud flash optical parameters (e.g., radiance, area, duration, number of optical groups, and number of optical events) are inter-compared. On average, the ground flash cloud-top emissions are more radiant, illuminate a larger area, are longer lasting, and have more optical groups and optical events than those cloud-top emissions associated with cloud flashes. Given these differences, it is suggested that the methods of Bayesian Inference could be used to help discriminate between ground and cloud flashes. The ability to discriminate flash type on-orbit is highly desired since such information would help researchers and operational decision makers better assess the intensification, evolutionary state, and severe weather potential of thunderstorms. This work supports risk reduction activities presently underway for the future launch of the GOES-R Geostationary Lightning Mapper (GLM).

Koshak, William

Cloud Features Detected by MODIS But Not by CloudSat and CALIOP

The ability to characterize the global cloud cover from space has been greatly enhanced by the availability of MODIS, CloudSat, and CALIOP data. The three sensors provide good complementary information about clouds. In this study, we investigated unexpected observations of certain types of clouds apparent in the MODIS data but not detected by CloudSat and CALIOP. Several examples are presented and generally these undetected clouds are geometrically thin, low-level clouds. In particular, they are located in the Arctic region and have optical thicknesses of less than 14, top height altitudes of below 2.5 km, and layer thickness of less than 1 km. CloudSat may miss such low-level clouds because of its coarse vertical resolution of about 500 m and it has limited sensitivity near the surface. Unexpectedly, CALIOP with a much higher vertical resolution of 30 m also misses these clouds and this is due to the cloud s geometrically thin nature and surface proximity.

Chan, Mark Aaron