TPSAS-NF1676L-13349-DND
Progress on the effort to calibrate historical AVHRR solar channels and derive a CERES-consistent cloud climatology form AVHRR data is presented.
Patrick Minnis↗
Engineering topics
Rabindra Palikonda
Publications and source records attributed to Rabindra Palikonda.
TPSAS-NF1676L-13135-DND
Aircraft Icing - Aircraft structures act as ice nuclei in supercooled clouds - ice collects, weight increases, plane falls - Pilots need to know where and when icing can occur - PIREPS are first order: sparse, aircraft dependent, location uncertain - Model analyses and forecasts: freezing levels, cloud expectations - radar => precipitation - All combined in NCAR/FAA/NOAA/NASA program to provide Current Icing Product (CIP) & Forecast Icing product (FIP) analyses to pilots (CONUS) - some inadequacies remain - NWP uncertainties, intensity, altitude of icing, etc. - Operational satellites can add valuable information - indirectly: input of cloud properties to CIP & NWP - directly: determination of icing threat from real time satellite data
William L Smith↗
Advancing NASA SatCORPS Global Data Products with Cloud Computing and Machine Learning
Operational satellite imager radiances are valuable for deriving many different physical parameters that can be used for a variety of weather, aviation, and energy applications. The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) applies a suite of algorithms to meteorological satellite data to provide cloud properties, radiative fluxes and other parameters on a global scale. The use of cloud computing has enabled recent enhancements to process a constellation of geostationary satellites at higher spatiotemporal resolutions than previously possible that meet low latency and near real-time needs. Data taken from Meteosat-8 and -11, Himawari, GOES-16, and -17 are processed and combined with operational polar orbiting satellite data and composited on a 3-km grid to provide global coverage. To improve the utility of the data products, machine learning and other innovative methods are applied in various ways to help minimize data product uncertainties under the most challenging conditions and to improve their consistency at all times of day. An update on recent SatCORPS enhancements is presented, highlighting the community benefits achieved with the use of cloud computing and machine learning.
William L Smith↗
Application of a Deep Neural Network to Improve Clear-sky Temperatures in Support of Satellite Cloud Retrievals
Explore the source record for details and available documents.
Benjamin Scarino↗
A 3-Channel Algorithm for Retrieving Consistent Cloud Properties Across Different Geostationary Satellites
Explore the source record for details and available documents.
David Painemal↗
SatCORPS Global Cloud Composite (GCC): the Design and Delivery of A High Quality, High Resolution, Global Cloud Product Available in Near-Real Time
The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) supports the development of an analysis ready and cloud-optimized data transformation pipeline and geospatial service enablement of a global cloud composite (GCC) product derived from global geostationary satellite imagery. This geospatial service will be available at high temporal and spatial resolution via the SatCORPS web mapping application for visualization and analysis as well as direct ingestion to common geospatial software and custom programming. The resulting global cloud composite products from the processing pipeline can then be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. Near real time global observations are created through the composition of five geostationary satellites that provides modelling and forecasting communities with the capability to provide high quality and timely information to start the projection process. The Global Cloud Composite product combines information from geostationary satellites, GOES-16, GOES-17, Himawari-8, Meteosat-11 and Meteosat-9 to create a single global composite netcdf file and images using the different products within the netcdf file. The SatCORPS team, though our Global Cloud Composite (GCC) product and web-based visualization tools including Geographical Information System (GIS) services provide near real time global cloud product information to both automated processes and traditional web users that is timely and high quality derived from geostationary satellites. The Global Cloud Composite product takes advantage of the scalable processing resources provided by the AWS batch service to provide new composites every thirty minutes. Because information from each of the low earth orbiting satellites is available on schedules tuned to the specific satellite, the processing algorithm temporally composites the final dataset as each satellite’s information becomes available. The SatCORPS team has leveraged our experience using Amazon Web Services (AWS) to build a low latency high availability tool that allows end users both human and automated to acquire high quality and high-resolution Geostationary Earth Orbiting (GEO) information at zero cost to the end user. This presentation will describe how we architected and implemented the service as well as lessons learned based on our experiences both developing and operating the system. The lessons learned include how we integrated multiple services including Amazon Batch, Amazon S3 and Amazon Lambda service to create a low cost but high-performance processing system that is capable of identifying and processing the most appropriate satellite overpass information into global cloud composites. We will also describe our web-based tools including our Geographic Information System that can be used for visualization and analysis. The products from the processing can be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. The SatCORPS Global Composite Cloud product provides sophisticated global composited cloud research products with very low latency that we see that as filling a rapidly growing need in the research and modelling community with no up-front nor ongoing costs associated with downloading or using the information.
AWS AMCE SMCE GCC SATCORPS GLOBAL CLOUD COMPOSITE ↗
High-Resolution Global Cloud Properties from Operational Satellites
Explore the source record for details and available documents.
William Smith Jr.↗
Novel Hourly-Resolved Global Cloud Property Composite from Operational Satellites Imagers
Numerous applications in satellite remote sensing of surface properties, atmospheric state, composition, and radiation require accurate knowledge of the location and characteristics of clouds. Operational satellite imager radiances are valuable for cloud detection and for deriving many different physical parameters that can be used for a variety of weather, aviation, and energy applications. The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) applies a suite of algorithms to meteorological satellite data to provide cloud properties, radiative fluxes and other parameters on a global scale. This paper describes a new global high-resolution dataset of cloud properties made available for community use that is constructed from analyses of a constellation of meteorological satellite imagers. Data taken from Meteosat-8/9 and -11, Himawari-8/9, GOES-16, and -17/-18, Aqua, Terra, Suomi-NPP and NOAA-20 are processed and composited on a 3-km grid to provide hourly global coverage. A historical multi-year dataset is available to serve various needs including modeling challenges related to cloud evaluations and parameterizations. Near real-time data products are also currently available between 60N and 60S. Efforts are underway to operationalize polar orbiting satellite cloud detection methods for low-latency applications over polar regions. The cloud detection and retrieval algorithms have been developed over many years to support NASA weather and climate programs such as the Clouds and Earth’s Radiant Energy System (CERES). To improve the utility of the data products, machine learning and other innovative methods are applied in various ways to help minimize data product uncertainties under the most challenging conditions and to improve their consistency at all times of day. A brief description of the methods highlighting the unique aspects of the SatCORPS data products will be presented along with information on their status and availability.
SatCORPS↗
Creating Satellite Data Products in the Cloud: SatCORPS Global Cloud Composites
Real time satellite observations and real time derived cloud products are becoming an important tool for both science as well as business ventures. The SatCORPS group leverages public and private cloud-based sources of satellite observations to create its Global Cloud Composite product in near real-time. This dataset allows others access to cloud information that can be accessed directly from the cloud. In this work, we describe the software algorithms and software infrastructure that we have created to create and distribute this product through our hybrid cloud and on-premises system that leverages the strengths and weaknesses of each platform. We will also describe the GCC product itself in terms of the scientific parameters available, resolution and temporal availability. Finally, we will also describe our web-based tools including our Geographic Information System that can be used for visualization and analysis. The products from the processing can be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. The SatCORPS Global Composite Cloud product provides sophisticated global cloud products with very low latency which we see that as filling a rapidly growing need in the research, modelling and business community. We present a detailed description of the SatCORPS GCC product in terms of the capabilities and research benefits as well as the delivery architecture in AWS. We take the discussion further and describe the web tools that the SatCORPS group has developed that allow users to access and use the GIS data that it creates.
Global Cloud Composite SatCORPS SMCE AWS↗
A 3-Channel Algorithm for Retrieving Spatially and Temporally Continuous Cloud Properties Across Different Geostationary Satellite Imagers
Cloud property retrieval algorithms for passive satellite imagers are generally designed to take advantage of all the useful spectral information available for a particular satellite. This strategy optimizes accuracy and reduces misidentification and retrieval biases, particularly for modern satellites with many spectral channels. However, the application of dissimilar algorithms tailored for different satellite sensor scan present a problem within the climate data record (CDR). Algorithm inconsistencies can introduce artificial trends in the CDR that are tied to instrument changes rather than physical changes, especially when older satellites with limited spectral information are included. The NASA CERES (Clouds and the Earth’s Radiant Energy System) data record provides global cloud property retrievals across 23 years and more than 25 satellites. With the goal of producing a spatially and temporally continuous record of cloud properties, the CERES cloud working group has developed algorithms that use only 3 channels that are common to most geostationary satellite imagers: 0.65, 3.9, and 10.8 μm.
Sarah Bedka↗
Machine Learning Application for Improving Cloud Detection and Phase Determination Over Sunglint Regions for Geostationary Satellites
Cloud detection and phase determination over sunglint regions has been a challenge, especially for geostationary (GEO) satellites. Sunglint is observed when the sunlight specular reflection is at the same viewing angle of the satellite sensor. This intense reflection in the visible channels (VIS) is often comparable to that from optically thick clouds. It also contaminates the shortwave infrared channels (SWIR). Consequently, VIS and SWIR channels become less useful - or not useful- when they are saturated, hampering the detection of cloudy and clear-sky pixels. Sunglint contamination happens frequently and exists nearly in every daytime GEO full disk satellite images. However, sunglint intensity and region are difficult to model due to variable viewing geometry and ocean surface conditions. Moreover, existing physical models do not meet the accuracy required for operational GEO satellite cloud detection. We developed a machine learning algorithm to improve cloud detection in sunglint conditions for the NASA Langley’s Satellite ClOud and radiation Property retrieval System (SatCORPS). This poster presents our recent progress in the algorithm development, validation and applications. The algorithm is validated using collocated SatCORPS GOES-East and GOES-West cloud products. We demonstrate that the machine learning cloud detection in sunglint regions is superior to the traditional approach by improving temporal consistency between sunglint and non-sunglint conditions.
Machine Learning, Cloud detection, Sunglint, SatCO↗