Engineering PapersSearch

Engineering topics

Thad Chee

Publications and source records attributed to Thad Chee.

Impact of COVID-19-related Air Traffic Reductions on the Coverage and Radiative Effects of Linear Persistent Contrails over Conterminous United States and Surrounding Oceanic Routes

The radiative effects of the large-scale air traffic slowdown during Apr and May 2020 due to the international response to the COVID-19 pandemic are estimated by comparing the coverage (CC), optical properties, and radiative forcing of persistent linear contrails over the conterminous United States and two surrounding oceanic air corridors during the slowdown period and a similar baseline period during 2018 and 2019 when air traffic was unrestricted. The detected CC during the slowdown period decreased by an area-averaged mean of 41% for the three analysis boxes. The retrieved contrail optical properties were mostly similar for both periods. Total shortwave contrail radiative forcings during the slowdown were 34 and 42% smaller for Terra and Aqua, respectively. The corresponding differences for longwave contrail radiative forcing were 33% for Terra and 40% for Aqua. To account for the impact of any changes in the atmospheric environment between baseline and slowdown periods on detected CC amounts, the contrail formation potential (CFP) was computed from reanalysis data. In addition, a filtered CFP (fCFP) was also developed to account for factors that may affect contrail formation and visibility of persistent contrails in satellite imagery. The CFP and fCFP were combined with air traffic density data to create empirical models that estimated CC during the baseline and slowdown periods and were compared to the detected CC. The models confirm that decreases in CC and radiative forcing during the slowdown period were mostly due to the reduction in air traffic, and partly due to environmental changes.

contrails

NASA Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST) New Observing Strategies (NOS)

NASA's Advanced Information Systems Technology (AIST) Program is one of several Technology programs managed by the Earth Science Technology Office (ESTO) in the Earth Science Division (ESD). The AIST Program focuses on advanced information systems and novel computer science technologies that will be needed by NASA Earth Science in the next 5 to 10 years. New Observing Strategies is one the three main thrusts of the AIST Program. Each year, all the PI's present the technical advancements of their projects during a Grouped Technical Session.

Jacqueline Le Moigne-stewart

Leveraging CSPP: Building a cloud based direct broadcast processing system

Reducing the time that it takes to have useful satellite information is very important because timely access allows for more informed decision making. This is especially true in time critical situations like disaster response and financial market analysis. One way to achieve reductions in the overall time between information capture and delivery to use the direct broadcast from weather satellites. In this work, we describe a state driven satellite information system that captures a satellite’s direct broadcast signal and uses cloud-based resources to provide end-user controlled processing. The system takes advantage of the reliability and customizability of Amazon Web Services to provide fast and reliable access to a system that takes the direct broadcast signal and leverages the CSPP software as well as dynamically supplied end-user processing modules to produce a user desired information product. Finally, we describe the development process and how a flexible design allowed for changes as the capabilities of the processing platform evolved and the lessons we learned from the process.

CSPP

Advancing NASA SatCORPS Global Data Products with Cloud Computing and Machine Learning

Operational satellite imager radiances are valuable for deriving many different physical parameters that can be used for a variety of weather, aviation, and energy applications. The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) applies a suite of algorithms to meteorological satellite data to provide cloud properties, radiative fluxes and other parameters on a global scale. The use of cloud computing has enabled recent enhancements to process a constellation of geostationary satellites at higher spatiotemporal resolutions than previously possible that meet low latency and near real-time needs. Data taken from Meteosat-8 and -11, Himawari, GOES-16, and -17 are processed and combined with operational polar orbiting satellite data and composited on a 3-km grid to provide global coverage. To improve the utility of the data products, machine learning and other innovative methods are applied in various ways to help minimize data product uncertainties under the most challenging conditions and to improve their consistency at all times of day. An update on recent SatCORPS enhancements is presented, highlighting the community benefits achieved with the use of cloud computing and machine learning.

William L Smith

Transitioning a Flexible and Scalable Satellite Ground Station Observation Network (GSON) Framework to an Operational Environment

Obtaining accurate and timely satellite observations is of paramount importance in fields like disaster management, weather diagnoses/forecasting, and Earth Sciences remote sensing. Stored mission data (SMD), from low Earth orbiting (LEO) satellite sensors, provides important observations for these fields and applications, however data access to SMD can be delayed from one and half hours to three hours from the time the observations were made. This data latency poses a significant impact on data product optimal use. We developed a Ground Station Observation Network (GSON) that utilizes commercial ground station as a service (GSaaS) providers to acquire low latency direct broadcast (DB) data from AQUA, SNPP, and JPSS-1 satellites using antennas located in strategic locations around the world. We will discuss techniques to improve the deployment efficiency and code reliability and quality of the GSON framework. Topics include right-sizing and containerization of the code to facilitate integration and adaptation with continuous delivery (CD) pipeline, locating non-code assets in referenceable repositories separated from code, adaptation of pipelines as code and simplification of CD, intersecting with code quality tests and checks as part of the pipeline execution and deployment, and establishing distributed repositories, registries, and system identities in a way that mitigates compromise to the CD pipeline. These techniques enable deployment of processing systems that are both highly specific but also dynamically modifiable. This new class of system allows for a flexible and scalable deployment while avoiding the “black box” issues that can plague large system deployments.

cluster

SatCORPS Global Cloud Composite (GCC): the Design and Delivery of A High Quality, High Resolution, Global Cloud Product Available in Near-Real Time

The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) supports the development of an analysis ready and cloud-optimized data transformation pipeline and geospatial service enablement of a global cloud composite (GCC) product derived from global geostationary satellite imagery. This geospatial service will be available at high temporal and spatial resolution via the SatCORPS web mapping application for visualization and analysis as well as direct ingestion to common geospatial software and custom programming. The resulting global cloud composite products from the processing pipeline can then be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. Near real time global observations are created through the composition of five geostationary satellites that provides modelling and forecasting communities with the capability to provide high quality and timely information to start the projection process. The Global Cloud Composite product combines information from geostationary satellites, GOES-16, GOES-17, Himawari-8, Meteosat-11 and Meteosat-9 to create a single global composite netcdf file and images using the different products within the netcdf file. The SatCORPS team, though our Global Cloud Composite (GCC) product and web-based visualization tools including Geographical Information System (GIS) services provide near real time global cloud product information to both automated processes and traditional web users that is timely and high quality derived from geostationary satellites. The Global Cloud Composite product takes advantage of the scalable processing resources provided by the AWS batch service to provide new composites every thirty minutes. Because information from each of the low earth orbiting satellites is available on schedules tuned to the specific satellite, the processing algorithm temporally composites the final dataset as each satellite’s information becomes available. The SatCORPS team has leveraged our experience using Amazon Web Services (AWS) to build a low latency high availability tool that allows end users both human and automated to acquire high quality and high-resolution Geostationary Earth Orbiting (GEO) information at zero cost to the end user. This presentation will describe how we architected and implemented the service as well as lessons learned based on our experiences both developing and operating the system. The lessons learned include how we integrated multiple services including Amazon Batch, Amazon S3 and Amazon Lambda service to create a low cost but high-performance processing system that is capable of identifying and processing the most appropriate satellite overpass information into global cloud composites. We will also describe our web-based tools including our Geographic Information System that can be used for visualization and analysis. The products from the processing can be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. The SatCORPS Global Composite Cloud product provides sophisticated global composited cloud research products with very low latency that we see that as filling a rapidly growing need in the research and modelling community with no up-front nor ongoing costs associated with downloading or using the information.

AWS AMCE SMCE GCC SATCORPS GLOBAL CLOUD COMPOSITE

Novel Hourly-Resolved Global Cloud Property Composite from Operational Satellites Imagers

Numerous applications in satellite remote sensing of surface properties, atmospheric state, composition, and radiation require accurate knowledge of the location and characteristics of clouds. Operational satellite imager radiances are valuable for cloud detection and for deriving many different physical parameters that can be used for a variety of weather, aviation, and energy applications. The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) applies a suite of algorithms to meteorological satellite data to provide cloud properties, radiative fluxes and other parameters on a global scale. This paper describes a new global high-resolution dataset of cloud properties made available for community use that is constructed from analyses of a constellation of meteorological satellite imagers. Data taken from Meteosat-8/9 and -11, Himawari-8/9, GOES-16, and -17/-18, Aqua, Terra, Suomi-NPP and NOAA-20 are processed and composited on a 3-km grid to provide hourly global coverage. A historical multi-year dataset is available to serve various needs including modeling challenges related to cloud evaluations and parameterizations. Near real-time data products are also currently available between 60N and 60S. Efforts are underway to operationalize polar orbiting satellite cloud detection methods for low-latency applications over polar regions. The cloud detection and retrieval algorithms have been developed over many years to support NASA weather and climate programs such as the Clouds and Earth’s Radiant Energy System (CERES). To improve the utility of the data products, machine learning and other innovative methods are applied in various ways to help minimize data product uncertainties under the most challenging conditions and to improve their consistency at all times of day. A brief description of the methods highlighting the unique aspects of the SatCORPS data products will be presented along with information on their status and availability.

SatCORPS

Creating Satellite Data Products in the Cloud: SatCORPS Global Cloud Composites

Real time satellite observations and real time derived cloud products are becoming an important tool for both science as well as business ventures. The SatCORPS group leverages public and private cloud-based sources of satellite observations to create its Global Cloud Composite product in near real-time. This dataset allows others access to cloud information that can be accessed directly from the cloud. In this work, we describe the software algorithms and software infrastructure that we have created to create and distribute this product through our hybrid cloud and on-premises system that leverages the strengths and weaknesses of each platform. We will also describe the GCC product itself in terms of the scientific parameters available, resolution and temporal availability. Finally, we will also describe our web-based tools including our Geographic Information System that can be used for visualization and analysis. The products from the processing can be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. The SatCORPS Global Composite Cloud product provides sophisticated global cloud products with very low latency which we see that as filling a rapidly growing need in the research, modelling and business community. We present a detailed description of the SatCORPS GCC product in terms of the capabilities and research benefits as well as the delivery architecture in AWS. We take the discussion further and describe the web tools that the SatCORPS group has developed that allow users to access and use the GIS data that it creates.

Global Cloud Composite SatCORPS SMCE AWS

Machine Learning Application for Improving Cloud Detection and Phase Determination Over Sunglint Regions for Geostationary Satellites

Cloud detection and phase determination over sunglint regions has been a challenge, especially for geostationary (GEO) satellites. Sunglint is observed when the sunlight specular reflection is at the same viewing angle of the satellite sensor. This intense reflection in the visible channels (VIS) is often comparable to that from optically thick clouds. It also contaminates the shortwave infrared channels (SWIR). Consequently, VIS and SWIR channels become less useful - or not useful- when they are saturated, hampering the detection of cloudy and clear-sky pixels. Sunglint contamination happens frequently and exists nearly in every daytime GEO full disk satellite images. However, sunglint intensity and region are difficult to model due to variable viewing geometry and ocean surface conditions. Moreover, existing physical models do not meet the accuracy required for operational GEO satellite cloud detection. We developed a machine learning algorithm to improve cloud detection in sunglint conditions for the NASA Langley’s Satellite ClOud and radiation Property retrieval System (SatCORPS). This poster presents our recent progress in the algorithm development, validation and applications. The algorithm is validated using collocated SatCORPS GOES-East and GOES-West cloud products. We demonstrate that the machine learning cloud detection in sunglint regions is superior to the traditional approach by improving temporal consistency between sunglint and non-sunglint conditions.

Machine Learning, Cloud detection, Sunglint, SatCO