Lessons Learned While Exploring Cloud-Native Architectures for NASA EOSDIS Applications and Systems

Pilone, Dan; Mclaughlin, Brett; Plofchan, Peter

Home/Archive/NASA NTRS

NASA NTRS · 20170000401

Lessons Learned While Exploring Cloud-Native Architectures for NASA EOSDIS Applications and Systems

Pilone, Dan·Mclaughlin, Brett·Plofchan, Peter

View original source ↗Export metadata ↓

Abstract

NASA's Earth Observing System (EOS) is a coordinated series of satellites for long term global observations. NASA's Earth Observing System Data and Information System (EOSDIS) is a multi-petabyte-scale archive of environmental data that supports global climate change research by providing end-to-end services from EOS instrument data collection to science data processing to full access to EOS and other earth science data. On a daily basis, the EOSDIS ingests, processes, archives and distributes over 3 terabytes of data from NASA's Earth Science missions representing over 6000 data products ranging from various types of science disciplines. EOSDIS has continually evolved to improve the discoverability, accessibility, and usability of high-impact NASA data spanning the multi-petabyte-scale archive of Earth science data products. Reviewed and approved by Chris Lynnes.

Explore related subjects

Cumulus GIBS in the Cloud NGAP

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Pilone, Dan, Mclaughlin, Brett, Plofchan, Peter. 2017-01-13. Lessons Learned While Exploring Cloud-Native Architectures for NASA EOSDIS Applications and Systems. https://ntrs.nasa.gov/citations/20170000401

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

NASA NTRS2019

The Cumulus Ecosystem: Open Source and Beyond to Foster Collaboration

NASA’s Earth Observing System Data and Information System (EOSDIS) open source Cumulus software is designed as a common set of code and services that can be used to create a pipeline to deliver and manage earth science data in the cloud. Cumulus strives to create an ecosystem on the foundation of open source that unites those with shared problems and goals by encouraging users to contribute solutions back to the platform. Large parts of ingesting and managing data are common and much of what is created can be used by others. Our goal is to maximize collaboration and code reuse while allowing users to design a custom solution that meets their needs without having to take on extraneous functionality. In this talk we will describe how the Cumulus ecosystem works beyond just open source software. We will review the technology, the successes and challenges, and the evolution and future of Cumulus as an ecosystem.

Cumulus↗

NASA NTRS2019

Cumulus: A Community of Collaboration

Cumulus is an open source platform used for ingesting and maintaining archives in the cloud. Sharing and maximizing code re-use are pillars of Cumulus development. Cumulus aims to promote collaboration within the community. This presentation will dive into the principles of Cumulus development, both within the team and the community.

Cumulus↗

NASA NTRS2018

Radiative Heating Profiles over Ascension Island during the 2016 and 2017 Biomass Burning Seasons

Marine boundary layer clouds, including the transition from stratocumulus to cumulus, are poorly represented in numerical weather prediction and general circulation models. In many cases, the complex physical relationships between cloud morphology and the environmental conditions in which marine boundary layer clouds exist are not well understood. Such uncertainties arise in the presence of biomass burning carbonaceous aerosol, as is the case over the southeast Atlantic Ocean, where it is likely that the absorbing and heating properties of these aerosols modify the microphysical composition and macrophysical arrangement of marine stratocumulus and trade cumulus. The deployment of the Atmospheric Radiation Measurement Mobile Facility #1 (AMF1) in support of LASIC (Layered Atlantic Smoke Interactions with Clouds) provided a unique opportunity to observe thermodynamic, cloud and aerosol properties during two consecutive biomass burning seasons from July through October of 2016 and 2017 over Ascension Island (7.96 S, 14.35 W). These observations in conjunction with radiation transfer modeling were used to assess the impact of biomass burning carbonaceous aerosol plumes as they passed over the site.Thermodynamic profiles were generated using a combination of radiosonde data and thermodynamic profilers to provide high temporal resolution profiles of quantities that are important for cloud development, such as CAPE and CIN. Coincident Ka-band radar and lidar profiles were used to characterize the cloud and sub-cloud structure. The resulting thermodynamic and cloud profiles are used as input forcing for the Rapid Radiative Transfer Model (RRTM) to compute radiative heating profiles over the observation site. Idealized experiments using RRTM, with and without aerosols present, are used to assess the impacts of the absorbing aerosol on the heating rate profiles.

Cumulus↗