Engineering Papers⌕ Search

DOE OSTI · 1808517

Coordinating an operational data distribution network for CMIP6 data

Abstract

The distribution of data contributed to the Coupled Model Intercomparison Project Phase 6 (CMIP6) is via the Earth System Grid Federation (ESGF). The ESGF is a network of internationally distributed sites that together work as a federated data archive. Data records from climate modelling institutes are published to the ESGF and then shared around the world. It is anticipated that CMIP6 will produce approximately 20 PB of data to be published and distributed via the ESGF. In addition to this large volume of data a number of value-added CMIP6 services are required to interact with the ESGF; for example the citation and errata services both interact with the ESGF but are not a core part of its infrastructure. With a number of interacting services and a large volume of data anticipated for CMIP6, the CMIP Data Node Operations Team (CDNOT) was formed. The CDNOT coordinated and implemented a series of CMIP6 preparation data challenges to test all the interacting components in the ESGF CMIP6 software ecosystem. This ensured that when CMIP6 data were released they could be reliably distributed.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Petrie, Ruth, Denvil, Sébastien, Ames, Sasha, Levavasseur, Guillaume, Fiore, Sandro, Allen, Chris, Antonio, Fabrizio, Berger, Katharina, Bretonnière, Pierre-Antoine, Cinquini, Luca, Dart, Eli, Dwarakanath, Prashanth, Druken, Kelsey, Evans, Ben, Franchistéguy, Laurent, Gardoll, Sébastien, Gerbier, Eric, Greenslade, Mark, Hassell, David, Iwi, Alan, Juckes, Martin, Kindermann, Stephan, Lacinski, Lukasz, Mirto, Maria, Nasser, Atef Ben, Nassisi, Paola, Nienhouse, Eric, Nikonov, Sergey, Nuzzo, Alessandra, Richards, Clare, Ridzwan, Syazwan, Rixen, Michel, Serradell, Kim, Snow, Kate, Stephens, Ag, Stockhause, Martina, Vahlenkamp, Hans, Wagner, Rick. 2021-01-29. Coordinating an operational data distribution network for CMIP6 data. https://doi.org/10.5194/gmd-14-629-2021

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

Ontologies for Intelligent Data Science

As anyone even vaguely aware of current technology can tell you, machine learning (ML) and artificial intelligence (AI) have made exceptional breakthroughs in recent years. Generative artificial intelligence (GAI) emerged circa 2022 dominated by Large Language Models (LLMs) and generative tools for images emerged at about the same time.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Data Cards for Standardized Metadata Across DOE-Aligned Data Initiatives: Toward Transparent, Interoperable, and Governed Dataset Documentation

As data-intensive research, advanced computing, and artificial intelligence become increasingly central to scientific and operational workflows, the need for consistent, transparent, and machine-actionable documentation has grown correspondingly. Multiple DOE-aligned communities—including Office of Science, Genesis Mission, American Science Cloud (AmSC), National Nuclear Security Administration (NNSA) stewardship and governance, and related cross-laboratory collaborations—have independently developed metadata practices to support discovery, access, reuse, repository deposit, and compliance.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Verification and Validation of Performance with Dissemination of Best Practices in District Energy and CHP for Enhanced Resiliency, Energy Efficiency, and Cybersecurity

This report contains the results of the International District Energy Association’s work to analyze, validate, and verify performance data of existing district energy systems and identify industy best practices for the purpose of improving system reliability, resiliency, and efficiency, and to accellerate decarbonization. In addition to a technical evaluation of the surveyed systems and identification of a series of technical performance metrics, the report illustrates the accompanying operations and financial best practices employed by surveyed systems to fully serve their customer base. Additionally, the third chapter of the report describes the current landscape of cybersecurity threats and counteracting measures, and recommends a series of steps for effectively guarding highly networked district energy systems against cybersecurity attacks.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗