Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Climate ensembles”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

The Community Earth System Model version 2 (CESM2)

An overview of the Community Earth System Model version 2 (CESM2) is provided, including a discussion of the challenges encountered during its development and how they were addressed. In addition, an evaluation of a pair of CESM2 long pre-industrial control and historical ensemble simulations is presented. These simulations were performed using the nominal 1° horizontal resolution configuration of the coupled model with both the “low-top” (40 km, with limited chemistry) and “high-top” (140 km, with comprehensive chemistry) versions of the atmospheric component. CESM2 contains many substantial science and infrastructure improvements and new capabilities since its previous major release, CESM1, resulting in improved historical simulations in comparison to CESM1 and available observations. These include major reductions in low latitude precipitation and short-wave cloud forcing biases; better representation of the Madden-Julian Oscillation; better El Niño – Southern Oscillation-related teleconnections; and a global land carbon accumulation trend that agrees well with observationally-based estimates. Most tropospheric and surface features of the low- and high-top simulations are very similar to each other, so these improvements are present in both configurations. CESM2 has an equilibrium climate sensitivity of 5.1-5.3°C, larger than in CESM1, primarily due to a combination of relatively small changes to cloud microphysics and boundary layer parameters. In contrast, CESM2’s transient climate response of 1.9-2.0°C is comparable to that of CESM1. The model outputs from these and many other simulations are available to the research community, and theyrepresent CESM2’s contributions to the Coupled Model Intercomparison Project phase 6 (CMIP6).

Danabasoglu, Gokhan↗

A machine learning approach to emulation and biophysical parameter estimation with the Community Land Model, version 5

Abstract. Land models are essential tools for understanding and predicting terrestrial processes and climate–carbon feedbacks in the Earth system, but uncertainties in their future projections are poorly understood. Improvements in physical process realism and the representation of human influence arguably make models more comparable to reality but also increase the degrees of freedom in model configuration, leading to increased parametric uncertainty in projections. In this work we design and implement a machine learning approach to globally calibrate a subset of the parameters of the Community Land Model, version 5 (CLM5) to observations of carbon and water fluxes. We focus on parameters controlling biophysical features such as surface energy balance, hydrology, and carbon uptake. We first use parameter sensitivity simulations and a combination of objective metrics including ranked global mean sensitivity to multiple output variables and non-overlapping spatial pattern responses between parameters to narrow the parameter space and determine a subset of important CLM5 biophysical parameters for further analysis. Using a perturbed parameter ensemble, we then train a series of artificial feed-forward neural networks to emulate CLM5 output given parameter values as input. We use annual mean globally aggregated spatial variability in carbon and water fluxes as our emulation and calibration targets. Validation and out-of-sample tests are used to assess the predictive skill of the networks, and we utilize permutation feature importance and partial dependence methods to better interpret the results. The trained networks are then used to estimate global optimal parameter values with greater computational efficiency than achieved by hand tuning efforts and increased spatial scale relative to previous studies optimizing at a single site. By developing this methodology, our framework can help quantify the contribution of parameter uncertainty to overall uncertainty in land model projections.

54 ENVIRONMENTAL SCIENCES↗

Unique Temperature Trend Pattern Associated With Internally Driven Global Cooling and Arctic Warming During 1980–2022

Abstract Diagnosing the role of internal variability over recent decades is critically important for both model validation and projections of future warming. Recent research suggests that for 1980–2022 internal variability manifested as Global Cooling and Arctic Warming (i‐GCAW), leading to enhanced Arctic Amplification (AA), and suppressed global warming over this period. Here we show that such an i‐GCAW is rare in CMIP6 large ensembles, but simulations that do produce similar i‐GCAW exhibit a unique and robust internally driven global surface air temperature (SAT) trend pattern. This unique SAT trend pattern features enhanced warming in the Barents and Kara Sea and cooling in the Tropical Eastern Pacific and Southern Ocean. Given that these features are imprinted in the observed record over recent decades, this work suggests that internal variability makes a crucial contribution to the discrepancy between observations and model‐simulated forced SAT trend patterns.

54 ENVIRONMENTAL SCIENCES↗

Assessing the Sensitivity of the Tropical Cyclone Boundary Layer to the Parameterization of Momentum Flux in the Community Earth System Model

Recent studies have demonstrated that high-resolution (~25 km) Earth System Models (ESMs) have the potential to skillfully predict tropical cyclone (TC) occurrence and intensity. However, biases in ESM TCs still exist, largely due to the need to parameterize processes such as boundary layer (PBL) turbulence. Building on past studies, we hypothesize that the depiction of the TC PBL in ESMs is sensitive to the configuration of the PBL parameterization scheme, and that the targeted perturbation of tunable parameters can reduce biases. The Morris one-at-a-time (MOAT) method is implemented to assess the sensitivity of the TC PBL to tunable parameters in the PBL scheme in an idealized configuration of the Community Atmosphere Model, version 6 (CAM6). The MOAT method objectively identifies several parameters in an experimental version of the Cloud Layers Unified by Binormals (CLUBB) scheme that appreciably influence the structure of the TC PBL. We then perturb the parameters identified by the MOAT method within a suite of CAM6 ensemble simulations and find a reduction in model biases compared to observations and a high-resolution, cloud-resolving model. Importantly, we demonstrate that the high-sensitivity parameters are tied to PBL processes that reduce turbulent mixing and effective eddy diffusivity, and that in CAM6 these parameters alter the TC PBL in a manner consistent with past modeling studies. In this way, we provide an initial identification of process-based input parameters that, when altered, have the potential to improve TC predictions by ESMs.

54 ENVIRONMENTAL SCIENCES↗

Future Changes in Midwest Extreme Precipitation Depend on Storm Type

Midwestern U.S. extreme precipitation is associated with multiple storm types including mesoscale convective systems (MCSs) and/or training thunderstorms, tropical cyclone (TC) remnants, and winter storms. Anthropogenic warming is expected to increase climatological precipitation globally, however, there may be little correspondence with regional storm-based changes. Furthermore, uncertainty remains in precipitation-temperature scaling due to use of convective parameterization in most global models. In this study, we investigated historically impactful extreme precipitation events from multiple types of Midwest storms using the Weather Research and Forecasting model at convection-permitting resolution. We simulated five-member ensembles of historical hindcasts and experiments representing the storms in the future using the pseudo-global warming method. We found that future precipitation changes depend on storm type, with increases near Clausius-Clapeyron (CC) for winter storms, no consensus for MCSs and/or training thunderstorms, and sub-CC increases for TC remnants. This research highlights the importance of considering storm type in future extreme precipitation projections.

54 ENVIRONMENTAL SCIENCES↗

Persistent ocean anomalies as a response to Northern Hemisphere heating induced by biomass burning variability

Biomass burning aerosol (BBA) emissions in the Coupled Model Intercomparison Project Phase 6 (CMIP6) historical forcing fields have enhanced temporal variability during the years 1997–2014 compared to earlier periods. Recent studies document that the corresponding inhomogeneous shortwave forcing over this period can cause changes in clouds, permafrost, and soil moisture, which contribute to a net terrestrial Northern Hemisphere warming relative to earlier periods. Here, we investigate the ocean response to the hemispherically asymmetric warming, using a 100-member ensemble of the Community Earth System Model version 2 Large Ensemble forced by two different BBA emissions (CMIP6 default and temporally smoothed over 1990–2020). Differences between the two subensemble means show that ocean temperature anomalies occur during periods of high BBA variability and subsequently persist over multiple decades. In the North Atlantic, surface warming is efficiently compensated for by decreased northward oceanic heat transport due to a slowdown of the Atlantic Meridional Overturning Circulation. In the North Pacific, surface warming is compensated for by an anomalous cross-equatorial cell (CEC) that reduces northward oceanic heat transport. The heat that converges in the South Pacific through the anomalous CEC is shunted into the subsurface and contributes to formation of long-lasting ocean temperature anomalies. The anomalous CEC is maintained through latitude-dependent contributions from narrow western boundary currents and basin-wide near-surface Ekman transport. Furthermore, these results indicate that interannual variability in forcing fields may significantly change the background climate state over long timescales, presenting a potential uncertainty in CMIP6-class climate projections forced without interannual variability.

54 ENVIRONMENTAL SCIENCES↗

Observing, Measuring, and Assessing the Consequences of Snow Drought

Warmer and shorter winters from climate change will reduce snowpacks in most seasonally snow-covered regions of the world, with consequences for freshwater availability in spring and summer when people and ecosystems demand water most. Recent record-low snowpacks, such as those in the winters of 2013/14 and 2014/15 in the western United States, have led to a surge in research on “snow droughts,” which are pointed to as harbingers of global warming that pose significant societal hazards. Yet, despite the importance of understanding snow droughts to best prepare for their attendant impacts, the concept remains amorphous, with no agreed-upon definition of what they are, how best to measure them, and how such snow droughts connect to warm-season impacts. These knowledge gaps limit our understanding of the risks posed by snow droughts in the present and future, and thus our preparedness for their differential impacts on freshwater resources. To address these issues, we compile a hemispheric ensemble of in situ, satellite, and reanalysis snowpack datasets. We use this ensemble to evaluate the scientific challenges and uncertainties arising from differences in defining and measuring snow droughts, and to identify opportunities to leverage this information to better understand the significance of snow droughts. We show that a clearer quantification of what constitutes a snow drought, including its uncertainties, improves our ability to anticipate costly and disruptive warm-season droughts, which is vital for informing risk management and adaptation to changing snow regimes.

54 ENVIRONMENTAL SCIENCES↗

A machine learning approach targeting parameter estimation for plant functional type coexistence modeling using ELM-FATES (v2.0)

Tropical forest dynamics play a crucial role in the global carbon, water, and energy cycles. However, realistically simulating the dynamics of competition and coexistence between different plant functional types (PFTs) in tropical forests remains a significant challenge. This study aims to improve the modeling of PFT coexistence in the Functionally Assembled Terrestrial Ecosystem Simulator (FATES), a vegetation demography model implemented in the Energy Exascale Earth System Model (E3SM) land model (ELM), ELM-FATES. Specifically, we explore (1) whether plant trait relationships established from field measurements can constrain ELM-FATES simulations and (2) whether machine learning (ML)-based surrogate models can emulate the complex ELM-FATES model and optimize parameter selections to improve PFT coexistence modeling. We conducted three ensembles of ELM-FATES experiments at a tropical forest site near Manaus, Brazil. By comparing the ensemble experiments without (Exp-CTR) and with (Exp-OBS) consideration of observed trait relationships, we found that accounting for these relationships slightly improves the simulations of water, energy, and carbon variables when compared to observations but degrades the simulation of PFT coexistence. Using ML-based surrogate models trained on Exp-CTR, we optimized the trait parameters in ELM-FATES and conducted another ensemble of experiments (Exp-ML) with these optimized parameters. The proportion of PFT coexistence experiments significantly increased from 21 % in Exp-CTR to 73 % in Exp-ML. After filtering the experiments that allow for PFT coexistence to agree with observations (within 15 % tolerance), 33 % of the Exp-ML experiments were retained, which is a significant improvement compared to the 1.4 % in Exp-CTR. Exp-ML also accurately reproduces the annual means and seasonal variations in water, energy, and carbon fluxes and the field inventory of aboveground biomass. This study represents a reproducible method that utilizes machine learning to identify parameter values that improve model fidelity against observations and PFT coexistence in vegetation demography models for diverse ecosystems. Our study also suggests the need for new mechanisms to enhance the robust simulation of coexisting plants in ELM-FATES and has significant implications for modeling the response and feedbacks of ecosystem dynamics to climate change.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the Quasi‐Biennial Oscillation in global climate models for the SPARC QBO‐initiative

Abstract Quasi‐biennial oscillations (QBOs) in thirteen atmospheric general circulation models forced with both observed and annually repeating sea surface temperatures (SSTs) are evaluated. In most models the QBO period is close to, but shorter than, the observed period of 28 months. Amplitudes are within ±20 % of the observed QBO amplitude at 10 hPa, but typically about half of that observed at lower altitudes (50 and 70 hPa). For almost all models, the oscillation's amplitude profile shows an overall upward shift compared to reanalysis and its meridional extent is too narrow. Asymmetry in the duration of eastward and westward phases is reasonably well captured, though not all models replicate the observed slowing of the descending westward shear. Westward phases are generally too weak, and most models have an eastward time mean wind bias throughout the depth of the QBO. The intercycle period variability is realistic and in some models is enhanced in the experiment with observed SSTs compared to the experiment with repeated annual cycle SSTs. Mean periods are also sensitive to this difference between SSTs, but only when parametrized non‐orographic gravity wave (NOGW) sources are coupled to tropospheric parameters and not prescribed with a fixed value. Overall, however, modelled QBOs are very similar whether or not the prescribed SSTs vary interannually. A portrait of the overall ensemble performance is provided by a normalized grading of QBO metrics. To simulate a QBO, all but one model used parametrized NOGWs, which provided the majority of the total wave forcing at altitudes above 70 hPa in most models. Hence the representation of NOGWs either explicitly or through parametrization is still a major uncertainty underlying QBO simulation in these present‐day experiments.

Bushell, A. C.↗

Projections of winter polynyas and their biophysical impacts in the Ross Sea Antarctica

Abstract This study investigates winter polynyas in the southern Ross Sea, Antarctica where several polynyas are known to form. Coastal polynyas are areas of lower sea ice concentration and/or thickness along the coast that are otherwise surrounded by more extensive, thicker sea ice pack. Polynyas are also locations where organisms can exploit both the ice substrate and pelagic resources. Using a self organizing map algorithm, we identify polynya events in the Community Earth System Model Version 2 Large Ensemble (CESM2-LE). The neural network algorithm is able to identify polynya events without imposing an ice concentration or thickness threshold, as is often done when identifying polynyas. The CESM2-LE produces a wintertime polynya feature comparable in size and location to the Ross Sea polynya, and during polynya events there are large turbulent heat fluxes and export of sea ice from the Ross Sea. In the CESM2-LE polynya event frequency is projected to decrease sharply in the later twentyfirst century, leading to increasing sea ice concentrations and thicknesses in the region. The drivers of the polynya frequency decline are likely both large scale circulation changes and local atmosphere and ocean feedbacks. If declines in wintertime polynya frequency over the twentyfirst century do occur they may impact Antarctic Bottom Water formation and local net primary productivity. Thus, better understanding potential local and unexpected sea ice changes in the Ross Sea is important for both assessing climate system impacts and ecological impacts on the Ross Sea ecosystem, which is currently protected by an internationally recognized marine protected area.

Meteorology & Atmospheric Sciences↗

One‐at‐a‐Time Parameter Perturbation Ensemble of the Community Land Model, Version 5.1

Comprehensive land models are subject to significant parametric uncertainty, which can be hard to quantify due to the large number of parameters and high model computational costs. We constructed a large parameter perturbation ensemble (PPE) for the Community Land Model version 5.1 with biogeochemistry configuration (CLM5.1-BGC). We performed more than 2,000 simulations perturbing 211 parameters across six forcing scenarios. This provides an expansive data set, which can be used to identify the most influential parameters on a wide range of output variables globally, by biome, or by plant functional type. We found that parameter effects can exceed scenario effects and that a small number of parameters explains a large fraction of variance across our ensemble. The most important parameters can differ regionally and also based on the forcing scenario. The software infrastructure developed for this experiment has greatly reduced the human and computer time needed for CLM PPEs, which can facilitate routine investigation of parameter sensitivity and uncertainty, as well as automated calibration.

Kennedy, Daniel [NSF National Center for Atmospher↗

Determining the Adsorption Energetics of 2,3-Butanediol on RuO 2 (110): Coupling First-Principles Calculations With Global Optimizers

As climate change continues to pose a threat to the Earth due to the disrupted carbon cycles and fossil fuel resources remain finite, new sources of sustainable hydrocarbons must be explored. 2,3-butanediol is a potential source to produce butene because of its sustainability as a biomass-derived sugar. Butene is an attractive product because it can be used as a precursor to jet fuel, categorizing this work in the alcohol-to-jet pathway. While studies have explored the conversion of 2,3-butanediol to butene, little is understood about the fundamental reaction itself. We quantify the energetics for three pathways that were reported in the literature in the absence of a catalyst. One of these pathways forms a 1,3-butadiene intermediate, which is a highly exothermic process and thus is unlikely to occur since 2,3-butanediol likely gets thermodynamically trapped at this intermediate. We further determined the corresponding energetics of 2,3-butanediol adsorption on an ensemble of predetermined binding sites when it interacts with a defect-free stoichiometric RuO 2 (110) surface. Within this ensemble of adsorption sites, the most favorable site has 2,3-butanediol covering a Ru 5–coordinated cation. This approach is compared to that obtained using the global optimization algorithm as implemented in the Northwest Potential Energy Surface Search Engine. When using such a global optimization algorithm, we determined a more favorable ground-state structure that was missed during the manual adsorption site testing, with an adsorption energy of -2.61 eV as compared to -2.34 eV when using the ensemble-based approach. We hypothesize that the dehydration reaction requires a stronger chemical bond, which could necessitate the formation of oxygen vacancies. As such, this study has taken the first step toward the utilization of a global optimization algorithm for the rational design of Ru-based catalysts toward the formation of butene from sustainable resources.

09 BIOMASS FUELS↗

Seasonal and CO 2 -Induced Shifts of the ITCZ: Testing Energetic Controls in Idealized Simulations with Comprehensive Models

The Tropical Rain Belts with an Annual Cycle and Continent Model Intercomparison Project (TRACMIP) ensemble—a multimodel ensemble of slab-ocean simulations in idealized configurations—provides a test of the relationship between the zonal mean ITCZ and the cross-equatorial atmospheric energy transports (AHT eq ). In a gross sense, the ITCZ position is linearly related to AHT eq , as expected from the energetic framework. Yet, in many aspects, the TRACMIP model simulations do not conform to the framework. Throughout the annual cycle there are large excursions in the ITCZ position unrelated to changes in the AHT eq and, conversely, substantial variations in the magnitude of the AHT eq while the ITCZ is stationary at its northernmost position. Variations both in the net vertical energy input at the ITCZ location and in the vertical profile of ascent play a role in setting the model behavior apart from the conceptual framework. Nevertheless, a linear fit to the ITCZ–AHT eq relationship captures a substantial fraction of the seasonal variations in these quantities as well as the intermodel or across-climate variations in their annual mean values. The slope of the ITCZ–AHT eq linear fit for annual mean changes across simulations with different forcings and configurations varies in magnitude and even sign from model to model and we identify variations in the vertical profile of ascent as a key factor. A simple sea surface temperature–based index avoids the complication of changes in the vertical structure of the atmospheric circulation and provides a more reliable diagnostic for the ITCZ position.

54 ENVIRONMENTAL SCIENCES↗

DayCent data and results for "Robust paths to net greenhouse gas mitigation and negative emissions via advanced biofuels"

DayCent data and results for:J. L. Field, T. L. Richard, E. A. Smithwick, H. Cai, M. S. Laser, D. S. LeBauer, S. P. Long, K. Paustian, Z. Qin, J. J. Sheehan, P. Smith, M. Q. Wang, L. R. Lynd, Robust paths to net greenhouse gas mitigation and negative emissions via advanced biofuels. Proceedings of the National Academy of Sciences (2020). https://doi.org/10.1073/pnas.1920877117 This zip file contains a UNIX-format DayCent model executable, input files, automation code, and associated directory structure necessary to re-produce the DayCent analysis underlying the manuscript. The main script 'autodaycent.py' (written for Python 2.7) opens an interactive command line routine that facilitates:* Calibrating the DayCent pine growth model.* Initializing DayCent for a set of case studies sites.* Executing an ensemble of model runs representing case study site reforestation, grassland restoration, or conversion to switchgrass cultivation. * Results analysis & generation of manuscript Fig. 3. Note that the interactive analysis code requires that all input files to be contained in the directory structure as uploaded, without modification. Executable versions of the DayCent model (https://www.nrel.colostate.edu/projects/daycent/) compatible with other operating systems are available upon request.Please send questions/comments to John.L.Field@gmail.com

Agro-ecosystem function and prediction↗

Characterization of Extremes and Compound Impacts: Applications of Machine Learning and Interpretable Neural Networks

Focal Area: This white paper responds to Focal area III by exploring data fusion, learning and explainable AI methods in characterizing hydrological extremes and interconnections. It also addresses Focal area II by using probabilistic AI and ensemble ML for predicting extremes and compound extremes. Science Challenge: A key question associated with the integrated water (or hydrological) cycle grand challenge in the Earth and Environmental Systems Sciences Division (EESSD) strategic plan, is how the frequency and intensity of hydrological events will change. Prediction of the tail behavior (extremes) of the hydrological cycle is especially challenging, because of their stochasticity and low probability. These extreme events and their compound impacts have significant societal and economic consequences. It is anticipated for the next-generation Earth System models (ESMs), that model predictability of the water cycle will improve with increased resolution (e.g., regionally refined E3SM), advanced software and computational architectures, and improved model physics based on the data from ARM measurements and high-fidelity models. However, the challenges for predictability of low-probability high-impact extreme events will unlikely be alleviated with conventional modeling and data-driven approaches, as ESMs are calibrated largely for capturing the high-frequency mean climate states. Recent AI and ML applications have shown great potential in quantifying well-defined climate extremes (e.g., supervised learning of tropical cyclones/atmospheric rivers by ClimateNet1) but few efforts are dedicated to compound events, extreme drivers and uncertainty estimation. We envision the opportunity to develop and apply ML and interpretable AI methods extended on the existing efforts, specifically, for: (1) identification of compound extremes, (2) diagnosing drivers of extremes, (3) bias correction in extreme predictions and (4) probabilistic modeling of extremes.

54 ENVIRONMENTAL SCIENCES↗

Characterizing uncertainty in Community Land Model version 5 hydrological applications in the United States

Abstract Land surface models such as the Community Land Model Version 5 (CLM5) are essential tools for simulating the behavior of the terrestrial system. Despite the extensive application of CLM5, limited attention has been paid to the underlying uncertainties associated with its hydrological parameters and how these uncertainties affect water resource applications. To address this long-standing issue, we use five meteorological datasets to conduct a comprehensive hydrological parameter uncertainty characterization of CLM5 over the hydroclimatic gradients of the conterminous United States. Key datasets produced from the uncertainty characterization experiment include: a benchmark dataset of CLM5 default hydrological performance, parameter sensitivities for 28 hydrological metrics, and large-ensemble outputs for CLM5 hydrological predictions. The presented datasets will assist CLM5 calibration and support broad applications, such as evaluating drought and flood vulnerabilities. The datasets can be used to identify the hydroclimatological conditions under which parametric uncertainties demonstrate substantial effects on hydrological predictions and clarify where further investigations are needed to understand how hydrological prediction uncertainties interact with other Earth system processes.

54 ENVIRONMENTAL SCIENCES↗

Concurrent Inter-Model Spread of Boreal Winter Westerly Jet Meridional Positions Between the Northern and Southern Hemispheres in CMIP6 Models

Here, this study investigates the inter-model spread of climatological extratropical westerly jets in boreal winter, using the historical simulation of 52 Coupled Model Intercomparison Project phase 6 (CMIP6) models from 1851 to 2014. The results show that there is a substantial spread in the latitude of the upper-tropospheric westerly jet across models, characterised by large inter-model standard deviations to both the poleward and equatorward sides of the jet axis, although the multi-model ensemble mean (MME) performs well in simulating meridional position of westerly jets. Furthermore, we detect the consistency of inter-model jet position spread between the Northern and Southern Hemispheres, based on the inter-model empirical orthogonal function (EOF) decomposition and correlation of regional-averaged zonal winds. Specifically, the models that simulate the westerly jets poleward/equatorward relative to the MME position in one hemisphere also tend to simulate the jets poleward/equatorward in the other hemisphere. Accordingly, we define a global jet spread index to depict the concurrence of jet shift in the two hemispheres. The results of inter-model regression analyses based on this index indicate that the models positioning the jets poleward than the MME tend to simulate a wider Hadley Cell, a poleward-shifted Ferrel Cell in the Southern Hemisphere, enhanced precipitation in the subtropics and suppressed precipitation in the tropics, and warmer sea surface temperatures in the subtropics and mid-latitudes. The present results suggest that improving the simulation of jet positions in climate models requires a comprehensive consideration of thermal states in the tropics and subtropics/mid latitudes.

54 ENVIRONMENTAL SCIENCES↗

Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3

Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations. By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date. The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Niño–Southern Oscillation (ENSO) and Madden–Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes. The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble. Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.

54 ENVIRONMENTAL SCIENCES↗