Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model intercomparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Multiple Metrics Informed Projections of Future Precipitation in China

Predicting how regional precipitation will respond to future warming is among the most challenging undertaking in climate change projection. Despite sustained efforts to improve modeling and understanding of precipitation, the overall uncertainty in projecting regional precipitation has not been reduced substantially. In this work, the potential for more robust precipitation projections is demonstrated through the use of discriminating metrics to subsample the multimodel ensemble. Using a two-dimensional metric of precipitation and its relationship with large-scale circulation indices in East Asia, 31 models in the Coupled Model Intercomparison Project Phase 5 (CMIP5) are classified into three groups. Models in the top performing group projected statistically significant increasing trends in precipitation and the regional precipitation patterns are more similar to each other than to the patterns in the bottom performing group. In contrast, models in the bottom performing group projected diverse responses, with overall small drying or no significant trends in precipitation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Simple Hybrid Sea Ice Nudging Method for Improving Control Over Partitioning of Sea Ice Concentration and Thickness

Abstract To assess the effect of ocean‐atmosphere coupling in the climate response to forced sea ice loss, the Polar Amplification Model Intercomparison Project protocol includes centennial coupled atmosphere‐ocean general circulation model simulations with imposed sea ice loss. The protocol, which specifies sea ice concentration and thickness distribution targets, does not prescribe a method for achieving them. Although different methods for imposing sea ice loss (or growth) in models have been documented, testing of the method‐dependence of the resulting climate responses has been limited. Achieving the targeted sea ice state has proven to be challenging using the so‐called ghost‐flux nudging method, which induces ice melt from below, as this method does not constrain the partitioning between thickness and concentration. We propose, describe and test a simple method that combines the advantages of direct sea ice nudging and ghost‐flux nudging. The hybrid nudging method better captures the partitioning between thickness and concentration while conserving total water content. We document how this novel sea ice constraining method reaches specific targets, enhances surface turbulent heat flux responses to sea ice loss, and induces tropospheric warming for both polar regions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Interactive Gas Chemistry for Enhanced Science Capabilities of the Energy Exascale Earth System Model Version 3

Atmospheric chemistry plays a crucial role in Earth system models (ESMs), controlling atmospheric composition and radiative balance; it is highly interactive with the physical climate, biogeochemical cycles, and human systems. However, it often imposes computational challenges in an ESM. Here we develop a full troposphere‐stratosphere interactive chemistry module for the US Department of Energy's Energy Exascale Earth System Model (E3SM). We intentionally build a streamlined module based on E3SM version 2 that interacts with other components and maintains all of major chemical and chemistry‐climate feedbacks. The module incorporates a new, highly efficient tracer advection scheme; linearization of stratospheric chemistry; and abridged tropospheric chemical mechanism with 28 reactive tracers. This new model, E3SM‐chem, can readily perform century‐long climate simulations of ozone, methane, and nitrous oxide based on emission scenarios as well as provide hourly budgets for the gas‐phase radicals that drive aerosol chemistry. We evaluate E3SM‐chem with an atmosphere‐only simulation as in the recent climate model intercomparison project (CMIP6) finding results similar to the other CMIP6 models. For the present‐day, E3SM‐chem matches the standard measurement metrics for stratospheric and tropospheric ozone, surface air quality, other key reactive gases like carbon monoxide, and the methane lifetime. Overall, E3SM‐chem maintains the climate fidelity of the baseline model while adding at most 20% to the computational cost of the atmosphere model. Hence, interactive chemistry can be a default configuration for long climate simulations at resolutions of 1° or finer, which is crucial for producing self‐consistent chemistry‐climate feedbacks that alter the climate system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Statistically bias-corrected and downscaled climate models underestimate the adverse effects of extreme heat on U.S. maize yields

Abstract Efforts to understand and quantify how a changing climate can impact agriculture often rely on bias-corrected and downscaled climate information, making it important to quantify potential biases of this approach. Here, we use a multi-model ensemble of statistically bias-corrected and downscaled climate models, as well as the corresponding parent models from the Coupled Model Intercomparison Project Phase 5 (CMIP5), to drive a statistical panel model of U.S. maize yields that incorporates season-wide measures of temperature and precipitation. We analyze uncertainty in annual yield hindcasts, finding that the CMIP5 models considerably overestimate historical yield variability while the bias-corrected and downscaled versions underestimate the largest weather-induced yield declines. We also find large differences in projected yields and other decision-relevant metrics throughout this century, leaving stakeholders with modeling choices that require navigating trade-offs in resolution, historical accuracy, and projection confidence.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

A semblance measure for model comparison

Algorithmic and computational advances have made it possible that geophysical survey and earth model design can be aided by many systematic trial inverse-modelling runs with synthetic data. Such may, for example, come up in machine-learning approaches. Automated image appraisal pertaining to such applications will involve common statistical tests for goodness-of-data fit as a primary evaluation method. However, solution non-uniqueness may render multiple images equivalent in terms of their data fit, requiring secondary categorizers. A logical choice for classifying synthetic-imaging results quantifies the goodness of model fit where a known reference model replaces the observational input. The task of model intercomparison in terms of measuring the resemblance to the reference model poses challenges to common distance-based metrics like root mean square error and mean absolute error. First, distance-based metrics can introduce spurious contributions when smooth models with fuzzy target contours are to be compared against a sharp reference. Second, large differences due to parameter-estimation overshoots can dominate distance metrics. Here, we propose a remedy that is referred to as semblance and is based on the idea of logistic functions, where a binary-dependent variable adds non-zero or zero accumulation terms for the, respectively, passing or failing of preset target thresholds. This classifying approach is amenable to an objective where model feature recognition is primary. Numerical comparisons to distance-based metrics provide evidence for the advantages of the semblance in view of this objective. Geophysical imaging in conjunction with machine-learning is seen as a benefitting upcoming application area.

58 GEOSCIENCES↗
DOE OSTI2021

Evaluating Climate Models with the CLIVAR 2020 ENSO Metrics Package

El Niño–Southern Oscillation (ENSO) is the dominant mode of interannual climate variability on the planet, with far-reaching global impacts. It is therefore key to evaluate ENSO simulations in state-of-the-art numerical models used to study past, present, and future climate. Recently, the Pacific Region Panel of the International Climate and Ocean: Variability, Predictability and Change (CLIVAR) Project, as a part of the World Climate Research Programme (WCRP), led a community-wide effort to evaluate the simulation of ENSO variability, teleconnections, and processes in climate models. The new CLIVAR 2020 ENSO metrics package enables model diagnosis, comparison, and evaluation to 1) highlight aspects that need improvement; 2) monitor progress across model generations; 3) help in selecting models that are well suited for particular analyses; 4) reveal links between various model biases, illuminating the impacts of those biases on ENSO and its sensitivity to climate change; and to 5) advance ENSO literacy. By interfacing with existing model evaluation tools, the ENSO metrics package enables rapid analysis of multipetabyte databases of simulations, such as those generated by the Coupled Model Intercomparison Project phases 5 (CMIP5) and 6 (CMIP6). The CMIP6 models are found to significantly outperform those from CMIP5 for 8 out of 24 ENSO-relevant metrics, with most CMIP6 models showing improved tropical Pacific seasonality and ENSO teleconnections. Only one ENSO metric is significantly degraded in CMIP6, namely, the coupling between the ocean surface and subsurface temperature anomalies, while the majority of metrics remain unchanged.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Steric Sea Level Rise and Relationships with Model Drift and Water Mass Representation in GFDL CM4 and ESM4

Abstract Density-driven steric seawater changes are a leading-order contributor to global mean sea level rise. However, intermodel differences in the magnitude and spatial patterns of steric sea level rise exist at regional scales and often emerge during the spinup and preindustrial control integrations of climate models. Steric sea level results from an eddy-permitting climate model, GFDL CM4, are compared with a lower-resolution counterpart, GFDL-ESM4. The results from both models are examined through basin-scale heat budgets and watermass analysis, and we compare the patterns of ocean heat uptake, redistribution, and sea level differ in ocean-only [i.e., Ocean Model Intercomparison Project (OMIP)] and coupled climate configurations. After correcting for model drift, both GFDL CM4 and GFDL-ESM4 simulate nearly equivalent ocean heat content change and global sea level rise during the historical period. However, the GFDL CM4 model exhibits as much as a 40% increase in surface ocean heat uptake in the Southern Ocean and subsequent increases in horizontal export to other ocean basins after bias correction. The results suggest regional differences in the processes governing Southern Ocean heat export, such as the formation of Antarctic Intermediate Water (AAIW), Subpolar Mode Water (SPMW), and gyre transport between the two models, and that sea level changes in these models cannot be fully bias-corrected. Since the process-level differences between the two models are evident in the preindustrial control simulations of both models, these results suggest that the control simulations are important for identifying and correcting sea level–related model biases.

Krasting, John P. [a NOAA/OAR/Geophysical Fluid Dy↗
DOE OSTI2026

Examining Cloud Feedback Components in the Simple Cloud-Resolving E3SM Atmosphere Model (SCREAM)

Cloud feedback remains the main source of uncertainty in climate sensitivity estimated by global climate models (GCMs), largely because subgrid cloud responses are parameterized in GCMs due to their coarse resolution. Here, this study examines cloud feedback in the global 3.25-km Simple Cloud-Resolving Energy Exascale Earth System Model (E3SM) Atmosphere Model (SCREAM 3 km) through a pair of 1-yr atmosphere-only simulations with control and +4-K sea surface temperature perturbations. SCREAM 3 km produces a positive cloud feedback that falls within but at the upper end of the range of Coupled Model Intercomparison Project phase 5 (CMIP5) and CMIP phase 6 (CMIP6) models and expert judgment. The positive cloud feedback arises from positive contributions from both high- and low-level clouds, with increases in high-cloud altitude and decreases in low-cloud amount and optical depth playing key roles. The stronger-than-CMIP-average feedback is mainly attributable to the high-cloud altitude feedback, owing to cloud tops rising nearly isothermally in SCREAM 3 km. The positive low-cloud amount feedback is weaker in SCREAM than in GCMs because estimated inversion strength (EIS) increases more dramatically with warming. A coarser 12-km resolution version of SCREAM exhibits a weaker positive cloud feedback than SCREAM 3 km, mainly because its low-cloud-radiative flux is more sensitive to EIS, leading to a stronger negative low-cloud amount feedback. With this process-level assessment of cloud feedback, this study reveals where SCREAM aligns with and diverges from conventional GCMs and expert assessment, providing insights to inform further model improvement and future expert assessment.

Cloud radiative effects↗
DOE OSTI2024

EAGLES Liquid Cloud Testbed Large Eddy Simulation Library (v2)

This library consists of large eddy simulation (LES) model output using the PINACLES codebase coupled to the Hebrew University Fast Spectral Bin Microphysics scheme representing shallow, liquid phase clouds from a range of global liquid cloud testbed regions as well as some well known LES model intercomparison cases. This data is particularly suitable for examining microphysical modeling assumptions in coarser-scale models, and was used for this purpose in the work "“Evaluation of Autoconversion Representation in E3SM.v2 using an Ensemble of Large-Eddy Simulations of Low-Level Warm Clouds” by M. Ovchinnikov, P.-L. Ma, C. M. Kaul, K. G. Pressel, M. Huang, J. Shpund, and S. Tang

Kaul, Colleen M↗
DOE OSTI2021

Contributions to Polar Amplification in CMIP5 and CMIP6 Models

As a step towards understanding the fundamental drivers of polar climate change, we evaluate contributions to polar warming and its seasonal and hemispheric asymmetries in Coupled Model Intercomparison Project phase 6 (CMIP6) as compared with CMIP5. CMIP6 models broadly capture the observed pattern of surface- and winter-dominated Arctic warming that has outpaced both tropical and Antarctic warming in recent decades. For both CMIP5 and CMIP6, CO 2 quadrupling experiments reveal that the lapse-rate and surface albedo feedbacks contribute most to stronger warming in the Arctic than the tropics or Antarctic. The relative strength of the polar surface albedo feedback in comparison to the lapse-rate feedback is sensitive to the choice of radiative kernel, and the albedo feedback contributes most to intermodel spread in polar warming at both poles. By separately calculating moist and dry atmospheric heat transport, we show that increased poleward moisture transport is another important driver of Arctic amplification and the largest contributor to projected Antarctic warming. Seasonal ocean heat storage and winter-amplified temperature feedbacks contribute most to the winter peak in warming in the Arctic and a weaker winter peak in the Antarctic. In comparison with CMIP5, stronger polar warming in CMIP6 results from a larger surface albedo feedback at both poles, combined with less-negative cloud feedbacks in the Arctic and increased poleward moisture transport in the Antarctic. However, normalizing by the global-mean surface warming yields a similar degree of Arctic amplification and only slightly increased Antarctic amplification in CMIP6 compared to CMIP5.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Constraints on simulated past Arctic amplification and lapse rate feedback from observations

The Arctic has warmed more rapidly than the global mean during the past few decades. The lapse rate feedback (LRF) has been identified as being a large contributor to the Arctic amplification (AA) of climate change. This particular feedback arises from the vertically non-uniform warming of the troposphere, which in the Arctic emerges as strong near-surface and muted free-tropospheric warming. Stable stratification and meridional energy transport are two characteristic processes that are evoked as causes for this vertical warming structure. Our aim is to constrain these governing processes by making use of detailed observations in combination with the large climate model ensemble of the sixth Coupled Model Intercomparison Project (CMIP6). We build on the result that CMIP6 models show a large spread in AA and Arctic LRF, which are positively correlated for the historical period of 1951–2014. Thus, we present process-oriented constraints by linking characteristics of the current climate to historical climate simulations. In particular, we compare a large consortium of present-day observations to co-located model data from subsets that show a weak and strong simulated AA and Arctic LRF in the past. Our analyses suggest that the vertical temperature structure of the Arctic boundary layer is more realistically depicted in climate models with weak (w) AA and Arctic LRF (CMIP6/w) in the past. In particular, CMIP6/w models show stronger inversions in the present climate for boreal autumn and winter and over sea ice, which is more consistent with the observations. These results are based on observations from the year-long Multidisciplinary Drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition in the central Arctic, long-term measurements at the Utqiagvik site in Alaska, USA, and dropsonde temperature profiling from aircraft campaigns in the Fram Strait. In addition, the atmospheric energy transport from lower latitudes that can further mediate the warming structure in the free troposphere is more realistically represented by CMIP6/w models. In particular, CMIP6/w models systemically simulate a weaker Arctic atmospheric energy transport convergence in the present climate for boreal autumn and winter, which is more consistent with fifth generation reanalysis of the European Centre for Medium-Range Weather Forecasts (ERA5). We further show a positive relationship between the magnitude of the present-day transport convergence and the strength of past AA. With respect to the Arctic LRF, we find links between the changes in transport pathways that drive vertical warming structures and local differences in the LRF. This highlights the mediating influence of advection on the Arctic LRF and motivates deeper studies to explicitly link spatial patterns of Arctic feedbacks to changes in the large-scale circulation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Benchmarking performance changes in the simulation of extratropical modes of variability across CMIP generations

In this work, we evaluate extratropical modes of variability in the three most recent phases of the Coupled Model Intercomparison Project (CMIP3, 5, and 6) to gauge improvement of climate models over time. A suite of high-level metrics is employed to objectively evaluate how well climate models simulate the qobserved Northern Annular Mode (NAM), North Atlantic Oscillation (NAO), Pacific North America pattern (PNA), Southern Annular Mode (SAM), Pacific Decadal Oscillation (PDO), North Pacific Oscillation (NPO), and North Pacific Gyre Oscillation (NPGO). We apply a Common Basis Function (CBF) approach that projects model anomalies onto observed empirical orthogonal functions (EOFs), together with the traditional EOF approach, to CMIP Historical and AMIP models. We find simulated spatial patterns of those modes have been significantly improved in the newer models, although the skill improvement is sensitive to the mode and season considered. We identify some potential contributions to the pattern improvement of certain modes (e.g., the Southern Hemisphere jet and High-top vertical coordinate), however the performance changes are likely attributed to gradual improvement of the base climate and multiple relevant processes. Less performance improvement is evident in the mode amplitude of these modes and systematic overestimation of the mode amplitude in spring remains in the newer climate models. We find that the post-dominant season amplitude errors in atmospheric modes are not limited to coupled runs but are often already evident in AMIP simulations. This suggests that rectifying the egregious post-dominant season amplitude errors found in many models can be addressed in an atmospheric-only framework making it more tractable to address in the model development process.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Pan-Arctic daily streamflow at 0.5-degree resolution

Data was derived using daily runoff from models participating in the Coupled Model Intercomparison Project, version 6 (CMIP6) that have been routed through the Model for Scale Adaptive River Transport (MOSART) routing model to represent streamflow at individual streamflow gage locations. Data from 750 streamflow gage locations are represented, which are indexed by gage id according to the metadata.csv file. Streamflow gage location sites were based on gage records downloaded from the United States Geological Survey (USGS), National Water Data (HYDAT) Archive from Canada, and the State Hydrological Institute of Russia. Data are available from 11 Earth System Models (ESMs) in total at a daily timestep with a duration of 1920-2099 (1850-2014 for E3SM only). The spatial domain of the modeled data is 0.5 degree resolution. Earth System Models and Units of mean daily streamflow are presented in cubic meters per second (cms). Data files consist of 11 Earth System Model mean daily streamflow output per gage location in .csv format, 1 metadata file in .csv format and 1 Readme file in .docx format (13 files in total). These data were used to benchmark CMIP6 modeled representations of streamflow against gage records.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Quasi-stationary Planetary Scale Waves in Modern Climate Models

We evaluate climate model simulations of geopotential height at the largest space-time scales, considering the first Fourier components (in longitude) of long-term climatological means. Quasi-stationary planetary scale waves emerge from this analysis. Variations of these waves are important components of climate change, for example associated with regional drought. Systematic examination of their long-term climatology provides context for understanding their evolution in time. We compare four reanalysis datasets with “historical runs” from the latest version of the Coupled Model Intercomparison Project (CMIP) and find general agreement, but we also identify model errors outside the range of both observational uncertainty and the uncertainty implied by interannual variability. Errors in wave phase have possible implications for climate model projections of regional climate and of shifting weather patterns. One model in the set we examine, originally created nearly 20 years before the others, exhibits noticeably greater errors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

ILAMBv2.7 benchmarking results comparing E3SMv2.1 land-atmosphere coupled (BGCv2LNDATM) and stand alone land (ELM) simulations with CMIP6 emission driven historical simulations

This dataset contains land model benchmarking results for the Energy Exascale Earth System Model version 2.1 (E3SMv2.1), including outputs from both coupled biogeochemistry simulations and stand-alone land model simulations. These results are compared against several emission-driven historical simulations from the Coupled Model Intercomparison Project Phase 6 (CMIP6). Benchmarking was conducted using the International Land Model Benchmarking (ILAMB) package, version 2.7 (ILAMBv2.7). CMIP6 model outputs were sourced from the Earth System Grid Federation (ESGF), while the E3SMv2.1 results were derived from raw model outputs. These outputs underwent processing steps such as time serialization, conservative regridding, and data standardization to ensure comparability. For spatial interpolation, the Earth System Modeling Framework (ESMF) tool, ESMF_RegridWeightGen, was employed to generate regridding weights, enabling the transformation of E3SM’s native cubed-sphere grid to a regular latitude-longitude grid.

Feng, Sha [PNNL]↗
DOE OSTI2023

Exploiting SMILEs and the CMIP5 Archive to Understand Arctic Climate Change Seasonality and Uncertainty

Arctic Amplification (AA) exhibits a distinct seasonal dependence; it is weakest in boreal summer and strongest in winter. Here, we analyze simulations from single-model initial-condition large ensembles and Coupled Model Intercomparison Project Phase 5 to decipher the seasonal evolution of Arctic climate change. Models agree that the annual maximum AA shifts from autumn into winter over the 21st century, accompanied by similar shifts in sea-ice loss and surface turbulent heat fluxes, whereas the maximum precipitation shifts only into late autumn. However, the exact seasonal timing and magnitude of these shifts are highly uncertain. Decomposing the uncertainty into model structural differences, emission scenarios, and internal variability reveals that model differences dominate the total uncertainty, which also undergo autumn-to-winter shifts. We also find that the scenario uncertainty is unimportant for projections of AA. These results highlight that understanding model differences is critical to reducing uncertainty in projected Arctic climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Evaluation of Ocean Biogeochemistry and Carbon Cycling in CMIP Earth System Models With the International Ocean Model Benchmarking (IOMB) Software System

Abstract The International Ocean Model Benchmarking (IOMB) software package is a new community resource that we use here to evaluate surface and upper ocean biogeochemical variables and integrated anthropogenic carbon uptake from earth system models (ESMs) contributing to the 5th and 6th phases of the Coupled Model Intercomparison Project (CMIP5 and CMIP6). IOMB generates graphics and tables for systematically comparing model predictions against multiple datasets. Our analysis reveals some improvement in the multi‐model mean from CMIP5 to CMIP6 for most of the variables we examined. Compared to data‐constrained estimates of ocean anthropogenic carbon uptake for the 1994–2007 period, negative biases exist for many models between 30 and 50°S. Global model estimates of anthropogenic carbon uptake for the same period do not change significantly from CMIP5 to CMIP6, with the combined ensemble mean estimate of 27.8 ± 0.5 Pg C lower than a data‐constrained estimate of 33.0 ± 4.0 Pg C. At the same time, the change in the natural carbon inventory from CMIP is estimated to be a source of 0.7 ± 0.3 Pg C, which is considerably smaller in magnitude than a data‐constrained estimate of 5.0 ± 3.0 Pg C. With chlorofluorocarbon (CFC) predictions available for several models, we demonstrate that negative anthropogenic dissolved inorganic carbon biases coincide with negative biases in CFC concentration, highlighting the importance of weak exchange between the surface and interior ocean in regulating rates of anthropogenic carbon uptake. To examine the robustness of this attribution across the CMIP models, we calculate the global vertical temperature gradient between 200 and 1,000 m as a metric for global stratification and exchange between the surface and deeper waters. We find a linear relationship between the bias of the vertical temperature gradients and the bias in global anthropogenic carbon uptake, consistent with the hypothesis that model biases in anthropogenic carbon uptake are related to biases in surface‐to‐interior exchange by physical processes.

58 GEOSCIENCES↗
DOE OSTI2023

Projected increase in summer heat-dome-like stationary waves over Northwestern North America

Heat-dome-like stationary waves often lead to extreme heat events, such as the unprecedented heatwave in Northwestern North America during the summer of 2021. However, future changes in summer stationary waves over Northwestern North America and the underlying driving factors remain unclear. Here, we investigate the projected changes in the anticyclonic stationary wave circulation over Northwestern North America using data from the Coupled Model Intercomparison Project Phase 6 and diagnose the circulation changes using a stationary wave model. Our findings reveal a significant 95% increase in the summer stationary wave amplitude over Northwestern North America under the high-emission scenario in 2080–2099 relative to 1995–2014. The response is mainly driven by the diabatic heating changes over the tropical Pacific which induce a Rossby wave source in the northeastern tropical Pacific, and further supported by a northward expanded waveguide in North America, both enhancing wave activity flux into the Northwestern North America. The heat-dome-like stationary wave anomaly is expected to heighten the heatwave risk over the region.

54 ENVIRONMENTAL SCIENCES↗