Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation/performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

The MERRA-2 Aerosol Reanalysis, 1980 Onward. Part I: System Description and Data Assimilation Evaluation

The Modern-Era Retrospective Analysis for Research and Applications, version 2 (MERRA-2), updates NASA’s previous satellite-era (1980 onward) reanalysis system to include additional observations and improvements to the Goddard Earth Observing System, version 5 (GEOS-5), Earth system model. As a major step toward a full Integrated Earth Systems Analysis (IESA), in addition to meteorological observations, MERRA-2 now includes assimilation of aerosol optical depth (AOD) from various ground- and space-based remote sensing platforms. Here, in the first of a pair of studies, the MERRA-2 aerosol assimilation is documented, including a description of the prognostic model (GEOS-5 coupled to the GOCART aerosol module), aerosol emissions, and the quality control of ingested observations. Initial validation and evaluation of the analyzed AOD fields are provided using independent observations from ground, aircraft, and shipborne instruments. The positive impact of the AOD assimilation on simulated aerosols is demonstrated by comparing MERRA-2 aerosol fields to an identical control simulation that does not include AOD assimilation. Fianlly, after showing the AOD evaluation, this paper takes a first look at aerosol–climate interactions by examining the shortwave, clear-sky aerosol direct radiative effect. The companion paper (Part II) evaluates and validates available MERRA-2 aerosol properties not directly impacted by the AOD assimilation (e.g., aerosol vertical distribution and absorption). Importantly, while highlighting the skill of the MERRA-2 aerosol assimilation products, both studies point out caveats that must be considered when using this new reanalysis product for future studies of aerosols and their interactions with weather and climate.

54 ENVIRONMENTAL SCIENCES↗

An Evaluation of Marine Boundary Layer Cloud Property Simulations in the Community Atmosphere Model Using Satellite Observations: Conventional Subgrid Parameterization versus CLUBB

This paper presents a satellite-observation-based evaluation of the marine boundary layer (MBL) cloud properties from two Community Atmosphere Model, version 5 (CAM5), simulations, one with the standard parameterization schemes (CAM5–Base) and the other with the Cloud Layers Unified by Binormals scheme (CAM5–CLUBB). When comparing the direct model outputs, the authors find that CAM5–CLUBB produces more MBL clouds, a smoother transition from stratocumulus to cumulus, and a tighter correlation between in-cloud water and cloud fraction than CAM5–Base. In the model-to-observation comparison using the COSP satellite simulators, the authors find that both simulations capture the main features and spatial patterns of the observed cloud fraction from MODIS and shortwave cloud radiative forcing (SWCF) from CERES. However, CAM5–CLUBB suffers more than CAM5–Base from a problem that can be best summarized as “undetectable” clouds (i.e., a significant fraction of simulated MBL clouds are thinner than the MODIS detection threshold). This issue leads to a smaller COSP–MODIS cloud fraction and a weaker SWCF in CAM5–CLUBB than the observations and also CAM5–Base in the tropical descending regions. Finally, the authors compare modeled radar reflectivity with CloudSat observations and find that both simulations, especially CAM5–CLUBB, suffer from an excessive drizzle problem. Further analysis reveals that the subgrid precipitation enhancement factors in CAM5–CLUBB are unrealistically large, which makes MBL clouds precipitate too excessively, and in turn results in too many undetectable thin clouds.

54 ENVIRONMENTAL SCIENCES↗

Sources of Uncertainty in Modeled Land Carbon Storage within and across Three MIPs: Diagnosis with Three New Techniques

Terrestrial carbon cycle models have incorporated increasingly more processes as a means to achieve more-realistic representations of ecosystem carbon cycling. Despite this, there are large across-model variations in the simulation and projection of carbon cycling. Several model intercomparison projects (MIPs), for example, the fifth phase of the Coupled Model Intercomparison Project (CMIP5) (historical simulations), Trends in Net Land–Atmosphere Carbon Exchange (TRENDY), and Multiscale Synthesis and Terrestrial Model Intercomparison Project (MsTMIP), have sought to understand intermodel differences. Here in this study, the authors developed a suite of new techniques to conduct post-MIP analysis to gain insights into uncertainty sources across 25 models in the three MIPs. First, terrestrial carbon storage dynamics were characterized by a three-dimensional (3D) model output space with coordinates of carbon residence time, net primary productivity (NPP), and carbon storage potential. The latter represents the potential of an ecosystem to lose or gain carbon. This space can be used to measure how and why model output differs. Models with a nitrogen cycle generally exhibit lower annual NPP in comparison with other models, and mostly negative carbon storage potential. Second, a transient traceability framework was used to decompose any given carbon cycle model into traceable components and identify the sources of model differences. The carbon residence time (or NPP) was traced to baseline carbon residence time (or baseline NPP related to the maximum carbon input), environmental scalars, and climate forcing. Third, by applying a variance decomposition method, the authors show that the intermodel differences in carbon storage can be mainly attributed to the baseline carbon residence time and baseline NPP (>90% in the three MIPs). The three techniques developed in this study offer a novel approach to gain more insight from existing MIPs and can point out directions for future MIPs. Finally, since this study is conducted at the global scale for an overview on intermodel differences, future studies should focus more on regional analysis to identify the sources of uncertainties and improve models at the specified mechanism level.

54 ENVIRONMENTAL SCIENCES↗

Using the Atmospheric Radiation Measurement (ARM) Datasets to Evaluate Climate Models in Simulating Diurnal and Seasonal Variations of Tropical Clouds

We use the long-term Atmospheric Radiation Measurement (ARM) datasets collected at the three Tropical Western Pacific (TWP) sites as a tropical testbed to evaluate the ability of the Community Atmosphere Model (CAM5) to simulate the various types of clouds, their seasonal and diurnal variations, and their impact on surface radiation. We conducted a series of CAM5 simulations at various horizontal grid spacing (around 2°, 1°, 0.5°, and 0.25°) with meteorological constraints from reanalysis. Model biases in the seasonal cycle of cloudiness are found to be weakly dependent on model resolution. Positive biases (up to 20%) in the annual mean total cloud fraction appear mostly in stratiform ice clouds. Higher-resolution simulations do reduce the positive bias in the frequency of ice clouds, but they inadvertently increase the negative biases in convective clouds and low-level liquid clouds, leading to a positive bias in annual mean shortwave fluxes at the sites, as high as 65 W m-2 in the 0.25° simulation. Such resolution-dependent biases in clouds can adversely lead to biases in ambient thermodynamic properties and, in turn, feedback on clouds. Both the CAM5 model and ARM observations show distinct diurnal cycles in total, stratiform and convective cloud fractions; however, they are out-of-phase by 12 hours and the biases vary by site. Our results suggest that biases in deep convection affect the vertical distribution and diurnal cycle of stratiform clouds through the transport of vapor and/or the detrainment of liquid and ice. We also found that the modelled gridmean surface longwave fluxes are systematically larger than site measurements when the grid that the ARM sites reside in is partially covered by ocean. The modeled longwave fluxes at such sites also lack a discernable diurnal cycle because the ocean part of the grid is warmer and less sensitive to radiative heating/cooling compared to land. Higher spatial resolution is more helpful is this regard. Our testbed approach can be easily adapted for the evaluation of new parameterizations being developed for CAM5 or other global or regional model simulations at high spatial resolutions.

Wang, Hailong↗

Evaluation of Planetary Boundary Layer Simulation in GFDL Atmospheric General Circulation Models

This study describes the performance of two Geophysical Fluid Dynamics Laboratory (GFDL) atmospheric general circulation models (AGCMs) in simulating the climatologies of planetary boundary layer (PBL) parameters, with a particular focus on the diurnal cycles. The two models differ solely in the PBL parameterization: one uses a prescribed K-profile parameterization (KPP) scheme with an entrainment parameterization, and the other employs a turbulence kinetic energy (TKE) scheme. The models are evaluated through comparison with the reanalysis ensemble, which is generated from European Centre for Medium-Range Weather Forecasts (ECMWF) twentieth-century reanalysis (ERA-20C), ERA-Interim, NCEP CFSR, and NASA MERRA, and the following systematic biases are identified. The models exhibit widespread cold biases in the high latitudes, and the biases are smaller when the KPP scheme is used. The diurnal cycle amplitudes are underestimated in most dry regions, and the model with the TKE scheme simulates larger amplitudes. For the near-surface winds, the models underestimate both the daily means and the diurnal amplitudes; the differences between the models are relatively small compared to the biases. The role of the PBL schemes in simulating the PBL parameters is investigated through the analysis of vertical profiles. The Sahara, which is suitable for focusing on the role of vertical mixing in dry PBLs, is selected for a detailed analysis. It reveals that compared to the KPP scheme, the heat transport is weaker with the TKE scheme in both convective and stable PBLs as a result of weaker vertical mixing, resulting in larger diurnal amplitudes. Lack of nonlocal momentum transport from the nocturnal low-level jets to the surfaces appears to explain the underestimation of the near-surface winds in the models.

58 GEOSCIENCES↗

Evaluating the Bias of South China Sea Summer Monsoon Precipitation Associated with Fast Physical Processes Using a Climate Model Hindcast Approach

Abstract The present study aims to identify the precipitation bias associated with the interactions among fast physical processes in the Community Atmospheric Model, version 5 (CAM5), during the abrupt onset of the South China Sea (SCS) summer monsoon, a key precursor of the overall East Asia summer monsoon (EASM). The multiyear hindcast approach is utilized to obtain the well-constrained synoptic-scale horizontal circulation each year during the onset period from the years 1998 to 2012. In the pre-onset period, the ocean precipitation over the SCS is insufficiently suppressed in CAM5 hindcasts and thus weaker land–ocean precipitation contrasts. This is associated with the weaker and shallower convection simulated over the surrounding land, producing weaker local circulation within the SCS basin. In the post-onset period, rainfall of the organized convection over the Philippine coastal ocean is underestimated in the hindcasts, with overestimated upper-level heating. These biases are further elaborated as the underrepresentation of the convection diurnal cycle and coastal convection systems, as well as the issue of precipitation sensitivity to environmental moisture during the SCS onset period. The biases identified in hindcasts are consistent with the general bias of the EASM in the climate simulation of CAM5. The current results highlight that the appropriate representation of land–ocean–convection interactions over coastal areas can potentially improve the simulation of seasonal transition over the monsoon regions.

54 ENVIRONMENTAL SCIENCES↗

Arctic Sea Ice Volume Variability over 1901–2010: A Model-Based Reconstruction

PIOMAS-20C, an Arctic sea ice reconstruction for 1901–2010, is produced by forcing the Pan-Arctic Ice Ocean Modeling and Assimilation System (PIOMAS) with ERA-20C atmospheric data. ERA-20C performance over Arctic sea ice is assessed by comparisons with measurements and data from other reanalyses. ERA-20C performs similarly with respect to the annual cycle of downwelling radiation, air temperature, and wind speed compared to reanalyses with more extensive data assimilation such as ERA-Interim and MERRA. PIOMAS-20C sea ice thickness and volume are then compared with in situ and aircraft remote sensing observations for the period of ~1950–2010. Error statistics are similar to those for PIOMAS. We compare the magnitude and patterns of sea ice variability between the first half of the twentieth century (1901–40) and the more recent period (1980–2010), both marked by sea ice decline in the Arctic. The first period contains the so-called early-twentieth-century warming (ETCW; ~1920–40) during which the Atlantic sector saw a significant decline in sea ice volume, but the Pacific sector did not. The sea ice decline over the 1979–2010 period is pan-Arctic and 6 times larger than the net decline during the 1901–40 period. Sea ice volume trends reconstructed solely from surface temperature anomalies are smaller than PIOMAS-20C, suggesting that mechanisms other than warming, such as changes in ice motion and deformation, played a significant role in determining sea ice volume trends during both periods.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Modeled Precipitation in Oceanic Extratropical Cyclones Using IMERG

Using a high-spatial- and high-temporal-resolution precipitation dataset, Integrated Multi-satellite Retrievals for GPM (IMERG), extratropical cyclone precipitation is evaluated in two reanalyses and two climate models. Based on cyclone-centered composites, all four models overestimate precipitation in the western subsiding and dry side of the cyclones, and underestimate the precipitation in the eastern ascending and moist side. By decomposing the composites into frequency of occurrence and intensity (mean precipitation rate when precipitating), the analysis reveals a tendency for all four models to overestimate frequency and underestimate intensity, with the former issue dominating in the western half and the latter in the eastern half of the cyclones. Differences in frequency are strongly dependent on cyclone environmental moisture, while the differences in intensity are strongly impacted by the strength of ascent within the cyclone. There are some uncertainties associated with the observations: IMERG might underreport frozen precipitation and possibly exaggerate rates in vigorously ascending regions. Nevertheless, the analysis suggests that all models produce extratropical cyclone precipitation too often and too lightly. These biases have consequences when evaluating the changes in precipitation characteristics with changes in cyclone properties: the models disagree on the magnitude of the change in precipitation intensity with a change in environmental moisture and in precipitation frequency with a change in cyclone strength. This complicates accurate predictions of precipitation changes in a changing climate.

54 ENVIRONMENTAL SCIENCES↗

Impact of Model Resolution on Tropical Cyclone Simulation Using the HighResMIP–PRIMAVERA Multimodel Ensemble

A multimodel, multiresolution set of simulations over the period 1950–2014 using a common forcing protocol from CMIP6 HighResMIP have been completed by six modeling groups. Analysis of tropical cyclone performance using two different tracking algorithms suggests that enhanced resolution toward 25 km typically leads to more frequent and stronger tropical cyclones, together with improvements in spatial distribution and storm structure. Both of these factors reduce typical GCM biases seen at lower resolution. Using single ensemble members of each model, there is little evidence of systematic improvement in interannual variability in either storm frequency or accumulated cyclone energy as compared with observations when resolution is increased. Changes in the relationships between large-scale drivers of climate variability and tropical cyclone variability in the Atlantic Ocean are also not robust to model resolution. However, using a larger ensemble of simulations (of up to 14 members) with one model at different resolutions does show evidence of increased skill at higher resolution. The ensemble mean correlation of Atlantic interannual tropical cyclone variability increases from ~0.5 to ~0.65 when resolution increases from 250 to 100 km. In the northwestern Pacific Ocean the skill keeps increasing with 50-km resolution to 0.7. These calculations also suggest that more than six members are required to adequately distinguish the impact of resolution within the forced signal from the weather noise.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Mesoscale Convective Systems in Climate Simulations: Methodological Development and Results from MPAS-CAM over the U.S.

In this study, a process-oriented approach is developed to evaluate warm-season mesoscale convective system (MCS) precipitation and their favorable large-scale meteorological patterns (FLSMPs) over the U.S. This approach features a novel observation-driven MCS-tracking algorithm using infrared brightness temperature and precipitation feature at 12, 25 and 50 km resolution and metrics to evaluate the model large-scale environment favorable for MCS initiation. The tracking algorithm successfully reproduces the observed MCS statistics from a reference 4-km radar MCS database. To demonstrate the utility of the new methodologies in evaluating MCS in climate simulations with mesoscale resolution, the process-oriented approach is applied to two climate simulations produced by the Variable-Resolution Model for Prediction Across Scales coupled to the Community Atmosphere Model physics, with refined horizontal grid spacing at 50 km and 25 km over North America. With the tracking algorithm applied to simulations and observations at equivalent resolutions, the simulated number of MCS and associated precipitation amount, frequency and intensity are found to be consistently underestimated in the Central U.S., particularly from May to August. The simulated MCS precipitation shows little diurnal variation and lasts too long, while MCS precipitation area is too large and intensity is too weak. The model is able to simulate four types of observed FLSMP associated with frontal systems and low-level jets (LLJ) in spring, but the frequencies are underestimated because of low-level dry bias and weaker LLJ. Precipitation simulated under different FLSMPs peak during daytime, in contrast to the observed nocturnal peak. Implications of these findings for future model development and diagnostics are discussed.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Diurnal and Semi-Diurnal Cycle of Precipitation in CMIP6 Models Using Satellite- and Ground-Based Observations

We report the diurnal and semi-diurnal cycle of precipitation simulated from CMIP6 models during 1996-2005 are evaluated globally between 60°S and 60°N, as well as at ten selected locations representing three categories of diurnal cycle of precipitation: (1) afternoon precipitation over land, (2) early morning precipitation over ocean, and (3) nocturnal precipitation over land. Three satellite-based and two ground-based rainfall products are used to evaluate the climate models. Globally, the ensemble mean of CMIP6 models shows a diurnal phase of 3 to 4 hours earlier over land and 1 to 2 hours earlier over ocean, when compared with the latest satellite products. These biases are in line with what were found in previous versions of climate models but reduced compared to the CMIP5 ensemble mean. Analysis at the selected locations complimented with in-situ measurements further reinforces these results. Several CMIP6 models have shown a significant improvement in the diurnal cycle of precipitation compared to their CMIP5 counterparts, notably on delaying afternoon precipitation over land. This can be attributed to the use of more sophisticated convective parameterizations. Most models are still unable to capture the nocturnal peak associated with elevated convection and propagating mesoscale convective systems, with a few exceptions that allow convection to be initiated above the boundary layer to capture nocturnal elevated convection. We also quantify an encouraging consistency between the satellite- and ground-based precipitation measurements despite differing spatiotemporal resolutions and sampling periods, which provides confidence in using them to evaluate the diurnal and semi-diurnal cycle of precipitation in climate models.

58 GEOSCIENCES↗

Understanding the Roles of Convective Trigger Functions in the Diurnal Cycle of Precipitation in the NCAR CAM5

The wrong diurnal cycle of precipitation is a common weakness of current global climate models (GCMs). To improve the simulation of the diurnal cycle of precipitation and understand what physical processes control it, we test a convective trigger function described in Xie et al. (2019) with additional optimizations in the NCAR Community Atmosphere Model version 5 (CAM5). The revised trigger function consists of three modifications: 1) replacing the Convective Available Potential Energy (CAPE) trigger with a dynamic CAPE (dCAPE) trigger, 2) allowing convection to originate above the top of planetary boundary layer (i.e., the unrestricted air parcel launch level - ULL), and 3) optimizing the entrainment rate and threshold value of the dynamic CAPE generation rate for convection onset based on observations. Results from 1°-resolution simulations show that the revised trigger can alleviate the long-standing GCM problem of too early maximum precipitation during the day and missing the nocturnal precipitation peak that is observed in many regions, including the U.S. southern Great Plains (SGP). The revised trigger also improves the simulation of the propagation of precipitation systems downstream of the Rockies and the Amazon region. A further composite analysis over the SGP unravels the mechanisms through which the revised trigger affects convection. Additional sensitivity tests show that both the peak time and the amplitude of the diurnal cycle of precipitation are sensitive to the entrainment rate and dCAPE threshold values.

54 ENVIRONMENTAL SCIENCES↗

Analyzing Relationships between Tropical Cyclone Intensity and Rain Rate over the Ocean Using Numerical Simulations

In this study, the relationship between tropical cyclone (TC) intensity and rain rate over the ocean is investigated using a full-physics numerical model (WRF) and a physics-based TC rainfall model (TCR). TC intensity is found to be nearly linearly correlated with the average rain rate in the inner core [~0.97 (mm h –1 m –2 )/(m s –1 )], while the correlation is weak at outer radii. This difference is induced because TC intensity is significantly correlated with both the vertical velocity and specific humidity in the inner core but is not significantly correlated with the vertical velocity in the outer radii. Further investigation shows that the intensity–rain-rate relationship at the outer radii is influenced by the TC evolution stage. The rain rate for the outer radii is positively correlated with TC intensity for nondecaying TCs, while this correlation is reduced for decaying TCs due to systematic downdrafts in the outer radii. In the context of climate change, the sensitivity of the TC rain rate to sea surface temperature (SST) is found to be +9% per 1 K increase of SST, roughly the product of the sensitivity of TC intensity to SST (+3%) and the Clausius-Clapeyron scaling (+7%). Coupled with synthetic storms, evolution of the TC rain rate over the twenty-first century under the SSP5-8.5 scenario is projected by the TCR (calibrated with the WRF simulations). The annual increase rates of averaged TC rain rate are 0.17% and 0.20% for the inner core and outer radii, respectively, larger than the annual increase rate of TC intensity (0.046%) but comparable to that of cube of intensity (0.18%).

54 ENVIRONMENTAL SCIENCES↗

A Surface Radiation Balance Dataset from Siple Dome in West Antarctica for Atmospheric and Climate Model Evaluation

Abstract A field campaign at Siple Dome in West Antarctica during the austral summer 2019/20 offers an opportunity to evaluate climate model performance, particularly cloud microphysical simulation. Over Antarctic ice sheets and ice shelves, clouds are a major regulator of the surface energy balance, and in the warm season their presence occasionally induces surface melt that can gradually weaken an ice shelf structure. This dataset from Siple Dome, obtained using transportable and solar-powered equipment, includes surface energy balance measurements, meteorology, and cloud remote sensing. To demonstrate how these data can be used to evaluate model performance, comparisons are made with meteorological reanalysis known to give generally good performance over Antarctica (ERA5). Surface albedo measurements show expected variability with observed cloud amount, and can be used to evaluate a model’s snowpack parameterization. One case study discussed involves a squall with northerly winds, during which ERA5 fails to produce cloud cover throughout one of the days. A second case study illustrates how shortwave spectroradiometer measurements that encompass the 1.6- μ m atmospheric window reveal cloud phase transitions associated with cloud life cycle. Here, continuously precipitating mixed-phase clouds become mainly liquid water clouds from local morning through the afternoon, not reproduced by ERA5. We challenge researchers to run their various regional or global models in a manner that has the large-scale meteorology follow the conditions of this field campaign, compare cloud and radiation simulations with this Siple Dome dataset, and potentially investigate why cloud microphysical simulations or other model components might produce discrepancies with these observations. significance statement Antarctica is a critical region for understanding climate change and sea level rise, as the great ice sheets and the ice shelves are subject to increasing risk as global climate warms. Climate models have difficulties over Antarctica, particularly with simulation of cloud properties that regulate snow surface melting or refreezing. Atmospheric and climate-related field work has significant challenges in the Antarctic, due to the small number of research stations that can support state-of-the-art equipment. Here we present new data from a suite of transportable and solar-powered instruments that can be deployed to remote Antarctic sites, including regions where ice shelves are most at risk, and we demonstrate how key components of climate model simulations can be evaluated against these data.

54 ENVIRONMENTAL SCIENCES↗

The Misrepresentation of the Southern African Easterly Jet in Models and Its Implications for Aerosol, Clouds, and Precipitation Distributions

The southern African easterly jet (AEJ-S) is an important midtropospheric feature critical to understanding the tropical convective system over central Africa and the aerosol–cloud interactions over the southeast Atlantic Ocean. However, it remains unclear how well models represent the AEJ-S and its influence on aerosol transport, clouds, and precipitation distribution. Here, in this work, we use ground- and satellite-based observations and reanalysis datasets to assess the representation of AEJ-S in the Coupled Model Intercomparison Project phase 6 (CMIP6) models between September and October during the peak of midtropospheric winds, aerosol transport, clouds, and precipitation. We find that most CMIP6 models have difficulty accurately simulating the strength, position, and spatial distribution of the AEJ-S. Specifically, the AEJ-S is relatively weaker and at a slightly lower altitude in the ensemble of CMIP6 models than represented by observation and reanalysis datasets. To assess the influence of the misrepresented the AEJ-S on CMIP6-simulated aerosol, clouds, and precipitation distributions, we performed composite analyses using models with low and high biases based on the estimates of their midtropospheric easterly wind speed. We find that the misrepresentation of the AEJ-S in CMIP6 models is associated with the overestimation of clouds and precipitation over central Africa, the underestimation of clouds over the southeast Atlantic Ocean, and the limitation of aerosol transport over the continent or the deviation of its spatial distribution from the typical zonal transport over the Atlantic Ocean. Because aerosols, clouds, and precipitation are important components of the regional climate system, we conclude that accurate representation of the AEJ-S is essential over central Africa and the southeast Atlantic Ocean.

54 ENVIRONMENTAL SCIENCES↗

Assessment of CMIP5 and CMIP6 AMIP Simulated Clouds and Surface Shortwave Radiation Using ARM Observations over Different Climate Regions

The simulations of clouds and surface radiation from 10 CMIP6 models and their CMIP5 predecessors are compared to the ARM ground-based observations over different climate regions. Compared to the ARM radar-lidar derived total cloud fractions (CFT) and cloud fraction vertical distributions over the six selected sites, both CMIP5 and CMIP6 significantly underestimated CFT and low-level CF over the Northern Hemispheric midlatitude sites (SGPC1 and ENAC1), although the biases are generally smaller in CMIP6. Over the tropical oceanic site (TWPC2), 5 out of 10 CMIP6 models better simulated low-level CF than their CMIP5 predecessors. CMIP6 simulations generally agreed well with the ARM observations in CFT and cloud fraction vertical distributions over the tropical continental (MAOM1) and coastal (TWPC3) sites but missed the transitions between dry and wet seasons, similar to CMIP5 simulations. The improvements in downwelling shortwave fluxes (SWdn) at the surface from the majority of CMIP6 compared to CMIP5 primarily resulted from the improved cloud fraction simulations, especially over the SGPC1, ENAC1, and TWPC3 sites. By contrast, both CMIP5 and CMIP6 models exhibited diverse performances of clouds and shortwave radiation over the Arctic site (NSAC1), where CMIP6 models produced more clouds than CMIP5 models, especially for the low-level clouds. The comparisons between observations and CMIP5 and CMIP6 simulations provide valuable quantitative assessments of the accuracy of mean states and variabilities in the model simulations and shed light on general directions to improve climate models in different regions.

54 ENVIRONMENTAL SCIENCES↗

Understanding the Biases in Global Monsoon Simulations from the Perspective of Atmospheric Energy Transport

Understanding global monsoon (GM) variability and projecting its future changes rely heavily on climate models. However, climate models generally show pronounced biases in GM simulations, and the reasons for this remain unclear. Here, in this study, we evaluate the performance of 20 pairs of climate models that participated in both phase 5 of the Coupled Model Intercomparison Project (CMIP5) and phase 6 of CMIP (CMIP6) and identify the sources of their GM simulation biases from an energy transport perspective. The multimodel mean improvement in CMIP6 compared to CMIP5 is demonstrated by the increasing skill scores for various GM metrics from 0.20–0.79 to 0.48–0.83. More specifically, the dry biases in the Northern Hemisphere Summer Monsoon (NHSM) precipitation in CMIP5 [root-mean-square error (RMSE): 1.85 mm day −1 ] are reduced in CMIP6 (RMSE: 1.66 mm day −1 ). This higher simulation skill is associated with higher skill in simulating the precipitation-solstitial mode, monsoon intensity, and monsoon domains. The improvement in the NHSM precipitation simulation results from that in the meridional transport of atmospheric energy. Atmospheric energy budget analysis shows that the negative biases in downward surface longwave radiation and northward energy transport are smaller in CMIP6 than in CMIP5 in the boreal summer, resulting in a more realistic interhemispheric thermal contrast and meridional gradient of moist static energy. However, a major weakness of the CMIP6 models is found in the Southern Hemisphere Summer Monsoon precipitation simulation due to the positive bias in the top-of-the-atmosphere downward longwave radiation. This study shows that reasonably reproducing the meridional global atmospheric energy transportation is necessary for skillful GM simulation.

54 ENVIRONMENTAL SCIENCES↗

Are North Atlantic Tropical Cyclones Modulated by the Madden–Julian Oscillation in HighResMIP AGCMs?

This study assesses the representation of the observed relationship between Atlantic tropical cyclones (TCs) and the Madden–Julian oscillation (MJO) across nine models participating in CMIP6 High Resolution Model Intercomparison Project (HighResMIP). Most models struggle to faithfully reproduce the observed impacts of the MJO on Atlantic TCs, with the primary issue being the underestimated TC activity over the Atlantic main development region (MDR). The negative biases in genesis frequency within the MDR can be further attributed to weaker-than-observed African easterly wave (AEW) activity south of ∼12°N. Errors in the diabatic heating profile within the Atlantic intertropical convergence zone lead to insufficient potential vorticity production in the lower troposphere and constrain the amplification of AEWs. In addition to the biased TC climatology, the eastward-propagating power of the MJO is consistently underestimated across all models. Nevertheless, in models with a higher eastward–westward power ratio, the simulated MJO demonstrates a stronger capacity to modulate subseasonal TC activity. Models with relatively realistic eastward propagation of the MJO also exhibit greater variance in tropical intraseasonal convection. Stronger contrasts in convective heating over the North Atlantic between phases 2–3 and phases 6–7 drive larger fluctuations in MDR shear and AEW activity over the Gulf of Mexico and West Africa, resulting in a more pronounced TC response to the MJO. Overall, our findings suggest that improved MDR TC climatology and MJO propagation are essential for models to accurately capture the observed modulations of Atlantic TCs by the MJO.

54 ENVIRONMENTAL SCIENCES↗