Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation/performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Earth System Reanalysis in Support of Climate Model Improvements

Recent climate model developments, established through increased model resolution, have led to substantial improvements in model simulations of the time-evolving, coupled Earth system and its subcomponents. However, regardless of resolution, climate models will always produce climate features and variability that differ from the real world and will be prone to biases. This is due to many remaining uncertainties, such as in parametric and structural model uncertainty, in the initial conditions prescribed, and in the prescribed (scenario) forcing which varies on decadal to centennial timescales. Further model improvements are expected to arise specifically from improved representation of physical processes realized through model-data fusion. This will create an unprecedented opportunity to better exploit a large array of Earth observations, from in situ measurements to weather radars and satellite observations, as the resolved scales of the models approach those of the observations. For this, climate DA will be the central tool to bring models and observations into consistency, by improving initial conditions, inferring uncertain model parameters and structure, and quantifying uncertainty. Generally, there will be advantages and complementarities of adjoint-based smoother approaches, ensemble-based filter approaches, or new ML-inspired approaches. Yet, the ever-increasing model resolution will present growing challenges arising from computational cost, calling for new ways of performing data assimilation and model optimization. Using the complementarity in a hybrid approach, blending tools and concepts from variational, ensemble and ML methods might be what is required in the future. In this context ML could be important to handle non-linear responses, and to better approximate non-Gaussian distributions.

54 ENVIRONMENTAL SCIENCES↗

Patterns of Precipitation Change and Climatological Uncertainty among CMIP5 Models, with a Focus on the Midlatitude Pacific Storm Track

Projections of modeled precipitation ( P ) change in global warming scenarios demonstrate marked intermodel disagreement at regional scales. Empirical orthogonal functions (EOFs) and maximum covariance analysis (MCA) are used to diagnose spatial patterns of disagreement in the simulated climatology and end-of-century P changes in phase 5 of the Coupled Model Intercomparison Project (CMIP5) archive. The term principal uncertainty pattern (PUP) is used for any robust mode calculated when applying these techniques to a multimodel ensemble. For selected domains in the tropics, leading PUPs highlight features at the margins of convection zones and in the Pacific cold tongue. The midlatitude Pacific storm track is emphasized given its relevance to wintertime P projections over western North America. The first storm-track PUP identifies a sensitive region of disagreement in P increases over the eastern midlatitude Pacific where the storm track terminates, related to uncertainty in an eastward extension of the climatological jet. The second PUP portrays uncertainty in a zonally asymmetric meridional shift of storm-track P , related to uncertainty in the extent of a poleward jet shift in the western Pacific. Both of these modes appear to arise primarily from intermodel differences in the response to radiative forcing, distinct from sampling of internal variability. The leading storm-track PUPs for P and zonal wind change exhibit similarities to the leading uncertainty patterns for the historical climatology, indicating important and parallel sensitivities in the eastern Pacific storm-track terminus region. However, expansion coefficients for climatological uncertainties tend to be weakly correlated with those for end-of-century change.

54 ENVIRONMENTAL SCIENCES↗

High-Resolution Tropical Channel Model Simulations of Tropical Cyclone Climatology and Intraseasonal-to-Interannual Variability

We tailored a tropical channel configuration of the Weather Research and Forecasting (WRF) Model to study tropical cyclone (TC) activity and associated climate variabilities. This tropical channel model (TCM) covers from 30°S to 50°N at 27-km horizontal resolution, with physics parameterizations carefully selected to achieve more realistic simulations of TCs and large-scale climate mean states. In this work we performed 15-member ensembles of retrospective simulations from 1982 to 2016 hurricane seasons. A thorough comparison with observations demonstrates that the TCM yields significant skills in simulating TC activity climatology and variabilities in each basin, as well as TC physical structures. The correlation of the ensemble averaged accumulated cyclone energy (ACE) with observations in the western North Pacific (WNP), eastern North Pacific (ENP), and North Atlantic (NAT) is 0.80, 0.64, and 0.61, respectively, but is insignificant in the north Indian Ocean (NIO). Moreover, the TCM-simulated modulations of El Niño–Southern Oscillation (ENSO) and the Madden–Julian oscillation (MJO) on the large-scale environment and TC genesis also agree well with observations. To examine the TCM’s potential for seasonal TC prediction, the model is used to forecast the 2017 and 2018 hurricane seasons, using bias-corrected sea surface temperatures (SSTs) from the CFSv2 seasonal prediction results. The TCM accurately predicts the hyperactive 2017 NAT hurricane season and near-normal WNP and ENP hurricane seasons when initialized in May. In addition, the TCM accurately predicts TC activity in the NAT and WNP during the 2018 season, but underpredicts ENP TC activity, in association with a poor ENSO forecast.

54 ENVIRONMENTAL SCIENCES↗

An Intercomparison of GCM and RCM Dynamical Downscaling for Characterizing the Hydroclimatology of California and Nevada

Abstract Dynamical downscaling is a widely used technique to properly capture regional surface heterogeneities that shape the local hydroclimatology. However, in the context of dynamical downscaling, the impacts on simulation fidelity have not been comprehensively evaluated across many user-specified factors, including the refinements of model horizontal resolution, large-scale forcing datasets, and dynamical cores. Two global-to-regional downscaling methods are used to assess these: specifically, the variable-resolution Community Earth System Model (VR-CESM) and the Weather Research and Forecasting (WRF) Model with horizontal resolutions of 28, 14, and 7 km. The modeling strategies are assessed by comparing the VR-CESM and WRF simulations with consistent physical parameterizations and grid domains. Two groups of WRF Models are driven by either the NCEP reanalysis dataset (WRF_NCEP) or VR-CESM7 results (WRF_VRCESM) to evaluate the effects of large-scale forcing datasets. The simulated hydroclimatologies are compared with reference datasets for key properties including total precipitation, snow cover, snow water equivalent (SWE), and surface temperature. The large-scale forcing datasets are critical to the WRF simulations of total precipitation but not surface temperature, controlled by the wind field and atmospheric moisture transport at the ocean boundary. No significant benefit is found in the regional average simulated hydroclimatology by increasing horizontal resolution refinement from 28 to 7 km, probably due to the systematic biases from the diagnostic treatment of rainfall and snowfall in the microphysics scheme. The choice of dynamical core has little impact on total precipitation but significantly determines simulated surface temperature, which is affected by the snow-albedo feedback in winter and soil moisture estimations in summer.

54 ENVIRONMENTAL SCIENCES↗

Pooling Data Improves Multimodel IDF Estimates over Median-Based IDF Estimates: Analysis over the Susquehanna and Florida

Traditional multimodel methods for estimating future changes in precipitation intensity, duration, and frequency (IDF) curves rely on mean or median of models’ IDF estimates. Such multimodel estimates are impaired by large estimation uncertainty, shadowing their efficacy in planning efforts. Here, assuming that each climate model is one representation of the underlying data generating process, i.e., the Earth system, we propose a novel extension of current methods through pooling model data: (i) evaluate performance of climate models in simulating the spatial and temporal variability of the observed annual maximum precipitation (AMP), (ii) bias-correct and pool historical and future AMP data of reasonably performing models, and (iii) compute IDF estimates in a nonstationary framework from pooled historical and future model data. Pooling enhances fitting of the extreme value distribution to the data and assumes that data from reasonably performing models represent samples from the “true” underlying data generating distribution. Through Monte Carlo simulations with synthetic data, we show that return periods derived from pooled data have smaller biases and lesser uncertainty than those derived from ensembles of individual model data. We apply this method to NA-CORDEX models to estimate changes in 24-h precipitation intensity–frequency (PIF) estimates over the Susquehanna watershed and Florida peninsula. Our approach identifies significant future changes at more stations compared to median-based PIF estimates. The analysis suggests that almost all stations over the Susquehanna and at least two-thirds of the stations over the Florida peninsula will observe significant increases in 24-h precipitation for 2–100-yr return periods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Case Study of Observed and Modeled Barrier Flow in the Denmark Strait in May 2015

Abstract Mesoscale barrier jets in the Denmark Strait are common in winter months and have the capability to influence open ocean convection. This paper presents the first detailed observational study of a summertime (21 May 2015) barrier wind event in the Denmark Strait using dropsondes and observations from an airborne Doppler wind lidar (DWL). The DWL profiles agree well with dropsonde observations and show a vertically narrow (~250–400 m) barrier jet of 23–28 m s−1 near the Greenland coast that broadens (~300–1000 m) and strengthens farther off coast. In addition, otherwise identical regional high-resolution Weather Research and Forecasting (WRF) Model simulations of the event are analyzed at four horizontal grid spacings (5, 10, 25, and 50 km), two vertical resolutions (40 and 60 levels), and two planetary boundary layer (PBL) parameterizations [Mellor–Yamada–Nakanishi–Niino, version 2.5 (MYNN2.5) and University of Washington (UW)] to determine what model configurations best simulate the observed jet structure. Comparison of the WRF simulations with wind observations from satellites, dropsondes, and the airborne DWL scans indicate that the combination of both high horizontal resolution (5 km) and vertical resolution (60 levels) best captures observed barrier jet structure and speeds as well as the observed cloud field, including some convective clouds. Both WRF PBL schemes produced reasonable barrier jets with the UW scheme slightly outperforming the MYNN2.5 scheme. However, further investigation at high horizontal and vertical resolution is needed to determine the impact of the WRF PBL scheme on surface energy budget terms, particularly in the high-latitude maritime environment around Greenland.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Turbulence and Dispersion in Multiscale Atmospheric Simulations over Complex Urban Terrain during the Joint Urban 2003 Field Campaign

Abstract This paper evaluates the representation of turbulence and its effect on transport and dispersion within multiscale and microscale-only simulations in an urban environment. These simulations, run using the Weather Research and Forecasting Model with the addition of an immersed boundary method, predict transport and mixing during a controlled tracer release from the Joint Urban 2003 field campaign in Oklahoma City, Oklahoma. This work extends the results of a recent study through analysis of turbulence kinetic energy and turbulence spectra and their role in accurately simulating wind speed, direction, and tracer concentration. The significance and role of surface heat fluxes and use of the cell perturbation method in the numerical simulation setup are also examined. Our previous study detailed the model development necessary for our multiscale simulations, examined model skill at predicting wind speeds and tracer concentrations, and demonstrated that dynamic downscaling from mesoscale to microscale through a sequence of nested simulations can improve predictions of transport and dispersion relative to a microscale-only simulation forced by idealized meteorology. Here, predictions are compared with observations to assess qualitative agreement and statistical model skill at predicting wind speed, wind direction, tracer concentration, and turbulent kinetic energy at locations throughout the city. We also investigate the scale distribution of turbulence and the associated impact on model skill, particularly for predictions of transport and dispersion. Our results show that downscaled large-scale turbulence, which is unique to the multiscale simulations, significantly improves predictions of tracer concentrations in this complex urban environment. Significance Statement Simulations of atmospheric transport and mixing in urban environments have many applications, including pollution modeling for urban planning or informing emergency response following a hazardous release. These applications include phenomena with spatial scales spanning from millimeters to kilometers. Most simulations resolve flow only within the urban area of interest, omitting larger scales of turbulence and regional influences. This study examines a method that resolves both the small and large-scale flow features. We evaluate simulation accuracy by comparing predictions with observations from an experiment involving the release of a tracer gas in Oklahoma City, Oklahoma, with emphasis on correctly modeling turbulent fluctuations. Our results demonstrate the importance of resolving large-scale flow features when predicting transport and dispersion in urban environments.

42 ENGINEERING↗

An Evaluation of Size-Resolved Cloud Microphysics Scheme Numerics for use with Radar Observations Part II: Condensation and Evaporation

Accurate numerical modeling of clouds and precipitation is essential for weather forecasting and climate change research. While size-resolved (bin) cloud microphysics models predict particle size distributions without imposing shapes, results are subject to artificial size distribution broadening owing to numerical diffusion associated with various processes. Whereas Part 1 addressed collision-coalescence, here we investigate numerical diffusion that occurs in solving condensation and evaporation. In a parcel model framework, all of the numerical schemes examined converge to one solution of condensation and evaporation as the mass grid is refined, and the advection-based schemes are recommended over the reassigning schemes. Including Eulerian vertical advection in a column limits the convergence to some extent, but that limitation occurs at a sufficiently fine mass grid, and the number of iterations in solving vertical advection should be minimized to reduce numerical diffusion. Insubstantial numerical diffusion in solving condensation can be amplified if collision-coalescence is also active, which in turn can be substantially diminished if turbulence effects on collision are incorporated. Large-eddy simulations of a drizzling stratocumulus field reveal that changes in moments of Doppler spectra obtained using different mass grids are consistent with those obtained from the simplified framework, and that spectral moments obtained using a mass grid designed to effectively reduce numerical diffusion are generally closer to observations. Notable differences between the simulations and observations still exist, and our results suggest a need to consider whether factors other than numerical diffusion in the fundamental process schemes employed can cause such differences.

Cloud microphysics↗

Exploratory Precipitation Metrics: Spatiotemporal Characteristics, Process-Oriented, and Phenomena-Based

Abstract Precipitation sustains life and supports human activities, making its prediction one of the most societally relevant challenges in weather and climate modeling. Limitations in modeling precipitation underscore the need for diagnostics and metrics to evaluate precipitation in simulations and predictions. While routine use of basic metrics is important for documenting model skill, more sophisticated diagnostics and metrics aimed at connecting model biases to their sources and revealing precipitation characteristics relevant to how model precipitation is used are critical for improving models and their uses. This paper illustrates examples of exploratory diagnostics and metrics including 1) spatiotemporal characteristics metrics such as diurnal variability, probability of extremes, duration of dry spells, spectral characteristics, and spatiotemporal coherence of precipitation; 2) process-oriented metrics based on the rainfall–moisture coupling and temperature–water vapor environments of precipitation; and 3) phenomena-based metrics focusing on precipitation associated with weather phenomena including low pressure systems, mesoscale convective systems, frontal systems, and atmospheric rivers. Together, these diagnostics and metrics delineate the multifaceted and multiscale nature of precipitation, its relations with the environments, and its generation mechanisms. The metrics are applied to historical simulations from phases 5 and 6 of the Coupled Model Intercomparison Project. Models exhibit diverse skill as measured by the suite of metrics, with very few models consistently ranked as top or bottom performers compared to other models in multiple metrics. Analysis of model skill across metrics and models suggests possible relationships among subsets of metrics, motivating the need for more systematic analysis to understand model biases for informing model development.

54 ENVIRONMENTAL SCIENCES↗

Performance of Convection-Permitting and Convection-Parameterized Models in Reproducing the Extreme Precipitation Intensity Relationship with Surface Conditions

Here, this study investigates the warm-season extreme precipitation–temperature scaling relationship in CONUS404, a convection-permitting (4 km) Weather Research and Forecasting (WRF) Model simulation over the conterminous United States for the past four decades, and compares it with the WRF-Thermodynamic Global Warming (WRF-TGW) historical simulation at a coarser resolution (12 km) using parameterized convection. We also analyze the NCEP stage IV and NASA Integrated Multi-satellitE Retrievals for the Global Precipitation Measurement (IMERG) datasets as observational benchmarks. We examine how extreme precipitation intensity (EPI) varies with temperature and saturation deficit over representative regions based on hourly data. The stage IV and IMERG data show a similar pattern of EPI variation with temperature and saturation deficit, except that the EPI peak is lower in IMERG than in stage IV. Under dry and hot conditions, EPI decreases too rapidly with elevated saturation deficit in both CONUS404 and WRF-TGW compared to observations, but the performance of CONUS404 is superior to WRF-TGW. When the near-surface atmosphere is saturated or close to saturated, both CONUS404 and WRF-TGW produce higher peak values of EPI relative to the observational references; IMERG exhibits scaling rates close to the Clausius–Clapeyron (C–C) relationship, while CONUS404, WRF-TGW, and stage IV all demonstrate super-C–C scaling behaviors. Despite marked warming over the past four decades, in both CONUS404 and WRF-TGW, the scaling relationship between EPI and temperature in a saturated atmosphere remains stable and robust. This indicates a strong potential for the EPI–temperature scaling rate under saturation to be used as an emergent constraint in reducing uncertainties of future extreme precipitation projection.

Atmosphere↗

Growth of Mesoscale Convective Systems in Observations and a Seasonal Convection-Permitting Simulation over Argentina

Abstract A 6.5-month, convection-permitting simulation is conducted over Argentina covering the Remote Sensing of Electrification, Lightning, And Mesoscale/Microscale Processes with Adaptive Ground Observations and Clouds, Aerosols, and Complex Terrain Interactions (RELAMPAGO-CACTI) field campaign and is compared with observations to evaluate mesoscale convective system (MCS) growth prediction. Observed and simulated MCSs are consistently identified, tracked, and separated into growth, mature, and decay stages using top-of-the-atmosphere infrared brightness temperature and surface rainfall. Simulated MCS number, lifetime, seasonal and diurnal cycles, and various cloud-shield characteristics including growth rate are similar to those observed. However, the simulation produces smaller rainfall areas, greater proportions of heavy rainfall, and faster system propagations. Rainfall area is significantly underestimated for long-lived MCSs but not for shorter-lived MCSs, and rain rates are always overestimated. These differences result from a combination of model and satellite retrieval biases, in which simulated MCS rain rates are shifted from light to heavy, while satellite-retrieved rainfall is too frequent relative to rain gauge estimates. However, the simulation reproduces satellite-retrieved MCS cloud-shield evolution well, supporting its usage to examine environmental controls on MCS growth. MCS initiation locations are associated with removal of convective inhibition more than maximized low-level moisture convergence or instability. Rapid growth is associated with a stronger upper-level jet (ULJ) and a deeper northwestern Argentinean low that causes a stronger northerly low-level jet (LLJ), increasing heat and moisture fluxes, low-level vertical wind shear, baroclinicity, and instability. Sustained growth corresponds to similar LLJ, baroclinicity, and instability conditions but is less sensitive to the ULJ, large-scale vertical motion, or low-level shear. Growth sustenance controls MCS maximum extent more than growth rate.

54 ENVIRONMENTAL SCIENCES↗

Assessment of NASA GISS CMIP5 and Post-CMIP5 Simulated Clouds and TOA Radiation Budgets Using Satellite Observations: TOA Radiation Budget and CREs - Part 2

In Part I of this study, the NASA GISS Coupled Model Intercomparison Project (CMIP5) and post-CMIP5 (herein called C5 and P5, respectively) simulated cloud properties were assessed utilizing multiple satellite observations, with a particular focus on the southern midlatitudes (SMLs). This study applies the knowledge gained from Part I of this series to evaluate the modeled TOA radiation budgets and cloud radiative effects (CREs) globally using CERES EBAF (CE) satellite observations and the impact of regional cloud properties and water vapor on the TOA radiation budgets. Comparisons revealed that the P5- and C5-simulated global means of clear-sky and all-sky outgoing longwave radiation (OLR) match well with CE observations, while biases are observed regionally. Negative biases are found in both P5- and C5-simulated clear-sky OLR. P5-simulated all-sky albedo slightly increased over the SMLs due to the increase in low-level cloud fraction from the new planetary boundary layer (PBL) scheme. Shortwave, longwave, and net CRE are quantitatively analyzed as well. Regions of strong large-scale atmospheric upwelling/downwelling motion are also defined to compare regional differences across multiple cloud and radiative variables. In general, the P5 and C5 simulations agree with the observations better over the downwelling regime than over the upwelling regime. Comparing the results herein with the cloud property comparisons presented in Part I, the modeled TOA radiation budgets and CREs agree well with the CE observations. These results, combined with results in Part I, have quantitatively estimated how much improvement is found in the P5-simulated cloud and radiative properties, particularly over the SMLs and tropics, due to the implementation of the new PBL and convection schemes.

Model comparison↗

Eddy-Driven Buoyancy Gradients on Eastern Boundaries and Their Role in the Thermocline

It is demonstrated that eddy fluxes of buoyancy at the eastern and western boundaries maintain alongshore buoyancy gradients along the coast. Eddy fluxes arise near the eastern and western boundaries because on both coasts buoyancy gradients normal to the boundary are strong. The eddy fluxes are accompanied by mean vertical flows that take place in narrow boundary layers next to the coast where the geostrophic constraint is broken. These ageostrophic cells have a velocity component normal to the coast that balances the geostrophic mean velocity. It is shown that the dynamics in these thin ageostrophic boundary layers can be replaced by effective boundary conditions for the interior flow, relating the eddy flux of buoyancy at the seaward edge of the boundary layers to the buoyancy gradient along the coast. These effective boundary conditions are applied to a model of the thermocline linearized around a mean stratification and a state of rest. The linear model parameterizes the eddy fluxes of buoyancy as isopycnal diffusion. Furthermore, the linear model produces horizontal gradients of buoyancy along the eastern coast on a vertical scale that depends on both the vertical diffusivity and the eddy diffusivity. The buoyancy field of the linear model agrees positively with the mean state of an eddy-resolving computation. Because the east–west difference in buoyancy is related to the zonally integrated meridional velocity, the linear model successfully predicts the meridional overturning circulation.

54 ENVIRONMENTAL SCIENCES↗

Process-Oriented Diagnostics: Principles, Practice, Community Development, and Common Standards

Process-oriented diagnostics (PODs) aim to provide feedback for model developers through model analysis based on physical hypotheses. However, the step from a diagnostic based on relationships among variables, even when hypothesis driven, to specific guidance for revising model formulation or parameterizations can be substantial. The POD may provide more information than a purely performance-based metric, but a gap between POD principles and providing actionable information for specific model revisions can remain. Furthermore, in coordinating diagnostics development, there is a trade-off between freedom for the developer, aiming to capture innovation, and near-term utility to the modeling center. Best practices that allow for the former, while conforming to specifications that aid the latter, are important for community diagnostics development that leads to tangible model improvements. Promising directions to close the gap between principles and practice include the interaction of PODs with perturbed physics experiments and with more quantitative process models as well as the inclusion of personnel from modeling centers in diagnostics development groups for immediate feedback during climate model revisions. Examples are provided, along with best-practice recommendations, based on practical experience from the NOAA Model Diagnostics Task Force (MDTF). Common standards for metrics and diagnostics that have arisen from a collaboration between the MDTF and the Department of Energy’s Coordinated Model Evaluation Capability are advocated as a means of uniting community diagnostics efforts.

58 GEOSCIENCES↗

Generalized Aerosol/Chemistry Interface (GIANT): A Community Effort to Advance Collaborative Science across Weather and Climate Models

Atmospheric aerosol and chemistry modules are key elements in Earth system models (ESMs), as they predict air pollutant concentrations and properties that can impact human health, weather, and climate. The current uncertainty in climate projections is partly due to the inaccurate representation of aerosol direct and indirect forcing. Aerosol/chemistry parameterizations used within ESMs and other atmospheric models span large structural and parameter uncertainties that are difficult to assess independently of their host models. Moreover, there is a strong need for a standardized interface between aerosol/chemistry modules and the host model to facilitate portability of aerosol/chemistry parameterizations from one model to another, allowing not only a comparison between different parameterizations within the same modeling framework, but also quantifying the impact of different model frameworks on aerosol/chemistry predictions. To address this need, we have initiated a new community effort to coordinate the construction of a Generalized Aerosol/Chemistry Interface (GIANT) for use across weather and climate models. We aim to organize a series of community workshops and hackathons to design and build GIANT, which will serve as the interface between a range of aerosol/chemistry modules and the physics and dynamics components of atmospheric host models. GIANT will leverage ongoing efforts at the U.S. modeling centers focused on building next-generation ESMs and the international AeroCom initiative to implement this common aerosol/chemistry interface. GIANT will create transformative opportunities for scientists and students to conduct innovative research to better characterize structural and parametric uncertainties in aerosol/chemistry modules, and to develop a common set of aerosol/chemistry parameterizations.

54 ENVIRONMENTAL SCIENCES↗

Are Atmospheric Models Too Cold in the Mountains? The State of Science and Insights from the SAIL Field Campaign

Mountains play an outsized role in water resource availability, and the amount and timing of water they provide depend strongly on temperature. To that end, we ask the question: How well are atmospheric models capturing mountain temperatures? We synthesize results showing that high-resolution, regionally relevant climate models produce 2-m air temperature (T2m) measurements colder than what is observed (a “cold bias”), particularly in snow-covered midlatitude mountain ranges during winter. We find common cold biases in 44 studies across global mountain ranges, including single-model and multimodel ensembles. We explore the factors driving these biases and examine the physical mechanisms, data limitations, and observational uncertainties behind T2m. Our analysis suggests that the biases are genuine and not due to observation sparsity or resolution mismatches. Cold biases occur primarily on mountain peaks and ridges, whereas valleys are often warm biased. Our literature review suggests that increasing model resolution does not clearly mitigate the bias. By analyzing data from the Surface Atmosphere Integrated Field Laboratory (SAIL) field campaign in the Colorado Rocky Mountains, we test various hypotheses related to cold biases and find that local wind circulations, longwave (LW) radiation, and surface-layer parameterizations contribute to the T2m biases in this particular location. We conclude by emphasizing the value of coordinated model evaluation and development efforts in heavily instrumented mountain locations for addressing the root cause(s) of T2m biases and improving predictive understanding of mountain climates.

54 ENVIRONMENTAL SCIENCES↗

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling↗

Observational Data for Next-Generation Climate Model Evaluation: Requirements, Considerations, and Best Practices

Climate model simulations are an important source of information about our planet’s climate system and also enable informed decision-making under different future scenarios. As a new archive of results from the next generation of climate models is anticipated to become available with the Coupled Model Intercomparison Project phase 7 (CMIP7), the need to develop efficient and robust methods to evaluate models is paramount. Observations are an integral part of model evaluation, providing a means to quantify and understand the degree to which climate models can faithfully reproduce Earth system processes. Such analysis is critical for constraining climate projections, identifying areas of focus for model development, and assisting analysts in deciphering the utility of models for specific applications. Observations of Earth system come from a diversity of sources, span different space–time domains, and are produced by different communities, and each dataset features different data structures and formats, metadata standards, and its own unique uncertainties. Uncertainties in an observational dataset may stem from gaps in temporal and spatial coverage, instrumentation errors, or assumptions in retrieval and processing methods. How then does one ensure that observational data are ready for use and utilized in the most appropriate way for robust, rapid, and routine climate model evaluation? The CMIP7 Model Benchmarking Task Team with input from the broader climate modeling, model evaluation, and observational data communities present a vision and considerations for best practices toward the optimal and appropriate use of observational data to support next-generation climate model evaluation.

Climate models↗