Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

An evaluation of global organic aerosol schemes using airborne observations

Chemical transport models have historically struggled to accurately simulate the magnitude and variability of observed organic aerosol (OA), with previous studies demonstrating that models significantly underestimate observed concentrations in the troposphere. In this study, we explore two different model OA schemes within the standard GEOS-Chem chemical transport model and evaluate the simulations against a suite of 15 globally distributed airborne campaigns from 2008 to 2017, primarily in the spring and summer seasons. These include the ATom, KORUS-AQ, GoAmazon,FRAPPE, SEAC4RS, SENEX, DC3, CalNex, OP3, EUCAARI, ARCTAS and ARCPAC campaigns and provide broad coverage over a diverse set of atmospheric composition regimes – anthropogenic, biogenic, pyrogenic and remote. The schemes include significant differences in their treatment of the primary and secondary components of OA – a “simple scheme” that models primary OA (POA) as non-volatile and takes a fixed-yield approach to secondary OA (SOA) formation and a “complex scheme” that simulates POA as semi-volatile and uses a more sophisticated volatility basis set approach for non-isoprene SOA, with an explicit aqueous uptake mechanism to model isoprene SOA. Despite these substantial differences, both the simple and complex schemes perform comparably across the aggregate dataset in their ability to capture the observed variability (with an R2 of 0.41 and 0.44, respectively). The simple scheme displays greater skill in minimizing the overall model bias (with a normalized mean bias of 0.04 compared to 0.30 for the complex scheme). Across both schemes, the model skill in reproducing observed OA is superior to previous model evaluations and approaches the fidelity of the sulfate simulation within the GEOS-Chem model. However,there are significant differences in model performance across different chemical source regimes, classified here into seven categories.Higher-resolution nested regional simulations indicate that model resolution is an important factor in capturing variability in highly localized campaigns, while also demonstrating the importance of well-constrained emissions inventories and local meteorology, particularly over Asia. Our analysis suggests that a semi-volatile treatment of POA is superior to anon-volatile treatment. It is also likely that the complex scheme parameterization overestimates biogenic SOA at the global scale. While this study identifies factors within the SOA schemes that likely contribute to OA model bias (such as a strong dependency of the bias in the complex scheme on relative humidity and sulfate concentrations), comparisons with the skill of the sulfate aerosol scheme in GEOS-Chem indicate the importance of other drivers of bias, such as emissions, transport and deposition, that are exogenous to the OA chemical scheme.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Evaluation of interactive and prescribed agricultural ammonia emissions for simulating atmospheric composition in CAM-chem

Abstract. Ammonia (NH3) plays a central role in the chemistry of inorganic secondary aerosols in the atmosphere. The largest emission sector for NH3 is agriculture, where NH3 is volatilized from livestock wastes and fertilized soils. Although the NH3 volatilization from soils is driven by the soil temperature and moisture, many atmospheric chemistry models prescribe the emission using yearly emission inventories and climatological seasonal variations. Here we evaluate an alternative approach where the NH3 emissions from agriculture are simulated interactively using the process model FANv2 (Flow of Agricultural Nitrogen, version 2) coupled to the Community Atmospheric Model with Chemistry (CAM-chem). We run a set of 6-year global simulations using the NH3 emission from FANv2 and three global emission inventories (EDGAR, CEDS and HTAP) and evaluate the model performance using a global set of multi-component (atmospheric NH3 and NH4+, and NH4+ wet deposition) in situ observations. Over East Asia, Europe and North America, the simulations with different emissions perform similarly when compared with the observed geographical patterns. The seasonal distributions of NH3 emissions differ between the inventories, and the comparison to observations suggests that both FANv2 and the inventories would benefit from more realistic timing of fertilizer applications. The largest differences between the simulations occur over data-scarce regions. In Africa, the emissions simulated by FANv2 are 200 %–300 % higher than in the inventories, and the available in situ observations from western and central Africa, as well as NH3 retrievals from the Infrared Atmospheric Sounding Interferometer (IASI) instrument, are consistent with the higher NH3 emissions as simulated by FANv2. Overall, in simulating ammonia and ammonium concentrations over regions with detailed regional emission inventories, the inventories based on these details (HTAP, CEDS) capture the atmospheric concentrations and their seasonal variability the best. However these inventories cannot capture the impact of meteorological variability on the emissions, nor can these inventories couple the emissions to the biogeochemical cycles and their changes with climate drivers. Finally, we show with sensitivity experiments that the simulated time-averaged nitrate concentration in air is sensitive to the temporal resolution of the NH3 emissions. Over the CASTNET monitoring network covering the US, resolving the NH3 emissions hourly instead monthly reduced the positive model bias from approximately 80 % to 60 % of the observed yearly mean nitrate concentration. This suggests that some of the commonly reported overestimation of aerosol nitrate over the US may be related to unresolved temporal variability in the NH3 emissions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A single-point modeling approach for the intercomparison and evaluation of ozone dry deposition across chemical transport models (Activity 2 of AQMEII4)

A primary sink of air pollutants and their precursors is dry deposition. Dry deposition estimates differ across chemical transport models, yet an understanding of the model spread is incomplete. Here, we introduce Activity 2 of the Air Quality Model Evaluation International Initiative Phase 4 (AQMEII4). We examine 18 dry deposition schemes from regional and global chemical transport models as well as standalone models used for impact assessments or process understanding. We configure the schemes as single-point models at eight Northern Hemisphere locations with observed ozone fluxes. Single-point models are driven by a common set of site-specific meteorological and environmental conditions. Five of eight sites have at least 3 years and up to 12 years of ozone fluxes. The interquartile range across models in multiyear mean ozone deposition velocities ranges from a factor of 1.2 to 1.9 annually across sites and tends to be highest during winter compared with summer. No model is within 50 % of observed multiyear averages across all sites and seasons, but some models perform well for some sites and seasons. For the first time, we demonstrate how contributions from depositional pathways vary across models. Models can disagree with respect to relative contributions from the pathways, even when they predict similar deposition velocities, or agree with respect to the relative contributions but predict different deposition velocities. Both stomatal and nonstomatal uptake contribute to the large model spread across sites. Our findings are the beginning of results from AQMEII4 Activity 2, which brings scientists who model air quality and dry deposition together with scientists who measure ozone fluxes to evaluate and improve dry deposition schemes in the chemical transport models used for research, planning, and regulatory purposes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Mid-Atlantic US observations of radiocarbon in CO 2 : fossil and biogenic source partitioning and model evaluation

Accurately quantifying regional anthropogenic CO 2 fluxes is fundamental to improving our understanding of the carbon cycle and for creating effective carbon mitigation policies, and the radiocarbon to total carbon ratio in atmospheric CO 2 (Δ 14 CO 2 ) is a robust tracer of fossil fuel CO 2 that can discriminate between biogenic and fossil fuel CO 2 sources. NASA's Atmospheric Carbon and Transport-America (ACT-America) airborne mission between 2016 and 2019 aimed to improve the accuracy of regional greenhouse gas flux estimates, through refining our understanding and characterization of fluxes and flux uncertainties in models. Δ 14 CO 2 observations from 26 flights are presented for examining seasonal CO 2 source partitioning in the Mid-Atlantic USA. Observed variability in boundary layer CO 2 at timescales ranging from intra-day to seasonal was largely driven by biogenic CO 2 (CO 2bio ) variability that ranged from −19.7 ppm in summer to 16.2 ppm in fall, while fossil fuel CO 2 (CO 2ff ) variability remained at 3.3±2.0 ppm. Carbonyl sulfide uptake was well-correlated with CO 2bio uptake, and examining this relationship, as well as that between CO 2 and CO 2bio variability reinforces the seasonal extent of gross primary productivity response throughout ACT-America. We use airborne Δ 14 CO 2 flask sampling alongside in situ carbon monoxide measurements to calculate high-frequency CO 2ff and evaluate the magnitude and diurnal variability of modeled CO 2ff , deducing likely transport errors in an example flight. Although ACT-America CO 2ff signals were attenuated due to the broad source regions sampled, results illustrate the value of Δ 14 CO 2 sampling and observation-based methodologies for regional CO 2 flux attribution, evaluation and improvement of modeled CO 2 .

Baier, Bianca C. [National Oceanic and Atmospheric↗
DOE OSTI2025

Warm-phase microphysical evolution in large-eddy simulations of tropical cumulus congestus: evaluating drop size distribution evolution using polarimetry retrievals, in situ measurements, and a thermal-based framework

Owing to uncertainties in convective microphysics processes, improving parameterizations in Earth system models (ESMs) can benefit from observationally constrained cases suitable for scaling between cloud-resolving models and ESMs. We propose a benchmark large-eddy simulation (LES) cumulus congestus case study from the NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP 2 Ex) for evaluating and improving ESMs in single-column model (SCM) mode. We seek observational constraints using novel polarimetric retrievals and in situ cloud microphysics measurements. Simulations using bulk and bin microphysics initialized with observed aerosol profiles are compared to cloud-top retrievals of cloud droplet effective radius (R eff ), effective variance (ν eff ), and number concentration (N d ) from the airborne Research Scanning Polarimeter (RSP). Both schemes reproduce characteristics of cloud-top N d and R eff that increase and decrease with altitude, respectively. Cloud-top N d is low-biased relative to RSP retrievals in both schemes, potentially due to limitations in both simulations and retrieval assumptions. Cloud-top R eff is low-biased in the bulk scheme but reasonably reproduced by the bin scheme. Profiles of N d and R eff are sensitive to the collision–coalescence process and the vertical variation in aerosol size distribution. Comparison of simulated and in situ droplet size distributions (DSDs) shows that, to first order, integrated moments are always sensitive to sizes < ~ 30 µm and can also be sensitive to larger sizes if the DSDs are sufficiently broad, with implications for the assumed maximum observed size retrieved by the RSP. The bin scheme captures the observed extended tail of the DSD, while the bulk scheme is unable to due to parametric constraints. Differences in expected relationships between in situ measurements of cloud cores and cloud-top retrievals by RSP demonstrate difficulty in constraining well the case presented herein. Finally, a thermal-tracking framework demonstrates that the dilution of N d throughout a thermal's lifetime is heavily determined by collision–coalescence and the height-varying aerosol distribution and that, in the absence of these, the impact of entrainment on diluting N d is largely offset by secondary activation. Implications for evaluating warm-phase convective microphysics schemes in ESMs and translating results for use on global, space-based polarimetry platforms are discussed.

Stanford, McKenna Wallace [Columbia Univ., New Yor↗
DOE OSTI2019

Evaluation of ARM tethered-balloon system instrumentation for supercooled liquid water and distributed temperature sensing in mixed-phase Arctic clouds

A tethered-balloon system (TBS) has been developed and is being operated by Sandia National Laboratories (SNL) on behalf of the U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) User Facility in order to collect in situ atmospheric measurements within mixed-phase Arctic clouds. Periodic tethered-balloon flights have been conducted since 2015 within restricted airspace at ARM's Advanced Mobile Facility 3 (AMF3) in Oliktok Point, Alaska, as part of the AALCO (Aerial Assessment of Liquid in Clouds at Oliktok), ERASMUS (Evaluation of Routine Atmospheric Sounding Measurements using Unmanned Systems), and POPEYE (Profiling at Oliktok Point to Enhance YOPP Experiments) field campaigns. The tethered-balloon system uses helium-filled 34 m 3 helikites and 79 and 104 m 3 aerostats to suspend instrumentation that is used to measure aerosol particle size distributions, temperature, horizontal wind, pressure, relative humidity, turbulence, and cloud particle properties and to calibrate ground-based remote sensing instruments. Supercooled liquid water content (SLWC) sondes using the vibrating-wire principle, developed by Anasphere Inc., were operated at Oliktok Point at multiple altitudes on the TBS within mixed-hase clouds for over 200 h. Sonde-collected SLWC data were compared with liquid water content derived from a microwave radiometer, Ka-band ARM zenith radar, and ceilometer at the AMF3, as well as liquid water content derived from AMF3 radiosonde flights. The in situ data collected by the Anasphere sensors were also compared with data collected simultaneously by an alternative SLWC sensor developed at the University of Reading, UK; both vibrating-wire instruments were typically observed to shed their ice quickly upon exiting the cloud or reaching maximum ice loading. Temperature sensing measurements distributed with fiber optic tethered balloons were also compared with AMF3 radiosonde temperature measurements. Combined, the results indicate that TBS-distributed temperature sensing and supercooled liquid water measurements are in reasonably good agreement with remote sensing and radiosonde-based measurements of both properties. From these measurements and sensor evaluations, tethered-balloon flights are shown to offer an effective method of collecting data to inform and constrain numerical models, calibrate and validate remote sensing instruments, and characterize the flight environment of unmanned aircraft, circumventing the difficulties of in-cloud unmanned aircraft flights such as limited flight time and in-flight icing.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Evaluating cloud liquid detection against Cloudnet using cloud radar Doppler spectra in a pre-trained artificial neural network

Detection of liquid-containing cloud layers in thick mixed-phase clouds or multi-layer cloud situations from ground-based remote-sensing instruments still poses observational challenges, yet improvements are crucial since the existence of multi-layer liquid layers in mixed-phase cloud situations influences cloud radiative effects, cloud lifetime, and precipitation formation processes. Hydrometeor target classifications such as from Cloudnet that require a lidar signal for the classification of liquid are limited to the maximum height of lidar signal penetration and thus often lead to underestimations of liquid-containing cloud layers. Here we evaluate the Cloudnet liquid detection against the approach of Luke et al. (2010) which extracts morphological features in cloud-penetrating cloud radar Doppler spectra measurements in an artificial neural network (ANN) approach to classify liquid beyond full lidar signal attenuation based on the simulation of the two lidar parameters particle backscatter coefficient and particle depolarization ratio. We show that the ANN of Luke et al. (2010) which was trained under Arctic conditions can successfully be applied to observations at the mid-latitudes obtained during the 7-week-long ACCEPT field experiment in Cabauw, the Netherlands, in 2014. In a sensitivity study covering the whole duration of the ACCEPT campaign, different liquid-detection thresholds for ANN-predicted lidar variables are applied and evaluated against the Cloudnet target classification. Independent validation of the liquid mask from the standard Cloudnet target classification against the ANN-based technique is realized by comparisons to observations of microwave radiometer liquid-water path, ceilometer liquid-layer base altitude, and radiosonde relative humidity. In addition, a case-study comparison against the cloud feature mask detected by the space-borne lidar aboard the CALIPSO satellite is presented. Three conclusions were drawn from the investigation. First, it was found that the threshold selection criteria of liquid-related lidar backscatter and depolarization alone control the liquid detection considerably. Second, all threshold values used in the ANN framework were found to outperform the Cloudnet target classification for deep or multi-layer cloud situations where the lidar signal is fully attenuated within low liquid layers and the cloud radar is able to detect the microphysical fingerprint of liquid in higher cloud layers. Third, if lidar data are available, Cloudnet is at least as good as the ANN. The times when Cloudnet outperforms the ANN in liquid detections are often associated with situations where cloud dynamics smear the imprint of cloud microphysics on the radar Doppler spectra.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Shortwave Array Spectroradiometer-Hemispheric (SAS-He): design and evaluation

A novel ground-based radiometer, referred to as the Shortwave Array Spectroradiometer-Hemispheric (SAS-He), is introduced. This radiometer uses the shadow-band technique to report total irradiance and its direct and diffuse components frequently (every 30 s) with continuous spectral coverage (350–1700 nm) and moderate spectral (~2.5 nm ultraviolet–visible and ~6 nm shortwave-infrared) resolution. The SAS-He's performance is evaluated using integrated datasets collected over coastal regions during three field campaigns supported by the US Department of Energy's Atmospheric Radiation Measurement (ARM) program, namely the (1) Two-Column Aerosol Project (TCAP; Cape Cod, Massachusetts), (2) Tracking Aerosol Convection Interactions Experiment (TRACER; in and around Houston, Texas), and (3) Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE; La Jolla, California). We compare (i) aerosol optical depth (AOD) and total optical depth (TOD) derived from the direct irradiance, as well as (ii) the diffuse irradiance and direct-to-diffuse ratio (DDR) calculated from two components of the total irradiance. As part of the evaluation, both AOD and TOD derived from the SAS-He direct irradiance are compared to those provided by a collocated Cimel sunphotometer (CSPHOT) at five (380, 440, 500, 675, 870 nm) and two (1020, 1640 nm) wavelengths, respectively. Additionally, the SAS-He diffuse irradiance and DDR are contrasted with their counterparts offered by a collocated multifilter rotating shadowband radiometer (MFRSR) at six (415, 500, 615, 675, 870, 1625 nm) wavelengths. Overall, reasonable agreement is demonstrated between the compared products despite the challenging observational conditions associated with varying aerosol loadings and diverse types of aerosols and clouds. For example, the AOD- and TOD-related values of root mean square error remain within 0.021 at 380, 440, 500, 675, 870, 1020, and 1640 nm wavelengths during the three field campaigns.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

A globally sampled high-resolution hand-labeled validation dataset for evaluating surface water extent maps

Effective monitoring of global water resources is increasingly critical due to climate change and population growth. Advancements in remote sensing technology, specifically in spatial, spectral, and temporal resolutions, are revolutionizing water resource monitoring, leading to more frequent and high-quality surface water extent maps using various techniques such as traditional image processing and machine learning algorithms. However, satellite imagery datasets contain trade-offs that result in inconsistencies in performance, such as disparities in measurement principles between optical (e.g., Sentinel-2) and radar (e.g., Sentinel-1) sensors and differences in spatial and spectral resolutions among optical sensors. Therefore, developing accurate and robust surface water mapping solutions requires independent validations from multiple datasets to identify potential biases within the imagery and algorithms. However, high-quality validation datasets are expensive to build, and few contain information on water resources. For this purpose, we introduce a globally sampled, high-spatial-resolution dataset labeled using 3 m PlanetScope imagery. Our surface water extent dataset comprises 100 images, each with a size of 1024×1024 pixels, which were sampled using a stratified random sampling strategy covering all 14 biomes. We highlighted urban and rural regions, lakes, and rivers, including braided rivers and coastal regions. We evaluated two surface water extent mapping methods using our dataset – Dynamic World, based on Sentinel-2, and the NASA IMPACT model, based on Sentinel-1. Dynamic World achieved a mean intersection over union (IoU) of 72.16 % and F1 score of 79.70 %, while the NASA IMPACT model had a mean IoU of 57.61 % and F1 score of 65.79 %. Performance varied substantially across biomes, highlighting the importance of evaluating models on diverse landscapes to assess their generalizability and robustness. Our dataset can be used to analyze satellite products and methods, providing insights into their advantages and drawbacks. Our dataset offers a unique tool for analyzing satellite products, aiding the development of more accurate and robust surface water monitoring solutions. The dataset can be accessed via https://doi.org/10.25739/03nt-4f29.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Evaluating integrated surface/subsurface permafrost thermal hydrology models in ATS (v0.88) against observations from a polygonal tundra site

Numerical simulations are essential tools for understanding the complex hydrologic response of Arctic regions to a warming climate. However, strong coupling among thermal and hydrological processes on the surface and in the subsurface and the significant role that subtle variations in surface topography have in regulating flow direction and surface storage lead to significant uncertainties. Careful model evaluation against field observations is thus important to build confidence.We evaluate the integrated surface/subsurface permafrost thermal hydrology models in the Advanced Terrestrial Simulator (ATS) against field observations from polygonal tundra at the Barrow Environmental Observatory. ATS couples a multiphase, 3D representation of subsurface thermal hydrology with representations of overland nonisothermal flows, snow processes, and surface energy balance. We simulated thermal hydrology of a 3D ice-wedge polygon with geometry that is abstracted but broadly consistent with the surface microtopography at our study site. The simulations were forced by meteorological data and observed water table elevations in ice-wedge polygon troughs. With limited calibration of parameters appearing in the soil evaporation model, the 3-year simulations agreed reasonably well with snow depth, summer water table elevations in the polygon center, and high-frequency soil temperature measurements at several depths in the trough, rim, and center of the polygon. Upscaled evaporation is in good agreement with flux tower observations. The simulations were found to be sensitive to parameters in the bare soil evaporation model, snowpack, and the lateral saturated hydraulic conductivity.Timing of fall freeze-up was found to be sensitive to initial snow density, illustrating the importance of including snow aging effects. The study provides new support for an emerging class of integrated surface/subsurface permafrost simulators.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Reduced Complexity Model Intercomparison Project Phase 1: introduction and evaluation of global-mean temperature response

Reduced-complexity climate models (RCMs) are critical in the policy and decision making space, and are directly used within multiple Intergovernmental Panel on Climate Change (IPCC) reports to complement the results of more comprehensive Earth system models. To date, evaluation of RCMs has been limited to a few independent studies. Here we introduce a systematic evaluation of RCMs in the form of the Reduced Complexity Model Intercomparison Project (RCMIP). We expect RCMIP will extend over multiple phases, with Phase 1 being the first. In Phase 1, we focus on the RCMs' global-mean temperature responses, comparing them to observations, exploring the extent to which they emulate more complex models and considering how the relationship between temperature and cumulative emissions of CO2 varies across the RCMs. Our work uses experiments which mirror those found in the Coupled Model Intercomparison Project (CMIP), which focuses on complex Earth system and atmosphere–ocean general circulation models. Using both scenario-based and idealised experiments, we examine RCMs' global-mean temperature response under a range of forcings. We find that the RCMs can all reproduce the approximately 1°C of warming since pre-industrial times, with varying representations of natural variability, volcanic eruptions and aerosols. We also find that RCMs can emulate the global-mean temperature response of CMIP models to within a root-mean-square error of 0.2°C over a range of experiments. Furthermore, we find that, for the Representative Concentration Pathway (RCP) and Shared Socioeconomic Pathway (SSP)-based scenario pairs that share the same IPCC Fifth Assessment Report (AR5)-consistent stratospheric-adjusted radiative forcing, the RCMs indicate higher effective radiative forcings for the SSP-based scenarios and correspondingly higher temperatures when run with the same climate settings. In our idealised setup of RCMs with a climate sensitivity of 3°C, the difference for the ssp585–rcp85 pair by 2100 is around 0.23°C(±0.12°C) due to a difference in effective radiative forcings between the two scenarios. Phase 1 demonstrates the utility of RCMIP's open-source infrastructure, paving the way for further phases of RCMIP to build on the research presented here and deepen our understanding of RCMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A multi-year short-range hindcast experiment with CESM1 for evaluating climate model moist processes from diurnal to interannual timescales

Abstract. We present a multi-year short-range hindcast experiment and its experimental design for better evaluation of both the mean state and variability of atmospheric moist processes in climate models from diurnal to interannual timescales and facilitate model development. We used the Community Earth System Model version 1 as the base model and performed a suite of 3 d hindcasts initialized every day starting at 00:00 Z from 1997 to 2012. Three processes – the diurnal cycle of clouds during different cloud regimes over the central US, precipitation and diabatic heating associated with the Madden–Julian Oscillation (MJO), and the response of precipitation, surface radiative and heat fluxes, as well as zonal wind stress to sea surface temperature anomalies associated with the El Niño–Southern Oscillation – are evaluated as examples to demonstrate how one can better utilize simulations from this experiment to gain insights into model errors and their connection to physical parameterizations or large-scale state. This is achieved by comparing the hindcasts with corresponding long-term observations for periods based on different phenomena. These analyses can only be done through this multi-year hindcast approach to establish robust statistics of the processes under well-controlled large-scale environment because these phenomena are either a result of interannual climate variability or only happen a few times in a given year (e.g., MJO, or cloud regime types). Furthermore, comparison of hindcasts to the typical simulations in climate mode with the same model allows one to infer what portion of a model's climate error directly comes from fast errors in the parameterizations of moist processes. As demonstrated here, model biases in the mean state and variability associated with parameterized moist processes usually develop within a few days and manifest within weeks to affect the simulations of large-scale circulation and ultimately the climate mean state and variability. Therefore, model developers can achieve additional useful understanding of the underlying problems in model physics by conducting a multi-year hindcast experiment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Evaluation of a quasi-steady-state approximation of the cloud droplet growth equation (QDGE) scheme for aerosol activation in global models using multiple aircraft data over both continental and marine environments

This research introduces a numerically efficient aerosol activation scheme and evaluates it by using stratus and stratocumulus cloud data sampled during multiple aircraft campaigns in Canada, Chile, Brazil, and China. The scheme employs a quasi-steady-state approximation of the cloud droplet growth equation (QDGE) to efficiently simulate aerosol activation, the vertical profile of supersaturation, and the activated cloud droplet number concentration (CDNC) near the cloud base. The calculated maximum supersaturation values using the QDGE scheme were compared with multiple parcel model simulations under various aerosol and environmental conditions. The differences are all below 0.18 %, indicating good performance and accuracy of the QDGE scheme. We evaluated the QDGE scheme by specifying observed environmental thermodynamic variables and aerosol information from 31 cloud cases as input and comparing the simulated CDNC with cloud observations. The average of mean relative error ($\overline{MRE}$) of the simulated CDNC for cloud cases in each campaign ranges from 17.30 % in Brazil to 25.90 % in China, indicating that the QDGE scheme successfully reproduces observed variations in CDNC over a wide range of different meteorological conditions and aerosol regimes. Additionally, we carried out an error analysis by calculating the maximum information coefficient (MIC) between the MRE and input variables for the individual campaigns and all cloud cases. MIC values were then sorted by aerosol properties, pollution level, environmental humidity, and dynamic condition according to their relative importance to MRE. Based on the error analysis, we found that the magnitude of MRE is more relevant to the specification of input aerosol pollution level in marine regions and aerosol hygroscopicity in continental regions than to other variables in the simulation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluating precipitation distributions at regional scales: a benchmarking framework and application to CMIP5 and 6 models

Abstract. As the resolution of global Earth system models increases, regional-scale evaluations are becoming ever more important. This study presents a framework for quantifying precipitation distributions at regional scales and applies it to evaluate Coupled Model Intercomparison Project (CMIP) 5 and 6 models. We employ the Intergovernmental Panel on Climate Change (IPCC) sixth assessment report (AR6) climate reference regions over land and propose refinements to the oceanic regions based on the homogeneity of precipitation distribution characteristics. The homogeneous regions are identified as heavy-, moderate-, and light-precipitating areas by K-means clustering of Integrated Multi-satellitE Retrievals for Global Precipitation Measurement (GPM) version 6 final run product (IMERG) precipitation frequency and amount distributions. With the global domain partitioned into 62 regions, including 46 land and 16 ocean regions, we apply 10 established precipitation distribution metrics. The collection includes metrics focused on the maximum peak, lower 10th percentile, and upper 90th percentile in precipitation amount and frequency distributions; the similarity between observed and modeled frequency distributions; an unevenness measure based on cumulative amount; average total intensity on all days with precipitation; and number of precipitating days each year. We apply our framework to 25 CMIP5 and 41 CMIP6 models, as well as six observation-based products of daily precipitation. Our results indicate that many CMIP5 and 6 models substantially overestimate the observed light-precipitation amount and frequency, as well as the number of precipitating days, especially over midlatitude regions outside of some land regions in the Americas and Eurasia. Improvement from CMIP5 to 6 is shown in some regions, especially in midlatitude regions, but it is not evident globally, and over the tropics most metrics point toward degradation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Evaluation and development of surface layer scheme representation of temperature inversions over boreal forests in Arctic wintertime conditions

Abstract. In this study, the Noah land surface model used in conjunction with the Mellor–Yamada–Janjić surface layer scheme (hereafter, Noah-MYJ) and the Noah multiphysics scheme (Noah-MP) from the Weather Research and Forecasting (WRF) 4.5.1 mesoscale model are evaluated with regard to their performance in reproducing positive temperature gradients over forested areas in the Arctic winter. First, simplified versions of the WRF schemes, recoded in Python, are compared with conceptual models of the surface layer in order to gain insight into the dependence of the temperature gradient on the wind speed at the top of the surface layer. It is shown that the WRF schemes place strong limits on the turbulent collapse, leading to lower surface temperature gradient at low wind speeds than in the conceptual models. We implemented modifications to the WRF schemes to correct this effect. The original and modified versions of Noah-MYJ and Noah-MP are then evaluated compared to long-term measurements at the Ameriflux Poker Flat Research Range, a forest site in interior Alaska. Noah-MP is found to perform better than Noah-MYJ because the former is a two-layer model which explicitly takes into account the effect of the forest canopy. Indeed, a non-negligible temperature gradient is maintained below the canopy at high wind speeds, leading to overall larger gradients than in the absence of vegetation. Furthermore, the modified versions are found to perform better than the original versions of each scheme because they better reproduce strong temperature gradients at low wind speeds.

Geology↗
DOE OSTI2024

Evaluating downscaled products with expected hydroclimatic co-variances

Abstract. There has been widespread adoption of downscaled products amongst practitioners and stakeholders to ascertain risk from climate hazards at the local scale (e.g., ∼ 5 km resolution). Such products must nevertheless be consistent with physical laws to be credible and of value to users. Here we evaluate statistically and dynamically downscaled products by examining local co-evolution of downscaled temperature and precipitation during convective and frontal precipitation events (two mechanisms testable with just temperature and precipitation). We find that two widely used statistical downscaling techniques (Localized Constructed Analogs version 2, LOCA2, and Seasonal Trends and Analysis of Residuals Empirical Statistical Downscaling Model, STAR-ESDM) generally preserve expected co-variances during convective precipitation events over the historical and future projected intervals as compared to European Centre for Medium-Range Weather Forecasts Reanalysis v5 (ERA5) and two observation-based data products (Livneh and nClimGrid-Daily). However, both techniques dampen future intensification of frontal precipitation that is otherwise robustly captured in global climate models (i.e., prior to downscaling) and with process-based dynamical downscaling across five different regional climate models. In the case of LOCA2, this leads to appreciable underestimation of future frontal precipitation event intensity. This study is one of the first to quantify a likely ramification of the stationarity assumption underlying statistical downscaling methods and identify a phenomenon where projections of future change diverge depending on data production method employed. Finally, our work proposes expected co-variances during convective and frontal precipitation as useful evaluation diagnostics that can be universally applied to a wide range of statistically downscaled products.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Runoff evaluation in an Earth System Land Model for permafrost regions in Alaska

Modeling of hydrological runoff is essential for accurately capturing spatiotemporal feedbacks within the land–atmosphere system, particularly in sensitive regions such as permafrost landscapes. However, substantial uncertainties persist in the terrestrial runoff parameterization schemes used in Earth system and land surface models. This is particularly true in permafrost regions, where landscape heterogeneity is high and reliable observational data are scarce. In this study, we evaluate the performance of runoff parameterization schemes in the Energy Exascale Earth System Model (E3SM) land model (ELM). Our proposed framework leverages simulation results from the Advanced Terrestrial Simulator (ATS), which is a physics-based integrated surface/subsurface hydrologic model that has been successfully evaluated previously in Arctic tundra regions. We used ATS to simulate runoff from 22 representative hillslopes in the Sagavanirktok River basin, located on the North Slope of Alaska, then compared the output with ELM's parameterized representation of total runoff. Results show that (1) ELM's total runoff was the same order of magnitude as the ATS simulations, and both models were similarly variable over time; (2) minor adjustments to coefficients in ELM's runoff parameterization improved the match between the ATS simulation and ELM's parameterized representation of annual and seasonal total runoff; (3) overall, runoff responses in ATS and ELM are more similar in flat hillslope environments compared to steep hillslopes; and (4) shallower active layer thicknesses and higher precipitation simulations resulted in lower correlations between the two models due to greater total runoff. By incorporating the optimized runoff coefficients from the Sagavanirktok River basin into ELM, the simulated total runoff better matched the streamflow observations at a small watershed located on the Seward Peninsula of Alaska. Our findings revealed important insights into the effectiveness of runoff parameterizations in land surface models and pathways for improving runoff coefficients in typical Arctic regions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Process-oriented evaluation of quasi-stationary Rossby waves and their impact on surface air temperature extremes in dynamical downscaling over North America

Quasi-stationary Rossby waves are a crucial component of the general circulation and play a significant role in regional water and energy cycles, as well as in extreme events. However, process-oriented evaluation for Rossby waves is rarely performed for dynamical downscaling simulations. To close this gap, we evaluate three classes of dynamical downscaling approaches, with a focus on quasi-stationary Rossby waves and their impact on surface air temperature over North America during Northern Hemisphere summer. The three classes of models differ in the way large-scale forcing is provided: a limited-area model (LAM) constrained only by lateral boundary conditions, represented by RegCM4 from the North American branch of the Coordinated Regional Downscaling Experiment (NA-CORDEX), a LAM with spectral nudging to maintain consistency in large-scale dynamics with the forcing data, represented by the Weather Research and Forecasting (WRF) model simulation in NA-CORDEX, and a global variable-resolution model with smoothly varying grid spacings, represented by the Community Atmosphere Model version 5.4, with the Model for Prediction Across Scales (MPAS) as its dynamical core (CAM-MPAS). With no constraints on the atmospheric dynamics, CAM-MPAS exhibits several mean biases in the upper-level circulations over the Pacific Coast region: a weaker subtropical jet, a northward-shifted mid-latitude jet, and an overestimated southerly flow. With the lateral boundary constraint alone, RegCM4 also exhibits weaker jets and overestimated southerly winds off the West Coast. Rossby ray theory reveals that those wind biases direct incoming Rossby waves northward. The erroneously routed Rossby waves distort the relationship between the accumulation of wave activity over the US West Coast and surface temperature anomalies over the Southern Great Plains, which emerges approximately 4 d after the convergence of wave-activity flux in the ERA-Interim reanalysis. Furthermore, the response of heatwaves to the extreme wave activity flux is not reproduced by the two models, a serious drawback as a dynamical downscaling framework is expected to connect large-scale forcing to local-scale phenomena. The WRF model employing spectral nudging is largely free from the aforementioned problems. A pair of sensitivity simulations suggests that spectral nudging is the key to improving the dynamics of quasi-stationary Rossby waves and their impact on surface air temperature. Our results also demonstrate the effectiveness of Rossby wave diagnostics that allow for realistic background flows for assessing the credibility of dynamical downscaling over North America, where incoming Rossby waves propagate through complex circulation patterns before traveling across the continent.

54 ENVIRONMENTAL SCIENCES↗