SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This repository contains workshop documentation and shell scripts/computational infrastructure for building, running, and analyzing output from the DOE Energy Exascale Earth System Model (E3SM) Land Model (ELM).
Using the 9-yr warm-season observations at the Atmospheric Radiation Measurement Southern Great Plains site, in this work we assess the land–atmosphere (LA) coupling in the North American Regional Reanalysis (NARR) and two climate models: hindcasts with the Community Atmosphere Model version 5.1 by Cloud-Associated Parameterizations Testbed (CAM5-CAPT) and nudged runs with the Energy Exascale Earth System Model Atmosphere Model version 1 Regionally Refined Model (EAMv1-RRM). We focus on three local convective regimes and diagnose model behaviors using the local coupling metrics. NARR agrees well with observations except a slightly warmer and drier surface with higher downwelling shortwave radiation and lower evaporative fraction. On clear-sky days, it shows warmer and drier early-morning conditions in both models with significant underestimates in surface evaporation by EAMv1-RRM. On the majority of the ARM-observed shallow cumulus days, there is no or little low-level clouds in either model. When captured in models, the simulated shallow cumulus shows much less cloud fraction and lower cloud bases than observed. On the days with late-afternoon deep convection, models tend to present a stable early-morning lower atmosphere more frequently than the observations, suggesting that the deep convection is triggered more often by elevated instabilities. Generally, CAM5-CAPT can reproduce the local LA coupling processes to some extent due to the constrained early-morning conditions and large-scale winds. EAMv1-RRM exhibits large precipitation deficits and warm and dry biases toward mid-to-late summers, which may be an amplification through a positive LA feedback among initial atmosphere and land states, convection triggering and large-scale circulations.
The US Department of Energy (DOE) conducts climate simulations on some of the world’s largest supercomputers. These exascale machines use heterogeneous architectures with both CPUs and GPUs, and scientific codes must adapt to make full use of this computing power. Los Alamos National Lab is developing Omega: The Ocean Model for E3SM Global Applications, which is specifically designed for modern exascale computers. It uses external libraries that have been optimized for a variety of architectures to run on different supercomputers. Omega is an unstructured-mesh ocean model based on TRiSK numerical methods. It will be the new ocean component of the DOE’s Energy Exascale Earth System Model (E3SM). The algorithms in Omega follow those of the current ocean component, MPAS-Ocean, but it will be written in C++ rather than Fortran to take advantage of the Kokkos performance portability library. Omega spatial operators are written as Kokkos kernels to run efficiently on both CPUs and GPUs. Work on Omega began in 2023 with a new C++ framework for unstructured mesh partitioning, halo exchanges, parallel IO, and Kokkos interfaces. The current version, Omega-0, is being developed to solve the shallow water equations and at present includes all of the tendency terms but not time stepping. Here we share the results of Omega-0 verification and performance testing. Verification includes unit tests implemented with CTest as well as convergence tests in Polaris, an in-house python package with a large suite of test problems. Performance tests compare simulations conducted on CPUs versus GPUs and across different architectures: tests are run on Frontier, which has AMD “Optimized 3rd Gen EPYC” CPUs and AMD MI250X GPUs, as well as Perlmutter, which is composed of AMD EPYC 7763 CPUs and NVIDIA A100 GPUs.
Using the 9-yr warm-season observations at the Atmospheric Radiation Measurement Southern Great Plains site, we assess the land-atmosphere (L-A) coupling in North American Regional Reanalysis (NARR) and two climate models: hindcasts with the Community Atmosphere Model version 5.1 by Cloud-Associated Parameterizations Testbed (CAM5-CAPT) and nudged runs with the Energy Exascale Earth System Model Atmosphere Model version 1 Regionally Refined Model (EAMv1-RRM). We focus on three local convective regimes and diagnose model behaviors using the Local Coupling metrics (Santanello et al. 2018). NARR agrees well with observations except a slightly warmer and drier surface with higher downwelling shortwave radiation and lower evaporative fraction. On clear-sky days, it shows warmer and drier early-morning conditions in both models with significant underestimates in surface evaporation by EAMv1-RRM. On the majority of the ARM-observed shallow cumulus days, there is no or little low-level clouds in either model. When captured in models, the simulated shallow cumulus shows much less cloud fraction and lower cloud bases than observed. On the days with late-afternoon deep convection, models tend to present a stable early-morning lower atmosphere more frequently than the observations, suggesting that the deep convection is triggered more often by elevated instabilities. Generally, CAM5-CAPT can reproduce the local L-A coupling processes to some extent due to the constrained early-morning conditions and large-scale winds. EAMv1-RRM exhibits large precipitation deficits and warm and dry biases towards mid-to-late summers, which may be an amplification through a positive L-A feedback among initial atmosphere and land states, convection triggering and large-scale circulations.
Focal Area(s): (2)Predictive modeling using AI techniques and AI-derived model components; use of AI and other tools to design a prediction system comprising of a hierarchy of models. (3) Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge- guided AI. Science Challenge: The Energy Exascale Earth System Model (E3SM) is a fully coupled, state-of-the-science Earth system model that uses code optimized for DOE's advanced computers to address the most critical scientific questions facing our nation and society (Golaz et al., 2019). The E3SM Land model (ELM) is designed to understand how the changes in terrestrial land surfaces will interact with other Earth system components and has been used to understand hydrologic cycles, biogeophysics, and ecosystem dynamics. In spite of great successes, the ELM has several known issues that restrain rapid improvements. For example, the ELM uses equilibrium models to simulate dynamic land-climate interactions and it requires long model spin-up time to identify suitable initial conditions for transient simulations. The ELM lacks built-in uncertainty mechanisms that can improve the robustness of model predictions. The ELM is a holistic, deterministic model system with a rigid design, and in many situations, it is hard to modify the ELM system to incorporate new theory/hypothesis and new data across scales to address emerging science problems (such as predicting the impacts of water cycle extremes). In addition, The ELM is technically optimized for traditional CPU-centric computers and it cannot fully utilize the current and incoming leadership computers for model simulations and uncertainty quantification (UQ). The success of artificial intelligence (AI) has inspired scientists to use AI models to discover intrinsic features from simulation data (Chattopadhyay et al., 2020) and observational data (Reichstein et al., 2019) to gain further process understanding of Earth science problems. However, autonomous AI model training through deep learning usually requires a huge amount of annotated data. To overcome the limitations from the data and computing resources, knowledge-guided AI models are necessary where human-knowledge is ingested in model construction (Banino et al., 2018) and training process (Silver et al., 2016) for efficient learning. Herein, we present a new way that leverages the process understanding from the ELM to guide AI model development for the ELM enhancement and UQ. We hope this study can inspire further Earth and environmental system model developments and transformations.
Earth system model experiments show that increasing horizontal resolution fundamentally alters the simulated soil-moisture-precipitation feedback. Kilometer-scale simulations often produce weaker or even negative feedback compared to coarse-resolution models. A key difference of kilometer-scale models is that they resolve mesoscale secondary circulations, including boundary layer horizontal rolls and cellular structures, in addition to cold pools and downdrafts associated with convective precipitation. However, because the relevant processes occur on yet-smaller scales, these circulations are often poorly resolved. This project demonstrated that boundary layer secondary circulations significantly affect surface heat exchanges and wind gusts, and that current model parameterizations can misrepresent these processes at kilometer-scale resolution. Using DOE Atmospheric Radiation Measurement (ARM) observations and targeted experiments with the DOE Energy Exascale Earth System Model (E3SM), we identified physically unrealistic wind gust and surface flux responses to secondary circulations, diagnosed a systematic overestimation of wind shear in convective cold pools, and uncovered a multivariate relationship between land surface fluxes and the scales of updrafts that form shallow cumulus clouds. These findings provide observation-based recommendations for improving parameterizations of surface fluxes and wind gusts in high-resolution Earth system models, thereby reducing uncertainty in convective storm prediction and land-atmosphere feedbacks.
21 Mixed-phase clouds are widespread in the Arctic and have substantial impacts on the 22 surface energy budget, sea ice extent, and regional climate. Significant changes are found in the 23 modeled phase partitioning of Arctic mixed-phase clouds in the newly developed U.S. 24 Department of Energy (DOE) Energy Exascale Earth System Model (E3SM) Atmosphere Model 25 version 1 (EAMv1) compared to its predecessor (CAM5/EAMv0). The mixed-phase clouds 26 simulated by EAMv1 is overly dominated by super-cool liquid which is often underestimated by 27 CAM5. Compared to CAM5, EAMv1 has made several important changes in its cloud physical 28 parameterizations, including using CLUBB to unify shallow convection, PBL turbulence, and 29 cloud macrophysics, as well as updating the MG two-moment cloud microphysics scheme and 30 using the CNT heterogeneous ice nucleation scheme to replace the Meyers scheme for mixed- 31 phase clouds. To understand which of the newly-implemented physical parameterizations is 32 responsible for the change of modeled mixed-phase cloud phase partitioning in EAMv1, 33 sensitivity tests are conducted by utilizing the short-term hindcast approach and results are 34 compared to the observations from the ARM Mixed-Phase Arctic Cloud Experiment (M-PACE) 35 field campaign. 36 It is found that although each scheme contributes to the decrease of cloud ice water 37 content (IWC) and increase of cloud liquid water content (LWC), only the combined effect of 38 CLUBB and CNT can explain the significant underestimation of IWC. By examining the budgets 39 of cloud microphysical processes, CLUBB is found to play a dominant role due to the fact that 40 CLUBB does not diagnoses cloud ice phase water in its assumed joint PDF method and thus may 41 not provide sufficient cloud ice to initialize ice phase microphysical processes such as the growth 42 of ice crystals through vapor deposition. Although a more effective heterogeneous ice nucleation 43 may alleviate the underestimation of IWC, the ice phase process in CLUBB requires urgent 44 attention in the future model development.
Abstract Many climate models exhibit a dry and warm bias over the central United States during the summer months, including the Energy Exascale Earth System Model (E3SM) and its Multiscale Modeling Framework (MMF) configuration. Understanding the causes of this bias is important to shine a light on this common model error and reduce the uncertainty in future projections. In this study, we use E3SMv2 and E3SM-MMF to assess how parameterized and resolved convection affect temperature and precipitation biases over the Southern Great Plains site of the Atmospheric Radiation Measurement program. Both configurations overestimate near-surface temperature and underestimate precipitation at the ARM SGP site. The bias is associated with a lack of low-level clouds during days without precipitation and too much incoming solar radiation causing the surface to warm. Low-level cloud fraction in E3SM-MMF during the nonprecipitating days is lower in comparison to E3SMv2 and observation, consistent with the larger warm bias. We also find that the underestimated precipitation can be characterized as “too frequent, too weak” in E3SMv2 and “too rare, too intense” in E3SM-MMF. These deficiencies conspire to sustain the warm and dry bias over the central United States.
This paper introduces Omega, the Ocean Model for E3SM Global Applications. Omega is a new ocean model designed to run efficiently on high performance computing (HPC) platforms, including exascale heterogeneous architectures with accelerators, such as Graphics Processing Units (GPUs). Omega is written in C and uses the Kokkos performance portability library. These were chosen because they are well-supported and will help future-proof Omega for upcoming HPC architectures. Omega will eventually replace the Model for Prediction Across Scales-Ocean (MPAS-Ocean) in the US Department of Energy's (DOE's) Energy Exascale Earth System Model (E3SM). Omega runs on unstructured horizontal meshes with variable-resolution capability and implements the same horizontal discretization as MPAS-Ocean. This work documents the design and performance of Omega Version 0.1.0 (Omega-V0), which solves the shallow water equations with passive tracers and is the first step towards the full primitive equation ocean model. On Central Processing Units (CPUs), Omega-V0 is 1.4 times faster than MPAS-Ocean with the same configuration. Omega-V0 is more efficient on GPUs than CPUs on a per-watt basis – by a factor of 5.3 on Frontier and 3.6 on Aurora, two of the world's fastest exascale computers.
Land surface models are increasingly used to simulate land surface processes at hyper-spatial resolutions (e.g., ∼1 km). As model resolution increases, grid-scale topographic effects on surface radiation fluxes and their interactions between adjacent grids become more pronounced. However, current land surface models routinely neglect the fine-scale topographic effects on surface radiation balance. This study developed physically-based and computationally-efficient parameterizations (fineTOP) that explicitly resolve fine-scale topographic effects on downward shortwave and longwave radiation as well as land surface radiative properties. The newly developed parameterizations were implemented and tested in the Energy Exascale Earth System Model (E3SM) Land Model (ELM). Multi-decadal km-resolution ELM simulations over the California Sierra Nevada show that fine-scale topography significantly impacts the surface energy balance and snow processes across seasons. Slope determines the magnitude of topographic effects, while aspect controls their sign. For slopes larger than 30°, topography-induced change in annual surface temperature can be as large as 3.3 K. Regionally, the mean value and standard deviation of topography-induced changes in annual surface temperature are −0.22 ± 0.38 K and +0.25 ± 0.37 K over north-facing and south-facing slopes, respectively. Topography-induced changes in surface radiative properties account for 3.5% ± 13.8% of total topographic effects on annual net radiation. With fineTOP, ELM captures the aspect-dependence of snow cover fraction, snow water equivalent, and land surface temperature found in MODIS satellite observations and a snow reanalysis data set, while the default ELM fails to capture this phenomenon. The enhanced capability to represent fine-scale topographic effects on surface radiation balance can be used to advance understanding of the role of fine-scale topography in land surface processes and land-atmosphere interactions over mountainous regions.
Abstract Earth System Models (ESMs) are increasingly representing agriculture due to its impact on biogeochemical cycles, local and regional climate, and fundamental importance for human society. Realistic large scale simulations may require spatially varying crop parameters that capture crop growth at various scales and among different cultivars, as well as common crop management practices, but their importance is uncertain, and they are often not represented in ESMs. In this study, we examine the impact of using constant versus spatially varying crop parameters using a novel, realistic crop rotation scenario in the Energy Exascale Earth System Model (E3SM) Land Model version 2 (ELMv2). We implemented crop rotation by using ELMv2's dynamic land unit capability, and then calibrated and validated the model against observations collected at three AmeriFlux sites in the US Midwest with corn soybean rotation. The calibrated model closely captured the magnitude and observed seasonality of carbon and energy fluxes across crops and sites. We performed regional simulations for the US Midwest using the calibrated model and found that spatially varying only a few crop parameters across the region, as opposed to using constant parameters, had a large impact, with the carbon fluxes and energy fluxes both varying by up to 40%. These results imply that large scale ESM simulations using spatially invariant crop parameters may result in biased energy and carbon fluxes estimation from agricultural land, and underline the importance of improving human‐earth systems interactions in ESMs.
Abstract not provided.
Focal Area(s): Primary focal areas are: predictive modeling through the use of AI-derived model components; advanced methods including network design/optimization/deep learning. Science Challenge: The atmospheric, ocean and ice dynamics components of the Energy Exascale Earth System Model (E3SM) are governed by Partial Differential Equations (PDEs) and significant efforts have been made during the last decades to develop such computational models. Here we propose to fundamentally improve these PDE-based codes by enhancing them with Machine Learning (ML) sub-models for complex, poorly understood physical processes in the context of ice sheet modeling. We propose to train these models with a novel approach that allows the assimilation of the different sources of data available (direct/indirect observations and possibly simulation data), improving on existing simplified models. We also highlight computational challenges originating from the coexistence of PDE-based and ML-based models.
A Lagrangian framework is used to evaluate aerosol–cloud interactions in the U.S. Department of Energy's Energy Exascale Earth System Model (E3SM) version 1 (E3SMv1) for measurements taken at Graciosa Island in the Azores where a U.S. Department of Energy Atmosphere Radiation Measurement (ARM) site is located. This framework uses direct measurements of cloud condensation nuclei (CCN) concentration (instead of relying on satellite retrievals of aerosol optical depth) and incorporates a suite of ground-based ARM measurements, satellite retrievals, and meteorological reanalysis products that when applied to over a 1500 trajectories provides key insights into the evolution of low-level clouds and aerosol radiative forcing that is not feasible from a traditional Eulerian analysis framework. Significantly lower concentrations (40 %) of surface CCN concentration are measured when precipitation rates in 48 h back trajectories average above 1.2 mm d -1 in the Integrated Multi-satellitE Retrievals for Global Precipitation Measurement (IMERG) product. The depletion of CCN concentration when precipitation rates are elevated is nearly twice as large in the ARM observations compared to E3SMv1 simulations. The model CCN concentration bias remains significant despite modifying the autoconversion and accretion rates in warm clouds. As the clouds in trajectories associated with larger surface-based CCN concentration advect away from Graciosa Island, they maintain higher values of droplet number concentrations (N d ) over multiple days in observations and E3SM simulations compared to trajectories that start with lower CCN concentrations. The response remains robust even after controlling for meteorological factors such as lower troposphere stability, the degree of cloud coupling with the surface, and island wake effects. E3SMv1 simulates a multi-day aerosol effect on clouds and a Twomey radiative effect that is within 30 % of the ARM and satellite observations. However, the mean cloud droplet concentration is more than 2–3 times larger than in the observations. While Twomey radiative effects are similar amongst autoconversion and accretion sensitivity experiments, the liquid water path and cloud fraction adjustments are positive when using a regression model as opposed to negative when using the present-day minus pre-industrial aerosol emissions approach. This result suggests that tuning the autoconversion and accretion alone is unlikely to produce the desired aerosol susceptibilities in E3SMv1.
Compound riverine and coastal flooding is usually driven by complex interactions among meteorological, hydrological, and ocean extremes. However, existing efforts to model this phenomenon often do not integrate hydrological processes across atmosphere–land–river–ocean systems, leading to substantial uncertainties that have not been fully examined. To bridge this gap, we leverage the new capabilities of the Energy Exascale Earth System Model (E3SM) that enable a multi-component framework that integrates coastally refined atmospheric, terrestrial, and oceanic components. We evaluate compound uncertainties arising from two-way land–river–ocean coupling in E3SM and track the cascading meteorological and hydrological uncertainties through ensemble simulations over the Delaware River basin and estuary during Hurricane Irene (2011). Our findings highlight the importance of two-way river–ocean coupling to compound flood modeling and demonstrate E3SM's capability in capturing compound flood extent near the coast, with a hit rate over 0.75. Our study shows the growing uncertainties that transition from atmospheric forcings to flood distribution and severity. Furthermore, an analysis based on artificial neural networks is used to assess the roles of hydrological drivers, such as infiltration and soil moisture, in the generation of compound flooding. The response of compound floods to tropical cyclones (TCs) is found to be susceptible to these often overlooked drivers. For instance, the flooded area could increase more than 2-fold (∼2.4) if Hurricane Irene were preceded by an extreme antecedent soil moisture condition (AMC). The results not only support the use of a multi-component framework for interactive flooding processes, but also underscore the necessity of broader definitions of compound flooding that encompass the simultaneous occurrence of intense precipitation, storm surge, and high AMC during TCs.
Abstract. This paper provides an overview of the United States (US) Department of Energy's (DOE's) Energy Exascale Earth System Model version 2 (E3SMv2) fully coupled regionally refined model (RRM) and documents the overall atmosphere, land, and river results from the Coupled Model Intercomparison Project 6 (CMIP6) DECK (Diagnosis, Evaluation, and Characterization of Klima) and historical simulations – a first-of-its-kind set of climate production simulations using RRM. The North American (NA) RRM (NARRM) is developed as the high-resolution configuration of E3SMv2 with the primary goal of more explicitly addressing DOE's mission needs regarding impacts to the US energy sector facing Earth system changes. The NARRM features finer horizontal resolution grids centered over NA, consisting of 25→100 km atmosphere and land, a 0.125∘ river-routing model, and 14→60 km ocean and sea ice. By design, the computational cost of NARRM is ∼3× of the uniform low-resolution (LR) model at 100 km but only ∼ 10 %–20 % of a globally uniform high-resolution model at 25 km. A novel hybrid time step strategy for the atmosphere is key for NARRM to achieve improved climate simulation fidelity within the high-resolution patch without sacrificing the overall global performance. The global climate, including climatology, time series, sensitivity, and feedback, is confirmed to be largely identical between NARRM and LR as quantified with typical climate metrics. Over the refined NA area, NARRM is generally superior to LR, including for precipitation and clouds over the contiguous US (CONUS), summertime marine stratocumulus clouds off the coast of California, liquid and ice phase clouds near the North Pole region, extratropical cyclones, and spatial variability in land hydrological processes. The improvements over land are related to the better-resolved topography in NARRM, whereas those over ocean are attributable to the improved air–sea interactions with finer grids for both atmosphere and ocean and sea ice. Some features appear insensitive to the resolution change analyzed here, for instance the diurnal propagation of organized mesoscale convective systems over CONUS and the warm-season land–atmosphere coupling at the southern Great Plains. In summary, our study presents a realistically efficient approach to leverage the fully coupled RRM framework for a standard Earth system model release and high-resolution climate production simulations.
Abstract. Using the regionally refined mesh (RRM) configuration of the US Department of Energy's Simple Cloud-Resolving Energy Exascale Earth System Model (E3SM) Atmosphere Model (SCREAM), we simulate and evaluate four meteorologically distinct atmospheric river events over California. We test five different RRM configurations, each differing in terms of the areal extent of the refined mesh and the resolution (ranging from 800 m to 3.25 km). We find that SCREAM RRM generally has a good representation of the AR-generated precipitation in CA, even for the control simulation which has a very small 3 km refined patch, and is able to capture the fine-scale regional distributions that are controlled largely by the fine-scale topography of the state. It is found that SCREAM generally has a wet bias over topography, most prominently over the Sierra Nevada mountain range, with a corresponding dry bias on the lee side. We find that refining the resolution beyond 3 km (specifically 1.6 km and 800 m) has virtually no benefit towards reducing systematic precipitation biases but that improvements can be found when increasing the areal extent of the upstream refined mesh. However, these improvements are relatively modest and only realized if the size of the refined mesh is expanded to the scale where employing RRM no longer achieves the substantial cost benefit it was intended for.
SAND2024-11300O TChem-atm is a software library that was developed to solve complex kinetic models for atmospheric chemistry applications. TChem-atm interface employs a hierarchical parallelism design to exploit the massive parallelism available from modern computing platforms. It also supports gas atmospheric chemistry applications, e.g., the energy exascale earth system model. TChem can be used as a box model or coupled with a climate model to compute the time evolution of gas tracer species. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.