SEARCH · Engineering Papers
Results for “EXASCALE”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Caffeine v0.1.0
Caffeine is the CoArray Fortran Framework of Efficient Interfaces to Network Environments. Caffeine aims to produce a parallel runtime library that will support Fortran compilers with a programming-model-agnostic application binary interface (ABI) to various lower-level communication libraries. The current version of Caffeine uses the GASNet-EX networking middleware, also developed at Berkeley Lab. On many combinations of applications and platforms, GASNet-EX outperforms the widely used Message Passing Interface (MPI). Through GASNet-EX's support for communicating between graphics processing units (GPU), GASNet-EX has features that specifically target the emerging, leading-edge exascale computing platforms.
MAM4xx
SAND2023-05377O The Modal Aerosol Model with 4 fixed modes (MAM4xx) is a performance-portable, C++ implementation for modeling the chemical reactions of aerosols in the atmosphere. MAM4xx is part of the Energy Exascale Earth System Model (E3SM). The E3SM project is an ongoing Earth system modeling, simulation, and prediction project that optimizes the use of DOE laboratory resources to meet the science needs of the nation and the mission needs of DOE. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.
Reposcanner
SAND2023-05455O Reposcanner provides a highly modular, extensible framework for defining routines for mining data from software repositories and performing analyses on that data to yield valuable insights on team behaviors. Reposcanner features seamless support for different version control platforms like GitHub, Gitlab, and Bitbucket; smart parsing of URLs; intelligent credential management capabilities; and a comprehensive test suite. Reposcanner is connected to the Exascale Computing Project and is intended for research purposes.
ARES v1.x - Performance Portable Tool to Simulate Supernovae based on Parthenon Framework
Historically, codes for simulating supernovae (such as Arepo, FLASH or LEAFS) have been at the forefront of scientific high-performance computing to the immense computational resources required for full 3D simulations. However, given the shift towards heterogenous HPC architectures, many current-generation codes are at the risk of losing their competitiveness as they are only designed to run on homogeneous CPU-only systems. There exist several efforts to enable these codes for GPU’s, however, these efforts only consider specific architectures or vendors (e.g., implement only CUDA or HIP), limiting themselves to a small range of exascale computing systems. Frameworks such as Kokkos aim to provide a framework which is agnostic of the targeted architecture, enabling the development of performant and portable code. In the Ares code, we develop a performance portable tool to simulate supernovae based on the Parthenon Framework, which in turn uses Kokkos in the background. Here, the Parthenon Framework provides an interface to the underlying mesh-refinement routines, which form the backbone of our code. In addition, we incorporate the already existing Singularity-EOS toolkit to provide us with various equations of state, primarily the Helmholtz equation of state. We also include the JINA Reaclib as a basis for our nuclear network solver. Finally, we implement a gravity solver to complete the required physics. This setup will provide us with a minimal code base to simulate supernova in a similar style to the tried-and-tested Arepo code, but in a futureproof performance portable framework.
exadigitUE5
This project provides the AR/VR interface to ORNL's exascale digital twin. The main functionality is implemented using Unreal Engine 5.1 for Desktop or Microsoft Hololens2 based visualization and interation with the system. The digital twin provides data ingestion from telemetry, as well as triggering and interacting with simulations developed for the wider ExaDigiT project at ORNL, as well as for the LUMI system at CSC and other CrayEX Supercomputers. For the overarching project, see ExaDigiT at https://exadigit.github.io, with the code repositories at https://code.ornl.gov/exadigit.
TChem-atm v1.0
SAND2024-11300O TChem-atm is a software library that was developed to solve complex kinetic models for atmospheric chemistry applications. TChem-atm interface employs a hierarchical parallelism design to exploit the massive parallelism available from modern computing platforms. It also supports gas atmospheric chemistry applications, e.g., the energy exascale earth system model. TChem can be used as a box model or coupled with a climate model to compute the time evolution of gas tracer species. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.
UFNet: Joint U-Net and Fully Connected Neural Network to Bias Correct Precipitation Predictions from
Paper information. Shuang Yu, Indrasis Chakraborty, Gemma J. Anderson, Donald D. Lucas, Yannic Lops, and Daniel Galea. UFNet: Joint U-Net and fully connected neural network to bias correct precipitation predictions from climate models. Artificial Intelligence for the Earth Systems, 2024. Overview. This work develops the UFNet methodology to correct E3SM historical precipitation projection bias. The UFNet deep learning framework consists of a two-part architecture: a U-Net convolutional network to capture the spatiotemporal distribution of precipitation and a fully connected network to capture the distribution of higher-order statistics. The joint network, termed UFNet, can simultaneously improve the spatial structure of the modeled precipitation and capture the distribution of extreme precipitation values. Below we provide guidance for applying UFNet to correct the Energy Exascale Earth System Model (E3SM; Golaz et al. 2019) daily precipitation projection over the contiguous United States (CONUS). Getting started 1. Obtain the historical climate simulation and observation data. The E3SM historical simulation data are available through https://aims2.llnl.gov/search/cmip6/. The CPC unified gauge-based analysis of daily precipitation can be found through https://psl.noaa.gov/data/gridded/data.cpc.globalprecip.html. The ECMWF atmospheric reanalysis of the 20th century (ERA-20C) data are available through https://www.ecmwf.int/en/forecasts/datasets/reanalysis-datasets/era-20c. The spatial resolution of E3SM and observed datasets are both regridded to a common 1° resolution grid using conservative interpolation. The regridded E3SM, CPC and ERA-20C with 1° resolution can be found throught ./data/. 2. Train the fully connected network (DNN) Python train_dnn.py 3. Train the UFNet Python train_ufnet.py 4. Evaluation and compared with the baseline Python evaluation.py
HydraGNN v4.0
The new version of HydraGNN v4.0 provides additional core capabilities, such as: Inclusion of multi-body atomistic cluster expansion MACE, polarizable atom interaction neural network PAINN, and equivariant principal neighborhood aggregation (PNAEq) among the message passing layers supported -Inclusion of graph transformers to directly model long-range interactions between nodes that are distant in the graph topology Integration of graph transformers with message passing layers by combining the graph embedding generated by the two mechanisms, which allows for an improved expressivity of the HydraGNN architecture Improved re-implementation of multi-task learning (MTL) to allow its use for stabilized training across imbalanced, multi-source, multi-fidelity data Introduction of multi-task parallelism, a newly proposed type of model parallelism specifically for MTL architectures, which allows to dispatch different output decoding heads to different GPU devices Integration of multi-task parallelism with pre-existing distributed data parallelism to enable a 2D parallelization for distributed training Improved portability of the distributed training across Intel GPUs, which has been testes on ALCF exascale supercomputer Aurora Inclusion of 2-level fine-grained energy profilers portable across NVIDIA, AMD, and Intel GPUs to monitor the power and energy consumption associated with different functions executed by the HydraGNN code during data pre-load and training Restructuring of previous examples and inclusion of new sets of examples to illustrate the download, preprocess, and training of HydraGNN models on new large-scale open-source datasets for atomistic materials modeling (e.g., Alexandria, Transition1x, OMat24, OMol25)
NGEE Arctic Field-to-Model
This repository contains workshop documentation and shell scripts/computational infrastructure for building, running, and analyzing output from the DOE Energy Exascale Earth System Model (E3SM) Land Model (ELM).
ExaChem/exachem
Open Source Exascale Quantum Chemistry Software
Assessing Tropical Pacific-induced Predictability of Southern California Precipitation Using a Novel Multi-input Multi-output Autoencoder
We construct a novel Multi-Input Multi-Output Autoencoder-decoder (MIMO-AE) to capture the non-linear relationship of Southern California precipitation and tropical Pacific Ocean sea surface temperature. The MIMO-AE is trained on both monthly TP-SST and SC-PRECIP anomalies simultaneously. The co-variability of the two fields in the MIMO-AE shared nonlinear latent space can be condensed into an index, termed the MIMO-AE index. We use a transfer learning approach to train a MIMO-AE on the combined dataset of 100 years of output from a historical simulation with the Energy Exascale Earth Systems Model version 1 and a segment of observational data. We further use Long Short-Term Memory networks to assess sub-seasonal predictability of SC-PRECIP using the MIMO-AE index. We find that the MIMO-AE index provides enhanced predictability of SC-PRECIP for a lead-time of up-to four months as compared to Niño 3.4 index and the El Niño Southern Oscillation Longitudinal Index.
Hacking Kilometer-Scale Models: A Participative Model for Climate Information
In May 2025, nearly 700 participants from all around the world coalesced at 10 regional nodes and a few satellite nodes to take part in a global hackathon of kilometer-scale (horizontal grid spacing < 10 km) regional and global Earth system models. Exciting science is emerging from these efforts, ranging across novel model analysis, new ways of integrating with satellite data, and emulation with machine learning. New technologies were trialed that enable the community to work in new and complementary ways to democratize access to global information at a local scale from a set of the world’s highest-resolution climate models. The hackathon demonstrated how exascale data can be organized to be accessible to anyone. Fundamentally, the community could apply these techniques and technologies to move toward more participative models for coproduction and delivery of diverse sources of climate information for climate scientists and citizens alike.
Assessment of Warm and Dry Bias over ARM SGP Site in E3SMv2 and E3SM-MMF
Abstract Many climate models exhibit a dry and warm bias over the central United States during the summer months, including the Energy Exascale Earth System Model (E3SM) and its Multiscale Modeling Framework (MMF) configuration. Understanding the causes of this bias is important to shine a light on this common model error and reduce the uncertainty in future projections. In this study, we use E3SMv2 and E3SM-MMF to assess how parameterized and resolved convection affect temperature and precipitation biases over the Southern Great Plains site of the Atmospheric Radiation Measurement program. Both configurations overestimate near-surface temperature and underestimate precipitation at the ARM SGP site. The bias is associated with a lack of low-level clouds during days without precipitation and too much incoming solar radiation causing the surface to warm. Low-level cloud fraction in E3SM-MMF during the nonprecipitating days is lower in comparison to E3SMv2 and observation, consistent with the larger warm bias. We also find that the underestimated precipitation can be characterized as “too frequent, too weak” in E3SMv2 and “too rare, too intense” in E3SM-MMF. These deficiencies conspire to sustain the warm and dry bias over the central United States.
Soil Moisture Variability Intensifies and Prolongs Eastern Amazon Temperature and Carbon Cycle Response to El Niño–Southern Oscillation
El Niño–Southern Oscillation (ENSO) is an important driver of climate and carbon cycle variability in the Amazon. Sea surface temperature (SST) anomalies in the equatorial Pacific drive teleconnections with temperature directly through changes in atmospheric circulation. These circulation changes also impact precipitation and, consequently, soil moisture, enabling additional indirect effects on temperature through land–atmosphere coupling. To separate the direct influence of ENSO SST anomalies from the indirect effects of soil moisture, a mechanism-denial experiment was performed to decouple their variability in the Energy Exascale Earth System Model (E3SM) forced with observed SSTs from 1982 to 2016. Soil moisture variability was found to amplify and extend the effects of SST forcing on eastern Amazon temperature and carbon fluxes in E3SM. During the wet season, the direct, circulation-driven effect of ENSO SST anomalies dominated temperature and carbon cycle variability throughout the Amazon. During the following dry season, after ENSO SST anomalies had dissipated, soil moisture variability became the dominant driver in the east, explaining 67%–82% of the temperature difference between El Niño and La Niña years, and 85%–91% of the difference in carbon fluxes. These results highlight the need to consider the interdependence between temperature and hydrology when attributing the relative contributions of these factors to interannual variability in the terrestrial carbon cycle. Specifically, when offline models are forced with observations or reanalysis, the contribution of temperature may be overestimated when its own variability is modulated by hydrology via land–atmosphere coupling.
Causal Interactions between Southern Ocean Polynyas and High-Latitude Atmosphere–Ocean Variability
Abstract Weddell Sea open-ocean polynyas have been observed to occasionally release heat from the deep ocean to the atmosphere, indicating that their sporadic appearances may be an important feature of high-latitude atmosphere–ocean variability. Yet, observations of the phenomenon are sparse and many standard-resolution models represent these features poorly, if at all. We use a fully coupled, synoptic-scale preindustrial control simulation of the Energy Exascale Earth System Model (E3SMv0-HR) to effectively simulate open-ocean polynyas and investigate their role in the climate system. Our approach employs statistical tests of Granger causality to diagnose local and remote drivers of, and responses to, polynya heat loss on interannual to decadal time scales. First, we find that polynya heat loss Granger causes a persistent increase in surface air temperature over the Weddell Sea, strengthening the local cyclonic wind circulation. Along with responding to polynyas, atmospheric conditions also facilitate their development. When the Southern Ocean experiences a rapid poleward shift in the circumpolar westerlies following a prolonged negative phase of the southern annular mode (SAM), Weddell Sea salinity increases, promoting density destratification and convection in the water column. Finally, we find that the reduction of surface heat fluxes during periods of full ice cover is not fully compensated by ocean heat transport into the high latitudes. This imbalance leads to a buildup of ocean heat content that supplies polynya heat loss. These results disentangle the complex, coupled climate processes that both enable the polynya’s existence and respond to it, providing insights to improve the representation of these highly episodic sea ice features in climate models.
Impacts of Ice-Shelf Melting on Water-Mass Transformation in the Southern Ocean from E3SM Simulations
Abstract The Southern Ocean overturning circulation is driven by winds, heat fluxes, and freshwater sources. Among these sources of freshwater, Antarctic sea ice formation and melting play the dominant role. Even though ice-shelf melt is relatively small in magnitude, it is located close to regions of convection, where it may influence dense water formation. Here, we explore the impacts of ice-shelf melting on Southern Ocean water-mass transformation (WMT) using simulations from the Energy Exascale Earth System Model (E3SM) both with and without the explicit representation of melt fluxes from beneath Antarctic ice shelves. We find that ice-shelf melting enhances transformation of Upper Circumpolar Deep Water, converting it to lower density values. While the overall differences in Southern Ocean WMT between the two simulations are moderate, freshwater fluxes produced by ice-shelf melting have a further, indirect impact on the Southern Ocean overturning circulation through their interaction with sea ice formation and melting, which also cause considerable upwelling. We further find that surface freshening and cooling by ice-shelf melting cause increased Antarctic sea ice production and stronger density stratification near the Antarctic coast. In addition, ice-shelf melting causes decreasing air temperature, which may be directly related to sea ice expansion. The increased stratification reduces vertical heat transport from the deeper ocean. Although the addition of ice-shelf melting processes leads to no significant changes in Southern Ocean WMT, the simulations and analysis conducted here point to a relationship between increased Antarctic ice-shelf melting and the increased role of sea ice in Southern Ocean overturning.
On the Generation of Weddell Sea Polynyas in a High-Resolution Earth System Model
Larger Weddell Sea polynyas (WSPs), differentiated in this study from the smaller Maud Rise Polynyas (MRPs), forming to the east of the prime meridian in the proximity of the Maud Rise seamount, have last been observed in the 1970s. We investigate WSPs that grow realistically out of MRPs in a high-resolution (HR) preindustrial simulation with the Energy Exascale Earth System Model version 0.1. The formation of MRPs requires HR to simulate the detailed flow around Maud Rise, while the realistic formation of WSPs requires a model to produce MRPs. Furthermore, WSPs tend to follow periods of a prolonged build-up of a heat reservoir at depth and weakly negative wind-stress curl in association with the core of the southern hemisphere westerlies at an anomalously northern position. While this scenario also leads to drier conditions over the central Weddell Sea, which some literature claims to be a necessary condition for the formation of WSPs, our model results indicate that open-ocean polynyas do not occur during periods of weakly negative wind-stress curl despite drier atmospheric conditions. Our study supports the hypothesis noted in earlier studies that a shift from a weakly negative to a strongly negative wind-stress curl over the Weddell Sea is a prerequisite for WSPs to form, together with a large heat reservoir at depth. However, the ultimate trigger is a pronounced MRP; whose associated convection creates high surface salinity anomalies that propagate westward with the flow of the Weddell Gyre. If large enough, these anomalies trigger the formation of a WSP and a pulse of newly formed Antarctic Bottom Water.