Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “EXASCALE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Composite Analysis Vadose Zone Transport of Selected Radionuclides Released from DOE O 435.1 Sources.

The main objectives of the composite analysis (CA) compliance case vadose zone (VZ) facet are to simulate transport of radionuclide releases from the surface to the water table, and to provide radionuclide transfer rates to groundwater for inclusion into the Plateau-to-River (P2R) saturated zone (SZ) model (CP-57037, Model Package Report: Plateau to River Groundwater Model, Version 8.3). The parallel exascale version of the Subsurface Transport Over Multiple Phases (eSTOMP1) simulator is used to simulate flow and transport for the CA VZ models. The CA compliance case approach to address the scale and distribution of contaminant sources in the VZ facet is to subdivide the Hanford Site Central Plateau into 26 models that contain contaminant sources and liquid discharges likely to commingle during migration through the VZ to the water table.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Quantitative Performance Assessment of Proxy Apps and Parents (Report for ECP Proxy App Project Milestone ADCD-504-11)

The ECP Proxy Application Project has an annual milestone to assess the state of ECP proxy applications. Our FY21 milestone (ADCD-504-11) proposed to: "Assess the performance and fidelity of proxy applications, including those in the ECP Proxy App Suite, relative to the ECP Application workload on heterogeneous platforms. Use proxy applications and selected ECP applications to assess the utility of critical elements of the Exascale toolchain, especially tools used to collect performance data. Identify gaps in coverage and/or common situations in which proxies may fail to adequately represent ECP applications." To satisfy this milestone, the following specific tasks were completed: Study ability of MACSio to represent I/O workloads of adaptive mesh codes; Prepare report on assessed performance and debugging tools; Perform cosine similarity study on Intel and P9 and submit paper; Complete LDMS/GPU subcontract, complete and receive report; Complete validation of LDMS data collection for GPUs and submit paper; and Perform cosine similarity study on GPUs.

97 MATHEMATICS AND COMPUTING↗

Celeritas: GPU-accelerated particle transport for detector simulation in High Energy Physics experiments

Within the next decade, experimental High Energy Physics (HEP) will enter a new era of scientific discovery through a set of targeted programs recommended by the Particle Physics Project Prioritization Panel (P5), including the upcoming High Luminosity Large Hadron Collider (LHC) HL-LHC upgrade and the Deep Underground Neutrino Experiment (DUNE). These efforts in the Energy and Intensity Frontiers will require an unprecedented amount of computational capacity on many fronts including Monte Carlo (MC) detector simulation. In order to alleviate this impending computational bottleneck, the Celeritas MC particle transport code is designed to leverage the new generation of heterogeneous computer architectures, including the exascale computing power of U.S. Department of Energy (DOE) Leadership Computing Facilities (LCFs), to model targeted HEP detector problems at the full fidelity of Geant4. This paper presents the planned roadmap for Celeritas, including its proposed code architecture, physics capabilities, and strategies for integrating it with existing and future experimental HEP computing workflows.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Simulating physical and biogeochemical dynamics of the Arctic Ocean [Slides]

Ocean physics (currents, mixing, air-sea transfer of heat and gases) and biogeochemistry (carbon and oxygen cycles, ecosystem dynamics, nutrient distributions) are tightly coupled. We used the DOE-developed Energy Exascale Earth System Model (E3SM) to simulate physical and biogeochemical dynamics of the global ocean, with an emphasis on the western North Pacific. In particular, we used the grid refinement capability of E3SM’s ocean component (LANL-developed MPASOcean) to quantify the effect of model resolution on the carbon and oxygen cycles using a pair of century-long simulations that differ only in the western North Pacific grid. Regional grid refinement has a noticeable impact on biogeochemistry. Distribution of important nutrients (such as nitrate) changes the amount of photosynthesis by phytoplankton, which in turn affects air-sea transfer of CO2 and the local carbon cycle.

58 GEOSCIENCES↗

Benthic Kinetic Energy in an Earth System Model and Observations

The benthic layer of the ocean is closely correlated with every upper layer above it. Close analysis of benthic layer stress can yield an accurate depiction of the state of the ocean, as well as the atmosphere above it. Through the use of the Department of Energy’s Energy Exascale Earth System Model (E3SM), we took a look at how these features changed over time in a simulation spanning the historical period from 1958 to 2018 in the Arctic Ocean north of 60° N. Making use of E3SM’s regional refinement capability to place higher resolution in regions of interest, the E3SM-Arctic configuration has ~10 km resolution in the ocean and sea ice components in this region, coarsening up to ~60 km outside of the Arctic (Veneziani et al. 2022). In particular, we narrowly focused on the benthic kinetic energy levels, and how trends changed over time. To validate the fidelity of the E3SM model, we compared model current speed outputs over a 369-day period in the Bering Strait to actual recorded observations during this time period. Our analysis of the benthic kinetic energy mean, standard deviation, and trend throughout this time period can be used to characterize the effects of environmental impacts in the Arctic Ocean.

54 ENVIRONMENTAL SCIENCES↗

Combining Physics and Machine Learning for the Next Generation of Molecular Simulation

Simulating molecules and atomic systems at quantum accuracy is a grand challenge for science in the 21 st century. Quantum-accurate simulations would enable the design of new medicines and the discovery of new materials. The defining problem in this challenge is that quantum calculations on large molecules, like proteins or DNA, are fundamentally impossible with current algorithms. In this work, we explore a range of different methods that aim to make large, quantum-accurate simulations possible. We show that using advanced classical models, we can accurately simulate ion channels, an important biomolecular system. We show how advanced classical models can be implemented in an exascale-ready software package. Lastly, we show how machine learning can learn the laws of quantum mechanics from data and enable quantum electronic structure calculations on thousands of atoms, a feat that is impossible for current algorithms. Altogether, this work shows that combining advances in physics models, computing, and machine learning, we are moving closer to the reality of accurately simulating our molecular world.

74 ATOMIC AND MOLECULAR PHYSICS↗

Porting a fast-running wildfire plume model for use in national security and climate applications

In this project, the code for the fast-running Freitas wildfire plume model was successfully ported into the NARAC system, creating an operations-ready capability for predicting the transport of hazardous smoke from large wildfires. “Porting” refers to copying a section of code from one software package to another while accounting for unique dependencies in each software package. In this case, the code was ported from the Weather Research and Forecasting (WRF) Model, which is used extensively by the project team. To verify correct implementation, model results from the updated NARAC system were compared to those from WRF and the High-Resolution Rapid Refresh (HRRR) forecast model, which also employs the Freitas scheme. The NARAC User Interface (UI) and code documentation were also updated to include the new wildfire plume option, and a wildfire case was added to the NARAC test suite. The code was used in a real-time, semi-operational setup to predict smoke transport during the Cerro Pelado fire near Los Alamos National Laboratory in May 2022. The Freitas plume model was also tested for LLNL climate applications. Although the code was not ported into the Energy Exascale Earth System Model (E3SM), it was tested offline using E3SM atmospheric inputs, and results were compared to existing high-resolution plume predictions from large-eddy simulations in WRF. The code implementation and testing completed during this project will enable future work predicting smoke transport from large wildfires in LLNL national security and climate mission spaces.

54 ENVIRONMENTAL SCIENCES↗

FY2022 Q4: Demonstrate multi-turbine simulation with hybrid-structured/unstructured-moving-grid software stack running primarily on GPUs and propose improvements for successful KPP-2 [Poster]

Milestone accomplishments staged the ExaWind team for successful completion of KPP-2 challenge problem in FY23, which requires the simulation on Frontier of at least four MW-scale turbines in an atmospheric boundary layer with at least 20B gridpoints. The ExaWind project and software stack is many faceted, with team members working on multiple areas, including linear-system solvers (Trilinos, hypre, AMReX), overset meshes, turbulence modeling, and in situ visualization, all with an aim for high fidelity predictions and performance portability. This milestone marks significant improvements on many fronts and provides the team with a pathway to exascale wind farm simulations in FY23.

17 WIND ENERGY↗

Demonstrate multi-turbine simulation with hybrid-structured / unstructured-moving-grid software stack running primarily on GPUs and propose improvements for successful KPP-2

The goal of the ExaWind project is to enable predictive simulations of wind farms comprised of many megawatt-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines, capturing the thin boundary layers, and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources.

17 WIND ENERGY↗

Model Coupling Through Learned Representations

Reliable climate predictions are important for making robust decisions in response to the changing climate. This project aims to reduce mis-modeling uncertainties arising from the representation of the land-atmosphere coupling in the Energy Exascale Earth System Model (E3SM) by using a machine learning approach. This approach will use an encoder-decoder architecture to represent the information that is developed in the land model and given to the atmosphere model. The simulated data will be taken from the E3SM simulation. However, the incorporation of observed data into the simulated dataset reduces mis-modeling uncertainties.

54 ENVIRONMENTAL SCIENCES↗

Composite Analysis Vadose Zone Transport of Selected Hanford Site Composite Analysis: Vadose Zone Transport of Selected Radionuclides Released from DOE O 435.1 Waste Sites

The main objectives of the composite analysis (CA) compliance case vadose zone (VZ) facet are to simulate transport of radionuclide releases from the surface to the water table, and to provide radionuclide transfer rates to groundwater for inclusion into the Plateau-to-River (P2R) saturated zone (SZ) model (CP-57037, Model Package Report: Plateau to River Groundwater Model, Version 8.3). The parallel exascale version of the Subsurface Transport Over Multiple Phases (eSTOMP) simulator is used to simulate flow and transport for the CA VZ models. The CA compliance case approach to address the scale and distribution of contaminant sources in the VZ facet is to subdivide the Hanford Site Central Plateau into 26 models that contain contaminant sources and liquid discharges likely to commingle during migration through the VZ to the water table.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Five years of ForTrilinos ECP

The ForTrilinos subproject of the Exascale Computing Project (ECP) was initiated to bring the capabilities and scalability of the Trilinos numerical solver collection to Fortran scientific application codes. A novel Fortran extension to the Simplified Wrapper and Interface Generator (SWIG) tool, which automatically generates Fortran bindings from existing C/C++ library code, has been applied to key Trilinos solver libraries to generate the new ForTrilinos libraries. SWIG-Fortran has additionally been used to generate new Fortran compatibility layers for additional scientific libraries and applications. This report summarizes the products and impact of the ForTrilinos subproject.

97 MATHEMATICS AND COMPUTING↗

Improving the representation of isopycnal mixing in E3SM (Final Report)

The DOE-supported Energy Exascale Earth System Model (E3SM) is a major attempt by the Department of Energy to develop a new Earth System Model using unstructured grids, which allow for the model to concentrate resolution where it is most needed and avoid numerical artifacts experienced by previous Earth System Models (ESMs) using regular grids in which the lateral resolution becomes extremely fine as the resolution shrinks at the poles. This effort required rewriting many of the algorithms previously developed for regular grids. One algorithm that was problematic in the first version of E3SM was the representation of mixing due to turbulent ocean eddies with scales smaller than the model grid. These mesoscale eddies are the primary way by which tracers are stirred along density surfaces in the ocean interior. In particular, the process of isopycnal mixing exchanges fresher, more oxygenated waters from polar regions with saltier, nutrient-rich and oxygen poor waters from tropical regions. Previous work in our group has shown that this mechanism is vitally important for bringing oxygen into poorly ventilated tropical regions (Gnanadesikan et al., 2012, 2013) and plays a significant role in determining the uptake of anthropogenic carbon dioxide (Gnanadesikan et al., 2015). However, in E3SMv1 this process was turned off, as turning it on caused the model to become unstable. Additionally, the rate of isopycnal mixing is directly proportional to a mixing coefficient $A_{Redi}$ whose value varies from less than 400 m 2 /s to 2000 m 2 /s across contemporary climate models. The main thrusts of this proposal therefore were to: 1.) Improve the numerics of isopycnal mixing in E3SM; 2.) Identify ways in which climate models are sensitive to the isopycnal mixing coefficient; and 3.) Develop better representations of the isopycnal mixing coefficient.

54 ENVIRONMENTAL SCIENCES↗

Science & Technology Review: Climate Change Comes into Focus

At Lawrence Livermore National Laboratory, we focus on science and technology research to ensure our nation’s security. We also apply that expertise to solve other important national problems in energy, bioscience, and the environment. Science & Technology Review is published eight times a year to communicate, to a broad audience, the Laboratory’s scientific and technological accomplishments in fulfilling its primary missions. The publication’s goal is to help readers understand these accomplishments and appreciate their value to the individual citizen, the nation, and the world. The cover image shows a simulation run on the Department of Energy’s (DOE’s) state-of-the-science Energy Exascale Earth Systems Model (E3SM), which leverages DOE’s advanced supercomputers for climate and earth science research. As the article beginning on p. 4 describes, the newly released version 2 will be used to simulate aspects of Earth’s variability at weather-scale resolution and investigate decadal changes in climate that will critically impact the United States in coming years.

54 ENVIRONMENTAL SCIENCES↗

Accelerator Performance Tuning for E3SM: 2022 Annual Report [Abstract]

Over the past few years, we have been porting the Energy Exascale Earth System Model (E3SM) to GPU-accelerated architectures with a focus on the Leadership Computing Facilities at Oak Ridge and Argonne National Laboratories. This brief report describes work under a small allocation on the LANL Institutional Computing Chicoma machine to perform initial porting and performance tuning of the GPU-accelerated portions of E3SM for later production use on Chicoma, Perlmutter (a similar machine at NERSC) and eventually Venado.

58 GEOSCIENCES↗

US Department of Energy, Office of Science High Performance Computing Facility Operational Assessment 2021: Oak Ridge Leadership Computing Facility

Oak Ridge National Laboratory’s (ORNL’s) Leadership Computing Facility (OLCF) continues to surpass its operational target goals of supporting users; delivering fast, reliable computational ecosystems; creating innovative solutions for high-performance computing (HPC) needs; contributing to the community to build the next generation HPC workforce, and managing risks, safety, and security associated with operating some of the most powerful computers in the world. The results can be seen in the cutting-edge science conducted by users and the praise from the research community. Calendar year (CY) 2021 saw continued excellence in research supported by the OLCF’s leadership-class computing resources, including Summit (the nation’s most powerful supercomputer), the global scratch file system Alpine, the Scalable Protected Infrastructure (SPI), the Exploratory Visualization Environment for Research in Science and Technology (EVEREST), and the archival mass-storage resource High-Performance Storage System (HPSS). While maintaining access and exceptional user support for Summit, the OLCF continued to make progress on the installation and deployment of Frontier, which will be the nation’s first exascale system when it comes online at the start of CY 2023. Users have already begun running and optimizing scientific codes on Crusher, the OLCF test and development system equipped with Frontier’s architecture. Throughout the year, the OLCF maintained a strong culture of operational excellence, including risk management, workplace safety, and cybersecurity. The OLCF’s rigorous risk management strategy anticipated and mitigated risks, and at this time there are no high-priority operational risks. Similarly, ORNL and the OLCF were committed to operating under the US Department of Energy’s (DOE’s) safety regulations that ensure a safe workplace. Technical staff tracked and monitored existing threats and vulnerabilities within the OLCF while continually developing tools and practices to enhance operations without increasing the facility’s risk. CY 2021 was filled with outstanding results and accomplishments, including a very high rating from users on overall satisfaction for the eighth consecutive year; a tremendous number of node hours delivered to 1,671 researchers on Summit; and the successful delivery of the allocation split of roughly 60%, 20%, and 20% of core-hours offered for the Innovative and Novel Computational Impact on Theory and Experiment (INCITE), Advanced Scientific Computing Research Leadership Computing Challenge (ALCC), and Director’s Discretionary (DD) programs, respectively (Section 2). COVID-19 research remained a focus in 2021, and the ALCC and DD programs allocated over 1 million Summit hours to the COVID-19 High Performance Computing Consortium. These accomplishments, coupled with the high utilization rates (i.e., overall and capability usage), represent the fulfillment of the promise of leadership class machines: efficient facilitation of leadership-class computational applications.

97 MATHEMATICS AND COMPUTING↗