Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “EXASCALE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87

ECP ST Capability Assesment Report (CAR) for VTK-m (FY18)

The ECP/VTK-m project is providing the core capabilities to perform scientific visualization on Exascale architectures. The ECP/VTK-m project fills the critical feature gap of performing visualization and analysis on processors like graphics-based processors and many integrated core. The results of this project will be delivered in tools like ParaView, Vislt, and Ascent as well as in stand-alone form. Moreover, these projects are depending on this ECP effort to be able to make effective use of ECP architectures.

97 MATHEMATICS AND COMPUTING↗

ECP Milestone Memo WBS 2.3.4.13 ECP/VTK-m FY18Q4 [MS-18/09-10] Dynamic Types / Rendering Topologies STDA05-16

The STDA05-16 milestone comprises the following 3 distinct deliverables. OpenMP VTK-m currently supports three types of devices: serial CPU, TBB, and CUDA. To run algorithms on multicore CPU-type devices (such as Xeon and Xeon Phi), TBB is required. However, there are known issues with integrating a software product using TBB with another one using OpenMP. Therefore, we will add an OpenMP device to the VTK-m software. When engaged, this device will run parallel algorithms using OpenMP directives. This will mesh more nicely with other code also using OpenMP. Rendering Topological Entities VTK-m currently supports surface rendering by tessellation of data structures,and rendering the resulting triangles. We will extend current functionality to include face, edge, and point rendering. Better Dynamic Types Impl For the best efficiency across all platforms, VTK-m algorithms use static typing with C++ templates. However, many libraries like VTK, ParaView, and Visit use dynamic types with virtual functions because data types often cannot be determined at compile time. We have an interface in VTK-m to merge these two typing mechanisms by generating all possible combinations of static types when faced with a dynamic type. Although this mechanism works, it generates very large executables and takes a very long time to compile. As we move forward, it is clear that these problems will get worse and become infeasible at exascale. We will rectify the problem by introducing some level of virtual methods, which require only a single code path, within VTK-m algorithms. This first milestone produces a design document to propose an approach to the new system.

97 MATHEMATICS AND COMPUTING↗

Final Report: Modeling coupled ice sheet-ocean interactions in the Model for Prediction Across Scales (MPAS) and in DOE Earth System Models

Ice sheet-ocean interactions are involved in a potential climate tipping point in the climate system. Weakening of dynamical ocean barriers that currently hold warmer waters off the Antarctic continental shelf could lead to warming under Antarctica’s largest ice shelves, causing as much as a hundredfold increase in sub-ice-shelf melting. Increased ice-sheet melting could trigger dynamical instabilities in the ice sheet itself if sufficient buttressing from ice shelves is lost. This project developed and tested several modeling capabilities needed to investigate these phenomena. In collaboration with a number of international groups, notably the climate modeling group at Los Alamos National Laboratory (LANL), the following capabilities were added to the Energy Exascale Earth System Model (E3SM) and its ocean component (the Model for Prediction Across Scales Ocean, MPAS-Ocean): 1) a new vertical coordinate appropriate for ice-shelf cavities; 2) an initialization procedure appropriate for damping waves from imbalances in ocean pressure and that of the overlying ice shelf; 3) A suite of idealized test cases related to ice shelf-ocean interactions; 4) A set of diagnostics for tracking freshwater fluxes and heat budgets from ice-shelf melting; 5) infrastructure for computing ice sheet-ocean fluxes in the E3SM coupler; and 6) A set of analysis and visualization tools for E3SM ocean and sea-ice validation with a particular focus on Antarctic and Southern Ocean climate. Additionally, the project included participation and leadership in a number of international model intercomparison projects (MIPs). Most notably, the PI was a co-chair of the Marine Ice Sheet-Ocean Model Intercomparison Project (MISOMIP), designing the experiment, coordinating participation in the MIP and performing the bulk of the analysis. Although the project was cut short when the PI accepted a staff scientist position at LANL, the project played a role in seven publications and has segued smoothly into ongoing Department of Energy projects in the “ecosystem” surrounding E3SM.

54 ENVIRONMENTAL SCIENCES↗

Blade-Resolved, Single-Turbine Simulations Under Atmospheric Flow

The ultimate goal of the ExaWind project is to enable scientific discovery through predictive simulations of wind farms comprised of many megawatt-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. The objective of this milestone is to demonstrate a 'production run' of a megawatt-scale turbine to exercise and demonstrate the turbine simulation capabilities that have been developed during the previous two years of the ExaWind project. Demonstrating this simulation capability is the critical first step in enabling Nalu-Wind to be used as a predictive modeling tool that can advance the scientific understanding of wind turbine performance. In Section 2, the milestone description is provided. Next, in Section 3, we present the NREL 5-megawatt (MW) reference turbine that was used to demonstrate Nalu-Wind's capabilities and describe the four computational meshes that were generated. In Section 4, we present results from simulations of the turbine operating under uniform inflow and homogeneous isotropic turbulence (HIT) conditions. Finally, in Section 5, notable achievements, conclusions, and a path forward are described.

17 WIND ENERGY↗

DARMA-EMPIRE Integration and Performance Assessment – Interim Report

We begin by presenting an overview of the general philosophy that is guiding the novel DARMA developments, followed by a brief reminder about the background of this project. We finally present the FY19 design requirements. As the Exascale era arises, DARMA is uniquely positioned at the forefront of asychronous many-task (AMT) research and development (R&D) to explore emerging programming model paradigms for next-generation HPC applications at Sandia, across NNSA labs, and beyond. The DARMA project explores how to fundamentally shift the expression(PM) and execution(EM)of massively concurrent HPC scientific algorithms to be more asynchronous, resilient to executional aberrations in heterogeneous/unpredictable environments, and data-dependency conscious—thereby enabling an intelligent, dynamic, and self-aware runtime to guide execution.

97 MATHEMATICS AND COMPUTING↗

Nalu's Linear System Assembly using Tpetra

The Nalu Exascale Wind application assembles linear systems using data structures provided by the Tpetra package in Trilinos. This note describes the initialization and assembly process. The purpose of this note is to help Nalu developers and maintainers to understand the code surrounding linear system assembly, in order to facilitate debugging, optimizations, and maintenance.

17 WIND ENERGY↗

High Performance Computing - Power Application Programming Interface Specification

Achieving practical exascale supercomputing will require massive increases in energy efficiency. The bulk of this improvement will likely be derived from hardware advances such as improved semiconductor device technologies and tighter integration, hopefully resulting in more energy efficient computer architectures. Still, software will have an important role to play. With every generation of new hardware, more power measurement and control capabilities are exposed. Many of these features require software involvement to maximize feature benefits. This trend will allow algorithm designers to add power and energy efficiency to their optimization criteria. Similarly, at the system level, opportunities now exist for energy-aware scheduling to meet external utility constraints such as time of day cost charging and power ramp rate limitations. Finally, future architectures might not be able to operate all components at full capability for a range of reasons including temperature considerations or power delivery limitations. Software will need to make appropriate choices about how to allocate the available power budget given many, sometimes conflicting considerations.

97 MATHEMATICS AND COMPUTING↗

UPC++ Specification v1.0, Draft 10

UPC++ is a C++11 library providing classes and functions that support Partitioned Global Address Space (PGAS) programming. We are revising the library under the auspices of the DOE’s Exascale Computing Project, to meet the needs of applications requiring PGAS support. UPC++ is intended for implementing elaborate distributed data structures where communication is irregular or fine-grained. The UPC++ interfaces for moving non-contiguous data and handling memories with different optimal access methods are composable and similar to those used in conventional C++. The UPC++ programmer can expect communication to run at close to hardware speeds. The key facilities in UPC++ are global pointers, that enable the programmer to express ownership information for improving locality, one-sided communication, both put/get and RPC, futures and continuations. Futures capture data readiness state, which is useful in making scheduling decisions, and continuations provide for completion handling via callbacks. Together, these enable the programmer to chain together a DAG of operations to execute asynchronously as high-latency dependencies become satisfied.

97 MATHEMATICS AND COMPUTING↗

Trinity Benchmarks on the Intel Xeon Phi (Knights Corner)

This report documents the early experiences with porting and performance analysis of the Tri-Lab Trinity benchmark applications on Intel Xeon Phi (Knights Corner) (KNC) processor. KNC, the second generation of the Intel Many Integrated Core (MIC) architectures, uses a large number of small P54C-x86 cores with wide vector units and is deployed as PCI bus attached process accelerators. Sandia has experimental test beds of small InifiniBand clusters and workstations to investigate the performance of the MIC architecture. On these experimental test beds the programming models that may be investigated are "offload", "symmetric" and "native". Among these program usage models our primary interest is in the so called "native" mode, because the planned Trinity system to be deployed in 2016 using the next generation MIC processor architecture called Knights Landing would be self-hosted. Trinity / NERSC-8 benchmark programs cover a variety of scientific disciplines and they were used to guide the procurement of these systems. Architectures such as the Intel MIC are well suited to study evolving processor architectures and a usage model commonly referred to as MPI + X that facilitates migration of our applications to use both coarse grain and fine grain parallelism. Our focus with the applications selected is on the efficacy of algorithms in these applications to take advantage of features like: large number of cores, wide vector units, higher-bandwidth and deeper memory sub-system. This is a first step towards understanding applications, algorithms and programming environments for Trinity and future exascale computing systems.

97 MATHEMATICS AND COMPUTING↗

Early Career Award: An Enabling Computational Framework for Uncertainty Assimilation and Propagation in Complex PDE Systems: Sparse and Low-rank Techniques (Final Report)

This project aims to develop a set of new theories, algorithms, and computational tools that enable ultra-scalable representation and propagation of high-dimensional uncertainties to circumvent the issue of curse-of-dimensionality. The research components are motivated by the fact that highly scalable algorithms are needed to achieve exascale performance for uncertainty quantification and predictive simulation at extreme scales. Although these developments are generic and applicable to a wide range of high-dimensional, complex, stochastic, partial-differential-equation (PDE) systems, this research effort will focus on predictive simulation of high-energy-density lithium batteries. To create knowledge about the precise failure mechanisms of these batteries and ultimately predict their performance and reliability, a truly data-driven, multi-scale, multi-physics framework is needed that allows studying (i) dominant sources of uncertainty in the governing physical models at all scales of relevance and (ii) the interface between the interchanging physics and scales. The impact of the planned mathematical and numerical advancements in prediction of high-dimensional uncertain systems will be broad across areas of engineering and science such as climate modeling, fusion energy, combustion, and nanoscience, among others.

97 MATHEMATICS AND COMPUTING↗

SNL ATDM Data and Visualization: IOSS and FAODEL

The SNL ATDM Data and Visualization project is developing data management software to improve how applications store and exchange large datasets efficiently on Exascale platforms. The data portion of this project is composed of two related efforts: (1) production work focused on improving Sandia's IOSS library for mesh datasets and (2) research work focused on developing new communication software named FAODEL that enables applications in a workflow to exchange data more efficiently.

97 MATHEMATICS AND COMPUTING↗

SNL ATDM Visualization (ECP ST Capability Assessment Report)

The SNL ATDM Data and Visualization work consolidates existing ATDM activities in scalable data management and visualization. Part of the responsibilities of the SNL ATDM Data and Visualization Project is the maintenance and development of visualization resources for ATDM applications on Exascale platforms. The ATDM Scalable Visualization project provides visualization and analysis required to satisfy the needs of the ASC/ATDM applications on next-generation, many-core platforms. This involves many activities including the re-engineering of visualization algorithms, services, and tools that enable ASC customers to carry out data analysis on ASC systems and ACES platforms. Current tools include scalable data analysis software released open source through ParaView, VTK, and Catalyst. We are also both leveraging and contributing to VTK-m, a many-core visualization library, to satisfy our visualization needs on advanced architectures. The scope of the Scalable Visualization under ATDM at SNL is R&D for the programming model and implementation of visualization code for ASC/ATDM projects and ASC/ATDM application support.

97 MATHEMATICS AND COMPUTING↗

Decrease time-to-solution through improved linear-system setup and solve (Milestone Report)

The goal of the ExaWind project is to enable predictive simulations of wind farms composed of many MW-scale turbines situated in complex terrain. Predictive simulations will require computational fluid dynamics (CFD) simulations for which the mesh resolves the geometry of the turbines, and captures the rotation and large deflections of blades. Whereas such simulations for a single turbine are arguably petascale class, multi-turbine wind farm simulations will require exascale-class resources. We describe in this report our efforts to decrease the setup and solution time for the mass-continuity Poisson system with respect to the benchmark timing results reported in FY18 Q1. In particular, we investigate improving and evaluating two types of algebraic multigrid (AMG) preconditioners: Classical Ruge-Stfiben AMG (C-AMG) and smoothed-aggregation AMG (SA-AMG), which are implemented in the Hypre and Trilinos/MueLu software stacks, respectively.

17 WIND ENERGY↗

An eddy-permitting ocean-sea ice general circulation model (E3SMv0-HiLAT03): Description and evaluation

We document modeling setups and present results for simulated ocean and sea ice climate from a recently developed, intermediate-resolution global ocean-sea ice model [Energy Exascale Earth System Model version 0 configured for High-Latitude Application and Testing at 0.3° resolution (E3SMv0-HiLAT03)]. The horizontal resolution of HiLAT03 ranges from 33 km in the tropics to 8.5 km at high latitudes, with 100 vertical levels. This resolution allows the explicit representation of some mesoscale eddies, particularly at lower latitudes, therefore being named as an “eddy-permitting model”. Analyses are presented based on the output of two 186-yr control simulations forced by modern atmospheric conditions of climatological and inter-annually varying data sets, respectively. Results are compared to available observational data sets and the 1° NCAR model, which has somewhat similar ocean physics but a coarser resolution and an earlier version of the sea ice component. Analyses focus on ocean temperature and salinity fields, ocean dynamics and circulations, sea ice concentrations and thicknesses. The HiLAT03 model does reasonably well in most oceanic aspects evaluated here, especially in ocean meridional heat transport, despite the fact that no explicit eddy parameterization is applied. Many Arctic sea ice features are much improved compared with the 1° NCAR model, but the Antarctic summer sea ice is still generally low in concentrations and thicknesses. In addition, we discuss the prolonged deep convection (“Antarctic prolonged polynya”) over the Southern Ocean in the inter-annually forced case.

54 ENVIRONMENTAL SCIENCES↗

Checkpoint-Restart and Platform Design Criteria

Long computations often use checkpoint/restart to survive the inevitable failures. Optimal checkpoint/restart strategy can be derived in terms of special functions, and approximated within the regime of interest. As a further step under nominal assumptions, platforms can be optimized for maximum progress rate, computed in terms of non-dimensional parameter JMTTI/Delta, where JMTTI is the Job Mean Time To Interrupt and Delta is the time it takes to write (or read) a checkpoint. Scaling to a larger platform of the same technology requires scaling checkpoint bandwidth quadratically to maintain the same progress rate. This was observed during the design of LANL’s Roadrunner in 2007, led to burst buffers proposed in 2009 and introduced on Trinity in 2015. The need to compute reliably continues to impact the design of future exascale platforms.

97 MATHEMATICS AND COMPUTING↗

Basic Research Needs for Microelectronics

Since the invention of the integrated circuit in 1958, advances in microelectronics have followed Moore’s law and other scaling laws. These have led to over a billion-fold increase in the number of transistors on a chip. The Department of Energy’s Office of Science (DOE-SC) programs have always been at the cutting edge of microelectronics, making major contributions to the scientific understanding, materials, and advanced instrumentation that enabled innovations to promote scaling. This has driven transformative advances in microelectronics for the challenging demands of DOE’s high performance computing and science facilities. Now, strong evidence exists that scaling is approaching its physical and economic limits, and yet, the growth of data-centric computing and sensor networks is redefining computing workloads and microelectronics needs. In addition, greatly improved microelectronics are needed for the nation’s electricity grid if it is to be energy-efficient, resilient to natural phenomena and intentional attack, and agile in adapting to fluctuations in demand and power generation. Sustained and rapid progress in microelectronics science and technology from millivolt to megavolt scales is thus essential if we are to continue pushing the boundaries of science within DOE, and more significantly, to continue to lead the global information and power technology revolution. In October 2018, DOE-SC convened a workshop to address Basic Research Needs for Microelectronics by a “co-design” approach. Participants focused on scientific issues associated with advanced microelectronics technologies for applications relevant to the DOE mission, including computing, power grid management, and science facility workloads. (Topics of direct relevance to quantum information science and quantum computing were outside the scope of this workshop.) The workshop was organized around microelectronics needs for three areas: 1) future DOE-SC facilities, 2) high performance computing beyond exascale (a billion billion calculations per second), and 3) power control, conversion, and detection for a modernized electrical grid and related high power applications. Panels were formed around each of these areas, with a fourth panel formed to address Crosscutting Research. Workshop participants were asked to focus on a co-design innovation ecosystem in which materials, chemistries, devices, systems, architectures, algorithms, and software are researched and developed in a closely integrated fashion, with feedback and interdisciplinary collaboration at each interface in this microelectronics technology hierarchy. The panels identified the five Priority Research Directions on the following page.

36 MATERIALS SCIENCE↗

XVis: Visualization for the Extreme-Scale Scientific Computation Ecosystem (Final Report)

Scientific computing is no longer be purely about how fast computations can be performed. Energy constraints, processor changes, and I/O limitations necessitate significant changes in both the software applications used in scientific computation and the ways in which scientists use them. Components for modeling, simulation, analysis, and visualization must work together in a computational ecosystem, rather than working independently as they have in the past. The XVis project provides the necessary research and infrastructure for scientific discovery in this new computational ecosystem by addressing four interlocking challenges: emerging processor technology, in situ integration, usability, and proxy analysis. This report reviews the accomplishments of the XVis project to prepare scientific visualization for Exascale computing.

97 MATHEMATICS AND COMPUTING↗

CMDV-RRM: Representation of Clouds and Convection across scales in E3SM

In order to address mission-relevant questions, DOE’s Energy Exascale Earth System Model (E3SM) is pushing the limits of horizontal resolution among global Earth System Models (ESMs). The atmospheric resolution in the recently released E3SMv1 is 110 km in the standard configuration, and 25 km in the high-resolution configuration. Furthermore, E3SM is fairly unique among global ESMs with a capability for multiresolution modeling using refined grids in most of its components (atmosphere, land, ocean, sea-ice). This Regionally Refined Model (RRM) capability is critical for future E3SM simulation campaigns that have a strong regional focus to meet DOE's needs in support of energy-sector decisions. RRM grids are also particularly well suited for model evaluation and process-level studies taking advantage of the vast amount of ASR site data collected over the past several decades. The overarching goal of this project was to understand and improve the behavior of clouds and convection in E3SM across these scales using RRM. Key deliverables that resulted from the project are summarized below, with more details provided in the subsequent sections of the report.

54 ENVIRONMENTAL SCIENCES↗