Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ECP”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Hardware Evaluation Outreach: Application development Challenges Now and for the Exascale Era

The intent of this document is to assist the programmer in understanding details of contemporary and Exascale hardware system design and how these designs provide opportunities and place constraints on next-generation simulation software design. We attempt to clarify hardware organization and component details for our most current and Exascale systems to help program developers understand how software needs to change in order to take best advantage of the performance available. Exascale success is specifically defined for ECP as a 50x improvement over baseline in the aggregate "capability volume" on several KPP axes, of which raw floating point performance is only one, but also includes characteristics such as problem size, system memory size, node memory size, power, and efficiency. This multi-axis approach is particularly important to understand in the context of delivered improvements in real applications, since, for instance, the floating point computation may comprise less than 10% of the actual computational work required. Given the Exascale requirements and the constraints these requirements put on the performance expectations of fundamental system components, the programmer will be forced to re-think several application implementation details in order to achieve exaflop performance on these systems. The remainder of this document aims to present more detail on Exascale era system hardware and the specific areas that the programmer should address to extract performance from these systems. We attempt to give the programmer guidance at both a high- and low-level, providing some abstract suggestions on how to refactor codes given the expected system architectures and some low-level recommendations on how to implement these modifications. We also include a section on training resources that are helpful for both programmers that are just beginning to understand code modifications for contemporary and Exascale systems and for those that have done some refactoring and are now trying to extract maximal application performance from these systems.

97 MATHEMATICS AND COMPUTING↗

Documented Kokkos API: WBS STPR 04 Milestone 13

This report documents the completion of milestone STPRO4-13 "Documented Kokkos API", which is part of the Exascale Computing Project (ECP). The goal of this Milestone was to generate documentation for the Kokkos programming model accessible to the open HPC community, beyond what was available via the tutorials. The total documentation for Kokkos now contains the equivalent of about 250 pages in text book format. About a third of it is contained in a more text book like style like the Kokkos Programming Guide, while most of the rest is an API reference modelled after popular C++ reference webpages. On the order of 175 pages was generated new as part of the work for this milestone.

97 MATHEMATICS AND COMPUTING↗

Analysis of Tank 38H (HTF-38-20-103, -104) and Tank 43H (HTF-43-20-105, -106) Samples for Support of the Enrichment Control and Corrosion Control Programs

SRNL analyzed samples from Tank 38H and Tank 43H to support ECP and CCP. The results indicate the concentrations of most species in the Tank 38H surface sample decreased from the previous surface sample. The Tank 38H sub-surface sample shows only minor changes in concentration for soluble species in the solution (e.g., Na, Al, Cs-137) but a large drop in concentrations for species typically associated with sludge solids (e.g., U, Pu, Fe, Si) likely because of a decrease in sludge solids from the previous sample. The large differences in the concentrations of major components between the Tank 38H surface and sub-surface samples indicate significant stratification of solution species within the tank.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

STNS01-21 BEE - FY21 P6-2: Archive, clone, and re-run workflows [Slide]

BEE will give ECP a tool that great simplifies the deployment of containerized workflows on the next generation of pre-exascale and exascale systems, as well as public and private clouds. BEE allows scientists to describe their workflow using the Common Workflow Language and then deploy that workflow across the entire spectrum of systems without having to learn the specifics of each container runtime, HPC resource manager, or cloud API. BEE also streamlines the curation and sharing of common workflows among the scientific community.

97 MATHEMATICS AND COMPUTING↗

Analysis of Tank 38H (HTF-38-21-95, -96) and Tank 43H (HTF-43-21-97, -98) Samples for Support of the Enrichment Control and Corrosion Control Programs

SRNL analyzed samples from Tank 38H and Tank 43H to support ECP and CCP. The results indicate the concentrations of most species in the Tank 38H surface sample increased from the previous surface sample. The Tank 38H sub-surface sample shows only minor changes in concentration for soluble species in the solution (e.g., Na, Al, Cs-137) relative to the previous sample, but a small decrease in concentrations for species typically associated with sludge solids (e.g., U, Pu, Fe, Si) likely because of a decrease in sludge solids from the previous sample. The large differences in the concentrations of major components between the Tank 38H surface and sub-surface samples indicate significant stratification of solution species within the tank.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

LLNL Response to the DOE ASCR RFI, "Stewardship of Software for Scientific and High-Performance Computing"

For decades, Lawrence Livermore National Laboratory (LLNL) has been engaged in significant research, development, and support for software to enable scientific computing and, particularly, the use of high performance computing (HPC) in the NNSA mission space. In particular, the move in the mid-1990’s to simulation as a leading component of stockpile stewardship through the ASCI and the successor ASC programs, as well as the need for reliable data acquisition and control software for the National Ignition Facility, have been important drivers in building expertise in production-quality software development at LLNL. LLNL has also been a leader in the DOE SciDAC FASTMath Institute and the DOE Exascale Computing Project (ECP), both of which have striven to make scientific computing software – in particular, the enabling technologies underpinning simulation capabilities – more widely adopted and sustainable. As such, we believe that our experience can inform the broader goal of software stewardship for scientific and high-performance computing. LLNL strongly supports the formation of a new DOE ASCR program element in software stewardship and sustainment. Historically, DOE ASCR has funded applied mathematics and computer science research that has led to the development of important new capabilities and algorithms that are expressed as artifacts in research software. Such frameworks, libraries, and tools have seldom been directly funded to address the important issues of code maintenance, documentation, robustness, and community building. Software engineering and support have typically been done on the side in support of the ASCR-driven research products. DOE funding priorities have been slow to recognize that good software engineering, the kind that ensures research investments have more adoption and longevity, requires significant resources. Based upon our experiences, we have prepared this response to highlight the concerns and issues we believe to be important as DOE ASCR considers its role in scientific software stewardship. We believe that role is important and will require a significant investment of new funding to legitimately support the technologies past and future DOE ASCR investments have and will produce to facilitate their uptake and adoption in the broader scientific computing community. Following a summary of our involvement in scientific software development, the remainder our response is organized around the nine topics specifically identified in the RFI.

97 MATHEMATICS AND COMPUTING↗

Initial CEED API (CEED-MS10)

Key components of CEED software development involve fast finite element operator storage and evaluation, architecture optimizations, performant algorithms for all orders, global kernels for finite element operators, efficient use of the memory sub-system, optimal data locality and motion, enhanced scalability and parallelism, and fast tensor contractions. As ultimate goals of the project, CEED is exploring and identifying the best algorithms for the full range of discretizations and applying algorithmic and software development to support ECP applications’ needs. In this milestone, we initiated the development and implementation of a common CEED API consisting of two main components: low-level and high-level APIs. We accomplished the goal of having the low-level component ready for the release of CEED v1.0 in the next quarter, see CEED-MS13. In this report we also provide a highlight from CEED’s integration with the MARBL app and the corresponding Laghos miniapp. A main theme in this work has been the systematic transition of advanced algorithms, developed and tested in Laghos, to the large-scale multi-physics settings of the MARBL code. The low-level CEED API provides a set of FE kernels and components for writing new low-level kernels. Examples include: vector and sparse linear algebra, element matrix assembly over a batch of elements, partial assembly and action for efficient high-order operators like mass, diffusion, advection, etc. The main goal of the low-level API is to establish the basis for the high-level API. Also, identifying such low-level kernels and providing a reference implementation for them serves as the basis for collaboration with vendors and STs. Another goal for the low-level API is to make it easy for applications with their own discretization infrastructure, who do not want to switch directly to using the high-level CEED API, to still evaluate and use the core operations provided by the low-level API. One of the challenges with high-order methods is that a global sparse matrix is no longer a good representation of a high-order linear operator, both with respect to the FLOPs needed for its evaluation, as well as the memory transfer needed for a matvec. Thus, another important question we tried to address while developing the low-level API is: is it possible to abstract out in a natural and efficient way the different implementations and data structures that arise when dealing with various computational device types: CPUs, GPUs, etc. Fully answering this question is beyond the scope of this particular milestone, since that requires longer time as we develop and expand the devices we support. The future high-level API will be the frontend provided by CEED consisting of high-level abstractions such as meshes, finite element spaces and solutions, bilinear forms, solvers, etc. At this high-level, an important aspect of the API will be to provide a uniform abstraction layer for writing code in a portable manner. To achieve that, we plan to utilize the MPI programming model combined with a device abstraction layer (DAL) for finite element computations that we will develop. The DAL will serve as the bridge between the low- and the high-level APIs, allowing a variety of programming models to be used for the low-level kernel implementations. The software artifacts delivered as part of this milestone include an initial CEED API software implementation (libCEED) provided through the CEED website, http://ceed.exascaleproject.org and the CEED GitHub organization, http://github.com/ceed. In addition to details and results from the above R&D efforts, in this document we are also reporting on other project-wide activities performed in Q1 of FY18, including: the Nek5000 v17.0 MFEM v3.3.2 and PETSc v3.8 releases, collaborations with ECP/ST and SciDAC projects, the inaugural Nek5000 hackathon and various outreach activities.

97 MATHEMATICS AND COMPUTING↗

Algorithmic and GPU enhancements for molecular dynamics in Cabana and LAMMPS

The focus of this milestone was to implement and test new algorithms and optimizations for improved GPU performance by molecular dynamics (MD) and related particle codes. The work was done in the CoPA Cabana library, the CabanaMD mini-app which uses Cabana to implement and benchmark prototypical MD models, and the LAMMPS MD code which is used by the ECP EXAALT project as well as for materials modeling generally. Efforts included (a) implementation of new or optimized algorithms for fundamental MD kernels like neighbor-list building and FFTs which are also widely used in other particle methods, (b) performance testing of data structure layouts for both simple pairwise and computationally intense neural network potentials, (c) optimizations aimed at improving GPU performance for models with small atom counts, and (d) optimizations specific to the SNAP interatomic potential due to its importance for the EXAALT project.

36 MATERIALS SCIENCE↗

Analysis of Tank 38H (HTF-38-22-31, -32) and Tank 43H (HTF-43-22-33, -34) Samples for Support of the Enrichment Control and Corrosion Control Programs

SRNL analyzed samples from Tank 38H and Tank 43H to support ECP and CCP. The results indicate the concentrations of most soluble species in the Tank 38H surface sample increased from the previous surface sample. The Tank 38H sub-surface sample shows changes in concentration for soluble species in the solution with some increasing and some decreasing. The current Tank 38H sub-surface sample contains less sludge solids than the previous sample based on visual appearance. The small differences in the concentrations of major components between the Tank 38H surface and sub-surface samples indicate only minimal stratification of solution species within the tank.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Simulating Atmospheric Boundary Layer Turbulence with Nek5000/RS

We present large-eddy-simulation (LES) modeling approaches for the simulation of atmospheric boundary layer turbulence that are of direct relevance to wind energy production. In this report, we study a GABLS benchmark problem using high-order spectral element code Nek5000/RS, which is supported under the DOE’s Exascale Computing Project (ECP) Center for Efficient Exascale Discretizations (CEED) project, targeting application simulations on various acceleration-device based exascale computing platforms [1, 2]. We demonstrate our newly developed subgrid-scale (SGS) models based on high-pass filter (HPF), mean-field eddy viscosity (MFEV), and Smagorinsky (SMG) with no-slip and traction boundary conditions, provided with low-order statistics, convergence and turbulent structure analysis. The model fidelity and scaling performance of Nek5000/RS on DOE’s leadership computing platforms in comparison to those of AMR-Wind, a block-structured second-order finite-volume code with adaptive-mesh-refinement capabilities, are discussed in [3].

17 WIND ENERGY↗

Nek5000/RS Performance on Advanced GPU Architectures

We demonstrate NekRS performance results on various advanced GPU architectures. NekRS is a GPU-accelerated version of Nek5000 that is targeting high performance on forthcoming exascale platforms. It is being developed in DOE’s Center of Efficient Exascale Discretizations (CEED), which is one of the co-design centers under the Exascale Computing Project (ECP). In this report, we consider Frontier, Crusher, Spock, Polaris, Perlmutter, ThetaGPU and Summit. Simulations are performed using ExaSMR’s 17x17 rod-bundle geometries with different problem sizes. The report focuses on strong scaling performance and analysis. Many of the results shown in this report are the outcome from participation in the ALCF GPU Hackathon on Polaris, which was held on 7/19/22, and 7/26–7/28/22. Members of the Nek5000/RS team included Misun Min, Yu-Hsiang Lan, Paul Fischer and Thilina Rathnayake. Mentors were Kris Rowe (ALCF) and Peng Wang (NVIDIA). Also presented in this report are results on Frontier, which were obtained in collaboration with John Holmen at OLCF.

97 MATHEMATICS AND COMPUTING↗

Analysis of Tank 38H (HTF-38-22-91, -92) and Tank 43H (HTF-43-22-93, -94) Samples for Support of the Enrichment Control and Corrosion Control Programs

SRNL analyzed samples from Tank 38H and Tank 43H to support ECP and CCP. The results indicate the concentrations of most soluble species in the Tank 38H surface sample increased slightly from the previous surface sample. The Tank 38H sub-surface sample shows changes in concentration for soluble species in the solution with some increasing and some decreasing. The current Tank 38H sub-surface sample contains more sludge solids than the previous sample based on visual appearance. The small differences in the concentrations of major components between the Tank 38H surface and sub-surface samples indicate only minimal stratification of solution species within the tank. The Tank 43H surface and sub-surface samples are similar in composition to the previous samples. The similar solution compositions measured in the Tank 43H surface and sub-surface samples indicate a minimal stratification within the tank. The total uranium and plutonium in the current Tank 38H surface sample remains similar to the previous analysis. The Tank 38H sub-surface sample shows an increase in uranium and plutonium concentrations compared to the previous sample likely because of an increase in sludge solids in the current sample. The total uranium concentration in the two Tank 43H samples is essentially unchanged from previous sample results. The plutonium concentration in the Tank 43H surface sample is similar to the previous sample results while the plutonium in the Tank 43H sub-surface sample increased relative to the previous analysis. The sum of the major cations versus the sum of the major anions shows a difference of <10% for both samples from Tank 38H and for both samples from Tank 43H providing an indication of good data quality for the non-radioactive analytes in the samples. The silicon concentrations measured in the Tank 38H sub-surface sample increased compared with the previous sample results likely due to the presence of more sludge solids in the current sample. The Tank 38H surface sample silicon concentrations is similar to the previous sample results. The Tank 43H surface and sub-surface sample silicon concentrations both increased compared to the previous sample results. The samples analyzed from Tanks 38H and 43H show silicon concentrations ranging from 61.5 to 97.3 mg/L.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Milestone Report: Co-Scheduling Applications on Current and Future Architectures

This report evaluates the viability and performance of co-scheduling scientific applications and workloads between CPUs and GPUs on current and future hardware architectures. This study was performed by collecting hardware independent and memory performance characteristics of 6 ECP mini-applications through Byfl and NSight Systems, by measuring the applications’ co-scheduled performance on current node architectures, and by gathering memory bandwidth utilization data with Intel Advisor and nvprof to begin reasoning about the feasibility of co-scheduling applications on future APU architectures.

97 MATHEMATICS AND COMPUTING↗

Extending PETSc's Composable Hierarchical Solvers (Final Technical Report)

This report documents research activities conducted at CU Boulder as part of Extending PETSc’s Composable Hierarchical Solvers, which has been part of a collaboration with Argonne National Laboratory (separate award). Our work has focused on performance-portable end-to-end GPU solvers demonstrated via exemplary applications in nonlinear fluid and structural mechanics. We describe advances in algorithmic composition and analysis in the context of these applications, but the implementations are fully documented and decoupled, and in use by other projects. We believe the vertical integration achieved through collaboration with ECP’s CEED and the PSAAP center at CU was necessary to take risks with data structures and algorithms.

42 ENGINEERING↗

Analysis of Tank 38h (HTF-38-23-19, -20) and Tank 43H (HTF-43-23-21, -22) Samples for Support of the Enrichment Control and Corrosion Control Programs

SRNL analyzed samples from Tank 38H and Tank 43H to support ECP and CCP. The results indicate the concentrations of most soluble species in the Tank 38H surface sample decreased significantly from the previous surface sample. The Tank 38H sub-surface sample shows changes in concentration for soluble species in the solution with some increasing and some decreasing. The current Thank 38H sub-surface sample contains visible sludge solids similar to the previous sample, i.e., less than 1%, based on visual appearance. The significant differences in the concentrations of major components between the Tank 38H surface and sub-surface samples indicate significant stratification of solution species between these two locations within the tank. Savannah River Mission Completion personnel indicate that ~ 150,000 gallons of Tank 22 supernate were received in Tank 38H since its last analysis during which time the 2H evaporator was not operated, so the observed stratification is expected. The Tank 43H surface and sub-surface samples are similar in composition to the previous samples. The similar solution compositions measured in the Tank 43H surface and sub-surface samples indicate a minimal stratification within the tank. The total uranium and plutonium in the current Tank 38H surface sample remains similar to the previous analysis. The Tank 38H sub-surface sample shows an increase in uranium and plutonium concentrations compared to the previous sample likely because of an increase in sludge solids in the current sample. The total uranium concentration in the Tank 43H surface sample is similar to the previous sample results while the plutonium in the Tank 43H sub-surface sample increased relative to the previous analysis. The sum of the major cations versus the sum of the major anions shows a difference of <10% for both samples from Tank 38H sub-surface sample (174 mg/L) increased compared with the previous sample. The Tank 38H surface sample silicon concentrations (27.5 mg/L) is one-half of the previous sample results. The Tank 43H surface sample silicon concentrations compared to the previous sample results indicate Si in the concentration range of 60 to 83 mg/L. Thus, these current samples analyzed from Tanks 38H and 43H show overall silicon concentrations ranging from 27.5 to 174 mg/L.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Advanced Research Directions on AI for Science, Energy, and Security: Report on Summer 2022 Workshops

Over the past decade, fundamental changes in artificial intelligence (AI)—from foundational to applied—have delivered dramatic insights across a wide breadth of U.S. Department of Energy (DOE) mission space. AI is helping to augment and improve scientific and engineering workflows (e.g., for control, design, and dramatic performance gains through surrogate models) in national security, the Office of Science, and DOE’s applied energy programs. The progress and potential for AI in DOE science was captured in the 2020 “AI for Science” report from the DOE laboratory community in collaboration with academia and industry. Specific scientific areas ready to further leverage the power of AI ranged from the scale and performance of computational models to data analysis to creating new classes of observations using computer vision. Since that report, the scale and scope of scientific AI have accelerated, revealing new, emergent properties that yield insights that go beyond enabling opportunities to being potentially transformative in the way that scientific problems are posed and solved. Thus, under the guidance of both the Office of Science (SC) and the National Nuclear Security Administration (NNSA), the DOE national laboratories organized a series of workshops in 2022 to gather input on new and rapidly emerging opportunities and challenges of scientific AI. This 2023 report is a synthesis of those workshops. The scientific community believes AI can have a foundational impact on a broad range of DOE missions, including science, energy, and national security. Further, DOE has unique capabilities that enable the community to drive progress in scientific use of AI, building on long-standing DOE strengths and investments in computation, data, and communications infrastructure, spanning the Energy Sciences Network (ESnet), the Exascale Computing Project (ECP), and integrative programs such as the NNSA Office of Defense Programs Advanced Simulation and Computing (ASC) and the SC Scientific Discovery through Advanced Computing (SciDAC) programs.

97 MATHEMATICS AND COMPUTING↗

2.3.3.01- xSDK-Batched Final Report for Subcontract Partner KIT

The xSDK batched effort as focus effort of the ECP project xSDK focused on the development, deployment, and dissemination of batched functionality in the US Exascale Computing Project. Over a duration of almost three years, KIT as subcontract to LLNL provided technology development, functionality deployment, integration support, and consulting on batched iterative solvers and batched preconditioners. This final report accumulates the quarterly progress reports and most significant contributions.

97 MATHEMATICS AND COMPUTING↗

2.3.3.01- xSDK-Multiprecision Final Report for Subcontract Partner KIT

The xSDK Multiprecision effort as focus effort of the ECP project xSDK focused on the development, deployment, and dissemination of mixed precision functionality in the US Exascale Computing Project. Over a duration of four years, KIT as subcontract to LLNL provided technology development, functionality deployment, integration support, and consulting on mixed precision functionality. The subcontract was modified several times over the project duration. All deliverables of the subcontract have been completed. This final report accumulates the quarterly progress reports and most significant contributions.

97 MATHEMATICS AND COMPUTING↗