Engineering Papers⌕ Search

Engineering topics

Bernholdt, David

Publications and source records attributed to Bernholdt, David.

At least 19 records

A Cast of Thousands: How the IDEAS Productivity Project Has Advanced Software Productivity and Sustainability

Computational and data-enabled science and engineering are revolutionizing advances throughout science and society, at all scales of computing. For example, teams in the U.S. Department of Energy’s Exascale Computing Project have been tackling new frontiers in modeling, simulation, and analysis by exploiting unprecedented exascale computing capabilities—building an advanced software ecosystem that supports next-generation applications and addresses disruptive changes in computer architectures. However, concerns are growing about the productivity of the developers of scientific software. Members of the Interoperable Design of Extreme-scale Application Software project serve as catalysts to address these challenges through fostering software communities, incubating and curating methodologies and resources, and disseminating knowledge to advance developer productivity and software sustainability. This article discusses how these synergistic activities are advancing scientific discovery—mitigating technical risks by building a firmer foundation for reproducible, sustainable science at all scales of computing, from laptops to clusters to exascale and beyond.

97 MATHEMATICS AND COMPUTING↗

Frontier: Exploring Exascale

As the US Department of Energy (DOE) computing facilities began deploying petascale systems in 2008, DOE was already setting its sights on exascale. In that year, DARPA published a report on the feasibility of reaching exascale. The report authors identified several key challenges in the pursuit of exascale including power, memory, concurrency, and resiliency. That report informed the DOE's computing strategy for reaching exascale. With the deployment of Oak Ridge National Laboratory's Frontier supercomputer, we have officially entered the exascale era. In this paper, we discuss Frontier's architecture, how it addresses those challenges, and describe some early application results from Oak Ridge Leadership Computing Facility's Center of Excellence and the Exascale Computing Project.

Atchley, Scott {Leadership Computing}↗

Enterprise Risks for Scientific Software in the Post Exascale Era

The Department of Energy’s Office of Science’s Advanced Scientific Computing Research (ASCR) Office hosts three high performance computing Facilities and one high performance networking Facility. ASCR’s Facilities Division and these four Facilities established a joint working group to address the most severe threats to the software capabilities that can prevent the Facilities from supporting a diverse array of mission critical scientific research carried out by thousands of researchers from national labs, academia, and industry. This report outlines the risk categories, threat matrix calculations, and number of risks in each of the categories along with the threat levels. Two categories—programming environment/tools and system software—account for 13 out of the 20 risks encountered in the risk register. A significant risk to ASCR’s software ecosystem also arises from the possible loss of personnel and expertise past the end of the exascale computing project. The working group recommends that the software enterprise risks are reevaluated regularly, and are considered in future decision making regarding system acquisition, knowledge sharing, partnership development, and strategic planning

97 MATHEMATICS AND COMPUTING↗

ECP SOLLVE: Validation and Verification Testsuite Status Update and Compiler Insight for OpenMP

The OpenMP language continues to evolve with every new specification release, as does the need to validate and verify the new features that have been implemented by the different vendors. With the release of OpenMP 5.0 and OpenMP 5.1, new target offload and host-based features have been introduced to the programming model. While OpenMP continues to grow in maturity, there is an observable growth in the number of compiler and hardware vendors that support OpenMP. In this manuscript, the main focus is on evaluating the conformity and OpenMP implementation progress of various compiler vendors such as Cray, IBM, GNU, Clang/LLVM, NVIDIA, and Intel. More specifically, the 4.5, 5.0, and 5.1 versions of the OpenMP specification are analyzed. For our experimental setup, the Crusher and Summit computing systems hosted by Oak Ridge National Lab’s Computing Facilities are utilized. The effort of vendor agnostic analysis of these implementations is especially valuable for application developers who are using new OpenMP features to accelerate their scientific codes. Insights are presented into the current implementation status of various vendors, the progression of specific compiler’s support for OpenMP overtime, the subset of OpenMP 4.5, 5.0, and 5.1 that is supported by all compilers, and examples of how our test suite has influenced discussion regarding the correct interpretation of the OpenMP specification. By evaluating OpenMP conformity of pre-Exascale computing systems, the aim is to detail progress and status of AMD + Cray ecosystem before the system and their OpenMP implementation is used for mission critical applications when the first Exascale Computer Frontier is made available to applications.

Huber, Thomas↗

A Survey on Sustainable Software Ecosystems to Support Experimental and Observational Science at Oak Ridge National Laboratory

In the search for a sustainable approach for software ecosystems that supports experimental and observational science (EOS) across Oak Ridge National Laboratory (ORNL), we conducted a survey to understand the current and future landscape of EOS software and data. This paper describes the survey design we used to identify significant areas of interest, gaps, and potential opportunities, followed by a discussion on the obtained responses. The survey formulates questions about project demographics, technical approach, and skills required for the present and the next five years. The study was conducted among 38 ORNL participants between June and July of 2021 and followed the required guidelines for human subjects training. We plan to use the collected information to help guide a vision for sustainable, community-based, and reusable scientific software ecosystems that need to adapt effectively to: i) the evolving landscape of heterogeneous hardware in the next generation of instruments and computing (e.g. edge, distributed, accelerators), and ii) data management requirements for data-driven science using artificial intelligence.

Bernholdt, David↗

Integrated model predictions on the impact of substrate damage on gas dynamics during ITER burning-plasma operations

Divertor design and choice of plasma-facing materials (PFM) will be essential to the success of next-generation fusion reactors as they operate under more powerful scenarios. Understanding and controlling interactions between the plasma and PFM is essential to making these choices. Within these plasma–material interactions and especially in tungsten (W), the interplay between the most abundant plasma species (hydrogen isotopes and helium, He) with the wall material alters fuel retention. However, this interplay is yet to be sufficiently understood to confidently project fuel retention levels to future fusion devices. The paper presents a series of integrated simulations of fusion plasmas and their interaction with tungsten. Specifically, this study assesses the impact of He plasma pre-exposure on hydrogenic species retention during 100 s of burning plasma operations (BPO) in ITER. Multiple pre-exposure scenarios are considered, including sub-surface damage resulting from exposures in the linear device PISCES and from early ITER He-operation. The predictions from these consecutive He-BPO exposures show that fuel content and spatial distribution in the material are largely determined by the He-induced damage, as manifest in: (i) changes in surface temperature expected during BPO have little effect on fuel retention in the presence of He-induced damage; (ii) gas content stabilizes quickly in substrates pre-exposed in PISCES, at levels set by the concentration of pre-existing vacancies, while it continues to increase in substrates initially pristine or pre-exposed to ITER He plasmas; (iii) the presence of He and He–V clusters in the near-surface region locally increases hydrogenic retention, but decreases its permeation; this results in hydrogenic species that remain closer to the surface in pre-damaged substrates, while the bulk content is higher for initially pristine cases. In summary, the interaction and binding of D and T with the pre-existing He–V clusters modifies retention and permeation of hydrogen species during ITER BPO.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Implementing Arbitrary/Common Concurrent Writes of CRCW PRAM

The Parallel Random Access Machines (PRAM) abstraction is the simplest and most elegant algorithmic model for the design and analysis of parallel algorithms. It consists of different models categorized based on the underlying memory access mode used, the most powerful of which is the Concurrent Read Concurrent Write (CRCW) model. A PRAM algorithm describes a series of rounds, each of which consists of a collection of operations that can be executed concurrently within the same time step. However, the lack of support for concurrent memory accesses and the prevalence of asynchronous programming models led to the belief that implementing CRCW PRAM algorithms is unattainable and prompted many to avoid this model except for theoretical studies of optimal performance.In this work, we study the arbitrary and common concurrent writes in the CRCW PRAM model and explore implementation challenges on general-purpose systems. Moreover, we examine current practices for implementing common/arbitrary concurrent writes and propose a new efficient lightweight and thread-safe method to implement concurrent writes through leveraging atomic instructions. To demonstrate the efficacy of our method, we developed OpenMP kernels for classical CRCW PRAM algorithms and provide experimental results and comparisons based on run time performance measured over the x86 multicore architecture. Our results show a performance speedup compared to current practices up to 4.5x across all our benchmarks.

Ghanim, Fady↗

Teaching Software Sustainability for High Performance Computing at ATPESC

The Argonne Training Program in Extreme Scale Computing (ATPESC) was started by Argonne National Laboratory with the objective of expanding the ranks of better-prepared users of high-performance computing (HPC) machines. One of the unique aspects of the program was inclusion of a track on software engineering and community codes. The inclusion was motivated by the observation that the projects with good software processes were better able to meet their scientific goals. Over the years, with greater awareness of software sustainability issues in the community, the track has evolved into a software productivity and sustainability track. In this paper we present our experience in choosing and disseminating the content related to the topic of software engineering in high performance computing science from the beginning of the program until now. We discuss the motivations and the reception of the tracks. We also document the evolution of the track over the years based on student feedback and also the growth of awareness about software productivity in high performance computing.

Dubey, Anshu↗

FY2018 Fusion Theory and Simulation Milestone on Plasma Materials Interaction (PMI) (Final Report)

The interaction of the boundary plasma with the material surfaces in magnetically confined plasmas is among the most critical problems in fusion energy science. In FY2018, perform high performance computing simulations with coupled boundary plasma physics and materials surface models to predict the fuel recycling and tritium retention of the ITER divertor for D-T burning plasma conditions, accounting for erosion, re-deposition and impurity transport in the plasma boundary, and an initial evaluation of the influence of material deposition on the recycling and retention.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Advancing Understanding of Fission Gas Behavior in Nuclear Fuel through Leadership Class Computing

This report describes the outcome of the pilot SciDAC project jointly funded by the DOE Office of Nuclear Energy and the DOE Office of Science, Advanced Scientific Computing Research to advance understanding of fission gas behavior in nuclear fuel. The computational approach involved utilizing both a bottom up and top down multiscale materials modeling to evaluate the processes of xenon fission gas diffusion, xenon clustering and precipitation and the mechanisms of fission gas resolution by energetic fission fragments in uranium dioxide nuclear fuel. The computer science and applied mathematics research activities were focused on optimizing the uranium – oxygen – xenon interatomic potential implementation in the LAMMPS molecular dynamics code for large-scale simulations of fission gas resolution, in addition to improvements in visualization of accelerated molecular dynamics simulations and performance optimization of the Xolotl continuum cluster dynamics with a new grouping scheme to reduce the computational cost of modeling very large fission gas bubbles containing more than 10,000 xenon atoms. The most impactful result from this project stems from a systematic series of atomistic molecular dynamics to evaluate fission gas resolution from xenon bubbles that, combined with the fission product yields and consideration of electron-phonon coupling, informed a first principles model that predicts the magnitude of fission gas resolution in good agreement with empirical estimates.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

CRADA Final Report: CRADA Number NFE-14-05227 with Total E&P Research and Technology USA LLC

Cooperative Research and Development Agreement (CRADA) NFE-14-05227 between Oak Ridge National Laboratory (ORNL) and Total E&P Research and Development USA LLC (Total) focused on exploration of programming models and optimization opportunities for two families of seismic imaging algorithms frequently used within the oil and gas sector. Studies involved the use of OpenACC and OpenMP directive-based programming models for GPU accelerators on Reverse Time Migration (RTM), and Time Reverse Time Migration (tRTM) model applications. The work provided insights into both the directive language capabilities and gaps with respect to the needs of these algorithms and how the algorithms can be ported to GPU accelerators using directive languages.

58 GEOSCIENCES↗