Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “HPC performance modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Design and Implementation of a High-Performance CCA Event Service

Event services based on publish-subscribe architectures are well established components of distributed computing applications. Recently, an event service has been proposed as part of the Common Component Architecture (CCA) for high-performance computing applications. In this paper we describe our implementation, experimental evaluation, and initial experience with a high performance CCA event service that exploits efficient communications mechanisms commonly used on high-performance computing (HPC) platforms. We describe the CCA event service model, and discuss briefly the possible implementation strategies of that model. We then present the design and implementation of the event service using the Aggregate Remote Memory Copy Interface (ARMCI) as an underlying communication layer for this mechanism. Two alternative implementations are presented and evaluated on a Cray XD-1 platform. The performance results demonstrate that event delivery latencies are low and that the event service is able to achieve high throughput levels. Finally, we describe the use of the event service in an application for high-speed processing of data from a mass spectrometer, and conclude by discussing some possible extensions to the event service for other HPC applications.

97 MATHEMATICS AND COMPUTING↗

28 NREL Stratus - Enabling Workflows to Fuse Data Streams, Modeling, Simulation, and Machine Learning: Preprint

Integrating cloud services into advanced computing facilities provides significant new capabilities over focusing solely on traditional high performance computing (HPC) workloads. This brings complementary capabilities as well as enabling new focused roles for HPC. They are especially potent for workflows that fuse data streams, modeling and simulation ('modsim') and machine learning. A key challenge to adopting a hybrid edge-cloud-HPC model is to align optimal capability, data, and user intent on the right resources for each step in a workflow.?The NREL Stratus service provides a basis for this: Stratus layers capabilities needed to make?cloud services accessible to a lab-based scientific community on commercial offerings, and; currently supports upwards of 200 projects ranging from IOT integration to traditional modeling and simulation. This provides a real-world inventory of scientific workflow elements. A growing knowledge base enables placing these elements appropriately between the edge, cloud, and traditional HPC. This paper outlines a vision via reference architecture and the application of that architecture in a typical workflow highlighting multiple components: sensor data intake, cleaning and transforming (edge/cloud suitable); generation of synthetic data through modsim, computationally heavy ML training and hyperparameter optimization (HPC suitable), and; inference and deployment (cloud ideal). Every step in such a workflow involves a cost-benefit analysis regarding the data movement, computational efficiency, availability, latency, and resource capabilities. The reference architecture and examples outlined allow for understanding new opportunities in the context of emerging workflows that combine IOT, cloud, and HPC to bolster scientific productivity.

AI↗

Machine Learning Based Parallel I/O Predictive Modeling: A Case Study on Lustre File Systems

Parallel I/O hardware and software infrastructure is a key contributor to performance variability for applications running on large-scale HPC systems. This variability confounds efforts to predict application performance for characterization, modeling, optimization, and job scheduling. We propose a modeling approach that improves predictive ability by explicitly treating the variability and by leveraging the sensitivity of application parameters on performance to group applications with similar characteristics. We develop a Gaussian process-based machine learning algorithm to model I/O performance and its variability as a function of application and file system characteristics. We demonstrate the effectiveness of the proposed approach using data collected from the Edison system at the National Energy Research Scientific Computing Center. The results show that the proposed sensitivity-based models are better at prediction when compared with application-partitioned or unpartitioned models. We highlight modeling techniques that are robust to the outliers that can occur in production parallel file systems. Using the developed metrics and modeling approach, we provide insights into the file system metrics that have a significant impact on I/O performance.

I/O performance variability↗

High Resolution Model Intercomparison Project (HighResMIP v1.0) for CMIP6

Robust projections and predictions of climate variability and change, particularly at regional scales, rely on the driving processes being represented with fidelity in model simulations. The role of enhanced horizontal resolution in improved process representation in all components of the climate system is of growing interest, particularly as some recent simulations suggest both the possibility of significant changes in large-scale aspects of circulation as well as improvements in small-scale processes and extremes. However, such high-resolution global simulations at climate timescales, with resolutions of at least 50 km in the atmosphere and 0.25° in the ocean, have been performed at relatively few research centres and generally without overall coordination, primarily due to their computational cost. Assessing the robustness of the response of simulated climate to model resolution requires a large multi-model ensemble using a coordinated set of experiments. The Coupled Model Intercomparison Project 6 (CMIP6) is the ideal framework within which to conduct such a study, due to the strong link to models being developed for the CMIP DECK experiments and other model intercomparison projects (MIPs). Increases in high-performance computing (HPC) resources, as well as the revised experimental design for CMIP6, now enable a detailed investigation of the impact of increased resolution up to synoptic weather scales on the simulated mean climate and its variability. The High Resolution Model Intercomparison Project (HighResMIP) presented in this paper applies, for the first time, a multi-model approach to the systematic investigation of the impact of horizontal resolution. A coordinated set of experiments has been designed to assess both a standard and an enhanced horizontal-resolution simulation in the atmosphere and ocean. The set of HighResMIP experiments is divided into three tiers consisting of atmosphere-only and coupled runs and spanning the period 1950–2050, with the possibility of extending to 2100, together with some additional targeted experiments. This paper describes the experimental set-up of HighResMIP, the analysis plan, the connection with the other CMIP6 endorsed MIPs, as well as the DECK and CMIP6 historical simulations. Lastly, HighResMIP thereby focuses on one of the CMIP6 broad questions, “what are the origins and consequences of systematic model biases?”, but we also discuss how it addresses the World Climate Research Program (WCRP) grand challenges.

58 GEOSCIENCES↗

Simulation of Large-Scale HPC Architectures

The Extreme-scale Simulator (xSim) is a recently developed performance investigation toolkit that permits running high-performance computing (HPC) applications in a controlled environment with millions of concurrent execution threads. It allows observing parallel application performance properties in a simulated extreme-scale HPC system to further assist in HPC hardware and application software co-design on the road toward multi-petascale and exascale computing. This paper presents a newly implemented network model for the xSim performance investigation toolkit that is capable of providing simulation support for a variety of HPC network architectures with the appropriate trade-off between simulation scalability and accuracy. The taken approach focuses on a scalable distributed solution with latency and bandwidth restrictions for the simulated network. Different network architectures, such as star, ring, mesh, torus, twisted torus and tree, as well as hierarchical combinations, such as to simulate network-on-chip and network-on-node, are supported. Network traffic congestion modeling is omitted to gain simulation scalability by reducing simulation accuracy.

99 GENERAL AND MISCELLANEOUS↗

SERGHEI (SERGHEI-SWE) v1.0: a performance-portable high-performance parallel-computing shallow-water solver for hydrology and environmental hydraulics

The Simulation EnviRonment for Geomorphology, Hydrodynamics, and Ecohydrology in Integrated form (SERGHEI) is a multi-dimensional, multi-domain, and multi-physics model framework for environmental and landscape simulation, designed with an outlook towards Earth system modelling. At the core of SERGHEI's innovation is its performance-portable high-performance parallel-computing (HPC) implementation, built from scratch on the Kokkos portability layer, allowing SERGHEI to be deployed, in a performance-portable fashion, in graphics processing unit (GPU)-based heterogeneous systems. In this work, we explore combinations of MPI and Kokkos using OpenMP and CUDA backends. In this contribution, we introduce the SERGHEI model framework and present with detail its first operational module for solving shallow-water equations (SERGHEI-SWE) and its HPC implementation. This module is designed to be applicable to hydrological and environmental problems including flooding and runoff generation, with an outlook towards Earth system modelling. Its applicability is demonstrated by testing several well-known benchmarks and large-scale problems, for which SERGHEI-SWE achieves excellent results for the different types of shallow-water problems. Finally, SERGHEI-SWE scalability and performance portability is demonstrated and evaluated on several TOP500 HPC systems, with very good scaling in the range of over 20 000 CPUs and up to 256 state-of-the art GPUs.

58 GEOSCIENCES↗

Pretraining Billion-Scale Geospatial Foundational Models on Frontier

As AI workloads increase in scope, generalization capability becomes challenging for small task-specific models and their demand for large amounts of labeled training samples increases. On the contrary, Foundation Models (FMs) are trained with internet-scale unlabeled data via self-supervised learning and have been shown to adapt to various tasks with minimal fine-tuning. Although large FMs have demonstrated significant impact in natural language processing and computer vision, efforts toward FMs for geospatial applications have been restricted to smaller size models, as pretraining larger models requires very large computing resources equipped with state-of-the-art hardware accelerators. Current satellite constellations collect 100+TBs of data a day, resulting in images that are billions of pixels and multimodal in nature. Such geospatial data poses unique challenges opening up new opportunities to develop FMs. We investigate billion scale FMs and HPC training profiles for geospatial applications by pretraining on publicly available data. We studied from end-to-end the performance and impact in the solution by scaling the model size. Our larger 3B parameter size model achieves up to 30% improvement in top1 scene classification accuracy when comparing a 100M parameter model. Moreover, we detail performance experiments on the Frontier supercomputer, America's first exascale system, where we study different model and data parallel approaches using PyTorch's Fully Sharded Data Parallel library. Specifically, we study variants of the Vision Transformer architecture (ViT), conducting performance analysis for ViT models with size up to 15B parameters. By discussing throughput and performance bottlenecks under different parallelism configurations, we offer insights on how to leverage such leadership-class HPC resources when developing large models for geospatial imagery applications.

Tsaris, Aristeidis (aris)↗

Proxy Applications for Converged Workloads: DMC LDRD Initiative

Modern scientific applications are complicated and require coordination of several components. Proxy application driven software-hardware co-design plays a vital role in driving innovation among the developments of applications, software infrastructure and hardware architecture. Proxy applications are self-contained and simplified codes that are intended to model the performance-critical computations within applications. Applications executing on modern High Performance Computing (HPC) systems are susceptible to network congestion, insufficient memory bandwidth within and across compute nodes, and inadvertent loss of performance due to bugs and unoptimized programming models. Modern numerical simulations and machine learning models play a critical role in studying physical phenomenon under myriad uncertainties. Such applications often exhibit irregular computation and memory accesses at specific regions of the application code, which can contribute to various performance bottlenecks at scale. To mitigate such issues and prepare the next generation hardware for a variety of computation and data movement contingencies, a well-known practice is to consider "proxy" applications as representative motifs for various classes of scientific applications. While there is disagreement in the HPC community on the mechanisms of construction of the proxy applications, there is a strong consensus on their positive impact in co-design. Proxy Applications for Converged Workloads (PACER) is about facilitating software-hardware co-design through proxy applications with the goal of improving the performance of converged science workflows on heterogeneous systems.

97 MATHEMATICS AND COMPUTING↗

A Data-Driven Approach to Nation-Scale Building Energy Modeling

In 2019, 125 million U.S. residential and commercial buildings consumed $412 billion in energy bills. These buildings currently consume 40% of the nation's primary energy, 73% of electricity, 80% of energy during peak electric grid use, and responsible for 39% of greenhouse gas emissions [14]. Urban-scale building energy modeling has grown significantly in the past decade, allowing individual campuses or communities of buildings to be modeled, simulated, and cost-effective solutions for intelligent management to be identified and implemented. While traditionally limited to individual counties and usually less than 2,000 buildings, the Automatic Building Energy Modeling (AutoBEM) soft-ware suite has been developed to process unconventional, nation-scale data sources to generate unique OpenStudio and EnergyPlus models of each building. Through the use of High Performance Computing (HPC) resources, every U.S. building has been simulated. This paper showcases the data layout, node partitioning, algorithmic approaches, and analytic results that were used to create, share, and analyze 124.4 million U.S. building models.

Berres, Andy↗

Performance Assessment Modeling and Sensitivity Analyses of Generic Disposal System Concepts

The Used Fuel Disposition Campaign (UFDC) of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE) is conducting research and development (R&D) on generic deep geologic disposal systems (i.e., repositories) for high-activity nuclear wastes (i.e., used nuclear fuel (UNF) and high-level radioactive waste (HLW)) that exist today or that could be generated in future fuel cycles. This report describes specific activities in FY2014 toward the development of an enhanced generic disposal system modeling and analysis capability that utilizes high performance computing (HPC) environments to simulate important multi-physics phenomena and couplings associated with the potential behavior of a geologic repository for UNF and HLW.

Sevougian, S. David↗

Analyzing Black Hole X-Rays with Simulations

We generate synthetic X-ray spectra of black holes from large-scale 3D GRMHD simulations performed on HPC machines. Here are a sampling of model spectra, characterized by the parameters indicated in the diagram below. The dashed red lines show power law fits to the parts of the spectrum observed by the X-ray telescope NuSTAR. How well these model spectra compare to real data helps us to characterize the physical realism of the underlying simulation techniques.

79 ASTRONOMY AND ASTROPHYSICS↗

Job Management with mpi_jm

About this book: This book constitutes the refereed post-conference proceedings of 13 workshops held at the 33rd International ISC High Performance 2018 Conference, in Frankfurt, Germany, in June 2018: HPC I/O in the Data Center, HPC-IODC 2018; Workshop on Performance and Scalability of Storage Systems, WOPSSS 2018; 13th Workshop on Virtualization in High­-Performance Cloud Computing, VHPC 2018; Third International Workshop on In Situ Visualization, WOIV 2018; 4th International Workshop on Communication Architectures for HPC, Big Data, Deep Learning and Clouds at Extreme Scale, ExaComm 2018; International Workshop on OpenPOWER for HPC, IWOPH 2018; IXPUG Workshop: Many-Core Computing on Intel Processors; Workshop on Sustainable Ultrascale Computing Systems; Approximate and Transprecision Computing on Emerging Technologies, ATCET 2018; First Workshop on the Convergence of Large-Scale Simulation and Artificial Intelligence; Third Workshop for Open Source Supercomputing, OpenSuCo 2018; First Workshop on Interactive High-Performance Computing; Workshop on Performance Portable Programming Models for Accelerators, P^3MA 2018. The 53 full papers included in this volume were carefully reviewed and selected from 80 submissions. They cover all aspects of research, development, and application of large-scale, high performance experimental and commercial systems. Topics include HPC computer architecture and hardware; programming models, system software, and applications; solutions for heterogeneity, reliability, power efficiency of systems; virtualization and containerized environments; big data and cloud computing; and artificial intelligence.

Berkowitz, Evan↗

High Resolution Model Development to Quantify the Impact of Icebergs on the Stability of the Atlantic Meridional Overturning Circulation

In the present-day North Atlantic Ocean, relatively warm and salty water moves northwards from the tropics to the high latitudes, sinks, and returns southward towards the equator as North Atlantic Deep Water, forming the so called Atlantic Meridional Overturning Circulation (AMOC). It has been found that the stability of the AMOC is non-linearly related to the freshwater budget of the North Atlantic. In this way, additional fresh water can be added to the ocean with little impact, until a tipping point is reached that causes the AMOC to suddenly weaken and the Northern Hemisphere to abruptly cool. A great deal of uncertainty still remains over the sensitivity of the AMOC to changes in freshwater discharge as a result of the unrealistic manner in which freshwater has historically been added to climate models. Frequently, freshwater is discharged in ocean models entirely as liquid water, but in reality a large fraction of freshwater entering the ocean is ice calving from marine glaciers (half for Antarctica and two-thirds for Greenland). To more accurately quantify AMOC sensitivity to past and future changes in freshwater input, this project developed a comprehensive iceberg model to more realistically simulate the interaction between the cryosphere and the oceans at high-latitudes. The iceberg model created is written in Fortran90 and designed to scale efficiently on High Performance Computing (HPC) clusters so that tens-of-thousands of icebergs can be simulated at any time. Experiments performed with our model showed that in the Pleistocene there would have been enormous floods of freshwater released into the North Atlantic that would have transported icebergs and meltwater along the entire east coast of the United States, as far south as Florida Keys. In addition, high-resolution, modern-day, model simulations showed that if the Greenland Ice Sheet continues to melt at its current rate then there will be a 6-fold increase in the number of icebergs drifting in the North Atlantic in the next 30 years, and that the strength of the AMOC could weaken by 3.5%.

54 ENVIRONMENTAL SCIENCES↗

Broadband (0–5 Hz) Fully Deterministic 3D Ground‐Motion Simulations of a Magnitude 7.0 Hayward Fault Earthquake: Comparison with Empirical Ground‐Motion Models and 3D Path and Site Effects from Source Normalized Intensities

We report on high‐performance computing (HPC) fully deterministic simulation of ground motions for a moment magnitude (⁠Mw⁠) 7.0 scenario earthquake on the Hayward fault resolved to 5 Hz using the SW4 finite‐difference code. We computed motions obeying physics‐based 3D wave propagation at a regional scale with an Mw 7.0 kinematic rupture model generated following Graves and Pitarka (2016). Both plane‐layered (1D) and 3D Earth models were considered, with 3D subsurface material properties and topography interpolated from a model of the U.S. Geological Survey (USGS). The resulting ground‐motion intensities cover a broader frequency range than typically considered in regional‐scale simulations, including higher frequencies relevant for engineering analysis of structures. Median intensities for sites across the domain are within the reported between‐event uncertainties (⁠τ⁠) of ground‐motion models (GMMs) across spectral periods 0.2–10 s (frequencies 0.1–5 Hz). The within‐event standard deviation ϕ of ground‐motion intensity measurement residuals range 0.2–0.5 natural log units with values consistently larger for the 3D model. Source‐normalized ratios of intensities (3D/1D) reveal patterns of path and site effects that are correlated with known geologic structure. These results demonstrate that earthquake simulations with fully deterministic wave propagation in 3D Earth models on HPC platforms produce broadband ground motions with median and within‐event aleatory variability consistent with empirical models. Systematic intensity variations for the 3D model caused by path and site effects suggest that these epistemic effects can be estimated and removed to reduce variation in site‐specific hazard estimates. This study motivates future work to evaluate the validity of the USGS 3D model and investigate the development of path and site corrections by running more scenarios.

Rodgers, Arthur J.↗

RDPM: An Extensible Tool for Resilience Design Patterns Modelling

Resilience to faults, errors, and failures in extreme-scale high-performance computing (HPC) systems is a critical challenge. Resilience design patterns offer a new, structured hardware and software design approach for improving resilience. While prior work focused on developing performance, reliability, and availability models for resilience design patterns, this paper extends it by providing a Resilience Design Patterns Modeling (RDPM) tool which allows (1) exploring performance, reliability, and availability of each resilience design pattern, (2) offering customization of parameters to optimize performance, reliability, and availability, and (3) allowing investigation of trade-off models for combining multiple patterns for practical resilience solutions.

Kumar, Mohit↗

Vision 2030 Aircraft Propulsion Grand Challenge Problem: Full-engine CFD Simulations with High Geometric Fidelity and Physics Accuracy

2014 NASA published the outcome of the 2030 CFD (Computational Fluid Dynamics) Vision study: “CFD Vision 2030: A path to Revolutionary Computational Aerosciences” . The study provided a comprehensive review of the state of the art of CFD in 2014 for aerospace applications including, but not limited to, numerical algorithms, physics models, MDAO (Multidisciplinary Design Analysis and Optimization) and HPC (High Performance Computing) hardware. The study also proposed four conceptual ideas of Grand Challenge problems that would build on and benefit from advances outlined in the roadmap. The proposed challenges were meant to foster more detailed descriptions of grand challenge problems for specific disciplines. One of the proposed challenges was in the gas turbine propulsion area, focusing on transient full engine simulations. The current paper addresses detailed technical aspects of that challenge, and proposes a plan to approach it in a gradual manner, which includes high fidelity modeling of components, component coupling, and targeted experimental campaigns relying on common research models.

turbine engine↗

Performance assessment modeling of a generic SNF/HLW repository in salt with coupled thermal-hydrologic effects - 15423

This paper describes advances in performance assessment modeling of deep geologic repositories facilitated by a massively parallel, high-performance computing (HPC) environment. Our new Generic Disposal System Analysis (GDSA) Framework utilizes the massively parallel PFLOTRAN multi-physics code to simulate repository performance in the presence of coupled thermal-hydrologic-chemical processes, linked to DAKOTA, an HPC uncertainty sampling and propagation code that provides nested parallelism for multi-realization performance assessment and sensitivity analysis. This enhanced performance assessment (PA) modeling capability is demonstrated with deterministic and probabilistic simulations of a generic repository for SNF and HLW in bedded salt host rock, by comparing repository performance between a case with heat-generating waste ('thermal' case) and a case without heat generation ('isothermal' case). The simulation results provide preliminary insights into the effect of multi-physics processes and thermal-hydrologic coupling on the long-term behavior of a reference-case salt repository. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A performance model for the communication in fast multipole methods on high-performance computing platforms

Exascale systems are predicted to have approximately 1 billion cores, assuming gigahertz cores. Limitations on affordable network topologies for distributed memory systems of such massive scale bring new challenges to the currently dominant parallel programing model. Currently, there are many efforts to evaluate the hardware and software bottlenecks of exascale designs. It is therefore of interest to model application performance and to understand what changes need to be made to ensure extrapolated scalability. The fast multipole method (FMM) was originally developed for accelerating N-body problems in astrophysics and molecular dynamics but has recently been extended to a wider range of problems. Its high arithmetic intensity combined with its linear complexity and asynchronous communication patterns make it a promising algorithm for exascale systems. In this paper, we discuss the challenges for FMM on current parallel computers and future exascale architectures, with a focus on internode communication. We focus on the communication part only; the efficiency of the computational kernels are beyond the scope of the present study. We develop a performance model that considers the communication patterns of the FMM and observe a good match between our model and the actual communication time on four high-performance computing (HPC) systems, when latency, bandwidth, network topology, and multicore penalties are all taken into account. To our knowledge, this is the first formal characterization of internode communication in FMM that validates the model against actual measurements of communication time. The ultimate communication model is predictive in an absolute sense; however, on complex systems, this objective is often out of reach or of a difficulty out of proportion to its benefit when there exists a simpler model that is inexpensive and sufficient to guide coding decisions leading to improved scaling. The current model provides such guidance.

Computer Science↗