Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance Tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Use of Continuous Integration Tools for Application Performance Monitoring

High performance computing systems are becom- ing increasingly complex, both in node architecture and in the multiple layers of software stack required to compile and run applications. As a consequence, the likelihood is increasing for application performance regressions to occur as a result of routine upgrades of system software components which interact in complex ways. The purpose of this study is to evaluate the effectiveness of continuous integration tools for application performance monitoring on HPC systems. In addition, this paper also describes a prototype system for application perfor- mance monitoring based on Jenkins, a Java-based continuous integration tool. The monitoring system described leverages several features in Jenkins to track application performance results over time. Preliminary results and lessons learned from monitoring applications on Cray systems at the Oak Ridge Leadership Computing Facility are presented.

Vergara Larrea, Veronica G↗

Performance Refactoring of Instrumentation, Measurement, and Analysis Technologies for Petascale Computing. The PRIMA Project

The growing number of cores provided by today’s high-­end computing systems present substantial challenges to application developers in their pursuit of parallel efficiency. To find the most effective optimization strategy, application developers need insight into the runtime behavior of their code. The University of Oregon (UO) and the Juelich Supercomputing Centre of Forschungszentrum Juelich (FZJ) develop the performance analysis tools TAU and Scalasca, respectively, which allow high-­performance computing (HPC) users to collect and analyze relevant performance data – even at very large scales. TAU and Scalasca are considered among the most advanced parallel performance systems available, and are used extensively across HPC centers in the U.S., Germany, and around the world. The TAU and Scalasca groups share a heritage of parallel performance tool research and partnership throughout the past fifteen years. Indeed, the close interactions of the two groups resulted in a cross-­fertilization of tool ideas and technologies that pushed TAU and Scalasca to what they are today. It also produced two performance systems with an increasing degree of functional overlap. While each tool has its specific analysis focus, the tools were implementing measurement infrastructures that were substantially similar. Because each tool provides complementary performance analysis, sharing of measurement results is valuable to provide the user with more facets to understand performance behavior. However, each measurement system was producing performance data in different formats, requiring data interoperability tools to be created. A common measurement and instrumentation system was needed to more closely integrate TAU and Scalasca and to avoid the duplication of development and maintenance effort. The PRIMA (Performance Refactoring of Instrumentation, Measurement, and Analysis) project was proposed over three years ago as a joint international effort between UO and FZJ to accomplish these objectives: (1) refactor TAU and Scalasca performance system components for core code sharing and (2) integrate TAU and Scalasca functionality through data interfaces, formats, and utilities. As presented in this report, the project has completed these goals. In addition to shared technical advances, the groups have worked to engage with users through application performance engineering and tools training. In this regard, the project benefits from the close interactions the teams have with national laboratories in the United States and Germany. We have also sought to enhance our interactions through joint tutorials and outreach. UO has become a member of the Virtual Institute of High-­Productivity Supercomputing (VI-­HPS) established by the Helmholtz Association of German Research Centres as a center of excellence, focusing on HPC tools for diagnosing programming errors and optimizing performance. UO and FZJ have conducted several VI-­HPS training activities together within the past three years.

97 MATHEMATICS AND COMPUTING↗

Document Flowdown Tool

DFTool performs the following: • A tool to conduct, capture, document, and manage a systematic review and flowdown of contractual requirements/documents to the site, facility, and project-level implementing documents. • Ability to alert/email document owners to impending changes/updates and impacts to upper-level linked documents. • Custom ability to generate reports and/or include custom functionalities based on other needs or consideration for site use. • Ability to be accessed by all personnel (particularly document owners). • Shows both document flow-up and flow-down. • Provides visibility where links/flowdown does not currently exist or is incorrect so it can be changed/updated (no visibility currently exists). • Ability to capture requirements and ultimately link to an existing/proven requirements-based commitment tracking system which can be used (electively) at the facility/organizational-level

Source record↗

Chimbuko: A Workflow-Level Scalable Performance Trace Analysis Tool

Due to the sheer volume of data it is typically impractical to analyze the detailed performance of an HPC application running at-scale. While conventional small-scale benchmarking and scaling studies are often sufficient for simple applications, many modern workflow-based applications couple multiple elements with competing resource demands and complex inter-communication patterns for which performance cannot easily be studied in isolation and at small scale. This work discusses Chimbuko, a performance analysis framework that provides real-time, in situ anomaly detection. By focusing specifically on performance anomalies and their origin (aka provenance), data volumes are dramatically reduced without losing necessary details. To the best of our knowledge, Chimbuko is the first online, distributed, and scalable workflow-level performance trace analysis framework. We demonstrate the tool's usefulness on Oak Ridge National Laboratory's Summit system.

97 MATHEMATICS AND COMPUTING↗

Chimbuko: A Workflow-Level Scalable Performance Trace Analysis Tool

ABSTRACT Due to the sheer volume of data it is typically impractical to analyze the detailed performance of an HPC application running at-scale. While conventional small-scale benchmarking and scaling studies are often sufficient for simple applications, many modern workflow-based applications couple multiple elements with competing resource demands and complex inter-communication patterns for which performance cannot easily be studied in isolation and at small scale. This work discusses Chimbuko, a performance analysis framework that provides real-time, in situ anomaly detection. By focusing specifically on performance anomalies and their origin (aka provenance), data volumes are dramatically reduced without losing necessary details. To the best of our knowledge, Chimbuko is the first online, distributed, and scalable workflow-level performance trace analysis framework. We demonstrate the tool's usefulness on Oak Ridge National Laboratory's Summit system.

97 MATHEMATICS AND COMPUTING↗

FCP: A Fast and Scalable Data Copy Tool for High Performance Parallel File Systems

The design of HPC file and storage systems has largely been driven by the requirements on capability, reliability, and capacity. However, the convergence of large-scale simulations with big data analytics have put the data, its usability, and management back on the front and center position. One of the most common and time consuming data management tasks is the transfer of very large datasets within and across file systems.In this paper, we are introducing the FCP tool, a file system agnostic copy tool designed at the OLCF for scalable and high-performance data transfers between two file system endpoints. It provides an array of interesting features such as adaptive chunking, checksumming on the fly, checkpoint and resume capabilities to handle failures, and preserving stripe information for Lustre file system among others. It is currently available on the Titan supercomputer at the OLCF. Initial tests have shown that FCP has much better and scalable performance than traditional data copy tools and it was capable of transferring petabyte-scale datasets between two Lustre file systems.

Wang, Feiyi↗

PAPI software-defined events for in-depth performance analysis

The methodology and standardization layer provided by the Performance Application Programming Interface (PAPI) has played a vital role in application profiling for almost two decades. It has enabled sophisticated performance analysis tool designers and performance-conscious scientists to gain insights into their applications by simply instrumenting their code using a handful of PAPI functions that “just work” across different hardware components. In the past, PAPI development had focused primarily on hardware-specific performance metrics. However, the rapidly increasing complexity of software infrastructure poses new measurement and analysis challenges for the developers of large-scale applications. In particular, acquiring information regarding the behavior of libraries and runtimes—used by scientific applications—requires low-level binary instrumentation, or APIs specific to each library and runtime. No uniform API for monitoring events that originate from inside the software stack has emerged. In this article, we present our efforts to extend PAPI’s role so that it becomes the de facto standard for exposing performance-critical events, which we refer to as software-defined events (SDEs), from different software layers. Upgrading PAPI with SDEs enables monitoring of both types of performance events—hardware- and software-related events—in a uniform way, through the same consistent PAPI. The goal of this article is threefold. First, we motivate the need for SDEs and describe our design decisions regarding the functionality we offer through PAPI’s new SDE interface. Second, we illustrate how SDEs can be utilized by different software packages, specifically, by showcasing their use in the numerical linear algebra library MAGMA-Sparse, the tensor algebra library TAMM that is part of the NWChem suite, and the compiler-based performance analysis tool Byfl. Third, we provide a performance analysis of the overhead that results from monitoring SDEs and discuss the trade-offs between overhead and functionality.

Jagode, Heike↗

Analyzing the Performance of Scientific Applications with OpenSpeedShop

Open|SpeedShop (O|SS) is a comprehensive, open source, parallel performance analysis tool set that provides the most common performance analysis steps in a single environment. It can help application programmers to analyze, understand and optimize the performance of their codes. O|SS provides a wide range of performance experiments covering both sampling and tracing techniques. It works on sequential, MPI, and multithreaded codes without requiring source code modifications. The latter allows users an easy integration of O|SS into their application's workflow and runtime environment. This ensures a low learning curve and is essential for achieving a wide spread adoption of any performance tool set. O|SS, together with documentation and extensive tutorials, is available at http://www.openspeedshop.org/.

99 GENERAL AND MISCELLANEOUS↗

Outyear Budgeting Tool

OBTool performs the following: • Consistent method and tool to develop/estimate fiscal year (FY) 2010 and outyear budget/estimates • Maintain configuration control on resource rates and changes to outyear budget estimates, while allowing for accessibility, accountability, and tracking shared access between program managers, facility managers (FMs), project managers (PMs), cost account managers (CAMs), and project controls engineers (PCEs) • Consistency in budget estimating methodology, including scope, requirements, basis of estimates, resources, activities, escalation, and presentation of documentation in tasks and execution plans and reports • Ability to sync (i.e. export) and import data into Primavera and Cobra to the lifecycle baseline file

Carlos Castillo, Jerel Nelson↗

Improving the Performance of Multipurpose Machine Tools

Attention focuses on means of improving the efficiency and capabilities of multipurpose machine tools by expanding the range of available tools and the methods of surface machining. As an example, new approaches are applied to the manufacture of complex parts by means of a multipurpose machine tool. The machining efficiency is improved.

42 ENGINEERING↗

An Online Prototype Toolset for Predicting and Optimizing P&T Performance (FY23 Status Report)

A new web-based toolset is being developed to support ongoing remediation optimization efforts and implementation of an adaptive site management strategy for the 200 West Area Pump-and-Treat (P&T) system at the Hanford Site. This toolset, comprising the well performance index tool and the well optimization pre-screening tool, will offer a user-friendly interface to predict and optimize the P&T well network’s performance at a preliminary level. Efforts in fiscal year (FY) 2023 focused on three main components: updating the existing deep learning model for predicting P&T performance, designing and developing a prototype of a web-based performance index tool, and initiating the conceptual design of the well optimization pre-screening tool. The well performance index tool is based on a pre-trained deep learning model that allows users to select a target contaminant and well screen length, then visualize the predicted performance of potential new wells across the site. The well optimization pre-screening tool includes two separate modules: the pre-computed scenario viewer, which organizes and visualizes offline optimization simulation results, and the quick analysis module, which provides real-time model prediction using user-specified well locations. In FY24, the plan is to add web-based applications to SOCRATES for both the well performance prediction tool and the optimization prescreening tool, with accompanying user and theory guides. These tools are intended to enable an accessible, easily applied, and transparent approach to remedy planning and decision-making.

97 MATHEMATICS AND COMPUTING↗

High Performance Computing Innovation Center Open Source Developer Tools

The High Performance Computing Innovation Center (HPCIC) aims to ease the transition for developers to use open source software provided by the lab. HPCIC Developer Tools is a collection of software, containers, cloud configurations, and associated documentation that make it easy to deploy tutorials or small apps to demonstrate lab-developed software. For example, building a tutorial container that includes lab software and interactive interfaces; a command line or web-based tool that accepts user preferences for the tutorial; supporting tools and software development kits (SDKs) for developer interactions or productivity in different languages embraced by the larger developer community such as Go, Rust, and Python; and automation in version control to support continued update of software and associated resources. These tools are best developed in an open source environment such as GitHub, not only to champion the lab's open source software, but for purposes of branding and demonstrating the lab's leadership in open source. Such an effort that brings in more developers to use and contribute to lab software can further improve the quality of the software, and developer experience at the lab.

Beckingsale, DavidA↗

A Web-Based Simulation Tool on The Performance of Different Roofing Systems

The Roof Savings Calculator (www.roofcalc.com) provides the general public with a web-based program for calculating the energy savings of different roofing and attic systems on four different building types (residential, office, retail, and warehouse) in 239 US TMY2 locations. The core simulation engine of the RSC is doe2attic, which couples the AtticSim program developed by Oak Ridge National Laboratory with the DOE-2.1E program originally developed by Lawrence Berkeley National Laboratory a widely used whole-building simulation program since the 1980 s. Although simulating heat flows through the roof may seem to be an easy task, simulating the net effect of roofing strategies on building heating and cooling energy use can be quite challenging. Few simulation programs can reliably capture dynamics including an attic or plenum with large day-night temperature swings, high ventilation rates, significant radiant exchange between the roof and the attic floor and thermal interactions when there are ducts in the attic, as is typical in North American buildings. The doe2attic program has been tested against detailed measurements gathered in two residential buildings in Fresno, California from cooling energy use to air and surface temperatures, and heat fluxes of the roof and attic floor. The focus of this paper is on the doe2attic simulation tool, but the user interface of the RSC will also be briefly described.

Huang, Joe↗

CHARM-SYCL & IRIS: A Tool Chain for Performance Portability on Extremely Heterogeneous Systems

Performance portability is becoming crucial as high-performance computing systems become increasingly heterogeneous. We have many options for CPUs and accelerators (e.g., GPUs) but also for non-Von Neumann architectures such as field-programmable gate arrays. This paper presents the CHARM-SYCL unified programming environment for multiple accelerator types as a performance-portable programming environment. It uses the IRIS library developed at Oak Ridge National Laboratory as the back end accelerator runtime. IRIS has a high-performance scheduler to distribute tasks across accelerators. This design allows us to run an application from the same source on multiple systems with multiple configurations. We provide three types of portability with CHARM-SYCL: Portable Workflow, Compiler and Runtime Portability, and Application and Performance Portability. We implement a Monte Carlo simulation benchmark code on the CHARM-SYCL execution environment and demonstrate that our programming environment can accommodate extremely heterogeneous systems.

Fujita, Norihisa↗

Predictive Models and High-Performance Computing as Tools to Accelerate the Scaling-Up of New Bio-Based Fuels Workshop: Summary Report

This report summarizes the results of a virtual workshop sponsored by the Bioenergy Technologies Office held on June 9–11, 2020. The workshop discussed best practices for utilizing mathematical modeling tools across multiple scales to reduce technology uncertainty and accelerate scaling-up of biorefinery/chemical production equipment and optimize operations.

09 BIOMASS FUELS↗

Tools for Assessing Performance Project: FY2021 Quarter 4 Report

The rotatable building located at Texas Tech’s Reese Technology Center is approximately 14 m wide (width being defined as more normal to the wind than parallel), 9 m long (aligned more with the wind than perpendicular), and 4 m tall. By placing 29 sonic anemometers downwind of the building, see Fig. 1, this facility provided a chance to collect data concerning both the wake velocity deficit distribution in the downstream and crosssteam directions (relative to the mean wind) behind an isolated building. A preliminary comparison between this data and the recently- developed fast-running diffusive wake model, which was developed based on wind tunnel and LES (performed with JOULES) simulations, for the purpose of either validating this model of understanding potential persistent differences between the idealized wind tunnel or LES conditions and those of full-scale real world phenomena. For this preliminary exploration, we utilized the diffusive wake model implemented in the QUIC model.

42 ENGINEERING↗