Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance tuning programming systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Autotuning in High-Performance Computing Applications

Autotuning refers to the automatic generation of a search space of possible implementations of a computation that are evaluated through models and/or empirical measurement to identify the most desirable implementation. Autotuning has the potential to dramatically improve the performance portability of petascale and exascale applications. To date, autotuning has been used primarily in high-performance applications through tunable libraries or previously tuned application code that is integrated directly into the application. This paper draws on the authors' extensive experience applying autotuning to high-performance applications, describing both successes and future challenges. If autotuning is to be widely used in the HPC community, researchers must address the software engineering challenges, manage configuration overheads, and continue to demonstrate significant performance gains and portability across architectures. In particular, tools that configure the application must be integrated into the application build process so that tuning can be reapplied as the application and target architectures evolve.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Performance Evaluation of Heterogeneous GPU Programming Frameworks for Hemodynamic Simulations

Preparing for the deployment of large scientific and engineering codes on upcoming exascale systems with GPU-dense nodes is made challenging by the unprecedented diversity of device architectures and heterogeneous programming models. In this work, we evaluate the process of porting a massively parallel, fluid dynamics code written in CUDA to SYCL, HIP, and Kokkos with a range of backends, using a combination of automated tools and manual tuning. We use a proxy application along with a custom performance model to inform the results and identify additional optimization strategies. At scale performance of the programming model implementations are evaluated on pre-production GPU node architectures for Frontier and Aurora, as well as on current NVIDIA device-based systems Summit and Polaris. Real-world workloads representing 3D blood flow calculations in complex vasculature are assessed. Our analysis highlights critical trade-offs between code performance, portability, and development time.

Martin, Aristotle↗
DOE OSTI2019

Production Application Performance Data Streaming for System Monitoring

In this article, we present an approach to streaming collection of application performance data. Practical application performance tuning and troubleshooting in production high-performance computing (HPC) environments requires an understanding of how applications interact with the platform, including (but not limited to) parallel programming libraries such as Message Passing Interface (MPI). Several profiling and tracing tools exist that collect heavy runtime data traces either in memory (released only at application exit) or on a file system (imposing an I/O load that may interfere with the performance being measured). Although these approaches are beneficial in development stages and post-run analysis, a systemwide and low-overhead method is required to monitor deployed applications continuously. This method must be able to collect information at both the application and system levels to yield a complete performance picture. In our approach, an application profiler collects application event counters. A sampler uses an efficient inter-process communication method to periodically extract the application counters and stream them into an infrastructure for performance data collection. We implement a tool-set based on our approach and integrate it with the Lightweight Distributed Metric Service (LDMS) system, a monitoring system used on large-scale computational platforms. LDMS provides the infrastructure to create and gather streams of performance data in a low overhead manner. We demonstrate our approach using applications implemented with MPI, as it is one of the most common standards for the development of large-scale scientific applications. We utilize our tool-set to study the impact of our approach on an open source HPC application, Nalu. Our tool-set enables us to efficiently identify patterns in the behavior of the application without source-level knowledge. We leverage LDMS to collect system-level performance data and explore the correlation between the system and application events. Finally, we demonstrate how our tool-set can help detect anomalies with a low latency. We run tests on two different architectures: a system enabled with Intel Xeon Phi and another system equipped with Intel Xeon processor. Our overhead study shows our method imposes at most 0.5% CPU usage overhead on the application in realistic deployment scenarios.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Exploring the use of novel programming models in land surface models

A wide range of programming models are currently under rapid development to meet the needs of application developers looking to work on more complex machines. These models fill a variety of roles. Some look to abstract supercomputer architecture, including both processors and memory, to present a strategy for portable performance across a wide range of machines. Others look to expose concurrency by explicitly constructing task-driven dependency graphs that allow a scheduler to find parallelism. Here we explore the implications for application codes of adopting two such programming models, Kokkos and Legion, one from each class of models. We specifically focus on the software design implications on refactoring existing applications, rather than the performance and performance tuning of these models. We identify a strategy for refactoring the Energy Exascale Earth System Model's Land Surface Model, an extremely complex code for climate applications, and prototype a series of mini-apps that explore the adoption of Kokkos and Legion. In doing this, we identify commonalities across the models, leading to a series of conclusions about application software design and refactoring for the adoption of novel programming models.

Coon, Ethan↗
DOE OSTI2025

Agentic AI vs ML-Based Autotuning: A Comparative Study for Loop Reordering Optimization

High Performance Computing (HPC) applications rely heavily on code optimizations to achieve good performance on modern CPU and GPU architectures. Traditional Machine Learning auto-tuning approaches have demonstrated success in exploring high-dimensional spaces, but they often require expensive compile-run evaluations and lack adaptability for large HPC applications. The recent advances in Large Language Models (LLMs) and Agentic AI systems raise intriguing questions about the potential of these approaches to address specific optimization methodologies. This work aims to answer an essential question for the HPC community: “How Agentic AI Systems Compare to Traditional ML Autotuning Techniques?” To address this question, we present a comparative analysis between a traditional ML-based optimization approach and an Agentic AI system, evaluating their respective capabilities and limitations for loop-level optimization. In addition, we introduced a new Agentic AI system named LoopGen-AI using three different Large Language Models: GPT-4.1, Claude 4.0, and Gemini 2.5. A key finding is that LoopGen-AI achieves competitive per-formance with only a few program runs, the reasoning logs from the agents revealed that their decisions rely heavily on the combination of semantic understanding of the target kernel with dynamic feedback from the environment, highlighting a promising new dimension in performance tuning. In contrast, ML-based autotuners focus on statistical exploration, and require orders of magnitude more runs to reach peak performance. Additionally, our analysis shows that prompt engineering, particularly using Persona + Context Manager patterns, significantly impacts the effectiveness of Agentic AI. Our results indicate that while Agentic AI systems are not yet a complete replacement for ML-based autotuners, it can effectively complement traditional methods.

Rosas, Miguel Romero↗
DOE OSTI2017

Aspen-based performance and energy modeling frameworks

Now with the anticipation of exascale architectures, energy consumption is becoming one of the critical design parameters, especially in light of the energy budget of 20-30 Megawatts set by the U.S. Department of Energy. Understanding an application’s execution pattern and its energy footprint is critical to improving application operation on a diverse heterogeneous architecture. Applying application-specific performance optimization can consequently improve energy consumption. However, this approach is only applicable to current systems. As we enter a new era of exascale architectures that is projected to contain more complex memory hierarchies, increased levels of parallelism, heterogeneity in hardware, and complex programming models and techniques, energy and performance management is getting more cumbersome. We therefore propose techniques that predict the energy consumption beforehand or at runtime to enable proactive tuning. Such energy prediction approaches must be generic and adapt themselves at runtime to changing application and hardware configurations. Most existing energy estimation and prediction approaches are empirical in nature and thus tied to current systems. To overcome this limitation, we propose two energy estimation techniques: ACEE (Algorithmic and Categorical Energy Estimation), which uses a combination of analytical and empirical modeling techniques; and AEEM (Aspen’s Embedded Energy Estimation), a system-level analytical energy estimation technique. Both of these models incorporate the Aspen domain specific language for performance modeling. We present the methodologies of these two models and test their accuracy using five proxy applications. We also describe three use cases.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

FOCAL Campaign II/III: Applying Active Hull Controls Using Tuned-mass Dampers/Hull Flexibility and Internal Loads

Campaign II and III of the Floating Offshore-wind Controls Advanced Laboratory Experimental Program (FOCAL) aimed to generate a dataset enabling the validation of the performance and loads of a scaled hull, with and without structural hull control. The floating platform was subjected to a variety of wave environments and controlled using tuned-mass dampers (TMDs) tuned to two of the systems natural frequencies (Platform Pitch and Tower-bending). The floating platform is fully instrumented to record a variety of parameters in real time such as platform dynamics, accelerations, and loads at different points in the structure. The test data considered was generated at the University of Maine's Harold Alfond Wind and Wave (W2) testing facility. This testing was focused only on validation of wave loading, and wind conditions were not considered. As such the platform does not support a working turbine, and instead supports a structure designed to have the same mass properties as the 1:70 IEA 15MW Reference turbine. The Load Cases (LC) considered in this testing campaign are as follows: LC 1.X - Platform Static Offset (TMD off); LC 2.X - Platform Free-decays (TMD off); LC 3.X - Wave Cases (Regular Wave, Irregular Wave, Pink Noise Wave) with and without TMDs active. Detailed properties on the model system are found in the following reference: Lenfest E., Floating Offshore-wind Controls Advanced Laboratory (FOCAL) Experimental Program - Campaigns 2 and 3: 1:70 Model-scale Testing of the IEA-Wind 15MW Reference Turbine and the VolturnUS-S Hull. UMaine ASCC Report Number 23-56-1183.

17 WIND ENERGY↗
DOE OSTI2019

Managing code transformations for better performance portability

Code optimization is an intricate task that is getting more complex as computing systems evolve. Managing the program optimization process, including the implementation and evaluation of code variants, is tedious, inefficient, and errors are likely to be introduced in the process. Moreover, because each platform typically requires a different sequence of transformations to fully harness its computing power, the optimization process complexity grows as new platforms are adopted. To address these issues, systems and frameworks have been proposed to automate the code optimization process. They, however, have not been widely adopted and are primarily used by experts with deep knowledge about underlying architecture and compiler intricacies. This article describes the requirements that we believe necessary for making automatic performance tuning more broadly used, especially in complex, long-lived high-performance computing applications. Besides discussing limitations of current systems and strategies to overcome these, we describe the design of a system that is able to semi-automatically generate efficient platform-specific code. In the proposed system, the code optimization is programmer-guided, separately from application code, on an external file in what we call optimization programming. The language to program the optimization process is able to represent complex collections of transformations and, as a result, generate efficient platform-specific code. A database manages different optimized versions of code regions, providing a pragmatic approach to performance portability, and the framework itself has separate components, allowing the optimized code to be used on systems without installing all of the modules required for the code generation. We present experiments on two different platforms to illustrate the generation of efficient platform-specific code that performs comparable to hand-optimized, vendor-provided code.

Computer Science↗
DOE OSTI2017

Balancing Power Absorption Against Structural Loads With Viscous Drag and Power-Takeoff Efficiency Considerations

The focus of this paper is to balance power absorption against structural loading for a novel fixed-bottom oscillating surge wave energy converter in both regular and irregular wave environments. The power-to-load ratio will be evaluated using pseudospectral control (PSC) to determine the optimum power-takeoff (PTO) torque based on a multiterm objective function. This paper extends the pseudospectral optimal control problem to not just maximize the time-averaged absorbed power but also include measures for the surge-foundation force and PTO torque in the optimization. The objective function may now potentially include three competing terms that the optimizer must balance. Separate weighting factors are attached to the surge-foundation force and PTO control torque that can be used to tune the optimizer performance to emphasize either power absorption or load shedding. To correct the pitch equation of motion, derived from linear hydrodynamic theory, a quadratic-viscous-drag torque has been included in the system dynamics; however, to continue the use of quadratic programming solvers, an iteratively obtained linearized drag coefficient was utilized that provided good accuracy in the predicted pitch motion. Furthermore, the analysis considers the use of a nonideal PTO unit to more accurately evaluate controller performance. The PTO efficiency is not directly included in the objective function but rather the weighting factors are utilized to limit the PTO torque amplitudes, thereby reducing the losses resulting from the bidirectional energy flow through a nonideal PTO. Furthermore, results from PSC show that shedding a portion of the available wave energy can lead to greater reductions in structural loads, peak-to-average power ratio, and reactive power requirement.

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

Multi-Node Program Fuzzing on High Performance Computing Resources

Significant effort is placed on tuning the internal parameters of fuzzers to explore the state space, measured as coverage, of binaries. In this work, we investigate the effects of the external environment on the resulting coverage after fuzzing two binaries with AFL for 24 hours. Parameters such as scaling to multiple nodes, node saturation, and parallel file system type on HPC resources are controlled in order to maximize coverage. It will be shown that employing a parallel file system such as IBM's General Parallel File System offers an advantage for fuzzing operations, since it contains enhancements for performance optimization. When combined with scaling to two and four nodes, while simultaneously restricting the number of coordinated AFL tasks per node on the low end (10-50% of available physical cores), coverage may be enhanced within a shorter period of time. Thus, controlling the external environment is a useful effort.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Advanced and Exploratory Shock Sensing Mechanisms.

Mechanical component response to shock environments must be predictable in order to ensure reliability and safety. Whether the shock input results from accidental drops during transportation to projectile impact scenarios, the system must irreversibly transition into a safe state that is incapable of triggering the component . With this critical need in mind, the 2017 Nuclear Weapons Summer Product Realization Institute (NW SPRINT) program objective sought the design of a passive shock failsafe with emphasis on additively manufactured (AM) components. Team Advanced and Exploratory (A&E) responded to the challenge by designing and delivering multiple passive shock sensing mech anisms that activate within a prescribed mechanical shock threshold. These AM failsafe designs were tuned and validated using analytical and computational techniques including the shock response spectrum (SRS) and finite element analysis (FEA). After rapid prototyping, the devices experienced physical shock tests conducted on Sandia drop tables to experimentally verify performance. Keywords: Additive manufacturing, dynamic system, failsafe, finite element analysis, mechanical shock, NW SPRINT, shock respon se spectrum

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2026

FOCAL Campaign IV: Integrated System Control: Turbine + Hull

Campaign IV of the Floating Offshore-wind Controls Advanced Laboratory Experimental Program (FOCAL) aimed to generate a dataset enabling the validation of a floating offshore wind turbine with turbine and hull controls. The turbine considered in this campaign is the scaled IEA 15MW Reference Wind Turbine similar to the setup considered in FOCAL Campaign I. This turbine is mounted on the VolturnUS platform with integrated hull controls similar to the hull considered in FOCAL Campaign II/III. This system is deployed for a fully-coupled wind and wave testing campaign at the University of Maine's Harold Alfond Wind and Wave (W2) facility. System dynamics and turbine characteristics are measured to determine global performance and assess the effect of the control strategies employed. NREL's reference open-source controller (ROSCO) is used for active blade pitch control and hull structural control is examined through the use of tuned mass dampers (TMD's) tuned to the systems pitch and tower-bending natural frequency. The naming convention of the load cases considered are described in the data details section. Detailed properties on the modeled system are found in the following reference: Lenfest E., Floating Offshore-wind Controls Advanced Laboratory (FOCAL) Experimental Program - Campaign IV: 1:70 Model-scale Testing of the IEA-Wind 15MW Reference Turbine and the VolturnUS-S Platform. UMaine ASCC Report Number 23-57-1183.

17 WIND ENERGY↗
DOE OSTI2019

Highlights and Lessons Learned from Army Re-tuning™ Pilot Demonstrations

The Army has aggressively pursued policy and energy efficiency projects and programs in recent years to meet Federal mandates and reduction goals organizationally (EISA 2007, AR 420-1, 42 U.S.C. § 8253), resulting in a 9.6% reduction in energy use intensity (EUI) from FY2015 to FY2017. Despite these successes, the Army remains the largest consumer of electricity in the Federal government and spent approximately $1.1 billion in energy-related costs in FY2017. Many of the low-cost/no-cost conservation measures have been deployed, so finding additional savings and projects that either (a) are cost effective or (b) can be bundled with more costly capital improvement projects to improve life cycle cost effectiveness, is imperative for the Army. Leveraging building control systems (BCS) and optimizing building performance through re-tuning represents a great opportunity for the Army. In 2016, the Pacific Northwest National Laboratory (PNNL), in support of the Assistant Secretary of the Army (Installations, Energy and Environment), i.e. ASA (IEE), was tasked in 2016 with a multi-year study and pilot demonstration to develop a business case for the potential energy and cost reduction benefits from re-tuning efforts for the Army.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Final Scientific/Technical Report-FREE-piston Zero Emissions Refrigerator (FREEZER)

The FREE-piston Zero Emissions Refrigerator (FREEZER™) is a natural refrigerant Stirling-cycle cooler developed by AMSC in partnership with Heatcraft, targeted as a replacement refrigeration system for walk-in coolers or freezers found commonly in restaurants, convenience stores, supermarkets, etc. The FREEZER™, combined with a closed-loop CO2 heat-transfer system, had the goal to provides an efficient (Target COP = 1.4), zero ODP (Ozone Depletion Potential) and near zero GWP (Global Warming Potential) refrigeration solution with no synthetic, flammable, or toxic refrigerants. Other near zero GWP refrigeration systems do not exist at the scale and performance level of FREEZER. ARPA-E Continuation Funding enabled the design and fabrication of one Advanced Development Unit (ADU) cooler and two Field Test Unit (FTU) coolers, and a new revised Field Test Unit (new FTU). Heatcraft was to extensively test the various coolers at their facilities, which closely simulate real-world conditions. The original plan was to install and operate FREEZER FTUs alongside a traditional cooling solution at one or more customer locations to obtain data on direct performance comparisons with existing commercial refrigeration systems. Success in this FREEZER refinement and field-test project will establish the basis for a new class of environmentally friendly refrigeration systems that will revolutionize the industry. The hardware developed under the program is shown below in Figure 1. Five Stirling-cycle machines were built within the program, with a sixth cooler still under construction. The original DU and the ADU coolers met the performance target with a coefficient of performance (COP) of 1.2. The FTU was underperforming during the initial tuning of the free-piston Stirling cycle dynamics when there was a catastrophic failure of the fasteners on pressure boundary. This caused a pause to the program while the failure mechanism was investigated. The root cause was an inadequate flange design that allowed an excessive cyclic loading on the fasteners, leading to a fatigue failure. It was determined that existing FTU design could not be reasonably salvaged in a safe manner, and that fact, combined with the lower-than-expected performance of the new experimental heat exchanger modules lead to the design of the “new FTU” with a more conventional shell-and-tube heat exchanger design which should get close to the design target COP of 1.4, but have a higher overall machine cost. The program ran out of time before the fabrication of the new FTU was completed, but AMSC is still working on the cooler, with the majority of the parts fabricated, and hopes to have the unit under test sometime in early 2022, after which it will be shipped to Heatcraft for additional testing.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

C3F: Collaborative Container-based Model Coupling Framework

Solving complex real-world grand challenge problems requires in-depth collaboration of researchers from multiple disciplines. Such collaboration often involves harnessing multiscale and multi-dimensional data and combining models from different fields to simulate systems. However, the progress on this front has been limited mainly due to significant gaps in domain knowledge and tools that are typically employed in silos of the domains. Researchers from different fields face considerable barriers to understanding and reusing each other’s data/models in order to collaborate effectively. For example, in solving the global sustainability problems, researchers from hydrology, climate science, agriculture, and economics need to run their respective models to study different components of the global and local food, energy and water systems while, at the same time, need to interact with other researchers and integrate the results of one model with another. Developing this kind of model coupling workflow calls for (1) a large amount of data being processed and exchanged across domains and organizations, (2) identifying and processing the output of one model to make it ready for integration into another model, (3) controlling the workflow dynamically so that it runs until a certain convergence condition or other criteria is met, and (4) close collaboration among the modelers to explore, tune, and test the configuration and data transformation needed to link the models. We have developed C3F, a flexible collaborative model coupling framework to help researchers accelerate their model integration and linking efforts by leveraging advanced cyberinfrastructure such as high-performance computing and virtual containers. In this paper, we describe our experience and lessons learned in developing this cyberinfrastructure solution to support the linking of Water Balance Model (WBM) and SIMPLE-G agricultural economic model in an NSF funded INFEWS project and a DOE-funded Program on Coupled Human and Earth Systems (PCHES) to study the implications of groundwater scarcity for food-energy-water systems. The C3F model coupling framework can be extended to facilitate other model linkages as well.

containerization↗
DOE OSTI2018

Tartan: Evaluating Modern GPU Interconnect via a Multi-GPU Benchmark Suite

In this paper, we fill the gap by proposing a multi-GPU benchmark suite named Tartan, which contains microbenchmarks, scale-up and scale-out applications. We then apply Tartan to evaluate the four latest types of modern GPU interconnects, i.e., PCI- e, NVLink-V1, NVLink-V2 and InfiniBand with GPUDirect- RDMA from two recently released NVIDIA super AI platforms as well as ORNL’s exascale prototype system. Based on empirical evaluation, we observe four new types of NUMA effects: three types are triggered by NVLink’s topology, connectivity and routing, while one type is caused by PCI-e (i.e., anti-locality). They are very important for performance tuning in multi-GPU environment. Our evaluation results show that, unless the current CPU-GPU master-slave programming model can be replaced, it is difficult for scale-up multi-GPU applications to really benefit from faster intra-node interconnects such as NVLinks; while for inter-node scale-out applications, although interconnect is more crucial to the overall performance, GPUDirect-RDMA appears to be not always the optimal choice.

HPC↗
DOE OSTI2025

Calibration and Performance of the ICARUS Detector at Fermilab

ICARUS is the largest Liquid Argon Time Projection Chamber (LArTPC) in operation and serves as the Far Detector of the Short Baseline Neutrino (SBN) program at Fermilab. Precise detector calibration is essential for reliable energy reconstruction and for maximizing the physics reach of the experiment. In this talk, I will describe the energy and timing calibration procedures developed at ICARUS. Thanks to the abundant flux of cosmic ray muons at the surface, the TPC response to ionization charge has been equalized across the detector, removing non-uniformities and in-transparency effects. A novel data-driven procedure has been used to tune the simulation of ionization signals and electronics noise yielding close agreement between Monte Carlo and data with minimal residual bias in reconstructed charge. In addition, the light detection system has been calibrated to sub-nanosecond timing resolution. This precision enables efficient cosmic background rejection and accurate synchronization of neutrino interactions with the time structure of both the Booster Neutrino Beam (BNB) and Neutrinos at the Main Injector (NuMI) beam. Together, these efforts demonstrate the robust performance of the detector and provide critical experience for future large LArTPCs, such as DUNE.

Vicenzi, Matteo [Brookhaven]↗
DOE OSTI2020

Compiler and Runtime Approaches to Enable Large-Scale Irregular Programs. Final report, July 2013 - July 2019

While regular algorithms, characterized by operations on dense matrices and arrays, have long been the mainstay of scientific, high-performance computing, irregular algorithms, which feature unpredictable accesses to pointer-based data structures, are becoming increasingly common in high performance computing, arising in graph analysis, data mining and visualization, among other domains. Unfortunately, the defining characteristics of irregular applications, their dynamic, unpredictable, data-dependent access patterns and data layouts, make achieving high performance on large scale systems difficult. Scaling applications to peta- and exa-scale requires carefully controlling communication and data movement and placement, an inherently difficult task when access patterns and data layouts are unpredictable! Most irregular applications that attain high performance must be painstakingly hand-written and hand-tuned, with few common principles or paradigms uniting various implementations and easing future development. Despite the increasing importance of irregular applications, there is little programmer knowledge, and even less compiler ability, devoted to optimizing them. This project aims to solve these problems. By allowing programmers to write irregular applications in high level forms, with at most a few annotations highlighting key structural properties, programmers can focus on developing their algorithms and methods. The compiler and run-time system can take on the tedious task of optimizing the application for execution at large scales, and can automatically provide efficient implementations. This will provide portability and ease maintenance for existing irregular applications, but, more importantly, open up whole new domains of computational science to large-scale, high-performance simulation codes.

97 MATHEMATICS AND COMPUTING↗