Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “open source codes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Development and Maintenance of NJOY

NJOY is the leading nuclear data processing code, which is developed at Los Alamos National Laboratory. NJOY21 is the current production version. It replaces the legacy, Fortran-based, NJOY2016 which is a direct descendent of the original version released in 1977. NJOY21 is the next-generation version of NJOY that is being completely modernized. It has been released with an Open Source license and has no export control restrictions. More information about NJOY21 can be found in Section 2. This report serves to document the development and maintenance plan for NJOY-– including legacy NJOY and NJOY21. This document is constantly being updated as the development of NJOY proceeds. The source of this document can be found in a git repository at LANL.

97 MATHEMATICS AND COMPUTING↗

Globally Gridded Groundwater Extraction Volumes and Costs under Six Depletion and Ponded Depth Targets

This repository contains simulated outputs from superwell – a hydro-economic tool for long-term assessment of groundwater cost and supply – providing globally gridded groundwater extractable volumes and associated unit costs ($/km³) for accessible groundwater production, based on a variety of user-defined depletion and ponded depth scenarios. Key model documentation: Niazi, H., Ferencz, S. B., Graham, N. T., Yoon, J., Wild, T. B., Hejazi, M., Watson, D. J., & Vernon, C. R. (2025). Long-term hydro-economic analysis tool for evaluating global groundwater cost and supply: Superwell v1.1. Geoscientific Model Development, 18(5), 1737-1767. https://doi.org/10.5194/gmd-18-1737-2025 Find the source code of the superwell model on GitHub: https://github.com/JGCRI/superwell Repository Overview Main output: superwell_outputs.7z contains 6 files (4.5 GB) named as superwell_py_deep_all_0.*PD_0.*DL.csv. These files present superwell outputs of global groundwater extraction volumes and cost estimates on a 0.5° scale for six scenarios with different Ponded Depth (PD; 0.3 and 0.6 m) and Depletion Limit (DL; 5%, 25%, and 40% of available volume) targets over the entire pumping lifetime of a grid cell superwell_py_deep_all_0.3PD_0.25DL_sample_100.csv contains superwell outputs for 100 data points sampled to match the global inputs' distribution superwell_py_deep_all_0.3PD_0.25DL_Grid_72548.csv contains superwell output for a single grid cell concept_v5.png provides an overview of the superwell workflow Outputs Description year_number: year of pumping depletion_limit: set depletion limit (DL) as a volume fraction of total available groundwater Mappings: continent, country, gcam_basin_id, Basin_long_name, grid_id: geographic identifiers and basin information Inputs: grid_area (km²): area of the grid cell whyclass: hydrogeological classification of the aquifer permeability (m/day), porosity (%), total_thickness (m), depth_to_water (m): aquifer properties. The geo-processed input data has been published separately: https://doi.org/10.57931/2307831 Model outputs: orig_aqfr_sat_thickness (m), aqfr_sat_thickness (m): original and remaining/instantaneous saturated thickness of the aquifer hydraulic_conductivity (m/day), transmissivity (m²/day): hydraulic properties of the aquifer radius_of_influence (m), areal_extent (km²): well radius and area of influence from the center of the well number_of_wells (-): number of wells in a grid cell determined by a ratio of well area and grid area max_drawdown (m), drawdown (m), drawdown_interference (m): well and aquifer drawdown during extraction total_head (m): total lift for the groundwater (depth to water plus drawdown) total_well_length (m): total depth of wells drilled well_yield (m³/day): pumping rate or well yield power (kW), energy (kWh): power and energy required for pumping groundwater Volume Outputs: volume_produced_perwell (m³), cumulative_vol_produced_perwell (m³): production volume metrics per well volume_produced_allwells (m³), cumulative_vol_produced_allwells (m³): aggregate extraction volumes for all wells in a grid cell available_volume (m³): available groundwater in storage for the grid cell as determined by aquifer properties depleted_vol_fraction: fraction of total volume pumped over available volumes in a grid cell (same as depletion limit) Cost Outputs: well_installation_cost ($): well installation cost based on the hydrogeological complexity of the aquifer annual_capital_cost, maintenance_cost, nonenergy_cost ($): nonenergy costs energy_cost_rate ($/kWh): electricity rate energy_cost ($): energy cost of pumping groundwater total_cost_perwell ($), total_cost_allwells ($): total annual energy and non-energy cost for each and all wells in a grid cell a unit_cost ($/m³), unit_cost_per_km3 ($/km³), unit_cost_per_acreft ($/acre-ft): total cost of pumping a unit of groundwater, indicated for different spatial units Key Resources Model documentation: Niazi, H., Ferencz, S., Graham, N., Yoon, J., Wild, T., Hejazi, M., Watson, D., & Vernon, C. (2024; In-prep). Long-term Hydro-economic Assessment Tool for Evaluating Global Groundwater Cost and Supply: Superwell v1. Geoscientific Model Development. Input data: Niazi, H., Watson, D., Hejazi, M., Yonkofski, C., Ferencz, S., Vernon, C., Graham, N., Wild, T., & Yoon, J. (2024). Global Geo-processed Data of Aquifer Properties by 0.5° Grid, Country and Water Basins. MSD-LIVE Data repository. https://doi.org/10.57931/2307831 superwell source code: https://github.com/JGCRI/superwell Cite as Niazi, H., Ferencz, S., Yoon, J., Graham, N., Wild, T., Hejazi, M., Watson, D., & Vernon, C. (2024). Globally Gridded Groundwater Extraction Volumes and Costs under Six Depletion and Ponded Depth Targets. MSD-LIVE Data repository. https://doi.org/10.57931/2307832 Contact Reach out to Hassan Niazi or Stephen Ferencz or open an issue in the superwell repository for questions or suggestions.

Earth Systems↗

Gyrokinetic continuum simulation of turbulence in a straight open-field-line plasma

Here, five-dimensional gyrokinetic continuum simulations of electrostatic plasma turbulence in a straight, open-field-line geometry have been performed using a full- discontinuous-Galerkin approach implemented in the Gkeyll code. While various simplifications have been used for now, such as long-wavelength approximations in the gyrokinetic Poisson equation and the Hamiltonian, these simulations include the basic elements of a fusion-device scrape-off layer: localised sources to model plasma outflow from the core, cross-field turbulent transport, parallel flow along magnetic field lines, and parallel losses at the limiter or divertor with sheath-model boundary conditions. The set of sheath-model boundary conditions used in the model allows currents to flow through the walls. In addition to details of the numerical approach, results from numerical simulations of turbulence in the Large Plasma Device, a linear device featuring straight magnetic field lines, are presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Admiralty Inlet Advanced Turbulence Measurements: June 2014

This data is from measurements at Admiralty Head, in Admiralty Inlet (Puget Sound) in June of 2014. The measurements were made using Inertial Motion Unit (IMU) equipped ADVs mounted on Tidal Turbulence Mooring's (TTMs). The TTM positions the ADV head above the seafloor to make mid-depth turbulence measurements. The inertial measurements from the IMU allows for removal of mooring motion in post processing. The mooring motion has been removed from the stream-wise and vertical velocity signals (u, w). The lateral (v) velocity has some 'persistent motion contamination' due to mooring sway. Each ttm was deployed with two ADVs. The 'top' ADV head was positioned 0.5m above the 'bottom' ADV head. The TTMs were placed in 58m of water. The position of the TTMs were: ttm01 : (48.1525, -122.6867) ttm01b : (48.15256666, -122.68678333) ttm02b : (48.152783333, -122.686316666) Deployments TTM01b and TTM02b occurred simultaneously and were spaced approximately 50m apart in the cross-stream direction. Units ----- - Velocity data (_u, urot, uacc) is in m/s. - Acceleration (Accel) data is in m/s^2. - Angular rate (AngRt) data is in rad/s. - The components of all vectors are in 'ENU' orientation. That is, the first index is True East, the second is True North, and the third is Up (vertical). - All other quantities are in the units defined in the Nortek Manual. Motion correction and rotation into the ENU earth reference frame was performed using the Python-based open source DOLfYN library (http://lkilcher.github.io/dolfyn/). Details on motion correction can be found there. Additional details on TTM measurements at this site can be found in the included Marine Energy Technology Symposium paper.

16 TIDAL AND WAVE POWER↗

Admiralty Inlet Advanced Turbulence Measurements: May 2015

This data is from measurements at Admiralty Head, in Admiralty Inlet (Puget Sound) in May of 2015. The measurements were made using Inertial Motion Unit (IMU) equipped ADVs mounted on a 'StableMoor' (Manufacturer: DeepWater Buoyancy) buoy and a Tidal Turbulence Mooring (TTM). These platforms position ADV heads above the seafloor to make mid-depth turbulence measurements. The inertial measurements from the IMU allows for removal of mooring motion in post processing. The mooring and buoy motion has been removed from the stream-wise and vertical velocity signals (u, w). The lateral (v) velocity has some 'persistent motion contamination' due to mooring sway. The TTM was deployed with one ADV, it's position was: 48 09.145', -122 41.209' The StableMoor was deployed twice, the first time it was deployed in 'wing-mode' with two ADVs ('Port' and 'Star') at: 48 09.166', -122 41.173' The second StableMoor deployment was in 'Nose' mode with one ADV at: 48 09.166', -122 41.174' Units ----- - Velocity data (_u, urot, uacc) is in m/s. - Acceleration (Accel) data is in m/s^2. - Angular rate (AngRt) data is in rad/s. - The components of all vectors are in 'ENU' orientation. That is, the first index is True East, the second is True North, and the third is Up (vertical). - All other quantities are in the units defined in the Nortek Manual. Motion correction and rotation into the ENU earth reference frame was performed using the Python-based open source DOLfYN library (http://lkilcher.github.io/dolfyn/). Details on motion correction can be found there. Additional details on TTM measurements at this site can be found in the included Marine Energy Technology Symposium paper.

16 TIDAL AND WAVE POWER↗

A graphics processing unit accelerated sparse direct solver and preconditioner with block low rank compression

We present the GPU implementation efforts and challenges of the sparse solver package STRUMPACK. The code is made publicly available on github with a permissive BSD license. STRUMPACK implements an approximate multifrontal solver, a sparse LU factorization which makes use of compression methods to accelerate time to solution and reduce memory usage. Multiple compression schemes based on rank-structured and hierarchical matrix approximations are supported, including hierarchically semi-separable, hierarchically off-diagonal butterfly, and block low rank. Here, in this paper, we present the GPU implementation of the block low rank (BLR) compression method within a multifrontal solver. Our GPU implementation relies on highly optimized vendor libraries such as cuBLAS and cuSOLVER for NVIDIA GPUs, rocBLAS and rocSOLVER for AMD GPUs and the Intel oneAPI Math Kernel Library (oneMKL) for Intel GPUs. Additionally, we rely on external open source libraries such as SLATE (Software for Linear Algebra Targeting Exascale), MAGMA (Matrix Algebra on GPU and Multi-core Architectures), and KBLAS (KAUST BLAS). SLATE is used as a GPU-capable ScaLAPACK replacement. From MAGMA we use variable sized batched dense linear algebra operations such as GEMM, TRSM and LU with partial pivoting. KBLAS provides efficient (batched) low rank matrix compression for NVIDIA GPUs using an adaptive randomized sampling scheme. The resulting sparse solver and preconditioner runs on NVIDIA, AMD and Intel GPUs. Interfaces are available from PETSc, Trilinos and MFEM, or the solver can be used directly in user code. We report results for a range of benchmark applications, using the Perlmutter system from NERSC, Frontier from ORNL, and Aurora from ALCF. For a high frequency wave equation on a regular mesh, using 32 Perlmutter compute nodes, the factorization phase of the exact GPU solver is about 6.5× faster compared to the CPU-only solver. The BLR-enabled GPU solver is about 13.8× faster than the CPU exact solver. For a collection of SuiteSparse matrices, the STRUMPACK exact factorization on a single GPU is on average 1.9× faster than NVIDIA’s cuDSS solver.

97 MATHEMATICS AND COMPUTING↗

Common workflows for computing material properties using different quantum engines

The prediction of material properties based on density-functional theory has become routinely common, thanks, in part, to the steady increase in the number and robustness of available simulation packages. This plurality of codes and methods is both a boon and a burden. While providing great opportunities for cross-verification, these packages adopt different methods, algorithms, and paradigms, making it challenging to choose, master, and efficiently use them. We demonstrate how developing common interfaces for workflows that automatically compute material properties greatly simplifies interoperability and cross-verification. We introduce design rules for reusable, code-agnostic, workflow interfaces to compute well-defined material properties, which we implement for eleven quantum engines and use to compute various material properties. Each implementation encodes carefully selected simulation parameters and workflow logic, making the implementer’s expertise of the quantum engine directly available to non-experts. All workflows are made available as open-source and full reproducibility of the workflows is guaranteed through the use of the AiiDA infrastructure.

36 MATERIALS SCIENCE↗

Few-shot leaf segmentation

In this work, we use few-shot learning to segment the body and vein architecture of Populus trichocarpa leaves from high-resolution scans obtained in the UC Davis common garden. Leaf and vein segmentation are formulated as separate tasks, in which convolutional neural networks (CNNs) are used to iteratively expand partial segmentations until reaching stopping criteria. Our leaf and vein segmentation approaches use just 50 and 8 manually traced images for training, respectively, and are applied to a set of 2,634 top and bottom leaf scans. We show that both methods achieve high segmentation accuracy, in some cases exceeding even human-level segmentation. The leaf and vein segmentations are subsequently used to extract 68 morphological traits using traditional open-source image processing tools, which are validated using real-world physical measurements. For a biological perspective, we perform a genome-wide association study using the "vein density" trait to discover novel genetic architectures associated with multiple physiological processes relating to leaf development and function. In addition to sharing all of the few-shot learning code, we are releasing all images, manual segmentations, model predictions, 68 extracted leaf phenotypes, and a new set of SNPs called against the v4 P. trichocarpa genome for 1,419 genotypes.

Lagergren, John [Oak Ridge National Lab. (ORNL), O↗

Supporting information for Few-Shot Learning Enables Population-Scale Analysis of Leaf Traits in Populus trichocarpa

In this work, we use few-shot learning to segment the body and vein architecture of P. trichocarpa leaves from high-resolution scans obtained in the UC Davis common garden. Leaf and vein segmentation are formulated as separate tasks, in which convolutional neural networks (CNNs) are used to iteratively expand partial segmentations until reaching stopping criteria. Our leaf and vein segmentation approaches use just 50 and 8 manually traced images for training, respectively, and are applied to a set of 2,634 top and bottom leaf scans. We show that both methods achieve high segmentation accuracy, in some cases exceeding even human-level segmentation. The leaf and vein segmentations are subsequently used to extract 68 morphological traits using traditional open-source image processing tools, which are validated using real-world physical measurements. For a biological perspective, we perform a genome-wide association study using the vein density trait to discover novel genetic architectures associated with multiple physiological processes relating to leaf development and function. In addition to sharing all of the few-shot learning code (see https://github.com/jlager/few-shot-leaf-segmentation), we are releasing all images, manual segmentations, model predictions, 68 extracted leaf phenotypes, and a new set of SNPs called against the v4 P. trichocarpa genome for 1,419 genotypes. The data folder includes all images, ground truth segmentations, predicted segmentations, and extracted leaf traits. All images encode the sample ID in the file name by indicating the treatment, block, row, position, and leaf side, respectively. For example, the file, C_1_1_2_bot.jpeg, indicates the control treatment, block 1, row 1, position 2, and the bottom side of the leaf. Tabulated results include position IDs as well as the corresponding genotype IDs. The images folder includes the 2,906 high-resolution leaf scans taken in the field. The leaf_masks folder includes 50 ground truth segmentations used for training the leaf tracing algorithm. The leaf_preds folder includes the 2,906 predicted segmentations from the leaf tracing algorithm. The vein_masks folder includes 8 ground truth segmentations used for training the vein growing algorithm. The vein_preds folder includes the 1,453 predicted segmentations from the vein growing algorithm. The vein_probs folder includes the 1,453 predicted probability maps from the vein growing algorithm before thresholding. The genomes folder includes the set of SNPs called against the v4 P. trichocarpa genome for 1,419 genotypes with a README file detailing the steps taken. The results folder includes: (i) raw values of the 68 predicted leaf traits in digital_traits.tsv, (ii) manually measured values of petiole length and width in manual_traits.tsv, (iii) thin plate spline (TPS) adjusted values of the vein density trait in vein_density_tps_adj.tsv, (iv) best linear unbiased prediction (BLUP) adjusted values of the vein density trait in vein_density_blups.tsv, and (v) GWAS results for the vein density trait, including chromosome positions and corresponding P values, in gwas_results.csv.

09 BIOMASS FUELS↗

Hydrologic Nuclide Transport Models in Cyder, A Geologic Disposal Software Library - 13328

Component level and system level abstraction of detailed computational geologic repository models have resulted in four rapid computational models of hydrologic radionuclide transport at varying levels of detail. Those models are described, as is their implementation in Cyder, a software library of interchangeable radionuclide transport models appropriate for representing natural and engineered barrier components of generic geology repository concepts. A proof of principle demonstration was also conducted in which these models were used to represent the natural and engineered barrier components of a repository concept in a reducing, homogenous, generic geology. This base case demonstrates integration of the Cyder open source library with the Cyclus computational fuel cycle systems analysis platform to facilitate calculation of repository performance metrics with respect to fuel cycle choices. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Design and physics basis for the upcoming DIII-D SAS-VW campaign to quantify tungsten leakage and transport in a new slot divertor geometry

A set of experiments are planned to exploit the high SOL collisionality enabled by a tightly baffled slot divertor geometry to suppress tungsten leakage in DIII-D. A toroidal row of graphite tiles from the Small Angle Slot (SAS) divertor is being coated with 10–15 μ m of tungsten. New spectroscopic viewing chords with in-vacuo optics will measure the W gross erosion source from the divertor surface with high spatial and temporal resolution. In parallel, the bottom of the SAS divertor is changed from a flat to a ‘V’ shape. New SOLPS-ITER/DIVIMP simulations conducted with drifts using the planned ‘V’ shape predict a substantial reduction in W sourcing and SOL accumulation in either B × ∇B direction relative to either the old SAS divertor shape or the open, lower divertor. Dedicated studies are planned to carefully characterize the level of W sourcing, leakage, and scrape-off-layer (SOL) accumulation in DIII-D over a wide range of plasma scenarios. Various actuators will be assessed for their efficacy in further reducing high-Z impurity sources and leakage from the slot divertor geometry. Finally, this coupled code-experiment validation effort will be used to stress-test physics models and build confidence in extrapolations to advanced, high-Z divertor geometries for next-step devices.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Continued Validation Studies using the MOOSE Framework for Plasma Simulation with Electromagnetics

Resources and tools for the modeling and simulation of low-temperature plasma (LTP) discharges are increasingly vital to progress in the field in order to properly characterize and study complex source designs and plasma chemistries beyond the scope of traditional diagnostics. Open-source software provides powerful platforms for this work and can enable community-driven LTP R&D. Within the Multiphysics Object-Oriented Simulation Environment (MOOSE) open-source framework [1], capabilities have been demonstrated in the areas of plasma fluids (Zapdos [2]), plasma chemistry (CRANE [3]), and general electromagnetic wave theory (Electromagnetic Library for Kinetics & fluids [ELK] [4]). ELK has since been coupled to Zapdos/CRANE to enable fully coupled electromagnetic plasma simulations. This talk will detail the continued validation efforts and discuss Zapdos-ELK-CRANE code coupling with various-low temperature plasma sources. The impact of fully coupled electromagnetics on process parameters (e.g., temperature and electron/ion energy) versus an electrostatic description will also be discussed. [1] Permann et al., SoftwareX, 11 (2020) 100430. [2] Lindsay et al., J. Phys. D: Appl. Phys. 49 (2016) 235204. [3] Keniley et al., Talk, GEC Session DT3.00002 (2019). [4] Icenhour et al., Talk, GEC Session RR1.00006 (2019). Acknowledgements: INL Graduate Fellowship Program, NSF SI2 Grant 1740300, U.S. Dept. of Energy Office of Science Graduate Student Research Program

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Laser beam coupling with capillary discharge plasma for laser wakefield acceleration applications

One of the most robust approaches, demonstrated to date, of accelerating electron beams by laser-plasma sources is the utilization of plasma channels generated by the capillary discharges. Although the spatial structure of the installation is simple in principle, there may be some important effects caused by the open ends of the capillary, by the supplying channels etc., which require a detailed 3D modeling of the processes. In the present work, such simulations are performed using the code MARPLE. First, the process of capillary filling with cold hydrogen before the discharge is fired, through the side supply channels is simulated. Second, the simulation of the capillary discharge is performed with the goal to obtain a time-dependent spatial distribution of the electron density near the open ends of the capillary as well as inside the capillary. Lastly, to evaluate the effectiveness of the beam coupling with the channeling plasma wave guide and of the electron acceleration, modeling of the laser-plasma interaction was performed with the code INF&RNO.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Theoretical framework for new magnetic materials for quantum computing and information storage. Final report for the Award No. DE-SC0018910

The focus of this grant was on molecular magnetic materials for information storage and quantum computing. We have been developing robust, first-principle methods for computing relevant electronic and magnetic properties of molecular building blocks (SMMs) of novel magnetic materials and quantum computers. These tools enable theoretical modeling of SMMs’ behavior, facilitating the interpretation of experimental studies and aiding the design of novel magnetic materials. Our strategy is based on the spin-flip (SF) approach, which extends the hierarchy of black-box single-reference methods to strongly correlated systems. Specifically, we developed general scalable algorithms and computer codes for calculating molecular properties, with an emphasis on spin-related properties, such as zero-field splittings, hyperfine couplings, and g-tensors. While our primary focus was on SF wave functions and SF-TDDFT, the underlying theory and computer codes were formulated using reduced density matrices, such that these tools are applicable to a broader class of methods. To extend the scope of applicability of wave-function-based SF methods to larger systems, we developed reduced-scaling approaches for the equation-of-motion coupled-cluster (EOM-CC) methods and continue developing libtensor (our open-source general tensor contraction library for many-body methods). We carried out extensive benchmarks and also carried out several applications.

36 MATERIALS SCIENCE↗

Enabling Catalog Simulations of Transient and Variable Sources Based on LSST Cadence Strategies

The American Astronomical Society. All rights reserved.. The Large Synoptic Survey Telescope (LSST) project will conduct a 10 year multi-band survey starting in 2022. Observing strategies for this survey are being actively investigated, and the science capabilities can be best forecasted on the basis of simulated strategies from the LSST Operations Simulator (OpSim). This paper describes the way in which OpSim simulates a stochastic realization of the sequence of LSST pointings over the survey duration, and is based on a model of the observatory (including telescope) and historical data of observational conditions. OpSim outputs contain a record of each simulated pointing of the survey along with a complete characterization of the pointing in terms of observing conditions, and some useful quantities derived from the characteristics of the pointing. Thus, each record can be efficiently used to derive the properties of observations of all astrophysical sources found in that pointing. However, in order to obtain the time series of observations (light curves) of a set of sources, it is often more convenient to compute all observations of an astrophysical source, and iterate over sources. In this document, we describe the open source python package OpSimSummary, which allows for a convenient reordering. The objectives of this package are to provide users with an Application Programming Interface for accessing all such observations and summarizing this information in the form of intermediate data products usable by third party software such as SNANA, thereby also bridging the gap between official LSST products and preexisting simulation codes.

79 ASTRONOMY AND ASTROPHYSICS↗

Calibrated Blade-Element/Momentum Theory Aerodynamic Model of the MARIN Stock Wind Turbine: Preprint

In this paper, a calibrated blade-element/momentum theory aerodynamic model of the MARIN stock wind turbine is developed and documented. The model is created using open-source software and calibrated to closely emulate experimental data obtained by the DeepCwind Consortium using a genetic algorithm optimization routine. The provided model will be useful for those interested in validating interested in validating floating wind turbine numerical simulators that rely on experiments utilizing the MARIN stock wind turbine—for example, the International Energy Agency Wind Task 30’s Offshore Code Comparison Collaboration Continued, with Correlation project.

17 WIND ENERGY↗

Preliminary Study on Fine-Grained Power and Energy Measurements on Grace Hopper GH200 with Open-Source Performance Tools

The increasing adoption of tightly integrated, heterogeneous architectures, combined with the slowdown of Moore’s law, has made application power and energy-driven optimizations critical to efficiently use high-performance computing systems. This paper introduces a newly developed open-source toolkit that seamlessly integrates the Linux real-time hardware monitoring program hwmon with the Performance Application Programming Interface and the Score-P performance measurement system, thereby enabling fine-grained power and energy measurements for high-performance computing applications. Our primary target platform is the Wombat test bed, which is a system based on the NVIDIA GH200 superchip. The toolkit can capture transient power peaks with high temporal resolution (50 ms) and, thanks to Score-P integration, can map power metrics to specific code regions, thereby providing actionable information on power-intensive operations and inefficiencies. The toolkit also provides a holistic view of both the power and the energy consumption of the entire GH200 superchip by covering all major components: the Grace CPU, the Hopper GPU, and the I/O subsystem. Experiments that use Locally Self-consistent Multiple Scattering, which is an application for first-principles calculations of materials developed at Oak Ridge National Laboratory, have demonstrated the tool’s ability to identify transient power spikes and uncover opportunities for energy-aware optimizations. Additionally, we introduce a Python-based utility for converting Open Trace Format 2 traces to Parquet format, thus enabling advanced data analysis for numerical integration methods applied to power data for accurate energy profiling.

Hernandez Mendoza, Oscar [ORNL] (ORCID:00000002538↗

OpenSHMEM Reference Implementation using UCCS-uGNI Transport Layer. In: PGAS '14 Proceedings of the 8th International Conference on Partitioned Global Address Space Programming Models, Article No. 18

OpenSHMEM is a library interface implementation and specification that enables the implementation of the Partitioned Global Address Space (PGAS) model. It exports modern RDMA network functionality and communication semantics to applications very efficiently. There are many closed source implementations of OpenSHMEM for modern RDMA interconnects such as InfiniBand and Cray's Gemini and Aries. Given the important role that Cray systems play in HPC, in this paper, we present an open source implementation of OpenSHMEM for Cray XE/XK/XC systems. To implement OpenSHMEM, we use the uGNI interface. uGNI is a generic interface that is designed for multiple programming models. The interface fits well the goal of UCCS. Having OpenSHMEM with UCCS-uGNI allows usage of the same implementation over multiple interconnects. This also translates into many advantages that come with common code such as resource sharing, increasing productivity because of less code maintenance, etc. Preliminary results show that OpenSHMEM-UCCS performs comparable to state-of-the-art Cray SHMEM for Put, Get, and AMO operations.

Janjusic, Tomislav↗