SEARCH · Engineering Papers

Results for “Performance benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Jas4pp — A data-analysis framework for physics and detector studies

This paper describes the Jas4pp framework for exploring physics cases and for detector-performance studies of future particle collision experiments. Jas4pp is a multi-platform Java program for numeric calculations, scientific visualization in 2D and 3D, storing data in various file formats and displaying collision events and detector geometries. It also includes complex data-analysis algorithms for function minimization, regression analysis, event reconstruction (such as jet reconstruction), limit settings and other libraries widely used in particle physics. The framework can be used with several scripting languages, such as Python/Jython, Groovy and JShell. Several benchmark tests discussed in the paper illustrate significant improvements in the performance of the Groovy and JShell scripting languages compared to the standard Python implementation in C. Furthermore, the improvements for numeric computations in Java are attributed to recent enhancements in the Java Virtual Machine.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Toward a Holistic Performance Evaluation of Large Language Models Across Diverse AI Accelerators

Artificial intelligence (AI) methods have become critical in scientific applications to help accelerate scientific discovery. Large language models (LLMs) are being considered a promising approach to address some challenging problems because of their superior generalization capabilities across domains. The effectiveness of the models and the accuracy of the applications are contingent upon their efficient execution on the underlying hardware infrastructure. Specialized Al accelerator hardware systems have recently become available for accelerating Al applications. However, the comparative performance of these AI accelerators on large language models has not been previously studied. In this paper, we systematically study LLMs on multiple AI accelerators and GPUs and evaluate their performance characteristics for these models. We evaluate these systems with (i) a micro-benchmark using a core transformer block, (ii) a GPT-2 model, and (iii) an 1,I,M-driven science use case, GenSLM. We present our findings and analyses of the models' performance to better understand the intrinsic capabilities of AI accelerators. Furthermore, our analysis takes into account key factors such as sequence lengths, scaling behavior, and sensitivity to gradient accumulation steps.

Emani, Murali↗

DOE OSTI2023

Multipole Expansion of Atomic Electron Density Fluctuation Interactions in the Density-Functional Tight-Binding Method

The accuracy of the density-functional tight-binding (DFTB) method in describing noncovalent interactions is limited due to its reliance on monopole-based spherical charge densities. In this study, we present a multipole-extended second-order DFTB (mDFTB2) method that takes into account atomic dipole and quadrupole interactions. Furthermore, we combine the multipole expansion with the monopole-based third-order contribution, resulting in the mDFTB3 method. To assess the accuracy of mDFTB2 and mDFTB3, we evaluate their performance in describing noncovalent interactions, proton transfer barriers, and dipole moments. Here, our benchmark results show promising improvements even when using the existing electronic parameters optimized for the original DFTB3 model. Both mDFTB2 and mDFTB3 outperform their monopole-based counterparts, DFTB2 and DFTB3, in terms of accuracy. While mDFTB2 and mDFTB3 perform comparably for neutral and positively charged systems, mDFTB3 exhibits superior performance over mDFTB2 when dealing with negatively charged systems and proton transfers. Overall, the incorporation of the multipole expansion significantly enhances the accuracy of the DFTB method in describing noncovalent interactions and proton transfers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

IRIS-DMEM: Efficient Memory Management for Heterogeneous Computing

This paper proposes an efficient data memory management approach for the Intelligent RuntIme System (IRIS) heterogeneous computing framework along with new data transfer policies. IRIS provides a task-based programming model for extreme heterogeneous computing (e.g., CPU, GPU, DSP, FPGA) with support for today's most important programming languages (e.g., OpenMP, OpenCL, CUDA, HIP, OpenACC). However, the IRIS framework either forces the programmer to introduce data transfer commands for each task or relies on suboptimal memory management for automatic and transparent data transfers. The work described here extends IRIS with novel heterogeneous memory handling and introduces novel data transfer policies by employing the Distributed data MEMory handler (DMEM) for efficient and optimal movement of data among the various computing resources. The proposed approach achieves performance gains of up to 7× for tiled LU factorization and tiled DGEMM (i.e., matrix multiplication) benchmarks. Moreover, this approach also reduces data transfers by up to 71% when compared to previous IRIS heterogeneous memory management handlers. This work compares the performance results of the IRIS framework's novel DMEM with the StarPU runtime and MAGMA math library for GPUs. Experiments show a performance gain of up to 1.95× over StarPU and 2.1× over MAGMA.

Miniskar, Narasinga Rao↗

DOE OSTI2024

CommBench: Micro-Benchmarking Hierarchical Networks with Multi-GPU, Multi-NIC Nodes

Modern high-performance computing systems have multiple GPUs and network interface cards (NICs) per node. The resulting network architectures have multilevel hierarchies of subnetworks with different interconnect and software technologies. These systems offer multiple vendor-provided communication capabilities and library implementations (IPC, MPI, NCCL, RCCL, OneCCL) with APIs providing varying levels of performance across the different levels. Understanding this performance is currently difficult because of the wide range of architectures and programming models (CUDA, HIP, OneAPI). We present CommBench, a library with cross-system portability and a high-level API that enables developers to easily build microbenchmarks relevant to their use cases and gain insight into the performance (bandwidth & latency) of multiple implementation libraries on different networks. We demonstrate CommBench with three sets of microbenchmarks that profile the performance of six systems. Our experimental results reveal the effect of multiple NICs on optimizing the bandwidth across nodes and also present the performance characteristics of four available communication libraries within and across nodes of NVIDIA, AMD, and Intel GPU networks.

Hidayetoglu, Mert↗

DOE OSTI2020

MELCOR 2.2 Benchmarks of Peach Bottom NUREG/CR 7155 Uncertainty Analysis

The U.S. Nuclear Regulatory Commission (NRC) performed a first-of-a-kind uncertainty analysis (UA) of the accident progression, radiological releases, and offsite consequences for the State-of- the-Art Reactor Consequence Analyses (SOARCA) of an unmitigated long-term station blackout (LTSBO) severe accident scenario at the Peach Bottom Atomic Power Station. The objective of the UA was to evaluate the robustness of the SOARCA deterministic "best estimate results and conclusions documented in NUREG-1935, and to develop insight into the overall sensitivity of the SOARCA results to uncertainty in key modeling inputs. The study was completed in 2015 and documented in NUREG/CR-7155. Since 2015, two other SOARCA UAs were completed for two pressurized water reactor (PWR) plants. The PWR UAs incrementally updated the approach and methodology, including using the latest release of the MELCOR 2.2 computer code. There were also advances made in the state-of-the-art modeling related to NRC efforts using the Peach Bottom model in NUREG-2206, which provided the technical basis for the containment protection and release reduction rulemaking for boiling water reactors with Mark I and Mark II containments. This report documents the input model changes from the NUREG/CR-7155 study and performs a small number of reference calculations to assess the changes of the new computer code and the model input updates. The objective of the work is to verify whether the updated Peach Bottom MELCOR model and updated version of MELCOR support the conclusions formed in the Peach Bottom SOARCA UA by performing these representative calculations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2025

Performance Evaluation of LPBF Manufactured 316H Components

This work represents the continuation of a benchmark study that includes modeling, fabrication and characterization as demonstration to support industry’s adoption of advanced manufacturing processes in a variety of structures. This comprehensive study investigated the feasibility of using additive manufacturing (AM) technologies, specifically Laser Powder Direct Energy Deposition (LP-DED) and Laser Powder Bed Fusion (LPBF), to produce complex nuclear microreactor components using 316H stainless steel. The research focused on manufacturing an expanded elbow pipe component with transitioning sections, which are traditionally difficult and costly to produce through conventional manufacturing methods. The overall study’s primary objectives are therefore demonstrating AM viability for nuclear applications, optimizing process parameters, developing comprehensive material characterization protocols, validating computational modeling approaches, and establishing manufacturing guidelines for complex geometries. Although the initial work included the phased approach of cubical, upscaled cylindrical components, it is to enable to obtain more knowledge for the printing of the expanded elbow structure. The project achieved significant progress in process development by successfully optimizing LP-DED parameters to achieve 99.16-99.97% relative density in 316H stainless steel components. Through systematic evaluation of sixteen cube samples with varied laser powers (400-700W) and scan speeds (600-900 mm/min), optimal processing windows were identified at 500-550W with 600-700 mm/min or 650-700W with 650-900 mm/min scan speeds. The DED manufactured 316H demonstrated mechanical properties comparable or superior to wrought materials, with Young's modulus ranging from 153-208 GPa and controlled microstructural characteristics including greater than 95% face-centered cubic (FCC) phases and engineered cellular structures with sizes between 3.23-6.17 µm.

36 MATERIALS SCIENCE↗

DOE OSTI2024

JACC: Leveraging HPC Meta-Programming and Performance Portability with the Just-in-Time and LLVM-based Julia Language

We present JACC (Julia for Accelerators), the first high-level, and performance-portable model for the just-in-time and LLVM-based Julia language. JACC provides a unified and lightweight front end across different back ends available in Julia, enabling the same Julia code to run efficiently on many HPC CPU and GPU targets. We evaluated the performance of JACC for common HPC kernels as well as for the most computationally demanding kernels used in applications, HPCCG, a supercomputing benchmark test for sparse domains, and HARVEY, a blood flow simulator to assist in the diagnosis and treatment of patients suffering from vascular diseases. We carried out the performance analysis on the most advanced US DOE supercomputers: Aurora, Frontier, and Perlmutter. Overall, we show that JACC has a negligible overhead versus vendor-specific solutions, reporting GPU speedups with no extra cost to programmability.

Valero-Lara, Pedro↗

DOE OSTI2025

DOE FAIR Surrogate Benchmarks Supporting AI and Simulation Research (SBI Surrogate Benchmark Initiative) (Final Report)

Computational Science is being revolutionized by integrating AI and simulation and, in particular, by deep learning surrogate models that can replace all or part of traditional large‐scale HPC computations. Such surrogates can achieve remarkable performance improvements, as much as several orders of magnitude, and save both compute time and energy. The Surrogate Benchmark Initiative (SBI) project creates a community repository and FAIR (Findable, Accessible, Interoperable, and Reusable) data ecosystem for HPC application surrogate benchmarks. The SBI team comes from Argonne National Laboratory (ANL), Indiana University (IU), Rutgers University, the University of Tennessee, Knoxville (UTK), and the University of Virginia(UVA). SBI repositories include data, code, and all relevant collateral artifacts, that the science and engineering community needs to use and reuse these data sets and surrogates. SBI repositories generate active research from both participants in SBI and the broader AI and domain science communities. This project develops surrogates that use several different neural nets to learn and quickly infer the results of simulations and data systems and capture them as surrogate benchmarks with a rich set of metadata, covering. Data; Model; Metrics specification; Machine specification; Science, Speed, Power Results, We research FAIR metadata for these benchmarks. We develop application surrogate examples as benchmarks across many fields (ANL, UTK, IU, UVA). We also study non Surrogate benchmarks that have many common features and similar issues regarding FAIRness. We work with MLCommons (UVA, UTK), which is a major machine learning benchmarking activity where we get metadata ontologies, software, and benchmarks, benchmarks have datasets, models, and metadata, and they need a technical framework developed by UTK and Rutgers and deployed by UVA. We study features of Surrogates, including performance, training set size, and uncertainty quantification (Rutgers, UVA and IU).

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

CephFS experiments on stria.sandia.gov

This report is an institutional record of experiments conducted to explore performance of a vendor installation of CephFS on the SNL stria cluster. Comparisons between CephFS, the Lustre parallel file system, and NFS were done using the IOR and MDTEST benchmarking tools, a test program which uses the SEACAS/Trilinos IOSS library, and the checkpointing activity performed by the LAMMPS molecular dynamics simulation.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2020

CephFS experiments on stria.sandia.gov

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Taming the fixed-node error in diffusion Monte Carlo via range separation

By combining density-functional theory (DFT) and wave function theory via the range separation (RS) of the interelectronic Coulomb operator, we obtain accurate fixed-node diffusion Monte Carlo (FN-DMC) energies with compact multi-determinant trial wave functions. In particular, we combine here short-range exchange-correlation functionals with a flavor of selected configuration interaction known as configuration interaction using a perturbative selection made iteratively (CIPSI), a scheme that we label RS-DFT-CIPSI. One of the take-home messages of the present study is that RS-DFT-CIPSI trial wave functions yield lower fixed-node energies with more compact multi-determinant expansions than CIPSI, especially for small basis sets. Indeed, as the CIPSI component of RS-DFT-CIPSI is relieved from describing the short-range part of the correlation hole around the electron-electron coalescence points, the number of determinants in the trial wave function required to reach a given accuracy is significantly reduced as compared to a conventional CIPSI calculation. Importantly, by performing various numerical experiments, we evidence that the RS-DFT scheme essentially plays the role of a simple Jastrow factor by mimicking short-range correlation effects, hence avoiding the burden of performing a stochastic optimization. Considering the 55 atomization energies of the Gaussian-1 benchmark set of molecules, we show that using a fixed value of mu = 0.5 bohr(-1) provides effective error cancellations as well as compact trial wave functions, making the present method a good candidate for the accurate description of large chemical systems.

Scemama, Anthony↗

DOE OSTI2024

Binder-Coated Carbon Cloth Electrodes for All-Vanadium Redox Flow Batteries

Vanadium redox flow batteries (VRFBs) are a promising solution for integrating intermittent renewable energy sources into the existing power grid. However, enhancing the electrochemical performance of VRFBs is critical for their widespread adoption in grid-scale energy storage. This study investigates the impact of adding a porous binder to a carbon-cloth electrode, with a focus on optimizing thermal activation conditions. The electrochemical performance of the binder-coated electrodes compared to uncoated electrodes is evaluated through electrochemical impedance spectroscopy, polarization curve measurements, and charge-discharge cycling. The surface morphology and structural integrity of the binder-coated electrodes at each activation stage are examined using various material characterization techniques to assess the effects of thermal activation. The results are benchmarked against the experiments using non-coated electrodes to determine the performance improvements offered by the binder coating. Notably, the study reveals that binder-coated electrodes exhibit significantly lower resistance and improved efficiency compared to their uncoated counterparts, with optimal activation conditions enhancing performance metrics crucial for VRFB applications. These findings provide valuable insights for further optimizing electrode design and activation strategies, advancing the development of more efficient VRFB systems for large-scale energy storage.

Caiado, Ashley A.↗

DOE OSTI2023

Invited Paper: Benchmarking and Optimizing Data Movement on Emerging Heterogeneous Architectures

As supercomputers evolve, nodes are continually increasing in complexity. As a result, each generation of parallel systems brings new performance challenges. For instance, on recent systems inter-node communication has outperformed inter-socket, resulting in poor performance of many node-aware communication optimizations. Communication optimizations are critical for the performance and scalability of parallel applications, but are dependent on the parallel architecture, which varies significantly among recent generations of supercomputers. Furthermore, this paper investigates the performance of various paths of data movement on recent generations of systems, and analyzes the increased complexity of communication, particularly on recent heterogeneous systems. The paper also introduces MPI Advance, a communication library that enables optimizations to be created based on benchmark analysis of each emerging system.

benchmarking↗

DOE OSTI2023

Extreme γ –Ray Radiation Tolerance of Spectrometer–Grade CsPbBr 3 Perovskite Detectors

The perovskite compound CsPbBr 3 has recently been discovered as a promising room-temperature semiconductor radiation detector, offering an inexpensive and easy-to-manufacture alternative to the current benchmark material Cd 1–x Zn x Te (CZT). The performance of CsPbBr 3 sensors is evaluated under harsh conditions, such as high radiation doses often found in industrial settings and extreme radiation in space. Results show minimal degradation in detector performance after exposure to 1 Mrad of Co-60 gamma radiation, with no significant change to energy resolution or hole mobility and lifetime. Additionally, many of the devices are still functional after being exposed to a 10 Mrad dose over 3 days, and those that do not survive can still be refabricated into working detectors. Notably, these results suggest that the failure mode in these devices is likely related to the interface between the electrode and material and their reaction, or the electrode itself and not the material itself. Overall, the study suggests that CsPbBr 3 has high potential as a reliable and efficient radiation detector in various applications, including those involving extreme fluxes and energies of gamma-ray radiation.

36 MATERIALS SCIENCE↗

DOE OSTI2024

A high-performance intermediate temperature reversible solid oxide cell with a new barrier layer free oxygen electrode

The best solution to address the critical durability issue of solid oxide electrolytic cells (SOECs) for high-efficiency and high-rate H 2 production is to lower the operating temperature without sacrificing the performance. Developing high performance oxygen electrodes (OEs) is a key to capitalizing this solution. Here, in this paper, we report on a highly active OE for intermediate temperature ZrO 2 -based SOECs without a CeO 2 barrier layer. The new barrier-layer-free (BLF) OE is a composite of two materials, (Bi 0.75 Y 0.25 ) 0.93 Ce 0.07 O 1.5±δ (BYC) that exhibits high oxide-ion conductivity and La 0.8 Sr 0.2 MnO 3 (LSM) that possesses a high electronic conductivity to enable fast oxygen reduction/evolution reactions (ORR/OER). Featuring a microscale porous BYC scaffold decorated with high surface area LSM nanoparticles (NPs), the new BLF-OE exhibited a low area specific resistance (ASR) of 0.10 Ω cm 2 at 650 °C in air. With 50%H 2 -50%H 2 O as a feed to hydrogen electrode (HE) and air to OE, the single cell performance achieved 588 mA cm -2 at 0.80 V in the fuel cell mode and 688 mA cm -2 at 1.30 V in the electrolytic mode at 650 °C. Our in-house testing showed that this level of performance was ~3.5x higher than the cell with the benchmark La 0.6 Sr 0.4 Co 0.2 Fe 0.8 O 3-δ -Ce 0.9 Gd 0.1 O 2-δ OE. The long-term durability testing under alternating fuel cell and electrolytic modes showed a low degradation rate of 0.10 mA cm -2 h -1 over 550 hours. These encouraging results showed the great promise of the newly developed BYC-LSM to be an excellent OE candidate for intermediate temperature SOECs.

25 ENERGY STORAGE↗

DOE OSTI2025

Implementation of a Mesh refinement algorithm into the quasi-static PIC code QuickPIC

Plasma-based acceleration (PBA) has emerged as a promising candidate for the accelerator technology used to build a future linear collider and/or an advanced light source. In PBA, a trailing or witness particle beam is accelerated in the plasma wave wakefield (WF) created by a laser or particle beam driver. The WF is often nonlinear and involves the crossing of plasma particle trajectories in real space and thus particle-in-cell methods are used. The distance over which the drive beam evolves is several orders of magnitude larger than the wake wavelength. This large disparity in length scales is amenable to the quasi-static approach. Three-dimensional (3D), quasi-static (QS), particle-in-cell (PIC) codes, e.g., QuickPIC, have been shown to provide high fidelity simulation capability with 2-4 orders of magnitude speedup over 3D fully explicit PIC codes. In PBA, the witness beam needs to be matched to the focusing forces of the WF to reduce the emittance growth. In some linear collider designs, the matched spot size of the witness beam can be 2 to 3 orders of magnitude smaller than the spot size (and wavelength) of the wakefield. Such an additional disparity in length scales is ideal for mesh refinement where the WF within the witness beam is described on a finer mesh than the rest of the WF. A mesh refinement scheme is described that has been implemented into the 3D QS PIC code, QuickPIC. Very fine (high) resolution is used in a small spatial region that includes the witness beam and progressively coarser resolutions in the rest of the simulation domain. A fast multigrid Poisson solver has been implemented for the field solve on the refined meshes and a Fast Fourier Transform (FFT) based Poisson solver is used for the coarse mesh. The code has been parallelized with both MPI and OpenMP, and the parallel scalability has also been improved by using pipelining. A preliminary adaptive mesh refinement technique is described to optimize the computational time for simulations with an evolving witness beam size. Several test problems are used to verify that the mesh refinement algorithm provides accurate results. Additionally, the results are benchmarked against highly resolved simulations exhibiting near-azimuthal symmetry, performed using QPAD—a novel hybrid QS PIC code that uses a PIC description in the coordinates (r, ct – z) and a gridless description in the azimuthal angle, Φ.

Linear collider↗

DOE OSTI2021

Probabilistic Deep Learning Approach to Automate the Interpretation of Multi-phase Diffraction Spectra

Autonomous synthesis and characterization of inorganic materials requires the automatic and accurate analysis of X-ray diffraction spectra. For this task, we designed a probabilistic deep learning algorithm to identify complex multi-phase mixtures. At the core of this algorithm lies an ensemble convolutional neural network trained on simulated diffraction spectra, which are systematically augmented with physics-informed perturbations to account for artifacts that can arise during experimental sample preparation and synthesis. In this work, larger perturbations associated with off-stoichiometry are also captured by supplementing the training set with hypothetical solid solutions. Spectra containing mixtures of materials are analyzed with a newly developed branching algorithm that utilizes the probabilistic nature of the neural network to explore suspected mixtures and identify the set of phases that maximize confidence in the prediction. Our model is benchmarked on simulated and experimentally measured diffraction spectra, showing exceptional performance with accuracies exceeding those given by previously reported methods based on profile matching and deep learning. We envision that the algorithm presented here may be integrated in experimental workflows to facilitate the high-throughput and autonomous discovery of inorganic materials.

36 MATERIALS SCIENCE↗