Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “application benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

Improving large-scale storage system performance via topology-aware and balanced data placement

With the advent of big data, the I/O subsystems of large-scale compute clusters are becoming a center of focus. More applications are putting greater demands on end-to-end I/O performance. These subsystems are often complex in design. They comprise of multiple hardware and software layers to cope with the increasing capacity, capability, and scalability requirements of data intensive applications. However, the sharing nature of storage resources and the intrinsic interactions across these layers make it a great challenge to realize end-to-end performance gains. This paper proposes a topology-aware strategy to balance the load across resources, to improve the per-application I/O performance. We demonstrate the effectiveness of our algorithm on an extreme-scale compute cluster, Titan, at the Oak Ridge Leadership Computing Facility (OLCF). Our experiments with both synthetic benchmarks and a real-world application show that, even under congestion, our proposed algorithm can improve large-scale application I/O performance significantly, resulting in both a reduction in application run time as well as a higher resolution of simulation run.

Wang, Feiyi↗
DOE OSTI2014

Improving Large-scale Storage System Performance via Topology-aware and Balanced Data Placement

With the advent of big data, the I/O subsystems of large-scale compute clusters are becoming a center of focus, with more applications putting greater demands on end-to-end I/O performance. These subsystems are often complex in design. They comprise of multiple hardware and software layers to cope with the increasing capacity, capability and scalability requirements of data intensive applications. The sharing nature of storage resources and the intrinsic interactions across these layers make it to realize user-level, end-to-end performance gains a great challenge. We propose a topology-aware resource load balancing strategy to improve per-application I/O performance. We demonstrate the effectiveness of our algorithm on an extreme-scale compute cluster, Titan, at the Oak Ridge Leadership Computing Facility (OLCF). Our experiments with both synthetic benchmarks and a real-world application show that, even under congestion, our proposed algorithm can improve large-scale application I/O performance significantly, resulting in both the reduction of application run times and higher resolution simulation runs.

Wang, Feiyi↗
DOE OSTI2018

Validation of nuclear data based on the ASPIS experiments from the SINBAD database - 25428

SINBAD, the Shielding Integral Benchmark Archive and Database, includes the experimental data relative to integral benchmark experiments relevant for radiation shielding applications. The ASPIS experiments, included in the Reactor Shielding section of SINBAD, provide neutron activation foils and spectra measurements performed before/between shielding slabs of Graphite, Sodium, Iron, Steels, Water and combinations of them. Benchmark models for the measurement simulations with the MCNP code are usually provided in SINBAD. Nonetheless, a user-friendly tool is presented, which would be useful for an independent production of MCNP benchmark models. It is based on GPL C++ code called CombLayer. The reports issued for SINBAD on the quality assessment of the ASPIS experiments are also described. The discussion on the quality of the ASPIS experiments for their use in nuclear data evaluations had a positive outcome, except for two experiments out of ten. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2019

PASTA: A Parallel Sparse Tensor Algorithm Benchmark Suite

Tensor methods have gained increasingly attention from various applications, including machine learning, quantum chemistry, healthcare analytics, social network analysis, data mining, and signal processing, to name a few. Sparse tensors and their algorithms become critical to further improve the performance of these methods and enhance the interpretability of their output. This work presents a sparse tensor algorithm benchmark suite (PASTA) for single- and multi-core CPUs. To the best of our knowledge, this is the first benchmark suite for sparse tensor world. PASTA targets on: 1) helping application users to evaluate different computer systems using its representative computational workloads; 2) providing insights to better utilize existed computer architecture and systems and inspiration for the future design. This benchmark suite will be publicly released.

HPC, sparse tensor, benchmark↗
DOE OSTI2024

h5bench: A unified benchmark suite for evaluating HDF5 I/O performance on pre‐exascale platforms

Summary Parallel I/O is a critical technique for moving data between compute and storage subsystems of supercomputers. With massive amounts of data produced or consumed by compute nodes, high‐performant parallel I/O is essential. I/O benchmarks play an important role in this process; however, there is a scarcity of I/O benchmarks representative of current workloads on HPC systems. Toward creating representative I/O kernels from real‐world applications, we have created h5bench , a set of I/O kernels that exercise hierarchical data format version 5 (HDF5) I/O on parallel file systems in numerous dimensions. Our focus on HDF5 is due to the parallel I/O library's heavy usage in various scientific applications running on supercomputing systems. The various tests benchmarked in the h5bench suite include I/O operations (read and write), data locality (arrays of basic data types and arrays of structures), array dimensionality (one‐dimensional arrays, two‐dimensional meshes, three‐dimensional cubes), I/O modes (synchronous and asynchronous). In this paper, we present the observed performance of h5bench executed along several of these dimensions on existing supercomputers (Cori and Summit) and pre‐exascale platforms (Perlmutter, Theta, and Polaris). h5bench measurements can be used to identify performance bottlenecks and their root causes and evaluate I/O optimizations. As the I/O patterns of h5bench are diverse and capture the I/O behaviors of various HPC applications, this study will be helpful to the broader supercomputing and I/O community.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Sensitivity/Uncertainty Comparison Study Involving IRSN, LANL, and ORNL Tools to Support Validation

Under a DOE Nuclear Criticality Safety Program (NCSP) task involving Analytical Methods, three Laboratories collaborated in a comparison of results obtained from Sensitivity/Uncertainty (S/U) packages relevant to validation of transport codes. The task involves Institut de Radioprotection et de Sûreté Nucléaire (IRSN), Los Alamos National Laboratory (LANL), and Oak Ridge National Laboratory (ORNL) comparing results of MORET 5/MACSENS V3.0, MCNP6.2/Whisper-1.1, and SCALE 6.2.3/TSUNAMI/USLSTATS respectively. All Monte Carlo transport code results utilize nuclear data from ENDF/B-VII.1 evaluation. This study examines five cases from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) selected as application models: IEU-MET- FAST-002-001, LEU-COMP-THERM-001-001, LEU-SOL-THERM-004-001, MIX-COMP- THERM-001-001, and U233-SOL-THERM-001-001. This is a continuation of a previous study to examine Pu and HEU cases: HEU-MET-FAST-013-001, HEU-SOL-THERM-001-008, PU-MET- FAST-022-001, and PU-SOL-THERM-001-001. Ultimately, comparison is made between Upper Subcritical Limits (USLs) obtained using each code package for each application case. Since differences exist in whether packages take into account margin of subcriticality (MOS), the USL is computed using only bias and bias uncertainty, also known as the calculational margin (CM) in ANSI/ANS-8.24. Results comparison appears to show that benchmark selection has a greater influence on the USL than the method used for calculation of bias and bias uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Characterizing Output Bottlenecks of a Production Supercomputer: Analysis and Implications

This article studies the I/O write behaviors of the Titan supercomputer and its Lustre parallel file stores under production load. The results can inform the design, deployment, and configuration of file systems along with the design of I/O software in the application, operating system, and adaptive I/O libraries.We propose a statistical benchmarking methodology to measure write performance across I/O configurations, hardware settings, and system conditions. Moreover, we introduce two relative measures to quantify the write-performance behaviors of hardware components under production load. In addition to designing experiments and benchmarking on Titan, we verify the experimental results on one real application and one real application I/O kernel, XGC and HACC IO, respectively. These two are representative and widely used to address the typical I/O behaviors of applications.In summary, we find that Titan’s I/O system is variable across the machine at fine time scales. This variability has two major implications. First, stragglers lessen the benefit of coupled I/O parallelism (striping). Peak median output bandwidths are obtained with parallel writes to many independent files, with no striping or write sharing of files across clients (compute nodes). I/O parallelism is most effective when the application—or its I/O libraries—distributes the I/O load so that each target stores files for multiple clients and each client writes files on multiple targets in a balanced way with minimal contention. Second, our results suggest that the potential benefit of dynamic adaptation is limited. In particular, it is not fruitful to attempt to identify “good locations” in the machine or in the file system: component performance is driven by transient load conditions and past performance is not a useful predictor of future performance. For example, we do not observe diurnal load patterns that are predictable.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Computational fluid dynamic analysis of a novel particle-to-air fluidized-bed heat exchanger for particle-based thermal energy storage applications

Long-duration energy storage technologies are being targeted to enable cost-effective, decarbonized energy systems. Particle-based thermal energy storage systems are one promising technology by storing excess electricity or heat as sensible thermal energy in inexpensive, solid, inert particles. These systems are only possible if an effective and economical particle-to-working fluid heat exchanger exists. This study predicts the performance of a proposed, direct-contact, particle-to-air, pressurized fluidized-bed heat exchanger using computational fluid dynamics. The common Eulerian-Eulerian framework for modeling fluidized beds is first benchmarked to experimental results at a previously untested operating condition and application. Then, the benchmarked model evaluates the performance of a proposed design for a commercial-scale version of the novel particle-to-air heat exchanger. The results show pressure drop and gas-phase approach temperatures are advantageous compared to other proposed designs for particle-to-air heat exchangers in the literature; approach temperatures were less than 5 °C and gas-phase pressure drop across the fluidized bed was 32 kPa. The model also highlights the importance of gas distributor design and representation in the Eulerian-Eulerian framework to control fluidization behavior. In conclusion, the model built and benchmarked in this study can be leveraged to advance the design and analysis of these heat exchangers critical to the deployment of a promising long-duration energy storage technology.

25 ENERGY STORAGE↗
DOE OSTI2022

Studsvik R2 materials test reactor Ad Hoc depletion strategy for the derivation of the fuel isotopic composition of the MPCMIV benchmark

The Ad Hoc Depletion Strategy elaborated by the NINE company, developed in support of the organization of the MPCMIV (Multi-physics Pellet Cladding Mechanical Interaction Validation) benchmark input and output specifications, is presented. This work aims at illustrating the strategy itself and then showing the results obtained with its application over the Studsvik R2 Testing Reactor, which is analyzed in the benchmark. The objective of the application of the strategy is to compute the fuel elements isotopic compositions at the beginning of some core loadings of interest for the benchmark. To this objective, it is necessary to implement first the simulation model of the three single assembly types and perform the infinite lattice depletions, then, to build the full core model and to perform the simulation of the core cycle. All the models and simulations were carried out with the use of the Monte Carlo particle transport code Serpent 2. Finally, the simulations results are assessed against Studsvik isotopic compositions of the fuel elements discharged from the R2 Reactor at the end of the core loading. Several assumptions were necessary during all the steps of the strategy, to overcome the lack of information regarding the core management. For this reason, the solution found at the end of the current analysis may not be completely optimized and further improvements regarding the model assumptions will be tested in a future work. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS2002

Performance and Scalability of the NAS Parallel Benchmarks in Java

Several features make Java an attractive choice for scientific applications. In order to gauge the applicability of Java to Computational Fluid Dynamics (CFD), we have implemented the NAS (NASA Advanced Supercomputing) Parallel Benchmarks in Java. The performance and scalability of the benchmarks point out the areas where improvement in Java compiler technology and in Java thread implementation would position Java closer to Fortran in the competition for scientific applications.

Frumkin, Michael A.↗
DOE OSTI2021

Scaled boundary cubature scheme for numerical integration over planar regions with affine and curved boundaries

This paper introduces the scaled boundary cubature (SBC) scheme for accurate and efficient integration of functions over polygons and two-dimensional regions bounded by parametric curves. Over two-dimensional domains, the SBC method reduces integration over a region bounded by m curves to integration over m regions (referred to as curved triangular regions), where each region is bounded by two line segments and a curve. With proper (counterclockwise) orientation of the boundary curves, the scheme is applicable to convex and nonconvex domains. Additionally, for star-convex domains, a tensor-product cubature rule with positive weights and integration points in the interior of the domain is obtained. If the integrand is homogeneous, we show that this new method reduces to the homogeneous numerical integration scheme; however, the SBC scheme is more versatile since it is equally applicable to both homogeneous and non-homogeneous functions. This paper also introduces several methods for smoothing integrands with point singularities and near-singularities. When these methods are used, highly efficient integration of weakly singular functions is realized. Finally, the SBC method is applied to a number of benchmark problems, which reveal its broad applicability and superior performance (in terms of time to generate a rule and accuracy per cubature point) when compared to existing methods for integration.

42 ENGINEERING↗
DOE OSTI2025

Effect of Plutonium on Uranium Oxide Microstructural Fingerprint

The analysis of particulates from environmental sampling is routinely performed for nuclear forensics applications. In order to increase the tools available for nuclear forensics applications, capability development materials (CDMs), or reference particulates, are necessary for developing and benchmarking new analytical methods. Historically, these CDM particulates have been produced with highly controlled and characterized isotopic and size parameters for applications in developing and benchmarking particle sizers and mass spectrometry analytical methods [1- 4]. However, the development of CDMs with highly characterized particle morphology and phase of the particles is vital for aiding in the development and benchmarking of particle analytical methods for those parameters. In many cases, key properties such as crystallographic phase, morphology, and microstructure, may be correlated to processing history of environmental sampling particulates [5]. To that end, this work investigates determining the structural fingerprint of produced Pu-doped uranium oxide CDMs using transmission electron microscopy (TEM). The particulates, one of which shown in Figure 1, were synthesized to Fig. 1. Single particulate of uranium oxide fabricated using the THESEUS technique. develop capabilities for environmental sampling investigations. These particles are monodisperse at diameter of 1 μm and a range of plutonium concentrations from 0- 1,000 ppm. Given their small diameter, TEM analysis was ideal for studying the particulate structural fingerprint in detail. Previous investigations confirmed the external homogeneity of the particulates at different plutonium concentrations, however this analysis focuses on determining the grain structure, phase distribution, and porosity of the particulates.

Mayer, Jack [Univ. of Florida, Gainesville, FL (Un↗
NASA NTRS1987

MPF: A portable message passing facility for shared memory multiprocessors

The design, implementation, and performance evaluation of a message passing facility (MPF) for shared memory multiprocessors are presented. The MPF is based on a message passing model conceptually similar to conversations. Participants (parallel processors) can enter or leave a conversation at any time. The message passing primitives for this model are implemented as a portable library of C function calls. The MPF is currently operational on a Sequent Balance 21000, and several parallel applications were developed and tested. Several simple benchmark programs are presented to establish interprocess communication performance for common patterns of interprocess communication. Finally, performance figures are presented for two parallel applications, linear systems solution, and iterative solution of partial differential equations.

Malony, Allen D.↗
DOE OSTI2023

Theoretical framework for new magnetic materials for quantum computing and information storage. Final report for the Award No. DE-SC0018910

The focus of this grant was on molecular magnetic materials for information storage and quantum computing. We have been developing robust, first-principle methods for computing relevant electronic and magnetic properties of molecular building blocks (SMMs) of novel magnetic materials and quantum computers. These tools enable theoretical modeling of SMMs’ behavior, facilitating the interpretation of experimental studies and aiding the design of novel magnetic materials. Our strategy is based on the spin-flip (SF) approach, which extends the hierarchy of black-box single-reference methods to strongly correlated systems. Specifically, we developed general scalable algorithms and computer codes for calculating molecular properties, with an emphasis on spin-related properties, such as zero-field splittings, hyperfine couplings, and g-tensors. While our primary focus was on SF wave functions and SF-TDDFT, the underlying theory and computer codes were formulated using reduced density matrices, such that these tools are applicable to a broader class of methods. To extend the scope of applicability of wave-function-based SF methods to larger systems, we developed reduced-scaling approaches for the equation-of-motion coupled-cluster (EOM-CC) methods and continue developing libtensor (our open-source general tensor contraction library for many-body methods). We carried out extensive benchmarks and also carried out several applications.

36 MATERIALS SCIENCE↗
DOE OSTI2016

Technical Report: Benchmarking for Quasispecies Abundance Inference with Confidence Intervals from Metagenomic Sequence Data

The software application “MetaQuant” was developed by our group at Lawrence Livermore National Laboratory (LLNL). It is designed to profile microbial populations in a sample using data from whole-genome shotgun (WGS) metagenomic DNA sequencing. Several other metagenomic profiling applications have been described in the literature. We ran a series of benchmark tests to compare the performance of MetaQuant against that of a few existing profiling tools, using real and simulated sequence datasets. This report describes our benchmarking procedure and results.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2016

Prediction on Underestimation of Statistical Uncertainty in Monte Carlo Eigenvalue Calculation for Two-dimensional Heterogeneous Color Set Geometry

In a Monte Carlo calculation, statistical uncertainty is inevitably included in the result. The statistical uncertainty is commonly estimated by the central limit theorem without considering correlation among generations. The statistical uncertainty is usually expected to decrease at the inverse square root of the number of neutron histories. However, in a Monte Carlo eigenvalue calculation in a large geometry whose dominance ratio is close to unity, the central limit theorem would not be valid and thus the statistical uncertainty of fission source distribution can be significantly underestimated when inter-cycle correlation is not appropriately taken into account. The true statistical uncertainty can be calculated by statistical processing of the results obtained by multiple Monte Carlo runs using different initial random seeds, but this approach has a drawback of large calculation cost. Therefore, prediction of true statistical uncertainty by alternate approach is desirable. One of the solutions for this issue is an evaluation method of statistical uncertainty based on the eigenfunction expansion and the Autoregressive model (AR model). In this method, the true statistical uncertainty is theoretically derived by applying the AR model to behavior of expansion coefficients of eigenfunction in fission source distribution during cycles. Underestimation ratio of statistical uncertainty of fission source distribution can be predicted by this method. Note that the underestimation ratio of statistical uncertainty is defined by the ratio of estimated error by a Monte Carlo calculation to the true statistical error. In the previous study, the proposed method was verified in a simple condition such as one energy group, one dimensional homogeneous slab geometry. Contributions of this summary are as follows. Firstly, expression of the noise term that is appeared in the AR model is theoretically derived. Secondly, prediction on underestimation ratio of statistical uncertainty is carried out in a more general case, i.e., flux of each fuel cell in 2 x 2 heterogeneous assembly geometry taken from the C5G7 benchmark problem. Through the present study, applicability of the theoretical prediction for underestimation of statistical uncertainty in practical problems will be verified. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2015

YARNsim: Simulating Hadoop YARN

Despite the popularity of the Apache Hadoop system, its success has been limited by issues such as single points of failure, centralized job/task management, and lack of support for programming models other than MapReduce. The next generation of Hadoop, Apache Hadoop YARN, is designed to address these issues. In this paper, we propose YARNsim, a simulation system for Hadoop YARN. YARNsim is based on parallel discrete event simulation and provides protocol-level accuracy in simulating key components of YARN. YARNsim provides a virtual platform on which system architects can evaluate the design and implementation of Hadoop YARN systems. Also, application developers can tune job performance and understand the tradeoffs between different configurations, and Hadoop YARN system vendors can evaluate system efficiency under limited budgets. To demonstrate the validity of YARNsim, we use it to model two real systems and compare the experimental results from YARNsim and the real systems. The experiments include standard Hadoop benchmarks, synthetic workloads, and a bioinformatics application. The results show that the error rate is within 10% for the majority of test cases. The experiments prove that YARNsim can provide what-if analysis for system designers in a timely manner and at minimal cost compared with testing and evaluating on a real system.

Hadoop↗
DOE OSTI2020

Griffin/Pronghorn PBMR-400 Benchmark Results [Slides]

Content Overview: 1) Pronghorn & Griffin, MOOSE based applications overview: Codes capabilities description & MOOSE ecosystem overiew; Current research activities and synergies with other projects; Different multiphysics coupling scheme description. 2) PBMR-400 Benchmark: OECD NEA Benchmark and Pronghorn/Griffin models description; Standalone NK Ex1 and TH Ex2 Results description; Coupled Steady state Ex3; Results analysis for Transiet Ex4a (100-40-100 Load Following) & Ex3 (Protected PLOFC). 3) Conclusions $ Future steps.

97 MATHEMATICS AND COMPUTING↗