Benchmarking MapReduce Implementations for Application Usage Scenarios
Explore the source record for details and available documents.
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “application benchmarks”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Practical Design and Benchmarking Considerations for Neuromorphic Applications.
Abstract not provided.
Hill, Aaron Jamison↗
SPEChpc 2021 Benchmark Suites for Modern HPC Systems
The SPEChpc 2021 suites are application-based benchmarks de- signed to measure performance of modern HPC systems. The bench- marks support MPI, MPI+OpenMP, MPI+OpenMP target offload, MPI+OpenACC and are portable across all major HPC platforms.
Boehm, Swen↗
Performance Efficiency and Effectivness of Supercomputers
Our first purpose here is to offer to a general technical and policy audience a perspective on whether the supercomputing community should focus on improving the efficiency of supercomputing systems and their use rather than on building larger and ostensibly more capable systems that are used at low efficiency. After first summarizing our content and defining some necessary terms, we give a concise answer to this question. We then set this in context by characterizing performance of current supercomputing systems on a variety of benchmark problems and actual problems drawn from workloads in the national security, industrial, and scientific context. Along the way we answer some related questions, identify some important technological trends, and offer a perspective on the significance of these trends. Our second purpose is to give a reasonably broad and transparent overview of the related issue space and thereby to better equip the reader to evaluate commentary and controversy concerning supercomputing performance. For example, questions repeatedly arise concerning the Linpack benchmark and its predictive power, so we consider this in moderate depth as an example. We also characterize benchmark and application performance for scientific and engineering use of supercomputers and offer some guidance on how to think about these. Examples here are drawn from traditional scientific computing. Other problem domains, for example, data analytics, have different performance characteristics that are better captured by different benchmark problems or applications, but the story in those domains is similar in character and leads to similar conclusions with regard to the motivating question.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Scalar quantum field theories as a benchmark for near-term quantum computers
Quantum field theory (QFT) simulations are a potentially important application for noisy intermediate scale quantum (NISQ) computers. The ability of a quantum computer to emulate a QFT therefore constitutes a natural application-centric benchmark. Foundational quantum algorithms to simulate QFT processes rely on fault-tolerant computational resources, but to be useful on NISQ machines, error-resilient algorithms are required. Here we outline and implement a hybrid algorithm to calculate the lowest energy levels of the paradigmatic 1+1–dimensional $\phi$ 4 interacting scalar QFT. We calculate energy splittings and compare results with experimental values obtained on currently available quantum hardware. We show that the accuracy of mass-renormalization calculations represents a useful metric with which near-term hardware may be benchmarked. Finally, we also discuss the prospects of scaling the algorithm to full simulation of interacting QFTs on future hardware.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
A Proposed Path Forward for Transportation of High-Assay Low-Enriched Uranium
Many of the advanced reactors that are being designed will use high-assay low-enriched uranium (HALEU) as the reactor fuel. HALEU is fuel that is enriched between 5% – 20% uranium-235. With the change to higher enriched material, the industry will have new challenges with the development and regulatory approval of enrichment and fuel fabrication facilities and suitable transportation packages to support the economic use of HALEU materials. One area of concern relates to ensure sub-criticality of the material during transportation as identified by the Nuclear Energy Institute (NEI). To evaluate the relevant work, experts, and industry perspectives on HALEU, a workshop was organized to share relevant experience and insights into HALEU transportation, handling, and management. At the August 30 and 31, 2018 workshop, NEI and industry provided the following recommendations to DOE and the national lab complex. 1. DOE and the lab complex should communicate and educate the Nuclear Regulatory Commission (NRC) on criticality issues related to HALEU. 2. Idaho National Laboratory (INL) should support work needed to certify package design for the transportation of HALEU. a. Suggest amending the Certificate of Compliance of an existing package used for the shipment of commercial quantities. b. Suggest DOE provide funding to package designer(s) for analysis and engineering work for a package to be submitted to NRC for approval. 3. INL should provide specific, or a range, of the expected impurities that will be present in recycled naval fuel. 4. In the longer term, DOE and the lab complex should increase the availability of criticality benchmark data to further reduce conservatism in package design. In addition, a couple key takeaways were identified, including: 1. Although the labs can provide additional criticality experiments, industry has enough data to license facilities, overpacks, and cylinders. Validation from additional critical experiments to establish less uncertainty in the benchmarks will be helpful. 2. A collective effort from industry is needed to express consistency on how much information exists or is needed related to criticality. Based on interactions with industry, DOE, and national laboratories, it appears that large-volume transportation of fresh HALEU appears feasible from a criticality perspective. Specifically, an initial review of applicable criticality benchmark experiments identified numerous applicable experiments. However, a more thorough review of a realistic transportation package design is suggested. Therefore, the following next steps are proposed: 1. Evaluate a large volume package with uranium dioxide enriched to 20%. Specifically, the GNF-A NPC package was proposed as a potentially viable option. 2. Based on the results of (1), determine if additional package designs and fuel material should be evaluated. 3. Based on the results of (1), determine if additional criticality experiments would be beneficial to improve the margins for criticality due to uncertainties. 4. Determine DOE transportation needs (packages sizes, shielding requirements, handling/operational requirements, and timing of availability) related to HALEU. 5. Continue to interface with NEI and interested industry companies to determine the appropriate time to engage the NRC.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Investigating Similarity Differences for Light-Water-Moderated and Polyethylene-Moderated Systems [Slides]
Validation efforts revealed noticeable differences in c k for light-water and polyethylene moderated systems when compared to experimental systems. Although 1 H-H 2 O and 1 H-poly use some of the same cross section and identical covariance data, the treatment of TSLs in SCALE lead to no contribution to c k between polyethylene application and benchmark experiment. When H 2 O contribution is removed the difference in c k appears to come from 239 Pu chi. Sensitivity profiles and data-induced uncertainty confirm that the polyethylene application more closely resembles the benchmark experiment. Interrogation techniques were used to observe how TSLs and nuclide IDs affect c k . Specific differences between similar systems can be accounted for and examined to help understand differences in similarity (c k ) between systems
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
PaRSEC: Scalability, flexibility, and hybrid architecture support for task-based applications in ECP
This paper highlights the most significant enhancements made to PaRSEC, a scalable task-based runtime system designed for hybrid machines, during the Exascale Computing Project (ECP). The enhancements focus on expanding the capabilities of PaRSEC to address the evolving landscape of parallel computing. Notable achievements include the integration of support for three major types of accelerators (NVIDIA, AMD, and Intel GPUs), the refinement and increased flexibility of the communication subsystem, and the introduction of new programming interfaces tailored for irregular applications. Additionally, the project resulted in the development of powerful debugging and performance analysis tools aimed at assisting users in understanding and optimizing their applications. We present a comprehensive demonstration of these advancements through a series of benchmarks and applications within ECP and beyond, thereby showcasing the enhanced capabilities of PaRSEC across the diverse architectures within the ECP, providing valuable insights into the runtime system’s adaptability and performance across varied computing environments.
Bouteiller, Aurelien↗
Understanding the Impact of Dynamic Power Capping on Application Progress
Electrical power has become an important design constraint in high-performance computing (HPC) systems. On future HPC machines, power is likely to be a budgeted resource and thus managed dynamically. Power management software needs to reliably measure application performance at runtime in order to respond effectively to changes in application behavior. Execution time tells us little about how the science in the application is progressing toward an application-defined end goal. To the best of our knowledge, no study has defined or categorized online application progress in the context of power management. Based on semi-structured interviews with HPC application-specialists, we define an online notion of progress—an application-specific metric that can be monitored at runtime to provide a sense of the rate at which application science is being performed. Using instrumentation, we characterize and categorize the progress of various production scientific applications and benchmarks. We propose a model of the impact of dynamic power capping on application progress. By experimental evaluation, we show that our model accurately captures the general behavior of the progress of different classes of applications under a power cap. We believe that such a model is an important first step toward the design of more dynamic power management policies for HPC systems.
application progress↗
Sensitivity Studies, Gap Analysis, and Benchmark Experiment Optimization for Reactor Applications
In regards to nuclear data, some reactor applications may lack validation experiments, which reduces confidence in predicted results. This is especially true for emerging advanced reactor, micro reactor, and Accelerator Driven System (ADS) designs. This work presents an approach to design new criticality experiments that have similar k eff cross section sensitivities to an application of interest. This process involves simulations to generate cross-section sensitivities to a parameter of interest (such as k eff ), a gap analysis to determine which existing benchmarks are most similar to the application, and an experiment optimization. This work focuses on cross-section sensitives and gap analysis for three examples relevant to the reactor physics community including a Travelling Wave Reactor (TWR) type-design, Kilopower (a space reactor design), and a lead-bismuth eutectic cooled accelerator-driven system (ADS) to transmute minor actinides.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Impact of Thermal Scattering Law on Similarity Assessment in Light-Water or Polyethylene-Moderated Systems [Slides]
This presentation found validation efforts revealed noticeable differences in c k for light-water and polyethylene moderated systems when compared to PST-002-001. Additionally, although 1 H-H 2 O and 1 H-poly use the same cross section and covariance data, the treatment of TSLs in SCALE lead to no contribution to ck between polyethylene application and benchmark experiment. When H 2 O contribution were removed the difference in c k appears to come from 239 Pu chi. Sensitivity profiles and data-induced uncertainty confirmed that the polyethylene application was more closely resembling the benchmark experiment. Specific differences between similar systems can be accounted for and examined to help understand differences in similarity (c k ) between systems was a conclusion reached by this presentation.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Results of a Geant4 benchmarking study for bio‐medical applications, performed with the G4‐Med system
Geant4, a Monte Carlo Simulation Toolkit extensively used in bio-medical physics, is in continuous evolution to include newest research findings to improve its accuracy and to respond to the evolving needs of a very diverse user community. In 2014, the G4-Med benchmarking system was born from the effort of the Geant4 Medical Simulation Benchmarking Group, to benchmark and monitor the evolution of Geant4 for medical physics applications. The G4-Med system was first described in our Medical Physics Special Report published in 2021. Results of the tests were reported for Geant4 10.5. Purpose In this work, we describe the evolution of the G4-Med benchmarking system. Methods The G4-Med benchmarking suite currently includes 23 tests, which benchmark Geant4 from the calculation of basic physical quantities to the simulation of more clinically relevant set-ups. New tests concern the benchmarking of Geant4-DNA physics and chemistry components for regression testing purposes, dosimetry for brachytherapy with a 125 I source, dosimetry for external x-ray and electron FLASH radiotherapy, experimental microdosimetry for proton therapy, and in vivo PET for carbon and oxygen beams. Regression testing has been performed between Geant4 10.5 and 11.1. Finally, a simple Geant4 simulation has been developed and used to compare Geant4 EM physics constructors and physics lists in terms of execution times. Results In summary, our EM tests show that the parameters of the multiple scattering in the Geant4 EM constructor G4EmStandardPhysics_option3 in Geant4 11.1, while improving the modeling of the electron backscattering in high atomic number targets, are not adequate for dosimetry for clinical x-ray and electron beams. Therefore, these parameters have been reverted back to those of Geant4 10.5 in Geant4 11.2.1. The x-ray radiotherapy test shows significant differences in the modeling of the bremsstrahlung process, especially between G4EmPenelopePhysics and the other constructors under study (G4EmLivermorePhysics, G4EmStandardPhysics_option3, and G4EmStandardPhysics_option4). These differences will be studied in an in-depth investigation within our Group. Improvement in Geant4 11.1 has been observed for the modeling of the proton and carbon ion Bragg peak with energies of clinical interest, thanks to the adoption of ICRU90 to calculate the low energy proton stopping powers in water and of the Linhard–Sorensen ion model, available in Geant4 since version 11.0. Nuclear fragmentation tests of interest for carbon ion therapy show differences between Geant4 10.5 and 11.1 in terms of fragment yields. In particular, a higher production of boron fragments is observed with Geant4 11.1, leading to a better agreement with reference data for this fragment. Conclusions Based on the overall results of our tests, we recommend to use G4EmStandardPhysics_option4 as EM constructor and QGSP_BIC_HP with G4EmStandardPhysics_option4, for hadrontherapy applications. The Geant4-DNA physics lists report differences in modeling electron interactions in water, however, the tests have a pure regression testing purpose so no recommendation can be formulated.
62 RADIOLOGY AND NUCLEAR MEDICINE↗
Constrained variational optimization of counting-time allocation in sequential scattering measurements: Application to Bonse–Hart USANS
Sequential scattering measurements are often performed under a fixed experimental-time budget, even though the expected count rate varies strongly across the measured coordinate. When the dwell time at each measurement position can be controlled independently, this variation creates a general resource-allocation problem: how should the available time be distributed to minimize the uncertainty of the reconstructed profile? We formulate this problem as a constrained variational optimization for measurements governed by Poisson counting statistics. When each measurement is treated independently, minimizing the averaged squared relative uncertainty yields an inverse-square-root intensity allocation. The formulation is then generalized to include correlations between neighboring measurements and an instrumental resolution operator, leading to an allocation criterion that equalizes the marginal reduction in posterior uncertainty per unit measurement time. Bonse–Hart ultra-small-angle neutron scattering (USANS), in which reciprocal space is sampled sequentially through analyzer-angle stepping, provides an experimentally grounded application. Computational benchmarking shows that the optimized allocation outperforms uniform-time and constant-relative-error strategies, while application to an experimentally measured graphite USANS profile from the Spallation Neutron Source, using Poisson resampling under alternative schedules, demonstrates how counting time should be redistributed toward weak-intensity regions under an identical total duration. The resulting framework applies to sequential scattering and related scanning measurements whenever local dwell times are adjustable and directly determine the measurement uncertainties, and when the relevant correlation and instrumental-response models are available.
Tung, Chi-Huan [ORNL] (ORCID:0000000221972074)↗
Static analysis techniques for semiautomatic synthesis of message passing software skeletons
The design of high-performance computing architectures demands performance analysis of large-scale parallel applications to derive various parameters concerning hardware design and software development. The process of performance analysis and benchmarking an application can be done in several ways with varying degrees of fidelity. One of the most cost-effective ways is to do a coarse-grained study of large-scale parallel applications through the use of program skeletons. The concept of a “program skeleton” that we discuss in this article is an abstracted program that is derived from a larger program where source code that is determined to be irrelevant is removed for the purposes of the skeleton. In this work, we develop a semiautomatic approach for extracting program skeletons based on compiler program analysis. Finally, we demonstrate correctness of our skeleton extraction process by comparing details from communication traces, as well as show the performance speedup of using skeletons by running simulations in the SST/macro simulator.
97 MATHEMATICS AND COMPUTING↗
Algorithm and Architecture Independent Benchmarking with SEAK
Many applications of high performance embedded computing are limited by performance or power bottlenecks. We have designed the Suite for Embedded Applications & Kernels (SEAK), a new benchmark suite, (a) to capture these bottlenecks in a way that encourages creative solutions; and (b) to facilitate rigorous, objective, end-user evaluation for their solutions. To avoid biasing solutions toward existing algorithms, SEAK benchmarks use a mission-centric (abstracted from a particular algorithm) and goal-oriented (functional) specification. To encourage solutions that are any combination of software or hardware, we use an end-user black-box evaluation that can capture tradeoffs between performance, power, accuracy, size, and weight. The tradeoffs are especially informative for procurement decisions. We call our benchmarks future proof because each mission-centric interface and evaluation remains useful despite shifting algorithmic preferences. It is challenging to create both concise and precise goal-oriented specifications for mission-centric problems. This paper describes the SEAK benchmark suite and presents an evaluation of sample solutions that highlights power and performance tradeoffs.
algorithms and kernels↗
NHT-1 I/O Benchmarks
The NHT-1 benchmarks am a set of three scalable I/0 benchmarks suitable for evaluating the I/0 subsystems of high performance distributed memory computer systems. The benchmarks test application I/0, maximum sustained disk I/0, and maximum sustained network I/0. Sample codes are available which implement the benchmarks.
Carter, Russell↗
Nuclear data covariances are critical input to determine upper sub-critical limits and to design experiments to increase it [Slides]
This presentation discusses how Upper Subcritical Limits (USL) are key parameters to determine operational limits in nuclear criticality safety evaluations. It also discusses an example of plutonium casting operation using tantalum at LANL PF-4. The Whisper tool at Los Alamos relies on many inputs, including covariance data, leading the presentation to ask if an existing benchmark data be used in Whisper to adjust nuclear data and covariances to justify a higher USL. If not, Whisper can be used to help design an optimal new benchmark experiment. The presentation also seeks to determine what the possible impacts are on USL and operational limits for plutonium casting. In conclusion, nuclear data covariances are used for by Whisper for: GSSL adjustment of nuclear data and covariances, identification of most similar existing benchmark experiments to application, simulation of Upper Subcritical Limit of application, and input to optimization techniques for designing most appropriate new benchmark experiment(s) to meet requirements. This requires a complete set of nuclear data covariances, benchmarks and k-effective sensitivity profiles (for both benchmarks and applications). The presentation concludes by asking if end users should trust results that depend on current covariance data.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗