Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BENCHMARKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Validation of MCNP Critical Benchmarks Models of Highly Enriched Uranium Cylinders

A new centralized repository of high-quality MCNP models of critical benchmark experiments is currently under development at Los Alamos National Laboratory (LANL). The benchmark experiments are described in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook, and the initial set of benchmark models are derived from the Whisper Suite provided with MCNP6.2. This effort is a collaboration among the Nuclear Criticality Safety, Nuclear Data, and Monte Carlo code development/application organization at LANL. The objective is to create a current single LANL benchmark collection that includes the latest ICSBEP revision that has a formal review and revision process, is contained in an open- source repository, and utilizes new Python tools for improved input and output file review.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Evaluation of Oak Ridge National Laboratory Health Physics Research Reactor Operation Data for Critical Benchmark Creation [Abstract]

The Oak Ridge National Laboratory (ORNL) Health Physics Research Reactor (HPRR) was a research reactor designed and built at ORNL in 1961. The critical assembly was using a highly enriched uranium and molybdenum alloy as the fuel, and it could be operated in steady-state or burst modes. The reactor was used for about 25 years to produce a lot of publications related to dosimetry, radiobiology and radiation detectors testing before its decommissioning in 1987. In recent years, the idea of using legacy operation data from the to create a valuable critical accident alarm system shielding benchmark arose. Such a benchmark has been submitted to the International Criticality Safety Benchmark Experiment Project (ICSBEP) Technical Review Group for a potential inclusion in the 2022 version of the handbook. Another way to use the valuable data from the operation of the HPRR is to evaluate the feasibility of the creation of a subcritical or prompt supercritical benchmark for inclusion in the ICSBEP or the International Reactor Physics Experiments Evaluation Project (IRPhEP) handbooks. To initiate a burst, the HPRR had to be operated in a slightly subcritical state for a few minutes. Then, the insertion of the burst control rod would greatly increase the reactivity of the system and start the burst. No critical configuration of the HPRR critical assembly could be located. The only information available concerns stable subcritical and prompt supercritical states, found in a burst experiments’ logbook. In the recovered logbook pages, information about 8 different bursts is available. The information includes the rods positions before and during a burst, the recorded subcritical reactor period and reactivity, and the burst fission yield derived from the temperature elevation sulfur pellet irradiation analysis. By using the HPRR logbook information and the as-built drawings of the critical assembly, a highly detailed model of the HPRR was created with SCALE 6.2.4/KENO-VI. Eight KENO-VI models were created to replicate the sub-critical assembly configurations described in the eight bursts from the recovered logbook pages. KENO-VI calculates k eff and it can be linked to a reactivity value in cents by using the delayed neutron fraction B eff , also calculated by KENO-VI. KENO-VI can also be used to model the prompt super-critical configurations of the HPRR and to assess the similarity with the burst measurements by comparing the calculated k eff and the measured fission yields between each burst. Unfortunately, high uncertainty exist and the obtained discrepancies between experiments and calculation results are high, compromising the creation of a valuable critical benchmark from HPRR operation data. The reasons of the discrepancies and potential ways to solve them are explored.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Status of the OECD/NEA Watts Bar unit 1 benchmark and calculations of local reactor core power data of the Zero Power physics tests

The paper aims to provide an update on the status of the Organization for Economic Cooperation and Development (OECD) / the Nuclear Energy Agency (NEA) Tennessee Valley Authority (TVA) Watts Bar 1 (WB1) Multi-Physics Multi-Cycle depletion benchmark and the results associated with Exercise 1. The benchmark relies on the set of benchmark progression problems developed by the Department of Energy (DOE) Consortium for the Advanced Simulation of Light Water Reactors (CASL) for the Virtual Environment for Reactor (VERA), which are based on real plant design and operational data. The OECD/NEA TVA WB1 benchmark is designed for validation of both traditional and novel high-fidelity multi-physics codes to analyze Pressurized Water Reactors (PWR) depletion cycles. The activities are conducted under the Expert Group on Reactor Systems Multi-Physics (EGMUP) at NEA/OECD. In this work, we analyze Exercise 1 of the benchmark: stand-alone Three-Dimensional (3D) neutronics at Start-up Zero Power Physics Test (ZPPT) at Hot Zero Power Conditions (HZP) and the resulting power maps. The code used to model the exercise is the continuous energy Monte Carlo code Serpent 2.1.31 along with the nuclear data library ENDF/B-VII.1. Serpent results are compared with the high-fidelity deterministic code MPACT, which is part of VERA. The paper presents three selected results from power calculations required output. The results compared are the normalized axially integrated radial core power maps, the normalized axial averaged core power shapes, and the normalized core hottest and coldest assemblies radial power maps. The Root Mean Square Deviation (RMSD) between Serpent and MPACT is 0.51 % for the axially integrated radial core power map, 1.41 % for the axial averaged core power shape, 2.42 % for the hottest assembly axial power shape, 0.88 % for the coldest assembly axial integrated hottest assembly radial pin power map, and 0.17 % for the axially integrated coldest assembly radial pin power map. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Generation of group constants at GRS for the Rostov-2 benchmark

The OECD/NEA benchmark entitled 'Reactivity compensation of boron dilution by stepwise insertion of control rod cluster into the VVER-1000 core' aims at validating and assessing high fidelity multi-physics simulation code capabilities by comparison with the high-quality measurements performed at the nuclear power plant Rostov unit 2. The benchmark is divided into 2 phases: assembly wise and pin-by-pin resolution of the multi-physics problems. Multi-physics simulation requires the generation of an accurate parametrized few-group cross-section library, and so this benchmark offers an opportunity to validate the methodology for their generation. Based on the specifications of the benchmark, the core simulator KMACS developed at GRS was used to generate a library of cross-sections as well as the burnup distribution required to model the transient scenario of the benchmark at the assembly level. The assessment of the library is performed through comparison with measured values obtained at the initial state of the transient. Good agreement was obtained in terms of critical boron concentration, peaking factors and power profiles. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

25-Pin metallic fuel performance benchmark case based on the EBR-II X430 experiments series

A metallic fuel benchmark case was developed for the fuel performance code BISON based on 25 uranium-zirconium and uranium-plutonium-zirconium pins of the Experimental Breeder Reactor II X430 experiment series. Results of the benchmarks were compared with measurements and calculations made at the time of the experiment as well as subsequent measurements reported in 2019. The comparisons were used to quantify the accuracy of the BISON predictions and to identify patterns in the BISON differences.BISON predicted burnup, plenum pressure, and fission gas release fractions accurately. BISON temperature predictions were somewhat cooler than the temperatures determined at the time of the experiment but appeared to be reasonably accurate considering uncertainties in the legacy temperature calculations, uncertainties in the legacy linear heat rate calculations, and the high sensitivities of the BISON-predicted temperatures to BISON inputs. Fuel axial elongation predictions had errors correlated to fuel composition; BISON tended to underpredict the elongation of binary fuels and overpredict the elongation of ternary fuels. BISON cladding radial dilation predictions were also significantly lower than legacy PIE measurements.Recommendations were made to improve the BISON fuel gaseous swelling model to account for fuel composition, to add additional capabilities to the coolant channel temperature model to ease benchmark development, and to continue developing benchmark cases based on a wide range of experiments in several reactors. Once a wide array of benchmarks is developed, an attempt can be made to enhance or calibrate BISON models to improve the cladding dilation predictions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Extending quantum-mechanical benchmark accuracy to biological ligand-pocket interactions

Predicting the binding affinity of ligands to protein pockets is key in the drug design pipeline. The flexibility of ligand-pocket motifs arises from a range of attractive and repulsive electronic interactions during binding. Accurately accounting for all interactions requires robust quantum-mechanical (QM) benchmarks, which are scarce for ligand-pocket systems. Additionally, disagreement between “gold standard” Coupled Cluster (CC) and Quantum Monte Carlo (QMC) methods casts doubt on many benchmarks for larger non-covalent systems. We introduce the “QUantum Interacting Dimer” (QUID) benchmark framework containing 170 non-covalent (non-)equilibrium systems modeling chemically and structurally diverse ligand-pocket motifs. Symmetry-adapted perturbation theory shows that QUID broadly covers non-covalent binding motifs and energetic contributions. Robust binding energies are obtained using complementary CC and QMC methods, achieving agreement of 0.5 kcal/mol. The benchmark data analysis reveals that several dispersion-inclusive density functional approximations provide accurate energy predictions, though their atomic van der Waals forces differ in magnitude and orientation. Contrarily, semiempirical methods and empirical force fields require improvements in capturing non-covalent interactions (NCIs) for out-of-equilibrium geometries. The wide span of NCIs, highly accurate interaction energies, and analysis of molecular properties take QUID beyond the “gold standard” for QM benchmarks of ligand-protein systems.

Puleva, Mirela [University of Luxembourg, Luxembou↗

A robust benchmark for detection of germline large deletions and insertions

New technologies and analysis methods are enabling genomic structural variants (SVs) to be detected with ever-increasing accuracy, resolution and comprehensiveness. To help translate these methods to routine research and clinical practice, we developed a sequence-resolved benchmark set for identification of both false-negative and false-positive germline large insertions and deletions. To create this benchmark for a broadly consented son in a Personal Genome Project trio with broadly available cells and DNA, the Genome in a Bottle Consortium integrated 19 sequence-resolved variant calling methods from diverse technologies. The final benchmark set contains 12,745 isolated, sequence-resolved insertion (7,281) and deletion (5,464) calls ≥50 base pairs (bp). The Tier 1 benchmark regions, for which any extra calls are putative false positives, cover 2.51 Gbp and 5,262 insertions and 4,095 deletions supported by ≥1 diploid assembly. We demonstrate that the benchmark set reliably identifies false negatives and false positives in high-quality SV callsets from short-, linked- and long-read sequencing and optical mapping.

59 BASIC BIOLOGICAL SCIENCES↗

WfBench: Automated Generation of Scientific Workflow Benchmarks

The prevalence of scientific workflows with high computational demands calls for their execution on various distributed computing platforms, including large-scale leadership-class high-performance computing (HPC) clusters. To handle the deployment, monitoring, and optimization of workflow executions, many workflow systems have been developed over the past decade. There is a need for workflow benchmarks that can be used to evaluate the performance of workflow systems on current and future software stacks and hardware platforms.We present a generator of realistic workflow benchmark specifications that can be translated into benchmark code to be executed with current workflow systems. Our approach generates workflow tasks with arbitrary performance characteristics (CPU, memory, and I/O usage) and with realistic task dependency structures based on those seen in production workflows. We present experimental results that show that our approach generates benchmarks that are representative of production workflows, and conduct a case study to demonstrate the use and usefulness of our generated benchmarks to evaluate the performance of workflow systems under different configuration scenarios.

Coleman, Taina↗

Assessment of four strain energy decomposition methods for phase field fracture models using quasi-static and dynamic benchmark cases

Abstract Strain energy decomposition methods in phase field fracture models separate strain energy that contributes to fracture from that which does not. However, various decomposition methods have been proposed in the literature, and it can be difficult to determine an appropriate method for a given problem. The goal of this work is to facilitate the choice of strain decomposition method by assessing the performance of three existing methods (spectral decomposition of the stress or the strain and deviatoric decomposition of the strain) and one new method (deviatoric decomposition of the stress) with several benchmark problems. In each benchmark problem, we compare the performance of the four methods using both qualitative and quantitative metrics. In the first benchmark, we compare the predicted mechanical behavior of cracked material. We then use four quasi-static benchmark cases: a single edge notched tension test, a single edge notched shear test, a three-point bending test, and a L-shaped panel test. Finally, we use two dynamic benchmark cases: a dynamic tensile fracture test and a dynamic shear fracture test. All four methods perform well in tension, the two spectral methods perform better in compression and with mixed mode (though the stress spectral method performs the best), and all the methods show minor issues in at least one of the shear cases. In general, whether the strain or the stress is decomposed does not have a significant impact on the predicted behavior.

Zhang, Shuaifang↗

The Rodinia Benchmark Suite in SYCL

As opposed to the Open Computing Language (OpenCL) programming model in which host and device codes are generally written in different programming languages, SYCL can combine host and device codes for an application in a type-safe way to improve development productivity and performance portability. Rodinia is a widely used benchmark suite for heterogeneous computing. Hence, we port the OpenCL implementations of the benchmark suite to SYCL manually. The SYCL benchmark suite is an opensource project for tracking the development of the mainstream SYCL compilers, and for developers and researchers interested in programming productivity, performance analysis, and portability across different computing platforms. We organize the remainder of the report as follows. Section II introduces the SYCL programming model, shows the major differences between an OpenCL program and a SYCL program, and gives a summary of the benchmark suite. In Section III, we describe our SYCL implementations in more details. We evaluate the SYCL benchmarks on the Intel® central processing units (CPUs) and graphics processing units (GPUs) in Section IV. Section V concludes the report.

97 MATHEMATICS AND COMPUTING↗

(U) Updated Godiva-IV Benchmark Preview

A note of errata prepended to the Godiva-IV delayed-critical benchmark (HEU-METFAST-086) identifies two corrections that need to be made to the model: The glory hole in the spindle should be made larger, and the height of the safety block should be made smaller (and therefore its density made larger). In addition, the safety block at its full-in position is closer to the inner subassembly plate than was modeled in the benchmark. These changes have been made to HEU-METFAST-086 Case 4 in order to estimate the effect on k eff and on the neutron flux spectrum. Using smaller separation, a smaller safety block, and a larger glory hole caused k eff to increase by 453 ± 1 pcm from the benchmark. The latest nuclear data, ENDF-B/VIII.0, have also been used; this caused k eff to increase another 37 ± 1 pcm. Flux spectra were compared in a modeled fission foil and at three external point detectors. Within the fission foil, using ENDF/B-VIII.0 for Godiva-IV induced changes in the flux spectrum similar in size to the changes due to using smaller separation, a smaller safety block, and a larger glory hole. At the point detectors, using ENDF/B-VIII.0 induced changes in the flux spectrum much larger than those due to changing the model. In other words, the corrections to the benchmark model cause a large increase in k eff , but the changes to the neutron flux spectrum are small compared to those caused by using the latest nuclear data. This study presents a preview of results expected during the reevaluation of the Godiva IV benchmark, but it is not a substitute for the full reevaluation

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The Rodinia Benchmarks in SYCL

The Rodinia Benchmark Suite in SYCL was first published as a technical report at Argonne National Laboratory in June 2020. While porting more programs to SYCL, the Rodinia benchmark suites were merged into the heterogenous computing benchmarks (HeCBench). Since then, the source codes and scripts of the benchmark suite have been updated to fix compile- and run-time issues that users encountered. With the recent SYCL compilers from Codeplay and Intel, this report presents the experimental results of evaluating these benchmarks on the Intel CPU and GPU devices.

97 MATHEMATICS AND COMPUTING↗

Updates to SNL Nuclear Criticality Safety Benchmark Suite for MCNP

Members of the Nuclear Criticality Safety (NCS) Program at Sandia National Laboratories (SNL) have updated the suite of benchmark problems developed to validate MCNP6 Version 2.0 for use in NCS applications. The updated NCS benchmark suite adds approximately 600 new benchmarks and includes peer review of all input files by two different NCS engineers (or one NCS engineer and one candidate NCS engineer). As with the originally released benchmark suite, the updated suite covers a broad range of fissile material types, material forms, moderators, reflectors, and neutron energy spectra. The benchmark suite provides a basis to establish a bias and bias uncertainty for use in NCS analyses at SNL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Using Likwid and Byfl to Benchmark Hardware Performance

This paper outlines a benchmarking study conducted during my internship at LANL, focusing on CPU (Computer Processing Unit) and program performance assessment. The primary goal was to gather memory access data using three methods across five polybench kernels The data gathered would then be used to compare and contrast to one another and calculate operational intensity for performance comparisons. Benchmarking tools like Byfl and Likwid were employed, with Byfl offering hardware-independent data through LLVM compiler communication and Likwid directly interacting with computer hardware. The study considered various benchmarking factors, including optimization levels, Big O notation ((n)), CPU diversity and specific kernel equations. Big O notation was utilized to simplify code complexity, with detailed breakdwons of operations and memory components for each polybench application. Specific O(n) equations enabled nuanced kernel compariosns, facilitating the identification of performance variations. CPU efficiency assessments were conducted using Likwid tests on two CPUs. The central focus on code optimization aimed at achieving higher speeds and reduced memory usage through streamlined code. Future work propsoes creating a roofline model, synthesizing benchmarking data into a comprehensive data graph to assist in optimizing code and improving hardware performance. The potential impact on the laboratory or national mission was underscored, emphasizing the importance of optimizing applications and hardware to conserve resources and accelerate program execution. The specific relevance to LANL’s operations in math-intensive fields such as Nuclear Fission, Space Exploration, and Nanotechnology highlights the necessity of efficient benchmarking for resource conservation and proram speed. Overall, this study contributes to the understanding of CPU and program performance, providing insights for future optimization efforts in a laboratory setting

97 MATHEMATICS AND COMPUTING↗

Benchmark Calculation for Turkey Point Unit 3 Cycles 1-3 Using the SCALE 6.3/Polaris–PARCS v3.4.2 Code Package

Benchmark calculations were performed for Turkey Point Unit 3 cycles 1–3 to validate the SCALE 6.3/Polaris–PARCS v3.4.2 code with the ENDF/B–VII.1 56–group library by comparing the simulated results with the measured data. The benchmark results will be used in evaluating the SCALE/Polaris–PARCS code package’s uncertainties for pressurized water reactor physics analysis. That future analysis will include key nuclear parameters such as reactivity, control bank worth, temperature coefficients, and pin and assembly power peaking factors. The present document details plant and fuel design specifications and input data for SCALE/Polaris, GenPMAXS, and PARCS. Additional details are provided with respect to the input and output files produced for the benchmark calculations. The benchmark results are summarized such that they can be used in evaluating uncertainties with other benchmark results for key nuclear parameters.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Benchmark Calculation for Surry Unit 1 Cycles 1-3 Using the SCALE 6.3/Polaris–PARCS v3.4.2 Code Package

The benchmark calculations were performed for Surry Unit 1 cycles 1–3 to validate the SCALE 6.3/Polaris–Purdue Advanced Reactor Core Simulator (PARCS) v3.4.2 with the ENDF/B–VII.1 56–group library by comparing the simulated results with the measured data. The benchmark results will be used to evaluate uncertainties of the SCALE/Polaris–PARCS code package for pressurized water reactor physics analysis for key nuclear parameters such as reactivity, control bank worth, temperature coefficients, and pin and assembly power peaking factors. This report details plant and fuel design specifications and input data for SCALE/Polaris, GenPMAXS, and PARCS. Additional details are provided for the input and output files produced for the benchmark calculations. The benchmark results were summarized such that they can be used in evaluating uncertainties with other benchmark results for key nuclear parameters.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Benchmark Calculation for the Quad Cities Unit 1 Cycles 1-3 Using the SCALE 6.3/Polaris–PARCS v3.4.2 Code Package

In this study, benchmark calculations were performed for the Quad Cities Unit 1 cycles 1–3 to validate the SCALE 6.3/Polaris–PARCS v3.4.2 code package with the ENDF/B-VII.1 AMPX 56-group library by comparing the simulated results with the measured data. The benchmark results will be used in evaluating uncertainties of the SCALE/Polaris–PARCS code package for boiling water reactor physics analysis for key nuclear parameters such as reactivity and assembly power peaking factors. This report details plant and fuel design specifications and input data for SCALE/Polaris, GenPMAXS, and PARCS; additionally, detailed information is provided for all the input and output files produced for the benchmark calculations. The benchmark results are summarized herein so that they can be used to evaluate uncertainties with other benchmark results for key nuclear parameters.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Benchmark Calculation for the Hatch Unit 1 Cycles 1-3 Using the SCALE 6.3/Polaris–PARCS v3.4.2 Code Package

This study was the performance of the benchmark calculation for the Hatch Unit 1 cycles 1–3, to validate the SCALE 6.3/Polaris–PARCS v3.4.2 with the ENDF/B-VII.1 AMPX 56-group library by comparing the simulated results with the measured data. The benchmark results will be used in evaluating uncertainties of the SCALE/Polaris–PARCS code package for boiling water reactor (BWR) physics analysis for key nuclear parameters such as reactivity and assembly power peaking factors. This report details plant and fuel design specifications and input data for SCALE/Polaris, GenPMAXS and PARCS, and additionally, detailed information is provided for all the input and output files produced for the benchmark calculations. The benchmark results were summarized such that they can be used in evaluating uncertainties for key nuclear parameters with other BWR benchmark results.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗