Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

OECD NEA Benchmark Database of Spent Nuclear Fuel Isotopic Compositions for World Reactor Designs

Experimental data on the isotopic concentrations in irradiated nuclear fuel represent one of the primary methods for validating computational methods and nuclear data used for reactor and spent fuel depletion simulations that support nuclear fuel cycle safety and safeguards programs. Measurement data have previously not been available to users in a centralized or searchable format, and the majority of accessible information has been, for the most part, limited to light-water-reactor designs. This paper describes a recent initiative to compile spent fuel benchmark data for additional reactor designs used throughout the world that can be used to validate computer model simulations that support nuclear energy and nuclear safeguards missions. Experimental benchmark data have been expanded to include VVER-440, VVER-1000, RBMK, graphite moderated MAGNOX, gas cooled AGR, and several heavy-water moderated CANDU reactor designs. Additional experimental data for pressurized light water and boiling water reactor fuels has also been compiled for modern assembly designs and more extensive isotopic measurements. These data are being compiled and uploaded to a recently revised structured and searchable database, SFCOMPO, to provide the nuclear analysis community with a centrally-accessible resource of spent fuel compositions that can be used to benchmark computer codes, models, and nuclear data. The current version of SFCOMPO contains data for eight reactor designs, 20 fuel assembly designs, more than 550 spent fuel samples, and measured isotopic data for about 80 nuclides.

Gauld, Ian C↗

Adding Fault Tolerance to NPB Benchmarks Using ULFM

In the world of high-performance computing, fault tolerance and application resilience are becoming some of the primary concerns because of increasing hardware failures and memory corruptions. While the research community has been investigating various options, from system-level solutions to application-level solutions, standards such as the Message Passing Interface (MPI) are also starting to include such capabilities. The current proposal for MPI fault tolerant is centered around the User-Level Failure Mitigation (ULFM) concept, which provides means for fault detection and recovery of the MPI layer. This approach does not address application-level recovery, which is currently left to application developers. In this work, we present a mod- ification of some of the benchmarks of the NAS parallel benchmark (NPB) to include support of the ULFM capabilities as well as application-level strategies and mechanisms for application-level failure recovery. As such, we present: (i) an application-level library to checkpoint and restore data, (ii) extensions of NPB benchmarks for fault tolerance based on different strategies, (iii) a fault injection tool, and (iv) some preliminary results that show the impact of such fault tolerant strategies on the application execution.

Parchman, Zachary W↗

OpenSHMEM Implementation of HPCG Benchmark

We describe the effort to implement the HPCG benchmark using OpenSHMEM and MPI one-sided communication. Unlike the High Performance LINPACK (HPL) benchmark that places em- phasis on large dense matrix computations, the HPCG benchmark is dominated by sparse operations such as sparse matrix-vector product, sparse matrix triangular solve, and long vector operations. The MPI one-sided implementation is developed using the one-sided OpenSHMEM implementation. Pre- liminary results comparing the original MPI, OpenSHMEM, and MPI one-sided implementations on an SGI cluster, Cray XK7 and Cray XC30 are presented. The results suggest the MPI, OpenSHMEM, and MPI one-sided implementations all obtain similar overall performance but the MPI one-sided im- plementation seems to slightly increase the run time for multigrid preconditioning in HPCG on the Cray XK7 and Cray XC30.

OpenSHMEM HPCG↗

MULTIPHYSICS-MODELING OF FIRE-INDUCED URANIUM AEROSOL FORMATION – A-POSTERIORI BENCHMARKING OF EXPERIMENTS

The formulation and solution of a model that properly described the temperature profiles of uranium in fire conditions was prepared, verified and validated, to support a-posteriori benchmarking of historical experiments. Data from the multi-physics model combined with data regression from the experiments provides a useful tool for exploring sources of potential bias in historical experiments. The approaches used are augmented by visual observations and photographic evidence allowing for correlations between various phenomena, independent of whether or not that specific phenomena are part of the validated model. In this manner, the validated model is a tool for a-posteriori benchmarking, and not a model designed to replicate the experimental output exactly for any specific experiment. For experiments like the Clark (2015) experiments, this integrated model (including chemistry) demonstrated that the largest bias was associated in the metallurgy of the coupons. The model developed does serve as a basis for defending which of the historical alloys tested are the most appropriate for any other alloy being considered (e.g., one that has not yet been tested). The model identifies key reactions that impact uranium chemistry and can significantly bias experimental results. Through use of the model and energy balances, data from historical experiments by Elder and Tinkle (1980) were regressed and benchmarked. This study identifies that all uranium alloys are not equal and that there are distinct differences between the dominant alloys representing distinct metallurgical phases.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Evaluation of Oak Ridge National Laboratory Health Physics Research Reactor Operation Data for Criticality Accident Alarm System Benchmark Creation

Over the last few decades, the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Working Group has focused on gathering critical and subcritical benchmark experiment data from different facilities around the world for inclusion in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook). The compiled data can be used by criticality safety analysts to help validate their calculation tools and cross-section libraries for a variety of applications.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Open-source FPGA-ML codesign for the MLPerf Tiny Benchmark

We present our development experience and recent results for the MLPerf Tiny Inference Benchmark on field-programmable gate array (FPGA) platforms. We use the open-source hls4ml and FINN workflows, which aim to democratize AI-hardware codesign of optimized neural networks on FPGAs. We present the design and implementation process for the keyword spotting, anomaly detection, and image classification benchmark tasks. The resulting hardware implementations are quantized, configurable, spatial dataflow architectures tailored for speed and efficiency and introduce new generic optimizations and common workflows developed as a part of this work. The full workflow is presented from quantization-aware training to FPGA implementation. The solutions are deployed on system-on-chip (Pynq-Z2) and pure FPGA (Arty A7-100T) platforms. The resulting submissions achieve latencies as low as 20 $\mu$s and energy consumption as low as 30 $\mu$J per inference. We demonstrate how emerging ML benchmarks on heterogeneous hardware platforms can catalyze collaboration and the development of new techniques and more accessible tools.

Borras, Hendrik↗

FastML Science Benchmarks: Accelerating Real-Time Scientific Edge Machine Learning

Applications of machine learning (ML) are growing by the day for many unique and challenging scientific applications. However, a crucial challenge facing these applications is their need for ultra low-latency and on-detector ML capabilities. Given the slowdown in Moore's law and Dennard scaling, coupled with the rapid advances in scientific instrumentation that is resulting in growing data rates, there is a need for ultra-fast ML at the extreme edge. Fast ML at the edge is essential for reducing and filtering scientific data in real-time to accelerate science experimentation and enable more profound insights. To accelerate real-time scientific edge ML hardware and software solutions, we need well-constrained benchmark tasks with enough specifications to be generically applicable and accessible. These benchmarks can guide the design of future edge ML hardware for scientific applications capable of meeting the nanosecond and microsecond level latency requirements. To this end, we present an initial set of scientific ML benchmarks, covering a variety of ML and embedded system techniques.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

MUSiC: Critical Experiment with Bare Highly Enriched Uranium Shells Benchmark

The measurements of the Uranium Subcritical and Critical (MUSiC) experiment were performed from December 2020 through April 2021. The purpose of the experiment was to test a variety of multiplicity detection systems for a large range of multiplication values and to see how well they perform as the k eff of the MUSiC series of experiments approached the delayed critical window. Out of the ten configurations that were studied, two of them were super critical and were recently approved as benchmarks and they will be included in the International Criticality Safety Benchmark Evaluation Project (ICBESP) handbook. For each of the two experiments, uncertainties were evaluated six categories: (1) critical measurement, (2) mass, (3) composition, (4) positioning, (5) dimensions, and (6) temperature. The largest contribution to the overall uncertainty in each of the cases was due to the uncertainties in the dimensions of the HEU Rocky Flats shells. Simplified detailed models were created with an average bias of -130.5 pcm due to the removal various components surrounding the experiment. For MCNP6.2 models using ENDF-VIII.0 neutron cross section data, the average difference between the calculated and benchmark k effs was -54 pcm for the detailed model and -102 pcm for the simplified model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DeepSurveySim: Simulation Software and Benchmark Challenges for Astronomical Observation Scheduling

Modern astronomical surveys have multiple competing scientific goals. Optimizing the observation schedule for these goals presents significant computational and theoretical challenges, and state-of-the-art methods rely on expensive human inspection of simulated telescope schedules. Automated methods, such as reinforcement learning, have recently been explored to accelerate scheduling. However, there do not yet exist benchmark data sets or user-friendly software frameworks for testing and comparing these methods. We present DeepSurveySim -- a high-fidelity and flexible simulation tool for use in telescope scheduling. DeepSurveySim provides methods for tracking and approximating sky conditions for a set of observations from a user-supplied telescope configuration. We envision this tool being used to produce benchmark data sets and for evaluating the efficacy of ground-based telescope scheduling algorithms, particularly for machine learning algorithms that would suffer in efficacy if limited to real data for training.We introduce three example survey configurations and related code implementations as benchmark problems that can be simulated with DeepSurveySim.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Benchmarking of the Updated Resolved Resonance Region Evaluations of Copper

A new resolved resonance region (RRR) evaluation for the two naturally occurring isotopes of copper, {sup 63}Cu and {sup 65}Cu was performed at Oak Ridge National Laboratory (ORNL), and the benchmarking results based on the four highly enriched uranium (HEU), intermediate spectrum, copper-reflected Zeus experiments were presented in June 2014. Since then, two significant updates to the evaluations have been performed: first, the data for the experimental measurement of the capture cross section between 220 keV and 300 keV were renormalized and the resonance parameters were refitted. Second, the angular distribution of elastic scattering initially reported in point-wise form in File 4 of the ENDF file format with high fidelity was significantly reduced in size to allow for better computer storage. Twenty-seven criticality safety benchmarks from the International Criticality Safety Benchmark Evaluation Project (ICSBEP) were calculated using these updated resolved resonance region evaluations for the two isotopes of copper. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Bare, complex, and potassium-filled HEU oralloy annuli Benchmark experiments - 14103

Hundreds of critical experiments were constructed from Oak Ridge Alloy (oralloy) during the 1960's and 1970's at the Oak Ridge Critical Experiments Facility (ORCEF) in support of criticality safety operations at the Y-12 Plant. The purpose of these experiments included the evaluation of storage, casting, and handling limits and providing data for verification of calculation methods and cross sections for nuclear criticality safety applications. Recent contributions to the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) include bare, complex, and potassium-filled annuli comprising multiple stacked units of highly enriched uranium (HEU), ∼93.2 wt.% {sup 235}U, annuli, discs, and parallelepipeds. Prior contributions to the ICSBEP Handbook include bare (unreflected and unmoderated) cylinders; configurations of cylinders and annuli reflected with polyethylene, beryllium, or thin-graphite reflectors; GROTESQUE; and ORSphere. The newest contributions include a bare HEU 11-7 (11 inch outer diameter and 7 inch inner diameter) annulus oralloy-capped at the top and bottom; bare HEU 13-7, 15-7, and 15-9 annuli; bare HEU complex annuli consisting of a 15-9 annulus containing either an off-center 7-inch-diameter cylinder, 5 x 5 inch parallelepiped, or split parallelepiped; and an HEU 13-7 annulus containing either empty stainless steel cans or potassium-metal-filled cans. The purpose of this latter pair of annulus configurations was to test the fast neutron cross sections of potassium as it was a candidate for coolant in some early space power reactor designs. A total of nine new configurations were evaluated as acceptable benchmark experiment measurements. Additional ORCEF oralloy experiments have also been identified for future benchmark evaluation. (authors)

36 MATERIALS SCIENCE↗

RELAP5-3D Solutions to Exercise 1 of the OECD-NEA HTTF Benchmark

Discussion of RELAP5-3D solutions to Exercise 1 of the OECD-NEA High Temperature Test Facility (HTTF) Benchmark. Results from ongoing benchmark activities supported by the Advanced Reactor Technologies - Gas-Cooled Reactor Program with use of the High Performance Computing Center at Idaho National Laboratory. Also discussion of Ultra Safe Nuclear Corporation and BWXT plans for the decade, and issues of modern thermal hydraulic tools for prismatic HTGR modeling. Open discussion of verification and validation and ART-GCR campaign to spearhead the development of an HTGR thermal hydraulics benchmark based on the HTTF.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

RELAP5-3D Modeling in the OECD-NEA HTTF Benchmark

Prismatic gas-cooled reactors are a technologically mature reactor concept of interest for near- to mid-term deployment. To accelerate the deployment of these reactors, the DOE's Advanced Reactor Technologies Gas-Cooled Reactor campaign is spearheading a thermal hydraulics code validation benchmark based on the High Temperature Test Facility at Oregon State University. This presentation provides an introduction to that benchmark and an overview of some of the RELAP5-3D validation activities stemming from that benchmark.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Benchmarking Framework for Evaluating Large Language Model Capabilities in Nuclear Reactor Safety Applications

Large language models (LLMs) are increasingly capable of answering technical questions, synthesizing domain knowledge, and supporting engineering workflows. For nuclear science and engineering, these capabilities require careful, domain-specific evaluation before they can be credibly incorporated into safety-related activities, regulatory review, or technical decision support. This paper presents preliminary results from benchmarking framework for evaluating LLM capabilities in nuclear contexts. The framework is organized into three evaluation categories: nuclear fundamentals, general dual-use knowledge, and plant specific knowledge. These categories are intended to distinguish general nuclear engineering competence from broader technical reasoning and more context-dependent nuclear knowledge. Initial evaluations focus on nuclear fundamentals using questions representative of the knowledge expected of a nuclear professional engineer. Results indicate that contemporary frontier models perform at a high level and substantially exceed the performance of older model generations, with some models approaching saturation of the current benchmark. These findings suggest both the rapid improvement of LLM capabilities in specialized technical domains and the need for more discriminating evaluation methods. The paper presents the benchmark structure, preliminary model-comparison results, and ongoing work. This work supports development of verifiable, responsible, and safety-conscious methods for assessing AI systems in nuclear engineering applications.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Benchmark of Advanced Burner Test Reactor Model Using MCNPX 2.6.0 and ERANOS 2.1

Significant research is currently being performed whereby fast reactor cores have been designed to burn transuranic materials reducing the volume and long-term radiotoxicity of spent nuclear fuel. These core and depletion models depend on various computer codes. This research used MCNPX 2.6.0 and ERANOS 2.1 to model a standard 250MWt Advanced Burner Test Reactor (ABTR) core. The intent was to benchmark criticality and burnup results from a stochastic Monte Carlo code and a deterministic depletion code using a standard ABTR model created by Argonne National Laboratory. Because each of these codes solve the transport and burnup problem differently, there is a need to benchmark the core models in order to verify results and identify root causes for significant differences in results between codes. Flux calculations in ERANOS were performed using diffusion theory, Legendre polynomial approximations (using the VARIANT module) and discrete ordinates methods. The k-effective for the higher-order transport models remained within 1000 pcm of the MCNPX model. The difference between the total heavy nuclide mass balance in ERANOS using the various flux calculations and the MCNPX depletion model was less than 0.4% out to a burnup of 1095 days (67.45 GWd/MTHM). For individual heavy nuclides, the depletion models closely matched (< 5.0 % difference) throughout the depletion for isotopes of Uranium, Neptunium and Plutonium and most of the higher transuranics. Notable exceptions were 242Am, 242Cm, 243Cm and 246Cm where differences ranged from 0.1 – 0.2% after 26 days and increased to 11 - 136% at 1095 days.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Reactor Physics Measurements and Benchmark Specifications for Oak Ridge Highly Enriched Uranium Sphere (ORSphere)

In the early 1970s Dr. John T. Mihalczo (team leader), J.J. Lynn, and J.R. Taylor performed experiments at the Oak Ridge Critical Experiments Facility (ORCEF) with highly enriched uranium (HEU) metal (called Oak Ridge Alloy or ORALLOY) in an effort to recreate GODIVA I results with greater accuracy than those performed at Los Alamos National Laboratory in the 1950s. The purpose of the Oak Ridge ORALLOY Sphere (ORSphere) experiments was to estimate the unreflected and unmoderated critical mass of an idealized sphere of uranium metal corrected to a density, purity, and enrichment such that it could be compared with the GODIVA I experiments. Additionally, various material reactivity worths, the surface material worth coefficient, the delayed neutron fraction, the prompt neutron decay constant, relative fission density, and relative neutron importance were all measured. The critical assembly, material reactivity worths, the surface material worth coefficient, and the delayed neutron fraction were all evaluated as benchmark experiment measurements. The reactor physics measurements are the focus of this paper; although for clarity the critical assembly benchmark specifications are briefly discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

TREAT Transient Analysis Benchmarking for the HEU Core

This work was performed to support the feasibility study on the potential conversion of the Transient Reactor Test Facility (TREAT) at Idaho National Laboratory from the use of high enriched uranium (HEU) fuel to the use of low enriched uranium (LEU) fuel. The analyses were performed by the GTRI Reactor Conversion staff at the Argonne National Laboratory (ANL). The objective of this study was to benchmark the transient calculations against temperature-limited transients performed in the final operating HEU TREAT core configuration. The MCNP code was used to evaluate steady-state neutronics behavior, and the point kinetics code TREKIN was used to determine core power and energy during transients. The first part of the benchmarking process was to calculate with MCNP all the neutronic parameters required by TREKIN to simulate the transients: the transient rod-bank worth, the prompt neutron generation lifetime, the temperature reactivity feedback as a function of total core energy, and the core-average temperature and peak temperature as a functions of total core energy. The results of these calculations were compared against measurements or against reported values as documented in the available TREAT reports. The heating of the fuel was simulated as an adiabatic process. The reported values were extracted from ANL reports, intra-laboratory memos and experiment logsheets and in some cases it was not clear if the values were based on measurements, on calculations or a combination of both. Therefore, it was decided to use the term “reported” values when referring to such data. The methods and results from the HEU core transient analyses will be used for the potential LEU core configurations to predict the converted (LEU) core’s performance.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

IER 480: TEX-Pu Benchmark (PU-MET-THERM-004) to Test Polyethylene and Lucite Thermal Scattering Laws [Slides]

This presentation finds that PMT-004 has four new benchmark cases highly sensitive to PE TSL (2 cases) and PMMA TSL (2 Cases). PE cases were well predicted using MCNP6.2 and ENDF/B-VIII.0. PMMA cases overpredicted by approximately 0.6-0.7% in k eff at 20°C. Accepted into 2023 version of the ICSBEP Handbook. Temperature had a large impact on reactivity of the critical configuration. Implications for validation work for thermal cases- need to adjust TSL data to correct temperature as it can have hundreds of pcm effects for a few °C. Future thermal experiments should try and measure reactivity at multiple temperatures to aid in data testing and benchmark adjustment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗