Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

The MCNP6 Analytic Criticality Benchmark Suite

Analytical benchmarks provide an invaluable tool for verifying computer codes used to simulate neutron transport. Several collections of analytical benchmark problems [1-4] are used routinely in the verification of production Monte Carlo codes such as MCNP® [5,6]. Verification of a computer code is a necessary prerequisite to the more complex validation process. The verification process confirms that a code performs its intended functions correctly. The validation process involves determining the absolute accuracy of code results vs. nature. In typical validations, results are computed for a set of benchmark experiments using a particular methodology (code, cross-section data with uncertainties, and modeling) and compared to the measured results from the set of benchmark experiments. The validation process determines bias, bias uncertainty, and possibly additional margins. Verification is generally performed by the code developers, while validation is generally performed by code users for a particular application space. The VERIFICATION_KEFF suite of criticality problems [1,2] was originally a set of 75 criticality problems found in the literature for which exact analytical solutions are available. Even though the spatial and energy detail is necessarily limited in analytical benchmarks, typically to a few regions or energy groups, the exact solutions obtained can be used to verify that the basic algorithms, mathematics, and methods used in complex production codes perform correctly. The present work has focused on revisiting this benchmark suite. A thorough review of the problems resulted in discarding some of them as not suitable for MCNP benchmarking. For the remaining problems, many of them were reformulated to permit execution in either multigroup mode or in the normal continuous-energy mode for MCNP. Execution of the benchmarks in continuous-energy mode provides a significant advance to MCNP verification methods.

97 MATHEMATICS AND COMPUTING↗

Relevant Advanced Reactor Benchmarks for Nuclear Data Assessment

Advanced reactor concepts currently being developed throughout the industry are significantly different from light water reactor (LWR) designs with respect to geometry, materials, and operating conditions, and consequently, with respect to their reactor physics behavior. Given the limited operating experience with non-LWRs, the accurate simulation of reactor physics and the quantification of associated uncertainties are critical for ensuring that advanced reactor concepts operate within the appropriate safety margins. Nuclear data are a major source of input uncertainties in reactor physics analysis. As part of an ongoing project at Oak Ridge National Laboratory, the effects of nuclear data uncertainties on key figures of merit associated with advanced reactor safety are being assessed for selected advanced reactor technologies. Key nuclear data relevant for reactor safety analysis for each selected advanced reactor technology were identified in Phase 1, and their impact on important key figures of merit was assessed in Phase 2. This report describes the outcome of Phase 3. Available benchmarks and fuel irradiation data for use in evaluating the impact of uncertainties and gaps in nuclear data that impact reactivity control for advanced reactor designs through the fuel cycle were identified and assessed. Benchmarks were identified by searching (1) the Organisation for Economic Co-operation and Development (OECD)/Nuclear Energy Agency (NEA) International Criticality Safety Benchmark Evaluation Project (IRPhEP) handbook, (2) the OCED/NEA International Reactor Physics Experiment Evaluation Project (IRPhEP) handbook, (3) ongoing OECD/NEA benchmark activities, and (4) documentation in public literature. Relevant benchmarks were identified by selecting reactors with geometry, materials, and neutron energy spectra similar to those of selected advanced reactor technologies. This assessment identified six benchmarks, of which three are experimental and three are purely computational. One experimental and one computation benchmark contain depleted fuel; all others are limited to fresh fuel. This report provides short descriptions of the selected benchmarks along with the availability of measured data for comparison.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

IER 555: Godiva Benchmark Update CED-2 (Final Design Report)

The International Criticality Safety Benchmark Evaluation Project (ICSBEP) evaluation of the Godiva IV critical assembly, HEU-MET-FAST-086: GODIVA-IV DELAYED-CRITICAL EXPERIMENTS (HMF-086), was completed by Russ Mosteller. Five critical experiment configurations performed at the Los Alamos National Laboratory (LANL) Technical Area (TA)-18 were evaluated as acceptable benchmark cases. The five cases consist of four delayed critical configurations which differ in control rod positions and one prompt critical configuration. All cases calculated a lower $k_{eff}$ than measured by experiment. This data is referred to as the TA-18 Godiva IV benchmark in this report. In 2005, Godiva IV was disassembled for relocation to the Nevada Test Site (NTS), now Nevada National Security Site (NNSS), at the National Criticality Experiments Research Center (NCERC). Following the disassembly and subsequent reassembly and startup of Godiva IV at NCERC, additional information about the Godiva IV components was obtained. An errata note was added to the HMF-086 evaluation in the ICSBEP handbook to provide this new information until a revision to the benchmark evaluation could be performed. In addition to those corrections, there are differences between the Godiva IV assembly at TA-18 and the Godiva IV assembly at NCERC. These differences include both assembly-specific differences (differences in the safety block gap, differences in the control rod positions, a new NCERC Top Hat and contamination shield) as well as environmental differences, such as the size and shape of the experimental building where the assembly is located. An additional model with similar cases, referred to as the NCERC Godiva IV benchmark in this report, will be added to the revised HMF-086 to capture these additional differences. This will provide the best benchmark model of Godiva for use by those performing experiments at NCERC. The IER 555 CED-2 report documents the information that will be updated in the HMF-086 revision, both the corrections to the TA-18 Godiva IV benchmark and the subsequent changes to create a NCERC Godiva IV benchmark. It describes the measurements that will be performed for cases similar to those performed at TA-18. It also describes measurements that will be included in the evaluation as additional data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A framework for benchmarking land models

Land models, which have been developed by the modeling community in the past few decades to predict future states of ecosystems and climate, have to be critically evaluated for their performance skills of simulating ecosystem responses and feedback to climate change. Benchmarking is an emerging procedure to measure performance of models against a set of defined standards. This paper proposes a benchmarking framework for evaluation of land model performances and, meanwhile, highlights major challenges at this infant stage of benchmark analysis. The framework includes (1) targeted aspects of model performance to be evaluated, (2) a set of benchmarks as defined references to test model performance, (3) metrics to measure and compare performance skills among models so as to identify model strengths and deficiencies, and (4) model improvement. Land models are required to simulate exchange of water, energy, carbon and sometimes other trace gases between the atmosphere and land surface, and should be evaluated for their simulations of biophysical processes, biogeochemical cycles, and vegetation dynamics in response to climate change across broad temporal and spatial scales. Thus, one major challenge is to select and define a limited number of benchmarks to effectively evaluate land model performance. The second challenge is to develop metrics of measuring mismatches between models and benchmarks. The metrics may include (1) a priori thresholds of acceptable model performance and (2) a scoring system to combine data–model mismatches for various processes at different temporal and spatial scales. The benchmark analyses should identify clues of weak model performance to guide future development, thus enabling improved predictions of future states of ecosystems and climate. The near-future research effort should be on development of a set of widely acceptable benchmarks that can be used to objectively, effectively, and reliably evaluate fundamental properties of land models to improve their prediction performance skills.

Biophysical Processes↗

Generation IV Benchmarking of TRISO Fuel Performance Models Under Accident Conditions Final Report

The Generation IV International Forum (GIF) is a co-operative international endeavor of fourteen members organized to carry out the research and development needed to establish the feasibility and performance capabilities of the next generation nuclear energy systems. GIF selected six reactor technologies, amongst which is the Very High Temperature Reactor (VHTR) that is primarily dedicated to the cogeneration of electricity and hydrogen. The technical basis for VHTR is the tristructural isotropic (TRISO)-coated particle fuel, the graphite as the core structure, helium coolant, as well as the dedicated core layout and lower power density to removal decay heat in a natural way. At the heart of safety features of the VHTR concept lie the TRISO fuel particles that are designed to keep their structural integrity and retain fission products at temperatures up to 1600°C. As part as the design and future operation of VHTRs, a key aspect is the accurate prediction of fuel performance under irradiation and accident conditions. Modeling and simulation allow prediction of TRISO fuel behavior when subject to neutron flux and in high temperature accident scenarios. The refinement of the fuel performance models and codes is performed by comparison to in-pile and out-of-pile experimental data that reproduce the expected irradiation conditions in high temperature gas-cooled reactors (HTGRs). Historically, the International Atomic Energy Agency (IAEA) developed a benchmark dedicated to the validation of predictive methods for fuel and fission product behavior through the Coordinated Research Program CRP-2 (IAEA, 1997). CRP-2 was later updated to cover fuel fabrication, quality assurance, irradiation performance, safety testing, and spent fuel. The scope of the resulting CRP-6 benchmarks focused on HTGR fuel performance and fission product release (IAEA, 2012). Taking advantage of additional TRISO fuel fabrication, irradiation, and safety testing campaigns, GIF launched a Generation IV Benchmarking of TRISO Fuel Performance Models under Accident Conditions in late 2015. This GIF benchmark is a three-year program steered by Idaho National Laboratory (INL, USA). The other participants include the Japan Atomic Energy Agency (JAEA, Japan) and the Korea Atomic Energy Research Institute (KAERI, Korea). The objectives of the benchmark are to: follow on the IAEA CRP benchmarks, (2) model fission product release under accident conditions, (3) compare results obtained by the fuel performance modeling codes of the benchmark participants, and (4) compare these code predictions to experimental data. Safety tests chosen for modeling include the first and second experiments of the Advanced Gas Reactor program (AGR-1 and AGR-2) and the High Flux Reactor (HFR) EU1bis experiment. This report presents the results obtained by the three research institutions using their respective fuel performance modeling codes. Comparisons of the corresponding fission product release predictions are made with experimental data from AGR-1, AGR-2, and HFR-EU1bis. The benchmark results show good agreements between all participants but also show a general trend of over-prediction of the experimental release data, which is mainly attributed to the use of over-estimated diffusion coefficients.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Mesoscale Benchmark Demonstration, Problem 1: Mesoscale Simulations of Intra-granular Fission Gas Bubbles in UO 2 under Post-irradiation Thermal Annealing

A study was conducted to evaluate the capabilities of different numerical methods used to represent microstructure behavior at the mesoscale for irradiated material using an idealized benchmark problem. The purpose of the mesoscale benchmark problem was to provide a common basis to assess several mesoscale methods with the objective of identifying the strengths and areas of improvement in the predictive modeling of microstructure evolution. In this work, mesoscale models (phase-field, Potts, and kinetic Monte Carlo) developed by PNNL, INL, SNL, and ORNL were used to calculate the evolution kinetics of intra-granular fission gas bubbles in UO 2 fuel under post-irradiation thermal annealing conditions. The benchmark problem was constructed to include important microstructural evolution mechanisms on the kinetics of intra-granular fission gas bubble behavior such as the atomic diffusion of Xe atoms, U vacancies, and O vacancies, the effect of vacancy capture and emission from defects, and the elastic interaction of non-equilibrium gas bubbles. An idealized set of assumptions was imposed on the benchmark problem to simplify the mechanisms considered. The capability and numerical efficiency of different models are compared against selected experimental and simulation results. These comparisons find that the phase-field methods, by the nature of the free energy formulation, are able to represent a larger subset of the mechanisms influencing the intra-granular bubble growth and coarsening mechanisms in the idealized benchmark problem as compared to the Potts and kinetic Monte Carlo methods. It is recognized that the mesoscale benchmark problem as formulated does not specifically highlight the strengths of the discrete particle modeling used in the Potts and kinetic Monte Carlo methods. Future efforts are recommended to construct increasingly more complex mesoscale benchmark problems to further verify and validate the predictive capabilities of the mesoscale modeling methods used in this study.

99 GENERAL AND MISCELLANEOUS↗

Integral Full Core Multi-Physics PWR Benchmark with Measured Data

In recent years, the importance of modeling and simulation has been highlighted extensively in the DOE research portfolio with concrete examples in nuclear engineering with the CASL and NEAMS programs. These research efforts and similar efforts worldwide aim at the development of high-fidelity multi-physics analysis tools for the simulation of current and next-generation nuclear power reactors. Like all analysis tools, verification and validation is essential to guarantee proper functioning of the software and methods employed. The current approach relies mainly on the validation of single physic phenomena (e.g. critical experiment, flow loops, etc.) and there is a lack of relevant multiphysics benchmark measurements that are necessary to validate high-fidelity methods being developed today. This work introduces a new multi-cycle full-core Pressurized Water Reactor (PWR) depletion benchmark based on two operational cycles of a commercial nuclear power plant that provides a detailed description of fuel assemblies, burnable absorbers, in-core fission detectors, core loading and re-loading patterns. This benchmark enables analysts to develop extremely detailed reactor core models that can be used for testing and validation of coupled neutron transport, thermal-hydraulics, and fuel isotopic depletion. The benchmark also provides measured reactor data for Hot Zero Power (HZP) physics tests, boron letdown curves, and three-dimensional in-core flux maps from 58 instrumented assemblies. The benchmark description is now available online and has been used by many groups. However, much work remains to be done on the quantification of uncertainties and modeling sensitivities. This work aims to address these deficiencies and make this benchmark a true non-proprietary international benchmark for the validation of high-fidelity tools. This report details the BEAVRS uncertainty quantification for the first two cycle of operations and serves as the final report of the project.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Results of a Geant4 benchmarking study for bio‐medical applications, performed with the G4‐Med system

Geant4, a Monte Carlo Simulation Toolkit extensively used in bio-medical physics, is in continuous evolution to include newest research findings to improve its accuracy and to respond to the evolving needs of a very diverse user community. In 2014, the G4-Med benchmarking system was born from the effort of the Geant4 Medical Simulation Benchmarking Group, to benchmark and monitor the evolution of Geant4 for medical physics applications. The G4-Med system was first described in our Medical Physics Special Report published in 2021. Results of the tests were reported for Geant4 10.5. Purpose In this work, we describe the evolution of the G4-Med benchmarking system. Methods The G4-Med benchmarking suite currently includes 23 tests, which benchmark Geant4 from the calculation of basic physical quantities to the simulation of more clinically relevant set-ups. New tests concern the benchmarking of Geant4-DNA physics and chemistry components for regression testing purposes, dosimetry for brachytherapy with a 125 I source, dosimetry for external x-ray and electron FLASH radiotherapy, experimental microdosimetry for proton therapy, and in vivo PET for carbon and oxygen beams. Regression testing has been performed between Geant4 10.5 and 11.1. Finally, a simple Geant4 simulation has been developed and used to compare Geant4 EM physics constructors and physics lists in terms of execution times. Results In summary, our EM tests show that the parameters of the multiple scattering in the Geant4 EM constructor G4EmStandardPhysics_option3 in Geant4 11.1, while improving the modeling of the electron backscattering in high atomic number targets, are not adequate for dosimetry for clinical x-ray and electron beams. Therefore, these parameters have been reverted back to those of Geant4 10.5 in Geant4 11.2.1. The x-ray radiotherapy test shows significant differences in the modeling of the bremsstrahlung process, especially between G4EmPenelopePhysics and the other constructors under study (G4EmLivermorePhysics, G4EmStandardPhysics_option3, and G4EmStandardPhysics_option4). These differences will be studied in an in-depth investigation within our Group. Improvement in Geant4 11.1 has been observed for the modeling of the proton and carbon ion Bragg peak with energies of clinical interest, thanks to the adoption of ICRU90 to calculate the low energy proton stopping powers in water and of the Linhard–Sorensen ion model, available in Geant4 since version 11.0. Nuclear fragmentation tests of interest for carbon ion therapy show differences between Geant4 10.5 and 11.1 in terms of fragment yields. In particular, a higher production of boron fragments is observed with Geant4 11.1, leading to a better agreement with reference data for this fragment. Conclusions Based on the overall results of our tests, we recommend to use G4EmStandardPhysics_option4 as EM constructor and QGSP_BIC_HP with G4EmStandardPhysics_option4, for hadrontherapy applications. The Geant4-DNA physics lists report differences in modeling electron interactions in water, however, the tests have a pure regression testing purpose so no recommendation can be formulated.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A New Shutdown Dose Rate Benchmark Problem for Representative Fusion Applications

Here, this work introduces a new benchmark problem for calculating shutdown dose rates (SDDRs) aimed at fusion reactor applications. The model is designed to represent a simplified version of a typical ITER port plug. The responses of interest include neutron flux, gamma flux, and gamma SDDR at 12 different locations scattered throughout the port. This article outlines the geometry specifications of the problem, provides material definitions for the components, specifies the required responses to be calculated, and presents the source definition information. The need for this benchmark arises from the limited availability of publicly accessible references, with only one benchmark representing the typical dimensions and materials found in fusion systems. This existing benchmark has been cited extensively, reflecting the demand within the scientific community to test both established and novel workflows for SDDR calculations. However, since its presentation at a conference in 2011, the results have become increasingly well known. Moreover, the absence of formal publication and peer review has led to the details of this benchmark being extracted from secondary sources, such as subsequent studies that reference it. As a result, analysts are left with significant flexibility in interpreting the key parameters, which can be adjusted to account for unknown systematic errors, ultimately reproducing the already well-known responses. This new benchmark serves as an updated version of that earlier work, with the aim of providing a more reliable description of the materials and their impurities, which is crucial for assessing activation and subsequent gamma emission. Additionally, it seeks to provide a geometry that more closely represents an ITER port plug. The improvements in the problem definition will lead to a more reproducible benchmark problem, while also presenting the radiation transport community with a completely new challenge. The results will be published in a future article to allow analysts adequate time to analyze this problem independently.

Benchmark↗

An HPC benchmark survey and taxonomy for characterization

The field of High-Performance Computing (HPC) is defined by providing computing devices with highest performance for a variety of demanding scientific users. The tight co-design relationship between HPC providers and users propels the field forward, paired with technological improvements, achieving continuously higher performance and resource utilization. A key device for system architects, architecture researchers, and scientific users are benchmarks, allowing for well-defined assessment of hardware, software, and algorithms. Many benchmarks exist in the community, from individual niche benchmarks testing specific features, to large-scale benchmark suites for whole procurements. We survey the available HPC benchmarks, summarizing them in table form with key details and concise categorization, also through an interactive website. For categorization, we present a benchmark taxonomy for well-defined characterization of benchmarks.

Benchmarking↗

Generation IV benchmarking of TRISO fuel performance models under accident conditions: Modeling input data

This document presents the benchmark plan for the calculation of particle fuel performance on safety testing experiments that are representative of operational accidental transients. The benchmark is dedicated to the modeling of fission product release under accident conditions by fuel performance codes from around the world, and the subsequent comparison to post-irradiation experiment (PIE) data from the modeled heating tests. The accident condition benchmark is divided into three parts: the modeling of a simplified benchmark problem to assess potential numerical calculation issues at low fission product release; the modeling of the AGR-1 and HFR-EU1bis safety testing experiments; and, the comparison of the AGR-1 and HFR-EU1bis modeling results with PIE data. The simplified benchmark case, thereafter named NCC (Numerical Calculation Case), is derived from ''Case 5'' of the International Atomic Energy Agency (IAEA) Coordinated Research Program (CRP) on coated particle fuel technology [IAEA 2012]. It is included so participants can evaluate their codes at low fission product release. ''Case 5'' of the IAEA CRP-6 showed large code-to-code discrepancies in the release of fission products, which were attributed to ''effects of the numerical calculation method rather than the physical model''[IAEA 2012]. The NCC is therefore intended to check if these numerical effects subsist. The first two steps imply the involvement of the benchmark participants with a modeling effort following the guidelines and recommendations provided by this document. The third step involves the collection of the modeling results by Idaho National Laboratory (INL) and the comparison of these results with the available PIE data. The objective of this document is to provide all necessary input data to model the benchmark cases, and to give some methodology guidelines and recommendations in order to make all results suitable for comparison with each other. The participants should read this document thoroughly to make sure all the data needed for their calculations is provided in the document. Missing data will be added to a revision of the document if necessary.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Building America Research Benchmark Definition, Updated December 19, 2008

To track progress toward aggressive multi-year, whole-house energy savings goals of 40%–70% and onsite power production of up to 30%, the U.S. Department of Energy (DOE) Residential Buildings Program and the National Renewable Energy Laboratory (NREL) developed the Building America (BA) Research Benchmark in consultation with the BA industry teams. The Benchmark is generally consistent with mid-1990s standard practice, as reflected in the Home Energy Rating System (HERS) Technical Guidelines (RESNET 2002), with additional definitions that allow the analyst to evaluate all residential end-uses, an extension of the traditional HERS rating approach that focuses on space conditioning and hot water. Unlike the reference homes used for HERS, ENERGY STAR ® , and most energy codes, the Benchmark represents typical construction at a fixed point in time so it can be used as the basis for Building America’s multi-year energy savings goals without the complication of chasing a “moving target.” As time passes, we expect energy codes to become increasingly energy efficient compared to the Benchmark as better construction practices and more efficient equipment become commonplace in the market. A series of user profiles, intended to represent the behavior of a “standard” set of occupants, was created for use in conjunction with the Benchmark. The Benchmark is intended for use with detached and attached single-family housing only. It is not suitable for multi-family housing as written. Energy analysis of a Prototype compared to the Benchmark can be performed with any software tool that complies with the BA Performance Analysis Procedures (Hendron et al. 2004). In addition, NREL will provide examples of technology packages that can be used to achieve different source energy savings based on BEopt analysis results (Anderson and Roberts, 2008). These technology packages, or alternative packages that provide equivalent source energy savings, may be used to demonstrate minimum whole house source energy savings for BA Gate reviews.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOES CRITICAL MASS DECREASE AS TEMPERATURE INCREASES: A REVIEW OF FIVE BENCHMARK EXPERIMENTS THAT SPAN A RANGE OF ELEVATED TEMPERATURES AND CRITICAL CONFIGURATIONS

Five sets of benchmark experiments are reviewed herein that cover a diverse set of fissile system configurations. The review specifically focused on the change in critical mass of these systems at elevated temperatures and the temperature reactivity coefficient ({alpha}{sub T}) on the system. Because plutonium-based critical benchmark experiments at varying temperatures were not found at the time this review was prepared, only uranium-based systems are included, as follows: (1) HEU-SOL-THERM-010 - UO{sub 2}F{sub 2} solutions with high U{sup 235} enrichment; (2) HEU-COMP-THERM-016 - uranium-graphite blocks with low U concentration; (3) LEU-COMP-THERM-032 - water moderated lattices of UO{sub 2} with stainless steel cladding, and intermediate U{sup 235} enrichment; (4) IEU-COMP-THERM-002 - water moderated lattices of annular UO{sub 2} with/without absorbers, and intermediate U{sup 235} enrichment; and (5) LEU-COMP-THERM-026 - water moderated lattices of UO{sub 2} at different pitches, and low U{sup 235} enrichment. In three of the five benchmarks (1, 3 and 5), modeling of the critical system at room temperature is conservative compared to modeling the system at elevated temperatures, i.e., a greater fissile mass is required at elevated temperature. In one benchmark (4), there was no difference in the fissile mass between the room temperature system and the system at the examined elevated temperature. In benchmark (2), the system clearly had a negative temperature reactivity coefficient. Some of the high temperature benchmark experiments were treated with appropriate (and comprehensive) adjustments to the cross section sets and thermal expansion coefficients, while other experiments were treated with partial adjustments. Regardless of the temperature treatment, modeling the systems at room temperature was found to be conservative for the examined systems, i.e., a smaller critical mass was obtained. While the five benchmarks presented herein demonstrate that, for the conditions examined, modeling of the systems at room temperature is conservative as compared to modeling the systems at elevated temperatures, it is possible to design a system in which the critical mass at room temperature is non-conservative compared to a system at elevated temperatures. As the temperature of the systems evaluated in this review was increased, the system's overall {alpha}{sub T} was negative at elevated temperatures. Furthermore, the review demonstrates that to accurate asses the effect of increased temperature on a system's k{sub eff}, changes in fissile, moderator, cladding, and, in some cases, structural material cross sections must be combined with other factors that influence reactivity, such as volumetric thermal expansion of fissile, moderating, reflector, and other interacting media. Altering the microscopic cross sections of fissile and moderating regions for temperature changes, without adjusting the corresponding densities at elevated temperatures can lead to an incorrect assessment of the impact of elevated temperature on a fissile system.

36 MATERIALS SCIENCE↗

GROWTH OF THE INTERNATIONAL CRITICALITY SAFETY AND REACTOR PHYSICS BENCHMARK EXPERIMENT EVALUATION PROJECTS SINCE ICNC 2011

Since the International Conference on Nuclear Criticality Safety (ICNC) 2011, the International Criticality Safety Benchmark Evaluation Project (ICSBEP) and the International Reactor Physics Experiment Evaluation Project (IRPhEP) have continued to expand their efforts. Twenty countries have continued to participate in the ICSBEP since 2011; participating countries in the IRPhEP have grown from 16 in 2011 to 20 in 2015. Since ICNC 2011, the contents of the International Handbook of Evaluated Criticality Safety Benchmark Experiments have increased from 533 evaluations (approximately 58,000 pages), containing benchmark specifications for 4,552 critical or subcritical configurations to 561 evaluations (approximately 67,000 pages), containing benchmark specifications for 4,839 critical or subcritical configurations in the 2014 Edition of the ICSBEP Handbook. While the current number of criticality-alarm-placement/shielding benchmark configurations has remained at 24, the number of fundamental physics measurements relevant to criticality safety applications has increased from 200 to 207. Since ICNC 2011, the contents of the International Handbook of Evaluated Reactor Physics Benchmark Experiments have increased from 53 experimental series that were performed at 31 different reactor facilities to 143 experimental series that were performed at 50 different reactor facilities in the 2015 Edition of the IRPhEP Handbook. The status of the ICSBEP and the IRPhEP is discussed and benchmarks that have been more recently added to the handbooks are highlighted.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Employing Whisper in selecting benchmarks for traditional validation methods

The Nuclear Criticality Safety Program at Sandia National Laboratories (SNL) uses a collection of benchmarks developed from the International Handbook of Evaluated Criticality Safety Benchmark Experiments for validation of MCNP. In early 2016, an effort began to expand the benchmark collection to cover a broader range of materials and neutron spectra. The program undertook the task of updating current benchmarks to reflect best practices from Los Alamos National Laboratory (LANL) for MCNP calculations. Spring of 2016, LANL shared the Whisper code with SNL in a collaborated effort to investigate application of the code to activities at SNL. Whisper is a statistical package developed to support nuclear criticality safety validation efforts. It measures how well benchmarks correlate to a system or process and calculates a USL. Whisper has begun to develop into an asset for the SNL Nuclear Criticality Safety team to determine and reassure benchmarks selected for validation truly correlate process parameters (i.e., fall within an acceptable Area of Applicability). SNL's use of traditional statistical methods, with the abilities of Whisper to identify correlating benchmarks, has facilitated in ensuring confidence in validation and USL determination. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Proposed Semi-Analytic Benchmark for Coupled Neutronics/Thermal-Hydraulics Feedback in Multiphysics Simulations

The past decade has seen considerable advancements in multiscale and multiphysics simulations that account for nonlinear effects of feedback between different physical processes within a single calculation. One area of particular interest has been multiphysics simulations that include both neutronics and thermal-hydraulics effects to accurately model the thermal feedback effects present in nuclear reactors. During this time, many groups have successfully modeled thermal feedback effects by coupling a variety of different types of neutron transport and thermal-hydraulic solvers together. However, formal verification and validation of these coupled code systems has proven challenging due to a lack of benchmark problems with well-characterized reference solutions. One approach is to confirm gross energy balance using bulk coolant properties (outlet temperature/enthalpy) for code verification purposes. Alternatively, code-to-code comparisons of results for a predefined reference/challenge problem have been used to establish reasonability of local results (neutron flux, heating, enthalpy rise) for various implementations, for example the VERA Core Physics Progression Problems. While community solutions are valuable for assessing the relative performance and fidelity of different implementations, they are not guaranteed to provide a measure of the absolute accuracy of a given implementation. In fact, these code-to-code comparisons can give a false sense of confidence by masking the effects of errors or approximations that are common to all of the solution methods tested. This is a particular concern when many methods derive from a common approach, such as Picard iteration. To this end, an analytical benchmark would be very valuable for verifying individual coupled physics implementations, as well as for providing a formal assessment of algorithm accuracy and sensitivity to model approximations such as mesh size and number of convergence iterations. However, creation of an analytical benchmark is difficult due to the complex nature of the eigenvalue form of the neutron transport equation (which does not permit a simple analytical solution for non-trivial cases) as well as the variety of different empirical closure relationships used in thermal-hydraulic modeling. In this paper we propose a benchmark for coupled neutronics/thermal-hydraulics simulations. The proposed benchmark overcomes the challenges associated with a multiphysics benchmark problem by using a fixed-source (rather than eigenvalue) formulation of the neutron transport equation and limiting fluid properties to the single-phase regime where the density and temperature of the coolant are related to enthalpy by a known relationship, while still preserving significant nuclear/thermal feedback effects within the simplified problem. The new benchmark is easy to simulate using existing coupled physics implementations, and allows for a direct comparison with a reference solution, as provided in this summary.

42 ENGINEERING↗

Growth of the international criticality safety and reactor physics Benchmark experiment evaluation projects since ICNC 2011 - 14102

Since the International Conference on Nuclear Criticality Safety (ICNC) 2011, the International Criticality Safety Benchmark Evaluation Project (ICSBEP) and the International Reactor Physics Experiment Evaluation Project (IRPhEP) have continued to expand their efforts. Twenty countries have continued to participate in the ICSBEP since 2011; participating countries in the IRPhEP have grown from 16 in 2011 to 20 in 2015. Since ICNC 2011, the contents of the International Handbook of Evaluated Criticality Safety Benchmark Experiments have increased from 533 evaluations (approximately 58,000 pages), containing benchmark specifications for 4,552 critical or subcritical configurations to 561 evaluations (approximately 67,000 pages), containing benchmark specifications for 4,839 critical or subcritical configurations in the 2014 Edition of the ICSBEP Handbook. While the current number of criticality-alarm-placement/shielding benchmark configurations has remained at 24, the number of fundamental physics measurements relevant to criticality safety applications has increased from 200 to 207. Since ICNC 2011, the contents of the International Handbook of Evaluated Reactor Physics Benchmark Experiments have increased from 53 experimental series that were performed at 31 different reactor facilities to 143 experimental series that were performed at 50 different reactor facilities in the 2015 Edition of the IRPhEP Handbook. The status of the ICSBEP and the IRPhEP is discussed and benchmarks that have been more recently added to the handbooks are highlighted. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Verification of the Uniformly-Ordered Binary Decision Algorithm in Correlated-Benchmark Whisper Calculations

Whisper is a nuclear criticality safety code package that aids analysts in validation exercises by computing upper subcritical limits (USL) for applications of interest. To obtain statistically meaningful, significant, and conservative USLs, the analyst must ensure that Whisper selects a sufficient number of benchmarks that are neutronically similar to the application. Many of the available benchmarks are correlated but are currently treated as independent, leading to an artificially small sample size, as their individual information contributions will be overestimated. To aid the analyst in obtaining a sufficient sample size, prior work [2] demonstrated application of the Uniformly-Ordered Binary Decision (UOBD) algorithm in adjusting benchmark weights to account for benchmark correlations. This work provides verification of the Whisper implementation and considers the impact of updated benchmark correlations compared to those available previously. We demonstrate that the UOBD algorithm performs as expected with an analytic example. With HEU-SOL-THERM-001 cases 1 through 10 as the applications, we compare the USLs computed with benchmark correlations available in the Whisper 1.1 release only to those computed with additional benchmark correlations from DICE 2023 and demonstrate substantive differences.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗