Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Benchmark problems and results for verifying resonance calculation methodologies

Resonance calculation is one of the most important procedures for the multi-group neutron transport calculation. With the development of nuclear reactor concepts, many new types of fuel assembly are raised. Compared to the traditional designs, most of the new fuel assemblies have different fuel types either with complex isotopes or with complicated geometry. This makes the traditional resonance calculation method invalid. Recently, many advanced resonance calculation methods are proposed. However, there are few benchmark problems for evaluating those methods with a comprehensive comparison. In this paper, we design 5 groups of benchmark problems including 21 typical cases of different geometries and fuel contents. The reference results of the benchmark problems are generated based on the sub-group method, ultra-fine group method, function expanding method and Monte Carlo method. It is shown that those benchmark problems and their results could be helpful to evaluate the validity of the newly developed resonance calculation method in the future work. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Benchmarking ENDF/B-VII.1, JENDL-4.0 and JEFF-3.1

Three nuclear data libraries have been tested extensively using criticality safety benchmark calculations. The three libraries are the new release of the US library ENDF/B-VII.1 (2011), the new release of the Japanese library JENDL-4.0 (2011), and the OECD/NEA library JEFF-3.1 (2006). All calculations were performed with the continuous-energy Monte Carlo code MCNP (version 4C3, as well as version 6-beta1). Around 2000 benchmark cases from the International Handbook of Criticality Safety Benchmark Experiments (ICSBEP) were used. The results were analyzed per ICSBEP category, and per element. Overall, the three libraries show similar performance on most criticality safety benchmarks. The largest differences are probably caused by elements such as Be, C, Fe, Zr, W. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

MC21 analysis of the nuclear energy agency Monte Carlo performance benchmark problem

Due to the steadily decreasing cost and wider availability of large scale computing platforms, there is growing interest in the prospects for the use of Monte Carlo for reactor design calculations that are currently performed using few-group diffusion theory or other low-order methods. To facilitate the monitoring of the progress being made toward the goal of practical full-core reactor design calculations using Monte Carlo, a performance benchmark has been developed and made available through the Nuclear Energy Agency. A first analysis of this benchmark using the MC21 Monte Carlo code was reported on in 2010, and several practical difficulties were highlighted. In this paper, a newer version of MC21 that addresses some of these difficulties has been applied to the benchmark. In particular, the confidence-interval-determination method has been improved to eliminate source correlation bias, and a fission-source-weighting method has been implemented to provide a more uniform distribution of statistical uncertainties. In addition, the Forward-Weighted, Consistent-Adjoint-Driven Importance Sampling methodology has been applied to the benchmark problem. Results of several analyses using these methods are presented, as well as results from a very large calculation with statistical uncertainties that approach what is needed for design applications. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Quantifying Transient Uncertainty in the BEAVRS Benchmark Using Time Series Analysis Methods

Advances in computation have brought about significant improvements in creating fast-running high-fidelity simulations of nuclear cores. The BEAVRS benchmark is a highly-detailed PWR specification with two cycles of measured operational data used to validate high-fidelity core analysis methods. This PWR depletion benchmark captures the fine details of the LWR fuel assemblies, burnable absorbers, in-core fission detectors, core loading and shuffling patterns. Specifically, 58 of the 193 assemblies contain in-core detectors with measurements taken over 61 axial positions every month. These detectors are U-235 fission chambers with slightly varying mass of U-235. The collected signals are normalized on a given assembly permitting full core comparisons. The fuel layout for cycle 1 and instrument tube locations for the reactor are given in figures 1 and 2 respectively. Through a series of data processing and comparisons, it was shown that axially integrated radial maps of reaction rates were in close agreement between provided detector data and calculated data. More recently, the focus of the BEAVRS project has been on quantifying uncertainty to further assess the validity of aforementioned results. A close investigation of sources of error shows that uncertainties from operational nuclear data arise primarily from data measurements and processing. While the errors in axial realignment and interpolation seem significant, these sources affect only a small subset of data points near grid spacers and do not persist throughout the entire core. Instead, measurement uncertainty from detector count rates and radial integration dominate the uncertainty in measured data are determined as the most significant sources of error. This uncertainty analysis treated each given burnup step as independent of comparable data at neighboring burnup steps. More recent work has been targeted at understanding how reaction rates vary over time, in order to determine whether calculated reaction rates follow any observable trends. This abstract hones in on transient uncertainty quantification, in order to compare observed data against models for transient behavior. The first section of the paper uses linear regression tools to fit operational data, while the latter portion of the paper explores more complex simulation tools to fit operational data. Ultimately, the BEAVRS benchmark aims to serve as a true non-proprietary international benchmark for the validation of high-fidelity tools. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Uncertainty Analysis of CTF for the Uncertainty Analysis in Modeling Benchmark

This work describes the results of a quantitative sensitivity and uncertainty analysis of the thermal hydraulic subchannel code, Coolant Boiling in Rod Arrays - Three Field (COBRA-TF). Four steady state cases from Phase II, Exercise 3 of the Organisation for Economic Co-operation and Development/Nuclear Energy Agency Uncertainty Analysis in Modeling (OECD/NEA UAM) Benchmark are analyzed using the statistical analysis tool, Design Analysis Kit for Optimization and Tera-scale Applications (Dakota). This study supports the larger goal of the UAM Benchmark, which is to assess the uncertainty inherent in nuclear codes in a straightforward framework. The benchmark first focuses on assessing the uncertainty in stand-alone codes and then uses these results to propagate those uncertainties to coupled calculations. The work presented here adds to the existing results for this benchmark. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

VERA neutronics high-fidelity benchmark for a modern PWR core design

Nearly 20 years since the origin of the infamous 'Kord Smith Challenge', and after 10 years and hundreds of millions of dollars invested by the US Department of Energy into the development of the Virtual Environment for Reactor Applications (VERA), the capability to accurately simulate a modern pressurized water reactor (PWR) fuel cycle at the fuel rod level with high-fidelity Monte Carlo (MC) stochastic transport methods still evades us. The deterministic methods in VERA make approximations that allow it to be successfully benchmarked against measured data from hundreds of PWR fuel cycles, but none of these benchmarks provided information at the local fuel rod level or allowed quantification of these approximations' impact for modern PWR reload designs. Using MPACT to establish the estimated isotopic distributions and thermal hydraulic conditions in a recent and challenging reactor design, a 2D quarter-core benchmark problem was established and solved consistently with both MPACT, the 51-energy group deterministic transport solver in VERA, and Shift, the continuous-energy MC transport solver in VERA. Impacts of energy groups, ray spacing, and scattering treatment were evaluated. Though MPACT has been previously shown to perform well compared to MC methods for initial Cycle 1 cores with only fresh fuel, this is the first benchmark of MPACT for a challenging modern reload core with depleted fuel and burnable absorbers. This work establishes additional credibility for the methods in MPACT and highlights the efficiency of these methods relative to those in use by MC-based tools. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Development of the TREAT M2 experiment as a transient benchmark

A transient benchmark based on the Transient Reactor Test Facility (TREAT) M2 Calibration experiment (M2-CAL) is under development. TREAT, at Idaho National Laboratory, is a graphite moderated air-cooled research reactor which has been used extensively for fuel material testing under extreme and accident conditions. Accurate benchmark models are a beneficial component in the operations, experimental planning, and development of TREAT. In this work, we present a transient benchmark model for the M2-CAL experiment core loading. The benchmark model incorporates the coupling between the Monte Carlo Code SERPENT and the computational fluid dynamics code OpenFOAM to capture the temperature feedback mechanism. The M2-CAL transient 2580 was simulated in this work. A pre-transient analysis was performed to determine the optimum core composition and conditions before the beginning of the transient. The analysis was validated against historic TREAT kinetic measurements and the worth of the transient rod T-2. The axial power distribution in the flux wire for the M2-CAL experiment was determined and contrasted with the experiment. The model was then used to simulate the M2-CAL transient 2580 experiment based on the reported pre-transient and transient conditions. Several transient observables were calculated and compared to the experiment. The model shows good agreement with the experimental power traces, period, and average increase of power at the power ramp (time > 7.8 s). Inverse point kinetics analysis was performed during the period of the power ramp for the model and the experiment based on that, the temperature feedback component was isolated and contrasted with the experimental feedback. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Reactor physics benchmark experiments at the JSI TRIGA MARK II reactor - Current status and future outlook

Full text of publication follows. With the development of new high-fidelity computational methods, improvement of nuclear data, and multiphysics modelling, there is an increased need for benchmark experiments to experimentally validate the models, methods and input data. Many of the nuclear facilities designed to perform reactor physics benchmark experiments have been shut down. Therefore, research reactors offer a great opportunity for benchmark experiments, if they are well designed and performed with great care and accuracy. In this presentation we provide an overview of the past and ongoing activities related to benchmark experiments at the Jozef Stefan Institute TRIGA Mark II research reactor. The following experiments have been performed: criticality with fresh fuel, {sup 197}Au(n,γ) and {sup 27}Al(n,α) reaction rates in irradiation channels, absolute and relative {sup 197}Au(n,γ), {sup 235}U(n,f) and {sup 238}U(n,f) reaction rates in the core, burnup, kinetic parameters, control rod worth, isothermal reactivity coefficient, self-shielding, slow and fast (pulse) transients, nuclear heating, delayed and prompt gamma ray production, temperature profiles for multi-physics. Since the existing fleet of research reactors is ageing very rapidly and new experiments are needed, new research reactors should be designed and built to meet the needs of future advanced reactors, education and training, and other technologies in the coming years. We will review planned activities at the JSI TRIGA reactors and plans for the new research reactor in Slovenia. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Development of Shielding Benchmarks Using the Godiva IV Assembly

The Nuclear Criticality Safety Program (NCSP) is developing a shielding benchmark using the Godiva IV assembly as a source. Its present status is reviewed herein. Even eight decades into the nuclear era, substantial work remains to develop a database of shielding benchmarks to support future nuclear development. A nuclear simulation is only as good as its supporting data, inputs, and validation basis. Uncertainty in these areas is addressed using conservatism, which adds margin and, occasionally, cost. In many shielding situations, high accuracy is not necessary because additional material is not particularly expensive. After all, 1–2 cm of lead often reduces the gamma ray dose substantially. However, in certain areas, conservatism can add unnecessary cost. These areas include mobile shielding applications such as casks, ships, microreactors, and spacecraft, where weight and, thus, margin is expensive. Although these characteristics are side benefits for NCSP shielding benchmark development, the main driver is enabling more reliable placement of criticality accident alarm systems (CAASs) in nuclear material facilities, such as those dedicated to the production of advanced reactor fuels. CAAS placement relies on more than accurate data and code validation. It also relies on sufficiently accurate materials specifications, geometry specifications, and a well-defined, alarm-producing baseline accident. All these things require tacit knowledge and understanding of the problem being evaluated. Benchmarks can help ensure this understanding.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

RELAP5-3D in the OECD-NEA HTGR Thermal Hydraulics Benchmark

The OECD-NEA HTGR Thermal Hydraulics benchmark uses data from the High Temperature Test Facility for a series of code-to-code and code-to-data exercises aimed at improving the state of knowledge on existing thermal hydraulics modeling and simulation tools for prismatic HTGR applications. This benchmark includes problems representing hot gas mixing in the lower plenum, the depressurized conduction cooldown accident and the pressurized conduction cooldown accident. This presentation discusses the benchmark and RELAP5-3D's role in that benchmark, including as a tool for predicting behavior in the core and as a tool for providing boundary conditions to computational fluid dynamics analysis in the lower plenum.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Levermore-Pomraning Model Results for an Interior Source Binary Stochastic Medium Benchmark Problem

The accuracy of the Levermore-Pomraning model for particle transport through a binary stochastic medium is investigated using an interior source benchmark problem. As in previous comparisons of the model for incident angular flux benchmark problems, the model accurately computes the leakage and the scalar flux distributions for optically thin slabs. The model is less accurate for more optically thick slabs but has a maximum relative error in the leakage of approximately 10% for the problems examined. The maximum root-mean-squared relative errors for the total and material scalar flux distributions approach 65% for the more optically thick slabs. Consistent with previous benchmark comparisons, the results of these interior source benchmark comparisons demonstrate that the Levermore-Pomraning model produces qualitatively correct and semi-quantitatively correct results for both leakage values and scalar flux distributions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Benchmark Analysis of Subcritical Noise Measurements on a Nickel-Reflected Plutonium Metal Sphere

Subcritical experiments using californium source-driven noise analysis (CSDNA) and Feynman variance-to-mean methods were performed with an alpha-phase plutonium sphere reflected by nickel shells, up to a maximum thickness of 7.62 cm. Both methods provide means of determining the subcritical multiplication of a system containing nuclear material. A benchmark analysis of the experiments was performed for inclusion in the 2010 edition of the International Handbook of Evaluated Criticality Safety Benchmark Experiments. Benchmark models have been developed that represent these subcritical experiments. An analysis of the computed eigenvalues and the uncertainty in the experiment and methods was performed. The eigenvalues computed using the CSDNA method were very close to those calculated using MCNP5; however, computed eigenvalues are used in the analysis of the CSDNA method. Independent calculations using KENO-VI provided similar eigenvalues to those determined using the CSDNA method and MCNP5. A slight trend with increasing nickel-reflector thickness was seen when comparing MCNP5 and KENO-VI results. For the 1.27-cm-thick configuration the MCNP eigenvalue was approximately 300 pcm greater. The calculated KENO eigenvalue was about 300 pcm greater for the 7.62-cm-thick configuration. The calculated results were approximately the same for a 5-cm-thick shell. The eigenvalues determined using the Feynman method are up to approximately 2.5% lower than those determined using either the CSDNA method or the Monte Carlo codes. The uncertainty in the results from either method was not large enough to account for the bias between the two experimental methods. An ongoing investigation is being performed to assess what potential uncertainties and/or biases exist that have yet to be properly accounted for. The dominant uncertainty in the CSDNA analysis was the uncertainty in selecting a neutron cross-section library for performing the analysis of the data. The uncertainty in the Feynman method was equally shared between the uncertainties in fitting the data to the Feynman equations and the neutron multiplicity of 239 Pu. Material and geometry uncertainties in the benchmark experiment were generally much smaller than uncertainties in the analysis methods.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Evaluating Performance Portability of Accelerator Programming Models using SPEC ACCEL 1.2 Benchmarks

As heterogeneous architectures are becoming mainstream for HPC systems, application programmers are looking for programming model implementations that offer both performance and portability across platforms. Two directive-based programming models for accelerator programming that aim at doing this are OpenMP 4/4.5 and OpenACC. Many users want to know the difference between these two programming models, the state of their implementations, how to use them, and evaluate how suitable they are for their applications.The Standard Performance Evaluation Corporation (SPEC) ACCEL benchmarks, developed by the SPEC High Performance Group (HPG), recently released SPEC ACCEL 1.2 benchmark suite to help the evaluation of OpenCL, OpenMP 4.5 and OpenACC on different platforms. Inthis paper we present our preliminary results that evaluates OpenMP4.5 and OpenACC on a variety of accelerator-based systems: POWER9with NVIDIA V100 GPUs (Summit), Intel Xeon Phi 7230 (Percival), and AMD Bulldozer Opteron with NVIDIA K20x (Titan). Comparing these benchmarks on different systems gives us insight into the support for OpenMP and OpenACC and their execution times provide insights about their quality of implementations provided by different vendors. We also compare best of OpenMP and OpenACC to see if a particular programming model favors a particular type of benchmark kernel.

Boehm, Swen↗

Benchmarking Cylindrical Blast Wave Theory Against the OSIRIS-REx Sample Return Capsule Reentry

Weak shock theory based on cylindrical blast waves has been used to interpret meteor infrasound, but it has not been systematically benchmarked against a non-ablating hypersonic source with independently known parameters. The objective of this study is not to propose a new theoretical framework, but to evaluate the operational validity of the existing suite of blast radius formulations against a high-fidelity ground truth dataset. The OSIRIS-REx Sample Return Capsule reentry on 24 September 2023 provides such a benchmark because the capsule geometry, trajectory, and infrasound emission points are constrained from mission data and ray tracing, reducing source-side uncertainty associated with ablation. Using observations from 39 infrasound stations, this benchmarking study evaluates six published blast radius (${R}_{0}$ ) formulations and three weak-shock transition coefficients ( C ) within a stratified atmospheric propagation model to predict signal period and peak overpressure. The benchmarking identifies the Sakurai formulation as the best-performing formulation for non-ablating bodies, with the Jones/Plooster formulation performing comparably when a physically appropriate C is adopted. Sakurai and Jones/Plooster yield linear-period median absolute percentage residuals of 9% and 11%, respectively. The period predictions show only weak sensitivity to C at these propagation distances. The Mach-diameter approximation commonly used in meteor studies overestimates ${R}_{0}$ by more than a factor of 3 in the absence of ablation. Finally, these results establish a performance baseline for applying cylindrical blast wave theory to effectively non-ablating hypersonic bodies and demonstrate that the signal period is a robust observable for constraining ${R}_{0}$.

atmospheric entry↗

Monte Carlo neutronics benchmarks on nuclear fuel depletion: A review

Monte Carlo (MC) neutronics codes are used widely for academic and industrial needs. Several schemes of coupling MC neutronics code with isotope generation and depletion code exist, which are used for performing nuclear fuel depletion simulations. These simulations can estimate the inventory of isotopes in neutron irradiated nuclear reactor fuel. However, the accuracy of these simulations shall be validated through experiments. MC codes are seldom validated by isotopic benchmarks compared to criticality benchmarks. This work compiles and analyzes the fuel depletion benchmarks and validations used to analyze the performance of MC-based fuel depletion neutronics codes. Analyses of these benchmarks and validations showed that the computed concentrations of 133 Cs, 135 Cs, 137 Cs, 148 Nd, 239 Pu, 240 Pu, and 241 Pu in the irradiated fuel by the depletion codes agreed with the measured values within 10% error. However, the computed concentrations of 125 Sb, 242 Cm, 243 Cm, 244 Cm, 245 Cm, and 246 Cm had errors more than 15% compared to the measured values. As a result, Ventina depletion code showed the most accurate predictions for the greatest number of isotope concentrations compared to ORIGEN2 and CINDER90.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Electric load shape benchmarking for small- and medium-sized commercial buildings

Small- and medium-sized commercial buildings owners and utility managers often look for opportunities for energy cost savings through energy efficiency and energy waste minimization. However, they currently lack easy access to low-cost tools that help interpret the massive amount of data needed to improve understanding of their energy use behaviors. Benchmarking is one of the techniques used in energy audits to identify which buildings are priorities for an energy analysis. Traditional energy performance indicators, such as the energy use intensity (annual energy per unit of floor area), consider only the total annual energy consumption, lacking consideration of the fluctuation of energy use behavior over time, which reveals the time of use information and represents distinct energy use behaviors during different time spans. To fill the gap, this study developed a general statistical method using 24-hour electric load shape benchmarking to compare a building or business/tenant space against peers. Specifically, the study developed new forms of benchmarking metrics and data analysis methods to infer the energy performance of a building based on its load shape. We first performed a data experiment with collected smart meter data using over 2,000 small- and medium-sized businesses in California. We then conducted a cluster analysis of the source data, and determined and interpreted the load shape features and parameters with peer group analysis. Finally, we implemented the load shape benchmarking feature in an open-access web-based toolkit (the Commercial Building Energy Saver) to provide straightforward and practical recommendations to users. The analysis techniques were generic and flexible for future datasets of other building types and in other utility territories.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

SoK: What does it Mean to Benchmark Database Forensics?

Relational Database Management Systems are the backbone of modern enterprises and public-sector services, and are thus frequent targets of security incidents, insider threats, and thorough regulatory audits. Consequently, databases have become key sources of digital evidence, requiring investigators to reconstruct past activity from audit logs, transaction logs, and backups. Although benchmarking frameworks such as those developed by the Transaction Processing Performance Council (TPC) are widely used to evaluate database performance, they do not capture forensic requirements such as evidentiary completeness, tamper-evidence, chain of custody, or regulatory compliance under GDPR and CCPA. This survey examines the emerging domain of forensic database benchmarking. We gathered prior research on database forensics, secure logging, and tamper-evident data structures; we analyze modern forensic-ready features in commercial and open-source systems (SQL Server Ledger, Oracle Blockchain Tables, PostgreSQL pgAudit, Db2 Audit, Aurora Database Activity Streams, Oracle Real Application Security and IBM Guardium) and assess why existing benchmarks are insufficient. We propose forensic workloads, metrics, and methodologies that incorporate adversarial stressors, deleted-record recovery, and backup analysis. We also identify open research problems and call for a community-driven forensic benchmark suite. The result is an idea for evaluating not only database performance but also forensic soundness, bridging the gap between system engineering, compliance, and digital investigations.

Lenard, Ben↗

Development of a U-19Pu-10Zr fuel performance benchmark case based on the IFR-1 experiment

Metallic nuclear fuels are subject to research and development for use in advanced reactors. Robust, accurate metallic fuel performance models are important for the design, safety analysis, and licensing of these reactors. However, metallic fuel performance models require additional development; they are not as mature as UO 2 fuel performance models. A benchmark case based on the IFR-1 experiment was developed to better gauge the accuracy of existing models, identify models for high-priority development, and potentially quantify any future improvements made by further model development.This work collected publicly available information on the IFR-1 experiment and used it to develop the benchmark case. Fuel behavior during the IFR-1 irradiation was simulated by using the fuel performance code BISON, and the predicted results were compared with postirradiation examination data from the IFR-1 experiment. Furthermore, a sensitivity study and tuning studies were performed as a preliminary investigation into the causes of inaccurate temperature and dimensional change predictions.The benchmark predicted reasonably accurate values for the burnup and fission gas release. There was error in the predicted temperatures, which could be explained by uncertainty in the input parameters and legacy temperatures. BISON over-predicted dimensional changes in the fuel and cladding. The sensitivity study showed that the dimensional changes were most sensitive to the fuel swelling anisotropy and the cladding void swelling model. Future benchmark and model development should focus on cladding swelling behaviors to improve dimensional change predictions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗