Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

MC21/CTF and VERA-CS Mutiphysics Solutions to VERA Core Physics Benchmark Problems 6 and 7

The continuous energy Monte Carlo neutron transport code, MC21, was coupled to the CTF subchannel thermal-hydraulics code using a combination of CASL tools and in-house Python scripts. An MC21/CTF solution for VERA Core Physics Benchmark Progression Problem 6 demonstrated excellent agreement with MC21/COBRA-IE and VERA solutions. The MC21/CTF solution for VERA Core Physics Benchmark Progression Problem 7, Watts Bar Unit 1 at beginning of cycle (BOC) hot full power (HFP) equilibrium xenon conditions, is the first published coupled Monte Carlo neutronics / subchannel T-H solution for this problem. MC21/CTF predicted a critical boron concentration of 854.5 ppm, yielding a critical eigenvalue of 0.99994 ± 6.8E-6 (95% CI). Excellent agreement with a VERA solution of Problem 7 was also demonstrated for integral and local power and temperature parameters.

Aviles, Brian↗

U-10Mo Conversion Burnup Benchmarking Activities for Full-Size LEU Fuel Plates

Validation benchmark experiments for low-enriched uranium (LEU) U-Mo fuel systems are currently being developed from existing experiments irradiated in the Advanced Test Reactor. (ATR) and ATR Critical Facility (ATRC). The experiments chosen include the ATR Full size plate In center Flux trap Position (AFIP-7) experiment and the Ki-Jang Research Reactor Lead Test Assembly (KJRR-LTA) located in the Northeast Flux Trap. Each experiment was modeled using a high-fidelity three-dimensional Monte Carlo code with depletion capabilities. A description of the validation experiments will be provided as well as comparison to post irradiation examination results for the AFIP-7 experiment. The PIE results for the AFIP-7 experiment have demonstrated good agreement with analytical models. Due to the complex nature in of the ATR, modeling simplifications to support benchmark activities using lower fidelity reactor physics software. A discussion of the analytical bias associated with modeling simplifications will also be provided.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Land Model Testbed: Accelerating Development, Benchmarking and Analysis of Land Surface Models

A Land Model Testbed (LMT), designed to provide a computational framework for systematically assessing model fidelity and supporting rapid development of complex multiscale models, offers a general-purpose workflow for conducting large ensemble simulations of multiple land surface models, post-processing large volumes of model output, and evaluating model results. It leverages existing tools for launching model simulations and the International Land Model Benchmarking (ILAMB) package for assessing model fidelity through comparison with best-available observational datasets. Increased complexity and proliferation of uncertain parameters in process representations in land surface models has driven the need for frequent and intensive testing and evaluating of models to quantify uncertainties and optimize parameters such that results are consistent with observations. The LMT described here meets these needs by providing tools to run thousands of ensemble simulations simultaneously and post-process their output files, by automating execution of an enhanced version of ILAMB with site-specific benchmarks and multivariate functional relationships, and by offering ensemble diagnostics and a customizable dashboard for displaying model performance metrics and associated graphics. We envision the LMT capabilities will serve as a foundational computational resource for a proposed user facility focused on terrestrial multiscale model--data integration.

Sreepathi, Sarat↗

Transparent Object Tracking Benchmark

Visual tracking has achieved considerable progress in recent years. However, current research in the field mainly focuses on tracking of opaque objects, while little attention is paid to transparent object tracking. In this paper, we make the first attempt in exploring this problem by proposing a Transparent Object Tracking Benchmark (TOTB). Specifically, TOTB consists of 225 videos (86K frames) from 15 diverse transparent object categories. Each sequence is manually labeled with axis-aligned bounding boxes. To the best of our knowledge, TOTB is the first benchmark dedicated to transparent object tracking. In order to understand how existing trackers perform and to provide comparison for future research on TOTB, we extensively evaluate 25 state-of-the-art tracking algorithms. The evaluation results exhibit that more efforts are needed to improve transparent object tracking. Besides, we observe some nontrivial findings from the evaluation that are discrepant with some common beliefs in opaque object tracking. For example, we find that deeper features are not always good for improvements. Moreover, to encourage future research, we introduce a novel tracker, named TransATOM, which leverages transparency features for tracking and surpasses all 25 evaluated approaches by a large margin. By releasing TOTB, we expect to facilitate future research and application of transparent object tracking in both the academia and industry.

97 MATHEMATICS AND COMPUTING↗

Towards a Benchmark Experiment with the Compact Nuclear Power Source

The Compact Nuclear Power Source (CNPS) was a high-assay low enriched uranium (HALEU) tristructural isotropic (TRISO)-fueled, graphite-moderated microreactor constructed in 1987 at Los Alamos National Laboratory. The reactor, conceived as a power source for short-range radar stations, was designed to be "walk-away safe," and was cooled by heat pipes and ambient air. Though the project was formally cancelled after the fuel and moderator material had been received, its potential to meaningfully advance the body of critical and integral data was evident, and critical experiments with a mock-up of the reactor proceeded at TA-18 until its disassembly in 1991. The reflector and some components of the core would later go on to see service as part of the New Production Reactor Modular High-Temperature Gas-Cooled Reactor (NP-MHTGR) critical experiments. In light of the progress made by groups like Westinghouse and X-Energy towards contemporary graphite-moderated microreactors, the system remains an attractive candidate for the basis of a benchmark experiment even today. Uncertainties remain, however, in some features of the system–inconsistencies in the dimensions and composition of the reactor’s components as described in literature and implemented in current computational models. The identification, quantification, and to the extent possible, the minimization of these uncertainties is a crucial task on the path towards creating a benchmark based on the CNPS system. The present work seeks to initiate this process with a survey of available documentation and improvements to the accuracy of CNPS neutronics models.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Wind Turbine Noise Code Benchmark: A Comparison and Verification Exercise: Preprint

In a number of institutions and companies, researchers and engineers are developing modeling numerical frameworks that are used to predict the aerodynamic noise emission from a wind turbine rotor. The simulation codes vary from empirically-tuned engineering models to high-fidelity computational ones. Their common feature is the fact that they all specifically model the main aerodynamic noise mechanisms occurring at the rotating blades, namely trailing edge noise and turbulent inflow noise. Nevertheless, it can be expected that these different modeling frameworks will produce different results for a same given rotor design, and identical operating conditions. Trailing edge noise is put at the forefront of the study as it is recognized as the main audible source of noise from wind turbines. The present benchmark aims at comparing the results from the different modeling approaches, and drawing some conclusions from these comparisons. This effort, denoted as Wind Turbine Noise Code benchmark, was initiated in 2019 as a joint-activity between the IEA Wind Task 39 (Quiet Wind Turbine Technology) and Task 29 (Detailed Aerodynamics of Wind Turbines, now Task 47). In addition to the investigation of the noise emissions themselves, the rotor aerodynamic characteristics are investigated as they have a significant impact on the noise generation mechanisms. A number of test cases are defined and the aerodynamic and aeroacoustic predictions from the various models are compared. There exist some discrepancies between the different methods, but it is difficult to conclude if one methodology is better than another in order to design a wind turbine with noise as a constraint.

aeroacoustics↗

OECD RIA Benchmark Phase II - Towards a better understanding of the RIA fuel modelling

This paper deals with the second phase of the RIA (reactivity initiated accident) fuel rod code benchmark for water-cooled reactors that began in 2014. This second phase has been organized around 2 complementary activities: the first activity is to compare the results of different simulations on simplified cases in order to provide additional bases for understanding the differences in modelling of the concerned phenomena, while the second activity is focused on the assessment of the uncertainty of the results. The detailed specification and comparison of the results from the first activity is presented in this paper. Based on the Phase-I and Phase-II conclusions, some generic recommendations can be made. First, fuel and clad thermomechanical models (with the associated material properties) should be further improved and validated more extensively against a sound RIA database. Secondly, build-up of a comprehensive and robust database consisting of both separate-effect tests and integral tests should be pursued in the short term to reinforce the basis for assessment of both individual model and model integration into codes. Thirdly, an assessment of the uncertainty of fuel thermo-mechanics is of high interest (which is consistent with the second activity of this RIA benchmark Phase-II). Finally, as RIA fuel codes are more and more likely to be used for reactor accident studies, particularly for those involving safety analyses, the fuel rod failure criteria (generally used in such analyses) will have to be carefully justified and validated. The current RIA fuel failure criteria are mainly based on the fuel thermal variables and the verification is based on 'conservative' assumptions for the heat transfer conditions. As all codes give rather consistent evaluations of such variables, it appears possible, taking into account adequate provisions, to derive criteria based on thermal variables from experimental values or from an analytical approach. However, if in the future more mechanistic modelling is ever to be used to establish fuel-failure criteria based on mechanical variables, weaknesses in the validation of the codes identified above will have to be accounted for.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Benchmark Testing of a new {sup 56}Fe evaluation for criticality safety applications - 14451

The SAMMY code was used to evaluate resonance parameters of the {sup 56}Fe cross section in the resolved resonance energy range of 0-2 MeV using transmission data, capture, elastic, inelastic, and double differential elastic cross sections. The resonance analysis was performed with the code SAMMY that fits R-matrix resonance parameters using the generalized least-squares technique (Bayes' theory). The evaluation yielded a set of resonance parameters that reproduced the experimental data very well, along with a resonance parameter covariance matrix for data uncertainty calculations. Benchmark tests were conducted to assess the evaluation performance in benchmark calculations. (authors)

42 ENGINEERING↗

Investigation of the Impact of TSL Data Libraries and Geometry Variations on the MSRE Benchmark

The increasing demand for green, low-carbon energy solutions has amplified the focus on advanced nuclear reactor technologies. Among these, Molten Salt Reactors (MSRs) have been spotlighted because of their special features. Historically, Oak Ridge National Laboratory (ORNL) started the Molten Salt Reactor Experiment (MSRE) in 1956. Later, ORNL and the University of California, Berkeley (UCB) jointly developed the MSRE benchmark. This was then reviewed by the International Reactor Physics Experiment Evaluation Project (IRPhEP) committee and added to their 2019 handbook. In the current study, the benchmark model was recreated via the Serpent code. The calculated effective multiplication factor was 1.02087 ± 0.00019, which gives a deviation of about 2000 pcm compared to the benchmark/experimental result. At North Carolina State University (NCSU), recent evaluations were conducted on thermal scattering cross sections for molten salt FLiBe and 20% porous nuclear graphite, anticipated for incorporation in the ENDF/B-VIII.1 library. The influences of these thermal scattering law (TSL) data and geometry changes on the multiplication factor were examined using the ENDF/B-VII.1 and ENDF/B-VIII.0 libraries. Introducing the TSL data for FLiBe and 20% porous graphite resulted in an effective multiplication factor of +270 pcm compared to the reference value obtained with ENDF/B-VII.1 in this study. The adjustment of the reactor vessel dimensions resulted in decrease of -448 pcm in the calculated effective multiplication factor.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Status of the CERBERUS Evaluation for the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook

Modeling & Simulation (M&S) tools are used to analyze advanced reactor designs and the safety of current nuclear operations. As computers continue to improve, we are able to enhance resolution in our calculations. Therefore, the limitations of simulation capability are in the quality of data that is being used, including our ability to quantify the uncertainty and sensitivity of that data. In order to model systems of interest with increasing accuracy, the industry must improve key nuclear data measurements. The International Criticality Safety Benchmark Evaluation Project (ICSBEP) compiles and evaluates experiment data in a handbook that can be used by criticality safety engineers and others to validate computer codes and cross section libraries at nuclear facilities. Both critical and subcritical experiments are included in the handbook. These experiments, along with differential measurements, can help improve the quality of nuclear data. Concerns regarding the accuracy of Cu nuclear data have been published. The large values and trend of C-E for the Zeus intermediate energy benchmark, being one of the primary examples. Furthermore, very few experiments have been designed to be sensitive to Cu (as shown in Figure 1), so an integral, critical experiment is needed to help resolve these differences.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NEA HTTR LOFC Project Test#3 Benchmark Results

In the second half of FY23, the High Temperature Engineering Test Reactor (HTTR) Loss Of Forced Cooling (LOFC)#3 data for the 9 MW test case with Vessel Cooling System (VCS) off were made available through the Nuclear Energy Agency (NEA) LOFC project framework; the neutronic model developed for the initial test (LOFC#1) achieved a satisfactory level of maturity, demonstrating its accuracy in predicting power evolution and core re-criticality, but LOFC#3 should be used primarily to investigate thermal hydraulic phenomena, as the reactor was shut down prematurely due to overheating in the upper reactor components, which prevented re-criticality; this report focuses on advancing the HTTR thermal hydraulic model to accurately simulate the LOFC#3 scenario, including simulating the LOFC#3 benchmark and generating the corresponding benchmark specifications, aiming to ensure consistency across participant models and provide essential data for future participants, including private industry stakeholders seeking to validate their computational tools.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

LC-Opt: Benchmarking Reinforcement Learning and Agentic AI for End-to-End Liquid Cooling Optimization in Data Centers

Liquid cooling is critical for thermal management in high-density data centers with the rising AI workloads. However, machine learning-based controllers are essential to unlock greater energy efficiency and reliability, promoting sustainability. We present LC-Opt, a Sustainable Liquid Cooling (LC) benchmark environment, for reinforcement learning (RL) control strategies in energy-efficient liquid cooling of high-performance computing (HPC) systems. Built on the baseline of a high-fidelity digital twin of Oak Ridge National Lab's Frontier Supercomputer cooling system, LC-Opt provides detailed Modelica-based end-to-end models spanning site-level cooling towers to data center cabinets and server blade groups. RL agents optimize critical thermal controls like liquid supply temperature, flow rate, and granular valve actuation at the IT cabinet level, as well as cooling tower (CT) setpoints through a Gymnasium interface, with dynamic changes in workloads. This environment creates a multi-objective real-time optimization challenge balancing local thermal regulation and global energy efficiency, and also supports additional components like a heat recovery unit (HRU). We benchmark centralized and decentralized multi-agent RL approaches, demonstrate policy distillation into decision and regression trees for interpretable control, and explore LLM-based methods that explain control actions in natural language through an agentic mesh architecture designed to foster user trust and simplify system management. LC-Opt democratizes access to detailed, customizable liquid cooling models, enabling the ML community, operators, and vendors to develop sustainable data center liquid cooling control solutions.

Naug, Avisek [Hewlett Packard Enterprise]↗

Benchmarking quantum trial wavefunctions for phaseless auxiliary-field quantum Monte Carlo

The phaseless auxiliary-field quantum Monte Carlo (ph-AFQMC) method is a stochastic imaginary-time projection technique for computing ground-state properties of strongly correlated quantum systems, with accuracy that depends critically on the choice of trial wavefunction. Here, we investigate ph-AFQMC with trial states prepared using parameterized quantum circuits. In this work, we present a comprehensive benchmarking study of quantum trial wavefunctions spanning unitary coupled-cluster, Hamiltonian-informed, Jastrow-inspired, and adaptively constructed ansatze. The benchmarking evaluates accuracy, expressibility, and scalability of these ansatze within the QC-AFQMC framework. We test these ansatze on linear hydrogen chains under bond stretching and find that several ansatz families produce chemically accurate ph-AFQMC energies across the dissociation curve. We have performed simulations using the CUDA-Q quantum development platform on the GPU partition of the Perlmutter supercomputer. When comparing ansatze at similar numbers of variational parameters, we find that different ansatz families yield comparable ph-AFQMC results despite exhibiting substantially different variational energies, optimization costs, and circuit depths. Our results indicate that the variational energy of an ansatz is not always a reliable indicator of its quality for ph-AFQMC and reveal instances of over-parameterization. In the strongly correlated regime, trial wavefunctions obtained from adaptive ansatze, exemplified here by ADAPT-VQE with the UCCSD operator pool, can outperform their fixed-ansatz counterparts (UCCSD) in terms of projected energies while using substantially more compact circuits, providing a flexible route to optimize quantum resources within the ph-AFQMC framework.

Rofougaran, Rod [LBNL, Berkeley; Columbia U.; PNL,↗

Benchmarking of collimation tracking using RHIC beam loss data.

State-of-the-art tracking tools were recently developed at CERN to study the cleaning efficiency of the Large Hadron Collider (LHC) collimation system. In order to estimate the prediction accuracy of these tools, benchmarking studies can be performed using actual beam loss measurements from a machine that already uses a similar multistage collimation system. This paper reviews the main results from benchmarking studies performed with specific data collected from operations at the Relativistic Heavy Ion Collider (RHIC).

43 PARTICLE ACCELERATORS↗

Benchmarking and Equipment and Controls Assessment for a 'Big Box' Retail Chain

The paper describes work to enable improved energy performance of existing and new retail stores belonging to a national chain and thereby also identify measures and tools that would improve the performance of 'big box' stores generally. A detailed energy simulation model of a standard store design was developed and used to: (1) demonstrate the benefits of benchmarking the energy performance of retail stores of relatively standard design using baselines derived from simulation, (2) identify cost-effective improvements in the efficiency of components to be incorporated in the next design cycle, and (3) use simulation to identify potential control strategy improvements that could be adopted in all stores, improving operational efficiency. The core enabling task of the project was to develop an energy model of the current standard design using the EnergyPlus simulation program. For the purpose of verification of the model against actual utility bills, the model was reconfigured to represent twelve existing stores (seven relatively new stores and five older stores) in different US climates and simulations were performed using weather data obtained from the National Weather Service. The results of this exercise, which showed generally good agreement between predicted and measured total energy use, suggest that dynamic benchmarking based on energy simulation would be an effective tool for identifying operational problems that affect whole building energy use. The models of the seven newer stores were then configured with manufacturers performance data for the equipment specified in the current design and used to assess the energy and cost benefits of increasing the efficiency of selected HVAC, lighting and envelope components. The greatest potential for cost-effective energy savings appears to be a substantial increase in the efficiency of the blowers in the roof top units and improvements in the efficiency of the lighting. The energy benefits of economizers on the roof-top units were analyzed and found to be very sensitive to the operation of the exhaust fans used to control building pressurization.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Benchmarking the x-ray phase contrast imaging for ICF DT ice characterization using roughened surrogates

We use x-ray phase contrast imaging to characterize the inner surface roughness of DT ice layers in capsules planned for future ignition experiments. It is therefore important to quantify how well the x-ray data correlates with the actual ice roughness. We benchmarked the accuracy of our system using surrogates with fabricated roughness characterized with high precision standard techniques. Cylindrical artifacts with azimuthally uniform sinusoidal perturbations with 100 um period and 1 um amplitude demonstrated 0.02 um accuracy limited by the resolution of the imager and the source size of our phase contrast system. Spherical surrogates with random roughness close to that required for the DT ice for a successful ignition experiment were used to correlate the actual surface roughness to that obtained from the x-ray measurements. When comparing average power spectra of individual measurements, the accuracy mode number limits of the x-ray phase contrast system benchmarked against surface characterization performed by Atomic Force Microscopy are 60 and 90 for surrogates smoother and rougher than the required roughness for the ice. These agreement mode number limits are >100 when comparing matching individual measurements. We will discuss the implications for interpreting DT ice roughness data derived from phase-contrast x-ray imaging.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NERSC-6 Workload Analysis and Benchmark Selection Process

This report describes efforts carried out during early 2008 to determine some of the science drivers for the"NERSC-6" next-generation high-performance computing system acquisition. Although the starting point was existing Greenbooks from DOE and the NERSC User Group, the main contribution of this work is an analysis of the current NERSC computational workload combined with requirements information elicited from key users and other scientists about expected needs in the 2009-2011 timeframe. The NERSC workload is described in terms of science areas, computer codes supporting research within those areas, and description of key algorithms that comprise the codes. This work was carried out in large part to help select a small set of benchmark programs that accurately capture the science and algorithmic characteristics of the workload. The report concludes with a description of the codes selected and some preliminary performance data for them on several important systems.

97 MATHEMATICS AND COMPUTING↗

EBR-II Reactor Physics Benchmark Evaluation Report

This report provides a reactor physics benchmark evaluation with associated uncertainty quantification for the critical configuration of the April 1986 Experimental Breeder Reactor II Run 138B core configuration.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗