Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BENCHMARKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Benchmark Testing on the IBM-Q Network

The goal of this project is to evaluate a proposed set of candidate benchmarks being developed by the Standards and Performance Metrics Technical Advisory Group (TAG) of the Quantum Economic Development Consortium (QED-C), of which LANL is a member. The QED-C Standards and Performance Metrics TAG has developed implementations of several benchmark codes with the hope and expectation that these codes will be helpful to QED-C members interested in investigating various quantum computer platforms. The benchmark set will be run on LANL’s access to the IBM-Q system with the intent to evaluate the set for scalability, correct execution, and coverage of the application space. The goal is for the QED-C Standards and Performance Metrics TAC to be able to produce a coherent, consistent, scalable set of benchmarks that will run on multiple quantum computing platforms and will be available to members of QED-C, including LANL.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Plutonium Production Reactor Progression Problems: Magnox Neutronics Benchmarks

The goal of this document is to provide a set of comprehensive benchmarking neutronics problems for gas-cooled, graphite-moderated reactors. The problems are designed to be representative problems that increase in complexity to test performance of various codes. For the simulation of the benchmarking problems, the Shift Monte Carlo code and MPACT deterministic code are chosen because of their state-of-the-art capabilities, which are optimized for various reactor designs. Because these codes have been developed primarily for light water reactor applications, their application to graphite-moderated, gas-cooled reactors has not been extensively explored. This report attempts to evaluate benchmarks for a Magnox-style reactor, one that is graphite-moderated and gas-cooled. Parameters that are calculated and presented in this benchmark include the eigenvalue, peaking factors, and isotope concentrations. Results show good agreement between Shift and MPACT, and demonstrate the capability of MPACT to model graphite-moderated systems well.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Questionable Benchmarks [Slides]

An investigation and initial review of ‘questionable benchmarks’ was performed at LANL. Multiple methods were used, including machine learning techniques, to identify 'questionable benchmarks' and/or benchmarks with low uncertainties. Those benchmarks were then reviewed for obvious errors. This is not a recommendation to ICSBEP, but can be used as a starting point for a more comprehensive review. A journal paper is being written on this work.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

International Benchmarking: A Global Perspective of Workplace Drug and Alcohol Testing

Workplace drug and alcohol testing has been widely implemented in diverse industries and is designed to detect the use of and deter the influence of legal and illegal substances that would impair the ability to perform work that has significant security and safety implications. Across the globe, patterns of drug and alcohol use and abuse and the regulations controlling drug and alcohol use vary by location (e.g., regions, countries, etc.). The prevalence of workplace drug and alcohol testing and protection of individuals’ rights in the workplace similarly tend to exhibit contextual differences. With the advancements in drug-testing technologies and the recent issuance of guidance for additional testing matrices (e.g., oral fluid, hair, etc.) by the U.S. Department of Health and Human Services, gaining a global perspective on the current state of drug and alcohol testing practices and regulations is important for leveraging such advancements to improve the effectiveness of drug and alcohol testing. The U.S. Nuclear Regulatory Commission (NRC) tasked the Pacific Northwest National Laboratory (PNNL) fitness for duty (FFD) team to conduct a benchmarking analysis of international drug and alcohol testing regulations and programs to identify similarities and differences in workplace testing programs and the basis for any differences. The benchmarking study focuses on a policy analysis and benchmarking metrics comparison among different countries and regions. The policy analysis includes the following three types of relevant international and national policies relevant to drug and alcohol testing in the nuclear industry: 1. National drug and alcohol policy 2. Workplace drug and alcohol testing 3. FFD regulations for Nuclear Power Plants The international drug and alcohol benchmarking metrics focusses on the use of blood, breath, urine, hair, and oral fluid in testing; drug and drug metabolite cutoff values; point-of-collection testing devices; roadside testing methodologies; innovations in drug testing; and the extent of availability of such data. Gaining an understanding of workplace drug and alcohol testing in other countries as well as information about new testing methods, matrices, tools, and technologies that other countries have adopted provides NRC with international comparative information regarding the technical basis for such programs and methods as it relates to the protection of worker and public health and safety.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2025

The Risk Assessment Information System Compendium of Ecological Screening Benchmarks for Chemicals and Radionuclides (2025) (Volume I – Text, Radionuclides for all Media, Chemicals for Air and Biota)

The Risk Assessment Information System Ecological Benchmark Tool compiles screening level benchmark values for assessing potential ecological risks posed by chemical and radionuclide contaminants. Drawing from a wide array of federal, state, and international sources, it consolidates benchmarks across environmental media, including soil, water, sediment, air, and biota, and presents values for a broad range of receptors and exposure pathways. The tool includes both effect-based and no-effect thresholds, with media- and organism-specific guidance derived from peer-reviewed literature and regulatory frameworks. By integrating diverse benchmark types into a unified reference, the tool supports consistent, scientifically grounded evaluations in ecological risk assessments and environmental management practices.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Demonstration of Optimal Benchmark Selection Website and Validation of the q c Coverage Metric Using HEU-SOL-THERM-013-003 Experiment

In the work documented in this interim report, the experiment selection toolkit web site was demonstrated and q C coverage metric methodology was validated for IEU-MET-FAST-002-001, MIX-COMP-THERM 004-004, and HEU-SOL-THERM-013-003 experiments. 𝑞 𝐶 is an information-theoretic measure based on mutual information that quantifies the ability of candidate benchmark experiments to reduce the bias and uncertainty of a target criticality safety application. The metric and an accompanying open-source Python toolkit with a web-based interface were tested against a benchmark set of 425 experiments drawn from the International Criticality Safety Benchmark Evaluation Project Handbook. The interface is hosted at https://edim.covdef.com. It accepts sensitivity data files produced by the TSUNAMI-IP module of the SCALE code system and supports both (i) deterministic analysis using the ENDF/B-VII.0 covariance library and (ii) stochastic analysis based on user-supplied keff samples. Demonstrations on representative applications across a range of material composition, spectrum, and form show that q C -guided benchmark selection achieves greater uncertainty reduction with fewer experiments and yields more stable posterior bias and uncertainty estimates than traditional similarity coefficient ( c k )–based selection, while also capturing valuable low-ck experiments that one-to-one metrics overlook.

Abdel-khalik, Hany S. [Indiana Univ.-Purdue Univ. ↗
DOE OSTI2021

Nuclear Data Sensitivity Study for the EBR-II Fast Reactor Benchmark Using SCALE with ENDF/B-VII.1 and ENDF/B-VIII.0

The EBR-II benchmark, which was recently included in the International Handbook of Evaluated Reactor Physics Benchmark Experiments, served as a basis for assessing the performance of the SCALE code system for fast reactor analyses. A reference SCALE model was developed based on the benchmark specifications. Great agreement was observed between the eigenvalue calculated with this SCALE model and the benchmark eigenvalue. To identify potential gaps and uncertainties of nuclear data for the simulation of various quantities of interest in fast spectrum systems, sensitivity and uncertainty analyses were performed for the eigenvalue, reactivity effects, and the radial power profile of EBR-II using the two most recent ENDF/B nuclear data library releases. While the nominal results are consistent between the calculations with the different libraries, the uncertainties due to nuclear data vary significantly. The major driver of observed uncertainties is the uncertainty of the 235 U ( n,γ ) reaction. Since the uncertainty of this reaction is significantly reduced in the ENDF/B-VIII.0 library compared to ENDF/B-VII.1, the obtained output uncertainties tend to be smaller in ENDF/B-VIII.0 calculations, although the decrease is partially compensated by increased uncertainties in 235 U fission and ν ¯ .

42 ENGINEERING↗
DOE OSTI2026

Benchmarking soil moisture and its relationship to ecohydrologic variables in Earth System Models

Soil moisture (SM) is a key regulator of ecosystem biogeophysics, influencing plant water relations and land-atmosphere energy exchanges. We evaluate the representation of SM in 16 Earth System Models from the Coupled Model Intercomparison Project Phase 6 (CMIP6) using the International Land Model Benchmarking (ILAMB) framework, focusing on surface (0–5, 0–10 cm) and rootzone (0–100 cm) depths, as well as key ecohydrological variables like gross primary productivity (GPP), leaf area index (LAI), and evapotranspiration (ET), and their coupling. Models are benchmarked against multiple observational and assimilated datasets to assess both state variables and cross-variable relationships. Surface SM is generally well represented (r > 0.87), while rootzone SM variability is systematically overestimated (normalized standard deviation > 1). ET shows strong agreement with observations (r > 0.9), whereas GPP and LAI exhibit larger inter-model spread. Skill in individual variables does not guarantee realistic SM–ecohydrology coupling, which varies strongly across models and depends on the reference dataset. Köppen-based regional analyses reveal strong regime dependence, with several models performing well in Tropical and Temperate regions but degrading in Continental (high-latitude) zones. Across both global and regional benchmarks, models cluster by land surface framework, indicating that structural choices in soil hydrology and soil–plant coupling exert a first-order control on performance. These results provide process-relevant benchmarks and suggest that improving the representation of vertical soil structure, rooting depth distributions, and soil–plant hydraulic coupling will be central to advancing soil moisture realism in next-generation Earth system models.

CMIP6↗
DOE OSTI2022

High-Fidelity Measurements for Flattop-HEU Benchmark Reevaluation

Flattop was first built in the 1950’s at Los Alamos National Laboratory. Flattop-HEU is composed of a sphere of highly enriched uranium (HEU) surrounded by a thick spherical natural uranium (NU) reflector. The reflector is composed of three parts: a stationary hemisphere and two movable quarter spheres. For fine control of the reactivity of the system, there are three control rods of natural uranium located in voids in the stationary hemisphere. The final components that make Flattop a useful critical assembly are the glory hole and mass adjustment pieces. These pieces can be loaded in various configurations into the glory hole and the core pedestal to control the known worth of the system. The glory hole and mass adjustment pieces are mostly small pieces of HEU with some mass adjustment pieces fabricated from NU. This allows for the irradiation of samples to a specified level. To better document the system, Flattop was evaluated and included in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) handbook. The original benchmark evaluation of Flattop-HEU was written in 1999 based on an experiment completed in the 1960’s. This original evaluation was written to provide a single diameter that defined critical mass; however, as computational capabilities have increased, the focus for benchmark evaluations has shifted to include detailed modelswith all physical dimensions. Thus, as Flattop is a lynchpin in critical experiment work, the benchmark is being reevaluated at current standards. This summary discusses some of the largest known uncertainties from the evaluation and the high-fidelity measurements taken to reduce these uncertainties.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

INL Contributions to Draft HTTF Benchmark Specifications

The High-Temperature Test Facility (HTTF) is an integral effects thermal hydraulics test facility at Oregon State University designed as a 1/4 length scale model of the Modular High-Temperature Gas-Cooled Reactor 350 MW core (mHTGR-350). In the spring and summer of 2019, several experiments were conducted at HTTF providing a valuable source of gas-cooled reactor thermal hydraulics data. Idaho National Laboratory (INL), Oregon State University, Argonne National Laboratory, and Canadian Nuclear Laboratories have partnered to use this experimental data to develop a gas-cooled reactor thermal hydraulics benchmark led by INL under the auspices of the Advanced Reactor Technologies (ART) program. This report provides some context on the benchmark, HTTF, and previous Reactor Excursions and Leak Analysis Program (RELAP)5-3D modeling of HTTF. It also provides a draft of the benchmark specifications for the Depressurized Conduction Cooldown problem, which is the INL-led benchmark problem.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Status of HEU-Pb in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook

The Department of Energy invests tens of millions of dollars each year to develop the next generation of nuclear engineering modeling & simulation (M&S) tools. These tools are used to analyze advanced reactor designs and the safety of current nuclear operations. As computers become more powerful, we are able to enhance resolution in our calculations. This improved resolution is taking us to a point where the limitations of simulation capability are in the quality of data, including our ability to quantify the uncertainty and sensitivity of the data. In order to model systems of interest with increasing accuracy, the industry must improve key nuclear data measurements. Thus, M&S tools need evaluated and quality-assured experimental data for validation purposes. The International Criticality Safety Benchmark Evaluation Project (ICSBEP) compiles and evaluates experiment data in a handbook that can be used by criticality safety engineers and others to validate computer codes and cross-section libraries at nuclear facilities. Both critical and subcritical experiments are included in the handbook. Figure 1 organizes all the benchmark evaluations that have been performed by the isotope of interest, in this case Pb, and the average neutron energy the system. Compared to other isotopes of interest for nuclear applications, there are few benchmark evaluations for Pb systems. The lack of integral measurements to determine errors in Pb cross-section data has caused the latest nuclear cross-section libraries to over/underestimate k eff compared to experimental results. Therefore, this evaluation fills an important knowledge gap in benchmark evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Experiment Design and Preparation for a Shielding Benchmark Utilizing Godiva-IV

An experiment is currently being designed to provide a high-quality shielding benchmark for Criticality Accident Alarm System (CAAS) modeling. Previous benchmarks have suffered from uncertainty primarily due to two factors. The first factor is radiation that is not directly coming from the source, also known as room return. Room return is notoriously difficult to account for in experimental data and to model in benchmarks. The second factor is uncertainty associated with the source term itself. In order to reduce these two sources of uncertainty, this experiment will utilize a room return shield [1] that will reduce the effect of room return and previous work performed to ensure the reproducibility of the source term. The experiment will use the Godiva IV [2] assembly located at the National Criticality Experiments Research Center (NCERC) to provide a neutron source representative of a criticality accident. Previous experiments [3]-[4] have shown that Godiva IV is capable of producing both bursts and steady-state emissions of equal magnitude which will allow for reduced uncertainty in the source term. The room return shield will house and isolate the shielding samples, neutron activation foils, and other detectors. Data collected will provide a comparison of the neutron and gamma dose for shielded and unshielded configurations. This data will be used to validate shielding data used for modeling criticality accident alarm systems. Shielding samples included in this benchmark are C, Fe, NaCl, Pb, high density polyethylene, and SiO 2 . This paper details the design of the room return shield, the experimental plan, challenges, and mitigation strategies.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

CNRS Molten Salt Reactor Benchmark Analysis Using Griffin-Pronghorn Coupled Multi-physics Code System

Molten salt reactors (MSRs) with flowing fuel have the unique feature of utilizing the fuel salt for heat generation and extraction at the same time, since the fuel salt is circulating through the whole primary loop. This movement of fuel salt results in a partial decay of the delayed neutron precursors (DNPs) outside the core and the corresponding redistribution of the DNPs in the active region of the core. To capture this effect, neutronics and thermal-hydraulics (T/H) codes need to be able to handle the movement of DNPs and their decay [1, 2]. Idaho National Laboratory (INL) is actively working on developing the neutronics and T/H codes to model the MSRs with flowing fuel. As one of the efforts, the neutronics code Griffin [3] and the T/H code Pronghorn [4] that are built upon the MOOSE framework [5] have been extended to handle the flowing fuel involving the drift of DNPs, and this capability is being tested and verified with MSR benchmark problems including the CNRS benchmark problem [6]. Additionally, a multi-physics analysis of the molten salt reactor experiment (MSRE) is being conducted to verify and validate the codes against available experimental data [7]. This work presents the analysis of the CNRS benchmark problem using the Griffin-Pronghorn coupled multi-physics code system of INL. Both steady-state and transient problems are analyzed, and the results are compared with those of other participants presented in [6]. The following section provides a description of the benchmark, along with input parameters and observables for each step. Then, the results for each step are presented in comparison with other participants’ results, followed by summary and conclusion.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Investigation of Benchmark $k$ eff Sensitivity and Uncertainty for 239 Pu fission in Specific Energy Ranges

Nuclear data at intermediate energies (from 1 to 100s of keV) are evaluated based on scarce differential data and theory unable to capture physics’ expected structure. There is also a lack of integral data. This is a known deficiency and is challenging to address. Calculated effective multiplication factor, k eff , values for intermediate energy experiments are ~25× further from experiment than for fast energies and are often well outside the experimental uncertainties. The goal of the PARADIGM (PARallel Approach of Differential and InteGral Measurements) project is to significantly re duce the uncertainties of intermediate energy nuclear data for 239 Pu. To this end, PARADIGM simultaneously optimizes experiments at both the Los Alamos Neutron Science Center (LANSCE) and National Criticality Experiments Research Center (NCERC). The combined set of data will inform new intermediate-energy nuclear data. By execution of differential and integral experiments, establishment of new theory, and undertaking nuclear data evaluation in parallel, the timeline to deliver improved nuclear data to users will be reduced significantly that is to three years. For the PARADIGM project, it was decided to optimize an integral experiment for two neutron energy ranges, within the full intermediate energy range. The low energy range goes from 1 to 30 keV, while the higher energy range goes from 30 to 600 keV. This work focuses on nuclear data sensitivities and uncertainties for 239 Pu fission for existing experiments in the International Criticality Safety Benchmark Evaluation Project (ICSBEP). When designing new experiments, it is important to understand what benchmarks currently exist. For a more traditional experiment design (in which a specific application model(s) exists), comparisons would be made between the application model(s) and existing benchmarks. For PARADIGM, there is no specific application model, but instead the specific nuclear data reaction and energy ranges of interest can be explored for existing benchmarks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

h5bench: A unified benchmark suite for evaluating HDF5 I/O performance on pre‐exascale platforms

Summary Parallel I/O is a critical technique for moving data between compute and storage subsystems of supercomputers. With massive amounts of data produced or consumed by compute nodes, high‐performant parallel I/O is essential. I/O benchmarks play an important role in this process; however, there is a scarcity of I/O benchmarks representative of current workloads on HPC systems. Toward creating representative I/O kernels from real‐world applications, we have created h5bench , a set of I/O kernels that exercise hierarchical data format version 5 (HDF5) I/O on parallel file systems in numerous dimensions. Our focus on HDF5 is due to the parallel I/O library's heavy usage in various scientific applications running on supercomputing systems. The various tests benchmarked in the h5bench suite include I/O operations (read and write), data locality (arrays of basic data types and arrays of structures), array dimensionality (one‐dimensional arrays, two‐dimensional meshes, three‐dimensional cubes), I/O modes (synchronous and asynchronous). In this paper, we present the observed performance of h5bench executed along several of these dimensions on existing supercomputers (Cori and Summit) and pre‐exascale platforms (Perlmutter, Theta, and Polaris). h5bench measurements can be used to identify performance bottlenecks and their root causes and evaluate I/O optimizations. As the I/O patterns of h5bench are diverse and capture the I/O behaviors of various HPC applications, this study will be helpful to the broader supercomputing and I/O community.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Benchmarking Quantum Chemistry Computations with Variational, Imaginary Time Evolution, and Krylov Space Solver Algorithms

Quantum chemistry is a key application area for noisy-intermediate scale quantum (NISQ) devices, and therefore serves as an important benchmark for current and future quantum computer performance. Previous benchmarks in this field have focused on variational methods for computing ground and excited states of various molecules, including a benchmarking suite focused on the performance of computing ground states for alkali-hydrides under an array of error mitigation methods. State-of-the-art methods to reach chemical accuracy in hybrid quantum-classical electronic structure calculations of alkali hydride molecules on NISQ devices from IBM are outlined here. Here it is demonstrated how to extend the reach of variational eigensolvers with symmetry preserving Ansätze. Next, it is outlined how to use quantum imaginary time evolution and Lanczos as a complementary method to variational techniques, highlighting the advantages of each approach. Finally, a new error mitigation method is demonstrated which uses systematic error cancellation via hidden inverse gate constructions, improving the performance of typical variational algorithms. These results show that electronic structure calculations have advanced rapidly, to routine chemical accuracy for simple molecules, from their inception on quantum computers a few short years ago, and they point to further rapid progress to larger molecules as the power of NISQ devices grows.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Simulation of mineral dissolution at the pore scale with evolving fluid-solid interfaces: review of approaches and benchmark problem set

This manuscript presents a benchmark problem for the simulation of single-phase flow, reactive transport, and solid geometry evolution at the pore scale. The problem is organized in three parts that focus on specific aspects: flow and reactive transport (part I), dissolution-driven geometry evolution in two dimensions (part II), and an experimental validation of three-dimensional dissolution-driven geometry evolution (part III). Five codes are used to obtain the solution to this benchmark problem, including Chombo-Crunch, OpenFOAM-DBS, a lattice Boltzman code, Vortex, and dissolFoam. These codes cover a good portion of the wide range of approaches typically employed for solving pore-scale problems in the literature, including discretization methods, characterization of the fluid-solid interfaces, and methods to move these interfaces as a result of fluid-solid reactions. A short review of these approaches is given in relation to selected published studies. Results from the simulations performed by the five codes show remarkable agreement both quantitatively--based on upscaled parameters such as surface area, solid volume, and effective reaction rate--and qualitatively--based on comparisons of shape evolution. This outcome is especially notable given the disparity of approaches used by the codes. Therefore, these results establish a strong benchmark for the validation and testing of pore-scale codes developed for the simulation of flow and reactive transport with evolving geometries. They also underscore the significant advances seen in the last decade in tools and approaches for simulating this type of problem.

58 GEOSCIENCES↗
DOE OSTI2025

Towards robust surrogate models: Benchmarking machine learning approaches to expediting phase field simulations of brittle fracture

Data-driven approaches have the potential to make modeling complex, nonlinear physical phenomena significantly more computationally tractable. For example, computational modeling of fracture is a core challenge where machine learning techniques have the potential to provide a much needed speedup that would enable progress in areas such as multi-scale modeling and uncertainty quantification. Currently, phase field modeling (PFM) of fracture is one such approach that offers a convenient variational formulation to model crack nucleation, branching and propagation. To date, machine learning techniques have shown promise in approximating PFM simulations. While standard fracture benchmarks represent realistic scenarios frequently observed in practice, they typically do not provide sufficiently challenging tests for data-driven methods. Here, to address this gap, we introduce a challenging dataset based on PFM simulations designed to benchmark and advance ML methods for fracture modeling. This dataset includes three energy decomposition methods, two boundary conditions, and 1000 random initial crack configurations for a total of 6000 simulations. Each sample contains 100 time steps capturing the temporal evolution of the crack field. Alongside this dataset, we also implement and evaluate Physics Informed Neural Networks (PINN), Fourier Neural Operators (FNO), and UNet models as baselines, and explore the impact of ensembling strategies on prediction accuracy. With this combination of our dataset and baseline models drawn from the literature we aim to provide a standardized and challenging benchmark for evaluating machine learning approaches to solid mechanics. Our results highlight both the promise and limitations of popular current models, and demonstrate the utility of this dataset as a testbed for advancing machine learning in fracture mechanics research.

Benchmark dataset↗