Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

FY23 Status Report on MOOSE-Based Approaches to Modeling Core Bowing in Fast Reactors

Under the U.S. Department of Energy Office of Nuclear Energy’s Advanced Modeling and Simulation (NEAMS) Program, an integrated multiphysics approach is being developed to model the core bowing phenomena important to liquid metal-cooled fast reactors. Core bowing is an important passive safety mechanism whereby increased power (which leads to temperature and flux gradients) influences the core to bow into less reactive configurations when the restraint system is properly designed. The phenomenon includes a complex interplay of radiation transport, duct temperature calculations involving fluid flow and heat transfer, and thermo-mechanical responses to the induced temperature and flux gradients. Structural material properties are also important to determining inelastic response to longer term flux gradients which cause irradiation creep and swelling. While core bowing provides a strong negative reactivity feedback when the restraint system is designed properly, it also results in additional forces between assemblies which increase the loads required to extricate them during refueling or control rod movement. Therefore, the restraint system must be designed with these tradeoffs in mind. The first stage of the work, which commenced in FY21 and continues through FY23, assesses thermo-mechanical modeling tools for producing core bowing predictions consistent with conventional tools. The Multiphysics Object Oriented Simulation Environment (MOOSE) Tensor Mechanics and Contact Modules are employed. This status report describes work on additional thermo-mechanical benchmark verification problems with increased complexity from the examples demonstrated in FY21 and FY22. Several benchmark verification examples were selected from the IAEA verification and validation report with increased number of ducts and more complex contact interaction behavior. These examples involve a full symmetric sector with restraint rings at multiple load pad locations to simulate a limited free-bow restraint system concept, as well as irradiation induced swelling and creep effects in a sector. In addition, improvements to the contact module sideset assignment were assessed and compared with previous MOOSE results to verify the contact behavior. The MOOSE-based results were compared to IAEA benchmark participants’ results. In every case, the MOOSE results agreed with other simulations results for estimating bowing behavior, providing additional verification basis of the tools for this particular physics application. Estimation of contact forces were mostly in agreement, with a few outlier results. A plan was suggested for dealing with the discrepancies with estimating contact force values. In addition, a 1-way coupling demonstration was performed using subchannel analysis code Pronghorn-SC and MOOSE on an ABR-1000-design sodium-cooled fast reactor assembly to evaluate coolant and duct wall temperatures.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluated Nuclear Data Requirements in Support of Fission and Fusion Applications [Slides]

This presentation touches on thermal scattering cross section and scattering lengths including criticality benchmarks (fission). Secondly, development and completeness of charged ­particle libraries: criticality benchmarks (fission), neutron source (fission/fusion), simulation benchmarks and light elements generation (fusion). Additionally, this presentation details on the covariances (methodology and completeness) with adjustment and optimization of nuclear data libraries (fission/fusion). Finally nuclear data reproducibility and conclusions are discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quantum Optimization: Potential, Challenges, and the Path Forward

Recent advances in quantum computers are demonstrating the ability to solve problems at a scale beyond brute force classical simulation. As such, a widespread interest in quantum algorithms has developed in many areas, with optimization being one of the most pronounced domains. Across computer science and physics, there are a number of algorithmic approaches, often with little linkage. This is further complicated by the fragmented nature of the field of mathematical optimization, where major classes of optimization problems, such as combinatorial optimization, convex optimization, non-convex optimization, and stochastic extensions, have devoted communities. With these aspects in mind, this work draws on multiple approaches to study quantum optimization. Provably exact versus heuristic settings are first explained using computational complexity theory — highlighting where quantum advantage is possible in each context. Then, the core building blocks for quantum optimization algorithms are outlined to subsequently define prominent problem classes and identify key open questions that, if answered, will advance the field. The effects of scaling relevant problems on noisy quantum devices are also outlined in detail, alongside meaningful benchmarking problems. We underscore the importance of benchmarking by proposing clear metrics to conduct appropriate comparisons with classical optimization techniques. Lastly, we highlight two domains – finance and sustainability – as rich sources of optimization problems that could be used to benchmark, and eventually validate, the potential real-world impact of quantum optimization.

97 MATHEMATICS AND COMPUTING↗

Delayed Critical Highly Enriched Uranium Metal Cylinders with Thin Graphite Top and Bottom Reflectors

Nine 7, 11, and 15 in. diam highly enriched uranium (HEU, 93.15 wt % 235 U) metal cylinders were assembled on the vertical assembly machine in the Oak Ridge Critical Experiments Facility (ORCEF) and had 1, 2, or 3 in. thick HLM graphite reflectors on the top and bottom. The experiments, which were performed between April 3, 1970, and February 18, 1971, used 23 operational days at ORCEF. Before those experiments were carried out, unreflected and unmoderated, graphite- and polyethylene-reflected, and polyethylene-moderated HEU metal cylinders had been assembled to obtain delayed criticality at ORCEF in the 1960s and reported by the International Criticality Safety Benchmark Evaluation Project (ICSBEP) at the Nuclear Energy Agency (NEA)*. The data from the nine critical experiments are acceptable for use as criticality safety benchmark experiments for the NEA’s ICSBEP once the uncertainty analysis is completed. Based on previous ICSBEP benchmarks with HEU metal at ORCEF, the uncertainties in k eff are expected to be as low as ±0.0004.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

TEX-Hf Assemblies: Highly Enriched Uranium Plates with Hafnium Using Polyethylene Moderator and Polyethylene Reflector

This report documents the integral experiment evaluation and publication for IER-532 (TEX-Hf), Thermal/Epithermal eXperiments (TEX) with highly enriched uranium (HEU) fuel and hafnium (Hf), moderated and reflected by polyethylene. The design of TEX-Hf is a variation of IER-297 (TEX-HEU), with the inclusion of hafnium as a diluent material. The experiment and evaluation include seven configurations, all of which were acceptable as benchmark cases. These benchmark cases provide validation for hafnium in the thermal, intermediate, and fast neutron energy regimes by maximizing the sensitivity in k eff to the hafnium cross sections. The evaluation was reviewed and accepted by the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Technical Review Group on April 17, 2024, and was submitted to the ICSBEP in August 2024 following subgroup approval.

42 ENGINEERING↗

ARC Software Validation Work for the FFTF Reactor

Extensive efforts have been carried out at ANL for the verification and validation of the Argonne Reactor Codes (ARC) software package currently used for the design of Versatile Test Reactor (VTR). The ARC software package consists of steady state neutronics and thermal hydraulics modeling capabilities which are being used by the VTR program to develop most of the VTR reactor design details which will be part of the licensing application. It is anticipated that this software will continue to be used for the design work and for initial operations although additional software may be introduced at a later time. The validation work was focused primarily on obtaining validation data consistent with VTR and usable for the ARC software. Because no critical facilities or operating fast spectrum reactors are available to do experiments for the VTR, the next best option is to identify historical experimental data that can be used as validation data. Early on in VTR, the ZPPR-15 set of experiments was identified as good validation data because of 1) the availability and quality of the data, 2) existing staff that are already familiar with the experimental machine and measurements, 3) most of the ZPPR-15 loadings of interest have already been processed into ARC models, and 4) a full uncertainty quantification has already been done for several loadings of ZPPR-15. The FFTF startup and operations data was identified as the most consistent reactor type that has validation data usable for VTR. Finally, the EBR-II fuel depletion measurements were identified as the best available validation data for VTR. It is important to note that both the FFTF and EBR-II reactors typically come with higher uncertainties than the ZPPR. In the frame of the discussed verification and validation efforts, the present document discusses the analysis of selected FFTF measurements included in the benchmark specifications of the International Reactor Physics Experiment (IRPhE) handbook. The FFTF reactor core configurations from the benchmark specification are presented in Section 2. The analysis is performed with the use of the ARC code suite available at ANL for fast reactor studies and is discussed in Section 3. The reactor parameters from the benchmark include criticality, neutron spectra, effective delayed neutron spectra, control rod worth, isothermal temperature coefficient and low energy gamma-ray spectra. The calculated values and the comparison with the experimental data is discussed in Sections 4 to 9 for each considered reactor parameter. Finally, conclusions are presented in Section 10.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Validation of Numerical Tools for Calculating Reactivity Feedback in Sodium Fast Reactors Using SEFOR Experimental Data

The Southwest Experimental Fast Oxide Reactor (SEFOR) was an experimental sodium-cooled fast breeder reactor operated from 1969 to 1972 with experiments designed to measure Doppler reactivity feedback in a wide temperature range from around 350 °F to temperatures approaching the melting point of mixed oxide fuel of around 5000 °F, providing valuable data for code validations. Co-supported by the Department of Energy (DOE) Fast Reactor Program (FRP) and the DOE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the SEFOR benchmark project focused on using the experimental data to validate numerical tools that are used in industry and academia to design and license sodium-cooled fast reactors (SFRs). By the end of FY-25, substantial progress was achieved in the SEFOR benchmark study. A variety of numerical tools commonly used for modeling SFRs were applied to develop models for SEFOR core configurations I-D, I-E, I-I, and I-J. These included Monte Carlo codes such as MCNP, Serpent, and Shift; deterministic codes such as the legacy Argonne Reactor Computation (ARC) suite and the high-fidelity NEAMS code Griffin; and the system analysis code SAS4A/SASSYS-1 (SAS). Using these models, both SEFOR zero-power experiments and power-ascending tests were successfully simulated. Comparisons were performed against experimental measurements of core criticalities, reflector worth, kinetics parameters (Λ/βeff), isothermal reactivity feedback (from 350 °F to 760 °F at zero power), and power-ascending reactivity feedback (as power increased from 0.4 MW to 17 MW). In general, these comparisons demonstrated very good agreement between numerical results and experimental data. In Fiscal Year 26 (FY-26), the SEFOR benchmark project will continue to address the modeling issues identified in FY-25. Effort will focus on the simulation of reactivity insertion transients in SEFOR core II using the ARC/SAS model. Future work will also focus on incorporating BISON into the SEFOR core modeling process to enable the first Multiphysics simulations of the isothermal tests based on the MOOSE framework.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Uncertainty Quantification for Smooth Functional Data with Application to Material Properties

This document outlines a method for processing functional output (i.e., curves) for the ultimate purpose of sampling curves under specified input conditions for use in modeling and simulation uncertainty quantification (UQ) studies. A set of benchmark curves sufficiently representative of the relevant scenario(s) being simulated are provided to the process and formatted as described in Section 1. Principal Component Analysis (PCA) is utilized to discover the components of uncertainty in the benchmark curves and is outlined in Section 2. Section 3 describes the application of uncertainty quantification to the PCA results for the purpose of sampling curves to be used in UQ analysis. Section 4 applies these techniques to an example benchmark dataset. Concluding remarks are provided in the final section.

36 MATERIALS SCIENCE↗

HEU Metal Delayed Critical Experiments with 10 to 19 Inch Thick Graphite Reflectors

Approximately 100 graphite-reflected highly enriched uranium (HEU, 93.14 wt % 235 U) metal annular and cylindrical critical experiments were performed in the early 1960s at the Oak Ridge Critical Experiments Facility (ORCEF). This report presents details from experiment logbooks, experimental data sheets and the author's memory for 44 HEU metal (93.14 wt % 235 U) critical assemblies with graphite reflectors varying from 10 to 19 in. thick, outside diameters varying from 7 to 15 in., inside diameters varying from 7 to 13 in. and critical HEU metal masses varying from 20.4 to 69.0 kg. The data from the 44 experiments described in this report are acceptable for use as criticality safety benchmark experiments for the International Criticality Safety Evaluation Program (ICSBEP) once the uncertainty analysis on the measured k eff is completed. Based on previous ICSBEP benchmarks with this HEU metal at ORCEF, the uncertainties in the measured k eff are expected to be as low as ±0.0004. Preparation of this report is part of an effort at Oak Ridge National Laboratory (ORNL) to document more than 15 undocumented series of critical and subcritical experiments enumerated in Critical and Subcritical NEA Benchmark Possibilities for Measurements at ORCEF and Other US DOE Facilities (Mihalzo, ORNL/TM-2019/1188, 2019) and performed by ORNL at ORCEF and other US Department of Energy critical experiments facilities. More than 500 operational days of critical facility time were used, not including setup and dismantlement time. This documentation for a part of one series of graphite reflected highly enriched uranium metal critical experiments, that used 50 operational days of ORCEF time, was performed using funding received from the DOE Office of Nuclear Energy’s Nuclear Energy University Programs at the University of Tennessee Nuclear Engineering Department. This documentation was also supported by the Nuclear Criticality, Radiation Transport, and Safety programs at ORNL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Algorithm-guided experimentation for autonomous AI systems in self-driving laboratories

This presentation summarizes our work in the PrOMMiS project on benchmarking of data-driven optimization algorithms and their applications in self-driving laboratories. This work supports the broader project goal of accelerating the identification of promising separation methods and operating conditions for critical minerals separation processes. We present a systematic benchmarking study of 42 data-driven optimization algorithms on a broad collection of 502 test problems. The results identify BAM, GLCCLUSTER, and MULTIMIN as the most effective optimization solvers, with BAM showing the highest overall performance and solving more than 80% of the benchmark problems. The study also shows that no single solver consistently outperforms the others across all problem types, indicating that our future laboratory applications may benefit from using a small set of strong solvers rather than relying on a single method. The presentation also illustrates an in-silico chemical reactor case study showing that data-driven optimization methods can guide autonomous experimentation in a self-driving laboratory and identify optimal operating conditions within a small number of experiments. Overall, the results provide a basis for selecting efficient optimization methods and demonstrate the practical use of data-driven optimization in self-driving laboratory workflows.

36 MATERIALS SCIENCE↗

HTGR Multiphysics Application Drivers FY26 Updates

This report summarizes FY26 progress under the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program's high-temperature gas-cooled reactor (HTGR) application driver work, covering a wide range of activities such as code validation and multi-physics code assessment. 1) A detailed SAM model of the High-Temperature Engineering Test Reactor (HTTR) was developed using a unique-block grouping approach, with an extended parallel thermal network method to capture block-to-block conduction and radiation heat transfer, and applied to steady-state simulations of the HTTR 30~MW and 9~MW cases. 2) In another activity, SAM's newly implemented multi-component gas flow model was validated against the Natural convection Shutdown heat removal Test Facility (NSTF) argon ingress experiment, correctly capturing the density-driven suppression and thermal recovery of natural circulation observed when argon is introduced into the air-cooled Reactor Cavity Cooling System (RCCS) loop. 3) For the OECD/NEA High Temperature Test Facility (HTTF) benchmark, we co-led the international benchmark activities as well as the OECD/NEA final benchmark report to be released at the end of this year. 4) Finally, the coupled Griffin-SAM modeling capability for pebble-bed HTGRs was advanced by verifying the Griffin neutronics solution against Serpent Monte Carlo for a realistic non-uniform temperature distribution, resolving several deficiencies in the SAM-to-Griffin temperature transfer scheme, and enabling distinct fuel kernel, moderator, and coolant temperatures for cross section feedback. These new features were demonstrated in a PBR load-following transient.

Lee, Alvin↗

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗

Quantifying the structural uncertainty of the aerosol mixing state representation in a modal model

Abstract. Aerosol mixing state is an important emergent property that affects aerosol radiative forcing and aerosol–cloud interactions, but it has not been easy to constrain this property globally. This study aims to verify the global distribution of aerosol mixing state represented by modal models. To quantify the aerosol mixing state, we used the aerosol mixing state indices for submicron aerosol based on the mixing of optically absorbing and non-absorbing species (χo), the mixing of primary carbonaceous and non-primary carbonaceous species (χc), and the mixing of hygroscopic and non-hygroscopic species (χh). To achieve a spatiotemporal comparison, we calculated the mixing state indices using output from the Community Earth System Model with the four-mode version of the Modal Aerosol Module (MAM4) and compared the results with the mixing state indices from a benchmark machine-learned model trained on high-detail particle-resolved simulations from the particle-resolved stochastic aerosol model PartMC-MOSAIC. The two methods yielded very different spatial patterns of the mixing state indices. In some regions, the yearly averaged χ value computed by the MAM4 model differed by up to 70 percentage points from the benchmark values. These errors tended to be zonally structured, with the MAM4 model predicting a more internally mixed aerosol at low latitudes and a more externally mixed aerosol at high latitudes compared to the benchmark. Our study quantifies potential model bias in simulating mixing state in different regions and provides insights into potential improvements to model process representation for a more realistic simulation of aerosols towards better quantification of radiative forcing and aerosol–cloud interactions.

54 ENVIRONMENTAL SCIENCES↗

Development of inter-grid-cell lateral unsaturated and saturated flow model in the E3SM Land Model (v2.0)

Abstract. The lateral transport of water in the subsurface is important in modulating terrestrial water energy distribution. Although a few land surface models have recently included lateral saturated flow within and across grid cells, it is not a default configuration in the Climate Model Intercomparison Project version 6 experiments. In this work, we developed the lateral subsurface flow model within both unsaturated and saturated zones in the Energy Exascale Earth System Model (E3SM) Land Model version 2 (ELMv2.0). The new model, called ELMlat, was benchmarked against PFLOTRAN, a 3D subsurface flow and transport model, for three idealized hillslopes that included a convergent hillslope, divergent hillslope, and tilted V-shaped hillslope with variably saturated initial conditions. ELMlat showed comparable performance against PFLOTRAN in terms of capturing the dynamics of soil moisture and groundwater table for the three benchmark hillslope problems. Specifically, the mean absolute errors (MAEs) of the soil moisture in the top 10 layers between ELMlat and PFLOTRAN were within 1 %±3 %, and the MAEs of water table depth were within ±0.2 m. Next, ELMlat was applied to the Little Washita experimental watershed to assess its prediction of groundwater table, soil moisture, and soil temperature. The spatial pattern of simulated groundwater table depth agreed well with the global groundwater table benchmark dataset generated from a global model calibrated with long-term observations. The effects of lateral groundwater flow on the energy flux partitioning were more prominent in lowland areas with shallower groundwater tables, where the difference in simulated annual surface soil temperature could reach 0.3–0.4 ∘C between ELMv2.0 and ELMlat. Incorporating lateral subsurface flow in ELM improves the representation of the subsurface hydrology, which will provide a good basis for future large-scale applications.

58 GEOSCIENCES↗

Antarctic ice sheet model comparison with uncurated geological constraints shows that higher spatial resolution improves deglacial reconstructions

Accurately reconstructing past changes to the shape and volume of the Antarctic ice sheet relies on the use of physically based and thus internally consistent ice sheet modeling, benchmarked against spatially limited geologic data. The challenge in model benchmarking against geologic data is diagnosing whether model-data misfits are the result of an inadequate model, inherently noisy or biased geologic data, and/or incorrect association between modeled quantities and geologic observations. In this work we address this challenge by (i) the development and use of a new model-data evaluation framework applied to an uncurated data set of geologic constraints, and (ii) nested high-spatial-resolution modeling designed to test the hypothesis that model resolution is an important limitation in matching geologic data. While previous approaches to model benchmarking employed highly curated datasets, our approach applies an automated screening and quality control algorithm to an uncurated public dataset of geochronological observations (specifically, cosmogenic-nuclide exposure-age measurements from glacial deposits in ice-free areas). This optimizes data utilization by including more geological constraints, reduces potential interpretive bias, and allows unsupervised assimilation of new data as they are collected. We also incorporate a nested model framework in which high-resolution domains are downscaled from a continent-wide ice sheet model. We highlight the application of this framework by applying these methods to a small ensemble of deglacial ice-sheet model simulations, and demonstrate that the nested approach improves the ability of model simulations to match exposure age data collected from areas of complex topography and ice flow. We develop a range of diagnostic model-data comparison metrics to provide more insight into model performance than possible from a single-valued misfit statistic, showing that different metrics capture different aspects of ice sheet deflation.

Geosciences↗

Mean velocity and turbulence measurements in a 90 deg curved duct with thin inlet boundary layer

The experimental database established by this investigation of the flow in a large rectangular turning duct is of benchmark quality. The experimental Reynolds numbers, Deans numbers and boundary layer characteristics are significantly different from previous benchmark curved-duct experimental parameters. This investigation extends the experimental database to higher Reynolds number and thinner entrance boundary layers. The 5% to 10% thick boundary layers, based on duct half-width, results in a large region of near-potential flow in the duct core surrounded by developing boundary layers with large crossflows. The turbulent entrance boundary layer case at R sub ed = 328,000 provides an incompressible flowfield which approaches real turbine blade cascade characteristics. The results of this investigation provide a challenging benchmark database for computational fluid dynamics code development.

Crawford, R. A.↗

I/O-Efficient Scientific Computation Using TPIE

In recent years, input/output (I/O)-efficient algorithms for a wide variety of problems have appeared in the literature. However, systems specifically designed to assist programmers in implementing such algorithms have remained scarce. TPIE is a system designed to support I/O-efficient paradigms for problems from a variety of domains, including computational geometry, graph algorithms, and scientific computation. The TPIE interface frees programmers from having to deal not only with explicit read and write calls, but also the complex memory management that must be performed for I/O-efficient computation. In this paper we discuss applications of TPIE to problems in scientific computation. We discuss algorithmic issues underlying the design and implementation of the relevant components of TPIE and present performance results of programs written to solve a series of benchmark problems using our current TPIE prototype. Some of the benchmarks we present are based on the NAS parallel benchmarks while others are of our own creation. We demonstrate that the central processing unit (CPU) overhead required to manage I/O is small and that even with just a single disk, the I/O overhead of I/O-efficient computation ranges from negligible to the same order of magnitude as CPU time. We conjecture that if we use a number of disks in parallel this overhead can be all but eliminated.

Vengroff, Darren Erik↗