Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Recent MOOSE Update Slides for a DOE CI visit

This is an updated slide deck for which much of the content has been previously cleared. This slide deck incorporates recent NRIC Virtual Test Bed work with several updates on modeling and simulation of benchmark advanced reactor problems. Note that none of the models or results contained within these slides is proprietary. Many of these have been openly published on the Virtual Test Bed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Dynamically robust coordinated set point tracking of distributed DERs at point of common coupling

Low-inertia operation of small-scale power systems, such as a microgrid or a portion of a long feeder, requires careful coordination of the controller performance of the constituting devices. This challenge is exacerbated in microgrids serving the functionalities of a conventional synchronous-based generation unit while comprised of smaller DERs operating mainly interfaced through power electronics converters. This paper builds on the idea of set point modulation and proposes a two-level control strategy that aims to achieve superior performance at the point of common coupling (PCC) of microgrids by combining a local control level with a distributed and coordinated level. Several case studies on both AC and DC systems, the CIGRE low-voltage benchmark system as the AC system and a test DC microgrid, validate the performance of the proposed approach. The real-world applicability of the approach is established via a high-fidelity power hardware-in-the-loop (PHIL) experimental setup and an application case study on grid frequency regulation. The proposed approach enables a microgrid to participate in ancillary service provisions where speed and quality of regulation are critical.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Knowledge-guided graph machine learning for spatially distributed prediction of daily discharge and nitrogen export dynamics

Spatially distributed prediction of streamflow and nitrogen export dynamics is essential for precision management of agricultural watersheds. While temporal deep learning models such as Long Short-Term Memory (LSTM) have shown strong performance at basin scales, their ability to generalize spatially is limited by insufficient representation of spatial dependencies and flow paths, particularly under data-scarce conditions. To address this gap, we propose HydroGraphNet, a knowledge-guided graph machine learning framework that integrates process-based knowledge and explicit spatial learning into temporal modeling. This framework incorporates directed graph topology to encode watershed connectivity and upstream inflows, with mass balance constraints to improve physical consistency. To enhance generalization in sparsely monitored regions, HydroGraphNet is pretrained on synthetic data generated by the SWAT+ (Soil and Water Assessment Tool Plus) model. We evaluated HydroGraphNet in the Upper Sangamon River Basin (44 HUC-12 subwatersheds, 2001–2020) against two LSTM baselines: a lumped basin-level model and a distributed variant. When benchmarked on SWAT+ simulations in pretraining, HydroGraphNet improved test NSEs by 8.9% (discharge) and 13.7% (NO₃–N load) in temporal extrapolation, and by 27.1% and 34.7% in spatial extrapolation, relative to the Lumped LSTM baseline. After fine-tuning with USGS monitoring data, the model achieved mean test NSE (KGE) scores of 0.768 (0.861) for discharge and 0.626 (0.664) for NO₃–N load, substantially outperforming baselines. Attribution analysis further highlighted the importance of upstream inflow representation and graph-based spatial learning in capturing cross-subwatershed dependencies. The model also reproduced seasonal hydrological and biogeochemical patterns consistent with known processes, demonstrating its robustness and process fidelity for spatially distributed prediction. Altogether, HydroGraphNet advances the integration of physical knowledge and spatially explicit learning in hydrological modeling, offering a generalizable framework for distributed modeling to support spatially targeted water quality management in data-scarce watersheds.

54 ENVIRONMENTAL SCIENCES↗

How Accurate Are Approximate Density Functionals for Noncovalent Interaction of Very Large Molecular Systems?

Noncovalent intermolecular interactions are very important in many research areas. Therefore, it is vital to understand the extent to which approximate density functionals give a proper description of noncovalent interactions. Previous research has demonstrated that some approximate density functionals can predict usefully accurate interaction energies for many noncovalent systems; however, most of that work is limited to small and moderate-sized molecules. Very recently though, accurate benchmarks have become available for some very large molecules. Here, the present work applies 21 approximate density functionals to compute the binding energies of seven large molecular systems that have a number of atoms ranging from 200 to 910. The results are judged by comparison to the recently published CIM-DLPNO-CCSD(T) results, which are assumed to provide a reliable benchmark. The five most accurate methods among those tested are found to be PW6B95-D4, PW6B95-D3(BJ), revM11, M06-L, and MN15.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Horizontal Split Table Conceptual Design for Validation of Nuclear Data used in Advanced Reactors [Slides]

A methodology to create conceptual designs of benchmark critical experiments for advanced reactors nuclear data testing and validation was developed. A first concept was explored, pebble-bed high-temperature gas cooled reactor, based on the HTR-10 reactor. The very high correlation is a proof of concept that the design is similar to the application, and performing such critical experiments would help nuclear data testing and validation. This proof-of-concept was included in the IER-539 CED-1:Preliminary Design of a New Horizontal Split Table report. Other concepts could be explored if needed, such as Molten-salt reactor, Sodium-cooled fast reactor or Heat pipe reactors/Microreactor.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Expanding Benchmarks for Nuclear Data Validation [Slides]

The presentation discusses benchmarking in comparison to experimental truth, the integral experiments that were performed, and that benchmarks are evaluated experiments. It also discusses validation testing, and that the ultimate goal of the validation end product is to improve evaluated nuclear data for applications It does state that validation highlights errors in the Nuclear Data Pipeline that affect applications, for example: Missing Cd Capture Gammas in ENDF/B-VII.1. It acknowledges that additional types of experiments are needed to test data used in applications, and that validation experiments do not have to be complicated and expensive. The presentation also discusses different types of measurements including activation foil and fission chamber measurements, reactor kinetics measurements, and subcritical measurements. The presentation concludes with an experiment summary and states that all applications need validation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

TEAMER Technical Support of Ramboll's for Numerical Modeling of WECs to Support OES Task 10: Cooperative Research and Development (Final Report)

National Technology & Engineering Solutions of Sandia, LLC (NTESS) in collaboration with the National Renewable Energy Laboratory (NREL), and with guidance from Ramboll, will perform fluid dynamics simulations to support of The Ocean Energy Systems (OES) Energy Technology Collaboration Program Task 10 Wave Energy Converters (WEC) Modelling Verification and Validation effort. Specific numerical simulations include the fixed device wave impingement studies to benchmark the performance of simulation techniques against physical testing results.

16 TIDAL AND WAVE POWER↗

DistOPF: Advanced Solutions for Distribution Optimal Power Flow Analysis - DistOPF v0.2 Documentation

To achieve an affordable and reliable energy system, research on power distribution system is often focused on integration of distributed generators, energy storage solution, EV charging, smart meters, and other advanced assets that may benefit from or require more advanced control and optimization techniques. Despite this focus on advanced distribution system topics, early researchers and grid scientists often start from scratch when developing optimization programs for power distribution systems. This report introduces DistOPF, a Python package that consolidates years of research into a versatile and modular tool. DistOPF provides researchers with essential capabilities to solve distribution system Optimal Power Flow (OPF) problems using standard network models. Additionally, it offers a platform to benchmark both new and existing algorithms against established test systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Demonstration and Verification of Thermo-Mechanical Bowing in a Limited Free-Bow SFR Concept Using MOOSE

Core bowing due to thermal gradients and irradiation induced swelling and creep introduces significant reactivity feedback effects in liquid metal-cooled fast spectrum reactors. During startup, normal operations, and transient events, differential thermal and flux gradients cause expansion, creep, and swelling, which results in bowing in preferential directions depending on local material properties and load-pad and restraint-ring design. The bowing phenomenon produces negative reactivity during accident conditions provided the restraint system has been properly designed to optimally guide the deformation outwards in the active core region. Under the Department of Energy Nuclear Energy Advanced Modeling and Simulation program, a Multiphysics Object Oriented Simulation Environment (MOOSE)-based multiphysics approach to model core bowing is being developed. The present work expands on previous modeling of simpler International Atomic Energy Agency (IAEA) verification problems with these tools by modeling IAEA Verification Problem 4, which involves a symmetric sector of a reactor core with ducted assemblies undergoing differential thermal expansion due to thermal gradients bowing outward with duct-to-duct contact. This model is available on the National Reactor Innovation Center Virtual Test Bed repository. This example was verified against benchmark participant results, which includes bowing deformation evaluation and duct-to-duct interactions at load pads with mechanical contact.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

SAS4A/SASSYS-1 Validation with EBR-II Tests Performed During the SHRT Testing Program

The EBR-II sodium-cooled fast reactor supported a wide range of fast reactor research activities. The final fifteen years of operations at EBR-II were used for experiments and tests to demonstrate the importance of passive safety in liquid metal reactors and the capability of such systems to provide strong passive responses during off-normal conditions. The Shutdown Heat Removal Test program at EBR-II provided test data supporting the validation of computer codes for design, licensing, and operation of LMRs, among other objectives. The program included nearly sixty tests, most of which were protected and unprotected loss of flow and loss of heat sink tests run at various initial powers and flow rates. This report documents the results of modeling and simulation of tests from the Shutdown Heat Removal Test program to support validation of Argonne’s SAS4A/SASSYS-1 fast reactor safety analysis code. SHRT-17 was a protected loss of flow test where a loss of electrical power to all sodium coolant pumps was simulated to demonstrate the effectiveness of natural circulation cooling characteristics. SHRT-45R was an unprotected loss of flow test where the control rod scram function of the plant protection system was disabled to demonstrate the effectiveness of EBR-II’s passive reactivity feedbacks. BOP-301 and BOP-302R were unprotected loss of heat sink tests that demonstrated how reactivity feedback effects driven by changes to the core inlet temperature can shut down the fission process. This validation activity leverages modeling and simulation efforts that originated under an International Atomic Energy Agency Coordinated Research Project for benchmark analysis of the EBR-II Shutdown Heat Removal Tests. The SAS4A/SASSYS-1 models originally developed for the CRP have been modernized to utilize new code features and modeling practices. Differences between the predicted and measured test data were explored and the causes of these differences were identified as being due to modeling approximations, uncertainty in transient component behavior, and instrumentation uncertainties. Overall, it was concluded that for SHRT-17, SHRT-45R, BOP-301, and BOP-302R there was good agreement between the flow, power, and temperature predictions and the measured data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Multiphysics Modeling of Microreactors with NEAMS codes, and Validation Based on KRUSTY Reactivity Insertion

The NEAMS Multiphysics Applications team continues to assess code usability and functionality for microreactor design and safety analyses, while demonstrating that NEAMS tools capture both steady-state and transient behavior across distinct microreactor concepts. In FY2025, the team advanced full-core, high-fidelity, multiphysics models that solve more complex problems and strengthen verification/validation for several microreactor systems: heat-pipe microreactor (HPMR), gas-cooled microreactor (GCMR), and the KRUSTY experiment. These models employ the MOOSE MultiApp/Transfers architecture with Griffin for neutronics, BISON for heat conduction/thermomechanics, Sockeye for heat pipes, SAM/THM for coolant channels and loops, and SWIFT for hydride behavior, with meshes generated via the MOOSE Reactor Module. The graphite models available in the Grizzly code were also investigated for future analyses. For the HPMR, a Na-HPMR variant was constructed to align with recently validated heat-pipe experiments and Sockeye’s LCVF capability, enabling mechanistic heat-pipe transients and startup modeling. The Na-HPMR will serve as the primary model for HPMR investigations in upcoming tasks. The load-following and single heat-pipe failure scenarios (Griffin/BISON/Sockeye), which were previously modeled for the K-HPMR, were replicated for the Na-HPMR, showing strong negative temperature feedback and highly localized thermal effects, respectively, while the startup case captured vapor-front progression and heat-removal activation. Solid mechanics was added to the previously built K-HPMR full-core model in BISON, showing minimal impact on steady-state reactivity yet enabling stress-field predictions that prepare the path for full-core TRISO performance analyses. For the GCMR, automated steady-state and four transient scenarios were executed using Griffin/BISON/SAM/SWIFT. Results confirm robust inherent safety: power collapses promptly in loss-of-cooling events, the inlet-temperature drop settles to a new equilibrium, and a single-channel blockage yields only a ~30 K local fuel-temperature rise with <0.4% power decrease. SWIFT-predicted hydrogen redistribution affects reactivity during both steady-state and transient conditions, underscoring its importance. A Brayton-cycle balance of plant (BOP) model in SAM/THM demonstrated stable startup behavior, and xenon-driven reactivity during load following was analyzed. To improve TRISO-compact temperature fidelity, a fast multiscale Heat Source Decomposition (HSD) treatment was implemented. Against heterogeneous benchmarks, HSD reduces underprediction of kernel temperatures and lowers predicted peak powers in reactivity-insertion transients compared to previous homogenized models. KRUSTY warm-critical validation progressed from FY2024 baselines: the 15Ȼ insertion shows excellent agreement in peak power (~2% high) and temperature trends, and the 30Ȼ case was automated via a feedback controller that maintained power near 3 kW for ~150 s with close agreement to data. The successful modeling of the warm critical tests has laid a strong foundation for simulating more complex nuclear system tests in the years ahead. Throughout FY2025, developer feedback was provided (e.g., MOOSE batch mesh generation, distributed pre-split meshes, Griffin sweeper on displaced meshes), several new models were contributed to the Virtual Test Bed, and an OECD-NEA WPRS multiphysics benchmark based on the HPMR was initiated to enable broader cross-comparison and best-practice development with the nuclear community at large.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Creep and Fatigue Characterization of High Strength Alloy Thin Sections in Advanced CO2 Heat Exchangers

The objective of this work was to characterize and model elevated temperature creep and fatigue behavior for thin sheet and foil forms of gamma-prime strengthened alloys in wrought form and as-processed folded and brazed constructions. This work was motivated by the demanding temperature and pressure service conditions of the GEN3 Concentrated Solar Power (CSP) and supercritical CO2 (sCO2) power cycle working fluid. More specifically, the possibility of leveraging the superior creep strength of gamma-prime alloys in folded-fin and brazed-plate heat exchanger constructions. Gamma-prime alloys represent a step-change in raw-material strength over solid-solution strengthened alloys. And the folded-fin and brazed-plate heat exchanger architecture is lightweight and leverages cost-effective material stock forms. The investigation contained two parallel paths. (1) The first is referred to as a fundamental investigation where Oak Ridge National Laboratory conducts uniaxial creep testing on thin sheet and foil in wrought form. This effort aimed to serve as a benchmark against a relatively sparse existing database and a baseline comparison for path number 2. (2) The second path is referred to as the practical investigation where Brayton Energy manufactures plate-fin heat exchangers and performs pressurized creep and fatigue testing. This effort aimed to de-risk heat exchanger manufacturing process for service under sCO2 CSP conditions. A total of 14 uniaxial creep tests were completed using Haynes 282 thin sheet and foil. A variety of heat treatments were specified to coincide with path number 2. Baseline metallography of test samples and creep strength performance are contained. Benchmarks relatively to existing thick-form Haynes 282 are made, as well as to other thin-form Nickel-based superalloys. Description of a wrought-form modeling approach for thin gamma-prime alloys is also discussed. A total of 11 pressurized creep and fatigue tests were completed successfully with Haynes 282 heat exchanger prototypes. Manufacturing processing details, testing details, testing results, and failure analysis are discussed. Additionally, creep modeling techniques to predict failure are discussed, and modeling to support technological-to-market. In conclusion, Haynes 282 foils were demonstrated to yield rupture two-to-three orders of magnitude higher than Haynes 230 foils under similar conditions. And the manufactured heat exchanger prototypes demonstrated strength similar to the wrought constituents. Both of which contribute to elevated performance potential or cost savings in practice. Discussion is included.

14 SOLAR ENERGY↗

Benchmarking characterization methods for noisy quantum circuits

Effective methods for characterizing the noise in quantum computing devices are essential for programming and debugging circuit performance. Existing approaches vary in the information obtained as well as the amount of quantum and classical resources required, with more information generally requiring more resources. Here we benchmark the characterization methods of gate set tomography, Pauli channel noise reconstruction, and empirical direct characterization for developing models that describe noisy quantum circuit performance on a 27-qubit superconducting transmon device. We evaluate these models by comparing the accuracy of noisy circuit simulations with the corresponding experimental observations. Here, we find that the agreement of noise model to experiment does not correlate with the information gained by characterization and that the underlying circuit strongly influences the best choice of characterization approach. Empirical direct characterization scales best of the methods we tested and produced the most accurate characterizations across our benchmarks.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Improved Verification and Validation Testing and Tools including Nuclear Criticality Safety Applications with the MCNP6.3® Code [Abstract]

A new Python-based framework has been developed to enable a more consistent layout with automatable setup, execution, and documentation of all verification and validation (V&V) test suites previously established for use with the MCNP code. In this paper, the new general framework for the V&V test suites is discussed, including information on all of the current capabilities and plans for future capabilities. For nuclear criticality safety applications, the existing V&V benchmark problems within the criticality, extended criticality, and analytic k-effective test suites have been ported into this new framework. In addition, the status and updates to the Rossi-alpha and subcritical multiplicationtest suites will be discussed. Some V&V results exercising new MCNP6.3 capabilities will be demonstrated.

97 MATHEMATICS AND COMPUTING↗

Roadmap for Molecular Benchmarks in Nonadiabatic Dynamics

Simulating the coupled electronic and nuclear response of a molecule to light excitation requires the application of nonadiabatic molecular dynamics. However, when faced with a specific photophysical or photochemical problem, selecting the most suitable theoretical approach from the wide array of available techniques is not a trivial task. The challenge is further complicated by the lack of systematic method comparisons and rigorous testing on realistic molecular systems. This absence of comprehensive molecular benchmarks remains a major obstacle to advances within the field of nonadiabatic molecular dynamics. A CECAM workshop, Standardizing Nonadiabatic Dynamics: Towards Common Benchmarks, was held in May 2024 to address this issue. This Perspective highlights the key challenges identified during the workshop in defining molecular benchmarks for nonadiabatic dynamics. Specifically, this work outlines some preliminary observations on essential components needed for simulations and proposes a roadmap aiming to establish, as an ultimate goal, a community-driven, standardized molecular benchmark set.

36 MATERIALS SCIENCE↗

Matrix-Model Simulations Using Quantum Computing, Deep Learning, and Lattice Monte Carlo

Matrix quantum mechanics plays various important roles in theoretical physics, such as a holographic description of quantum black holes, and it underpins the only practical numerical approach to the study of complex high-dimensional supergravity theories. Understanding quantum black holes and the role of entanglement in a holographic setup is of paramount importance for the realization of a quantum theory of gravity. Moreover, a complete numerical understanding of the holographic duality and the emergence of geometric space-time features from microscopic degrees of freedom could pave the way for new discoveries in quantum information science. Euclidean lattice Monte Carlo simulations are the de facto numerical tool for understanding the spectrum of large matrix models and have been used to test the holographic duality. However, they are not tailored to extract dynamical properties or even the quantum wave function of the ground state of matrix models. Quantum computing and deep learning provide potentially useful approaches to study the dynamics of matrix quantum mechanics. If successful in the context of matrix models, these rapidly improving numerical techniques could become the new Swiss army knife of quantum gravity practitioners. In this paper, we perform the first systematic survey for quantum computing and deep-learning approaches to matrix quantum mechanics, comparing them to lattice Monte Carlo simulations. These provide baseline benchmarks before addressing more complicated problems. In particular, we test the performance of each method by calculating the low-energy spectrum.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DeepSurveySim: Simulation Software and Benchmark Challenges for Astronomical Observation Scheduling

Modern astronomical surveys have multiple competing scientific goals. Optimizing the observation schedule for these goals presents significant computational and theoretical challenges, and state-of-the-art methods rely on expensive human inspection of simulated telescope schedules. Automated methods, such as reinforcement learning, have recently been explored to accelerate scheduling. However, there do not yet exist benchmark data sets or user-friendly software frameworks for testing and comparing these methods. We present DeepSurveySim -- a high-fidelity and flexible simulation tool for use in telescope scheduling. DeepSurveySim provides methods for tracking and approximating sky conditions for a set of observations from a user-supplied telescope configuration. We envision this tool being used to produce benchmark data sets and for evaluating the efficacy of ground-based telescope scheduling algorithms, particularly for machine learning algorithms that would suffer in efficacy if limited to real data for training.We introduce three example survey configurations and related code implementations as benchmark problems that can be simulated with DeepSurveySim.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SAS4A/SASSYS-1 Validation with EBR-II Tests Performed During the SHRT Testing Program (Rev. 2)

The EBR-II sodium-cooled fast reactor supported a wide range of fast reactor research activities. The final fifteen years of operations at EBR-II were used for experiments and tests to demonstrate the importance of passive safety in liquid metal reactors and the capability of such systems to provide strong passive responses during off-normal conditions. The Shutdown Heat Removal Test program at EBR-II provided test data supporting the validation of computer codes for design, licensing, and operation of LMRs, among other objectives. The program included nearly sixty tests, most of which were protected and unprotected loss of flow and loss of heat sink tests run at various initial powers and flow rates. This report documents the results of modeling and simulation of tests from the Shutdown Heat Removal Test program to support validation of Argonne’s SAS4A/SASSYS-1 fast reactor safety analysis code. SHRT-17 and SHRT-6 were protected loss of flow tests where a loss of electrical power to all sodium coolant pumps was simulated to demonstrate the effectiveness of natural circulation cooling characteristics. SHRT-45R, SHRT-39, and SHRT-43R were unprotected loss of flow tests where the control rod scram function of the plant protection system was disabled to demonstrate the effectiveness of EBR-II’s passive reactivity feedbacks. BOP-301 and BOP-302R were unprotected loss of heat sink tests that demonstrated how reactivity feedback effects driven by changes to the core inlet temperature can shut down the fission process. PICT-5/6 demonstrated how core power could be increased and decreased via changes in the intermediate sodium and feedwater flow rates. This validation activity leverages modeling and simulation efforts that originated under an International Atomic Energy Agency Coordinated Research Project for benchmark analysis of the EBR-II Shutdown Heat Removal Tests. The SAS4A/SASSYS-1 models originally developed for the CRP have been modernized to utilize new code features and modeling practices. Differences between the predicted and measured test data were explored and the causes of these differences were identified as being due to modeling approximations, uncertainty in transient component behavior, and instrumentation uncertainties. Overall, it was concluded that for all tests simulated there was good agreement between the flow, power, and temperature predictions and the measured data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗