Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BENCHMARKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Uncertainty quantification and sensitivity analysis for SPERT III E-core reactivity measurement benchmarking

The Special Power Excursion Reactor Test (SPERT) III E-core experiment is important because it provides critical data on reactor behavior under significant reactivity insertions, which is essential for validating computer simulations and ensuring the safety of modern light water reactors. Its design similarities to contemporary reactors make it a valuable resource for understanding and mitigating extreme hazards in nuclear operations. The current study details the application of formal parametric uncertainty quantification and sensitivity analysis to a model of the SPERT-III E-core model for zero power reactivity benchmarking. Additionally, the reactivity impact from various modeling assumptions is quantified. Overall, an conservative estimate for an uncertainty in k$_{\text{eff}}$ of $\pm$1257 was observed. A less conservative, more realistic, uncertainty estimate of $\pm$1096 pcm can be justified by the potential for various parametric uncertainties to become negligible when sampled independently across the ~1400 pins in the core. The experimental results fall within both of these uncertainty bounds. Standardized regression coefficient as well as Sobol indices are used to identify the guide tube thicknesses as the primary contributors to the uncertainty in k$_{\text{eff}}$. Overall, this study provides information on how the uncertainties in input parameters and modeling methods impact simulated k$_{\text{eff}}$ values and can be used to aid model building efforts for future code validation with the SPERT-III E-core experiment.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

First benchmarked electron cooling simulations from first principles

We present the first microscopic electron cooling simulations from first principles with accurate prediction of cooling time. These simulations were performed using our previously developed numerical method, PHAD, which is the first efficient large-scale collisional numerical method in beam physics. The simulation results are benchmarked with the experimental data of the low energy bunched electron cooling of ion beams at the storage ring CSRm at the IMP facility in China. Here, we have accurately considered the nonlinear dynamics in the whole accelerator system in addition to the electron cooling section. As a result, our simulations correctly reproduced cooling times of the experiments from first principles and without any tuning or fitting parameters in the code.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Benchmarking fast-neutron response of 7 Li-enriched C 7 LYC scintillators: Simulations and experiment

New insights into the fast neutron response of 7 Li-enriched C 7 LYC scintillators have been obtained through detailed Geant4 simulations of 35 Cl(n,p) and 35 Cl(n, α) reactions that are primarily responsible for the fast neutron response of C 7 LYC. The light output of a 1” x1” C 7 LYC detector was simulated using the Birks equation for light quenching in scintillators. The simulations were benchmarked against neutron scattering data from a 12 C target obtained with a white neutron beam at the Los Alamos LANSCE facility and fourteen 1”x1” C 7 LYC detectors. Incident neutron energies extracted from time-of-flight measurements, and appropriate recoil corrections for the different detector angles were used to map the response of C 7 LYC to mono-energetic neutrons. Resonances in the 35 Cl(n,p) reaction cross-section below 3 MeV incident neutron energy were directly observed in C 7 LYC. The experimental data and simulations are compared with ENDF databases, as well as recent direct cross-section measurements of neutrons scattered from a 35 Cl target. In conclusion, the results suggest a scrutiny of the 35 Cl(n,p) and 35 Cl(n, α) cross sections at low energy in the ENDF library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Numerical benchmark of transient pressure-driven metallic melt flows

Fluid dynamics simulations of melting and crater formation at the surface of a copper cathode exposed to high plasma heat fluxes and pressure gradients are presented. The predicted deformations of the free surface and the temperature evolution inside the metal are benchmarked against previously published simulations. Despite the physical model being entirely hydrodynamic and ignoring a variety of plasma–surface interaction processes, the results are also shown to be remarkably consistent with the predictions of more advanced models, as well as experimental data. This provides a sound basis for future applications of similar models to studies of transient surface melting and droplet ejection from metallic plasma-facing components after disruptions.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Material Interactions in Severe Accidents – Benchmarking the MELCOR V2.2 Eutectics Model for a BWR-3 Mark-I Station Blackout: Part II – Uncertainty Analysis

Single case comparisons between severe accident simulations can provide detailed insights into severe accident model behavior, however, they cannot offer insights into model uncertainty, sensitivity to uncertain parameters, or underlying model biases.Here in this analysis, the single case benchmark comparison of the MELCOR material interaction models for a station blackout (SBO) scenario of a boiling water reactor (BWR) using representative Fukushima Daiichi Unit 1 boundary conditions is expanded to include an uncertainty analysis. As part of this uncertainty analysis, 1200 simulations are performed for each material interaction model (2400 total), with random sampling of 14 uncertain MELCOR input parameters. Input parameters are selected for their impact on models representing core degradation processes. These include candling, fuel rod failure, debris quenching and dryout. The analysis performed here is not a traditional “best-estimate” uncertainty analysis that uses best-estimate parameters or identifies best-estimate figure of merit distributions. Instead, it is an exploratory uncertainty analysis that identifies and interrogates underlying model form biases of the two material interaction models (eutectics and interactive materials models). Uniform distributions are applied to all uncertain parameters to ensure coverage of the model parameter uncertainty space. Key findings from this study include underlying model form biases exhibited by material interaction models, and notable differences in accident progression outcomes between the material interaction models. This uncertainty study extends and confirms the conclusions from the first part of this study, which compared the impact of material interaction modeling on simulation of a short-term station blackout scenario with representative Fukushima Daiichi Unit I boundary conditions. In particular, this study confirms that the eutectics model generally exhibits accelerated degradation and failure of fuel components, the core plate, and the lower head. The eutectics model also has a tendency to exhibit a greater degree of core degradation, greater debris mass formation, and larger debris mass ejection. Finally, the eutectics model exhibits higher maximum temperatures for fuel, cladding, particulate debris, oxidic molten pool, and metallic molten pool components than the interactive materials model; interactive materials model simulations exhibit a soft “limitation” on maximum temperatures that is related to the temperature at which material relocation occurs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Wind turbine response in waked inflow: A modelling benchmark against full-scale measurements

Predicting the power and loads of wind turbines in waked inflow conditions still presents a major modelling challenge. It requires the accurate modelling of the atmospheric flow conditions, wakes of upstream turbines and the response of the turbine of interest. Rigorous validations of model frameworks against measurements of utility-scale wind turbines in such scenarios remain limited to date. In this study, six models of different fidelity are compared against measurements from the DanAero experiment. The two benchmark cases feature a full-wake and partial-wake scenario, respectively. The simulations are compared against local pressure forces and inflow velocities measured on several blade sections of the downstream turbine, as well as met mast measurements and standard SCADA data. Regardless of the model fidelity, reasonable agreements are found in terms of the wake characteristics and turbine response. For instance, the azimuth variation of the mean aerodynamic forces acting on the blade was captured with a mean relative error of 15-20%. Additionally, while various model-specific deficiencies could be identified, the study highlights the need for further full-scale measurement campaigns with even more extensive instrumentation. Furthermore, it is concluded that validations should not be limited to integrated and/or time-averaged quantities that conceal characteristic spatial or temporal variations.

17 WIND ENERGY↗
DOE OSTI2020

Modeling of thermal pressurization in tight claystone using sequential THM coupling: Benchmarking and validation against in-situ heating experiments in COx claystone

We apply thermoporoelasticity and a sequentially coupling technique for modeling thermally-driven coupled Thermo-Hydro-Mechanical (THM) processes in tight claystone. A THM benchmark case with a corresponding analytic solution for thermoporoelasticity under a constant heat loading verifies the model. Thereafter, two in situ heating experiments are simulated for model validation: a smaller-scale heating experiment (TED experiment) and a larger-scale experiment (ALC experiment) in Callovo-Oxfordian (COx) claystone at the Meuse/Haute-Marne underground research laboratory in France. The model exhibits good performance to match the observed temperature and pore pressure evolution for the smaller-scale TED experiment. For the larger-scale ALC experiment, general trends of thermal-pressurization are captured in the modeling, but pressure is underestimated at some monitoring points during cool-down. This indicates that the THM response in the field may be affected by the variability of rock's properties or irreversible or time-dependent mechanical processes that are not included in the current thermoporoelastic model. The main contributions of this work are as follows: (1) we verify and validate the numerical simulator, TOUGH-FLAC, to be a valuable coupled THM modeling tool; (2) prove that the laboratory determined material parameters can be used as reference values for upscaling experiments. However, to better identify and quantify THM processes with modeling of in situ tests, more emphasize should be dedicated to obtaining high-quality mechanical deformation data.

58 GEOSCIENCES↗
DOE OSTI2023

Benchmarking magnetised three-wave coupling for laser backscattering: analytic solutions and kinetic simulations

Understanding magnetised laser–plasma interactions is important for controlling magneto-inertial fusion experiments and developing magnetically assisted radiation and particle sources. For nanosecond pulses at non-relativistic intensities, interactions are dominated by coherent three-wave interactions, whose nonlinear coupling coefficients became known only recently when waves propagate at oblique angles with the magnetic field. In this paper, backscattering coupling coefficients predicted by warm-fluid theory are benchmarked using particle-in-cell simulations in one spatial dimension, and excellent agreements are found for a wide range of plasma temperatures, magnetic field strengths and laser propagation angles, when the interactions are mediated by electron-dominant hybrid waves. Systematic comparisons between theory and simulations are made possible by a rigorous protocol. On the theory side, the initial boundary value problem of linearised three-wave equations is solved, and the transient-time solutions allow the effects of growth and damping to be distinguished. On the simulation side, parameters are carefully chosen and calibration runs are performed to ensure that comparisons are well controlled. Fitting simulation data to analytical solutions yields numerical growth rates that match theory predictions within error bars. Although warm-fluid theory is found to be valid for a wide parameter range, genuine kinetic effects have also been observed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

An Introduction to the Benchmarking and Publications for Non-Targeted Analysis Working Group

Non-targeted analysis (NTA) encompasses a rapidly evolving set of mass spectrometry techniques aimed at characterizing the chemical composition of complex samples, identifying unknown compounds, and/or classifying samples, without prior knowledge regarding the chemical content of the samples. Recent advances in NTA are the result of improved and more accessible instrumentation for data generation, and analysis tools for data evaluation and interpretation. As researchers continue to develop NTA approaches in various scientific fields, there is a growing need to identify, disseminate, and adopt community-wide method reporting guidelines. In 2018, NTA researchers formed the Benchmarking and Publications for Non-Targeted Analysis Working Group (BP4NTA) to address this need. Consisting of participants from around the world and representing fields ranging from environmental science and food chemistry to ‘omics and toxicology, BP4NTA provides resources addressing a variety of challenges associated with NTA. Furthermore, thus far, BP4NTA group members have aimed to establish consensus on NTA-related terms and concepts, and to create consistency in reporting practices by providing resources on a public website, including consensus definitions, reference content, and lists of available tools. Moving forward, BP4NTA will provide a setting for NTA researchers to continue discussing emerging challenges and contribute to additional harmonization efforts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Benchmarking Soft Sensors for Remote Monitoring of On-Site Wastewater Treatment Plants

On-site wastewater treatment plants (OSTs) are usually unattended, so failures often remain undetected and lead to prolonged periods of reduced performance. To stabilize the performance of unattended plants, soft sensors could expose faults and failures to the operator. In a previous study, we developed soft sensors and showed that soft sensors with data from unmaintained physical sensors can be as accurate as soft sensors with data from maintained ones. The monitored variables were pH and dissolved oxygen (DO), and soft sensors were used to predict nitrification performance. In the present study, we use synthetic data and monitor three plants to test these soft sensors. We find that a long solids retention time and a moderate aeration rate improve the pH soft-sensor accuracy and that the aeration regime is the main operational parameter affecting the accuracy of the DO soft sensor. We demonstrate that integrated design of monitoring and control is necessary to achieve robustness when extrapolating from one OST to another in the absence of plant-specific fine-tuning. Additionally, we provide a unique labeled dataset for further feature and data-driven soft-sensor development. Our benchmarking results indicate that it is feasible to monitor OSTs with unmaintained sensors and without plant-specific tuning of the developed soft sensors. This is expected to drastically reduce monitoring costs for OST-based sanitation systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Benchmarking an Embedded Adaptive Sampling Configuration Interaction Method for Surface Reactions: H 2 Desorption from and CH 4 Dissociation on Cu(111)

Embedded (emb-) correlated wavefunction (CW) theory enables accurate assessments of both ground- and excited-state reaction mechanisms involved in heterogeneous catalysis. Embedded multireference second-order perturbation theory (emb-MRPT2) based on reference wavefunctions generated via embedded complete active space self-consistent field (emb-CASSCF) theory is currently state-of-the-art. However, the factorial scaling of CASSCF limits the size of active space and the complexity of systems that can be studied. In this work, we assess the efficacy of an alternative CW method, adaptive sampling configuration interaction (ASCI)–which enables large active spaces to be used–for studying surface reactions. We couple ASCI with density functional embedding theory (DFET) and benchmark its performance for two reactions: H 2 desorption from and CH 4 dissociation on the Cu(111) surface. Unlike embedded complete active space second-order perturbation theory (emb-CASPT2) that accurately reproduces a measured H 2 desorption barrier, embedded ASCI, using a very large active space (though one that still comprises a small portion of the full set of orbitals) fails to do so. Adding an extra correlation term from embedded Møller–Plesset second-order perturbation theory (emb-MP2) improves the desorption barrier and endothermicity predictions. Thus, the inaccuracy of embedded ASCI comes from the missing dynamic correlation from the many other electrons and orbitals not included in the active space. For CH 4 dissociation, again embedded ASCI overestimates the dissociation barrier compared to emb-CASPT2 predictions. Adding dynamic correlation from emb-MP2 helps correct the barrier. However, this composite approach suffers from double counting of correlation within embedded ASCI followed by emb-MP2 calculations. We therefore conclude that the state-of-the-art emb-MRPT2 based on reference wavefunctions generated via emb-CASSCF remains the method of choice for studying surface reactions. emb-ASCI is useful when large active spaces beyond the limit of emb-CASSCF are essential, such as to study complex surface reactions with significant multiconfigurational character (static correlation) but weak dynamic correlation.

08 HYDROGEN↗
DOE OSTI2022

Quadratic Unitary Coupled-Cluster Singles and Doubles Scheme: Efficient Implementation, Benchmark Study, and Formulation of an Extended Version

An efficient implementation of the quadratic unitary coupled-cluster singles and doubles (qUCCSD) scheme for calculations of electronic ground and excited states using an unrestricted molecular spin–orbital formulation and an efficient tensor contraction library is reported. The accuracy of the qUCCSD scheme and the efficiency of the present implementation are demonstrated using extensive benchmark calculations of excitation energies and an application to S o → S 1 vertical excitation energies for cis- and trans-4a,4b-dihydrotriphenylene. The qUCCSD scheme has been shown to provide improved excitation energies compared with the UCC3 scheme formulated based on perturbation theory. Here, a UCC truncation scheme that can provide excitation energies correct through the fourth order is also presented to further improve the accuracy of the qUCCSD scheme.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Importance of Electron Correlation on the Geometry and Electronic Structure of [2Fe–2S] Systems: A Benchmark Study of the [Fe 2 S 2 (SCH 3 ) 4 ] 2–,3–,4– , [Fe 2 S 2 (SCys) 4 ] 2– , [Fe 2 S 2 (S- p -tol) 4 ] 2– , and [Fe 2 S 2 (S- o -xyl) 4 ] 2– Complexes

Iron–sulfur clusters are crucial for biological electron transport and catalysis. Obtaining accurate geometries, energetics, manifolds of their excited electronic states, and reduction energies is important to understand their role in these processes. Here, using a [2Fe–2S] model complex with Fe II and Fe III oxidation states, which leads to different charges, i.e., [Fe 2 S 2 (SMe) 4 ] 2–,3–,4– , we benchmarked a variety of computational methodologies ranging from density functional theory (DFT) to post-Hartree–Fock methods, including complete active space self-consistent field (CASSCF), multireference configuration interaction, the second-order N-electron valence state perturbation theory (NEVPT2), and the linearized integrand approximation of adiabatic connection (AC0) approaches. Additionally, we studied three experimentally well-characterized complexes, [Fe 2 S 2 (SCys) 4 ] 2– , [Fe 2 S 2 (S-o-tol) 4 ] 2– , and [Fe 2 S 2 (S-o-xyl) 4 ] 2– , via DFT methods. We conclude that the dynamic electron correlation is important for accurately predicting the geometry of these complexes. Broken symmetry (BS) DFT correctly predicts experimental geometries of low-spin multiplicity, while CASSCF does not. However, BS-DFT significantly overestimates the difference between the low- and high-spin electronic states for a given oxidation state. At the same time, CASSCF underestimates it but provides relative energies closer to the reference NEVPT2 results. Finally, AC0 provides energetics of NEVPT2 quality with the additional advantage of being able to use large CASSCF sizes. NEVPT2 gives the best estimates of the Fe III /Fe III → Fe II /Fe III (4.27 eV) and Fe II /F III → Fe II /F II (7.72 eV) reduction energies. The results provide insight into the electronic structure of these complexes and assist in the understanding of their physical properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Benchmarking the Performance of the ReaxFF Reactive Force Field on Hydrogen Combustion Systems

A thorough understanding of the kinetics and dynamics of combusting mixtures is of considerable interest, especially in regimes beyond the reach of current experimental validation. The ReaxFF reactive force field method has provided a way to simulate large-scale systems of hydrogen combustion via a parametrized potential that can simulate bond breaking. This modeling approach has been applied to hydrogen combustion, as well as myriad other reactive chemical systems. In this work, we benchmark the performance of several common parametrizations of this potential against higher-level quantum mechanical (QM) approaches. We demonstrate instances where these parametrizations of the ReaxFF potential fail both quantitatively and qualitatively to describe reactive events relevant for hydrogen combustion systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Quantum Simulation of Molecular Dynamics Processes─A Benchmark Study Using a Classical Simulator and Present-Day Quantum Hardware

Here, we explore how the fundamental problems in quantum molecular dynamics can be modeled using classical simulators (emulators) of quantum computers and the actual quantum hardware available to us today. The list of problems we tackle includes propagation of a free wave packet, vibration of a harmonic oscillator, and tunneling through a barrier. Each of these problems starts with the initial wave packet setup. Although Qiskit provides a general method for initializing wave functions, in most cases it generates deep quantum circuits. While these circuits perform well on noiseless simulators, they suffer from excessive noise on quantum hardware. To overcome this issue, we designed a shallower quantum circuit for preparing a Gaussian-like initial wave packet, which improves the performance of real hardware. Next, quantum circuits are implemented to apply the kinetic and potential energy operators for the evolution of a wave function over time. The results of our modeling on classical emulators of quantum hardware agree perfectly with the results obtained using the traditional (classical) methods. This serves as a benchmark and demonstrates that the quantum algorithms and Qiskit codes we developed are accurate. However, the results obtained on the actual quantum hardware available today, such as IBM’s superconducting qubits and IonQ’s trapped ions, indicate large discrepancies due to hardware limitations. This work highlights both the potential and challenges of using quantum computers to solve fundamental quantum molecular dynamics problems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Benchmarking DFT Accuracy in Predicting O 1s Binding Energies on Metals

X-ray photoelectron spectroscopy (XPS) is a powerful tool for probing the electronic structure and composition of materials, particularly metals and metal oxides of relevance to solar cells and catalysis. Density functional theory (DFT) is often used to support XPS peak assignments, but its reliability for predicting oxygen species is not well established. Here, we compile a large data set of experimental oxygen binding energies and evaluate corresponding DFT predictions. We find that as the binding energies of metal-bound atomic oxygen species increase, especially above ≈530 eV, there is a general decrease in the accuracy of DFTpredicted values. Thus, high-binding-energy atomic oxygen species, such as those proposed as active for selective Ag-catalyzed epoxidation, are less well represented. The chemical nature of the oxygen species also influences accuracy, with molecularly bound species more reliably captured across the entire range of energies. These findings illustrate the limitations of DFT for interpreting XPS spectra and provide a benchmark for improving computational methods.

Adsorption↗
DOE OSTI2025

Quantum Monte Carlo Benchmarking of Molecular Adsorption on Graphene-Supported Single Pt Atom

The precise understanding of adsorption energetics and molecular geometry at catalytic sites is fundamental for advancing catalysis, particularly under the constraints of resource efficiency and environmental sustainability. Here, this study benchmarks the performance of density functional theory (DFT) calculations against diffusion Monte Carlo (DMC) calculations for adsorption properties of small gas molecules relevant to CO oxidation—namely O 2 , CO, CO 2 , and atomic oxygen—on a single Pt atom supported by pristine graphene. Our findings reveal that DMC calculations provide a significantly different landscape of adsorption energetics compared to DFT results. Notably, DFT predicts different lowest-energy configurations and spin states, particularly for O 2 , which suggests potential discrepancies in predicting the catalytic behavior. Furthermore, this study identifies the critical issue of CO poisoning, highlighted by the large disparity between the DMC adsorption energies of O 2 (−1.23(2) eV) and CO (−3.37(1) eV), which can inhibit the catalytic process. These results emphasize the necessity for more sophisticated computational approaches in catalysis research, aiming to refine the prediction accuracy of reaction mechanisms and to enhance the design of more effective catalysts.

Ahn, Jeonghwan [University of Illinois at Urbana-C↗
DOE OSTI2025

Benchmarking Density Functional Theory Methods for Efficient Calculations of a Strongly Correlated Li 1– x Ni 1– y O 2−δ System

Transition metal oxides (TMOs), such as LiNiO 2 , are promising candidates for energy storage and electronic devices due to their unique electronic properties, exceptional physical and chemical characteristics, and ability to adopt multiple oxidation states. However, accurately predicting their properties using mean-field density functional theory (DFT) is challenging due to the presence of strongly correlated d-electrons and the complex interplay between their structural, electronic, and magnetic responses. These challenges are further exacerbated by the need to model defects, surfaces, and interfaces, which require computationally efficient, large-scale simulations. To address these issues, we carry out a benchmark study on the Li 1–x NiO 2 system, evaluating the performance of several popular functionals. Our findings demonstrate that combining SCAN functional relaxation with single-step HSE calculations provides a practical and scalable computational strategy. This approach balances accuracy and efficiency, enabling high-throughput simulations of strongly correlated TMOs and improved predictive modeling capability of TMOs for practical applications.

25 ENERGY STORAGE↗