SEARCH · Engineering Papers
Results for “Benchmarks”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Design, Manufacture, and Testing of an Open-Source Benchmark Composite Hydrokinetic Turbine Blade: Preprint
In a trend toward clean energy alternatives, recent years have seen great strides in the marine energy space. Consequently, there is a pressing need for the design, development, and validation of novel energy harvesting technologies such as hydrokinetic devices, which capture kinetic energy from waves, tides, and currents. However, these devices span numerous concepts and designs that often lack solid benchmark research that can be freely referenced throughout their development. This work focuses on the design process of an open-source composite hydrokinetic turbine blade for a three-bladed marine turbine rotor assembly with a diameter of 2.5 m. The proposed blade consists of two structural composite skins that are bonded with an adhesive and filled with a foam core. This study also explores and contrasts the efficiency and resolution of low-fidelity rapid design methodologies and comprehensive high-fidelity approaches in the context of blade design, modeling, and analysis efforts, a key objective in this research. Blade hydrodynamic loads were modeled and applied to finite-element blade models to study deformations and potential failure. Ongoing and upcoming efforts will result in blade manufacture and structural testing at the National Renewable Energy Laboratory. In future work, multiple blades will be deployed at the Living Bridge site at the University of New Hampshire and will be compared to rigid aluminum blades of the same geometry, developed by Sandia National Laboratories. Ultimately, this research will lay foundational groundwork for researchers and manufacturers, establishing a baseline composite blade design that will serve as a benchmark in the development of future hydrokinetic turbine blades.
Application-level benchmarking of quantum computers using nonlocal game strategies
In a nonlocal game, two noncommunicating players cooperate to convince a referee that they possess a strategy that does not violate the rules of the game. Quantum strategies allow players to optimally win some games by performing joint measurements on a shared entangled state, but computing these strategies can be challenging. We present a variational quantum algorithm to compute quantum strategies for nonlocal games by encoding the rules of a nonlocal game into a Hamiltonian. We show how this algorithm can generate a short-depth optimal quantum strategy for a graph coloring game with a quantum advantage. This quantum strategy is then evaluated on fourteen different quantum hardware platforms to demonstrate its utility as a benchmark. Finally, we discuss potential sources of errors that can explain the observed decreased performance of the executed task and derive an expression for the number of samples required to accurately estimate the win rate in the presence of noise.
Best Practices and Testing Protocols for Benchmarking ORR Activities of Fuel Cell Electrocatalysts Using Rotating Disk Electrode
Abstract Thin-film-rotating disk electrodes (TF-RDEs) are the half-cell electrochemical system of choice for rapid screening of oxygen reduction reaction (ORR) activity of novel Pt supported on carbon black supports (Pt/C) electrocatalysts. It has been shown that the magnitude of the measured ORR activity and reproducibility are highly dependent on the system cleanliness, evaluation protocols, and operating conditions as well as ink formulation, composition, film drying, and the resultant film thickness and uniformity. Accurate benchmarks of baseline Pt/C catalysts evaluated using standardized protocols and best practices are necessary to expedite ultra-low-platinum group metal (PGM) catalyst development that is crucial for the imminent commercialization of fuel cell vehicles. We report results of evaluation in three independent laboratories of Pt/C electrocatalysts provided by commercial fuel cell catalyst manufacturers (Johnson Matthey, Umicore, Tanaka Kikinzoku Kogyo—TKK). The studies were conducted using identical evaluation protocols/ink formulation/film fabrication albeit employing unique electrochemical cell designs specific to each laboratory. The ORR activities reported in this work provide a baseline and criteria for selection and scale-up of novel high activity ORR electrocatalysts for implementation in proton exchange membrane fuel cells (PEMFCs).
Simulation of the BEAVRS benchmark using VERA
The Virtual Environment for Reactor Applications (VERA) is being developed by the Consortium for the Advanced Simulation of Light Water Reactors (CASL). Here, VERA is used to perform the Benchmark for Evaluation and Validation of Reactor Simulations (BEAVRS), which provides two cycles’ worth of operating power history, along with a full, detailed description of the geometry, and measured data. Cycle 1 and 2 are simulated with VERA and the results are compared to the measured zero power physics tests, critical boron concentration, and flux maps.
Spin-orbit couplings within the equation-of-motion coupled-cluster framework: Theory, implementation, and benchmark calculations
We present a formalism and an implementation for calculating spin-orbit couplings (SOCs) within the EOM-CCSD (equation-of-motion coupled-cluster with single and double substitutions) approach. The following variants of EOM-CCSD are considered: EOM-CCSD for excitation energies (EOM-EE-CCSD), EOM-CCSD with spin-flip (EOM-SF-CCSD), EOM-CCSD for ionization potentials (EOM-IP-CCSD) and electron attachment (EOM-EA-CCSD). We employ a perturbative approach in which the SOCs are computed as matrix elements of the respective part of the Breit-Pauli Hamiltonian using zeroth-order non-relativistic wave functions. We follow the expectation-value approach rather than the response-theory formulation for property calculations. Both the full two-electron treatment and the mean-field approximation (a partial account of the two-electron contributions) have been implemented and benchmarked using several small molecules containing elements up to the fourth row of the periodic table. The benchmark results show the excellent performance of the perturbative treatment and the mean-field approximation. When used with an appropriate basis set, the errors with respect to experiment are below 5% for the considered examples. The findings regarding basis-set requirements are in agreement with previous studies. The impact of different correlation treatment in zeroth-order wave functions is analyzed. Overall, the EOM-IP-CCSD, EOM-EA-CCSD, EOM-EE-CCSD, and EOM-SF-CCSD wave functions yield SOCs that agree well with each other (and with the experimental values when available). Using an EOM-CCSD approach that provides a more balanced description of the target states yields more accurate results.
A systematic benchmark of the ab initio Bethe-Salpeter equation approach for low-lying optical excitations of small organic molecules
The predictive power of the ab initio Bethe-Salpeter equation (BSE) approach, rigorously based on many-body Green’s function theory but incorporating information from density functional theory, has already been demonstrated for the optical gaps and spectra of solid-state systems. Interest in photoactive hybrid organic/inorganic systems has recently increased and so has the use of the BSE for computing neutral excitations of organic molecules. However, no systematic benchmarks of the BSE for neutral electronic excitations of organic molecules exist. Here, we study the performance of the BSE for the 28 small molecules in Thiel’s widely used time-dependent density functional theory benchmark set [Schreiber et al., J. Chem. Phys. 128, 134110 (2008)]. We observe that the BSE produces results that depend critically on the mean-field starting point employed in the perturbative approach. We find that this starting point dependence is mainly introduced through the quasiparticle energies obtained at the intermediate GW step and that with a judicious choice of starting mean-field, singlet excitation energies obtained from BSE are in excellent quantitative agreement with higher-level wavefunction methods. The quality of the triplet excitations is slightly less satisfactory.
Jet substructure at the Tevatron and LHC: new results, new tools, new benchmarks
Here, we review recent theoretical progress and the latest experimental results in jet substructure from the Tevatron and the LHC. We review the status of and outlook for calculation and simulation tools for studying jet substructure. Following up on the report of the Boost 2010 workshop, we present a new set of benchmark comparisons of substructure techniques, focusing on the set of variables and grooming methods that are collectively known as ‘top taggers’. To facilitate further exploration, we have attempted to collect, harmonize and publish software implementations of these techniques.
A Benchmark Case for the Grid Survivability Analysis
Among current priorities of the power system analysis is the development of metrics and computational tools for the resilience analysis during catastrophic events. New methods and tools are required for such an analysis and they have to be validated prior application to real systems. However, benchmark problems are not readily available due to the analysis novelty. The current paper presents a case based on the IEEE 14-bus system for this purpose. The grid is simplified to a graph with nodes representing generators, loads, and buses. Power inputs are imported from real-time simulations of the IEEE 14-bus system. Outcomes of all possible combinations of failed elements are presented in terms of probabilities for the grid to survive, partially survive, or fail. Only the power grid's ability to withstand adverse events (survivability) is analyzed. The grid's recoverability, the other part of the resilience analysis, is not considered.
SCALE HTR-PROTEUS Benchmark Model
This dataset contains input and result files of computational simulations of HTR-PROTEUS benchmark with the latest version of SCALE code system. The simulations cover criticality control rod worth calculations as well as sensitivity analysis and uncertainty quantification. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases
Glassy Carbon Substrate Oxidation Effects on Electrode Stability for Oxygen Evolution Reaction Catalysis Stability Benchmarking
Employing benchmarking metrics to capture the activity and stability of electrocatalysts for the oxygen evolution reaction (OER) in acid is a critical practice that enables meaningful comparison of catalyst material candidates reported throughout the literature. In this work, we find that ubiquitously used glassy carbon electrode substrates oxidize under typical OER operating conditions, forming a pacified, electrically insulating, and oxygen-rich surface layer that causes drastic loss of current density over the course of extended chronoamperometric stability tests at an anodic potential of 1.7 VRHE. We show that the experimentally observed stability of glassy carbon-based electrodes is approximately two orders of magnitude lower than that expected solely from dissolution-based catalyst intrinsic stability of Ir-based catalysts. We additionally find that glassy carbon-based electrode stability measured by chronoamperometric holds is greatly impacted by catalyst loading, with high catalyst loadings improving the stability of the overall electrode via a protective effect on the glassy carbon substrate. Altogether, our investigation highlights that glassy carbon is not electrochemically inert under OER conditions on the timescale of common stability tests, which can cause electrodes to exhibit performance losses that do not reflect the intrinsic stability of the actual catalyst material being investigated. In light of our findings, we underscore the usefulness of metrics, such as the S-number, to reflect intrinsic catalyst material stability.
Benchmark Interaction Energies for Biologically Relevant Noncovalent Complexes Containing Divalent Sulfur
Explore the source record for details and available documents.
Electronic Energies Are Not Enough: An Ion Mobility-Aided, Quantum Chemical Benchmark Analysis of H + GPGG Conformers
Peptides and proteins exist not as single, lowest energy structures but as ensembles of states separated by small barriers. In order to study these species we must be able to correctly identify their gas phase conformational distributions, and ion mobility spectrometry (IMS) has arisen as an experimental method for assessing the gas phase energetics of flexible peptides. Here, we present a thorough exploration and benchmarking of the low energy conformers of the small, hairpin peptide H+ GPGG with the aid of ion mobility spectrometry against a wide swath of density functionals (35 dispersion-corrected and uncorrected functionals represented by 21 unique exchange–correlation functionals) and wave function theory methods (15 total levels of theory). The three experimentally resolved IMS peaks were found to correspond to three distinct pairs of conformers, each pair composed of species differing only by the chair or boat configuration of the proline. Two of the H+ GPGG conformer pairs possess a cis configuration about the Pro–Gly1 peptide bond while the other adopts a trans configuration. While the experimental spectrum reports a higher intensity for the cis-1 conformer than the trans conformer, 13 WFT levels of theory, including a complete basis set CCSD(T) extrapolation, obtain trans to be favored in terms of the electronic energy. This same effect is seen in 14 of the 18 dispersion-corrected density functionals studied, whereas the remaining 17 functionals show more variety. Only when Gibbs free energies are considered do the WFT methods and dispersion-corrected functionals reflect the experimental distribution. CAM-B3LYP-D3BJ emerges as the best-performing density functional, matching the experimental distribution and the CCSD(T)/CBS relative energies within 6%. Further analysis reveals the trans conformer to be favored electronically, but entropically disfavored, leading to the experimental preference of the cis-1 conformer. Furthermore, these results highlight the danger in considering only the electronic energies, which is common practice in electronic structure theory predictions of conformational energy distributions. Additionally, the effects of temperature and scaling of the frequencies used in obtaining the Gibbs free energies are explored.
Quantum Monte Carlo benchmark of exchange-correlation functionals for bulk water
Abstract not provided
Quantum Monte Carlo benchmarking of large noncovalent complexes in the L7 benchmark set
We have used diffusion Monte Carlo (DMC) to perform calculations on the L7 benchmark set. DMC is a stochastic numerical integration scheme in real-space and part of a larger set of quantum Monte Carlo methods. The L7 set was designed to test the ability of electronic structure methods to include dispersive interactions. While the agreement between DMC and quantum-chemical state-of-the-art methods is excellent for some of the structures, there are significant differences in others. In contrast to wavefunction-based quantum chemical methods, DMC is a first-principle many-body method with the many-body wavefunction evolving in real space. It includes explicitly all electron–electron interactions and is relatively insensitive to the size of the basis set.
MSSM Higgs Boson Searches at the LHC: Benchmark Scenarios after the Discovery of a Higgs-like Particle
A Higgs-like particle with a mass of about 125.5 GeV has been discovered at the LHC. Within the current experimental uncertainties, this new state is compatible with both the predictions for the Standard Model (SM) Higgs boson and with the Higgs sector in the Minimal Supersymmetric Standard Model (MSSM). We propose new low-energy MSSM benchmark scenarios that, over a wide parameter range, are compatible with the mass and production rates of the observed signal. These scenarios also exhibit interesting phenomenology for the MSSM Higgs sector. We propose a slightly updated version of the well-known mh-max scenario, and a modified scenario (mh-mod), where the light CP-even Higgs boson can be interpreted as the LHC signal in large parts of the MA-tan \beta\ plane. Furthermore, we define a light stop scenario that leads to a suppression of the lightest CP-even Higgs gluon fusion rate, and a light stau scenario with an enhanced decay rate of h to \gamma\gamma\ at large tan \beta. We also suggest a \tau-phobic Higgs scenario in which the lightest Higgs can have suppressed couplings to down-type fermions. We propose to supplement the specified value of the \mu\ parameter in some of these scenarios with additional values of both signs. This has a significant impact on the interpretation of searches for the non SM-like MSSM Higgs bosons. We also discuss the sensitivity of the searches to heavy Higgs decays into light charginos and neutralinos, and to decays of the form H to hh. Finally, in addition to all the other scenarios where the lightest CP-even Higgs is interpreted as the LHC signal, we propose a low-MH scenario, where instead the heavy CP-even Higgs boson corresponds to the new state around 125.5 GeV.
Development of a Computer-based Benchmarking and Analytical Tool: Benchmarking and Energy & Water Savings Tool in Dairy Plants (BEST-Dairy)
The overall goal of the project is to develop a computer-based benchmarking and energy and water savings tool (BEST-Dairy) for use in the California dairy industry – including four dairy processes – cheese, fluid milk, butter, and milk powder.