Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

2D radial-azimuthal particle-in-cell benchmark for E × B discharges

In this paper we propose a representative simulation test-case of E × B discharges accounting for plasma wall interactions with the presence of both the electron cyclotron drift instability and the modified-two-stream-instability. Seven independently developed particle-in-cell (PIC) codes have simulated this benchmark case, with the same specified conditions. The characteristics of the different codes and computing times are given. Here, results show that both instabilities were captured in a similar fashion and good agreement between the different PIC codes is reported as main plasma parameters were closely related within a 5% interval. The number of macroparticles per cell was also varied and statistical convergence was reached. Detailed outputs are given in the supplementary data, to be used by other similar groups in the perspective of code verification.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

A code-to-code benchmark for magneto-convection in a horizontal duct

Liquid metals and magnetic fields are used in many technical applications such as metallurgy, crystal growth and nuclear fusion reactors. When an electrically conducting fluid moves in a magnetic environment, electric currents and electromagnetic forces are generated that affect velocity and pressure losses in the flow. These magnetohydrodynamic (MHD) interactions have to be investigated to optimize the engineering processes. The characteristics of MHD flows depend on the geometrical configuration, the strength of the applied magnetic field, the electrical properties of fluid and structural materials and the thermal conditions. In the so-called blankets for fusion reactors, where liquid metals are used to breed the plasma fuel component tritium and to extract the generated heat, magneto-convective flows play a crucial role in determining heat and mass transfer. Therefore, the availability of numerical codes to simulate this type of flow is mandatory and their validation is a necessary step to guarantee the reliability of the results. For that reason, a benchmark problem has been defined to simulate liquid metal flows in a horizontal rectangular duct heated from below and exposed to a non-uniform magnetic field. Results obtained by five research groups using different codes are compared.

benchmark↗
DOE OSTI2022

Benchmarking embedded chain breaking in quantum annealing*

Quantum annealing solves combinatorial optimization problems by finding the energetic ground states of an embedded Hamiltonian. However, quantum annealing dynamics under the embedded Hamiltonian may violate the principles of adiabatic evolution and generate excitations that correspond to errors in the computed solution. Here we empirically benchmark the probability of chain breaks and identify sweet spots for solving a suite of embedded Hamiltonians. We further correlate the physical location of chain breaks in the quantum annealing hardware with the underlying embedding technique and use these localized rates in a tailored post-processing strategies. Our results demonstrate how to use characterization of the quantum annealing hardware to tune the embedded Hamiltonian and remove computational errors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Benchmarking noise extrapolation with the OpenPulse control framework

Distilling precise estimates from noisy intermediate scale quantum (NISQ) data has recently attracted considerable attention Kandala et al., Nature (London) 567, 491 (2019). In order to augment digital qubit metrics, such as gate fidelity, we discuss analog error mitigability, i.e., the ability to accurately distill precise observable estimates, as a hybrid quantum classical computing benchmarking task. Specifically, using Rabi oscillations as a test program, we characterize single qubit error rates on IBM's Poughkeepsie superconducting quantum hardware, incorporate control-mediated noise dependence into a generalized rescaling protocol, and analyze how noise characteristics influence Richardson extrapolation-based error mitigation. Finally, our results identify regions in the space of Hamiltonian control fields and circuit depth which are most amenable to reliable noise extrapolation, as well as shed light on how low-level hardware characterization can be used as a predictive tool for uncertainty quantification in error-mitigated NISQ computations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Benchmarking Information Scrambling

Information scrambling refers to the rapid spreading of initially localized information over an entire system, via the generation of global entanglement. This effect is usually detected by measuring a temporal decay of the out-of-time order correlators. However, in experiments, decays of these correlators suffer from fake positive signals from various sources, e.g., decoherence due to inevitable couplings to the environment, or errors that cause mismatches between the purported forward and backward evolutions. Here, in this Letter, we provide a simple and robust approach to single out the effect of genuine scrambling. This allows us to benchmark the scrambling process by quantifying the degree of the scrambling from the noisy backgrounds. We also demonstrate our protocol with simulations on IBM cloud-based quantum computers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Invited Paper: Benchmarking and Optimizing Data Movement on Emerging Heterogeneous Architectures

As supercomputers evolve, nodes are continually increasing in complexity. As a result, each generation of parallel systems brings new performance challenges. For instance, on recent systems inter-node communication has outperformed inter-socket, resulting in poor performance of many node-aware communication optimizations. Communication optimizations are critical for the performance and scalability of parallel applications, but are dependent on the parallel architecture, which varies significantly among recent generations of supercomputers. Furthermore, this paper investigates the performance of various paths of data movement on recent generations of systems, and analyzes the increased complexity of communication, particularly on recent heterogeneous systems. The paper also introduces MPI Advance, a communication library that enables optimizations to be created based on benchmark analysis of each emerging system.

benchmarking↗
DOE OSTI2019

Energy and Performance Benchmarking of a Domain Wall-Magnetic Tunnel Junction Multibit Adder

The domain wall (DW)-magnetic tunnel junction (MTJ) device implements universal Boolean logic in a manner that is naturally compact and cascadable. However, an evaluation of the energy efficiency of this emerging technology for standard logic applications is still lacking. In this work, we use a previously developed compact model to construct and benchmark a 32-bit adder entirely from DW-MTJ devices that communicates with DW-MTJ registers. The results of this large-scale design and simulation indicate that, while the energy cost of systems driven by spin-transfer torque (STT) domain wall motion is significantly higher than previously predicted, the same concept using spin-orbit torque (SOT) switching benefits from an improvement in the energy per operation by multiple orders of magnitude, attaining competitive energy values relative to a comparable CMOS sub-processor component. This result clarifies the path towards practical implementations of an all-magnetic processor system.

42 ENGINEERING↗
DOE OSTI2016

Benchmark testing of DIII-D neutral beam modeling with water flow calorimetry

Power loading on beamline components in the DIII-D neutral beam system is measured in this paper using water flow calorimetry. The results are used to benchmark beam transport models. Finally, anomalously high heat loads in the magnet region are investigated and a speculative hypothesis as to their origin is presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2016

SU-F-T-153: Experimental Validation and Calculation Benchmark for a Commercial Monte Carlo Pencil Beam Scanning Proton Therapy Treatment Planning System in Water

Purpose: Eclipse proton Monte Carlo AcurosPT 13.7 was commissioned and experimentally validated for an IBA dedicated PBS nozzle in water. Topas 1.3 was used to isolate the cause of differences in output and penumbra between simulation and experiment. Methods: The spot profiles were measured in air at five locations using Lynx. PTW-34070 Bragg peak chamber (Freiburg, Germany) was used to collect the relative integral Bragg peak for 15 proton energies from 100 MeV to 225 MeV. The phase space parameters (σx, σθ, ρxθ) number of protons per MU, energy spread and calculated mean energy provided by AcurosPT were identically implemented into Topas. The absolute dose, profiles and field size factors measured using ionization chamber arrays were compared with both AcurosPT and Topas. Results: The beam spot size, σx, and the angular spread, σθ, in air were both energy-dependent: in particular, the spot size in air at isocentre ranged from 2.8 to 5.3 mm, and the angular spread ranged from 2.7 mrad to 6 mrad. The number of protons per MU increased from ∼9E7 at 100 MeV to ∼1.5E8 at 225 MeV. Both AcurosPT and TOPAS agree with experiment within 2 mm penumbra difference or 3% dose difference for scenarios including central axis depth dose and profiles at two depths in multi-spot square fields, from 40 to 200 mm, for all the investigated single-energy and multi-energy beams, indicating clinically acceptable source model and radiation transport algorithm in water. Conclusion: By comparing measured data and TOPAS simulation using the same source model, the AcurosPT 13.7 was validated in water within 2 mm penumbra difference or 3% dose difference. Benchmarks versus an independent Monte Carlo code are recommended to study the agreement in output, filed size factors and penumbra differences. This project is partially supported by the Varian grant under the master agreement between University of Pennsylvania and Varian.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2018

Plaster: An Integration, Benchmark and Development Framework for Heterogeneous Metadata Normalization Methods

The recent advances in the automation of metadata normalization and the invention of a unified schema — Brick — alleviate the metadata normalization challenge for deploying portable applications across buildings. Yet, the lack of compatibility between existing metadata normalization methods precludes the possibility of comparing and combining them. While generic machine learning (ML) frameworks, such as MLJAR and OpenML, provide versatile interfaces for standard ML problems, they cannot easily accommodate the metadata normalization tasks for buildings due to the heterogeneity in the inference scope, type of data required as input, evaluation metric, and the building-specific human-in-the-loop learning procedure. We propose Plaster, an open and modular framework that incorporates existing advances in building metadata normalization. It provides unified programming interfaces for various types of learning methods for metadata normalization and defines standardized data models for building metadata and timeseries data. Thus, it enables the integration of different methods via a workflow, benchmarking of different methods via unified interfaces, and rapid prototyping of new algorithms. With Plaster, we 1) show three examples of the workflow integration, delivering better performance than individual algorithms, 2) benchmark/analyze five algorithms over five common buildings, and 3) exemplify the process of developing a new algorithm involving time series features. We believe Plaster will facilitate the development of new algorithms and expedite the adoption of standard metadata schema such as Brick, in order to enable seamless smart building applications in the future.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2017

Validation and benchmarking of two particle-in-cell codes for a glow discharge

The two particle-in-cell codes EDIPIC and LSP are benchmarked and validated for a parallel-plate glow discharge in helium, in which the axial electric field had been carefully measured, primarily to investigate and improve the fidelity of their collision models. The scattering anisotropy of electron-impact ionization, as well as the value of the secondary-electron emission yield, are not well known in this case. The experimental uncertainty for the emission yield corresponds to a factor of two variation in the cathode current. If the emission yield is tuned to make the cathode current computed by each code match the experiment, the computed electric fields are in excellent agreement with each other, and within about 10% of the experimental value. The non-monotonic variation of the width of the cathode fa ll with the applied voltage seen in the experiment is reproduced by both codes. The electron temperature in the negative glow is within experimental error bars for both codes, but the density of slow trapped electrons is underestimated. A more detailed code comparison don e for several synthetic cases of electron-beam injection into helium gas shows that the codes are in excellent agreement for ionization rate, as well as for elastic and excitation collisions with isotropic scattering pattern. The remaining significant discrepancies between the two codes are due to differences in their electron binary-collision models, and for anisotropic scattering due to elastic and excitation collisions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

Benchmarking of alignment-free sequence comparison methods

Background: Alignment-free (AF) sequence comparison is attracting persistent interest driven by data-intensive applications. Hence, many AF procedures have been proposed in recent years, but a lack of a clearly defined benchmarking consensus hampers their performance assessment. Results: Here, we present a community resource (http://afproject.org) to establish standards for comparing alignment-free approaches across different areas of sequence-based research. We characterize 74 AF methods available in 24 software tools for five research applications, namely, protein sequence classification, gene tree inference, regulatory element detection, genome-based phylogenetic inference, and reconstruction of species trees under horizontal gene transfer and recombination events. Conclusion: The interactive web service allows researchers to explore the performance of alignment-free tools relevant to their data types and analytical goals. It also allows method developers to assess their own algorithms and compare them with current state-of-the-art tools, accelerating the development of new, more accurate AF solutions

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Phase 1 Specifications and preliminary sensitivity analyses of the OECD-NRC liquid metal fast reactor core thermal-hydraulics benchmark

The developments in wire-wrapped fuel bundle thermal-hydraulics research have become increasingly diverse and this makes comparisons across studies difficult. This paper describes an ongoing benchmark that will address this issue by directly comparing computational results with experimental data from two unique wire-wrapped thermal-hydraulic facilities. Preliminary subchannel sensitivity / uncertainty analyses show largely expected behavior for the presented cases, where rod diameter and friction factor show the greatest sensitivities to geometrical perturbations. Guidelines for computational fluid dynamics evaluations have been prepared and highlight the need for consolidated modeling strategies. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Comparative analysis of energy deposition modes available in Serpent 2 within the framework of the supercritical water reactor - Fuel qualification test reactor physics benchmark

A joint European Canadian Chinese development of a supercritical water-cooled small modular reactor (SCW-SMR) technology is in progress since September 2020 in the framework of a Horizon 2020 project called ECC-SMART. As a main purpose of the project, proper estimates of energy deposition and its spatial distribution are prerequisites for the accurate analysis of safety related parameters of the SCW-SMR concept under development. A supercritical water reactor fuel computational benchmark model, provided by Canadian Nuclear Laboratories, was applied for detailed comparison of different energy deposition calculation options available in the Serpent 2 Monte Carlo code. The effect of energy deposition options on the normalization of the results as well as on the spatial distribution of the energy deposition are discussed. Consistent energy deposition calculation methods are presented between three Monte Carlo codes, viz., Serpent 2, MCNP6 and OpenMC. Although resource-intensive, the use of the coupled neutron-photon transport mode of Serpent 2 is recommended for accurate spatial and quantitative characterization of energy deposition in the SCW-SMR fuel assemblies, accounting for both neutron and photon heating of all the materials. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Verification of the LOTUS code with C5G7 benchmark

In this study, the verification of the neutron transport code LOTUS through the well-known C5G7 benchmark is performed. LOTUS uses the current coupled collision probability method with the expansion of the flux by orthogonal polynomials (CCCPO) for the solution of the neutron transport equation. The expansion of the flux by orthogonal polynomials allows one to avoid discretization of the calculation regions and significantly decreases the simulation time. The results of the LOTUS calculations are compared with the results of the reference OpenMC Monte Carlo simulations. The results of the comparison demonstrate almost perfect agreement with Monte-Carlo for the second order of the flux expansion. Even though the results obtained in the presented study agree well with the results of reference Monte Carlo calculations, further investigations are necessary for a better understanding of the stability and limitations of the code.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Benchmark evaluation of one dimensional array of HEU moderated and reflected by Lucite

The evaluation of two HEU-Lucite experiments is presented. The critical experiments were performed using the Planet Universal Critical Assembly Machine at Los Alamos National Laboratory in 2019. In these experiments, HEU foils were interleaved with Lucite in a column stack and were moderated and reflected from the square Lucite plates. The neutron data produced were used to approximate the multiplication of each measured configuration. The evaluation of the experiments using calculational techniques is presented in the paper. A Monte-Carlo computational model to be used with MCNP6 was developed for the determination of uncertainties and the effects of various uncertainties on the multiplication factor were studied. The evaluation of the benchmark was performed for comparison of calculation results with the experimental data and validation of calculation techniques in particular the newly available thermal scattering data for the Lucite material. The sensitivity studies include parametric variations of material composition and geometry. Experimental uncertainties were low, with the overall height of the HEU/Lucite stack being the largest contributor to the overall uncertainty in k{sub eff}. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2019

Update on Benchmark Analysis of Component Critical Configurations of KRUSTY

Kilowatt Reactor Using Stirling Technology (KRUSTY) is prototype designed as a proof of concept for NASA’s Kilo power program, which was funded in order to create a small reactor for various space applications such as providing power for a colony on Mars or the moon and eventually as a possible option for powering rockets on deep space missions. Before the final prototype design was tested in March 2018, the component critical configuration, which had less external equipment than the prototype design, was created in November 2017. Both of these designs had less external equipment than the final version will have. This component critical con figuration was used to determine the worth of the beryllium oxide (BeO) reflector and of the boron carbide (B4C) control rod as well as creating necessary benchmark configurations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2018

2018 Water Splitting Technologies Benchmarking and Protocols Workshop

The HydroGEN EMN (Energy Materials Network) benchmarking team held a workshop for the advanced water splitting technologies on October 24-25 at Arizona State University, in Tempe, AZ. Several breakout sessions were held for each technology area, to gather information for developing material protocols and identifying critical parameters.

08 HYDROGEN↗