Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Experimental aerothermodynamic research of hypersonic aircraft

Wind tunnel tests were conducted to establish a benchmark experimental data base for a genetic hypersonic aircraft vehicle. Comprehensive measurements were made at Mach 7 to give flow visualization, surface pressure, surface convective heat transfer, and flow field Pitot pressure for a delta platform all-body vehicle. The tests were conducted in the NASA/Ames 3.5-Foot Hypersonic Wind Tunnel at Reynolds numbers sufficient to give turbulent flow. Comparisons are made of the experimental results with computational solutions of the flow by an upwind parabolized Navier-Stokes code developed at Ames. Good agreement of experiment with solutions by the code is demonstrated.

Cleary, Joseph W.↗
DOE OSTI2016

Graph 500 on OpenSHMEM: Using a Practical Survey of Past Work to Motivate Novel Algorithmic Developments

Graph500 [14] is an effort to offer a standardized benchmark across large-scale distributed platforms which captures the behavior of common communicationbound graph algorithms. Graph500 differs from other large-scale benchmarking efforts (such as HPL [6] or HPGMG [7]) primarily in the irregularity of its computation and data access patterns. The core computational kernel of Graph500 is a breadth-first search (BFS) implemented on an undirected graph. The output of Graph500 is a spanning tree of the input graph, usually represented by a predecessor mapping for every node in the graph. The Graph500 benchmark defines several pre-defined input sizes for implementers to test against. This report summarizes investigation into implementing the Graph500 benchmark on OpenSHMEM, and focuses on first building a strong and practical understanding of the strengths and limitations of past work before proposing and developing novel extensions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

SAS4A/SASSYS-1 Validation with the FFTF LOFWOS Tests #10-12

The FFTF liquid sodium cooled test reactor was built to assist the development and testing of advanced fuels and material for fast reactors. The goals of the FFTF Passive Safety Testing program included confirming the safety margins of FFTF as a liquid metal reactor, providing data for computer code validation, and demonstrating the inherent and passive safety benefits of its specific design features. The program included thirteen unprotected loss of flow without scram tests. The results of modeling and simulation of LOFWOS Tests #10, #11, and #12 are presented in this report to support validation of Argonne’s SAS4A/SASSYS-1 fast reactor safety analysis code. These three tests did not use the primary loop pony motors and thus transitioned to natural circulation flow rates from varying initial power levels. This validation activity leverages modeling and simulation efforts that originated under an International Atomic Energy Agency Coordinated Research Project (CRP) for benchmark analysis of the FFTF LOFWOS Test #13. The SAS4A/SASSYS-1 model originally developed for the CRP has been extended to include LOFWOS Tests #10-12 and modernized to utilize new code features and modeling practices. Predicted results from SAS4A/SASSYS-1 were compared to measured test data and differences were investigated. Overall, it was concluded that, for LOFWOS Tests #10-12, there was good agreement between the flow, power, and temperature predictions and the measured data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2018

Evaluating Support for OpenMP Offload Features

The OpenMP language features have been evolving to meet the rapid development in hardware platforms. DOE applications tend to push the bleeding edge of features ratified in the OpenMP specification and tend to expose the rough edges of the features' implementations. The software harness on DOE supercomputers such as Titan and (upcoming) Summit include Cray, Clang, Flang, XL and GCC compilers. It is critical, especially for Summit, that the compilers support OpenMP offloading features. This paper focuses on evaluating support for OpenMP 4.5 target offload directives across compiler implementations on Titan and Summitdev, an early access system, which is one generation removed from Summit's architecture enabling application teams to test the systems' architecture. Our tests not only evaluate the OpenMP implementations but also expose ambiguities in the OpenMP 4.5 specification. We also evaluate compiler implementations using kernels extracted from production DOE applications. This helps in assessing the interaction of different OpenMP directives independent of other application artifacts. We are aware that the implementations are constantly evolving and are advertised as having only partial OpenMP 4.x support. We see this as a synergistic effort to help identify and correct features that are required by DOE applications and prevent deployment delays later on. Going forward, we also plan to interact with standard benchmarking bodies like SPEC/HPG to donate our tests and mini-apps/kernels for potential inclusion in the next release versions of SPEC OMP and SPEC ACCEL benchmark suites.

Monsalve Diaz, Jose↗
DOE OSTI2019

A scalable real-time framework for Thomson scattering analysis: Application to NSTX-U

A detailed description of a prototype setup for real-time (RT) Thomson scattering (TS) analysis is presented and implemented in the multi-point Thomson scattering (MPTS) diagnostic system at the National Spherical Torus Experiment Upgrade (NSTX-U). The data acquisition hardware was upgraded with RT capable electronics (RT-analog digital converters and a RT server) that allow for fast digitization of the laser pulse signal of eight radial MPTS channels. In addition, a new TS spectrum analysis software for a rapid calculation of electron temperature ( T e ) and electron density ( n e ) was developed. Testing of the RT hardware and data analysis software was successfully completed and benchmarked against the standard, post-shot evaluation. Timing tests were performed showing that the end-to-end processing time was reproducibly below 17 ms for the duration of at least 5 s, meeting a 60 Hz deadline by the laser pulse repetition rate over the length of a NSTX-U discharge. The presented RT framework is designed to be scalable in system size, i.e., incorporation of additional radial channels by solely adding additional RT capable hardware. In conclusion, it is scalable in its operation duration and was continuously running for up to 30 min, making it an attractive solution for machines with long discharges such as advanced, non-inductive tokamaks or stellarators.

47 OTHER INSTRUMENTATION↗
DOE OSTI2019

Bias Between ENDF/B-VIII and ENDF/B-VII.1 for LEU Pin Array Systems

Extensive testing of new cross section data is performed in SCALE prior to its release. The release of ENDF/B-VIII.0 requires the generation and testing of new data libraries which are planned to be included in the release of SCALE 6.3 in 2019 or 2020. KENO benchmark results have been published previously for beta and final releases of ENDF/B-VIII.0 using the entire Verified, Archived Library of Inputs and Data (VALID). This work presents an energy-dependent change in the results for low-enriched uranium (LEU) pin array systems. The process of identifying the difference is highlighted as a case study to determine how data testing and benchmarking can be performed to provide more detailed feedback to the data community on potential data deficiencies.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Concept Study of Robotic Camera-Based Foreign Object Detection for EV Wireless Charging

Wireless charging of an electric vehicle (EV) is an emerging charging technology promising convenient, autonomous, and highly efficient EV charging without requiring heavy gauge cables. However, due to the strong electromagnetic field created by this process that surrounds the wireless charger, the presence of foreign objects can detrimentally interact with it, thus affecting wireless power transfer (WPT) performance or leading to harmful and unwanted safety risks. This paper presents the results for a concept study on a robotic camera-based foreign object detection (FOD) system, as a supplement to the industry-existing overlapped FOD coil array method, for EV wireless charging. A Raspberry PI 4 control board and compatible Raspberry PI Camera Module 2 are used to implement camera-based object detection. The FOD program was developed using a state-of-the-art deep learning object detection model with the OpenCV and Pytorch library and is compatible with camera module hardware. A dry-run test with Raspberry PI and a camera module was conducted and the preliminary FOD function was verified. The feasibility assessment is also validated by comparing the performance of five existing state-of-the-art deep learning object detection models for vehicles, animals, persons, and metals subsets, respectively. Satisfactory performance on the benchmark datasets is observed by the tests, but further improvements are needed in future work when detecting small-sized metallic objects. A programable robotic car is also under development as ongoing work for carrying the Raspberry PI and camera module while moving for the maintenance process.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2010

Basis set consistent revision of the S22 test set of noncovalent interaction energies

The S22 test set of interaction energies for small model complexes has been very valuable for benchmarking new and existing methods for noncovalent interactions. However, the basis sets utilized to compute the CCSD(T) interaction energies for some of the dimers are insufficient to obtain converged results. Here we consistently extrapolate all CCSD(T)/complete basis set (CBS) interaction energies using larger basis sets for the CCSD(T) component of the computation. The revised values, which we designate S22A, represent the most accurate results to date for this set of dimers. The new values appear to be within a few hundredths of 1 kcal mol –1 of the true CCSD(T)/CBS limit at the given geometries, but the former S22 values are off by as much as 0.6 kcal mol –1 compared to the revised values. Because some of the most promising methods for noncovalent interactions are already achieving this level of agreement (or better) compared to the S22 data, more accurate benchmark values would clearly be helpful. The MP2, SCS-MP2, SCS-CCSD, SCS(MI)-MP2, and B2PLYP-D methods have been tested against the more accurate benchmark set. The B2PLYP-D method outperforms all other methods tested here, with a mean average deviation of only 0.12 kcal mol –1 . Furthermore, the consistent, slight underestimation of the interaction energies computed by the SCS-CCSD method (an overall mean absolute deviation and mean deviation of 0.24 and –0.23 kcal mol –1 , respectively) suggests that the SCS-CCSD method has the potential to become even more accurate with a reoptimization of its parameters for noncovalent interactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Validating Intra-Plate Power Distributions in the Advanced Test Reactor

We report that the neutronics software, HELIOS, was validated in 2015 for performing core reload design and safety analysis of the Advanced Test Reactor. However, when HELIOS was benchmarked against historic fission-wire measurements (i.e., zero-power full-core measurements) a statistically resolved calculation-to-measurement bias was discovered. The azimuthal power along each fuel plate computed by HELIOS has consistently shown to under-predict measurements made by fission-wires in historic zero-power tests near the fuel element side-plates. It was hypothesized during the HELIOS software validation work, that this bias is attributable to local moderation in coolant vents in the side-plates axially just above and below the fission-wires on the fuel-plate edges. This work used detailed MCNP and MC21 models of the side-plate vents to test this hypothesis. By comparing the average azimuthal biases between HELIOS, and 2D and 3D MCNP models, and a 3D MC21 model, it was found that the HELIOS azimuthal bias is not due to the measurement.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS2000

Generation and Radiation of Acoustic Waves from a 2-D Shear Layer

A parallel numerical simulation of the radiation of sound from an acoustic source inside a 2-D jet is presented in this paper. This basic benchmark problem is used as a test case for scattering problems that are presently being solved by using the Impedance Mismatch Method (IMM). In this technique, a solid body in the domain is represented by setting the acoustic impedance of each medium, encountered by a wave, to a different value. This impedance discrepancy results in reflected and scattered waves with appropriate amplitudes. The great advantage of the use of this method is that no modifications to a simple Cartesian grid need to be made for complicated geometry bodies. Thus, high order finite difference schemes may be applied simply to all parts of the domain. In the IMM, the total perturbation field is split into incident and scattered fields. The incident pressure is assumed to be known and the equivalent sources for the scattered field are associated with the presence of the scattering body (through the impedance mismatch) and the propagation of the incident field through a non-uniform flow. An earlier version of the technique could only handle uniform flow in the vicinity of the source and at the outflow boundary. Scattering problems in non-uniform mean flow are of great practical importance (for example, scattering from a high lift device in a non-uniform mean flow or the effects of a fuselage boundary layer). The solution to this benchmark problem, which has an acoustic wave propagating through a non-uniform mean flow, serves as a test case for the extensions of the IMM technique.

Agarwal, Anurag↗
DOE OSTI2014

Modeling of transport phenomena in tokamak plasmas with neural networks

A new transport model that uses neural networks (NNs) to yield electron and ion heat ux pro les has been developed. Given a set of local dimensionless plasma parameters similar to the ones that the highest delity models use, the NN model is able to efficiently and accurately predict the ion and electron heat transport pro les. As a benchmark, a NN was built, trained, and tested on data from the 2012 and 2013 DIII-D experimental campaigns. It is found that NN can capture the experimental behavior over the majority of the plasma radius and across a broad range of plasma regimes. Although each radial location is calculated independently from the others, the heat ux pro les are smooth, suggesting that the solution found by the NN is a smooth function of the local input parameters. This result supports the evidence of a well-de ned, non-stochastic relationship between the input parameters and the experimentally measured transport uxes. Finally, the numerical efficiency of this method, requiring only a few CPU-μs per data point, makes it ideal for scenario development simulations and real-time plasma control.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Performance of three-dimensional printed nasopharyngeal swabs for COVID-19 testing

At the start of the COVID-19 pandemic, the US faced nationwide shortages of nasopharyngeal swabs due to both overwhelmed supply chains and an increase in demand. To address this shortfall, multiple 3D printed swabs were ultimately produced and sold for COVID-19 testing. In this work, we present a framework for mechanical and functional bench-testing of nasopharyngeal swabs using standard and widely available material testing equipment. Using this framework, we offer a comprehensive, quantitative comparison of the 3D printed swabs to benchmark their performance against traditional flocked swabs. The test protocols were designed to emulate the clinical use of the nasopharyngeal swabs and to evaluate potential failure modes. Overall, the 3D printed swabs performed comparably to, or outperformed, the traditional swabs in all mechanical tests. While traditional swabs outperformed some of the new 3D printed swabs in terms of sample uptake and retention, similar amounts of RNA were recovered from both 3D printed and traditional swabs.

3D printing↗
DOE OSTI2012

Benchmark On Sensitivity Calculation (Phase III)

The sensitivities of the keff eigenvalue to neutron cross sections have become commonly used in similarity studies and as part of the validation algorithm for criticality safety assessments. To test calculations of the sensitivity coefficients, a benchmark study (Phase III) has been established by the OECD-NEA/WPNCS/EG UACSA (Expert Group on Uncertainty Analysis for Criticality Safety Assessment). This paper presents some sensitivity results generated by the benchmark participants using various computational tools based upon different computational methods: SCALE/TSUNAMI-3D and -1D, MONK, APOLLO2-MORET 5, DRAGON-SUSD3D and MMKKENO. The study demonstrates the performance of the tools. It also illustrates how model simplifications impact the sensitivity results and demonstrates the importance of 'implicit' (self-shielding) sensitivities. This work has been a useful step towards verification of the existing and developed sensitivity analysis methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2015

A Software Developer’s Guide to Informal Evaluation of Visual Analytics Environments Using VAST Challenge Information

The VAST Challenge has been a popular venue for academic and industry participants for over ten years. Many participants comment that the majority of their time in preparing VAST Challenge entries is discovering elements in their software environments that need to be redesigned in order to solve the given task. Fortunately, there is no need to wait until the VAST Challenge is announced to test out software systems. The Visual Analytics Benchmark Repository contains all past VAST Challenge tasks, data, solutions and submissions. This paper details the various types of evaluations that may be conducted using the Repository information. In this paper we describe how developers can do informal evaluations of various aspects of their visual analytics environments using VAST Challenge information. Aspects that can be evaluated include the appropriateness of the software for various tasks, the various data types and formats that can be accommodated, the effectiveness and efficiency of the process supported by the software, and the intuitiveness of the visualizations and interactions. Researchers can compare their visualizations and interactions to those submitted to determine novelty. In addition, the paper provides pointers to various guidelines that software teams can use to evaluate the usability of their software. While these evaluations are not a replacement for formal evaluation methods, this information can be extremely useful during the development of visual analytics environments.

evaluation↗
DOE OSTI2023

Verifying MCNP Models of the TEX High 240 Plutonium Benchmark

Computational modeling programs are invaluable tools that allow us to understand systems, safely develop new processes, and make reliable predictions about future designs. However, the effectiveness of these codes is limited by the degree to which their parameters match the real world. In the field of nuclear engineering, cross section data is one of these vital parameters. Accurate cross section data on important fissile and fissionable isotopes promotes the design of safer and more efficient fabrication, transportation, storage, and stockpiling of nuclear fuel. Unfortunately, there are knowledge gaps in data on key isotopes. In 2011, a multinational meeting hosted by the US Department of Energy Nuclear Criticality Safety Program ranked the priority of certain cross section data needs. In response, Lawrence Livermore National Lab (LLNL) designed the Thermal and Epithermal eXperiment (TEX) series of benchmark experiments. Benchmark experiments are used to validate current cross section data. They validate data by comparing the results of an actual experiment to the predicted results from a computational model. The data a benchmark applies to depends on the isotope and energy range the experiment’s neutron multiplication factor ( k eff ) is most sensitive to. The development and testing of the TEX High 240 Plutonium Benchmark will help validate 240 Pu cross section data. The configuration and materials of this benchmark are designed to be most sensitive to 240 Pu's intermediate energy range (from 0.625 ev to 100 keV ). MCNP® models of the assembly have been developed by LLNL and the results have been written in the final design report. In order for the discrepancies between benchmark models and experiments to be attributed to cross section inaccuracies, the accuracy of the models needs to be verified. The goal of this project is to verify of the results of LLNL's modeling by creating a new set of MCNP models and comparing the results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Benchmark Analysis

Tremendous progress has been achieved in the development of land models and their inclusion in Earth system models (ESMs). However, we still have very limited knowledge on the performance skills of these land models. This chapter introduces benchmark analysis, which is a procedure to measure performance of models against a set of defined standards. The benchmark analysis includes: (1) defining targeted aspects of model performance to be evaluated; (2) testing model performance in comparison with a set of benchmarks; (3) measuring model performance skill through quantitative metrics; and (4) evaluating model performance and offering suggestions for future model improvement.

Luo, Yiqi↗
DOE OSTI2016

VASIMR{sup R} Interfaced High Temperature Gas-Cooled Fast Reactor for Space Applications

This project was undertaken to assess the feasibility and advantages of utilizing a gas-cooled fast reactor to supply power to an electric propulsion system for deep space exploration to Europa, one of Jupiter's moons. Specifically, the primary objective of this project was to design a 9 MWe gas cooled fast reactor with an accompanying power conversion system to supply electricity to multiple electrically-powered thrusters for a four year mission duration. The thruster design chosen for this analysis is the Variable Specific Impulse Magnetoplasma Rocket (VASIMR). The VASIMR propulsion system, currently being developed by Ad Astra Rocket Company (AARC), is an electric propulsion rocket that uses electric power to accelerate neutral plasma propellant. Advanced electric space propulsion systems such as the VASIMR offer unique capabilities that allow for higher exhaust velocities that are up to ten times that of traditional chemical rockets. Furthermore, the thrust and specific impulse of the VASIMR system can be varied in order to achieve optimal travel times to given destinations for a desired payload. As a result, electric propulsion systems characteristically have lower ratios of system mass to power output than chemical rockets. This ratio is commonly known as the alpha parameter. Alpha parameters of approximately 10 kg/kWe or less make electric propulsion more attractive for deep space exploration missions in terms of resource efficiency and cost. However, the primary challenge with electric propulsion is to develop a high power density source of electricity in order to minimize the total system mass. The alpha parameter is the main benchmark used in this project to test whether or not the proposed coupled gas cooled reactor and power conversion system design is more competitive than other proposed systems. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2013

Simulation of Enhanced Geothermal Systems: A Benchmarking and Code Intercomparison Study

Numerical simulation codes have become critical tools for understanding complex geologic processes, as applied to technology assessment, system design, monitoring, and operational guidance. Recently the need for quantitatively evaluating coupled Thermodynamic, Hydrologic, geoMechanical, and geoChemical (THMC) processes has grown, driven by new applications such as geologic sequestration of greenhouse gases and development of unconventional energy sources. Here we focus on Enhanced Geothermal Systems (EGS), which are man-made geothermal reservoirs created where hot rock exists but there is insufficient natural permeability and/or pore fluids to allow efficient energy extraction. In an EGS, carefully controlled subsurface fluid injection is performed to enhance the permeability of pre-existing fractures, which facilitates fluid circulation and heat transport. EGS technologies are relatively new, and pose significant simulation challenges. To become a trusted analytical tool for EGS, numerical simulation codes must be tested to demonstrate that they adequately represent the coupled THMC processes of concern. This presentation describes the approach and status of a benchmarking and code intercomparison effort currently underway, supported by the U. S. Department of Energy’s Geothermal Technologies Program. This study is being closely coordinated with a parallel international effort sponsored by the International Partnership for Geothermal Technology (IPGT). We have defined an extensive suite of benchmark problems, test cases, and challenge problems, ranging in complexity and difficulty, and a number of modeling teams are applying various simulation tools to these problems. The descriptions of the problems and modeling results are being compiled using the Velo framework, a scientific workflow and data management environment accessible through a simple web-based interface.

benchmark↗