Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Assessment of Grizzly Capabilities for Reactor Pressure Vessels and Reinforced Concrete Structures

Over the last several years, capabilities to simulate the progression and effects of degradation in critical structures in light water reactor (LWR) nuclear power plants have been under development in the Grizzly code. Age-related material degradation is important for a number of systems in LWRs, but the main focus for Grizzly development has been on reactor pressure vessels (RPVs) and concrete structures because of their central role and the difficulty of replacement of these structures if they are found to be degraded to an unacceptable degree. The capabilities for analyzing both RPVs and concrete structures in Grizzly have reached a point where the feature sets are sufficiently complete to perform credible analyses of those types of structures. Because of this, the emphasis has shifted from foundational development to assessing the accuracy of these modeling capabilities on representative problems of interest and on improving the physical basis of those models to improve their ability to predict the actual response of those structural systems. This report documents a first set of test cases that have been developed to assess the Grizzly code on real-world problems for these two types of structures. For RPVs, these test cases consist of a set of benchmark problems where Grizzly is compared to another code. For concrete structures, a set of models of experimental specimens designed to characterize the multidimensional swelling response of reinforced concrete members due to alkali-silica reaction (ASR) has been developed and compared with experimental results. Both the RPV and concrete test cases developed here are much more computationally intensive than the small regression tests that are used in the testing that Grizzly undergoes every time a proposed set of changes is made to ensure that those changes do not adversely affect previously established behavior. A system for regularly running these large problems to monitor the behavior of the code as it is developed has been instituted. While these test cases generally indicate good comparison with the benchmark results, they also indicate areas where further development is warranted.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DYNA3D/ParaDyn Regression Test Suite Inventory

The following table constitutes an initial assessment of feature coverage across the regression test suite used for DYNA3D and ParaDyn. It documents the regression test suite at the time of production release 10.1 in September 2010. The columns of the table represent groupings of functionalities, e.g., material models. Each problem in the test suite is represented by a row in the table. All features exercised by the problem are denoted by a check mark in the corresponding column. The definition of ''feature'' has not been subdivided to its smallest unit of user input, e.g., algorithmic parameters specific to a particular type of contact surface. This represents a judgment to provide code developers and users a reasonable impression of feature coverage without expanding the width of the table by several multiples. All regression testing is run in parallel, typically with eight processors. Many are strictly regression tests acting as a check that the codes continue to produce adequately repeatable results as development unfolds, compilers change and platforms are replaced. A subset of the tests represents true verification problems that have been checked against analytical or other benchmark solutions. Users are welcomed to submit documented problems for inclusion in the test suite, especially if they are heavily exercising, and dependent upon, features that are currently underrepresented.

42 ENGINEERING↗

Development Plan for Acoustic Emission and Vibration Sensors

This document discusses the need for high temperature, radiation tolerant sensors for monitoring vibration and acoustic emissions in advanced reactors and irradiation experiments. Testing of several commercial sensors using infrastructure available at Idaho National Laboratory was performed to benchmark currently available sensors as well as the test facilities. Finally, a strategy for developing sensors for more extreme environments is presented.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Impact of Coating Defects on Performance of Coated Zirconium Cladding

Research on accident tolerant fuels (ATF) has started after the Fukushima accident [1–3]. While efforts have been expended on both fuel and cladding ATF concepts, the bulk of work has been devoted to improved cladding. The overarching goal of these approaches is to extend the coping time available during a severe accident before any event would result in release of radioactivity to the public. The most basic ATF cladding concept is obtained by applying a thin coating of highly corrosion-resistant material on the surface of a licensed zirconium cladding alloy. This thin coating is intended to not interfere with the neutronic or mechanical performance of the base cladding under normal operating conditions. Different coating materials, thicknesses, coating processes, process parameters, and testing methods have an impact on the microstructure and mechanical properties and therefore on the results of the applied investigation methods. These challenges have motivated an initial focus on demonstrating that the presence of coatings do not perturb the critical performance benchmarks of uncoated material. Ongoing lead test assembly irradiations of coated zirconium concepts in commercial reactions is intended to establish baseline performance in this regard in the coming years.

36 MATERIALS SCIENCE↗

Graph 500 on OpenSHMEM: Using a Practical Survey of Past Work to Motivate Novel Algorithmic Developments

Graph500 [14] is an effort to offer a standardized benchmark across large-scale distributed platforms which captures the behavior of common communicationbound graph algorithms. Graph500 differs from other large-scale benchmarking efforts (such as HPL [6] or HPGMG [7]) primarily in the irregularity of its computation and data access patterns. The core computational kernel of Graph500 is a breadth-first search (BFS) implemented on an undirected graph. The output of Graph500 is a spanning tree of the input graph, usually represented by a predecessor mapping for every node in the graph. The Graph500 benchmark defines several pre-defined input sizes for implementers to test against. This report summarizes investigation into implementing the Graph500 benchmark on OpenSHMEM, and focuses on first building a strong and practical understanding of the strengths and limitations of past work before proposing and developing novel extensions.

97 MATHEMATICS AND COMPUTING↗

SAS4A/SASSYS-1 Validation with the FFTF LOFWOS Tests #10-12

The FFTF liquid sodium cooled test reactor was built to assist the development and testing of advanced fuels and material for fast reactors. The goals of the FFTF Passive Safety Testing program included confirming the safety margins of FFTF as a liquid metal reactor, providing data for computer code validation, and demonstrating the inherent and passive safety benefits of its specific design features. The program included thirteen unprotected loss of flow without scram tests. The results of modeling and simulation of LOFWOS Tests #10, #11, and #12 are presented in this report to support validation of Argonne’s SAS4A/SASSYS-1 fast reactor safety analysis code. These three tests did not use the primary loop pony motors and thus transitioned to natural circulation flow rates from varying initial power levels. This validation activity leverages modeling and simulation efforts that originated under an International Atomic Energy Agency Coordinated Research Project (CRP) for benchmark analysis of the FFTF LOFWOS Test #13. The SAS4A/SASSYS-1 model originally developed for the CRP has been extended to include LOFWOS Tests #10-12 and modernized to utilize new code features and modeling practices. Predicted results from SAS4A/SASSYS-1 were compared to measured test data and differences were investigated. Overall, it was concluded that, for LOFWOS Tests #10-12, there was good agreement between the flow, power, and temperature predictions and the measured data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Evaluating Support for OpenMP Offload Features

The OpenMP language features have been evolving to meet the rapid development in hardware platforms. DOE applications tend to push the bleeding edge of features ratified in the OpenMP specification and tend to expose the rough edges of the features' implementations. The software harness on DOE supercomputers such as Titan and (upcoming) Summit include Cray, Clang, Flang, XL and GCC compilers. It is critical, especially for Summit, that the compilers support OpenMP offloading features. This paper focuses on evaluating support for OpenMP 4.5 target offload directives across compiler implementations on Titan and Summitdev, an early access system, which is one generation removed from Summit's architecture enabling application teams to test the systems' architecture. Our tests not only evaluate the OpenMP implementations but also expose ambiguities in the OpenMP 4.5 specification. We also evaluate compiler implementations using kernels extracted from production DOE applications. This helps in assessing the interaction of different OpenMP directives independent of other application artifacts. We are aware that the implementations are constantly evolving and are advertised as having only partial OpenMP 4.x support. We see this as a synergistic effort to help identify and correct features that are required by DOE applications and prevent deployment delays later on. Going forward, we also plan to interact with standard benchmarking bodies like SPEC/HPG to donate our tests and mini-apps/kernels for potential inclusion in the next release versions of SPEC OMP and SPEC ACCEL benchmark suites.

Monsalve Diaz, Jose↗

A scalable real-time framework for Thomson scattering analysis: Application to NSTX-U

A detailed description of a prototype setup for real-time (RT) Thomson scattering (TS) analysis is presented and implemented in the multi-point Thomson scattering (MPTS) diagnostic system at the National Spherical Torus Experiment Upgrade (NSTX-U). The data acquisition hardware was upgraded with RT capable electronics (RT-analog digital converters and a RT server) that allow for fast digitization of the laser pulse signal of eight radial MPTS channels. In addition, a new TS spectrum analysis software for a rapid calculation of electron temperature ( T e ) and electron density ( n e ) was developed. Testing of the RT hardware and data analysis software was successfully completed and benchmarked against the standard, post-shot evaluation. Timing tests were performed showing that the end-to-end processing time was reproducibly below 17 ms for the duration of at least 5 s, meeting a 60 Hz deadline by the laser pulse repetition rate over the length of a NSTX-U discharge. The presented RT framework is designed to be scalable in system size, i.e., incorporation of additional radial channels by solely adding additional RT capable hardware. In conclusion, it is scalable in its operation duration and was continuously running for up to 30 min, making it an attractive solution for machines with long discharges such as advanced, non-inductive tokamaks or stellarators.

47 OTHER INSTRUMENTATION↗

Making resonance a common case: a high-performance implementation of collective I/O on parallel file systems

Collective I/O is a widely used technique to improve I/O performance in parallel computing. It can be implemented as a client-based or server-based scheme. The client-based implementation is more widely adopted in MPI-IO software such as ROMIO because of its independence from the storage system configuration and its greater portability. However, existing implementations of client-side collective I/O do not take into account the actual pattern offile striping over multiple I/O nodes in the storage system. This can cause a significant number of requests for non-sequential data at I/O nodes, substantially degrading I/O performance. Investigating the surprisingly high I/O throughput achieved when there is an accidental match between a particular request pattern and the data striping pattern on the I/O nodes, we reveal the resonance phenomenon as the cause. Exploiting readily available information on data striping from the metadata server in popular file systems such as PVFS2 and Lustre, we design a new collective I/O implementation technique, resonant I/O, that makes resonance a common case. Resonant I/O rearranges requests from multiple MPI processes to transform non-sequential data accesses on I/O nodes into sequential accesses, significantly improving I/O performance without compromising the independence ofa client-based implementation. We have implemented our design in ROMIO. Our experimental results show that the scheme can increase I/O throughput for some commonly used parallel I/O benchmarks such as mpi-io-test and ior-mpi-io over the existing implementation of ROMIO by up to 157%, with no scenario demonstrating significantly decreased performance.

42 ENGINEERING↗

Bias Between ENDF/B-VIII and ENDF/B-VII.1 for LEU Pin Array Systems

Extensive testing of new cross section data is performed in SCALE prior to its release. The release of ENDF/B-VIII.0 requires the generation and testing of new data libraries which are planned to be included in the release of SCALE 6.3 in 2019 or 2020. KENO benchmark results have been published previously for beta and final releases of ENDF/B-VIII.0 using the entire Verified, Archived Library of Inputs and Data (VALID). This work presents an energy-dependent change in the results for low-enriched uranium (LEU) pin array systems. The process of identifying the difference is highlighted as a case study to determine how data testing and benchmarking can be performed to provide more detailed feedback to the data community on potential data deficiencies.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Concept Study of Robotic Camera-Based Foreign Object Detection for EV Wireless Charging

Wireless charging of an electric vehicle (EV) is an emerging charging technology promising convenient, autonomous, and highly efficient EV charging without requiring heavy gauge cables. However, due to the strong electromagnetic field created by this process that surrounds the wireless charger, the presence of foreign objects can detrimentally interact with it, thus affecting wireless power transfer (WPT) performance or leading to harmful and unwanted safety risks. This paper presents the results for a concept study on a robotic camera-based foreign object detection (FOD) system, as a supplement to the industry-existing overlapped FOD coil array method, for EV wireless charging. A Raspberry PI 4 control board and compatible Raspberry PI Camera Module 2 are used to implement camera-based object detection. The FOD program was developed using a state-of-the-art deep learning object detection model with the OpenCV and Pytorch library and is compatible with camera module hardware. A dry-run test with Raspberry PI and a camera module was conducted and the preliminary FOD function was verified. The feasibility assessment is also validated by comparing the performance of five existing state-of-the-art deep learning object detection models for vehicles, animals, persons, and metals subsets, respectively. Satisfactory performance on the benchmark datasets is observed by the tests, but further improvements are needed in future work when detecting small-sized metallic objects. A programable robotic car is also under development as ongoing work for carrying the Raspberry PI and camera module while moving for the maintenance process.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Basis set consistent revision of the S22 test set of noncovalent interaction energies

The S22 test set of interaction energies for small model complexes has been very valuable for benchmarking new and existing methods for noncovalent interactions. However, the basis sets utilized to compute the CCSD(T) interaction energies for some of the dimers are insufficient to obtain converged results. Here we consistently extrapolate all CCSD(T)/complete basis set (CBS) interaction energies using larger basis sets for the CCSD(T) component of the computation. The revised values, which we designate S22A, represent the most accurate results to date for this set of dimers. The new values appear to be within a few hundredths of 1 kcal mol –1 of the true CCSD(T)/CBS limit at the given geometries, but the former S22 values are off by as much as 0.6 kcal mol –1 compared to the revised values. Because some of the most promising methods for noncovalent interactions are already achieving this level of agreement (or better) compared to the S22 data, more accurate benchmark values would clearly be helpful. The MP2, SCS-MP2, SCS-CCSD, SCS(MI)-MP2, and B2PLYP-D methods have been tested against the more accurate benchmark set. The B2PLYP-D method outperforms all other methods tested here, with a mean average deviation of only 0.12 kcal mol –1 . Furthermore, the consistent, slight underestimation of the interaction energies computed by the SCS-CCSD method (an overall mean absolute deviation and mean deviation of 0.24 and –0.23 kcal mol –1 , respectively) suggests that the SCS-CCSD method has the potential to become even more accurate with a reoptimization of its parameters for noncovalent interactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Validating Intra-Plate Power Distributions in the Advanced Test Reactor

We report that the neutronics software, HELIOS, was validated in 2015 for performing core reload design and safety analysis of the Advanced Test Reactor. However, when HELIOS was benchmarked against historic fission-wire measurements (i.e., zero-power full-core measurements) a statistically resolved calculation-to-measurement bias was discovered. The azimuthal power along each fuel plate computed by HELIOS has consistently shown to under-predict measurements made by fission-wires in historic zero-power tests near the fuel element side-plates. It was hypothesized during the HELIOS software validation work, that this bias is attributable to local moderation in coolant vents in the side-plates axially just above and below the fission-wires on the fuel-plate edges. This work used detailed MCNP and MC21 models of the side-plate vents to test this hypothesis. By comparing the average azimuthal biases between HELIOS, and 2D and 3D MCNP models, and a 3D MC21 model, it was found that the HELIOS azimuthal bias is not due to the measurement.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Modeling of transport phenomena in tokamak plasmas with neural networks

A new transport model that uses neural networks (NNs) to yield electron and ion heat ux pro les has been developed. Given a set of local dimensionless plasma parameters similar to the ones that the highest delity models use, the NN model is able to efficiently and accurately predict the ion and electron heat transport pro les. As a benchmark, a NN was built, trained, and tested on data from the 2012 and 2013 DIII-D experimental campaigns. It is found that NN can capture the experimental behavior over the majority of the plasma radius and across a broad range of plasma regimes. Although each radial location is calculated independently from the others, the heat ux pro les are smooth, suggesting that the solution found by the NN is a smooth function of the local input parameters. This result supports the evidence of a well-de ned, non-stochastic relationship between the input parameters and the experimentally measured transport uxes. Finally, the numerical efficiency of this method, requiring only a few CPU-μs per data point, makes it ideal for scenario development simulations and real-time plasma control.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Performance of three-dimensional printed nasopharyngeal swabs for COVID-19 testing

At the start of the COVID-19 pandemic, the US faced nationwide shortages of nasopharyngeal swabs due to both overwhelmed supply chains and an increase in demand. To address this shortfall, multiple 3D printed swabs were ultimately produced and sold for COVID-19 testing. In this work, we present a framework for mechanical and functional bench-testing of nasopharyngeal swabs using standard and widely available material testing equipment. Using this framework, we offer a comprehensive, quantitative comparison of the 3D printed swabs to benchmark their performance against traditional flocked swabs. The test protocols were designed to emulate the clinical use of the nasopharyngeal swabs and to evaluate potential failure modes. Overall, the 3D printed swabs performed comparably to, or outperformed, the traditional swabs in all mechanical tests. While traditional swabs outperformed some of the new 3D printed swabs in terms of sample uptake and retention, similar amounts of RNA were recovered from both 3D printed and traditional swabs.

3D printing↗

Benchmark On Sensitivity Calculation (Phase III)

The sensitivities of the keff eigenvalue to neutron cross sections have become commonly used in similarity studies and as part of the validation algorithm for criticality safety assessments. To test calculations of the sensitivity coefficients, a benchmark study (Phase III) has been established by the OECD-NEA/WPNCS/EG UACSA (Expert Group on Uncertainty Analysis for Criticality Safety Assessment). This paper presents some sensitivity results generated by the benchmark participants using various computational tools based upon different computational methods: SCALE/TSUNAMI-3D and -1D, MONK, APOLLO2-MORET 5, DRAGON-SUSD3D and MMKKENO. The study demonstrates the performance of the tools. It also illustrates how model simplifications impact the sensitivity results and demonstrates the importance of 'implicit' (self-shielding) sensitivities. This work has been a useful step towards verification of the existing and developed sensitivity analysis methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Scaled Testing to Evaluate Pulse Jet Mixer Performance in Waste Treatment Plant Mixing Vessels

The Waste Treatment and Immobilization Plant (WTP) at Hanford is being designed and built to pre-treat and vitrify the waste in Hanford’s 177 underground waste storage tanks. Numerous process vessels will hold waste at various stages in the WTP. These vessels have pulse jet mixer (PJM) systems. A test program was developed to evaluate the adequacy of mixing system designs in the solids-containing vessels in the WTP. The program focused mainly on non-cohesive solids behavior. Specifically, the program addressed the effectiveness of the mixing systems to suspend settled solids off the vessel bottom, and distribute the solids vertically. Experiments were conducted at three scales using various particulate simulants. A range of solids loadings and operational parameters were evaluated, including jet velocity, pulse volume, and duty cycle. In place of actual PJMs, the tests used direct injection from tubes with suction at the top of the tank fluid. This gave better control over the discharge duration and duty cycle and simplified the facility requirements. The mixing system configurations represented in testing varied from 4 to 12 PJMs with various jet nozzle sizes. In this way the results collected could be applied to the broad range of WTP vessels with varying geometrical configurations and planned operating conditions. Data for “just-suspended velocity”, solids cloud height, and solids concentration vertical profile were collected, analyzed, and correlated. The correlations were successfully benchmarked against previous large-scale test results, then applied to the WTP vessels using reasonable assumptions of anticipated waste properties to evaluate adequacy of the existing mixing system designs.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗