Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Performance modeling & simulation of complex systems (A systems engineering design & analysis approach)

Modeling of the Multi-mission Image Processing System (MIPS) will be described as an example of the use of a modeling tool to design a distributed system that supports multiple application scenarios. This paper examines: (a) modeling tool selection, capabilities, and operation (namely NETWORK 2.5 by CACl), (b) pointers for building or constructing a model and how the MIPS model was developed, (c) the importance of benchmarking or testing the performance of equipment/subsystems being considered for incorporation the design/architecture, (d) the essential step of model validation and/or calibration using the benchmark results, (e) sample simulation results from the MIPS model, and (f) how modeling and simulation analysis affected the MIPS design process by having a supportive and informative impact.

Hall, Laverne↗

DeepBench: A simulation package for physical benchmarking data

We introduce **DeepBench**, a python library that generates simple simulated image data from first principles, such as basic geometric shapes and astronomical objects. These data are highly valuable for developing (calibration, testing, and benchmarking) statistical and machine learning models because they make it possible to connect the final data product to physically interpretable inputs. This software includes tools to curate and store the datasets to maximize reproducibility.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Well-balanced Component-wise Scheme for Shallow Water System

This paper presents a well-balanced numerical scheme for solving free surface flows involving wetting and drying. The proposed algorithm combines a component-wise approach with hydrostatic reconstruction strategy to compute flows over wet or dry surfaces and to satisfy the steady state condition of still water. The robustness of the proposed scheme is verified under several benchmark hydraulic tests.

42 ENGINEERING↗

LCIO

Performance of file systems shift during their life cycles. Evaluating this performance change over time is not trivial. Complexity arises in the interplay between external (i.e. application I/O workloads) and internal (i.e. the filesystem state) factors. Many benchmarks can test how a filesystem performs at the current snapshot state, but to observe the change over time necessitates that the filesystem state mutate (age) between benchmark runs. For a large-scale HPC parallel filesystem, the sheer scale and amount of interacting components during I/O operations magnify these challenges. LCIO addresses the question - how will the filesystem perform at different stages of its life cycle? LCIO is a synthetic benchmark, which provides the file system aging process to increase the amount of information that existing benchmarks like IOR and MDTest yield, as well as provide additional points of data that will be useful to system architects and engineers.

Bachstein, Matthew↗

Thermal scattering law of C 2 H 4 n : Integrating experimental data with DFT calculations

Improvements in determination of the thermal scattering law of moderator materials (measuring, calculating and validating) are important for accurate prediction of neutron thermalization in nuclear systems. In this paper a methodology for producing thermal scattering libraries from the experimental data for polyethylene C 2 H 4 n is discussed. Double differential scattering cross section (DDSCS) experiments were performed at the Spallation Neutron Source of Oak Ridge National Laboratory (SNS ORNL). New scattering kernel evaluations, based on phonon spectrum for C 2 H 4 n , are created using the NJOY2016 code. Two different methods were used: direct and indirect geometry neutron scattering at ARCS and SEQUOIA, and VISION instruments, respectively, where the phonon spectrum was derived from the dynamical structure factor S(Q, ω ) obtained from the measured DDSCS. In order to compare and validate the newly created library, the experimental setup was simulated using MCNP6.1. Compared with the current ENDF/B-VII.1, the resulting RPI C 2 H 4 n libraries improved both double differential scattering and total scattering cross sections. A set of criticality benchmarks containing C 2 H 4 n from HEU-MET-THERM resulted in an overall improved calculation of K eff , although the libraries should be tested against benchmarks more sensitive to C 2 H 4 n . The DFT + oClimax method is used and is shown to be most comprehensive method for analysis of moderator materials. Finally, the importance of DFT + oClimax method lies in the fact that it can be validated against all data measured at VISION, ARCS and SEQUOIA, and experimental total scattering cross section measurements.

74 ATOMIC AND MOLECULAR PHYSICS↗

QA/QC-ed Groundwater Level Time Series in PLM-1 and PLM-6 Monitoring Wells, East River, Colorado (2016-2022)

This data set contains QA/QC-ed (Quality Assurance and Quality Control) water level data for the PLM1 and PLM6 wells. PLM1 and PLM6 are location identifiers used by the Watershed Function SFA project for two groundwater monitoring wells along an elevation gradient located along the lower montane life zone of a hillslope near the Pumphouse location at the East River Watershed, Colorado, USA. These wells are used to monitor subsurface water and carbon inventories and fluxes, and to determine the seasonally dependent flow of groundwater under the PLM hillslope. The downslope flow of groundwater in combination with data on groundwater chemistry (see related references) can be used to estimate rates of solute export from the hillslope to the floodplain and river. QA/QC analysis of measured groundwater levels in monitoring wells PLM-1 and PLM-6 included identification and flagging of duplicated values of timestamps, gap filling of missing timestamps and water levels, removal of abnormal/bad and outliers of measured water levels. The QA/QC analysis also tested the application of different QA/QC methods and the development of regular (5-minute, 1-hour, and 1-day) time series datasets, which can serve as a benchmark for testing other QA/QC techniques, and will be applicable for ecohydrological modeling. The package includes a Readme file, one R code file used to perform QA/QC, a series of 8 data csv files (six QA/QC-ed regular time series datasets of varying intervals (5-min, 1-hr, 1-day) and two files with QA/QC flagging of original data), and three files for the reporting format adoption of this dataset (InstallationMethods, file level metadata (flmd), and data dictionary (dd) files).QA/QC-ed data herein were derived from the original/raw data publication available at Williams et al., 2020 (DOI: 10.15485/1818367). For more information about running R code file (10.15485_1866836_QAQC_PLM1_PLM6.R) to reproduce QA/QC output files, see README (QAQC_PLM_readme.docx). This dataset replaces the previously published raw data time series, and is the final groundwater data product for the PLM wells in the East River. Complete metadata information on the PLM1 and PLM6 wells are available in a related dataset on ESS-DIVE: Varadharajan C, et al (2022). https://doi.org/10.15485/1660962. These data products are part of the Watershed Function Scientific Focus Area collection effort to further scientific understanding of biogeochemical dynamics from genome to watershed scales. 2022/09/09 Update: Converted data files using ESS-DIVE’s Hydrological Monitoring Reporting Format. With the adoption of this reporting format, the addition of three new files (v1_20220909_flmd.csv, V1_20220909_dd.csv, and InstallationMethods.csv) were added. The file-level metadata file (v1_20220909_flmd.csv) contains information specific to the files contained within the dataset. The data dictionary file (v1_20220909_dd.csv) contains definitions of column headers and other terms across the dataset. The installation methods file (InstallationMethods.csv) contains a description of methods associated with installation and deployment at PLM1 and PLM6 wells. Additionally, eight data files were re-formatted to follow the reporting format guidance (er_plm1_waterlevel_2016-2020.csv, er_plm1_waterlevel_1-hour_2016-2020.csv, er_plm1_waterlevel_daily_2016-2020.csv, QA_PLM1_Flagging.csv, er_plm6_waterlevel_2016-2020.csv, er_plm6_waterlevel_1-hour_2016-2020.csv, er_plm6_waterlevel_daily_2016-2020.csv, QA_PLM6_Flagging.csv). The major changes to the data files include the addition of header_rows above the data containing metadata about the particular well, units, and sensor description. 2023/01/18 Update: Dataset updated to include additional QA/QC-ed water level data up until 2022-10-12 for ER-PLM1 and 2022-10-13 for ER-PLM6. Reporting format specific files (v2_20230118_flmd.csv, v2_20230118_dd.csv, v2_20230118_InstallationMethods.csv) were updated to reflect the additional data. R code file (QAQC_PLM1_PLM6.R) was added to replace the previously uploaded HTML files to enable execution of the associated code. R code file (QAQC_PLM1_PLM6.R) and ReadMe file (QAQC_PLM_readme.docx) were revised to clarify where original data was retrieved from and to remove local file paths.

54 ENVIRONMENTAL SCIENCES↗

Graph Generator Survey

The benchmarking effort within the Extreme Scale Systems Center at Oak Ridge National Laboratory seeks to provide High Performance Computing benchmarks and test suites of interest to the DoD sponsor. The work described in this report is a part of the effort focusing on graph generation. A previously developed benchmark, SystemBurn, allowed the emulation of different application behavior profiles within a single framework. To complement this effort, similar capabilities are desired for graph-centric problems. This report examines existing synthetic graph generator implementations in preparation for further study on the properties of their generated synthetic graphs.

analytics↗

Synthetic Graph Generation for Data-Intensive HPC Benchmarking: Scalability, Analysis and Real-World Application

The benchmarking effort within the Extreme Scale Systems Center at Oak Ridge National Laboratory seeks to provide High Performance Computing benchmarks and test suites of interest to the DoD sponsor. The work described in this report is a part of the effort focusing on graph generation. A previously developed benchmark, SystemBurn, allows the emulation of a broad spectrum of application behavior profiles within a single framework. To complement this effort, similar capabilities are desired for graph-centric problems. This report described the in-depth analysis of the generated synthetic graphs' properties at a variety of scales using different generator implementations and examines their applicability to replicating real world datasets.

97 MATHEMATICS AND COMPUTING↗

Performance of an RPM based on Gd-lined plastic scintillator for neutron and gamma detection [ANIMMA--2015-IO-372]

A Radiation Portal Monitor (RPM) was developed by the Istituto Nazionale di Fisica Nucleare (INFN) and Ansaldo Nucleare (ANN) within the FP7 SCINTILLA European project. The system was designed to detect both gamma and neutron radiation with a single technology. It is conceived to monitor vehicle and cargo containers in transits across borders or ports, to find radioactive elements and to avoid illegal trafficking of strategic nuclear materials. The system is based on a {sup 3}He-free neutron detection technology using plastic scintillators coupled to Gadolinium to detect and discriminate gamma from neutron signals. During the 3 years of the SCINTILLA project the construction and test of the first two prototypes drove the definition of the final layout of a full RPM system consisting of two twin pillars as a portal for vehicle and cargo container scan. A custom System Control Software (SCS) manages the electronics of the RPM, the ancillary devices and the data analysis. The combination of the detector layout and of the software functionalities enables both to distinguish neutrons and gammas and to identify the energy range of a detected gamma source. The system was initially characterized via static tests with gamma and neutron sources in the INFN laboratory. These measurements were used to calibrate the detector, evaluate the response of the single pillars as well as of the full system, and optimize the RPM configuration and discrimination algorithm. During this phase, specific tests were performed to study the stability over time of the system, monitoring the measured the neutron and gamma count rates over periods of several weeks. The results allow us to demonstrate the reliability and robustness of the RPM. In a second time the RPM performance was studied via dynamic tests performed during the SCINTILLA test and benchmark campaigns. These measurements took place in the JRC ITRAP+10 facility at Ispra (Varese-Italy). The laboratory is equipped with an experimental set-up for dynamic tests of multiple systems according to international standards. The performed measurements utilized radioactive sources with activities selected according to ANSI and IEC standards to test the detector alarm performances in terms of gamma and neutron response, sensitivity to high gamma fields, sensitivity to moderated neutron sources as well as false alarm rates (FAR). In addition, the RPM was tested in challenging configurations exceeding the requirements set by international standards to determine the real limits of the system. The results obtained during these campaigns demonstrated that the system detection efficiency is not only compliant to international standards for its category, but often exceeds them, demonstrating the validity of the chosen technology and of the implemented layout. The positive performance also showed the effectiveness of the SCS and of its functionalities. To further demonstrate the system capabilities, a test in a real-life environment of the RPM is planned to happen in a near future by installing the detectors in a seaport. In this presentation I will give an overview of the RPM characteristics, of its performances as determined in the test campaign mentioned above and of future plans, to demonstrate how this technology can be an effective choice for the realization of {sup 3}He-free RPM detectors. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Isospin-invariant Skyrme energy-density-functional approach with axial symmetry

Density functional theory (DFT) is the microscopic tool of choice to describe properties of nuclei over the entire nuclear landscape, with a focus on medium-mass and heavy complex systems. Modern energy density functionals (EDFs) often offer a level of accuracy typical of phenomenological approaches based on parameters locally fitted to the data. It is clear, however, that in order to achieve high quality of predictions to guide spectroscopic studies, current functionals must be improved, especially in the isospin channel. In this respect, experimental studies of short-lived nuclei far from stability offer a unique test of isospin aspects of the many-body theory. In this study, we develop the isospin-invariant Skyrme-EDF method by considering local densities in all possible isospin channels and proton-neutron ($p-n$) mixing terms as mandated by the isospin symmetry. The EDF employed has the most general form that depends quadratically on the isoscalar and isovector densities. We test and benchmark the resulting $p-n$ EDF approach, and study the general properties of the new scheme by means of the cranking in the isospin space. We extend the existing axial DFT solver HFBTHO to the case of isospin-invariant EDF approach with all possible $p-n$ mixing terms. Explicit expressions have been derived for all the densities and potentials that appear in the isospin representation. In practical tests, we consider the Skyrme EDF SkM* and, as a first application, concentrate on Hartree-Fock aspects of the problem, i.e., pairing has been disregarded. Calculations have been performed for the ($A = 78, T ≃ 11), (A = 40, T ≃ 8$), and ($A = 48, T ≃ 4$) isobaric analog chains. Isospin structure of self-consistent $p-n$ mixed solutions has been investigated with and without the Coulomb interaction, which is the sole source of isospin symmetry breaking in our approach. The extended axial HFBTHO solver has been benchmarked against the symmetry-unrestricted HFODD code for deformed and spherical states. We developed and tested a general isospin-invariant Skyrme-EDF framework. The new approach permits spin-isospin densities that may give rise to hitherto unexplored modes in the excitation spectrum. The new formalism has been tested in the Hartree-Fock limit. A systematic comparison between HFODD and HFBTHO results show a maximum deviation of about 10 keV on the total binding energy for deformed nuclei when the Coulomb term is included. Without this term, the results of both solvers agree down to a ~10 eV level.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

OpenSHMEM Implementation of IOR Benchmark

The benchmarking effort within the Computational Research & Development Programs at the Oak Ridge National Laboratory (ORNL) seeks to design and enable High Performance Computing (HPC) benchmarks and test suites. The work described in this report is a part of the effort focusing on the comparison and analysis of OpenSHMEM implementations using the Interleave Or Random (IOR) software for benchmarking parallel file system using POSIX, MPIIO, or HDF5 interfaces. We describe the effort to emulate the MPIIO parallel collective capabilities in the IOR benchmark using OpenSHMEM communication. One development effort was in emulating the MPI derived datatype used in the read/write operations and in setting the file view. Another effort was in implementing an internal cache in OpenSHMEM distributed shared memory to facilitate global collective I/O operations. Experiments comparing collective I/O in MPIIO implementations with the OpenSHMEM implementations were performed on the SGI Turing Cluster and the Cray XK7 Titan supercomputer at the Oak Ridge Leadership Computing Facility (OLCF). The preliminary results suggest that on the Cray XK7 Titan, the MPIIO implementations obtained higher write performance and the OpenSHMEM version obtained slightly higher read performance. On the SGI Turing Cluster, the MPIIO implementations obtained slightly higher performance over the OpenSHMEM implementations on large files.

97 MATHEMATICS AND COMPUTING↗

Neutronic Consideration of TREAT Facility Fuel SiC Recladding

The Transient Reactor Test (TREAT) Facility is an air-cooled reactor composed of graphite-urania fuel encapsulated in zirconium alloy canisters and surrounded by ~2 ft (~61 cm) of nuclear grade graphite. The primary role of TREAT is to provide in-pile nuclear-heated safety research via transient testing [1]. Benchmark efforts have demonstrated sensitivity of TREAT neutronics models to graphite cross section data and key neutron poisons found in the fuel assemblies [2]. During fabrication of TREAT fuel assemblies, a small concentration of boron was inadvertently introduced with variable concentration into the aggregate of fuel blocks prepared for TREAT use. The concentration of boron, and its respective uncertainty, represent the most sensitive component in a neutronics study; unfortunately, nothing can be done to reduce or otherwise mitigate its impact. Hydrogen in the fuel blocks reduces the mean free path of the core and its true quantity and uncertainty is approximated. The hydrogen remains from pitch binder used in the fuel fabrication process and was not completely released due to incomplete fuel graphitization. Destructive fuel testing is necessary to quantify the actual hydrogen content and to improve benchmark model quality. A third neutron poison of some significance is the hafnium impurity in the Zircaloy-3 (Zry-3) assembly cladding. The quantity of hafnium is expected to be within nominal manufacturing limits for nuclear grade zircaloy. Recladding the fuel assemblies with material that is less neutron absorbing is expected to benefit reactor neutron economy. Moreover, TREAT’s total transient energy is restricted based on the rate of Zry-3 oxidation in TREAT’s air coolant environment. Hence, cladding with more benign air reaction kinetics could dramatically uprate the facility’s experimental capability. Silicon carbide (SiC) has been proposed as a candidate material for recladding TREAT assemblies, as SiC/SiC demonstrate favorable properties within nuclear environments [3]. The current operational limits of TREAT are restricted by the oxidation of Zry-3. Change of the cladding to SiC could feasibly double the current temperature limitation. Recladding opportunities allow for previously damaged fuel assemblies to be returned to service, as Zry-3 is not commercially available. The initial effort required to consider proceeding with any recladding effort is to neutronically characterize key reactor parameters while replacing Zry-3 with SiC. A characterization summary, with respective results, is provided herein.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

The cosmic DANCe of Perseus

Context. Star-forming regions are excellent benchmarks for testing and validating theories of star formation and stellar evolution. The Perseus star-forming region, being one of the youngest (< 10 Myr), closest (280-320 pc), and most studied in the literature, is a fundamental benchmark. Aims. We aim to study the membership, phase-space structure, mass, and energy (kinetic plus potential) distribution of the Perseus star-forming region using public catalogues (Gaia, APOGEE, 2MASS, and Pan-STARRS). Methods. We used Bayesian methodologies that account for extinction to identify the Perseus physical groups in the phase-space, retrieve their candidate members, derive their properties (age, mass, 3D positions, 3D velocities, and energy), and attempt to reconstruct their origin. Results. We identify 1052 candidate members in seven physical groups (one of them new) with ages between 3 and 10 Myr, dynamical super-virial states, and large fractions of energetically unbounded stars. Their mass distributions are broadly compatible with that of Chabrier for masses ≳0.1 M ⊙ and do not show hints of over-abundance of low-mass stars in NGC 1333 with respect to IC 348. These groups’ ages, spatial structure, and kinematics are compatible with at least three generations of stars. Future work is still needed to clarify if the formation of the youngest was triggered by the oldest. Conclusions. The exquisite Gaia data complemented with public archives and mined with comprehensive Bayesian methodologies allow us to identify 31% more members than previous studies, discover a new physical group (Gorgophone: 7 Myr, 191 members, and 145 M ⊙ ), and confirm that the spatial, kinematic, and energy distributions of these groups support the hierarchical star formation scenario.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

The Young L Dwarf 2MASS J11193254−1137466 Is a Planetary-mass Binary

We have discovered that the extremely red, low-gravity L7 dwarf 2MASS J11193254−1137466 is a 0.″14 (3.6 au) binary using Keck laser guide star adaptive optics imaging. 2MASS J11193254−1137466 has previously been identified as a likely member of the TW Hydrae Association (TWA). Using our updated photometric distance and proper motion, a kinematic analysis based on the BANYAN II model gives an 82% probability of TWA membership. At TWA’s 10 ± 3 Myr age and using hot-start evolutionary models, 2MASS J11193254−1137466AB is a pair of 3.7{sub −0.9}{sup +1.2} M{sub Jup} brown dwarfs, making it the lowest-mass binary discovered to date. We estimate an orbital period of 90{sub −50}{sup +80} years. One component is marginally brighter in K band but fainter in J band, making this a probable flux-reversal binary, the first discovered with such a young age. We also imaged the spectrally similar TWA L7 dwarf WISEA J114724.10−204021.3 with Keck and found no sign of binarity. Our evolutionary model-derived T{sub eff} estimate for WISEA J114724.10−204021.3 is ≈230 K higher than for 2MASS J11193254−1137466AB, at odds with the spectral similarity of the two objects. This discrepancy suggests that WISEA J114724.10−204021.3 may actually be a tight binary with masses and temperatures very similar to 2MASS J11193254−1137466AB, or further supporting the idea that near-infrared spectra of young ultracool dwarfs are shaped by factors other than temperature and gravity. 2MASS J11193254−1137466AB will be an essential benchmark for testing evolutionary and atmospheric models in the young planetary-mass regime.

79 ASTRONOMY AND ASTROPHYSICS↗

Experimental power density distribution benchmark in the TRIGA Mark II reactor

In order to improve the power calibration process and to benchmark the existing computational model of the TRIGA Mark II reactor at the Josef Stefan Inst. (JSI), a bilateral project was started as part of the agreement between the French Commissariat a l'energie atomique et aux energies alternatives (CEA) and the Ministry of higher education, science and technology of Slovenia. One of the objectives of the project was to analyze and improve the power calibration process of the JSI TRIGA reactor (procedural improvement and uncertainty reduction) by using absolutely calibrated CEA fission chambers (FCs). This is one of the few available power density distribution benchmarks for testing not only the fission rate distribution but also the absolute values of the fission rates. Our preliminary calculations indicate that the total experimental uncertainty of the measured reaction rate is sufficiently low that the experiments could be considered as benchmark experiments. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗