Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Combining Phase Identification and Statistic Modeling for Automated Parallel Benchmark Generation

Parallel application benchmarks are indispensable for evaluating/optimizing HPC software and hardware. However, it is very challenging and costly to obtain high-fidelity benchmarks reflecting the scale and complexity of state-of-the-art parallel applications. Hand-extracted synthetic benchmarks are time-and labor-intensive to create. Real applications themselves, while offering most accurate performance evaluation, are expensive to compile, port, reconfigure, and often plainly inaccessible due to security or ownership concerns. This work contributes APPRIME, a novel tool for trace-based automatic parallel benchmark generation. Taking as input standard communication-I/O traces of an application's execution, it couples accurate automatic phase identification with statistical regeneration of event parameters to create compact, portable, and to some degree reconfigurable parallel application benchmarks. Experiments with four NAS Parallel Benchmarks (NPB) and three real scientific simulation codes confirm the fidelity of APPRIME benchmarks. They retain the original applications' performance characteristics, in particular the relative performance across platforms.

Jin, Ye↗

Advancing our understanding of instabilities in high-energy-density systems through the study of benchmark datasets with advanced modeling tools

Numerous types of pulsed power driven inertial confinement fusion (ICF) and high energy density (HED) systems rely on implosion stability to achieve desired temperatures, pressures, and densities. Sandia National Laboratories Pulsed Power Sciences Center’s main ICF platform, Magnetized Liner Inertial Fusion (MagLIF), suffers from implosion instabilities which limit attainable fuel conditions and can compromise fuel confinement. This Truman Fellowship research primarily focused on computationally exploring (a) methods for improving our understanding of hydrodynamic and magnetohydrodynamic instabilities that form during cylindrical liner implosions, (b) methods for mitigating implosion instabilities, particularly those that degrade performance of MagLIF targets, and (c) novel MagLIF target designs intended to improve target performance primarily via enhanced implosion stability. Several multi-dimensional computational tools were used, including the magnetohydrodynamics code ALEGRA, the radiation-magnetohydrodynamics code HYDRA, and the magnetohydrodynamics code KRAKEN. This research succeeded in executing and analyzing simulations of automagnetizing liner implosions, shockless MagLIF implosions, dynamic screw pinch driven cylindrical liner implosions, and cylindrically convergent HED instability studies. The methods and tools explored and developed in this Truman Fellowship research have been published in several peer-reviewed journal articles and will serve as useful contributions to the fields of pulsed power science and engineering, particularly pertaining to pulsed power ICF and HED science.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Net Load Forecasting With Disaggregated Behind-the-Meter PV Generation

As worldwide use of residential photovoltaic (PV) systems grows, system operators and utilities will need to transition from forecasting pure demand to forecasting net load with behind-the-meter (BTM) PV generation. However, PV generation can be difficult to predict and the measurements of PV generation from BTM residential systems are often invisible behind a measurement of the net load, making net load forecasting challenging. This paper proposes a novel two-stage framework for net load forecasting in areas with limited observability and high BTM PV generation. First, the profiles of observable customers are used to disaggregate the net load measurements into the pure load and PV generation. Then, separate models are used to forecast the PV generation and pure load individually, and the results are combined for a net load forecast. Further, this paper also proposes a compensator for correcting the error of the net load forecast, using historical forecast errors of the PV generation, pure load, and net load. The proposed framework is tested through two case studies for areas with high BTM PV penetration and less than 10% observable customers. The two-stage forecasting model is compared to two benchmark methods - a time series forecasting model, and a model that forecasts the net load directly using historical net load measurements. Results show that the proposed disaggregation-forecasting framework reduces the error of the net load forecast compared to both benchmark models. In addition, when the net load forecast error is periodic, the compensator can correct the error to improve the forecast accuracy.

14 SOLAR ENERGY↗

Evaluating Performance Portability of Accelerator Programming Models using SPEC ACCEL 1.2 Benchmarks

As heterogeneous architectures are becoming mainstream for HPC systems, application programmers are looking for programming model implementations that offer both performance and portability across platforms. Two directive-based programming models for accelerator programming that aim at doing this are OpenMP 4/4.5 and OpenACC. Many users want to know the difference between these two programming models, the state of their implementations, how to use them, and evaluate how suitable they are for their applications.The Standard Performance Evaluation Corporation (SPEC) ACCEL benchmarks, developed by the SPEC High Performance Group (HPG), recently released SPEC ACCEL 1.2 benchmark suite to help the evaluation of OpenCL, OpenMP 4.5 and OpenACC on different platforms. Inthis paper we present our preliminary results that evaluates OpenMP4.5 and OpenACC on a variety of accelerator-based systems: POWER9with NVIDIA V100 GPUs (Summit), Intel Xeon Phi 7230 (Percival), and AMD Bulldozer Opteron with NVIDIA K20x (Titan). Comparing these benchmarks on different systems gives us insight into the support for OpenMP and OpenACC and their execution times provide insights about their quality of implementations provided by different vendors. We also compare best of OpenMP and OpenACC to see if a particular programming model favors a particular type of benchmark kernel.

Boehm, Swen↗

Two-Step Analysis of Watts Bar Nuclear 1 Cycle 1 with SCALE/PARCS

A two-step approach to reactor core analysis was performed using SCALE and PARCS. Polaris is a new lattice physics module in SCALE 6.2 that provides light water reactor (LWR) modelling capabilities. The VERA (Virtual Environment for Reactor Applications) benchmark problems have been established by the Consortium of Advanced Simulation of Light Water Reactors (CASL). These benchmark problems were chosen to assess the performance of Polaris and PARCS. Homogenized few-group assembly cross sections were generated using Polaris and used in the United States Nuclear Regulatory Commission (NRC) core simulator PARCS. This paper will provide descriptions of the benchmark problems modelled, discuss the impact of transport cross section approximations in SCALE 6.2.0 and 6.2.1, and present the results obtained from the SCALE/PARCS benchmark calculations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Updated Godiva-IV Benchmark Preview

A note of errata prepended to the Godiva-IV delayed-critical benchmark (HEU-MET-FAST- 086) identifies two corrections to be made to the model: The glory hole in the spindle should be made larger, and the height of the safety block should be made smaller (and therefore its density made larger). In addition, the safety block at its full-in position is closer to the inner subassembly plate than was modeled in the benchmark. These changes have been made to HEU-MET-FAST-086 Case 4 in order to estimate the effect on $\kappa$ eff and on the neutron flux spectrum. Using smaller separation, a smaller safety block, and a larger glory hole caused keff to increase by 453 ± 1 pcm from the benchmark. The latest nuclear data, ENDF/B-VIII.0, have also been used, causing $\kappa$ eff to increase another 37 ± 1 pcm. Flux spectra were compared in a modeled fission foil (near the center of Godiva-IV in the glory hole) and at three external (point) detectors. Within the fission foil, using ENDF/B-VIII.0 induced changes in the flux spectrum similar in size to the changes due to using smaller separation, a smaller safety block, and a larger glory hole. At the detectors, using ENDF/B- VIII.0 induced changes in the flux spectrum much larger than those due to changing the model. In other words, the corrections to the benchmark model cause a large increase in $\kappa$ eff , but the changes to the neutron flux spectrum are small compared to those caused by using the latest nuclear data. This study presents a preview of results expected during the reevaluation of the Godiva IV benchmark, but it is not a substitute for the full reevaluation.A note of errata prepended to the Godiva-IV delayed-critical benchmark (HEU-MET-FAST- 086) identifies two corrections to be made to the model: The glory hole in the spindle should be made larger, and the height of the safety block should be made smaller (and therefore its density made larger). In addition, the safety block at its full-in position is closer to the inner subassembly plate than was modeled in the benchmark. These changes have been made to HEU-MET-FAST-086 Case 4 in order to estimate the effect on $\kappa$ eff and on the neutron flux spectrum. Using smaller separation, a smaller safety block, and a larger glory hole caused $\kappa$ eff to increase by 453 ± 1 pcm from the benchmark. The latest nuclear data, ENDF/B-VIII.0, have also been used, causing $\kappa$ eff to increase another 37 ± 1 pcm. Flux spectra were compared in a modeled fission foil (near the center of Godiva-IV in the glory hole) and at three external (point) detectors. Within the fission foil, using ENDF/B-VIII.0 induced changes in the flux spectrum similar in size to the changes due to using smaller separation, a smaller safety block, and a larger glory hole. At the detectors, using ENDF/B- VIII.0 induced changes in the flux spectrum much larger than those due to changing the model. In other words, the corrections to the benchmark model cause a large increase in $\kappa$ eff , but the changes to the neutron flux spectrum are small compared to those caused by using the latest nuclear data. This study presents a preview of results expected during the reevaluation of the Godiva IV benchmark, but it is not a substitute for the full reevaluation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Qualification of CASMO5 / SIMULATE-3K against the SPERT-III E-core cold start-up experiments

SIMULATE-3K is a three-dimensional kinetic code applicable to LWR Reactivity Initiated Accidents. S3K has been used to calculate several international recognized benchmarks. However, the feedback models in the benchmark exercises are different from the feedback models that SIMULATE-3K uses for LWR reactors. For this reason, it is worth comparing the SIMULATE-3K capabilities for Reactivity Initiated Accidents against kinetic experiments. The Special Power Excursion Reactor Test III was a pressurized-water, nuclear-research facility constructed to analyze the reactor kinetic behavior under initial conditions similar to those of commercial LWRs. The SPERT III E-core resembles a PWR in terms of fuel type, moderator, coolant flow rate, and system pressure. The initial test conditions (power, core flow, system pressure, core inlet temperature) are representative of cold start-up, hot start-up, hot standby, and hot full power. The qualification of S3K against the SPERT III E-core measurements is an ongoing work at Studsvik. In this paper, the results for the 30 cold start-up tests are presented. The results show good agreement with the experiments for the reactivity initiated accident main parameters: peak power, energy release and compensated reactivity. Predicted and measured peak powers differ at most by 13%. Measured and predicted reactivity compensations at the time of the peak power differ less than 0.01 $. Predicted and measured energy release differ at most by 13%. All differences are within the experimental uncertainty. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluating Climate Models’ Cloud Feedbacks Against Expert Judgment

Abstract The persistent and growing spread in effective climate sensitivity (ECS) across global climate models necessitates rigorous evaluation of their cloud feedbacks. Here we evaluate several cloud feedback components simulated in 19 climate models against benchmark values determined via an expert synthesis of observational, theoretical, and high‐resolution modeling studies. We find that models with smallest feedback errors relative to these benchmark values generally have moderate total cloud feedbacks (0.4–0.6 W m −2 K −1 ) and ECS (3–4 K). Those with largest errors generally have total cloud feedback and ECS values that are too large or too small. Models tend to achieve large positive total cloud feedbacks by having several cloud feedback components that are systematically biased high rather than by having a single anomalously large component, and vice versa. In general, better simulation of mean‐state cloud properties leads to stronger but not necessarily better cloud feedbacks. The Python code base provided herein could be applied to developmental versions of models to assess cloud feedbacks and cloud errors and place them in the context of other models and of expert judgment in real‐time during model development.

58 GEOSCIENCES↗

How strongly do hydrogen and water molecules stick to carbon nanomaterials?

The interaction strength of molecular hydrogen and water to carbon nanomaterials is relevant to, among many applications, hydrogen storage, water treatment, and water flow. Yet, accurate interaction energies for hydrogen and water with carbon nanotubes (CNTs) remain scarce despite the importance of having reliable benchmark data to inform experiments and to validate computational models. Here, benchmark fixed-node diffusion Monte Carlo (DMC) interaction energies are provided for hydrogen and water monomers inside and outside a typical zigzag CNT. The DMC interaction energies provide valuable insight into molecular interactions with CNTs in general and are also expected to be particularly relevant to gas uptake studies on CNTs. In addition, a selection of density functional theory (DFT) exchange-correlation (xc) functionals and force field potentials that ought to be suitable for these systems is compared. An unexpected variation is found in the performance of DFT van der Waals (vdW) models in particular. An analysis of the peculiar discrepancy between different vdW models indicates that medium-range correlation (at circa 3 to 5 Å) plays a key role inside CNTs and is poorly predicted by some vdW models. Using accurate reference information, this work reveals which xc functionals and force fields perform well for molecules interacting with CNTs. The results will be valuable to future work on these and related systems that involve molecules interacting with low-dimensional systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Physics at a 100 TeV pp Collider: Standard Model Processes

This report summarises the properties of Standard Model processes at the 100 TeV pp collider. We document the production rates and typical distributions for a number of benchmark Standard Model processes, and discuss new dynamical phenomena arising at the highest energies available at this collider. We discuss the intrinsic physics interest in the measurement of these Standard Model processes, as well as their role as backgrounds for New Physics searches.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗