Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “BENCHMARKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

On Integral Benchmarks for Resolving TSL Conflicts for ENDF/B-VIII.1 Release [Slides]

This presentation touches on polystyrene ORNL evaluation in TSL review process for ENDF/B-VIII.1. the presentation found excellent agreement with INS and transmission measurements. Additionally, PS and PE evaluations with different phonon spectra, similar total xs., calculate keff similarly. This presentation found for critical benchmarks. While extremely useful for validation of nuclear data at all energies, critical benchmarks are not the best tool to provide a definitive answer on conflicting TSLs. In conclusion this presentation found INS and transmission measurements need to be the basis of validation of TSLs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Griffin/Pronghorn PBMR-400 Benchmark Results [Slides]

Content Overview: 1) Pronghorn & Griffin, MOOSE based applications overview: Codes capabilities description & MOOSE ecosystem overiew; Current research activities and synergies with other projects; Different multiphysics coupling scheme description. 2) PBMR-400 Benchmark: OECD NEA Benchmark and Pronghorn/Griffin models description; Standalone NK Ex1 and TH Ex2 Results description; Coupled Steady state Ex3; Results analysis for Transiet Ex4a (100-40-100 Load Following) & Ex3 (Protected PLOFC). 3) Conclusions $ Future steps.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Highly Accurate Experimental Heave Decay Tests with a Floating Sphere: A Public Benchmark Dataset for Model Validation of Fluid–Structure Interaction

Highly accurate and precise heave decay tests on a sphere with a diameter of 300 mm were completed in a meticulously designed test setup in the wave basin in the Ocean and Coastal Engineering Laboratory at Aalborg University, Denmark. The tests were dedicated to providing a rigorous benchmark dataset for numerical model validation. The sphere was ballasted to half submergence, thereby floating with the waterline at the equator when at rest in calm water. Heave decay tests were conducted, wherein the sphere was held stationary and dropped from three drop heights: a small drop height, which can be considered a linear case, a moderately nonlinear case, and a highly nonlinear case with a drop height from a position where the whole sphere was initially above the water. The precision of the heave decay time series was calculated from random and systematic standard uncertainties. At a 95% confidence level, uncertainties were found to be very low—on average only about 0.3% of the respective drop heights. Physical parameters of the test setup and associated uncertainties were quantified. A test case was formulated that closely represents the physical tests, enabling the reader to do his/her own numerical tests. The paper includes a comparison of the physical test results to the results from several independent numerical models based on linear potential flow, fully nonlinear potential flow, and the Reynolds-averaged Navier–Stokes (RANS) equations. A high correlation between physical and numerical test results is shown. The physical test results are very suitable for numerical model validation and are public as a benchmark dataset.

42 ENGINEERING↗
NASA NTRS2016

Final Report of the NASA Office of Safety and Mission Assurance Agile Benchmarking Team

To ensure that the NASA Safety and Mission Assurance (SMA) community remains in a position to perform reliable Software Assurance (SA) on NASAs critical software (SW) systems with the software industry rapidly transitioning from waterfall to Agile processes, Terry Wilcutt, Chief, Safety and Mission Assurance, Office of Safety and Mission Assurance (OSMA) established the Agile Benchmarking Team (ABT). The Team's tasks were: 1. Research background literature on current Agile processes, 2. Perform benchmark activities with other organizations that are involved in software Agile processes to determine best practices, 3. Collect information on Agile-developed systems to enable improvements to the current NASA standards and processes to enhance their ability to perform reliable software assurance on NASA Agile-developed systems, 4. Suggest additional guidance and recommendations for updates to those standards and processes, as needed. The ABT's findings and recommendations for software management, engineering and software assurance are addressed herein.

Software Assurance↗
NASA NTRS2021

IFAR Liner Benchmark Challenge #1 - DLR Impedance Eduction of Uniform and Axially Segmented Liners and Comparison with NASA Results

This paper presents the contribution from the German Aerospace Center (DLR) to the first liner benchmark challenge under the framework of the International Forum for Aviation Research (IFAR).Therefore, two sets of acoustically damping wall treatment, called ’liner samples’, have been produced by additive manufacturing based on the design data provided by NASA coordinating this benchmark. These liner samples have been integrated and acoustically characterized in the liner flow test facility DUCT-R at DLR Berlin as well as in the liner flow test facility GFIT at NASA Langley. Besides the dissipation coefficients and the axial pressure profiles, the liner wall impedance was educed by first determining the axial wave numbers and then applying a straightforward method based on the one-dimensional Convected Helmholtz Equation. Finally, the comparison of the liner impedance values to the NASA results show a fairly good agreement.

liner characterization↗
DOE OSTI2020

Evaluation of Graph Analytics Frameworks Using the GAP Benchmark Suite

The analysis of connected data is an increasingly important application in high-performance computing. Such analyses can reveal fraudulent patterns in financial transactions, optimize telecommunications networks, predict information flow in social networks, etc. However, the landscape of graph analytics is highly diverse. Graph algorithms stress processor architectures differently, and no one graph can represent all topologies. Consequently, no single approach or framework is expected to be optimal for all graph analytics problems. To help make sense of this diverse landscape, we evaluated four approaches to graph analytics: GraphBLAS, Galois, BGL17, GraphIt; and compare them against hand-tuned implementations that take advantage of hardware features on our test platform. Graph- BLAS formulates graph analytics as sparse linear algebra. Galois provides syntactic constructs for data parallelism over irregular data structures. BGL17 is a generic C++ template library for implementing graph algorithms. GraphIt provides a domain- specific language to describe and optimize graph algorithms. We use the GAP Benchmark Suite to establish baseline performance and guide the side-by-side evaluation of each framework. GAP consists of 30 tests: six graph analytics algorithms (breadth- first search, single-source shortest path, PageRank, betweenness centrality, connected components, and triangle counting) run on five graphs, each with different topological characteristics (e.g., high diameter, skewed degree distribution, high average degree). High-performance reference implementations are included for each benchmark algorithm. Because a graph can be loaded into memory a number of ways (e.g., flat file on disk, compressed sparse format, data frames, retrieved from SQL or NoSQL databases), our evaluation focused on computational performance rather than I/O. Our results show the relative strengths of each framework.

Graph algorithms, Benchmarking, shared-memory prog↗
DOE OSTI2022

Verification of MCNP Critical Benchmark Model of U233-COMP-THERM-004

Los Alamos National Laboratory (LANL) has been working on creating a new centralized repository for MCNP models of critical benchmark experiments. The initial model of U233-COMP-THERM-004 was derived from the Whisper Suite provided with MCNP6.2, and was compared against the ICSBEP handbook chapter for the benchmark. Many notable errors were found in the initial model and were revised accordingly. Comparing the computational model of the old and new models confirmed that any Whisper results that relied upon the old model are still valid.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

FORCE Development Status Update: Vertical Integration and Benchmarking of System Dynamics

Recent efforts to establish effective models for grid energy analysis, especially given the increase in variable renewable energy (VRE) sources and the economic challenges faced by traditional nuclear energy, have generated new technological considerations. One effort to improve the economic viability of nuclear power involves investigating integrated energy systems (IES) which include secondary energy systems that introduce flexibility and secondary market possibilities to existing and perceived future nuclear energy generation technologies. To analyze the technical and economic potential of IES, the Framework for Optimization of Resources and Economics (FORCE) tool suite was developed through a collaboration among national laboratories. Within the FORCE tool suite, the Holistic Energy Resource Optimization Network (HERON) provides algorithms for analyzing the long-term viability of potential IES technologies, while HYBRID provides algorithms and models to achieve high-resolution analysis of coupling physics over a short time period. Continued maturing of the FORCE tool suite requires further interconnections between the various tools in the suite in order to ensure consistent analysis. Analyses performed by applying HYBRID to transient process modeling should be easily harvestable as inputs to HERON analyses. The first item in this status update is a demonstration of an automated data pipeline for loading data from HYBRID into HERON analyses. Application of HYBRID results to HERON, as part of using the FORCE tool suite, relies on robust modeling assumptions for the various models included in HYBRID. The second result of this status update is the benchmarking and validation of cost and operational data, with a particular focus on natural gas energy generators. These generators are benchmarked with a focus on contrasting them with proposed thermal energy storage (TES) technologies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

RELAP5-3D Solutions to Exercise 1 of the OECD-NEA HTTF Benchmark

The high-temperature gas-cooled reactor (HTGR) is an advanced reactor concept that has received considerable attention over the last 60 years. HTGRs boast high coolant outlet temperatures, passive safety, and large margins to fuel failure. Recent years have seen increasing interest in HTGRs, whether large-scale HTGRs for electricity or process heat applications or as microreactors serving remote communities. HTGRs have considerable potential to fulfill these applications, but modeling and simulation tools typically used for reactor safety analysis have not been validated for HTGR modeling. The High-Temperature Test Facility (HTTF) was constructed at Oregon State University (OSU) to provide validation data for HTGR modeling. Recently, Idaho National Laboratory (INL), OSU, Argonne National Laboratory, Canadian Nuclear Laboratories, and the University of Tennessee Knoxville have collaborated to develop an HTGR thermal hydraulics benchmark based on HTTF experiments. This summary presents results from a portion of that benchmark using RELAP5-3D

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Whole core analysis of OECD/NEA TVA-WB1 benchmark exercise 1 using continuous-energy Monte Carlo code MVP with JENDL-4.0u and ENDF/B-VII.0

The TVA WB1 benchmark problem was precisely modeled in accordance with the geometry and material specifications, and benchmark exercise 1 was solved with the MVP code and the nuclear data libraries based on JENDL-4.0u (JENDL-4.0 updated file) and ENDF/B-VII.0. The criticality, the control rod bank worth, the isothermal temperature coefficient (ITC), the integral rod worth of bank D, and differential soluble boron worth (DBW) were obtained. The criticality and the control rod bank worth were compared with the measured data and published calculation results with other codes, Serpent and KENO. The criticality and the control rod bank worth calculated by MVP and the libraries agree with the measured and the published calculation results within the criteria specified in the ANSI/ANS standard. From these results, the calculation model for the MVP and the libraries was verified. The other parameters such as ITC, the integral rod worth, and DBW were also compared between JENDL-4.0u and ENDF/B-VII.0. The comparison of the results shows JENDL-4.0u and ENDF/B-VII.0 give comparable results within the standard deviation, the difference between libraries is small. (author)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

OECD/NEA MPCMIV Benchmark - Preliminary fuel performance results

The on-going OECD/NEA Multi-physics Pellet Cladding Mechanical Interaction Validation (MPCMIV) benchmark aims to provide guidance on multi-physics validation through the modelling of two cold ramps. In this paper, the first results for the base irradiation of the father rod and fuel rodlet (refabricated from the father rod), and the first cold ramp are presented. The base irradiation consists of 3 years of irradiation in the Forsmark-2 reactor. The cold ramp encompasses a steady-state pre-ramp period of less than one hour at a low constant linear heat rate (LHR) followed by a ramp test (< 1 min) with a much higher maximal LHR. The base irradiation is modelled using the fuel performance codes FRAPCON and FAST, while the cold ramp modeling is using the fuel performance code FRAPTRAN. Several missing parameters for FRAPCON/FAST base irradiation models have been selected using multiple references such as the OECD/NEA light water reactor Uncertainty Analysis in Modelling (UAM) benchmark specifications and the FRAPCON Integral Assessment report. The obtained results for the base irradiation such as the cladding outer diameter show reasonable agreement with the experimental measurements. The results for the cold ramp show larger differences with the experimental measurements (e.g., cladding axial elongation). However, such differences have been observed as well in other studies involving pellet cladding mechanical interaction analyses and are attributed to the fuel performance modelling assumptions and to the tuned modelling parameters that were not covered by the specifications. Uncertainty and sensitivity analysis might allow a better quantification of these missing parameters. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

High Temperature Gas-Cooled Reactor Thermal Hydraulics Benchmark Problem 2 Description: Depressurized Conduction Cooldown

Problem 2 of the HTGR T/H Benchmark represents the depressurized conduction cooldown transient and is based on HTTF experiment PG-29. The problem includes an exercise for code-to-code comparison, an exercise for code-to-data comparison, and an exercise for error scaling. This presentation provides an overview of the problem description and provides benchmark participants an opportunity to ask questions about the problem definition.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Code Benchmark of Depressurized Conduction Cooldown Transient in the High Temperature Test Facility

This paper presents results from modeling of a depressurized conduction cooldown (DCC) transient at the High Temperature Test Facility (HTTF) as part of the OECD-NEA Thermal Hydraulics Code Validation Benchmark for High-Temperature Gas-Cooled Reactors using HTTF Data . This paper briefly describes the benchmark and the models being used. It then presents a comparison of steady state and transient results based on the Problem 2 Exercise 1A and 1B definitions. We compare block and helium temperature distributions, mass flow distribution, and energy balance in steady state. All models show comparable mass flow distributions and energy balances. The temperatures within the core and outer regions are comparable in all models too, but inner reflector temperatures can vary significantly. Despite that, we find that the models are in good agreement for the full-power steady state. In the DCC, we look at block temperature at the core midplane and RCCS water exit temperature. The INL and ANL models are found to be in excellent agreement with one another on block temperature over time, while the agreement when the KAERI and NRG models are added into consideration is good. Differences in the transient heat removal from the RCCS cause the differences in block temperature over time in these models. The CNL models show similar trends to the INL, ANL, KAERI, and NRG models, but the temperatures are high because the volumes used in calculating the average temperature include the heater rods in the CNL models only. The HUN-REN model shows results that suggest significantly lower heat removal in the RCCS which merit further investigation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Progress in the HTTF Benchmark and RELAP5-3D Gas-Cooled Reactor Validation

This slide set presents results of analysis done in the first year after the kickoff of the HTTF benchmark. This work includes the development of a new RELAP5-3D model of the facility and collection and presentation of results from one of the exercises in the benchmark. Highlights include good agreement between the new and legacy models for full-power steady state and similar predictions of maximum block temperature during a pressurized conduction cooldown. Additionally, code-to-code comparisons of a full-power steady state and depressurized conduction cooldown (DCC) from full-power steady state as part of Problem 2 Exercises 1A and 1B show good agreement on temperatures predicted in the core but considerable spread in central reflector temperatures. During the DCC, temperature behavior is similar across all models, but cooldown rates are dictated by the performance of the reactor cavity cooling system

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

International collaboration framework for the calculation of performance loss rates: Data quality, benchmarks, and trends (towards a uniform methodology)

Abstract The IEA PVPS Task 13 group, experts who focus on photovoltaic performance, operation, and reliability from several leading R&D centers, universities, and industrial companies, is developing a framework for the calculation of performance loss rates of a large number of commercial and research photovoltaic (PV) power plants and their related weather data coming across various climatic zones. The general steps to calculate the performance loss rate are (i) input data cleaning and grading; (ii) data filtering; (iii) performance metric selection, corrections, and aggregation; and finally, (iv) application of a statistical modeling method to determine the performance loss rate value. In this study, several high‐quality power and irradiance datasets have been shared, and the participants of the study were asked to calculate the performance loss rate of each individual system using their preferred methodologies. The data are used for benchmarking activities and to define capabilities and uncertainties of all the various methods. The combination of data filtering, metrics (performance ratio or power based), and statistical modeling methods are benchmarked in terms of (i) their deviation from the average value and (ii) their uncertainty, standard error, and confidence intervals. It was observed that careful data filtering is an essential foundation for reliable performance loss rate calculations. Furthermore, the selection of the calculation steps filter/metric/statistical method is highly dependent on one another, and the steps should not be assessed individually.

14 SOLAR ENERGY↗
DOE OSTI2020

Verification benchmarks for single-phase flow in three-dimensional fractured porous media

Flow in fractured porous media occurs in the earth’s subsurface, in biological tissues, and in man-made materials. Fractures have a dominating influence on flow processes, and the last decade has seen an extensive development of models and numerical methods that explicitly account for their presence. To support these developments, four benchmark cases for single-phase flow in three-dimensional fractured porous media are presented. Furthermore, the cases are specifically designed to test the methods’ capabilities in handling various complexities common to the geometrical structures of fracture networks. Based on an open call for participation, results obtained with 17 numerical methods were collected. This paper presents the underlying mathematical model, an overview of the features of the participating numerical methods, and their performance in solving the benchmark cases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Development of a Benchmark Eddy Flux Evapotranspiration Dataset for Evaluation of Satellite-Driven Evapotranspiration Models Over the CONUS

A large sample of ground-based evapotranspiration (ET) measurements made in the United States, primarily from eddy covariance systems, were post-processed to produce a benchmark ET dataset. The dataset was produced primarily to support the intercomparison and evaluation of the OpenET satellite-based remote sensing ET (RSET) models and could also be used to evaluate ET data from other models and approaches. OpenET is a web-based service that makes field-delineated and pixel-level ET estimates from well-established RSET models readily available to water managers, agricultural producers, and the public. The benchmark dataset is composed of flux and meteorological data from a variety of providers covering native vegetation and agricultural settings. Flux footprint predictions were developed for each station and included static flux footprints developed based on average wind direction and speed, as well as dynamic hourly footprints that were generated with a physically based model of upwind source area. The two footprint prediction methods were rigorously compared to evaluate their relative spatial coverage. Data from all sources were post-processed in a consistent and reproducible manner including data handling, gap-filling, temporal aggregation, and energy balance closure correction. The resulting dataset included 243,048 daily and 5,284 monthly ET values from 194 stations, with all data falling between 1995 and 2021. We assessed average daily energy imbalance using 172 flux sites with a total of 193,021 days of data, finding that overall turbulent fluxes were understated by about 12% on average relative to available energy. Multiple linear regression analyses indicated that daily average latent energy flux may be typically understated slightly more than sensible heat flux. This dataset was developed to provide a consistent reference to support evaluation of RSET data being developed for a wide range of applications related to water accounting and water resources management at field to watershed scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A benchmarking study of Geant4 for Auger electrons emitted by medical radioisotopes

Auger emitting radioisotopes are of great interest in targeted radiotherapy because, once internalised in the tumour cells, they can deliver dose locally to the radiation sensitive targets, while not affecting surrounding cells. Geant4 is a Monte Carlo code widely used to characterise the physics mechanism at the basis of targeted radiotherapy. Here, we benchmarked the modelling of the emission of Auger electrons in Geant4 deriving from the decay of 123 I, 124 I, 125 I radionuclides against existing theoretical approaches. We also compared Geant4 against reference data in the case of 131 Cs, which is of interest for brachytherapy. In the case of 125 I and 131 Cs, the simulation results are compared to experimental measurements as well. Good agreement was found between Geant4 and the reference data. As far as we know, this is the first study aimed to benchmark against experimental measurements the emission of Auger electrons in Geant4 for radiotherapy applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗