Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

High-order diamond differencing schemes for the Boltzmann Fokker-Planck equation in 3D Cartesian geometries

The Boltzmann Fokker-Planck, an approximate form of the linear Boltzmann equation is commonly used to treat efficiently the transport of charged particles in matter. This paper introduces the application of high-order diamond differencing schemes (HODD), specifically the DD1 and DD2 schemes which are 4- and 6-order accurate respectively, to handle the spatial discretization of that equation in 3D Cartesian geometries. The energy deposition solutions for the coupled transport of electrons and photons presented in this work shows that HODD, compared to classical DD scheme, provides correction to the oscillations and a reduced propensity to yield negative fluxes. They are useful tools to minimize local error, notably in regions with abrupt variations of the flux solution. They also can be used to reduced execution time by decreasing the needed number of voxels to obtain a fixed accuracy. On the tested benchmarks, the DD1 scheme is 87%- 92%-91% more accurate than the classical DD scheme for total, mean per-voxels and maximum deviation of energy deposition values respectively. For comparison, a calculation with 8 times more voxels, requiring roughly 2.5 times more time to execute, is 92%-90%-77% more accurate. (authors)

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Benchmarking FFTF LOFWOS Test# 13 using SAM code: Baseline model development and uncertainty quantification

The development and deployment of advanced reactors, such as the sodium-cooled fast reactor (SFR), relies on sophisticated modeling tools to ensure the safety of the design under various transients. The predictive capability of these advanced modeling tools requires validation to garner trust in supporting the licensing of the advanced reactors. For this reason, the International Atomic Energy Agency (IAEA) initiated a coordinated research project (CRP) in 2018 for the analysis of the Fast Flux Test Facility (FFTF) Loss of Flow Without Scram (LOFWOS) Test #13.In this study, we present and discuss the benchmarking efforts of the modern system code SAM on the FFTF LOFWOS Test #13. Further, the SAM baseline model was developed according to the benchmark specification, which included a detailed core model with reactivity feedback. Generally, good agreement was observed between the baseline results and benchmark measurements; however, discrepancies persisted, particularly in predicted fuel assembly coolant outlet temperatures. Utilizing the baseline model, uncertainty quantification (UQ) and sensitivity analysis (SA) were conducted with the assistance of various statistical learning and machine learning methods, including kernel density estimation, Gaussian processes, and Sobol indices. Following the baseline model prediction and UQ and SA results, we discuss the reasons for the simulation discrepancies and propose further improvements to the model. This benchmarking effort adheres to the best-estimate plus uncertainty approach and can serve as a valuable example for supporting risk-informed licensing of advanced reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2000

Test Cases for the Benchmark Active Controls: Spoiler and Control Surface Oscillations and Flutter

As a portion of the Benchmark Models Program at NASA Langley, a simple generic model was developed for active controls research and was called BACT for Benchmark Active Controls Technology model. This model was based on the previously-tested Benchmark Models rectangular wing with the NACA 0012 airfoil section that was mounted on the Pitch and Plunge Apparatus (PAPA) for flutter testing. The BACT model had an upper surface spoiler, a lower surface spoiler, and a trailing edge control surface for use in flutter suppression and dynamic response excitation. Previous experience with flutter suppression indicated a need for measured control surface aerodynamics for accurate control law design. Three different types of flutter instability boundaries had also been determined for the NACA 0012/PAPA model, a classical flutter boundary, a transonic stall flutter boundary at angle of attack, and a plunge instability near M = 0.9. Therefore an extensive set of steady and control surface oscillation data was generated spanning the range of the three types of instabilities. This information was subsequently used to design control laws to suppress each flutter instability. There have been three tests of the BACT model. The objective of the first test, TDT Test 485, was to generate a data set of steady and unsteady control surface effectiveness data, and to determine the open loop dynamic characteristics of the control systems including the actuators. Unsteady pressures, loads, and transfer functions were measured. The other two tests, TDT Test 502 and TDT Test 5 18, were primarily oriented towards active controls research, but some data supplementary to the first test were obtained. Dynamic response of the flexible system to control surface excitation and open loop flutter characteristics were determined during Test 502. Loads were not measured during the last two tests. During these tests, a database of over 3000 data sets was obtained. A reasonably extensive subset of the data sets from the first two tests have been chosen for Test Cases for computational comparisons concentrating on static conditions and cases with harmonically oscillating control surfaces. Several flutter Test Cases from both tests have also been included. Some aerodynamic comparisons with the BACT data have been made using computational fluid dynamics codes at the Navier-Stokes level (and in the accompanying chapter SC). Some mechanical and active control studies have been presented. In this report several Test Cases are selected to illustrate trends for a variety of different conditions with emphasis on transonic flow effects. Cases for static angles of attack, static trailing-edge and upper-surface spoiler deflections are included for a range of conditions near those for the oscillation cases. Cases for trailing-edge control and upper-surface spoiler oscillations for a range of Mach numbers, angle of attack, and static control deflections are included. Cases for all three types of flutter instability are selected. In addition some cases are included for dynamic response measurements during forced oscillations of the controls on the flexible mount. An overview of the model and tests is given, and the standard formulary for these data is listed. Some sample data and sample results of calculations are presented. Only the static pressures and the first harmonic real and imaginary parts of the pressures are included in the data for the Test Cases, but digitized time histories have been archived. The data for the Test Cases are also available as separate electronic files.

Bennett, Robert M.↗
NASA NTRS1991

A status report on a model for Benchmark active controls testing

This 'work-in-progress' paper presents a status report on an active controls flutter model which is currently in the design and fabrication phase. This model is a part of the Benchmark Models Program (BMP). The BMP is a NASA LaRC program that includes a series of models which will be used to study different aeroelastic phenomena and to validate aeroelastic methods. The objective of Benchmark Active Controls testing is to validate active control design tools. Flutter testing will be conducted with a pressure-instrumented rigid model attached to a flexible pitch and plunge mount system. Unsteady pressure distributions and transonic flutter boundaries will be measured with and without active control system engaged.

Durham, Michael H.↗
NASA NTRS1993

A determination of the external forces required to move the benchmark active controls testing model in pure plunge and pure pitch

In view of the strong need for a well-documented set of experimental data which is suitable for the validation and/or calibration of modern Computational Fluid Dynamics codes, the Benchmark Models Program was initiated by the Structural Dynamics Division of the NASA Langley Research Center. One of the models in the program, the Benchmark Active Controls Testing Model, consists of a rigid wing of rectangular planform with a NACA 0012 profile and three control surfaces (a trailing-edge control surface, a lower-surface spoiler, and an upper-surface spoiler). The model is affixed to a flexible mount system which allows only plunging and/or pitching motion. An approximate analytical determination of the forces required to move this model, with its control surfaces fixed, in pure plunge and pure pitch at a number of test conditions is included. This provides a good indication of the type of actuator system required to generate the aerodynamic data resulting from pure plunging and pure pitching motion, in which much interest was expressed. The analysis makes use of previously obtained numerical results.

Dcruz, Jonathan↗
NASA NTRS2013

Experimental Data from the Benchmark SuperCritical Wing Wind Tunnel Test on an Oscillating Turntable

The Benchmark SuperCritical Wing (BSCW) wind tunnel model served as a semi-blind testcase for the 2012 AIAA Aeroelastic Prediction Workshop (AePW). The BSCW was chosen as a testcase due to its geometric simplicity and flow physics complexity. The data sets examined include unforced system information and forced pitching oscillations. The aerodynamic challenges presented by this AePW testcase include a strong shock that was observed to be unsteady for even the unforced system cases, shock-induced separation and trailing edge separation. The current paper quantifies these characteristics at the AePW test condition and at a suggested benchmarking test condition. General characteristics of the model's behavior are examined for the entire available data set.

Heeg, Jennifer↗
DOE OSTI2022

Benchmark Specification for FFTF LOFWOS Test #13

The Fast Flux Test Facility (FFTF) at the Hanford site in Washington was designed by the Westinghouse Electric Corporation for the U.S. Department of Energy. FFTF was a 400 MW thermal, oxide-fueled, liquid sodium cooled test reactor, built to assist development and testing of advanced fuels and materials for fast breeder reactors. After reaching criticality in 1980, FFTF operated until 1992, providing the U.S. Department of Energy (DOE) with the means to test fuels, materials, and other components in a fast neutron flux environment. In July 1986, a series of unprotected transients (with the plant protection system intentionally disabled) were performed in FFTF as part of the passive safety demonstration program. Among these were thirteen loss of flow without scram (LOFWOS) tests. The goals of this program included confirming the liquid metal reactor safety margins, providing data for computer code validation, and demonstrating the inherent and passive safety benefits of specific design features. The test defined in this benchmark is LOFWOS Test #13, which was initiated at 50% power and 100% flow with the pump pony motors turned off. This benchmark specification is intended to support collaborative efforts within international partnerships on the validation of simulation tools and models in the area of Sodium-cooled Fast Reactor (SFR) safety. Validated tools and models are needed to evaluate SFR inherent safety characteristics and assess the impact of passive design features in response to accident initiators. Comparisons with experimental data and the results of safety analyses from other groups create unique opportunities to improve predictive capabilities of computational codes and methods for SFR modeling and simulation. The conditions of the LOFWOS test along with the feedback from FFTF’s limited free bow core restraint system and the novel passive reactivity control Gas-Expansion Modules (GEMs) pose a very challenging and uniquely valuable benchmark exercise.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

A High-Fidelity Cyber-Physical Testbed-Based Benchmarking Dataset For Testing Operational Technology Specific Intrusion Detection Systems

Quality datasets serve a critical purpose in cyber security research. Data is needed to understand system behavior and develop security controls to protect critical systems. However, for critical infrastructure operational environments there is a lack of available datasets to study because of the high cost and specialized capabilities necessary to generate them. This paper documents the development of a dataset of high fidelity hardware in the loop laboratory simulated models of electric and natural gas distribution systems with real cyber attack test cases. A deep dive discussion for the experimental setup and controls for generating the data is provided along with observations from using the data in evaluating intrusion detection approaches.

Ashok, Aditya↗
DOE OSTI2022

Comparative analysis of energy deposition modes available in Serpent 2 within the framework of the supercritical water reactor - Fuel qualification test reactor physics benchmark

A joint European Canadian Chinese development of a supercritical water-cooled small modular reactor (SCW-SMR) technology is in progress since September 2020 in the framework of a Horizon 2020 project called ECC-SMART. As a main purpose of the project, proper estimates of energy deposition and its spatial distribution are prerequisites for the accurate analysis of safety related parameters of the SCW-SMR concept under development. A supercritical water reactor fuel computational benchmark model, provided by Canadian Nuclear Laboratories, was applied for detailed comparison of different energy deposition calculation options available in the Serpent 2 Monte Carlo code. The effect of energy deposition options on the normalization of the results as well as on the spatial distribution of the energy deposition are discussed. Consistent energy deposition calculation methods are presented between three Monte Carlo codes, viz., Serpent 2, MCNP6 and OpenMC. Although resource-intensive, the use of the coupled neutron-photon transport mode of Serpent 2 is recommended for accurate spatial and quantitative characterization of energy deposition in the SCW-SMR fuel assemblies, accounting for both neutron and photon heating of all the materials. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS1999

Measurement of Two-Phase Flow Characteristics Under Microgravity Conditions

This paper describes the technical approach and initial results of a test program for studying two-phase annular flow under the simulated microgravity conditions of KC-135 aircraft flights. A helical coil flow channel orientation was utilized in order to circumvent the restrictions normally associated with drop tower or aircraft flight tests with respect to two-phase flow, namely spatial restrictions preventing channel lengths of sufficient size to accurately measure pressure drops. Additionally, the helical coil geometry is of interest in itself, considering that operating in a microgravity environment vastly simplifies the two-phase flows occurring in coiled flow channels under 1-g conditions for virtually any orientation. Pressure drop measurements were made across four stainless steel coil test sections, having a range of inside tube diameters (0.95 to 1.9 cm), coil diameters (25 - 50 cm), and length-to-diameter ratios (380 - 720). High-speed video photographic flow observations were made in the transparent straight sections immediately preceding and following the coil test sections. A transparent coil of tygon tubing of 1.9 cm inside diameter was also used to obtain flow visualization information within the coil itself. Initial test data has been obtained from one set of KC-135 flight tests, along with benchmark ground tests. Preliminary results appear to indicate that accurate pressure drop data is obtainable using a helical coil geometry that may be related to straight channel flow behavior. Also, video photographic results appear to indicate that the observed slug-annular flow regime transitions agree quite reasonably with the Dukler microgravity map.

Keshock, E. G.↗
DOE OSTI2023

Design, Manufacture, and Testing of an Open-Source Benchmark Composite Hydrokinetic Turbine Blade: Preprint

In a trend toward clean energy alternatives, recent years have seen great strides in the marine energy space. Consequently, there is a pressing need for the design, development, and validation of novel energy harvesting technologies such as hydrokinetic devices, which capture kinetic energy from waves, tides, and currents. However, these devices span numerous concepts and designs that often lack solid benchmark research that can be freely referenced throughout their development. This work focuses on the design process of an open-source composite hydrokinetic turbine blade for a three-bladed marine turbine rotor assembly with a diameter of 2.5 m. The proposed blade consists of two structural composite skins that are bonded with an adhesive and filled with a foam core. This study also explores and contrasts the efficiency and resolution of low-fidelity rapid design methodologies and comprehensive high-fidelity approaches in the context of blade design, modeling, and analysis efforts, a key objective in this research. Blade hydrodynamic loads were modeled and applied to finite-element blade models to study deformations and potential failure. Ongoing and upcoming efforts will result in blade manufacture and structural testing at the National Renewable Energy Laboratory. In future work, multiple blades will be deployed at the Living Bridge site at the University of New Hampshire and will be compared to rigid aluminum blades of the same geometry, developed by Sandia National Laboratories. Ultimately, this research will lay foundational groundwork for researchers and manufacturers, establishing a baseline composite blade design that will serve as a benchmark in the development of future hydrokinetic turbine blades.

blade design↗
DOE OSTI2021

Initial Benchmarks of UV LEDs and Comparisons with White LEDs

The primary goal of this report is to benchmark the initial level of performance of a selection of commercial UV LEDs across all three bands (i.e., UV-A, UV-B, UV-C). To provide the initial performance benchmarks, a test matrix containing 13 different UV LED products was created in association with the LED Systems Reliability Consortium (LSRC). The products in this test matrix were all commercially available as of June 2021, and at least 22 samples of each product were tested. In addition, two common, commercial white LEDs were tested to provide a benchmark against blue-pumped white LEDs. Testing of the samples included electrical performance testing (e.g., current-voltage measurements) and photometric testing in a calibrated integrating sphere capable of measuring devices in the UV-A, UV-B, and UV-C bands. The electrical testing provided insights into the performance of the semiconductor layers in the LEDs, allowing parameters such as the threshold voltage (V th ) and serial resistance (R serial ) of each sample to be determined. The photometric testing provided insights into emission wavelengths, peak shapes, and radiant efficiencies for each sample. Combined, the information from these tests permits the overall device efficiencies to be compared and provides insights into the electrical and optical performance of the technology.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Benchmarking materials property prediction methods: the Matbench test set and Automatminer reference algorithm

Abstract We present a benchmark test suite and an automated machine learning procedure for evaluating supervised machine learning (ML) models for predicting properties of inorganic bulk materials. The test suite, Matbench, is a set of 13 ML tasks that range in size from 312 to 132k samples and contain data from 10 density functional theory-derived and experimental sources. Tasks include predicting optical, thermal, electronic, thermodynamic, tensile, and elastic properties given a material’s composition and/or crystal structure. The reference algorithm, Automatminer, is a highly-extensible, fully automated ML pipeline for predicting materials properties from materials primitives (such as composition and crystal structure) without user intervention or hyperparameter tuning. We test Automatminer on the Matbench test suite and compare its predictive power with state-of-the-art crystal graph neural networks and a traditional descriptor-based Random Forest model. We find Automatminer achieves the best performance on 8 of 13 tasks in the benchmark. We also show our test suite is capable of exposing predictive advantages of each algorithm—namely, that crystal graph methods appear to outperform traditional machine learning methods given ~10 4 or greater data points. We encourage evaluating materials ML algorithms on the Matbench benchmark and comparing them against the latest version of Automatminer.

36 MATERIALS SCIENCE↗
DOE OSTI2026

OptiBench: An Optimization Benchmark Tool for Renewable Energy Problems

We propose a benchmark framework and visualization tool, OptiBench, for analyzing the performance of state-of-the-art optimization solvers across a variety of optimization problems in renewable energy research. Our framework is designed from the ground up in the Julia programming language and enables analysis at scale on high performance computing (HPC) systems. Our visualization tool allows effortless evaluation of optimization solver performance, robustness, and accuracy through intuitive plots, e.g., performance profiles, heat maps, and distribution plots. We have tested three benchmark suites relevant to the modeling of renewable energy systems, viz., CUTEst, PGLib-OPF, and WaterTAP water treatment optimization problems. We illustrate benchmarking of CUTEst using OptiBench on the National Laboratory of the Rockies's (NLR) HPC Kestrel. Our findings indicate that MA57 HSL linear solver demonstrated the best overall performance for an experimental IPOPT implementation. Our work is ongoing and we intend to add support for more optimization solvers and benchmark test suites in the future.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

OptiBench: An Optimization Benchmark Tool for Renewable Energy Problems

We propose a benchmark framework and visualization tool, OptiBench, for analyzing the performance of state-of-the-art optimization solvers across a variety of optimization problems in renewable energy research. Our framework is designed from the ground up in the Julia programming language and enables analysis at scale on high performance computing (HPC) systems. Our visualization tool allows effortless evaluation of optimization solver performance, robustness, and accuracy through intuitive plots, e.g., performance profiles, heat maps, and distribution plots. We have tested three benchmark suites relevant to the modeling of renewable energy systems, viz., CUTEst, PGLib-OPF, and WaterTAP water treatment optimization problems. We illustrate benchmarking of CUTEst using OptiBench on the National Renewable Energy Laboratory's (NREL) HPC Kestrel. Our findings indicate that MA57 HSL linear solver demonstrated the best overall performance for an experimental IPOPT implementation. Our work is ongoing and we intend to add support for more optimization solvers and benchmark test suites in the future.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Benchmark Specifications for TREAT Tests M5, M6, and M7

Detailed information describing three TREAT tests performed on metallic fuels has been collected and organized for use as a benchmark in evaluating the performance of metallic fuel models and codes. The tests, designated M5, M6, and M7, subjected EBR-II-irradiated fuel pins to a single type of overpower transient (at prototypical conditions with full coolant flow and an exponential power rise on an 8 second period) in flowing sodium loops. Six fuel pins were tested; five were ternary (U-19Pu-10Zr) alloy fuel clad in D9 with burnup ranging from 0.8 to 9.8 at. %, and one was binary alloy fuel (U-10Zr) clad in HT9 with 2.9 at. % burnup. The information gathered from the test records is expected to be useful for pre-transient characterization of the irradiated fuel pins as well as the transient analysis of the metallic fuel when subjected to severe accident conditions. This report presents benchmark specifications for the M5, M6, and M7 TREAT tests, identifies where primary sources of benchmark-related information can be found, and includes background information to help a user of the data understand their applicability and limitations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Advances in benchmarking and round robin testing for PEM water electrolysis: Reference protocol and hardware

While the number of publications in the PEM water electrolysis community increases each year, no common ground concerning reference hardware (test cells and test bench) and testing protocols has been yet established. This would, however, be necessary for the comparability of experimental results. First attempts for such reference hardware and procedures have been made in the framework of the Task 30 Electrolysis within the Technology Collaboration Programme on Advanced Fuel Cells (AFC TCP) of the International Energy Agency (IEA). Since then, improvements of both the test hardware (test cell and components) as well as the measurement protocol were identified, and a revised methodology and key results based on a comprehensive measurement series have been obtained. A detailed protocol for testing commercial reference components with a reference laboratory test cell developed in-house by Fraunhofer ISE is presented. For evaluation of the protocol and the hardware, it was tested at three different institutions at the same time. Impedance spectroscopic and polarization data was acquired and analyzed. The obtained differences in performance were calculated to give the community an expectation window to compare own data to. Finally, the importance of a thorough temperature control and the conditioning phase are demonstrated.

08 HYDROGEN↗
NASA NTRSDate not supplied

Benchmark Problem Development for Testing Maturity of Intelligent Contingency Management Tools

Increasingly autonomous Advanced Air Mobility (AAM) vehicles will be required to handle diverse conditions with limited human intervention. Intelligent contingency management (iCM) approaches are under development to address how automated agents can handle unforeseen, unplanned, and unanticipated events. Benchmark scenario is needed to test the maturity of the developed iCM tools and techniques.

Jon Holbrook↗