Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

NISQ Benchmarking

Test suite of quantum algorithms for Noisy Intermediate Scale Quantum (NISQ) computers. The test suite includes benchmark-style code for quantum volume circuits (QV), fairness sampling circuits, quantum telecloning circuits, and other NISQ benchmark style algorithms on small problems (i.e., up to 100 qubits), such as Variational Quantum Eigensolver (VQE), Hamiltonian Simulation, and Grover unstructured search example circuits. These benchmark-style applications are implemented in quantum software packages, mostly IBM's QISKIT, but may include vendor-specific frameworks, such as PyQuil (for Rigetti) or Q\# for Microsoft, or CirQ (for Google) as the test suite grows with the vendor sample. The test suite also includes numerical simulation code for Quantum Alternating Operator Ansatz (QAOA) algorithms, VQE, Hamiltonian Simulation and search examples. Numerical simulation code simulates quantum computers on classical computers, which is only possible for small problem instances; the implementation framework of choice is typically within Python, using the numpy/scipy libraries as well as extensions to the Julia language.

Pelofske, Elijah↗

Structural Benchmark Creep Testing for the Advanced Stirling Convertor Heater Head

The National Aeronautics and Space Administration (NASA) has identified the high efficiency Advanced Stirling Radioisotope Generator (ASRG) as a candidate power source for use on long duration Science missions such as lunar applications, Mars rovers, and deep space missions. For the inherent long life times required, a structurally significant design limit for the heater head component of the ASRG Advanced Stirling Convertor (ASC) is creep deformation induced at low stress levels and high temperatures. Demonstrating proof of adequate margins on creep deformation and rupture for the operating conditions and the MarM-247 material of construction is a challenge that the NASA Glenn Research Center is addressing. The combined analytical and experimental program ensures integrity and high reliability of the heater head for its 17-year design life. The life assessment approach starts with an extensive series of uniaxial creep tests on thin MarM-247 specimens that comprise the same chemistry, microstructure, and heat treatment processing as the heater head itself. This effort addresses a scarcity of openly available creep properties for the material as well as for the virtual absence of understanding of the effect on creep properties due to very thin walls, fine grains, low stress levels, and high-temperature fabrication steps. The approach continues with a considerable analytical effort, both deterministically to evaluate the median creep life using nonlinear finite element analysis, and probabilistically to calculate the heater head s reliability to a higher degree. Finally, the approach includes a substantial structural benchmark creep testing activity to calibrate and validate the analytical work. This last element provides high fidelity testing of prototypical heater head test articles; the testing includes the relevant material issues and the essential multiaxial stress state, and applies prototypical and accelerated temperature profiles for timely results in a highly controlled laboratory environment. This paper focuses on the last element and presents a preliminary methodology for creep rate prediction, the experimental methods, test challenges, and results from benchmark testing of a trial MarM-247 heater head test article. The results compare favorably with the analytical strain predictions. A description of other test findings is provided, and recommendations for future test procedures are suggested. The manuscript concludes with describing the potential impact of the heater head creep life assessment and benchmark testing effort on the ASC program.

Krause, David L.↗

Benchmark Calibration Tests Completed for Stirling Convertor Heater Head Life Assessment

A major phase of benchmark testing has been completed at the NASA Glenn Research Center (http://www.nasa.gov/glenn/), where a critical component of the Stirling Radioisotope Generator (SRG) is undergoing extensive experimentation to aid the development of an analytical life-prediction methodology. Two special-purpose test rigs subjected SRG heater-head pressure-vessel test articles to accelerated creep conditions, using the standard design temperatures to stay within the wall material s operating creep-response regime, but increasing wall stresses up to 7 times over the design point. This resulted in well-controlled "ballooning" of the heater-head hot end. The test plan was developed to provide critical input to analytical parameters in a reasonable period of time.

Krause, David L.↗

SABATH: Surrogate AI Benchmarking Applications' Testing Harness

SABATH provides benchmarking infrastructure for evaluating scientific ML/AI models. It contains support for scientific machine learning surrogates from external repositories. The software dependences are explicitly exposed in the surrogate model definition, which allows the use of advanced optimization, communication, and hardware features.

Luszczek, Piotr [Univ. of Tennessee, Knoxville, TN↗

Online Optimization for Networked Distributed Energy Resources With Time-Coupling Constraints

This paper proposes a Lyapunov optimization-based online distributed (LOOD) algorithmic framework for active distribution networks (ADNs) with numerous photovoltaic inverters and inverter air conditionings (IACs). In the proposed scheme, ADNs can track an active power setpoint reference at the substation in response to transmission-level requests while concurrently minimizing the social utility loss and ensuring the security of voltages. Conventional distributed optimization methods are rarely feasible to track the optimal solutions in fast variable environments using a fine-grained sampling interval where the underlying optimization problem evolves with the iterations of the algorithms. In contrast, based on the framework of online convex optimization (OCO), the developed approach uses a distributed algebraic update to compute the next round decisions relying on the current feedback of measurements. Notably, the time-coupling constraints of IACs are decoupled for online implementation with Lyapunov optimization technique. An incentive scheme is tailored to coordinate the customer-owned assets in lieu of the direct control from network operators. Optimality and convergency are characterized analytically. Finally, we corroborate the proposed method on a modified version of 33-node test feeder. Benchmark tests show that the proposed method is computationally and economically efficient, and outperforming existing algorithms.

active distribution networks↗

Development of a CFD Code for Analysis of Fluid Dynamic Forces in Seals

The aim is to develop a 3-D computational fluid dynamics (CFD) code for the analysis of fluid flow in cylindrical seals and evaluation of the dynamic forces on the seals. This code is expected to serve as a scientific tool for detailed flow analysis as well as a check for the accuracy of the 2D industrial codes. The features necessary in the CFD code are outlined. The initial focus was to develop or modify and implement new techniques and physical models. These include collocated grid formulation, rotating coordinate frames and moving grid formulation. Other advanced numerical techniques include higher order spatial and temporal differencing and an efficient linear equation solver. These techniques were implemented in a 2D flow solver for initial testing. Several benchmark test cases were computed using the 2D code, and the results of these were compared to analytical solutions or experimental data to check the accuracy. Tests presented here include planar wedge flow, flow due to an enclosed rotor, and flow in a 2D seal with a whirling rotor. Comparisons between numerical and experimental results for an annular seal and a 7-cavity labyrinth seal are also included.

Athavale, Mahesh M.↗

Numerical Study of Magnetic Damping During Unidirectional Solidification

A fully 3-D numerical model is developed to represent magnetic damping of complex fluid flow, heat transfer and electromagnetic field distributions in a melt cavity. The model is developed based on our in-house finite element code for the fluid flow, heat transfer and electromagnetic field calculations. The computer code has been tested against benchmark test problems that are solved by other commercial codes as well as analytical solutions whenever available. The numerical model is tested against numerical and experimental results for water reported in literature. With the model so tested, various numerical simulations are carried out for the Sn-35.5% Pb melt convection and temperature distribution in a cylindrical cavity with and without the presence of a transverse magnetic field. Numerical results show that magnetic damping can be effectively applied to reduce turbulence and flow levels in the melt undergoing solidification and over a certain threshold value a higher magnetic field resulted in a higher velocity reduction. It is found also that for a fully 3-D representation of the magnetic damping effects, the electric field induced in the melt by the applied DC magnetic field does not vanish, as some researchers suggested, and must be included even for molten metal and semiconductors. Also, for the study of the melt flow instability, a long enough time has to be applied to ensure the final fluid flow recirculation pattern. Moreover, our numerical results suggested that there seems to exist a threshold value of applied magnetic field, above which magnetic damping becomes possible and below which the convection in the melt is actually enhanced. Because of the limited financial resource allocated for the project, we are unable to carry out extensive study on this effect, which should warrant further theoretical and experimental study. In that endeavor, the developed numerical model should be very useful; and the model should serve as a useful tool for exploring necessary design parameters for planning magnetic damping experiments and interpreting the experimental results.

Li, Ben Q.↗

Advanced Stirling Convertor Heater Head Durability and Reliability Quantification

The National Aeronautics and Space Administration (NASA) has identified the high efficiency Advanced Stirling Radioisotope Generator (ASRG) as a candidate power source for long duration Science missions, such as lunar applications, Mars rovers, and deep space missions, that require reliable design lifetimes of up to 17 years. Resistance to creep deformation of the MarM-247 heater head (HH), a structurally critical component of the ASRG Advanced Stirling Convertor (ASC), under high temperatures (up to 850 C) is a key design driver for durability. Inherent uncertainties in the creep behavior of the thin-walled HH and the variations in the wall thickness, control temperature, and working gas pressure need to be accounted for in the life and reliability prediction. Due to the availability of very limited test data, assuring life and reliability of the HH is a challenging task. The NASA Glenn Research Center (GRC) has adopted an integrated approach combining available uniaxial MarM-247 material behavior testing, HH benchmark testing and advanced analysis in order to demonstrate the integrity, life and reliability of the HH under expected mission conditions. The proposed paper describes analytical aspects of the deterministic and probabilistic approaches and results. The deterministic approach involves development of the creep constitutive model for the MarM-247 (akin to the Oak Ridge National Laboratory master curve model used previously for Inconel 718 (Special Metals Corporation)) and nonlinear finite element analysis to predict the mean life. The probabilistic approach includes evaluation of the effect of design variable uncertainties in material creep behavior, geometry and operating conditions on life and reliability for the expected life. The sensitivity of the uncertainties in the design variables on the HH reliability is also quantified, and guidelines to improve reliability are discussed.

Krause, David L.↗

NEA HTTR LOFC Project Test#2 Benchmark Results

The High Temperature Engineering Test Reactor (HTTR) is a 30 MW prismatic high-temperature gas-cooled reactor (HTGR) owned and operated by the Japan Atomic Energy Agency (JAEA). Staring in 2010, HTTR was used in a series of three loss of forced cooling (LOFC) tests without SCRAM to demonstrate the inherent safety of HTGRs.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Noiseless Vlasov–Poisson simulations with linearly transformed particles

We introduce a deterministic discrete-particle simulation approach, the Linearly-Transformed Particle-In-Cell (LTPIC) method, that employs linear deformations of the particles to reduce the noise traditionally associated with particle schemes. Formally, transforming the particles is justified by local first order expansions of the characteristic flow in phase space. In practice the method amounts of using deformation matrices within the particle shape functions; these matrices are updated via local evaluations of the forward numerical flow. Because it is necessary to periodically remap the particles on a regular grid to avoid excessively deforming their shapes, the method can be seen as a development of Denavit's Forward Semi-Lagrangian (FSL) scheme (Denavit, 1972 [8]). However, it has recently been established (Campos Pinto, 2012 [20]) that the underlying Linearly-Transformed Particle scheme converges for abstract transport problems, with no need to remap the particles; deforming the particles can thus be seen as a way to significantly lower the remapping frequency needed in the FSL schemes, and hence the associated numerical diffusion. To couple the method with electrostatic field solvers, two specific charge deposition schemes are examined, and their performance compared with that of the standard deposition method. Finally, numerical 1d1v simulations involving benchmark test cases and halo formation in an initially mismatched thermal sheet beam demonstrate some advantages of our LTPIC scheme over the classical PIC and FSL methods. Benchmarked test cases also indicate that, for numerical choices involving similar computational effort, the LTPIC method is capable of accuracy comparable to or exceeding that of state-of-the-art, high-resolution Vlasov schemes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Space Networking Implementation for Lunar Operations

The High-Rate Delay Tolerant Networking (HDTN) project at NASA has developed a performance optimized and open-source Delay Tolerant Networking (DTN) implementation. The primary goal is to create a scalable networking solution to increase the scientific data return rate of space missions. To reach this goal, HDTN must span multiple edge cases in space networking by including tools and configurations to accommodate a wide range of space systems. Typically, HDTN evaluations are conducted on a laboratory emulation test bed, made up of hardware accelerated x86 based systems capable of data rates over 10 Gbps. HDTN must have an effective implementation process on a wide range of systems to increase the sustainability of the design. One important implementation option is with low-level embedded systems which could be used on small robotic missions. This paper details the implementation process, benchmark testing, and performance results of HDTN in multiple configurations on Raspberry Pi 4 devices. By implementing HDTN on a Raspberry Pi 4, a process for building HDTN onto ARM processors was developed and utilized to conduct benchmark tests in multiple network configurations, achieving a data rate performance exceeding 600 Mbps. Based on these results, HDTN proved to run on small ARM based systems with slight modifications to the build procedure. These results were then extended to evaluating an implementation of the HDTN software parsed across several Raspberry Pi 4 nodes. To test this capability, HDTN was configured in a simplified cut-through setup and distributed among multiple Raspberry Pi 4 processors. This distributed architecture was benchmark tested in a similar fashion to the testing of a singular HDTN implementation. The results from the benchmark testing are used to examine how these implementation options and capabilities can expand the use cases for DTN, and particularly with small robotic missions.

Space Networking↗

RIA simulation tests using driver tube for ATF cladding

Pellet-cladding mechanical interaction (PCMI) is a potential failure mechanism for accident-tolerant fuel (ATF) cladding candidates during a reactivity-initiated accident (RIA). This report summarizes Fiscal Year (FY) 2017 research activities that were undertaken to evaluate the PCMI-like hoop-strain-driven mechanical response of ATF cladding candidates. To achieve various RIA-like conditions, a modified-burst test (MBT) device was developed to produce different mechanical pulses. The calibration of the MBT instrument was accomplished by performing mechanical tests on unirradiated Generation-I iron-chromium-aluminum (FeCrAl) alloy samples. Shakedown tests were also conducted in both FY 2016 and FY 2017 using unirradiated hydrided ZIRLO™ tube samples. This milestone report focuses on testing of ATF materials, but the benchmark tests with hydrided ZIRLO™ tube samples are documented in a recent journal article.a For the calibration and benchmark tests, the hoop strain was monitored using strain gauges attached to the sample surface in the hoop direction. A novel digital image correlation (DIC) system composed of a single high-speed camera and an array of six mirrors was developed for the MBT instrument to better resolve the failure behavior of samples and to provide useful data for validation of high-fidelity modeling and simulation tools. The DIC system enable a 360° view of a sample’s outer surface. This feature was added to the instrument to determine the precise failure location on a sample’s surface for strain predictions. The DIC system was tested on several silicon carbide fiber/silicon carbide matrix (SiC/SiC) composite tube samples at various pressurization rates of the driver tube (which correspond to the strain rates for the samples). The hoop strains for various loading conditions were determined for the SiC/SiC composite tube samples. Future work is planned to enhance understanding of the failure behavior of the ATF cladding candidates of age-hardened FeCrAl alloys and SiC/SiC composites in detail during RIA conditions informed by the computational studies performed under the US Department of Energy Office of Nuclear Energy Advanced Fuels Campaign. The testing instrument and the new DIC system will be further developed to reach different stress-state conditions and to perform tests at elevated temperatures.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Use of Apollo 17 Epoch Neutron Spectrum as a Benchmark in Testing LEND Collimated Sensor

The Apollo 17 neutron experiment LPNE provided a unique set of data on production of neutrons in the Lunar soil bombarded by Galactic Cosmic Rays (GCR). It serves as valuable "ground-truth" in the age of orbital remote sensing. We used the neutron data attributed to Apollo 17 epoch as a benchmark for testing the LEND's collimated sensor, as introduced by the geometry of collimator and efficiency of He3 counters. The latter is defined by the size of gas counter and pressure inside it. The intensity and energy spectrum of neutrons escaping the lunar surface are dependent on incident flux of Galactic Cosmic Rays (GCR) whose variability is associated with Solar Cycle and its peculiarities. We obtain first the share of neutrons entering through the field of view of collimator as a fraction of the total neutron flux by using the angular distribution of neutron exiting the Moon described by our Monte Carlo code. We computed next the count rate of the 3He sensor by using the neutron energy spectrum from McKinney et al. [JGR, 2006] and by consider geometry and gas pressure of the LEND sensor. Finally the neutron count rate obtained for the Apollo 17 epoch characterized by intermediate solar activity was adjusted to the LRO epoch characterized by low solar activity. It has been done by taking into account solar modulation potential, which affects the GCR flux, and in turn changes the neutron albedo flux.

Chin, Gordon↗

Identification of fuel cycle simulator functionalities for analysis of transition to a new fuel cycle

Dynamic fuel cycle simulation tools are intended to model holistic transient nuclear fuel cycle scenarios. As with all simulation tools, fuel cycle simulators require verification through unit tests, benchmark cases, and integral tests. Model validation is a vital aspect as well. Although compara-tive studies have been performed, there is no comprehensive unit test and benchmark library for fuel cycle simulator tools. The objective of this paper is to identify the must test functionalities of a fuel cycle simulator tool within the context of specific problems of interest to the Fuel Cycle Options Campaign within the U.S. Department of Energy s Office of Nuclear Energy. The approach in this paper identifies the features needed to cover the range of promising fuel cycle options identified in the DOE-NE Fuel Cycle Evaluation and Screening (E&S) and categorizes these features to facilitate prioritization. Features were categorized as essential functions, integrating features, and exemplary capabilities. One objective of this paper is to propose a library of unit tests applicable to each of the essential functions. Another underlying motivation for this paper is to encourage an international dialog on the functionalities and standard test methods for fuel cycle simulator tools.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

MPACT Testing and Benchmarking Results

This document provides detailed reactivity and fission rate distribution results for MPACT for the Core Physics Benchmark Progression Problems 1-5, including comparisons to initial startup data from Watts Bar Nuclear Unit 1. Also included are computer requirements and runtimes for each type of problem and feedback for issues encountered during the testing. Testing for the benchmark problems that do not require thermal-hydraulic feedback has been very successful. Testing for the coupled problems (6 and 7) is still ongoing and will be documented in a future revision or separate document. A few issues have been identified needing more research/investigation before all of these problems have ideal solutions. These items are included in the Section 8 near the end of this document. MPACT has successfully solved all of the zero power core physics progression problems. The computer resources required and runtimes were all acceptable, though faster cases would be preferable considering there was no thermal-hydraulic feedback. MPACT converged very reliably for all 3D problems, expect in a few isolated studies where very thin axial planes were purposely created to attempt to quantify the errors in the control rod tip homogenization model. Despite the issues listed in Section 8, the accuracy of MPACT compared to the reference solution is considered to be very good.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

NEA HTTR LOFC Project Test#3 Benchmark Results

In the second half of FY23, the High Temperature Engineering Test Reactor (HTTR) Loss Of Forced Cooling (LOFC)#3 data for the 9 MW test case with Vessel Cooling System (VCS) off were made available through the Nuclear Energy Agency (NEA) LOFC project framework; the neutronic model developed for the initial test (LOFC#1) achieved a satisfactory level of maturity, demonstrating its accuracy in predicting power evolution and core re-criticality, but LOFC#3 should be used primarily to investigate thermal hydraulic phenomena, as the reactor was shut down prematurely due to overheating in the upper reactor components, which prevented re-criticality; this report focuses on advancing the HTTR thermal hydraulic model to accurately simulate the LOFC#3 scenario, including simulating the LOFC#3 benchmark and generating the corresponding benchmark specifications, aiming to ensure consistency across participant models and provide essential data for future participants, including private industry stakeholders seeking to validate their computational tools.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluating Space Object Conjunction Probabilities Using Characteristic Function Inversion

This report discusses an approach to computing the probability of a conjunction between two space objects in the short-term encounter scenario. A conjunction is defined here as an event where the miss distance between the objects is less than some specified value. The scenario assumptions are that the motion of the objects is linear, their positions are Gaussian distributed, and their velocities are known and constant. Under these assumptions, the squared-miss distance is shown to have the generalized chi-square distribution. An established statistical technique called characteristic function inversion is employed to evaluate the distribution and obtain conjunction probabilities. The method is closely related to a recent approach based on moment generating function inversion, and a qualitative comparison of the approaches is provided. Last, the method is tested on several benchmark test cases where it agrees with numerical integration on the cases with conjunction probabilities above 10 –12 . However, the exact probability in these cases is usually not needed and this probability can be bounded above using an independent Gaussian approximation. Overall, the report shows how to compute conjunction probabilities using a standard statistical method, though numerical integration seems to perform equally well.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Ada compiler evaluation on the Space Station Freedom Software Support Environment project

This paper describes the work in progress to select the Ada compilers for the Space Station Freedom Program (SSFP) Software Support Environment (SSE) project. The purpose of the SSE Ada compiler evaluation team is to establish the criteria, test suites, and benchmarks to be used for evaluating Ada compilers for the mainframes, workstations, and the realtime target for flight- and ground-based computers. The combined efforts and cooperation of the customer, subcontractors, vendors, academia and SIGAda groups made it possible to acquire the necessary background information, benchmarks, test suites, and criteria used.

Badal, D. L.↗