SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Stability Analysis of Power Systems with High Penetration of State-of-the-Art Inverter Technologies

With the increasing level of inverter-based resources (IBRs) in modern power systems, this paper presents a small-signal stability analysis for power systems comprising synchronous generators (SGs) and IBRs. Four types of inverter controls are considered: two grid-following (GFL) controls, with or without grid support functions; droop-based grid-forming (GFM) controls; and virtual oscillator control-based GFM. We also analyze the impact of STATCOM and synchronous condensers on system stability to assess their role in the energy mix transition. With the small-signal dynamic behavior of the major technologies modeled, this paper provides stringent stability assessments using the IEEE 39-bus benchmark system modified to simulate future power systems. The exhaustive test cases allow for (a) assessing the impacts of different types and controls of generation and supplementary grid assets, as well as system inertia and line impedance on grid stability, and (b) elucidating pathways for the stabilization of IBR-dominated power systems. The analysis also indicates that future power systems can be stabilized with only a fraction of the total generation as voltage sources without SGs or significant system inertia if they are well distributed. This study provides insights into future power system operations with a high level of IBRs that can also be used for planning and operation studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

RELAP5-3D HTGR Validation Work at Idaho National Laboratory

Prismatic block-type high-temperature gas-cooled reactors (HTGRs) were built in the United States decades ago, and now advanced reactor vendors are seeking to deploy them again for a variety of applications. Deploying these reactors requires modelling and simulation tools that have been validated against conditions representative of the HTGR application. Idaho National Laboratory (INL) is leading the execution an of HTGR thermal hydraulics benchmark to accelerate the validation of thermal hydraulics modelling and simulation tools for these applications. That benchmark is based on a facility called the High Temperature Test Facility (HTTF). This work provides an overview of work conducted at INL over the last 2 years to validate RELAP5-3D against data from HTTF. This presentation shows results from multiple RELAP5-3D models and an HTTF experiment to assess the impact of certain modelling assumptions on results. The contents of this talk sit on the cutting edge of RELAP5-3D validation for HTGR analysis.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

A volumetric framework for quantum computer benchmarks

We propose a very large family of benchmarks for probing the performance of quantum computers. We call them volumetric benchmarks (VBs) because they generalize IBM's benchmark for measuring quantum volume \cite{Cross18}. The quantum volume benchmark defines a family of square circuits whose depth d and width w are the same. A volumetric benchmark defines a family of rectangular quantum circuits, for which d and w are uncoupled to allow the study of time/space performance trade-offs. Each VB defines a mapping from circuit shapes — ( w , d ) pairs — to test suites C ( w , d ) . A test suite is an ensemble of test circuits that share a common structure. The test suite C for a given circuit shape may be a single circuit C , a specific list of circuits { C 1 … C N } that must all be run, or a large set of possible circuits equipped with a distribution P r ( C ) . The circuits in a given VB share a structure, which is limited only by designers' creativity. We list some known benchmarks, and other circuit families, that fit into the VB framework: several families of random circuits, periodic circuits, and algorithm-inspired circuits. The last ingredient defining a benchmark is a success criterion that defines when a processor is judged to have ``passed'' a given test circuit. We discuss several options. Benchmark data can be analyzed in many ways to extract many properties, but we propose a simple, universal graphical summary of results that illustrates the Pareto frontier of the d vs w trade-off for the processor being benchmarked.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Towards an Era of Low-Temperature Integral Critical Experiments: Surrogate Testing of Low-Temperature TEX Configurations

United States and IAEA regulations for the transportation of radioactive materials require that fissile materials must be subcritical under expected ambient temperatures ranging from -40°C to 38°C. While historical experiments have been conducted at room and elevated temperatures, no criticality integral benchmarks exist for temperatures below room temperature. The Low-Temperature Thermal Epithermal eXperiments (LT-TEX) aim to provide benchmark evaluations down to -40°C. The LT-TEX design incorporates stacked HEU plates interspersed with varying thicknesses of polyethylene disks to provide varying levels of moderation, with five configurations at 20°C having already been benchmarked. A novel vacuum/cryogenic chamber was fabricated to contain the LT-TEX configurations in a thermally isolated environment and cool it to -40°C. Prior to testing with fissile materials, testing with surrogate fuel plates was performed to characterize the thermal properties of the system, ensure no condensation forms on the stack, and to test that the uranium plates would not warp, or fracture during the thermal cycling. Surrogate testing has characterized the cryogenic chamber and verified its viability to perform the benchmark experiments, allowing for the next steps in the LT-TEX experimental campaign. The results of the surrogate testing are discussed and compared to heat transfer calculations performed as part of the experiment design process, to establish confidence in the thermal behavior of the system.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2024

Modeling Enhancements, Cross-Section Generation Updates, and Benchmarking with Shift

This technical report documents the modeling enhancements, cross-section generation updates, and bench marking with the Shift Monte Carlo code performed under the US Department of Energy Nuclear Energy Advanced Modeling and Simulation Program in FY 2024. The work performed included several modeling enhancements, such as integration of cross-section generation in Titan and the ability to produce microscopic multigroup cross sections with Shift. Benchmarking of the cross sections produced by Shift and the two-step workflow with Griffin was performed for three problems: the Advanced Breeder Test Reactor, a generic pebble bed reactor, and a TRISO heat pipe microreactor. Comparisons of results from these benchmark problems were done with Serpent, OpenMC, and Griffin. These enhancements provide a robust foundation for applying Shift for both reference and two-step neutronics analysis for advanced reactor simulation.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

The McDonald Accelerating Stars Survey (MASS): White Dwarf Companions Accelerating the Sun-like Stars 12 Psc and HD 159062

We present the discovery of a white dwarf companion to the G1 V star 12 Psc found as part of a Keck adaptive optics imaging survey of long-term accelerating stars from the McDonald Observatory Planet Search Program. Twenty years of precise radial-velocity monitoring of 12 Psc with the Tull Spectrograph at the Harlan J. Smith telescope reveals a moderate radial acceleration (≈10 m s{sup −1} yr {sup −1}), which together with relative astrometry from Keck/NIRC2 and the astrometric acceleration between Hipparcos and Gaia DR2 yields a dynamical mass of M {sub B} = 0.605{sub −0.022}{sup +0.021} M {sub ⊙} for 12 Psc B, a semimajor axis of 40{sub −4}{sup +2} au, and an eccentricity of 0.84 ± 0.08. We also report an updated orbital fit of the white dwarf companion to the metal-poor (but barium-rich) G9 V dwarf HD 159062 based on new radial-velocity observations from the High-Resolution Spectrograph at the Hobby–Eberly Telescope and astrometry from Keck/NIRC2. A joint fit of the available relative astrometry, radial velocities, and tangential astrometric acceleration yields a dynamical mass of M {sub B} = 0.609{sub −0.011}{sup +0.010} M {sub ⊙} for HD 159062 B, a semimajor axis of 60{sub −7}{sup +5} au, and preference for circular orbits (e < 0.42 at 95% confidence). 12 Psc B and HD 159062 B join a small list of resolved Sirius-like benchmark white dwarfs with precise dynamical mass measurements which serve as valuable tests of white dwarf mass–radius cooling models and probes of AGB wind accretion onto their main-sequence companions.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

Compaction of crushed salt for safe containment – overview of the KOMPASS project

Abstract. In Germany, rock salt formations are possible host rock candidates for a repository for heat-emitting radioactive waste. The safety concept of a repository in salt bases on a multibarrier system consisting mainly of the geological barrier salt and geotechnical seals ensuring safe containment. Crushed salt will be used for backfilling of cavities and sealing measures in drifts and shafts due to its favourable properties and its easy availability (mined-off material). The creep of the rock salt leads to crushed salt compaction with time. Thereby, the crushed salts' porosity is reduced from the initial porosity of 30 %–40 % to a value comparable to the porosity of undisturbed rock salt (≤1 %). In such low porosity ranges, technical impermeability is assumed. The compaction behaviour of crushed salt is rather complex and involves several coupled THM processes (Kröhn et al., 2017; Hansen et al., 2014). It is influenced by internal properties like humidity and grain size distribution, as well as boundary conditions such as temperature, compaction rate or stress state. However, the current process understanding has some important gaps referring to the material behaviour, experimental database and numerical modelling. It needs to be extended and validated, especially in the low porosity range. The objective of the KOMPASS project was development of methods and strategies for the reduction of deficits in the prediction of crushed salt compaction leading to an improvement of the prognosis quality. Key results are as follows (KOMPASS Phase 1, 2020): selection of an easily available and permanently producible synthetic crushed salt mixture, acting as a reference material for generic investigations; development and proof of different techniques for producing pre-compacted samples for further investigations; establishment of a tool of microstructure investigation methods to demonstrate the comparability of grain structures of pre-compacted samples with in-situ compacted material for future investigations; execution of various laboratory experiments using pre-compacted samples, e.g. long-term creep tests which deliver reliable information about time- and stress-dependent compaction behaviour; development of a complex experimental investigation strategy to derive necessary model parameters considering individual functional dependencies. Its technical feasibility was successfully verified; benchmarking with various existing numerical models using datasets from three different triaxial long-term tests. The result was not entirely satisfactory; however, the number of influencing factors is small and further validation work has to be done. Overall, the KOMPASS project has made significant progress in the approaches to solving the outstanding question, building the basis for further investigations.

Friedenberg, Larissa↗

DOE OSTI2026

How efficiently can AI recognize Wireless Devices?

This poster presents a hardware benchmarking methodology for a 3-layer CNN waveform classifier deployed using ONNX Runtime on an NVIDIA Jetson AGX Orin. The dataset consist of 9 signal types, -30 to +30 dB SNR with 5dB increments. Benchmarking on the Jetson AGX Orin gave an accuracy of 91.9% and GPU throughput of 107,120 predictions/sec (23× faster than CPU). The Jetson GPU reached approximately 27M samples/sec with stable performance but fell below the 40 MHz rate needed for real-time radio feeds. Sustained testing of 5 minutes confirmed stable performance with no memory leaks, establishing a reproducible benchmarking baseline for future edge-deployment optimization.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

Hardware Demonstration of Weak Grid Oscillations in Grid-Following Converters

The increasing penetration of inverter-based resources (IBRs) introduces some unexpected dynamic issues, including low-frequency oscillations. In this paper, a laboratory-scale grid-following voltage-source converter (VSC) system is implemented to demonstrate weak grid oscillations. Grid-following control is applied in VSC to provide active power, reactive power or ac voltage control. The test bed is also replicated in electromagnetic transient (EMT) simulation environment (MAT-LAB/SimPowerSystems) for benchmark purpose. Case studies are carried out to demonstrate low-frequency oscillations under real power/ac voltage or real power/reactive power control. The excellent agreement between the simulation and experimental results ensures that the two test beds are exchangeable and can be used for testing oscillation mitigation strategies in future research.

Bao, Li↗

DOE OSTI2025

Characterization of Heat Transfer in a Trapped-Vortex Combustor Designed for High-Temperature Material Testing

Next generation gas turbines will reduce carbon emissions by improving their cycle efficiencies and implementing hydrogen as a low-carbon fuel. The combined-cycle efficiency can be improved by increasing the combustor outlet temperature and decreasing the cooling air required for hot-section parts. Ultra-high temperature ceramic matrix composites (CMC) can survive increasingly extreme environments due to their strong mechanical properties at expected conditions. The introduction of CMCs in high-hydrogen flame environments requires testing at realistic conditions that mimic the thermochemical and fluid mechanic states in gas-turbine combustors. In this work, we describe a new experiment that has been designed to test high-temperature materials in a combustor-relevant environment. Its trapped-vortex combustor chamber design allows for high levels of fuel flexibility and wide flame stability limits. Testing of monolithic silicon carbide (SiC) samples in this environment was done to characterize the heat transfer to material samples over a wide range of operating conditions, including variations in fuel composition and thermal power. Heat flux measurements were verified in non-reacting and reacting environments after which they were benchmarked with previous literature to verify the operation of the facility with heated air. Testing in combustor-relevant conditions shows high levels of heat flux to the material samples in the combustor, particularly downstream of the anchored flame.

Richins, Porter [Pennsylvania State University , ,↗

DOE OSTI2021

An Open Combinatorial Diffraction Dataset Including Consensus Human and Machine Learning Labels with Quantified Uncertainty for Training New Machine Learning Models

Modern machine learning and autonomous experimentation schemes in materials science rely on accurate analysis of the data ingested by these models. Unfortunately, accurate analysis of the underlying data can be difficult, even for domain experts, complicating the training of the models intended to drive experiments. This is especially true when the goal is to identify the presence of weak signatures in diffraction or spectroscopic datasets. In this work, we examine a set of as-obtained diffraction data that track the phase transition from monoclinic to tetragonal in a Nb-doped VO2 film as a function of temperature and dopant concentration. We then task a set of domain experts and a set of machine learning experts with identifying which phase is present in each diffraction pattern manually and algorithmically, respectively; in both cases, the labels can vary dramatically, especially at the phase boundaries. We use the mode of the labels and the Shannon entropy as a method to capture, preserve and propagate consensus labels and their variance. Further we use the expert labels as a benchmark and demonstrate the use of Shannon entropy weighted scoring to test the performance of machine learning generated labels. Finally, we propose a material data challenge centered around generating improved labeling algorithms. This real-world dataset curated with expert labels can act as test bed for new algorithms. The raw data, annotations and code used in this study are all available online at data.gov and the interested reader is encouraged to replicate and improve the existing models

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustness

In this article, full waveform inversion (FWI) infers the subsurface structure information from seismic waveform data by solving a non-convex optimization problem. Data-driven FWI has been increasingly studied with various neural network architectures to improve accuracy and computational efficiency. Nevertheless, the applicability of pre-trained neural networks is severely restricted by potential discrepancies between the source function used in the field survey and the one utilized during training. Here, we develop a Fourier-enhanced deep operator network (Fourier-DeepONet) for FWI with the generalization of seismic sources, including the frequencies and locations of sources. Specifically, we employ the Fourier neural operator as the decoder of DeepONet, and we utilize source parameters as one input of Fourier-DeepONet, facilitating the resolution of FWI with variable sources. To test Fourier-DeepONet, we develop three new and realistic FWI benchmark datasets (FWI-F, FWI-L, and FWI-FL) with varying source frequencies, locations, or both. Our experiments demonstrate that compared with existing data-driven FWI methods, Fourier-DeepONet obtains more accurate predictions of subsurface structures in a wide range of source parameters. Moreover, the proposed Fourier-DeepONet exhibits superior robustness when handling data with Gaussian noise or missing traces and sources with Gaussian noise, paving the way for more reliable and accurate subsurface imaging across diverse real conditions.

42 ENGINEERING↗

DOE OSTI2020

A Privacy Preserving Model-Free Optimization and Control Framework for Demand Response from Residential Thermal Loads

We consider the problem of optimizing the cost of procuring electricity for a large collection of homes managed by a load serving entity, by pre-cooling or pre-heating the thermal inertial loads in the homes to avoid procuring power during periods of peak electricity pricing. We would like to accomplish this objective in a completely privacy-preserving and model-free manner, that is, without direct access to the state variables (temperatures or power consumption) or the dynamical models (thermal characteristics) of individual homes, while guaranteeing personal comfort constraints of the consumers. We propose a two-stage optimization and control framework to address this problem. In the first stage, we use a long short-term memory (LSTM) network to predict hourly electricity prices, based on historical pricing data and weather forecasts. Given the hourly price forecast and thermal models of the homes, the problem of designing an optimal power consumption trajectory that minimizes the total electricity procurement cost for the collection of thermal loads can be formulated as a large-scale integer program (with millions of variables) due to the on-off cyclical dynamics of such loads. We provide a simple heuristic relaxation to make this large-scale optimization problem model-free and computationally tractable. In the second stage, we translate the results of this optimization problem into distributed open-loop control laws that can be implemented at individual homes without measuring or estimating their state variables, while simultaneously ensuring consumer comfort constraints. We demonstrate the performance of this approach on a large-scale test case comprising of 500 homes in the Houston area and benchmark its performance against a direct model-based optimization and control solution.

Sivaranjani, S.↗

DOE OSTI2022

Qualification of ANSI/HPS N13.1-2011 Mixing Criteria by Computational Fluid Dynamics Modeling for the 3430 Building Fan Addition and Increased Ventilation Capacity

Additional ventilation capacity has been designed for the 3430 Building filtered exhaust stack system. The updated system will increase the number of fans from two to three and include new ductwork with a larger diameter to integrate the new fan into the existing stack. Stack operations will involve running various fan combinations at any given time. The air monitoring system of the existing two-fan stack previously was found to comply with the American National Standards Institute/Health Physics Society (ANSI/HPS) N13.1-1999 standard. Full-scale, three-dimensional computational fluid dynamics (CFD) modeling was used to evaluate the modified three-fan system for compliance with the ANSI/HPS N13.1-2011 standard, which essentially is equivalent to the ANSI/HPS N13.1-1999 standard. The four mixing criteria evaluated are 1) flow angle, 2) velocity, 3) gas tracer, and 4) particle tracer. Benchmarking of the CFD modeling methodology showed good agreement with previous testing used to qualify the stack, and modeling of the existing two-fan system showed good agreement with test data collected from the 3430 Building stack. Modeling was performed to develop a suitable three-fan design. Initial modeling of the three-fan design and basic ductwork showed that flow angles and velocity uniformity were acceptable; however, the gas tracer and particle tracer mixing results were not acceptable. To meet ANSI/HPS N13.1-2011 criteria, an air blender was added to the stack design.

42 ENGINEERING↗

DOE OSTI2022

Qualification of ANSI/HPS N13.1-2011 Mixing Criteria by Computational Fluid Dynamics Modeling for the 3430 Building Fan Addition and Increased Ventilation Capacity

42 ENGINEERING↗

DOE OSTI2022

Voronoi Meshing to Accurately Capture Geological Structure in Subsurface Simulations

Mesh generation lies at the interface of geological modeling and reservoir simulation. Highly skewed or very small grid cells may be necessary to accurately capture the geometry of geological features, but the resulting poorly scaled or small grid cells can have a substantial negative impact on simulator accuracy and speed. One way to minimize numerical errors caused by gridding complex structures is to simulate on high-quality Voronoi meshes, which reduce grid orientation effects in fluid flow. This work presents a complete methodology to create Voronoi simulation grids, model fluid flow in complex geological systems, and visualize the results. A recently developed Voronoi meshing method that can automatically generate provably good unstructured meshes that conform to input surfaces creating closed volumes is used. Initially an analytical benchmark simulation is presented to validate the quality of the meshes and simulation results and demonstrate the superiority of simulation results using Voronoi meshes over flexed-hexahedral meshes on a domain with internal features. Next, meshes are created for test structures representing four of the most common geological features in the subsurface: layering, pinch-out, an interior lens that tapers to zero thickness on all sides and a fault with offset. Two benchmark flow simulations are run for each test structure. Finally, a realistic geological example for CO 2 injection into an anticline is simulated. Three realizations of the Voronoi mesh at the same resolution are generated for the simulations. Each mesh is highly refined near the injection wells and coarse in areas of less interest. These three meshes are used to model the CO 2 plume in the subsurface as it migrates to the top of the structure and then fills downward. Simulations on the meshes with randomly generated elements inside the input volumes each give slightly different fingering patterns for the viscous-unstable buoyant gas flow. The results presented in this work show a promising step towards utilizing fully automated Voronoi meshing for subsurface flow simulations in complex geology.

58 GEOSCIENCES↗

DOE OSTI2021

A Step Towards the Final Frontier: Lessons Learned from Acceptance Testing of the First HPE/Cray EX 3000 System at ORNL

In this paper, we summarize the deployment of the Air Force Weather (AFW) HPC11 system at Oak Ridge National Laboratory (ORNL) including the process followed to successfully complete acceptance testing of the system. HPC11 is the first HPE/Cray EX 3000 system that has been successfully released to its user community in a federal facility. HPC11 consists of two identical 800-node supercomputers, Fawbush and Miller, with access to two independent and identical Lustre parallel file systems. HPC11 is equipped with Slingshot 10 interconnect technology and relies on the HPE Performance Cluster Manager (HPCM) software for system configuration. ORNL has a clearly defined acceptance testing process used to ensure that every new system deployed can provide the necessary capabilities to support user workloads. We worked closely with HPE and AFW to develop a set of tests that used the United Kingdom’s Meteorological Office’s Unified Model (UM) and 4DVAR. We also included benchmarks and applications from the Oak Ridge Leadership Computing Facility (OLCF) portfolio to fully exercise the HPE/Cray programming environment and evaluate the functionality and performance of the system. Acceptance testing of HPC11 required parallel execution of each element on Fawbush and Miller. In addition, careful coordination was needed to ensure successful acceptance of the newly deployed Lustre file systems alongside the compute resources. In this work, we present test results from specific system components and provide an overview of the issues identified, challenges encountered, and the lessons learned along the way.

Melesse Vergara, Veronica↗

DOE OSTI2026

Viscous Gubser flow with conserved charges to benchmark fluid simulations

We present semi-analytical solutions for the evolution of both the temperature and chemical potentials for viscous Gubser flow with conserved charges. Such a solution can be especially useful in testing numerical codes intended to simulate relativistic fluids with large chemical potentials. The freeze-out hypersurface profiles for constant energy density are calculated, along with the corresponding normal vectors, and presented as a new unit test for numerical codes. We also compare the influence of the equation of state on the semi-analytical solutions. We benchmark the newly developed smoothed particle hydrodynamics code ccake that includes both shear viscosity and three conserved charges. Here, the numerical solutions are in excellent agreement with the semi-analytical solution and are also able to accurately reproduce the hypersurface at freeze-out.

Hydrodynamic models↗