Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Preliminary Computational Analysis of the (HIRENASD) Configuration in Preparation for the Aeroelastic Prediction Workshop

This paper presents preliminary computational aeroelastic analysis results generated in preparation for the first Aeroelastic Prediction Workshop (AePW). These results were produced using FUN3D software developed at NASA Langley and are compared against the experimental data generated during the HIgh REynolds Number Aero- Structural Dynamics (HIRENASD) Project. The HIRENASD wind-tunnel model was tested in the European Transonic Windtunnel in 2006 by Aachen University0s Department of Mechanics with funding from the German Research Foundation. The computational effort discussed here was performed (1) to obtain a preliminary assessment of the ability of the FUN3D code to accurately compute physical quantities experimentally measured on the HIRENASD model and (2) to translate the lessons learned from the FUN3D analysis of HIRENASD into a set of initial guidelines for the first AePW, which includes test cases for the HIRENASD model and its experimental data set. This paper compares the computational and experimental results obtained at Mach 0.8 for a Reynolds number of 7 million based on chord, corresponding to the HIRENASD test conditions No. 132 and No. 159. Aerodynamic loads and static aeroelastic displacements are compared at two levels of the grid resolution. Harmonic perturbation numerical results are compared with the experimental data using the magnitude and phase relationship between pressure coefficients and displacement. A dynamic aeroelastic numerical calculation is presented at one wind-tunnel condition in the form of the time history of the generalized displacements. Additional FUN3D validation results are also presented for the AGARD 445.6 wing data set. This wing was tested in the Transonic Dynamics Tunnel and is commonly used in the preliminary benchmarking of computational aeroelastic software.

Chwalowski, Pawel↗
NASA NTRSDate not supplied

Nuclear Thermal Propulsion (NTP) Fission Product and Source Term Analysis

Nuclear thermal propulsion (NTP) is an in-space propulsion technology that uses a nuclear reactor to directly heat a propellant to provide high thrust, at higher efficiencies than achievable with conventional chemical propulsion systems. Due to the ability of NTP rockets to efficiently provide high thrust, this technology has been proposed for long duration space missions such as crewed missions to Mars and beyond. A primary hurdle for NTP technology development is the demonstration of an integrated reactor engine system to verify its functionality and performance. This primarily requires the manufacture and testing of candidate reactor and engine technologies to demonstrate the proposed design enables desired performance and exhibits acceptable response under all known operation modes. A major component in this testing is fission product accumulation, since after operation radioactive isotopes can be produced and pose radiological dose concerns. This paper explains the background behind fission product analysis and the methodology used to evaluate current reactor designs and identify the amount of fission products present and their radiological impact. Results of multiple thrust level engines at different time periods are discussed and highlight the need for additional experimental testing to confirm fractional release levels of fission products out of the system. Benchmarking of models and future paths of analysis are also discussed.

Fission↗
NASA NTRSDate not supplied

Nuclear Thermal Propulsion (NTP) Fission Product and Source Term Analysis

Nuclear thermal propulsion (NTP) is an in-space propulsion technology that uses a nuclear reactor to directly heat a propellant to provide high thrust, at higher efficiencies than achievable with conventional chemical propulsion systems. Due to the ability of NTP rockets to efficiently provide high thrust, this technology has been proposed for long duration space missions such as crewed missions to Mars and beyond. A primary hurdle for NTP technology development is the demonstration of an integrated reactor engine system to verify its functionality and performance. This primarily requires the manufacture and testing of candidate reactor and engine technologies to demonstrate the proposed design enables desired performance and exhibits acceptable response under all known operation modes. A major component in this testing is fission product accumulation, since after operation radioactive isotopes can be produced and pose radiological dose concerns. This paper explains the background behind fission product analysis and the methodology used to evaluate current reactor designs and identify the amount of fission products present and their radiological impact. Results of multiple thrust level engines at different time periods are discussed and highlight the need for additional experimental testing to confirm fractional release levels of fission products out of the system. Benchmarking of models and future paths of analysis are also discussed.

Nuclear Thermal Propulsion↗
DOE OSTI2020

Improvements to the Modeling of the TREAT Reactor and Experiments

This paper summarizes the latest improvements and lessons learned from the modeling and simulation of the transient test reactor at Idaho National Laboratory using the MAM- MOTH reactor physics application. MAMMOTH is a MOOSE-based, Finite Element Method application that specializes in the analysis of the spatial dynamics behavior of nuclear reactors. Since early 2018 several transient tests have been conducted at TREAT, thus providing the opportunity to apply and benchmark modern modeling and simulation tools. MAMMOTH was used to provide predictions of the power coupling factor between the core and the experiment for various experiments. Even though the power coupling factor predictions agree very well with the experimental data, within the bounds of the experimental uncertainty, one shortcoming was the underprediction of the total energy deposited in the core and in the experiment. Determination of the sources for this discrepancy are ongoing, but several key problems have been identified and resolved, thus providing valuable insights for future research. This paper discusses several of these lessons learned. First, the heat capacity data for the TREAT fuel has some significant problems due to limitations of the measurement techniques used circa 1960s. The sensitivity of the peak power and the total energy deposition to various representations of the heat capacity is approximately 5%. Second, the effects of the biological shield and thermal column on the modeling of the core are non-negligible, since they affect the mean generation time and the effective reflection of neutrons back into the core, which is suspected to be important during the core heat up. Matching the reactor period resolves the fact that the reduced spatial domain used in the MAMMOTH model underpredicts the mean generation time. The neutron reflection from these regions is marginally improved with the use of an albedo boundary condition. Third, modeling of the control rod movement with a multi-scheme method is introduced and its current limitations are exposed. Fourth, we explore the effects of using a homogenized model with Superhomogenization equivalence and how that differs from fully heterogeneous simulations. Finally, the energy condensation effects for this graphite core are significant. Solutions with 10 and 26 energy groups show the benefits of using a finer coarse group structure.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Modeling of HTTF using RELAP5-3D

Overview: HTTF Overview HTTF Test Matrix REALP5-3D Model Results PG-26 and PG-27 HTTF Benchmark Conclusions

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

On Distribution Grid Optimal Power Flow Development and Integration

Due to changes in electric distribution grid operation, new operation regimes have been recommended. Distribution grid optimal power flow (DOPF) has received tremendous attention in the research community, yet it has not been fully adopted across the utility industry. Our paper recognizes this problem and suggests a development and integration procedure for DOPF. We propose development of DOPF as a three step procedure of 1) processing the grid, 2) obtaining a tractable solution, and 3) implementing multiple solution algorithms and benchmarking them to improve application reliability. For the integration of DOPF, we demonstrate how a DOPF federate may be developed that can be integrated in a co-simulation environment to mimic the real-world conditions and hence improve its practicality to be deployed in the field. To demonstrate the efficacy of the proposed methods, tests on IEEE 123 bus system are performed where the usage of tractable formulation in DOPF algorithm development and its comparison to the benchmark solution are demonstrated.

Hanif, Sarmad↗
DOE OSTI2025

Progress Towards the Validation of a new RELAP5-3D model of the High Temperature Test Facility

Validation is a key step in the development of any type of systems model. As the next generation of reactors approaches, the need for codes that have been validated for these new types of systems continues to grow. An example of a prominent option is the Reactor Excursion Leak Analysis Program (RELAP5-3D), developed by Idaho National Laboratory. This code was developed for the purpose of systems level thermal-hydraulic modeling of light water reactors (LWRS) and postulated transients that can occur in LWRS.RELAP5-3D has been substantially validated against LWR data. Due to its long history as a reactor safety analysis tool, there has been an effort to adapt RELAP5-3D for the purposes of advanced reactor concepts such as prismatic high-temperature gas-cooled reactors (HTGRs). However, RELAP5-3D has not nearly been validated and verified for HTGRs to the degree of LWRs, warranting verification and validation opportunities with computational benchmarks and existing experimental facilities. Examples of such facilities include the modular high-temperature gas-cooled reactor (MHTGR) 350 and the high temperature engineering test reactor (HTTR) from Japan. The MHTGR 350 is a benchmark design concept for code-to-code verification purposes; therefore, it does not provide any experimental data for validation opportunities The HTTR provides useful multiphysics validation data but does not have the in-core instruments to generate thermal-hydraulic experimental data to help with RELAP5-3D validation. Consequently, a facility that could provide key in-core temperatures for thermal-hydraulic validation was still needed. The High Temperature Test Facility (HTTF) is an integral effects facility for HTGR thermal hydraulics developed and operated by Oregon State University. HTTF represents ¼ length scale of the General Atomics MHTGR and is rated for a total power of 2.2 MW. Axially, the core consists of an upper and lower reflector and 10 blocks, numbered from bottom to top (Block 1 is right above lower reflector). The core is heated via graphite resistive heater rods, with respective channels distributed throughout the core. The primary coolant is helium and heat can radiate out of the core to the reactor cavity cooling system (RCCS), which is cooled by water. The primary purpose of the facility is to investigate pressurized conduction cooldown (PCC) and depressurized conduction cooldown (DCC) transients, which are also referred to as the pressurized and depressurized loss of forced cooling respectively. Two experiments were chosen to perform the validation study with a RELAP5-3D model of HTTF. These experiments are PG-27 (PCC) and PG-29 (DCC). These were chosen based off of the quality of available experimental data before and during the experiment which led to their inclusion in the HTGR Thermal Hydraulics Benchmark.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Thermal Hydraulics Validation Activities in the ART-GCR Campaign

The Advanced Reactor Technologies - Gas Cooled Reactor Campaign (ART-GCR) is part of the United States Department of Energy - Office of Nuclear Energy's Advanced Reactor Technologies program aimed at developing a High Temperature Gas-cooled Reactor (HTGR) which will offer enhancements in safety and efficiency. The Design, Methods, and Validation arm of the ART-GCR program provides experience and advanced tools for HTGR design and analysis. The Methods and Validation arm is developing data to validate predictions of decay heat removal through an extensive experimental campaign the Natural Convection Shutdown Heat Removal Test Facility at Argonne National Laboratory. In-core thermal hydraulics validation is being facilitated through the OECD/NEA's Thermal Hydraulic Code Validation Benchmark for High Temperature Gas-Cooled Reactors using HTTF Data. That benchmark contains code-to-code and code-to-data comparisons for 3 sets of HTGR thermal hydraulics phenomena. This ongoing benchmark activity has 16 participants from 9 countries developing leading insights into HTGR thermal hydraulics code validation. The ART-GCR campaign is also working on the development of state-of-the-art MOOSE-based models of the High Temperature Engineering Test Reactor (HTTR). Through the OECD/NEA's HTTR Loss of Forced Cooling (LOFC) program, the ART-GCR campaign is developing a multiphysics transient code validation benchmark based on 3 HTTR experiments that will provide an opportunity for international collaboration on multiphysics code validation.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in many neuroscience laboratories interested in neuron tracing. Here, we report generated gold standard manual annotations for a subset of the available imaging datasets and quantified tracing quality for 35 automatic tracing algorithms. The goal of generating such a hand-curated diverse dataset is to advance the development of tracing algorithms and enable generalizable benchmarking. Together with image quality features, we pooled the data in an interactive web application that enables users and developers to perform principal component analysis, t-distributed stochastic neighbor embedding, correlation and clustering, visualization of imaging and tracing data, and benchmarking of automatic tracing algorithms in user-defined data subsets. The image quality metrics explain most of the variance in the data, followed by neuromorphological features related to neuron size. Furthermore, we observed that diverse algorithms can provide complementary information to obtain accurate results and developed a method to iteratively combine methods and generate consensus reconstructions. The consensus trees obtained provide estimates of the neuron structure ground truth that typically outperform single algorithms in noisy datasets. However, specific algorithms may outperform the consensus tree strategy in specific imaging conditions. Finally, to aid users in predicting the most accurate automatic tracing results without manual annotations for comparison, we used support vector machine regression to predict reconstruction quality given an image volume and a set of automatic tracings.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

A curated benchmark for cofolding models on kinase conformational states

Abstract Protein kinases are critical drug targets, requiring therapeutics that can modulate their active and inactive conformational states. While cofolding models can generate global folds directly from kinase sequences and ligand SMILES strings, these models have not yet been tested on their ability to recover ligand-induced-fit conformational states of the kinase proteins. Here, we introduce KinConfBench, a curated benchmark of 2225 high-quality human kinase chains to evaluate the ability of four state-of-the-art cofolding models—Boltz-2, Chai-1, Protenix, and RoseTTAFold-All-Atom—to recover both canonical and rare conformational states. We show that geometric success metrics of a ligand pose in the active site do not correlate strongly with the correct kinase conformational state, motivating a new set of dynamical benchmarks for assessing cofolding models. While all four cofolding models achieve ~60–80% prediction accuracy for kinase conformational classification, they exhibit severe mode collapse when performing multiple inferences, show negligible structural diversity in sampling induced-fit motions, and display a prevalent “apo-drift” in which most cofolding models predominantly predict the kinase to be in its ligand-free state. Our results highlight that capturing ligand-induced protein conformational diversity, not just geometric fit, is critical for next-generation structure-based drug discovery.

Sun, Kunyang↗
NASA NTRS2013

Aircraft Engine Gas Path Diagnostic Methods: Public Benchmarking Results

Recent technology reviews have identified the need for objective assessments of aircraft engine health management (EHM) technologies. To help address this issue, a gas path diagnostic benchmark problem has been created and made publicly available. This software tool, referred to as the Propulsion Diagnostic Method Evaluation Strategy (ProDiMES), has been constructed based on feedback provided by the aircraft EHM community. It provides a standard benchmark problem enabling users to develop, evaluate and compare diagnostic methods. This paper will present an overview of ProDiMES along with a description of four gas path diagnostic methods developed and applied to the problem. These methods, which include analytical and empirical diagnostic techniques, will be described and associated blind-test-case metric results will be presented and compared. Lessons learned along with recommendations for improving the public benchmarking processes will also be presented and discussed.

Simon, Donald L.↗
NASA NTRS2004

Fourth Computational Aeroacoustics (CAA) Workshop on Benchmark Problems

This publication contains the proceedings of the Fourth Computational Aeroacoustics (CAA) Workshop on Benchmark Problems. In this workshop, as in previous workshops, the problems were devised to gauge the technological advancement of computational techniques to calculate all aspects of sound generation and propagation in air directly from the fundamental governing equations. A variety of benchmark problems have been previously solved ranging from simple geometries with idealized acoustic conditions to test the accuracy and effectiveness of computational algorithms and numerical boundary conditions; to sound radiation from a duct; to gust interaction with a cascade of airfoils; to the sound generated by a separating, turbulent viscous flow. By solving these and similar problems, workshop participants have shown the technical progress from the basic challenges to accurate CAA calculations to the solution of CAA problems of increasing complexity and difficulty. The fourth CAA workshop emphasized the application of CAA methods to the solution of realistic problems. The workshop was held at the Ohio Aerospace Institute in Cleveland, Ohio, on October 20 to 22, 2003. At that time, workshop participants presented their solutions to problems in one or more of five categories. Their solutions are presented in this proceedings along with the comparisons of their solutions to the benchmark solutions or experimental data. The five categories for the benchmark problems were as follows: Category 1:Basic Methods. The numerical computation of sound is affected by, among other issues, the choice of grid used and by the boundary conditions. Category 2:Complex Geometry. The ability to compute the sound in the presence of complex geometric surfaces is important in practical applications of CAA. Category 3:Sound Generation by Interacting With a Gust. The practical application of CAA for computing noise generated by turbomachinery involves the modeling of the noise source mechanism as a vortical gust interacting with an airfoil. Category 4:Sound Transmission and Radiation. Category 5:Sound Generation in Viscous Problems. Sound is generated under certain conditions by a viscous flow as the flow passes an object or a cavity.

Dahl, Milo D.↗
DOE OSTI2023

MUSiC: Critical Experiment with Bare Highly Enriched Uranium Shells Benchmark

The measurements of the Uranium Subcritical and Critical (MUSiC) experiment were performed from December 2020 through April 2021. The purpose of the experiment was to test a variety of multiplicity detection systems for a large range of multiplication values and to see how well they perform as the k eff of the MUSiC series of experiments approached the delayed critical window. Out of the ten configurations that were studied, two of them were super critical and were recently approved as benchmarks and they will be included in the International Criticality Safety Benchmark Evaluation Project (ICBESP) handbook. For each of the two experiments, uncertainties were evaluated six categories: (1) critical measurement, (2) mass, (3) composition, (4) positioning, (5) dimensions, and (6) temperature. The largest contribution to the overall uncertainty in each of the cases was due to the uncertainties in the dimensions of the HEU Rocky Flats shells. Simplified detailed models were created with an average bias of -130.5 pcm due to the removal various components surrounding the experiment. For MCNP6.2 models using ENDF-VIII.0 neutron cross section data, the average difference between the calculated and benchmark k effs was -54 pcm for the detailed model and -102 pcm for the simplified model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS1997

Degradation of Precision Reference Devices in Space Environments

This paper presents radiation test results for several different precision voltage devices. Their degradation is compared to that expected for the basic bandgap reference circuit, which is used as a theoretical benchmark, and uses only npn transistorss.

Precision↗
DOE OSTI2024

Quantum-Hardware Focused Application Performance Benchmarks (Final Technical Report)

Quantum computers promise to transform how we do scientific calculations. In this project, we benchmark different current quantum computers for solving chemistry problems and find ways to build noise-resilient implementations. We also use the characterization techniques developed to test ion trap quantum computers.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2026

Drive Cycles, Battery Pack Scaling, and Usage Considerations for Long-Haul and Regional-Haul Electric Trucks

Electrifying Class-8 heavy-duty trucks presents a promising opportunity to enhance energy efficiency and reduce freight transport costs. Battery electric trucks (BETs), once considered niche, are gaining traction due to advancements in battery technology and cost reductions. However, accurately predicting battery lifespan under realistic usage conditions remains a key challenge. Understanding battery failure mechanisms and their links to design, operation, and management is essential for developers and fleet operators. This study introduces a method to develop simplified, lab-testable dynamic stress test (DST) cycles for regional and long-haul Class-8 BETs, derived from real-world diesel truck usage. These DSTs enable benchmarking of battery technologies, identification of aging stressors, and optimization of battery design, life, and cost. The approach supports evaluation of key metrics such as levelized cost of driving and total cost of ownership, aiding fair comparisons and adoption decisions. We also propose feasible battery pack sizes that meet current driving demands with strategic charging, and a method to scale pack-level DSTs to cell-level cycles for lab-based testing. These tools facilitate tradeoff analysis across battery chemistries, pack sizing, and charging strategies, while offering means to get insights into battery aging under realistic conditions-ultimately supporting informed BET deployment decisions.

25 ENERGY STORAGE↗
DOE OSTI2021

Benchmark estimate of the effect of anthropogenic emissions on the ocean surface

Abstract Investigations into the role of anthropogenic emissions in the occurrence of extreme weather often use a method that compares simulations of atmospheric climate models run under a factual scenario of historical boundary conditions observed during the period of the event against simulations run under a counterfactual scenario of what those boundary conditions might naturally have been over that same period in the absence of anthropogenic emissions. A particular requirement for this experiment design is an accurate estimation of ocean surface boundary conditions for use by the counterfactual natural simulations. Here we use output from the CMIP5 multi‐climate‐model archive to develop a robust estimate of sea surface temperatures and sea ice conditions for use in counterfactual natural simulations, intended as a benchmark estimate to facilitate comparison across climate models and across studies. This development includes tests to ensure that the final estimate is stable from year‐to‐year and stable against other perturbations to the methodology, as well as consideration of the strengths and weaknesses in comparison to other available attributable warming estimates. While this estimate is tailored specifically for the International CLIVAR C20C+ Detection and Attribution Project, it can be used by related projects as well.

Stone, Dáithí A.↗
DOE OSTI2026

Reactive Transport Modeling with Physics-Informed Machine Learning for Critical Minerals Applications

This study presents a physics-informed neural network (PINN) framework for reactive transport modeling for simulating fast bimolecular reactions in porous media. Accurate characterization of cAhemical interactions and product formation in surface and subsurface environments is essential for advancing critical mineral extraction and related geoscience applications. The proposed methodology sequentially addresses the flow and diffusion–reaction subproblems. The flow field is computed using a mixed formulation, while the diffusion–reaction system is modeled via two uncoupled tensorial diffusion equations reformulated in terms of chemical invariants. PINNs are employed to solve the governing equations, enabling data-efficient, mesh-free prediction of chemical concentration fields. The framework is validated through a series of benchmark problems involving flow in heterogeneous porous media. Initial verification is conducted using patch tests for the flow field, followed by validation of the transport problem with emphasis on preserving non-negativity of concentrations. The complete fast bimolecular reaction scenario is then solved, yielding spatial distributions of reactants and product species. Results demonstrate that the PINNs-based approach effectively captures sharp, mixing-limited reaction fronts and dispersive mixing behavior, offering reliable predictions of reactive plume evolution. These capabilities are crucial for evaluating long-term subsurface behavior in applications such as fluid storage, energy extraction, and efficient extraction of critical minerals.

42 ENGINEERING↗