Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
NASA NTRS1981

Overview study of Space Power Technologies for the advanced energetics program

Space power technologies are reviewed to determine the state-of-the-art and to identify advanced or novel concepts which promise large increases in performance. The potential for incresed performance is judged relative to benchmarks based on technologies which have been flight tested. Space power technology concepts selected for their potentially high performance are prioritized in a list of R & D topical recommendations for the NASA program on Advanced Energetics. The technology categories studied are solar collection, nuclear power sources, energy conversion, energy storage, power transmission, and power processing. The emphasis is on electric power generation in space for satellite on board electric power, for electric propulsion, or for beamed power to spacecraft. Generic mission categories such as low Earth orbit missions and geosynchronous orbit missions are used to distinguish general requirements placed on the performance of power conversion technology. Each space power technology is judged on its own merits without reference to specific missions or power systems. Recommendations include 31 space power concepts which span the entire collection of technology categories studied and represent the critical technologies needed for higher power, lighter weight, more efficient power conversion in space.

Taussig, R.↗
NASA NTRS1992

A CFD validation roadmap for hypersonic flows

A roadmap for computational fluid dynamics (CFD) code validation is developed. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments would provide the needed validation data.

Marvin, Joseph G.↗
NASA NTRS1992

CFD validation experiments for hypersonic flows

A roadmap for CFD code validation is introduced. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments could provide new validation data.

Marvin, Joseph G.↗
NASA NTRS1993

A CFD validation roadmap for hypersonic flows

A roadmap for computational fluid dynamics (CFD) code validation is developed. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments would provide the needed validation data.

Marvin, Joseph G.↗
NASA NTRS1998

Automated Generation of Message-Passing Programs: An Evaluation Using CAPTools

Scientists at NASA Ames Research Center have been developing computational aeroscience applications on highly parallel architectures over the past ten years. During that same time period, a steady transition of hardware and system software also occurred, forcing us to expend great efforts into migrating and re-coding our applications. As applications and machine architectures become increasingly complex, the cost and time required for this process will become prohibitive. In this paper, we present the first set of results in our evaluation of interactive parallelization tools. In particular, we evaluate CAPTool's ability to parallelize computational aeroscience applications. CAPTools was tested on serial versions of the NAS Parallel Benchmarks and ARC3D, a computational fluid dynamics application, on two platforms: the SGI Origin 2000 and the Cray T3E. This evaluation includes performance, amount of user interaction required, limitations and portability. Based on these results, a discussion on the feasibility of computer aided parallelization of aerospace applications is presented along with suggestions for future work.

Hribar, Michelle R.↗
NASA NTRS2002

Automated Generation of Message-Passing Programs: An Evaluation Using CAPTools

Scientists at NASA Ames Research Center have been developing computational aeroscience applications on highly parallel architectures over the past ten years. During that same time period, a steady transition of hardware and system software also occurred, forcing us to expend great efforts into migrating and re-coding our applications. As applications and machine architectures become increasingly complex, the cost and time required for this process will become prohibitive. In this paper, we present the first set of results in our evaluation of interactive parallelization tools. In particular, we evaluate CAPTool's ability to parallelize computational aeroscience applications. CAPTools was tested on serial versions of the NAS Parallel Benchmarks and ARC3D, a computational fluid dynamics application, on two platforms: the SGI Origin 2000 and the Cray T3E. This evaluation includes performance, amount of user interaction required, limitations and portability. Based on these results, a discussion on the feasibility of computer aided parallelization of aerospace applications is presented along with suggestions for future work.

Hribar, Michelle R.↗
NASA NTRS2007

Convergent Close-Coupling Approach to Electron-Atom Collisions

It was with great pleasure and honour to accept the invitation to make a presentation at the symposium celebrating the life-long work of Aaron Temkin and Richard Drachman. The work of Aaron Temkin was particularly influential on our own during the development of the CCC method for electron-atom collisions. There are a number of key problems that need to be dealt with when developing a general computational approach to such collisions. Traditionally, the electron energy range was subdivided into the low, intermediate, and high energies. At the low energies only a finite number of channels are open and variational or close-coupling techniques could be used to obtain accurate results. At high energies an infinite number of discrete channels and the target continuum are open, but perturbative techniques are able to yield accurate results. However, at the intermediate energies perturbative techniques fail and computational approaches need to be found for treating the infinite number of open channels. In addition, there are also problems associated with the identical nature of electrons and the difficulty of implementing the boundary conditions for ionization processes. The beauty of the Temkin-Poet model of electron-hydrogen scattering is that it simplifies the full computational problem by neglecting any non-zero orbital angular momenta in the partial-wave expansion, without loosing the complexity associated with the above-mentioned problems. The unique nature of the problem allowed for accurate solution leading to benchmark results which could then be used to test the much more general approaches to electron-atom collision problems. The immense value of the Temkin-Poet model is readily summarised by the fact that the initial papers of Temkin and Poet have been collectively cited around 250 times to date and are still being cited in present times. Many of the citations came from our own work during the course of the development of the CCC method, which we now describe.

Bray, Igor↗
NASA NTRS2017

Wall-Resolved Large-Eddy Simulation of Flow Separation Over NASA Wall-Mounted Hump

This paper reports the findings from a study that applies wall-resolved large-eddy simulation to investigate flow separation over the NASA wall-mounted hump geometry. Despite its conceptually simple flow configuration, this benchmark problem has proven to be a challenging test case for various turbulence simulation methods that have attempted to predict flow separation arising from the adverse pressure gradient on the aft region of the hump. The momentum-thickness Reynolds number of the incoming boundary layer has a value that is near the upper limit achieved by recent direct numerical simulation and large-eddy simulation of incompressible turbulent boundary layers. The high Reynolds number of the problem necessitates a significant number of grid points for wall-resolved calculations. The present simulations show a significant improvement in the separation-bubble length prediction compared to Reynolds-Averaged Navier-Stokes calculations. The current simulations also provide good overall prediction of the skin-friction distribution, including the relaminarization observed over the front portion of the hump due to the strong favorable pressure gradient. We discuss a number of problems that were encountered during the course of this work and present possible solutions. A systematic study regarding the effect of domain span, subgrid-scale model, tunnel back pressure, upstream boundary layer conditions and grid refinement is performed. The predicted separation-bubble length is found to be sensitive to the span of the domain. Despite the large number of grid points used in the simulations, some differences between the predictions and experimental observations still exist (particularly for Reynolds stresses) in the case of the wide-span simulation, suggesting that additional grid resolution may be required.

Uzun, Ali↗
DOE OSTI2024

Demonstration and Verification of Thermo-Mechanical Bowing in a Limited Free-Bow SFR Concept Using MOOSE

Core bowing due to thermal gradients and irradiation induced swelling and creep introduces significant reactivity feedback effects in liquid metal-cooled fast spectrum reactors. During startup, normal operations, and transient events, differential thermal and flux gradients cause expansion, creep, and swelling, which results in bowing in preferential directions depending on local material properties and load-pad and restraint-ring design. The bowing phenomenon produces negative reactivity during accident conditions provided the restraint system has been properly designed to optimally guide the deformation outwards in the active core region. Under the Department of Energy Nuclear Energy Advanced Modeling and Simulation program, a Multiphysics Object Oriented Simulation Environment (MOOSE)-based multiphysics approach to model core bowing is being developed. The present work expands on previous modeling of simpler International Atomic Energy Agency (IAEA) verification problems with these tools by modeling IAEA Verification Problem 4, which involves a symmetric sector of a reactor core with ducted assemblies undergoing differential thermal expansion due to thermal gradients bowing outward with duct-to-duct contact. This model is available on the National Reactor Innovation Center Virtual Test Bed repository. This example was verified against benchmark participant results, which includes bowing deformation evaluation and duct-to-duct interactions at load pads with mechanical contact.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

SAS4A/SASSYS-1 Validation with EBR-II Tests Performed During the SHRT Testing Program

The EBR-II sodium-cooled fast reactor supported a wide range of fast reactor research activities. The final fifteen years of operations at EBR-II were used for experiments and tests to demonstrate the importance of passive safety in liquid metal reactors and the capability of such systems to provide strong passive responses during off-normal conditions. The Shutdown Heat Removal Test program at EBR-II provided test data supporting the validation of computer codes for design, licensing, and operation of LMRs, among other objectives. The program included nearly sixty tests, most of which were protected and unprotected loss of flow and loss of heat sink tests run at various initial powers and flow rates. This report documents the results of modeling and simulation of tests from the Shutdown Heat Removal Test program to support validation of Argonne’s SAS4A/SASSYS-1 fast reactor safety analysis code. SHRT-17 was a protected loss of flow test where a loss of electrical power to all sodium coolant pumps was simulated to demonstrate the effectiveness of natural circulation cooling characteristics. SHRT-45R was an unprotected loss of flow test where the control rod scram function of the plant protection system was disabled to demonstrate the effectiveness of EBR-II’s passive reactivity feedbacks. BOP-301 and BOP-302R were unprotected loss of heat sink tests that demonstrated how reactivity feedback effects driven by changes to the core inlet temperature can shut down the fission process. This validation activity leverages modeling and simulation efforts that originated under an International Atomic Energy Agency Coordinated Research Project for benchmark analysis of the EBR-II Shutdown Heat Removal Tests. The SAS4A/SASSYS-1 models originally developed for the CRP have been modernized to utilize new code features and modeling practices. Differences between the predicted and measured test data were explored and the causes of these differences were identified as being due to modeling approximations, uncertainty in transient component behavior, and instrumentation uncertainties. Overall, it was concluded that for SHRT-17, SHRT-45R, BOP-301, and BOP-302R there was good agreement between the flow, power, and temperature predictions and the measured data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Multiphysics Modeling of Microreactors with NEAMS codes, and Validation Based on KRUSTY Reactivity Insertion

The NEAMS Multiphysics Applications team continues to assess code usability and functionality for microreactor design and safety analyses, while demonstrating that NEAMS tools capture both steady-state and transient behavior across distinct microreactor concepts. In FY2025, the team advanced full-core, high-fidelity, multiphysics models that solve more complex problems and strengthen verification/validation for several microreactor systems: heat-pipe microreactor (HPMR), gas-cooled microreactor (GCMR), and the KRUSTY experiment. These models employ the MOOSE MultiApp/Transfers architecture with Griffin for neutronics, BISON for heat conduction/thermomechanics, Sockeye for heat pipes, SAM/THM for coolant channels and loops, and SWIFT for hydride behavior, with meshes generated via the MOOSE Reactor Module. The graphite models available in the Grizzly code were also investigated for future analyses. For the HPMR, a Na-HPMR variant was constructed to align with recently validated heat-pipe experiments and Sockeye’s LCVF capability, enabling mechanistic heat-pipe transients and startup modeling. The Na-HPMR will serve as the primary model for HPMR investigations in upcoming tasks. The load-following and single heat-pipe failure scenarios (Griffin/BISON/Sockeye), which were previously modeled for the K-HPMR, were replicated for the Na-HPMR, showing strong negative temperature feedback and highly localized thermal effects, respectively, while the startup case captured vapor-front progression and heat-removal activation. Solid mechanics was added to the previously built K-HPMR full-core model in BISON, showing minimal impact on steady-state reactivity yet enabling stress-field predictions that prepare the path for full-core TRISO performance analyses. For the GCMR, automated steady-state and four transient scenarios were executed using Griffin/BISON/SAM/SWIFT. Results confirm robust inherent safety: power collapses promptly in loss-of-cooling events, the inlet-temperature drop settles to a new equilibrium, and a single-channel blockage yields only a ~30 K local fuel-temperature rise with <0.4% power decrease. SWIFT-predicted hydrogen redistribution affects reactivity during both steady-state and transient conditions, underscoring its importance. A Brayton-cycle balance of plant (BOP) model in SAM/THM demonstrated stable startup behavior, and xenon-driven reactivity during load following was analyzed. To improve TRISO-compact temperature fidelity, a fast multiscale Heat Source Decomposition (HSD) treatment was implemented. Against heterogeneous benchmarks, HSD reduces underprediction of kernel temperatures and lowers predicted peak powers in reactivity-insertion transients compared to previous homogenized models. KRUSTY warm-critical validation progressed from FY2024 baselines: the 15Ȼ insertion shows excellent agreement in peak power (~2% high) and temperature trends, and the 30Ȼ case was automated via a feedback controller that maintained power near 3 kW for ~150 s with close agreement to data. The successful modeling of the warm critical tests has laid a strong foundation for simulating more complex nuclear system tests in the years ahead. Throughout FY2025, developer feedback was provided (e.g., MOOSE batch mesh generation, distributed pre-split meshes, Griffin sweeper on displaced meshes), several new models were contributed to the Virtual Test Bed, and an OECD-NEA WPRS multiphysics benchmark based on the HPMR was initiated to enable broader cross-comparison and best-practice development with the nuclear community at large.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Creep and Fatigue Characterization of High Strength Alloy Thin Sections in Advanced CO2 Heat Exchangers

The objective of this work was to characterize and model elevated temperature creep and fatigue behavior for thin sheet and foil forms of gamma-prime strengthened alloys in wrought form and as-processed folded and brazed constructions. This work was motivated by the demanding temperature and pressure service conditions of the GEN3 Concentrated Solar Power (CSP) and supercritical CO2 (sCO2) power cycle working fluid. More specifically, the possibility of leveraging the superior creep strength of gamma-prime alloys in folded-fin and brazed-plate heat exchanger constructions. Gamma-prime alloys represent a step-change in raw-material strength over solid-solution strengthened alloys. And the folded-fin and brazed-plate heat exchanger architecture is lightweight and leverages cost-effective material stock forms. The investigation contained two parallel paths. (1) The first is referred to as a fundamental investigation where Oak Ridge National Laboratory conducts uniaxial creep testing on thin sheet and foil in wrought form. This effort aimed to serve as a benchmark against a relatively sparse existing database and a baseline comparison for path number 2. (2) The second path is referred to as the practical investigation where Brayton Energy manufactures plate-fin heat exchangers and performs pressurized creep and fatigue testing. This effort aimed to de-risk heat exchanger manufacturing process for service under sCO2 CSP conditions. A total of 14 uniaxial creep tests were completed using Haynes 282 thin sheet and foil. A variety of heat treatments were specified to coincide with path number 2. Baseline metallography of test samples and creep strength performance are contained. Benchmarks relatively to existing thick-form Haynes 282 are made, as well as to other thin-form Nickel-based superalloys. Description of a wrought-form modeling approach for thin gamma-prime alloys is also discussed. A total of 11 pressurized creep and fatigue tests were completed successfully with Haynes 282 heat exchanger prototypes. Manufacturing processing details, testing details, testing results, and failure analysis are discussed. Additionally, creep modeling techniques to predict failure are discussed, and modeling to support technological-to-market. In conclusion, Haynes 282 foils were demonstrated to yield rupture two-to-three orders of magnitude higher than Haynes 230 foils under similar conditions. And the manufactured heat exchanger prototypes demonstrated strength similar to the wrought constituents. Both of which contribute to elevated performance potential or cost savings in practice. Discussion is included.

14 SOLAR ENERGY↗
DOE OSTI2024

Benchmarking characterization methods for noisy quantum circuits

Effective methods for characterizing the noise in quantum computing devices are essential for programming and debugging circuit performance. Existing approaches vary in the information obtained as well as the amount of quantum and classical resources required, with more information generally requiring more resources. Here we benchmark the characterization methods of gate set tomography, Pauli channel noise reconstruction, and empirical direct characterization for developing models that describe noisy quantum circuit performance on a 27-qubit superconducting transmon device. We evaluate these models by comparing the accuracy of noisy circuit simulations with the corresponding experimental observations. Here, we find that the agreement of noise model to experiment does not correlate with the information gained by characterization and that the underlying circuit strongly influences the best choice of characterization approach. Empirical direct characterization scales best of the methods we tested and produced the most accurate characterizations across our benchmarks.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Improved Verification and Validation Testing and Tools including Nuclear Criticality Safety Applications with the MCNP6.3® Code [Abstract]

A new Python-based framework has been developed to enable a more consistent layout with automatable setup, execution, and documentation of all verification and validation (V&V) test suites previously established for use with the MCNP code. In this paper, the new general framework for the V&V test suites is discussed, including information on all of the current capabilities and plans for future capabilities. For nuclear criticality safety applications, the existing V&V benchmark problems within the criticality, extended criticality, and analytic k-effective test suites have been ported into this new framework. In addition, the status and updates to the Rossi-alpha and subcritical multiplicationtest suites will be discussed. Some V&V results exercising new MCNP6.3 capabilities will be demonstrated.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Roadmap for Molecular Benchmarks in Nonadiabatic Dynamics

Simulating the coupled electronic and nuclear response of a molecule to light excitation requires the application of nonadiabatic molecular dynamics. However, when faced with a specific photophysical or photochemical problem, selecting the most suitable theoretical approach from the wide array of available techniques is not a trivial task. The challenge is further complicated by the lack of systematic method comparisons and rigorous testing on realistic molecular systems. This absence of comprehensive molecular benchmarks remains a major obstacle to advances within the field of nonadiabatic molecular dynamics. A CECAM workshop, Standardizing Nonadiabatic Dynamics: Towards Common Benchmarks, was held in May 2024 to address this issue. This Perspective highlights the key challenges identified during the workshop in defining molecular benchmarks for nonadiabatic dynamics. Specifically, this work outlines some preliminary observations on essential components needed for simulations and proposes a roadmap aiming to establish, as an ultimate goal, a community-driven, standardized molecular benchmark set.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Matrix-Model Simulations Using Quantum Computing, Deep Learning, and Lattice Monte Carlo

Matrix quantum mechanics plays various important roles in theoretical physics, such as a holographic description of quantum black holes, and it underpins the only practical numerical approach to the study of complex high-dimensional supergravity theories. Understanding quantum black holes and the role of entanglement in a holographic setup is of paramount importance for the realization of a quantum theory of gravity. Moreover, a complete numerical understanding of the holographic duality and the emergence of geometric space-time features from microscopic degrees of freedom could pave the way for new discoveries in quantum information science. Euclidean lattice Monte Carlo simulations are the de facto numerical tool for understanding the spectrum of large matrix models and have been used to test the holographic duality. However, they are not tailored to extract dynamical properties or even the quantum wave function of the ground state of matrix models. Quantum computing and deep learning provide potentially useful approaches to study the dynamics of matrix quantum mechanics. If successful in the context of matrix models, these rapidly improving numerical techniques could become the new Swiss army knife of quantum gravity practitioners. In this paper, we perform the first systematic survey for quantum computing and deep-learning approaches to matrix quantum mechanics, comparing them to lattice Monte Carlo simulations. These provide baseline benchmarks before addressing more complicated problems. In particular, we test the performance of each method by calculating the low-energy spectrum.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2004

DSMC Simulations of Hypersonic Flows and Comparison With Experiments

This paper presents computational results obtained with the direct simulation Monte Carlo (DSMC) method for several biconic test cases in which shock interactions and flow separation-reattachment are key features of the flow. Recent ground-based experiments have been performed for several biconic configurations, and surface heating rate and pressure measurements have been proposed for code validation studies. The present focus is to expand on the current validating activities for a relatively new DSMC code called DS2V that Bird (second author) has developed. Comparisons with experiments and other computations help clarify the agreement currently being achieved between computations and experiments and to identify the range of measurement variability of the proposed validation data when benchmarked with respect to the current computations. For the test cases with significant vibrational nonequilibrium, the effect of the vibrational energy surface accommodation on heating and other quantities is demonstrated.

Moss, James N.↗
NASA NTRS2017

Global Gridded Crop Model Evaluation: Benchmarking, Skills, Deficiencies and Implications.

Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.

wheat↗