Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRS2009

Fan Noise Prediction with Applications to Aircraft System Noise Assessment

This paper describes an assessment of current fan noise prediction tools by comparing measured and predicted sideline acoustic levels from a benchmark fan noise wind tunnel test. Specifically, an empirical method and newly developed coupled computational approach are utilized to predict aft fan noise for a benchmark test configuration. Comparisons with sideline noise measurements are performed to assess the relative merits of the two approaches. The study identifies issues entailed in coupling the source and propagation codes, as well as provides insight into the capabilities of the tools in predicting the fan noise source and subsequent propagation and radiation. In contrast to the empirical method, the new coupled computational approach provides the ability to investigate acoustic near-field effects. The potential benefits/costs of these new methods are also compared with the existing capabilities in a current aircraft noise system prediction tool. The knowledge gained in this work provides a basis for improved fan source specification in overall aircraft system noise studies.

Nark, Douglas M.↗
NASA NTRS2008

AMS Prototyping Activities

This slide presentation reviews the activity around the Asynchronous Message Service (AMS) prototype. An AMS reference implementation has been available since late 2005. It is aimed at supporting message exchange both in on-board environments and over space links. The implementation incoroporates all mandatory elements of the draft recommendation from July 2007: (1) MAMS, AMS, and RAMS protocols. (2) Failover, heartbeats, resync. (3) "Hooks" for security, but no cipher suites included in the distribution. The performance is reviewed, and a Benchmark latency test over VxWorks Message Queues is shown as histograms of a count vs microseconds per 1000-byte message

AMS (Asynchronous Message Service)↗
NASA NTRS2002

Structural Analyses of Stirling Power Convertor Heater Head for Long-Term Reliability, Durability, and Performance

Deep-space missions require onboard electric power systems with reliable design lifetimes of up to 10 yr and beyond. A high-efficiency Stirling radioisotope power system is a likely candidate for future deep-space missions and Mars rover applications. To ensure ample durability, the structurally critical heater head of the Stirling power convertor has undergone extensive computational analyses of operating temperatures (up to 650 C), stresses, and creep resistance of the thin-walled Inconel 718 bill of material. Durability predictions are presented in terms of the probability of survival. A benchmark structural testing program has commenced to support the analyses. This report presents the current status of durability assessments.

Halford, Gary R.↗
NASA NTRS2017

Sensitivity Analysis of Multidisciplinary Rotorcraft Simulations

A multidisciplinary sensitivity analysis of rotorcraft simulations involving tightly coupled high-fidelity computational fluid dynamics and comprehensive analysis solvers is presented and evaluated. An unstructured sensitivity-enabled Navier-Stokes solver, FUN3D, and a nonlinear flexible multibody dynamics solver, DYMORE, are coupled to predict the aerodynamic loads and structural responses of helicopter rotor blades. A discretely-consistent adjoint-based sensitivity analysis available in FUN3D provides sensitivities arising from unsteady turbulent flows and unstructured dynamic overset meshes, while a complex-variable approach is used to compute DYMORE structural sensitivities with respect to aerodynamic loads. The multidisciplinary sensitivity analysis is conducted through integrating the sensitivity components from each discipline of the coupled system. Numerical results verify accuracy of the FUN3D/DYMORE system by conducting simulations for a benchmark rotorcraft test model and comparing solutions with established analyses and experimental data. Complex-variable implementation of sensitivity analysis of DYMORE and the coupled FUN3D/DYMORE system is verified by comparing with real-valued analysis and sensitivities. Correctness of adjoint formulations for FUN3D/DYMORE interfaces is verified by comparing adjoint-based and complex-variable sensitivities. Finally, sensitivities of the lift and drag functions obtained by complex-variable FUN3D/DYMORE simulations are compared with sensitivities computed by the multidisciplinary sensitivity analysis, which couples adjoint-based flow and grid sensitivities of FUN3D and FUN3D/DYMORE interfaces with complex-variable sensitivities of DYMORE structural responses.

Wang, Li↗
NASA NTRS2017

Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) Instrument Improvements

The Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) combines airborne sun tracking and sky scanning with grating spectroscopy to improve knowledge of atmospheric constituents and their links to air-pollution and climate. Hyper-spectral measurements of direct-beam solar irradiance provide retrievals of gas constituents, aerosol optical depth, and aerosol and thin cloud optical properties. Sky radiance measurements in the principal and almucantar planes enhance retrievals of aerosol absorption, aerosol type, and size mode distribution. Zenith radiance measurements are used to retrieve cloud properties and phase, which in turn are used to quantify the radiative transfer below cloud layers. These airborne measurements tighten the closure between satellite and ground-based measurements. In contrast to the Ames Airborne Tracking Sunphotometer (AATS-14) predecessor instrument, new technologies for each subsystem have been incorporated into 4STAR. In particular, 4STAR utilizes a modular sun-trackingsky-scanning optical head with fiber optic signal transmission to rack mounted spectrometers, permitting miniaturization of the external optical head, and spectrometerdetector configurations that may be tailored for specific scientific objectives. This paper discusses technical challenges relating to compact optical collector design, radiometric dynamic range and stability, and broad spectral coverage at high resolution. Test results benchmarking the performance of the instrument against the AATS-14 standard and emerging science requirements are presented.

Atmopheric Research (4STAR)↗
NASA NTRS2018

Constraints on the chemical enrichment history of the Perseus Cluster of galaxies from high-resolution X-ray spectroscopy

High-resolution spectroscopy of the core of the Perseus Cluster of galaxies, using the Hitomi satellite above 2 keV and the XMM–Newton Reflection Grating Spectrometer at lower energies, provides reliable constraints on the abundances of O, Ne, Mg, Si, S, Ar, Ca, Cr, Mn, Fe, and Ni. Accounting for all known systematic uncertainties, the Ar/Fe, Ca/Fe, and Ni/Fe ratios are determined with a remarkable precision of less than 10 per cent, while the constraints on Si/Fe, S/Fe, and Cr/Fe are at the 15 per cent level, and Mn/Fe is measured with a 20 percent uncertainty. The average biases in determining the chemical composition using archival CCD spectra from XMM–Newton and Suzaku typically range from 15 to 40 per cent. A simple model in which the enrichment pattern in the Perseus Cluster core and the protosolar nebula are identical gives a surprisingly good description of the high-resolution X-ray spectroscopy results, with X^2=10.7 for 10 degrees of freedom. However, this pattern is challenging to reproduce with linear combinations of existing supernova nucleosynthesis calculations, particularly given the precise measurements of intermediateα-elements enabled by Hitomi. We discuss in detail the degeneracies between various supernova progenitor models and explosion mechanisms, and the remaining uncertainties in these theoretical models. We suggest that including neutrino physics in the core-collapse supernova yield calculations may improve the agreement with the observed pattern ofα-elements in the Perseus Cluster core. Our results provide a complementary benchmark for testing future nucleosynthesis calculations required to understand the origin of chemical elements.

A Simionescu↗
NASA NTRS2022

The TRAPPIST-1 Habitable Atmosphere Intercomparison (THAI). I. Dry Cases—The Fellowship of the GCMs

With the commissioning of powerful, new-generation telescopes such as the James Webb Space Telescope (JWST) and the ground-based Extremely Large Telescopes, the first characterization of a high molecular weight atmosphere around a temperate rocky exoplanet is imminent. Atmospheric simulations and synthetic observables of target exoplanets are essential to prepare and interpret these observations. Here we report the results of the first part of the TRAPPIST-1 Habitable Atmosphere Intercomparison (THAI) project, which compares 3D numerical simulations performed with four state-of-the-art global climate models (ExoCAM, LMD-Generic, ROCKE-3D, Unified Model) for the potentially habitable target TRAPPIST-1e. In this first part, we present the results of dry atmospheric simulations. These simulations serve as a benchmark to test how radiative transfer, subgrid-scale mixing (dry turbulence and convection), and large-scale dynamics impact the climate of TRAPPIST-1e and consequently the transit spectroscopy signature as seen by JWST. To first order, the four models give results in good agreement. The intermodel spread in the global mean surface temperature amounts to 7 K (6 K) for the N2-dominated (CO2-dominated) atmosphere. The radiative fluxes are also remarkably similar (intermodel variations less than 5%), from the surface (1 bar) up to atmospheric pressures ∼5 mbar. Moderate differences between the models appear in the atmospheric circulation pattern (winds) and the (stratospheric) thermal structure. These differences arise between the models from (1) large-scale dynamics, because TRAPPIST-1e lies at the tipping point between two different circulation regimes (fast and Rhines rotators) in which the models can be alternatively trapped, and (2) parameterizations used in the upper atmosphere such as numerical damping.

Martin Turbet↗
NASA NTRSDate not supplied

Implementation of Two Local Correlation-Based Transition Models in OVERFLOW 2.3e

Accurate prediction of the laminar-to-turbulent boundary layer transition is highlighted as a vital component of NASA's CFD Vision 2030 Study. With an increased emphasis on greener air transports and sustainable aviation, transition modeling is anticipated to have an added significance, particularly in the applications related to laminar flow technology. However, unmanned aerial vehicles, crewed reentry vehicles, and ground-to-flight extrapolation all benefit from transition models. It is useful to incorporate a variety of models in CFD solvers because there isn't a single transition model that is ideal for the complete spectrum of applications. While the Langtry-Menter γ–Reθt model has been widely used for CFD predictions of flows with laminar, transitional, and turbulent boundary layers, it does not meet the criteria for Galilean invariance, a desirable attribute for rotorcraft applications. To help overcome that limitation, we have implemented Menter's SST-based γ transition model within NASA’s OVERFLOW Overset CFD code (version 2.3e). In addition, an SA-based implementation of the Langtry-Menter γ–Reθt transition model has also been implemented in view of the increased robustness of the SA-turbulence model for external aerodynamic applications. An initial assessment of the implemented models has been carried out using benchmark 2D test cases involving flat plates and the NLF-0416 airfoil, focusing on bypass, Tollmien-Schlichting, and laminar separation bubble-induced transition scenarios. In comparison to the Langtry-Menter γ–Reθt model, both models were found to produce increased computation efficiency, principally as a result of the decrease from four to three auxiliary transport equations. Results from the initial analysis will be presented, along with additional details pertaining to the deployment of these models.

CFD modeling↗
DOE OSTI2021

An Orthogonal Recursive Bisection (ORB) Based Time Advancement Algorithm for CFD-DEM Solvers

The time integration of the granular phase in coupled computational fluid dynamics (CFD) – discrete element method (DEM) simulations presents a unique computational challenge brought about by the large variations in particle collisional time scales. Particles in the dilute regions of the computational domain can be advanced with large time steps while dense regions require much smaller time increments. However, the time step size in most solvers is globally set as the limit for accuracy and stability imposed by the collisions and is typically orders of magnitude less than that required away from collisions. This work addresses this precise issue and provides a strategy to avoid the use of a global conservative small time step size for the entire set of particles.A novel time stepping algorithm for CFD-DEM solvers using a partitioning approach using orthogonal recursive bisection (ORB) that allows for variable time steps among particles is described and its computational performance is compared against baseline explicit methods, typically used in several CFD-DEM solvers. ORB has advantages of being relatively quick and easy to update incrementally and has the required heuristic behavior (i.e., it will split the region in half with a cluster on each side) when groups of particles are well separated (clustered). The algorithm presented in this work uses a local time stepping approach to resolve collisional time scales for subsets of particles that are present at the leaves of the ORB, thereby resulting in substantial reduction of computational cost. The parallel implementation of this method where a ``knapsack” algorithm is used in tandem with ORB for effective load-balancing is also presented, where a best possible partitioning is obtained based on number of particles and local time-stepping costs. The algorithm is tested against benchmark problems with varying particle distributions that include fluidized bed and riser flow scenarios. Preliminary results indicate that the approach is 2-3X faster than traditional explicit methods for problems that involve both dense and dilute regions, while maintaining the same level of accuracy.

adaptive timestepping↗
DOE OSTI2025

Updates to the HTR-PROTEUS HALEU Benchmark Using Modern Analysis Methodologies

The HTR-PROTEUS IRPhEP Handbook benchmarks represent some of the highest quality benchmarks available for systems with TRISO-HALEU fuel, graphite pebbles, graphite reflector, and high neutron leakage. Nevertheless, significant variability in computed eigenvalue results was encountered in HTR-PROTEUS configurations that are relevant for transportation configurations. The team will investigate the source of these variabilities in the original benchmark. In addition, the team will investigate the HTR-PROTEUS subcritical measurements, kinetics data, and potential criticality effects from the introduction of hydrogen in the system (water ingress). The project will generate a benchmark evaluation of additional HTR-PROTEUS measurements that can significantly increase the value of these criticality benchmarks in testing nuclear codes and data to support transportation validation needs for industry and the U.S. NRC.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Spin Splitting Energy of Transition Metals: A New, More Affordable Wave Function Benchmark Method and Its Use to Test Density Functional Theory

Accurately predicting the spin splitting energy of chemical species is important for understanding their reactivity and magnetic properties, but it is very challenging, especially for molecules containing transition metals. One impediment to progress is the scarcity of accurate benchmark data. Here we report a set of calculations designed to yield reliable benchmarks for simple transition-metal complexes that can be used to test density functional methods that are affordable for large systems of more practical interest. Various wave function methods are tested against experiment for Fe 2+ , Fe 3+ , and Co 3+ , including CASSCF, CASPT2, CASPT3, MRCISD, MRCISD+Q, ACPF, AQCC, CCSD(T), and CASPT2/CCSD(T) and also a new method called CASPT2.5, which is performed by taking the average of the CASPT2 and CASPT3 energies. Furthermore, we find that MRCISD+Q, ACPF, and AQCC require smaller active spaces for good accuracy than are required by CASPT2 and CASPT3, and this aspect may be important for calculations on larger molecules; here we find that CASPT2.5 extrapolated to a complete basis set is the most suitable method—in terms of computational cost and in terms of accuracy on monatomic systems—and therefore we chose this method for molecular benchmarks. Then Kohn–Sham density functional calculations with 60 exchange-correlation functionals are tested for FeF 2 , FeCl 2 , and CoF 2 . We find that MN15-L, M06-SX, and revM06 have very good agreement with CASPT2.5 benchmarks in terms of both the spin splitting energy and the optimized geometry for each spin state. In addition, we recommend def2-TZVP as the most suitable basis set to perform density functional calculations for molecular spin splitting energies; extra polarization functions in the basis set do not help to increase the accuracy of the spin splitting energy in KS calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

TRIPOLI-4 neutronics calculations for IAEA-CRP benchmark of CEFR start-up tests using new libraries JEFF-3.3 and ENDF/B-VIII

Sodium-cooled Fast Reactors (SFR) are one of the promising Generation IV fast reactors. The China Experimental Fast Reactor (CEFR) is a 65 MWth pool-type SFR with a high neutron leakage core using high enriched uranium oxide fuel. The CEFR start-up tests in 2010 consist of series of neutronics experiments. Essential experimental data are available from the 2018 IAEA-CEFR-CRP benchmark document and useful for the validation of neutron transport codes and nuclear data libraries. The TRIPOLI-4 Monte Carlo transport code is a general-purpose neutronics code using continuous-energy nuclear data libraries. It has a rich validation database covering different computational and experimental benchmark data sets to assure the accuracy and credibility of numerical studies. Previous TRIPOLI-4 SFR core physics calculations used mainly MOX fuels. SFR control rod worth studies with TRIPOLI-4 were mainly on big-size cores. To test the modeling capability of TRIPOLI-4 on fuel loading patterns and on variable control rods positions for SFRs and to check recent nuclear data libraries, it is interesting to investigate the CEFR start-up tests in this work, including core states from subcritical to supercritical, control rods and rod group worth, point kinetics parameters, and radial foil activation measurements. TRIPOLI-4 calculation results using new data libraries JEFF-3.3, ENDF/B-VIII, and those of ENDF/B-VII.1 for different CEFR core states are reported here. By means of different options of TRIPOLI-4, control-rod SAs reactivity worth, point kinetics parameters, and radial {sup 237}Np(n,f) fission rate distribution were successfully evaluated. Both ENDF/B-VIII and JEFF-3.3 nuclear data libraries provided reliable results with a difference of 170 +/- 11 pcm in k{sub eff}.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS2010

Experimental Creep Life Assessment for the Advanced Stirling Convertor Heater Head

The United States Department of Energy is planning to develop the Advanced Stirling Radioisotope Generator (ASRG) for the National Aeronautics and Space Administration (NASA) for potential use on future space missions. The ASRG provides substantial efficiency and specific power improvements over radioisotope power systems of heritage designs. The ASRG would use General Purpose Heat Source modules as energy sources and the free-piston Advanced Stirling Convertor (ASC) to convert heat into electrical energy. Lockheed Martin Corporation of Valley Forge, Pennsylvania, is integrating the ASRG systems, and Sunpower, Inc., of Athens, Ohio, is designing and building the ASC. NASA Glenn Research Center of Cleveland, Ohio, manages the Sunpower contract and provides technology development in several areas for the ASC. One area is reliability assessment for the ASC heater head, a critical pressure vessel within which heat is converted into mechanical oscillation of a displacer piston. For high system efficiency, the ASC heater head operates at very high temperature (850 C) and therefore is fabricated from an advanced heat-resistant nickel-based superalloy Microcast MarM-247. Since use of MarM-247 in a thin-walled pressure vessel is atypical, much effort is required to assure that the system will operate reliably for its design life of 17 years. One life-limiting structural response for this application is creep; creep deformation is the accumulation of time-dependent inelastic strain under sustained loading over time. If allowed to progress, the deformation eventually results in creep rupture. Since creep material properties are not available in the open literature, a detailed creep life assessment of the ASC heater head effort is underway. This paper presents an overview of that creep life assessment approach, including the reliability-based creep criteria developed from coupon testing, and the associated heater head deterministic and probabilistic analyses. The approach also includes direct benchmark experimental creep assessment. This element provides high-fidelity creep testing of prototypical heater head test articles to investigate the relevant material issues and multiaxial stress state. Benchmark testing provides required data to evaluate the complex life assessment methodology and to validate that analysis. Results from current benchmark heater head tests and newly developed experimental methods are presented. In the concluding remarks, the test results are shown to compare favorably with the creep strain predictions and are the first experimental evidence for a robust ASC heater head creep life.

Krause, David L.↗
DOE OSTI2025

ON THE EFFECTIVENESS OF LLMS IN UNIT TEST GENERATION FOR STRUCTURED TEXT PROGRAMS

The reliability of industrial automation systems heavily depends on the correctness of Programmable Logic Controller (PLC) programs, which are often written in Structured Text (ST). While Large Language Models (LLMs) have shown promise in automating test generation for mainstream programming languages, their effectiveness for the syntactically strict ST language remains underexplored. This thesis presents a systematic empirical evaluation of three state-of-the-art LLMs—GPT-4o, Gemini 2.5 Pro, and Claude Sonnet 4.5—for generating ST unit tests. We examine three prompting strategies: Natural Language (NL), Code Language (CL), and Chain-of-Thought (CoT), across a curated set of 11 ST function blocks. The quality of the generated tests is assessed using Compilation Success Rate (CSR), Statement Coverage (SC), and Branch Coverage (BC). In the zero-shot setting, Claude Sonnet 4.5 achieves the highest CSR, while Gemini 2.5 Pro consistently delivers the best statement and branch coverage, particularly under CL prompts. By incorporating a one-shot CL prompt, all models exhibit substantial improvements—most notably GPT-4o, whose CSR increases from 45.45% to 90.91%, with substantial gains in both SC and BC. To further contextualize these findings, we compare GPT-4o’s one-shot results with PLCAutoTester, a state-ofthe- art ST unit test generation tool, on an additional benchmark dataset. While LLMgenerated tests approach competitive coverage levels, PLCAutoTester maintains significantly higher and more stable coverage across programs. This study provides the first comprehensive benchmark of modern LLMs for ST unit testing, highlighting their strengths, limitations, and improvements through one-shot prompting, and positioning their performance relative to specialized automated testing tools in industrial automation.

42 ENGINEERING↗
NASA NTRS1995

High Reynolds Number Effects on Multi-Hole Probes and Hot Wire Anemometers

The paper reports on the results from an experimental investigation of the response of multi-hole and hot wire probes at high flow Reynolds numbers (Re approx. 10(exp 6)). The limited results available in literature for 5-hole probes are restricted to Re approx. 10(exp 4). The experiment aims to investigate the probe response (in terms of dimensionless pressure ratios, characterizing pitch, and yaw angles and the total and static pressures) at high Re values and to gauge their effect on the calculated velocity vector. Hot wire calibrations were also undertaken with a parametric variation of the flow pressure, velocity and temperature. Different correction and calibration schemes are sought to be tested against the acquired data set. The data is in the analysis stage at the present time. The test provided good benchmark quality data that can be used to test future calibration and testing methods.

Ramachandran, N.↗
DOE OSTI2020

Exploring Hilbert space on a budget: Novel benchmark set and performance metric for testing electronic structure methods in the regime of strong correlation

This work explores the ability of classical electronic structure methods to efficiently represent (compress) the information content of full configuration interaction (FCI) wave functions. We introduce a benchmark set of four hydrogen model systems of different dimensionalities and distinctive electronic structures: a 1D chain, a 1D ring, a 2D triangular lattice, and a 3D close-packed pyramid. To assess the ability of a computational method to produce accurate and compact wave functions, we introduce the accuracy volume, a metric that measures the number of variational parameters necessary to achieve a target energy error. Using this metric and the hydrogen models, we examine the performance of three classical deterministic methods: (i) selected configuration interaction (sCI) realized both via an a posteriori (ap-sCI) and variational selection of the most important determinants, (ii) an a posteriori singular value decomposition (SVD) of the FCI tensor (SVD-FCI), and (iii) the matrix product state representation obtained via the density matrix renormalization group (DMRG). We find that the DMRG generally gives the most efficient wave function representation for all systems, particularly in the 1D chain with a localized basis. For the 2D and 3D systems, all methods (except DMRG) perform best with a delocalized basis, and the efficiency of sCI and SVD-FCI is closer to that of DMRG. For larger analogs of the models, the DMRG consistently requires the fewest parameters but still scales exponentially in 2D and 3D systems, and the performance of SVD-FCI is essentially equivalent to that of ap-sCI.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1988

Space station operating system study

The current phase of the Space Station Operating System study is based on the analysis, evaluation, and comparison of the operating systems implemented on the computer systems and workstations in the software development laboratory. Primary emphasis has been placed on the DEC MicroVMS operating system as implemented on the MicroVax II computer, with comparative analysis of the SUN UNIX system on the SUN 3/260 workstation computer, and to a limited extent, the IBM PC/AT microcomputer running PC-DOS. Some benchmark development and testing was also done for the Motorola MC68010 (VM03 system) before the system was taken from the laboratory. These systems were studied with the objective of determining their capability to support Space Station software development requirements, specifically for multi-tasking and real-time applications. The methodology utilized consisted of development, execution, and analysis of benchmark programs and test software, and the experimentation and analysis of specific features of the system or compilers in the study.

Horn, Albert E.↗