Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

DSMC Simulations of Hypersonic Flows and Comparison With Experiments

This paper presents computational results obtained with the direct simulation Monte Carlo (DSMC) method for several biconic test cases in which shock interactions and flow separation-reattachment are key features of the flow. Recent ground-based experiments have been performed for several biconic configurations, and surface heating rate and pressure measurements have been proposed for code validation studies. The present focus is to expand on the current validating activities for a relatively new DSMC code called DS2V that Bird (second author) has developed. Comparisons with experiments and other computations help clarify the agreement currently being achieved between computations and experiments and to identify the range of measurement variability of the proposed validation data when benchmarked with respect to the current computations. For the test cases with significant vibrational nonequilibrium, the effect of the vibrational energy surface accommodation on heating and other quantities is demonstrated.

Moss, James N.↗

Global Gridded Crop Model Evaluation: Benchmarking, Skills, Deficiencies and Implications.

Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.

wheat↗

Contra-Rotating Open Rotor Tone Noise Prediction

Reliable prediction of contra-rotating open rotor (CROR) noise is an essential element of any strategy for the development of low-noise open rotor propulsion systems that can meet both the community noise regulations and the cabin noise limits. Since CROR noise spectra typically exhibits a preponderance of tones, significant efforts have been directed towards predicting their tone spectra. To that end, there has been an ongoing effort at NASA to assess various in-house open rotor tone noise prediction tools using a benchmark CROR blade set for which significant aerodynamic and acoustic data had been acquired in wind tunnel tests. In the work presented here, the focus is on the near-field noise of the benchmark open rotor blade set at the cruise condition. Using an analytical CROR tone noise model with input from high-fidelity aerodynamic simulations, detailed tone noise spectral predictions have been generated and compared with the experimental data. Comparisons indicate that the theoretical predictions are in good agreement with the data, especially for the dominant CROR tones and their overall sound pressure level. The results also indicate that, whereas individual rotor tones are well predicted by the linear sources (i.e., thickness and loading), for the interaction tones it is essential that the quadrupole sources be included in the analysis.

Propeller Noise↗

Demonstration of Fabry-Perot interferometric spectrometry technology

As rocket engine components experience wear or failure, anomalous materials may be entrained in the plume. Historically, visible plume anomalies have preceded many rocket engine failures, some of which have been catastrophic. Development of a small, rugged, high-speed, high resolution Fabry-Perot interferometer (FPI) based spectrometer capable of detecting the spectral signatures of eroding engine components during rocket engine test and/or flight operations is described. An operational plume spectrometer fabricated with miniaturized optics has been successfully tested. An extensive test series was conducted to define the limits of the spectrometer with respect to time-response and resolution. The data collected during testing were correlated with measurements obtained using sensitive ground equipment in order to benchmark the spectrometer's performance against a known device. The FPI demonstrated the reliability required for a flight instrument by functioning satisfactorily at or near the rocket engine test stand environment. Several of the optical components are interchangeable, allowing collection of a greater variety of plume signals. Also, the FPI's high resolution capabilities suggest it is suitable for application to both absorption and emission spectroscopy.

Petersen, T. V.↗

Venus mesosphere and thermosphere. III - Three-dimensional general circulation with coupled dynamics and composition

The three-dimensional structure and circulation of Venus' upper mesosphere and thermosphere is examined by means of a modification of NCAR's earth thermosphere general circulation model, using the parameterizations from an earlier two-dimensional Venus model that included eddy diffusion and wave drag. Many of the observed Venus thermosphere features are found to be reproduced by the model, which thereby serves as a benchmark on which to incorporate additional minor constituents and test new self-consistent parameterizations for wave drag and superrotation.

Bougher, S. W.↗

Investigation of Error Patterns in Geographical Databases

The objective of the research conducted in this project is to develop a methodology to investigate the accuracy of Airport Safety Modeling Data (ASMD) using statistical, visualization, and Artificial Neural Network (ANN) techniques. Such a methodology can contribute to answering the following research questions: Over a representative sampling of ASMD databases, can statistical error analysis techniques be accurately learned and replicated by ANN modeling techniques? This representative ASMD sample should include numerous airports and a variety of terrain characterizations. Is it possible to identify and automate the recognition of patterns of error related to geographical features? Do such patterns of error relate to specific geographical features, such as elevation or terrain slope? Is it possible to combine the errors in small regions into an error prediction for a larger region? What are the data density reduction implications of this work? ASMD may be used as the source of terrain data for a synthetic visual system to be used in the cockpit of aircraft when visual reference to ground features is not possible during conditions of marginal weather or reduced visibility. In this research, United States Geologic Survey (USGS) digital elevation model (DEM) data has been selected as the benchmark. Artificial Neural Networks (ANNS) have been used and tested as alternate methods in place of the statistical methods in similar problems. They often perform better in pattern recognition, prediction and classification and categorization problems. Many studies show that when the data is complex and noisy, the accuracy of ANN models is generally higher than those of comparable traditional methods.

Dryer, David↗

Experimentation Toward the Analysis of Gear Noise Sources Controlled by Sliding Friction and Surface Roughness

In helicopters and other rotorcraft, the gearbox is a major source of noise and vibration (N&V). The two N&V excitation mechanisms are the relative displacements between mating gears (transmission errors) and the friction associated with sliding between gear teeth. Historically, transmission errors have been minimized via improved manufacturing accuracies and tooth modifications. Yet, at high torque loads, noise levels are still relatively high though transmission errors might be somewhat minimal. This suggests that sliding friction is indeed a dominant noise source for high power density rotorcraft gearboxes. In reality, friction source mechanism is associated with surface roughness, lubrication regime properties, time-varying friction forces/torques and gear-mesh interface dynamics. Currently, the nature of these mechanisms is not well understood, while there is a definite need for analytical tools that incorporate sliding resistance and surface roughness, and predict their effects on the vibro- acoustic behavior of gears. Toward this end, an experiment was conducted to collect sound and vibration data on the NASA Glenn Gear-Noise Rig. Three iterations of the experiment were accomplished: Iteration 1 tested a baseline set of gears to establish a benchmark. Iteration 2 used a gear-set with low surface asperities to reduce the sliding friction excitation. Iteration 3 incorporated low viscosity oil with the baseline set of gears to examine the effect of lubrication. The results from this experiment will contribute to a two year project in collaboration with the Ohio State University to develop the necessary mathematical and computer models for analyzing geared systems and explain key physical phenomena seen in experiments. Given the importance of sliding friction in the gear dynamic and vibro-acoustic behavior of rotorcraft gearboxes, there is considerable potential for research & developmental activities. Better models and understanding will lead to quiet and reliable gear designs, as well as the selection of optimal manufacturing processes.

Asnani, Vivake M.↗

Experimental Results for an Annular Aerospike with Differential Throttling

A) MSFC funded an internal study on Altitude Compensating Nozzles: 1) Develop an ACN design and performance prediction tool. 2) Design, build and test cold flow ACN nozzles. 3) An annular aerospike nozzle was designed and tested. 4) Incorporated differential throttling to assess Thrust Vector Control. B) Objective of the test hardware: 1) Provide design tool verification. 2) Provide benchmark data for CFD calculations. 3) Experimentally measure side force, or TVC, for a differentially throttled annular aerospike.

Ruf, Joseph H.↗

Systematic Benchmarking of Diagnostic Technologies for an Electrical Power System

Automated health management is a critical functionality for complex aerospace systems. A wide variety of diagnostic algorithms have been developed to address this technical challenge. Unfortunately, the lack of support to perform large-scale V&V (verification and validation) of diagnostic technologies continues to create barriers to effective development and deployment of such algorithms for aerospace vehicles. In this paper, we describe a formal framework developed for benchmarking of diagnostic technologies. The diagnosed system is the Advanced Diagnostics and Prognostics Testbed (ADAPT), a real-world electrical power system (EPS), developed and maintained at the NASA Ames Research Center. The benchmarking approach provides a systematic, empirical basis to the testing of diagnostic software and is used to provide performance assessment for different diagnostic algorithms.

Kurtoglu, Tolga↗

Open Rotor Tone Shielding Methods for System Noise Assessments Using Multiple Databases

Advanced aircraft designs such as the hybrid wing body, in conjunction with open rotor engines, may allow for significant improvements in the environmental impact of aviation. System noise assessments allow for the prediction of the aircraft noise of such designs while they are still in the conceptual phase. Due to significant requirements of computational methods, these predictions still rely on experimental data to account for the interaction of the open rotor tones with the hybrid wing body airframe. Recently, multiple aircraft system noise assessments have been conducted for hybrid wing body designs with open rotor engines. These assessments utilized measured benchmark data from a Propulsion Airframe Aeroacoustic interaction effects test. The measured data demonstrated airframe shielding of open rotor tonal and broadband noise with legacy F7/A7 open rotor blades. Two methods are proposed for improving the use of these data on general open rotor designs in a system noise assessment. The first, direct difference, is a simple octave band subtraction which does not account for tone distribution within the rotor acoustic signal. The second, tone matching, is a higher-fidelity process incorporating additional physical aspects of the problem, where isolated rotor tones are matched by their directivity to determine tone-by-tone shielding. A case study is conducted with the two methods to assess how well each reproduces the measured data and identify the merits of each. Both methods perform similarly for system level results and successfully approach the experimental data for the case study. The tone matching method provides additional tools for assessing the quality of the match to the data set. Additionally, a potential path to improve the tone matching method is provided.

Bahr, Christopher J.↗

Chemical Modeling of the Reactivity of Short-Lived Greenhouse Gases: A Model Inter-Comparison Prescribing a Well-Measured, Remote Troposphere

We develop a new protocol for merging in situ measurements with 3-D model simulations of atmospheric chemistry with the goal of integrating over the data to identify the most reactive air parcels in terms of tropospheric production and loss of the greenhouse gases ozone and methane. Presupposing that we can accurately measure atmospheric composition, we examine whether models constrained by such measurements agree on the chemical budgets for ozone and methane. In applying our technique to a synthetic data stream of 14,880 parcels along 180W, we are able to isolate the performance of the photochemical modules operating within their global chemistry-climate and chemistry-transport models, removing the effects of modules controlling tracer transport, emissions, and scavenging. Differences in reactivity across models are driven only by the chemical mechanism and the diurnal cycle of photolysis rates, which are driven in turn by temperature, water vapor, solar zenith angle, clouds, and possibly aerosols and overhead ozone, which are calculated in each model. We evaluate six global models and identify their differences and similarities in simulating the chemistry through a range of innovative diagnostics. All models agree that the more highly reactive parcels dominate the chemistry (e.g., the hottest 10% of parcels control 25-30% of the total reactivities), but do not fully agree on which parcels comprise the top 10%. Distinct differences in specific features occur, including the regions of maximum ozone production and methane loss, as well as in the relationship between photolysis and these reactivities. Unique, possibly aberrant, features are identified for each model, providing a benchmark for photochemical module development. Among the 6 models tested here, 3 are almost indistinguishable based on the inherent variability caused by clouds, and thus we identify 4, effectively distinct, chemical models. Based on this work, we suggest that water vapor differences in model simulations of past and future atmospheres may be a cause of the different evolution of tropospheric O3 and CH4, and lead to different chemistry-climate feedbacks across the models.

greenhouse gases↗

Results of the KRUSTY Warm Critical Experiments

The Kilowatt Reactor Using Stirling TechnologY (KRUSTY) was a prototypic nuclear-powered test of a 5-kW(thermal) Kilopower space reactor. This paper presents results from the KRUSTY warm critical experiments, which were completed prior to the final system test. The first set of criticals comprised cold or zero-power criticals; i.e., the core was not heated by fission power. These were followed by three warm criticals, where fission power heated the core to 200°C, 300°C, and 450°C, respectively. These criticals provided the data, confidence, and regulatory framework that were needed to proceed with the KRUSTY nuclear system test. The criticals also provided valuable data for the benchmarking of codes applicable to all nuclear systems. Finally, a comparison of KRUSTY results to pretest predictions is provided, and overall, the models matched the experimental results very closely.

David I. Poston↗

Summary of Shock Wave Turbulent Boundary Layer Interaction Experiments In a Circular Test Section

A series of experiments were performed at Mach 2.5 in a 17 cm diameter circular test section to characterize an impinging/reflected shock wave turbulent boundary layer interaction generated by a cone-cylinder centerbody. The cone-cylinder centerbody generates a conical shock wave that interacts with the naturally occurring boundary layer developing on the test section wall. Three different cone angles were used in the experiment to study unseparated, incipiently separated, and separated interactions. When the cone-cylinder centerbody is positioned on the centerline, a flowfield which is two-dimensional in the mean is generated. Three dimensional interactions were also created by offsetting the cone-cylinder centerbody from the test section centerline. The results are intended to provide benchmark quality datasets for computational fluid dynamics (CFD) validation without the pitfalls inherent in rectangular configurations where corner effects prohibit a truly two-dimensional flow in the mean. The experimental measurements included surface flow visualization, wall static pressure, flowfield Pitot tube pressure, constant-voltage anemometry (CVA) normal hot-wire, and particle image velocimetry (PIV) measurements. The hot-wire measurements were used to calculate mean mass flux and total temperature profiles, mass flux and total temperature turbulence intensities, and the mass flux-total temperature correlation. The PIV measurements provide three-dimensional mean velocity measurements. Agreement between the pressure, hot-wire, and PIV measurements is established in the undisturbed upstream flowfield.

Supersonic↗

Summary of Shock Wave Turbulent Boundary Layer Interaction Experiments in a Circular Test Section

A series of experiments were performed at Mach 2.5 in a 17 cm diameter circular test section to characterize an impinging/reflected shock wave turbulent boundary layer interaction generated by a cone-cylinder centerbody. The cone-cylinder centerbody generates a conical shock wave that interacts with the naturally occurring boundary layer developing on the test section wall. Three different cone angles were used in the experiment to study unseparated, incipiently separated, and separated interactions. When the cone-cylinder centerbody is positioned on the centerline, a flowfield which is two-dimensional in the mean is generated. Three dimensional interactions were also created by offsetting the cone-cylinder centerbody from the test section centerline. The results are intended to provide benchmark quality datasets for computational fluid dynamics (CFD) validation without the pitfalls inherent in rectangular configurations where corner effects prohibit a truly two-dimensional flow in the mean. The experimental measurements included surface flow visualization, wall static pressure, flowfield Pitot tube pressure, constant-voltage anemometry (CVA) normal hot-wire, and particle image velocimetry (PIV) measurements. The hot-wire measurements were used to calculate mean mass flux and total temperature profiles, mass flux and total temperature turbulence intensities, and the mass flux-total temperature correlation. The PIV measurements provide three-dimensional mean velocity measurements. Agreement between the pressure, hot-wire, and PIV measurements is established in the undisturbed upstream flowfield.

compressible flow↗

Benchmarking the Collocation Stand-Alone Library and Toolkit (CSALT)

This paper describes the processes and results of Verification and Validation (VV) efforts for the Collocation Stand Alone Library and Toolkit (CSALT). We describe the test program and environments, the tools used for independent test data, and comparison results. The VV effort employs classical problems with known analytic solutions, solutions from other available software tools, and comparisons to benchmarking data available in the public literature. Presenting all test results are beyond the scope of a single paper. Here we present high-level test results for a broad range of problems, and detailed comparisons for selected problems.

trajectory optimization↗

Verification Test Suite for Spalart-Allmaras QCR2000 Turbulence Model

The paper presents three benchmark cases for verification of Reynolds-averaged Navier-Stokes solvers. The verification studies focus on a one-equation Spalart-Allmaras model, SA-[neg]-QCR2000, that uses a version of quadratic constitutive relations.The benchmark cases are a two-dimensional subsonic flow around a Joukowski airfoil, a three-dimensional supersonic flow through a square duct, and a three-dimensional flow over a wing-fuselage configuration. The turbulence-model formulation, geometry, flow conditions, grids, and the expected output are described in detail. Reference solutions computed by several established codes are shown

Computational Aerodynamics↗

Improved Modeling of Finite-Rate Turbulent Combustion Processes in Research Combustors

The objective of this thesis is to further develop and test a stochastic model of turbulent combustion in recirculating flows. There is a requirement to increase the accuracy of multi-dimensional combustion predictions. As turbulence affects reaction rates, this interaction must be more accurately evaluated. In this work a more physically correct way of handling the interaction of turbulence on combustion is further developed and tested. As turbulence involves randomness, stochastic modeling is used. Averaged values such as temperature and species concentration are found by integrating the probability density function (pdf) over the range of the scalar. The model in this work does not assume the pdf type, but solves for the evolution of the pdf using the Monte Carlo solution technique. The model is further developed by including a more robust reaction solver, by using accurate thermodynamics and by more accurate transport elements. The stochastic method is used with Semi-Implicit Method for Pressure-Linked Equations. The SIMPLE method is used to solve for velocity, pressure, turbulent kinetic energy and dissipation. The pdf solver solves for temperature and species concentration. Thus, the method is partially familiar to combustor engineers. The method is compared to benchmark experimental data and baseline calculations. The baseline method was tested on isothermal flows, evaporating sprays and combusting sprays. Pdf and baseline predictions were performed for three diffusion flames and one premixed flame. The pdf method predicted lower combustion rates than the baseline method in agreement with the data, except for the premixed flame. The baseline and stochastic predictions bounded the experimental data for the premixed flame. The use of a continuous mixing model or relax to mean mixing model had little effect on the prediction of average temperature. Two grids were used in a hydrogen diffusion flame simulation. Grid density did not effect the predictions except for peak temperature and tangential velocity. The hybrid pdf method did take longer and required more memory, but has a theoretical basis to extend to many reaction steps which cannot be said of current turbulent combustion models.

VanOverbeke, Thomas J.↗

Benchmarking the Collocation Stand-Alone Library and Toolkit (CSALT)

This paper describes the processes and results of Verification and Validation (V&V) efforts for the Collocation Stand Alone Library and Toolkit (CSALT). We describe the test program and environments, the tools used for independent test data, and comparison results. The V&V effort employs classical problems with known analytic solutions, solutions from other available software tools, and comparisons to benchmarking data available in the public literature. Presenting all test results are beyond the scope of a single paper. Here we present high-level test results for a broad range of problems, and detailed comparisons for selected problems.

optimal control↗