Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Sensitivity Analysis of Multidisciplinary Rotorcraft Simulations

A multidisciplinary sensitivity analysis of rotorcraft simulations involving tightly coupled high-fidelity computational fluid dynamics and comprehensive analysis solvers is presented and evaluated. An unstructured sensitivity-enabled Navier-Stokes solver, FUN3D, and a nonlinear flexible multibody dynamics solver, DYMORE, are coupled to predict the aerodynamic loads and structural responses of helicopter rotor blades. A discretely-consistent adjoint-based sensitivity analysis available in FUN3D provides sensitivities arising from unsteady turbulent flows and unstructured dynamic overset meshes, while a complex-variable approach is used to compute DYMORE structural sensitivities with respect to aerodynamic loads. The multidisciplinary sensitivity analysis is conducted through integrating the sensitivity components from each discipline of the coupled system. Numerical results verify accuracy of the FUN3D/DYMORE system by conducting simulations for a benchmark rotorcraft test model and comparing solutions with established analyses and experimental data. Complex-variable implementation of sensitivity analysis of DYMORE and the coupled FUN3D/DYMORE system is verified by comparing with real-valued analysis and sensitivities. Correctness of adjoint formulations for FUN3D/DYMORE interfaces is verified by comparing adjoint-based and complex-variable sensitivities. Finally, sensitivities of the lift and drag functions obtained by complex-variable FUN3D/DYMORE simulations are compared with sensitivities computed by the multidisciplinary sensitivity analysis, which couples adjoint-based flow and grid sensitivities of FUN3D and FUN3D/DYMORE interfaces with complex-variable sensitivities of DYMORE structural responses.

Wang, Li↗
NASA NTRS2017

Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) Instrument Improvements

The Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) combines airborne sun tracking and sky scanning with grating spectroscopy to improve knowledge of atmospheric constituents and their links to air-pollution and climate. Hyper-spectral measurements of direct-beam solar irradiance provide retrievals of gas constituents, aerosol optical depth, and aerosol and thin cloud optical properties. Sky radiance measurements in the principal and almucantar planes enhance retrievals of aerosol absorption, aerosol type, and size mode distribution. Zenith radiance measurements are used to retrieve cloud properties and phase, which in turn are used to quantify the radiative transfer below cloud layers. These airborne measurements tighten the closure between satellite and ground-based measurements. In contrast to the Ames Airborne Tracking Sunphotometer (AATS-14) predecessor instrument, new technologies for each subsystem have been incorporated into 4STAR. In particular, 4STAR utilizes a modular sun-trackingsky-scanning optical head with fiber optic signal transmission to rack mounted spectrometers, permitting miniaturization of the external optical head, and spectrometerdetector configurations that may be tailored for specific scientific objectives. This paper discusses technical challenges relating to compact optical collector design, radiometric dynamic range and stability, and broad spectral coverage at high resolution. Test results benchmarking the performance of the instrument against the AATS-14 standard and emerging science requirements are presented.

Atmopheric Research (4STAR)↗
NASA NTRS2018

Constraints on the chemical enrichment history of the Perseus Cluster of galaxies from high-resolution X-ray spectroscopy

High-resolution spectroscopy of the core of the Perseus Cluster of galaxies, using the Hitomi satellite above 2 keV and the XMM–Newton Reflection Grating Spectrometer at lower energies, provides reliable constraints on the abundances of O, Ne, Mg, Si, S, Ar, Ca, Cr, Mn, Fe, and Ni. Accounting for all known systematic uncertainties, the Ar/Fe, Ca/Fe, and Ni/Fe ratios are determined with a remarkable precision of less than 10 per cent, while the constraints on Si/Fe, S/Fe, and Cr/Fe are at the 15 per cent level, and Mn/Fe is measured with a 20 percent uncertainty. The average biases in determining the chemical composition using archival CCD spectra from XMM–Newton and Suzaku typically range from 15 to 40 per cent. A simple model in which the enrichment pattern in the Perseus Cluster core and the protosolar nebula are identical gives a surprisingly good description of the high-resolution X-ray spectroscopy results, with X^2=10.7 for 10 degrees of freedom. However, this pattern is challenging to reproduce with linear combinations of existing supernova nucleosynthesis calculations, particularly given the precise measurements of intermediateα-elements enabled by Hitomi. We discuss in detail the degeneracies between various supernova progenitor models and explosion mechanisms, and the remaining uncertainties in these theoretical models. We suggest that including neutrino physics in the core-collapse supernova yield calculations may improve the agreement with the observed pattern ofα-elements in the Perseus Cluster core. Our results provide a complementary benchmark for testing future nucleosynthesis calculations required to understand the origin of chemical elements.

A Simionescu↗
NASA NTRS2022

The TRAPPIST-1 Habitable Atmosphere Intercomparison (THAI). I. Dry Cases—The Fellowship of the GCMs

With the commissioning of powerful, new-generation telescopes such as the James Webb Space Telescope (JWST) and the ground-based Extremely Large Telescopes, the first characterization of a high molecular weight atmosphere around a temperate rocky exoplanet is imminent. Atmospheric simulations and synthetic observables of target exoplanets are essential to prepare and interpret these observations. Here we report the results of the first part of the TRAPPIST-1 Habitable Atmosphere Intercomparison (THAI) project, which compares 3D numerical simulations performed with four state-of-the-art global climate models (ExoCAM, LMD-Generic, ROCKE-3D, Unified Model) for the potentially habitable target TRAPPIST-1e. In this first part, we present the results of dry atmospheric simulations. These simulations serve as a benchmark to test how radiative transfer, subgrid-scale mixing (dry turbulence and convection), and large-scale dynamics impact the climate of TRAPPIST-1e and consequently the transit spectroscopy signature as seen by JWST. To first order, the four models give results in good agreement. The intermodel spread in the global mean surface temperature amounts to 7 K (6 K) for the N2-dominated (CO2-dominated) atmosphere. The radiative fluxes are also remarkably similar (intermodel variations less than 5%), from the surface (1 bar) up to atmospheric pressures ∼5 mbar. Moderate differences between the models appear in the atmospheric circulation pattern (winds) and the (stratospheric) thermal structure. These differences arise between the models from (1) large-scale dynamics, because TRAPPIST-1e lies at the tipping point between two different circulation regimes (fast and Rhines rotators) in which the models can be alternatively trapped, and (2) parameterizations used in the upper atmosphere such as numerical damping.

Martin Turbet↗
NASA NTRSDate not supplied

Implementation of Two Local Correlation-Based Transition Models in OVERFLOW 2.3e

Accurate prediction of the laminar-to-turbulent boundary layer transition is highlighted as a vital component of NASA's CFD Vision 2030 Study. With an increased emphasis on greener air transports and sustainable aviation, transition modeling is anticipated to have an added significance, particularly in the applications related to laminar flow technology. However, unmanned aerial vehicles, crewed reentry vehicles, and ground-to-flight extrapolation all benefit from transition models. It is useful to incorporate a variety of models in CFD solvers because there isn't a single transition model that is ideal for the complete spectrum of applications. While the Langtry-Menter γ–Reθt model has been widely used for CFD predictions of flows with laminar, transitional, and turbulent boundary layers, it does not meet the criteria for Galilean invariance, a desirable attribute for rotorcraft applications. To help overcome that limitation, we have implemented Menter's SST-based γ transition model within NASA’s OVERFLOW Overset CFD code (version 2.3e). In addition, an SA-based implementation of the Langtry-Menter γ–Reθt transition model has also been implemented in view of the increased robustness of the SA-turbulence model for external aerodynamic applications. An initial assessment of the implemented models has been carried out using benchmark 2D test cases involving flat plates and the NLF-0416 airfoil, focusing on bypass, Tollmien-Schlichting, and laminar separation bubble-induced transition scenarios. In comparison to the Langtry-Menter γ–Reθt model, both models were found to produce increased computation efficiency, principally as a result of the decrease from four to three auxiliary transport equations. Results from the initial analysis will be presented, along with additional details pertaining to the deployment of these models.

CFD modeling↗
NASA NTRS2010

Experimental Creep Life Assessment for the Advanced Stirling Convertor Heater Head

The United States Department of Energy is planning to develop the Advanced Stirling Radioisotope Generator (ASRG) for the National Aeronautics and Space Administration (NASA) for potential use on future space missions. The ASRG provides substantial efficiency and specific power improvements over radioisotope power systems of heritage designs. The ASRG would use General Purpose Heat Source modules as energy sources and the free-piston Advanced Stirling Convertor (ASC) to convert heat into electrical energy. Lockheed Martin Corporation of Valley Forge, Pennsylvania, is integrating the ASRG systems, and Sunpower, Inc., of Athens, Ohio, is designing and building the ASC. NASA Glenn Research Center of Cleveland, Ohio, manages the Sunpower contract and provides technology development in several areas for the ASC. One area is reliability assessment for the ASC heater head, a critical pressure vessel within which heat is converted into mechanical oscillation of a displacer piston. For high system efficiency, the ASC heater head operates at very high temperature (850 C) and therefore is fabricated from an advanced heat-resistant nickel-based superalloy Microcast MarM-247. Since use of MarM-247 in a thin-walled pressure vessel is atypical, much effort is required to assure that the system will operate reliably for its design life of 17 years. One life-limiting structural response for this application is creep; creep deformation is the accumulation of time-dependent inelastic strain under sustained loading over time. If allowed to progress, the deformation eventually results in creep rupture. Since creep material properties are not available in the open literature, a detailed creep life assessment of the ASC heater head effort is underway. This paper presents an overview of that creep life assessment approach, including the reliability-based creep criteria developed from coupon testing, and the associated heater head deterministic and probabilistic analyses. The approach also includes direct benchmark experimental creep assessment. This element provides high-fidelity creep testing of prototypical heater head test articles to investigate the relevant material issues and multiaxial stress state. Benchmark testing provides required data to evaluate the complex life assessment methodology and to validate that analysis. Results from current benchmark heater head tests and newly developed experimental methods are presented. In the concluding remarks, the test results are shown to compare favorably with the creep strain predictions and are the first experimental evidence for a robust ASC heater head creep life.

Krause, David L.↗
NASA NTRS1995

High Reynolds Number Effects on Multi-Hole Probes and Hot Wire Anemometers

The paper reports on the results from an experimental investigation of the response of multi-hole and hot wire probes at high flow Reynolds numbers (Re approx. 10(exp 6)). The limited results available in literature for 5-hole probes are restricted to Re approx. 10(exp 4). The experiment aims to investigate the probe response (in terms of dimensionless pressure ratios, characterizing pitch, and yaw angles and the total and static pressures) at high Re values and to gauge their effect on the calculated velocity vector. Hot wire calibrations were also undertaken with a parametric variation of the flow pressure, velocity and temperature. Different correction and calibration schemes are sought to be tested against the acquired data set. The data is in the analysis stage at the present time. The test provided good benchmark quality data that can be used to test future calibration and testing methods.

Ramachandran, N.↗
NASA NTRS1988

Space station operating system study

The current phase of the Space Station Operating System study is based on the analysis, evaluation, and comparison of the operating systems implemented on the computer systems and workstations in the software development laboratory. Primary emphasis has been placed on the DEC MicroVMS operating system as implemented on the MicroVax II computer, with comparative analysis of the SUN UNIX system on the SUN 3/260 workstation computer, and to a limited extent, the IBM PC/AT microcomputer running PC-DOS. Some benchmark development and testing was also done for the Motorola MC68010 (VM03 system) before the system was taken from the laboratory. These systems were studied with the objective of determining their capability to support Space Station software development requirements, specifically for multi-tasking and real-time applications. The methodology utilized consisted of development, execution, and analysis of benchmark programs and test software, and the experimentation and analysis of specific features of the system or compilers in the study.

Horn, Albert E.↗
NASA NTRS2003

Reference Gauging System for a Small-Scale Liquid Hydrogen Tank

A system to accurately weigh the fluid contents of a small-scale liquid hydrogen test tank has been experimentally verified. It is intended for use as a reference or benchmark system when testing lowgravity liquid quantity gauging concepts in the terrestrial environment. The reference gauging system has shown a repeatable measurement accuracy of better than 0.5 percent of the full tank liquid weight. With further refinement, the system accuracy can be improved to within 0.10 percent of full scale. This report describes the weighing system design, calibration, and operational results. Suggestions are given for further refinement of the system. An example is given to illustrate additional sources of uncertainty when mass measurements are converted to volume equivalents. Specifications of the companion test tank and its multi-layer insulation system are provided.

VanDresar, Neil T.↗
NASA NTRS2005

Liquid Nitrogen Removal of Critical Aerospace Materials

Identification of innovative solutions to unique materials problems is an every-day quest for members of the aerospace community. Finding a technique that will minimize costs, maximize throughput, and generate quality results is always the target. United Space Alliance Materials Engineers recently conducted such a search in their drive to return the Space Shuttle fleet to operational status. The removal of high performance thermal coatings from solid rocket motors represents a formidable task during post flight disassembly on reusable expended hardware. The removal of these coatings from unfired motors increases the complexity and safety requirements while reducing the available facilities and approved processes. A temporary solution to this problem was identified, tested and approved during the Solid Rocket Booster (SRB) return to flight activities. Utilization of ultra high-pressure liquid nitrogen (LN2) to strip the protective coating from assembled space shuttle hardware marked the first such use of the technology in the aerospace industry. This process provides a configurable stream of liquid nitrogen (LN2) at pressures of up to 55,000 psig. The performance of a one-time certification for the removal of thermal ablatives from SRB hardware involved extensive testing to ensure adequate material removal without causing undesirable damage to the residual materials or aluminum substrates. Testing to establish appropriate process parameters such as flow, temperature and pressures of the liquid nitrogen stream provided an initial benchmark for process testing. Equipped with these initial parameters engineers were then able to establish more detailed test criteria that set the process limits. Quantifying the potential for aluminum hardware damage represented the greatest hurdle for satisfying engineers as to the safety of this process. Extensive testing for aluminum erosion, surface profiling, and substrate weight loss was performed. This successful project clearly demonstrated that the liquid nitrogen jet possesses unique strengths that align remarkably well with the unusual challenges that space hardware and missile manufacturers face on a regular basis. Performance of this task within the confines of a critical manufacturing facility marks a milestone in advanced processing.

Noah, Donald E.↗
NASA NTRS2000

Testing New Programming Paradigms with NAS Parallel Benchmarks

Over the past decade, high performance computing has evolved rapidly, not only in hardware architectures but also with increasing complexity of real applications. Technologies have been developing to aim at scaling up to thousands of processors on both distributed and shared memory systems. Development of parallel programs on these computers is always a challenging task. Today, writing parallel programs with message passing (e.g. MPI) is the most popular way of achieving scalability and high performance. However, writing message passing programs is difficult and error prone. Recent years new effort has been made in defining new parallel programming paradigms. The best examples are: HPF (based on data parallelism) and OpenMP (based on shared memory parallelism). Both provide simple and clear extensions to sequential programs, thus greatly simplify the tedious tasks encountered in writing message passing programs. HPF is independent of memory hierarchy, however, due to the immaturity of compiler technology its performance is still questionable. Although use of parallel compiler directives is not new, OpenMP offers a portable solution in the shared-memory domain. Another important development involves the tremendous progress in the internet and its associated technology. Although still in its infancy, Java promisses portability in a heterogeneous environment and offers possibility to "compile once and run anywhere." In light of testing these new technologies, we implemented new parallel versions of the NAS Parallel Benchmarks (NPBs) with HPF and OpenMP directives, and extended the work with Java and Java-threads. The purpose of this study is to examine the effectiveness of alternative programming paradigms. NPBs consist of five kernels and three simulated applications that mimic the computation and data movement of large scale computational fluid dynamics (CFD) applications. We started with the serial version included in NPB2.3. Optimization of memory and cache usage was applied to several benchmarks, noticeably BT and SP, resulting in better sequential performance. In order to overcome the lack of an HPF performance model and guide the development of the HPF codes, we employed an empirical performance model for several primitives found in the benchmarks. We encountered a few limitations of HPF, such as lack of supporting the "REDISTRIBUTION" directive and no easy way to handle irregular computation. The parallelization with OpenMP directives was done at the outer-most loop level to achieve the largest granularity. The performance of six HPF and OpenMP benchmarks is compared with their MPI counterparts for the Class-A problem size in the figure in next page. These results were obtained on an SGI Origin2000 (195MHz) with MIPSpro-f77 compiler 7.2.1 for OpenMP and MPI codes and PGI pghpf-2.4.3 compiler with MPI interface for HPF programs.

Jin, H.↗
NASA NTRS2016

EVA Health and Human Performance Benchmarking Study

Multiple HRP Risks and Gaps require detailed characterization of human health and performance during exploration extravehicular activity (EVA) tasks; however, a rigorous and comprehensive methodology for characterizing and comparing the health and human performance implications of current and future EVA spacesuit designs does not exist. This study will identify and implement functional tasks and metrics, both objective and subjective, that are relevant to health and human performance, such as metabolic expenditure, suit fit, discomfort, suited postural stability, cognitive performance, and potentially biochemical responses for humans working inside different EVA suits doing functional tasks under the appropriate simulated reduced gravity environments. This study will provide health and human performance benchmark data for humans working in current EVA suits (EMU, Mark III, and Z2) as well as shirtsleeves using a standard set of tasks and metrics with quantified reliability. Results and methodologies developed during this test will provide benchmark data against which future EVA suits, and different suit configurations (eg, varied pressure, mass, CG) may be reliably compared in subsequent tests. Results will also inform fitness for duty standards as well as design requirements and operations concepts for future EVA suits and other exploration systems.

Abercromby, A. F.↗
NASA NTRSDate not supplied

Acoustic Emission Methods for the Health Evaluation of Integrated Pressure Components

At the request of the Pressure Systems Senior Discipline Expert, to overcome the access and detectable flaw size limitations of other nondestructive evaluation (NDE) methods for integrated components, a technique akin to seismology was advanced to perceive the earliest signs of cracking in titanium components before they escalate into serious issues. In this project we achieved a landmark in Acoustic Emission (AE) testing with the first NASA Probability of Detection (POD) study. This is an important first step to the certification of the AE method for flight components and was based on the testing of notched panels. By working closely with industry allies and employing approved methods from the boiler and pressure vessel sector, we not only met but surpassed all POD benchmarks with our test and acceptance criteria. In experiments involving solution heat-treated and aged 6Al-4V-Ti alloy tested with broadband sensors, we recorded a 96% success rate, with zero false positives reported. Our research shows that in some cases, AE testing can locate smaller cracks than other NDE methods. An industry tool for scaling results to full pressure vessels is highlighted. However, before applying our findings to NASA components, tests to validate the transfer functions are advised.

acoustic↗
NASA NTRS1990

A two-step iterative method for evolving nonlinear acoustic systems to a steady-state

A new approach for evolving two-dimensional nonlinear acoustic systems with flow to a steady state is presented. The approach is a two-step iterative method which is tested on a benchmark acoustic problem for which an exact analytical solution is available. Results are also calculated for a nonlinear acoustic problem for which an exact analytical solution is not known. Results indicate that the two-step method represents a powerful, efficient, and stable method for evolving two-dimensional acoustic systems to a steady state, and that the method is applicable to any number of spatial dimensions and to other hyperbolic systems. It is noted that for the benchmark problem only a single iteration on the method is required when the transient and steady-state field are of the same order of magnitude; however, four iterations are required when the steady-state field is several orders of magnitude smaller than the transient field. This method requires six iterations before achieving a steady state for the nonlinear test problem.

Watson, Willie R.↗
NASA NTRSDate not supplied

Comparison of Boeing 777 Landing Gear Noise Simulations with Flight Test Data

Acoustic phased microphone array measurements of aircraft flyover noise acquired during the 2005 Quiet Technology Demonstrator II test were used to assess the accuracy of high-fidelity, full-scale simulations of landing gear noise produced by a large civilian aircraft. The simulations, conducted with the lattice Boltzmann solver PowerFLOW®, used a highly accurate digital model of a Boeing 777-300ER aircraft with the nose and main landing gear components replicating the full-scale geometries. The simulations were performed for aircraft parameters that matched those recorded during the flyover test conditions. For benchmarking purposes, several aircraft configurations were simulated: a) nose landing gear deployed with main landing gear and wing high-lift devices stowed, b) nose and main landing gear deployed with wing high-lift devices stowed and c) nose and main landing gear with wing high-lift devices deployed. To facilitate direct comparison with measured data, the simulated data sets were used to generate synthetic pressure records at the same array microphone locations as those used during the flight test. Broadly self-consistent beamforming techniques and procedures were used to process the synthetic pressure records and the measured data. Integration of select regions of the beamform maps containing the nose or main landing gear yielded good agreement between predicted and measured integrated far-field spectra for forward directivity angles where airframe noise is more prominent.

airframe noise↗
NASA NTRS1991

Collected notes from the Benchmarks and Metrics Workshop

In recent years there has been a proliferation of proposals in the artificial intelligence (AI) literature for integrated agent architectures. Each architecture offers an approach to the general problem of constructing an integrated agent. Unfortunately, the ways in which one architecture might be considered better than another are not always clear. There has been a growing realization that many of the positive and negative aspects of an architecture become apparent only when experimental evaluation is performed and that to progress as a discipline, we must develop rigorous experimental methods. In addition to the intrinsic intellectual interest of experimentation, rigorous performance evaluation of systems is also a crucial practical concern to our research sponsors. DARPA, NASA, and AFOSR (among others) are actively searching for better ways of experimentally evaluating alternative approaches to building intelligent agents. One tool for experimental evaluation involves testing systems on benchmark tasks in order to assess their relative performance. As part of a joint DARPA and NASA funded project, NASA-Ames and Teleos Research are carrying out a research effort to establish a set of benchmark tasks and evaluation metrics by which the performance of agent architectures may be determined. As part of this project, we held a workshop on Benchmarks and Metrics at the NASA Ames Research Center on June 25, 1990. The objective of the workshop was to foster early discussion on this important topic. We did not achieve a consensus, nor did we expect to. Collected here is some of the information that was exchanged at the workshop. Given here is an outline of the workshop, a list of the participants, notes taken on the white-board during open discussions, position papers/notes from some participants, and copies of slides used in the presentations.

Drummond, Mark E.↗
NASA NTRS2001

Fluctuating Pressure Data from 2-D Nozzle Cold Flow Tests (Dual Bell)

Rocket engines nozzle performance changes as a vehicle climbs through the atmosphere. An altitude compensating nozzle, ACN, is intended to improve on a fixed geometry bell nozzle that performs at optimum at only one trajectory point. In addition to nozzle performance, nozzle transient loads are an important consideration. Any nozzle experiences large transient toads when shocks pass through the nozzle at start and shutdown. Additional transient toads will occur at transitional flow conditions. The objectives of cold flow nozzle testing at MSFC are CFD benchmark / calibration and Unsteady flow / sideloads. Initial testing performed with 2-D inserts to 14" transonic wind tunnel. Recent review of 2-D data in preparation for nozzle test facility 3-D testing. This presentation shows fluctuating pressure data and some observations from 2-D dual-bell nozzle cold flow tests.

Nesman, Tomas E.↗