Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Development of comprehensive numerical schemes for predicting evaporating gas-droplets flow processes of a liquid-fueled combustor

An existing Computational Fluid Dynamics code for simulating complex turbulent flows inside a liquid rocket combustion chamber was validated and further developed. The Advanced Rocket Injector/Combustor Code (ARICC) is simplified and validated against benchmark flow situations for laminar and turbulent flows. The numerical method used in ARICC Code is re-examined for incompressible flow calculations. For turbulent flows, both the subgrid and the two equation k-epsilon turbulence models are studied. Cases tested include idealized Burger's equation in complex geometries and boundaries, a laminar pipe flow, a high Reynolds number turbulent flow, and a confined coaxial jet with recirculations. The accuracy of the algorithm is examined by comparing the numerical results with the analytical solutions as well as experimented data with different grid sizes.

Chen, C. P.↗
NASA NTRS1989

Aeroassist flight experiment aerodynamics and aerothermodynamics

The problem is to determine the transitional flow aerodynamics and aerothermodynamics, including the base flow characteristics, of the Aeroassist Flight Experiment (AFE). The justification for the computational fluid dynamic (CFD) Application stems from MSFC's system integration responsibility for the AFE. To insure that the AFE objectives are met, MSFC must understand the limitations and uncertainties of the design data. Perhaps the only method capable of handling the complex physics of the rarefied high energy AFE trajectory is Bird's Direct Simulation Monte Carlo (DSMC) technique. The 3-D code used in this analysis is applicable only to the AFE geometry. It uses the Variable Hard Sphere (VHS) collision model and five specie chemistry model available from Langley Research Center. The code is benchmarked against the AFE flight data and used as an Aeroassisted Space Transfer Vehicle (ASTV) design tool. The code is being used to understand the AFE flow field and verify or modify existing design data. Continued application to lower altitudes is testing the capability of the Numerical Aerodynamic Simulation Facility (NASF) to handle 3-D DSMC and its practicality as an ASTV/AFE design tool.

Brewer, Edwin B.↗
NASA NTRS1999

Assurance of COTS Boards for Space Flight

Space Flight hardware and software designers are increasingly turning to Commercial-Off-the-Shelf (COTS) products in hopes of meeting the demands imposed on them by projects with short development cycle times. The Technology Validation Assurance (TVA) team at NASA GSFC has embarked on applying a method for inserting COTS hardware into the Spartan 251 spacecraft. This method includes Procurement, Characterization, Ruggedization/Remediation and Verification Testing process steps which are intended to increase the user's confidence in the hardware's ability to function in the intended application for the required duration. As this method is refined with use, it has the potential for becoming a benchmark for industry-wide use of COTS in high reliability systems.

Plante Jeannette↗
NASA NTRS1986

A performance comparison of the Cray-2 and the Cray X-MP

A suite of thirteen large Fortran benchmark codes were run on Cray-2 and Cray X-MP supercomputers. These codes were a mix of compute-intensive scientific application programs (mostly Computational Fluid Dynamics) and some special vectorized computation exercise programs. For the general class of programs tested on the Cray-2, most of which were not specially tuned for speed, the floating point operation rates varied under a variety of system load configurations from 40 percent up to 125 percent of X-MP performance rates. It is concluded that the Cray-2, in the original system configuration studied (without memory pseudo-banking) will run untuned Fortran code, on average, about 70 percent of X-MP speeds.

Schmickley, Ronald↗
NASA NTRS2010

Propulsion Diagnostic Method Evaluation Strategy (ProDiMES) User's Guide

This report is a User's Guide for the Propulsion Diagnostic Method Evaluation Strategy (ProDiMES). ProDiMES is a standard benchmarking problem and a set of evaluation metrics to enable the comparison of candidate aircraft engine gas path diagnostic methods. This Matlab (The Mathworks, Inc.) based software tool enables users to independently develop and evaluate diagnostic methods. Additionally, a set of blind test case data is also distributed as part of the software. This will enable the side-by-side comparison of diagnostic approaches developed by multiple users. The Users Guide describes the various components of ProDiMES, and provides instructions for the installation and operation of the tool.

Simon, Donald L.↗
NASA NTRSDate not supplied

Creating Benchmark Data for Artificial Intelligence and Machine Learning Space Biology Research

To identify an appropriate AI/ML approach for a specific problem, the best practice is to measure algorithm performance through the benchmarking process. A scientific benchmark consists of an AI-ready dataset and a reference implementation on a specific scientific question. The NASA Science Mission Directorate (SMD) has started the “Benchmark Initiative for AI/ML to create scientific benchmark datasets in three applications: 1) scientific benchmarking, which finds the best algorithm for a specific problem; 2) application benchmarking, which measures algorithm performance against a set of parameters; and 3) system benchmarking, which evaluates performance of hardware and software architecture. Currently, there are no standardized datasets available to benchmark AI/ML algorithms in the domain of space biology. In this work, we constructed two AI/ML-ready biological datasets from experiments in space-flown mice: cellular imaging and RNA-seq. First, radiation-exposed immune cells harbor DNA damage foci that can be fluorescently marked to visualize the amount of damage following exposure to ionizing radiation. However, such large datasets are difficult to analyze visually, due to imaging inconsistencies and human bias, and classical image processing approaches can fail on imaging artifacts. AI/ML are therefore exciting alternative, providing the speed of machines and the accuracy of humans. We have made this dataset available at https://registry.opendata.aws/bps_microscopy/. Second, high-throughput nucleic acid sequencing (DNA-seq, RNA-seq) has become widespread in biomedical research due to the growing availability and affordability of these assays. However, most sequencing datasets suffer from high dimensionality and low sample count. In this work, we used a generative adversarial network to synthesize a standardized, AI-ready, publicly available benchmark dataset for space biology RNA-seq data with sufficient space-flown and ground control mouse liver samples from NASA GeneLab. This dataset is available at https://registry.opendata.aws/bps_rnaseq/. These datasets are now fully open the Space Biology community to test their favorite AI/ML approaches.

James Casaletto↗
NASA NTRS1993

Robust controllers for the Middeck Active Control Experiment using Popov controller synthesis

Recent work in robust control with real parameter uncertainties has focused on absolute stability and its connections to real mu theory. In particular, the research has investigated the Popov stability criterion and its associated Lur'e-Postnikov Liapunov functions. State space representations of this Popov stability analysis tests are included in an H2 design formulation to provide a powerful technique for robust controller synthesis. This synthesis approach uses a state space optimization procedure to design controllers that minimize an overbound of an H2 cost functional and satisfy stability analysis tests based on the Popov multiplier. The controller and stability multiplier coefficients are optimized simultaneously, which avoids the iteration and curve-fitting procedures required by the D-K algorithm of mu synthesis. While previous work has demonstrated this synthesis approach on benchmark control problems, the purpose of this paper is to use Popov controller synthesis to design robust compensators for the Middeck Active Control Experiment (MACE).

How, Jonathan P.↗
NASA NTRS2009

Multi-Core Processor Memory Contention Benchmark Analysis Case Study

Multi-core processors dominate current mainframe, server, and high performance computing (HPC) systems. This paper provides synthetic kernel and natural benchmark results from an HPC system at the NASA Goddard Space Flight Center that illustrate the performance impacts of multi-core (dual- and quad-core) vs. single core processor systems. Analysis of processor design, application source code, and synthetic and natural test results all indicate that multi-core processors can suffer from significant memory subsystem contention compared to similar single-core processors.

Simon, Tyler↗
NASA NTRS2017

Development of a Molecular Tagging Velocimetry Technique for Non-Intrusive Velocity Measurements in Low-Speed Gas Flows

N2O molecular tagging velocimetry (N2O-MTV) is developed for use in very-high-temperature reactor environments. Tests were carried out to determine the optimum excitation wavelength, tracer concentration, and timing parameters for the laser system. Using NO tracers obtained from photo-dissociation of N2O, velocity profiles are successfully obtained in air, nitrogen, and helium for a large range of parameters: temperature from 295 to 781 K, pressure from 1 to 3 bars, with a velocity precision of 0.01 m/s. Furthermore, by using two read pulses at adjustable time delays, the velocity dynamic range can be increased. An unprecedented dynamic range of 5,000 has been obtained to successfully resolve the flow during a helium blowdown from 1000 m/s down to 0.2 m/s. This technique is also applied to the high-temperature test facility (HTTF) at Oregon State University (OSU) during a depressurized condition cooldown (DCC) event. Details of these measurements are presented in a companion paper. This technique shows a strong potential for fundamental understanding of gas flows in nuclear reactors and to provide benchmark experimental data to validate numerical simulations.

Andre, M. A.↗
NASA NTRS2021

A Chlorophyll-a Algorithm for Landsat-8 Based on Mixture Density Networks

Retrieval of aquatic biogeochemical variables, such as the near-surface concentration of chlorophyll-a (Chla) in inland and coastal waters via remote observations, has long been regarded as a challenging task. This manuscript applies Mixture Density Networks (MDN) that use the visible spectral bands available by the Operational Land Imager (OLI) aboard Landsat-8 to estimate Chla. We utilize a database of co-located in situ radiometric and Chla measurements (N = 4,354), referred to as Type A data, to train and test an MDN model (MDN(A)). This algorithm’s performance, having been proven for other satellite missions, is further evaluated against other widely used machine learning models (e.g., support vector machines), as well as other domain-specific solutions (OC3), and shown to offer significant advancements in the field. Our performance assessment using a held-out test data set suggests that a 49% (median) accuracy with near-zero bias can be achieved via the MDN(A) model, offering improvements of 20 to 100% in retrievals with respect to other models. The sensitivity of the MDN(A) model and benchmarking methods to uncertainties from atmospheric correction (AC) methods, is further quantified through a semi-global matchup dataset (N = 3,337), referred to as Type B data. To tackle the increased uncertainties, alternative MDN models (MDN(B)) are developed through various features of the Type B data (e.g., Rayleigh-corrected reflectance spectra ρ(s)). Using held-out data, along with spatial and temporal analyses, we demonstrate that these alternative models show promise in enhancing the retrieval accuracy adversely influenced by the AC process. Results lend support for the adoption of MDN(B) models for regional and potentially global processing of OLI imagery, until a more robust AC method is developed. Index Terms—Chlorophyll-a, coastal water, inland water, Landsat-8, machine learning, ocean color, aquatic remote sensing.

Brandon Smith↗
NASA NTRSDate not supplied

Atmospheric Boundary-Layer and Flutter Computations Using CFD Model of the Transonic Dynamics Tunnel

This paper presents two Computational Fluid Dynamics (CFD) models of the flow in the NASA Langley Research Center Transonic Dynamics Tunnel (TDT). The TDT is a continuous-flow, closed circuit wind tunnel with a 16- by 16-foot slotted test section with cropped corners. The tunnel was originally built as the 19-ft Pressure Tunnel in 1938, but it was converted to the current transonic tunnel in the 1950s, with capabilities to use either air or heavy gas as the test medium. The first computational model describes the generation of an atmospheric-boundary-layer (ABL) profile inside the tunnel. An ABL, which includes both a wind profile and turbulence content, is one of the aerodynamic characteristics affecting the occurrence of wind-induced oscillations for a launch vehicle sitting on a pad. The challenging part of this analysis was modeling the turbulent flow inside the tunnel. This is due to the special ABL-generating hardware that was installed at the entrance of the TDT test section in order to change the downstream velocity profile and to introduce velocity fluctuations into the flow. The second CFD model builds on the computational aeroelastic results that were generated in support of the second Aeroelastic Prediction Workshop (AePW) for the NASA Benchmark Supercritical Wing (BSCW) configuration. During the AePW, the wing-only configuration (classical free-air model) was analyzed. In the current study, the flutter computations were conducted on the configuration as it was mounted in the TDT during the experiment. This includes the wing attached to the splitter plate that was attached to the wind-tunnel walls. The preliminary results show that the wind-tunnel walls marginally affect flutter prediction.

Pawel Chwalowski↗
NASA NTRS1993

Program For Workload And Performance Experiments

Multi-Attribute Task (MAT) battery of computer programs gives researcher capability of performing experiments in multitask workloads and performances. Provides benchmark set of tasks for use in wide range of laboratory studies of operator performance and workload. Incorporates tasks analogous to activities aircraft crewmembers perform in flight, while providing high degree of experiment control, performance data on each subtask, and freedom to use nonpilot test subjects. Designed to use serially linked second computer to generate voice messages for communication task. Also used independently of voice computer if no computer-synthesized voice messages desired or if some other method of presenting auditory messages devised. Written in QuickBasic and Assembly language for IBM PC(R) series.

Comstock, J. Raymond, Jr.↗
NASA NTRS2000

Experimental/Analytical Characterization of the RBCC Rocket-Ejector Mode

The experimental/analytical research work described here addresses the rocket-ejector mode (Mach 0-2 operational range) of the RBCC engine. The experimental phase of the program includes studying the mixing and combustion characteristics of the rocket-ejector system utilizing state-of-the-art diagnostic techniques. A two-dimensional variable geometry rocket-ejector system with enhanced optical access was utilized as the experimental platform. The goals of the experimental phase of the research being conducted at Penn State are to: (a) systematically increase the range of rocket-ejector understanding over a wide range of flow/geometry parameters and (b) provide a comprehensive data base for evaluating and anchoring CFD codes. Concurrent with the experimental activities, a CFD code benchmarking effort at Marshall Space Flight Center is also being used to further investigate the RBCC rocket-ejector mode. Experiments involving the single rocket based optically-accessible rocket-ejector system have been conducted for Diffusion and Afterburning (DAB) as well as Simultaneous Mixing and Combustion configurations. For the DAB configuration, air is introduced (direct-connect) or ejected (sea-level static) into a constant area mixer section with a centrally located gaseous oxygen (GO2)/gaseous hydrogen (GH2) rocket combustor. The downstream flowpath for this configuration includes a diffuser, an afterburner and a final converging nozzle. For the SMC configuration, the rocket is centrally located in a slightly divergent duct. For all tested configurations, global measurements of the axial pressure and heat transfer profiles as well as the overall engine thrust were made. Detailed measurements include major species concentration (H2 O2 N2 and H2O) profiles at various mixer locations made using Raman spectroscopy. Complementary CFD calculations of the flowfield at the experimental conditions also provide additional information on the physics of the problem. These calculations are being conducted at Marshall Space Flight Center to benchmark the FDNS code for RBCC engine operations for such configurations. The primary fluid physics of interests are the mixing and interaction of the rocket plume and secondary flow, subsequent combustion of the fuel rich rocket exhaust with the secondary flow and combustion of the injected afterburner flow. The CFD results are compared to static pressure along the RBCC duct walls, Raman Spectroscopy specie distribution data at several axial locations, net engine thrust and entrained air for the SLS cases. The CFD results compare reasonably well with the experimental results.

Ruf, J. H.↗
NASA NTRS1987

An LDA investigation of three-dimensional normal shock-boundary layer interactions in a corner

Nonintrusive, three-dimensional, measurements have been made of a normal shock wave-turbulent boundary layer interaction. The measurements were made in the corner of the test section of a continuous supersonic wind tunnel in which a normal shock wave had been stabilized. LDA, surface pressure measurement and flow visualization techniques were employed for two freestream Mach number test cases: 1.6 and 1.3. The former contained separated flow regions and a system of shock waves. The latter was found to be far less complicated. The reported results are believed to accurately define the flow physics of each case and may be used as benchmark data to verify three-dimensional computer codes.

Chriss, R. M.↗
NASA NTRS1992

Assured crew return vehicle post landing configuration design and test

The 1991-1992 senior Mechanical and Aerospace Engineering Design class continued work on the post landing configurations for the Assured Crew Return Vehicle (ACRV) and the Emergency Egress Couch (EEC). The ACRV will be permanently docked to Space Station Freedom, fulfilling NASA's commitment of Assured Crew Return Capability in the event of an accident or illness aboard Space Station Freedom. The EEC provides medical support and a transportation surface for an incapacitated crew member. The objective of the projects was to give the ACRV Project Office data to feed into their feasibility studies. Four design teams were given the task of developing models with dynamically and geometrically scaled characteristics. Groups one and two combined effort to design a one-fifth scale model of the Apollo Command Module derivative, an on-board flotation system, and a lift attachment point system. This model was designed to test the feasibility of a rigid flotation and stabilization system and to determine the dynamics associated with lifting the vehicle during retrieval. However, due to priorities, it was not built. Group three designed a one-fifth scale model of the Johnson Space Center (JSC) benchmark configuration, the Station Crew Return Alternative Module (SCRAM) with a lift attachment point system. This model helped to determine the flotation and lifting characteristics of the SCRAM configuration. Group four designed a full scale EEC with changeable geometric and dynamic characteristics. This model provided data on the geometric characteristics of the EEC and on the placement of the CG and moment of inertia. It also gave the helicopter rescue personnel direct input to the feasibility study.

Anderson, Loren A.↗
NASA NTRS2021

K2-138 g: Spitzer Spots a Sixth Planet for the Citizen Science System

K2 greatly extended Kepler's ability to find new planets, but it was typically limited to identifying transiting planets with orbital periods below 40 days. While analyzing K2 data through the Exoplanet Explorers project, citizen scientists helped discover one super-Earth and four sub-Neptune sized planets in the relatively bright (V = 12.21, K = 10.3) K2-138 system, all which orbit near 3:2 mean-motion resonances. The K2 light curve showed two additional transit events consistent with a sixth planet. Using Spitzer photometry, we validate the sixth planet's orbital period of 41.966 ± 0.006 days and measure a radius of 3.44 (+0.32,-.031)Rꚛ, solidifying K2-138 as the K2 system with the most currently known planets. There is a sizeable gap between the outer two planets, since the fifth planet in the system, K2-138 f, orbits at 12.76 days. We explore the possibility of additional nontransiting planets in the gap between f and g. Due to the relative brightness of the K2-138 host star, and the near resonance of the inner planets, K2-138 could be a key benchmark system for both radial velocity and transit-timing variation mass measurements, and indeed radial velocity masses for the inner four planets have already been obtained. With its five sub-Neptunes and one super-Earth, the K2-138 system provides a unique test bed for comparative atmospheric studies of warm to temperate planets of similar size, dynamical studies of near-resonant planets, and models of planet formation and migration.

Kevin K. Hardegree-Ullman↗
NASA NTRS1991

Task planning and scheduling: Toward real-time expert system autonomous control

Research under this grant successfully developed and tested the Interruptable Control System (ICE). The best description of ICE is in the M.S. thesis of Jim Vezina, who was the primary designer and implementer of ICE. Vezina's thesis is included as the bulk of this report. To test the general usefulness and maintainability of the ICE System, the examples of the ICE system in action given in Vezina's thesis were extended. The extensions consisted of two components: debugging and rewriting the simulation of passive and active agents, both controlled and uncontrolled, and benchmarking more extensively the HES expert system concerned with monitoring sensors. The expert system was chosen because it demonstrates the ability of CLIPS.

Sterling, Leon↗
NASA NTRS2011

Blade Displacement Measurements of the Full-Scale UH-60A Airloads Rotor

Blade displacement measurements were acquired during a wind tunnel test of the full-scale UH-60A Airloads rotor. The test was conducted in the 40- by 80-Foot Wind Tunnel of the National Full-Scale Aerodynamics Complex at NASA Ames Research Center. Multi-camera photogrammetry was used to measure the blade displacements of the four-bladed rotor. These measurements encompass a range of test conditions that include advance ratios from 0.15 to unique slowed-rotor simulations as high as 1.0, thrust coefficient to rotor solidity ratios from 0.01 to 0.13, and rotor shaft angles from -10.0 to 8.0 degrees. The objective of these measurements is to provide a benchmark blade displacement database to be utilized in the development and validation of rotorcraft computational tools. The methodology, system development, measurement techniques, and preliminary sample blade displacement measurements are presented.

Barrows, Danny A.↗