SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

All sources NASA NTRS DOE OSTI

NASA NTRS2007

Feasibility of Turing-Style Tests for Autonomous Aerial Vehicle "Intelligence"

A new approach is suggested to define and evaluate key metrics as to autonomous aerial vehicle performance. This approach entails the conceptual definition of a "Turing Test" for UAVs. Such a "UAV Turing test" would be conducted by means of mission simulations and/or tailored flight demonstrations of vehicles under the guidance of their autonomous system software. These autonomous vehicle mission simulations and flight demonstrations would also have to be benchmarked against missions "flown" with pilots/human-operators in the loop. In turn, scoring criteria for such testing could be based upon both quantitative mission success metrics (unique to each mission) and by turning to analog "handling quality" metrics similar to the well-known Cooper-Harper pilot ratings used for manned aircraft. Autonomous aerial vehicles would be considered to have successfully passed this "UAV Turing Test" if the aggregate mission success metrics and handling qualities for the autonomous aerial vehicle matched or exceeded the equivalent metrics for missions conducted with pilots/human-operators in the loop. Alternatively, an independent, knowledgeable observer could provide the "UAV Turing Test" ratings of whether a vehicle is autonomous or "piloted." This observer ideally would, in the more sophisticated mission simulations, also have the enhanced capability of being able to override the scripted mission scenario and instigate failure modes and change of flight profile/plans. If a majority of mission tasks are rated as "piloted" by the observer, when in reality the vehicle/simulation is fully- or semi- autonomously controlled, then the vehicle/simulation "passes" the "UAV Turing Test." In this regards, this second "UAV Turing Test" approach is more consistent with Turing s original "imitation game" proposal. The overall feasibility, and important considerations and limitations, of such an approach for judging/evaluating autonomous aerial vehicle "intelligence" will be discussed from a theoretical perspective.

Young, Larry A.↗

NASA NTRS1972

Flowing gas, non-nuclear experiments on the gas core reactor

Flow tests were conducted on models of the gas core (cavity) reactor. Variations in cavity wall and injection configurations were aimed at establishing flow patterns that give a maximum of the nuclear criticality eigenvalue. Correlation with the nuclear effect was made using multigroup diffusion theory normalized by previous benchmark critical experiments. Air was used to simulate the hydrogen propellant in the flow tests, and smoked air, argon, or freon to simulate the central nuclear fuel gas. All tests were run in the down-firing direction so that gravitational effects simulated the acceleration effect of a rocket. Results show that acceptable flow patterns with high volume fraction for the simulated nuclear fuel gas and high flow rate ratios of propellant to fuel can be obtained. Using a point injector for the fuel, good flow patterns are obtained by directing the outer gas at high velocity along the cavity wall, using louvered or oblique-angle-honeycomb injection schemes.

Kunze, J. F.↗

NASA NTRS1994

Congestion Avoidance Testbed Experiments

DARTnet provides an excellent environment for executing networking experiments. Since the network is private and spans the continental United States, it gives researchers a great opportunity to test network behavior under controlled conditions. However, this opportunity is not available very often, and therefore a support environment for such testing is lacking. To help remedy this situation, part of SRI's effort in this project was devoted to advancing the state of the art in the techniques used for benchmarking network performance. The second objective of SRI's effort in this project was to advance networking technology in the area of traffic control, and to test our ideas on DARTnet, using the tools we developed to improve benchmarking networks. Networks are becoming more common and are being used by more and more people. The applications, such as multimedia conferencing and distributed simulations, are also placing greater demand on the resources the networks provide. Hence, new mechanisms for traffic control must be created to enable their networks to serve the needs of their users. SRI's objective, therefore, was to investigate a new queueing and scheduling approach that will help to meet the needs of a large, diverse user population in a "fair" way.

Denny, Barbara A.↗

NASA NTRS1995

Aerothermodynamic testing requirements for future space transportation systems

Aerothermodynamics, encompassing aerodynamics, aeroheating, and fluid dynamic and physical processes, is the genesis for the design and development of advanced space transportation vehicles. It provides crucial information to other disciplines involved in the development process such as structures, materials, propulsion, and avionics. Sources of aerothermodynamic information include ground-based facilities, computational fluid dynamic (CFD) and engineering computer codes, and flight experiments. Utilization of this triad is required to provide the optimum requirements while reducing undue design conservatism, risk, and cost. This paper discusses the role of ground-based facilities in the design of future space transportation system concepts. Testing methodology is addressed, including the iterative approach often required for the assessment and optimization of configurations from an aerothermodynamic perspective. The influence of vehicle shape and the transition from parametric studies for optimization to benchmark studies for final design and establishment of the flight data book is discussed. Future aerothermodynamic testing requirements including the need for new facilities are also presented.

Paulson, John W., Jr.↗

NASA NTRS1995

Importance of real gas effects in entry technology

Critical issues concerning real gas effects in hypervelocity flows where the thermochemical nonequilibrium effects are pronounced, are described. Emphasis is on the development and validation of benchmark analysis tools. Approaches to develop and/or enhance phenomenological models, including test techniques to acquire databases, and incorporate them into computational flow field simulation codes are described. The performance characteristics of shock tubes, ballistic ranges and arc heated wind tunnels, state of the art diagnostics are included. The following aerothermodynamic phenomena are discussed: aerodynamic parameters, viscous interactions, turbulent transition, forebody heating/heat transfer, radiative heating, Lee-Base flows and low density real gas.

Deiwert, George S.↗

NASA NTRS2012

Performance Evaluation of Pressure Transducers for Water Impacts

The Orion Multi-Purpose Crew Vehicle is being designed for water landings. In order to benchmark the ability of engineering tools to predict water landing loads, test programs are underway for scale model and full-scale water impacts. These test programs are predicated on the reliable measurement of impact pressure histories. Tests have been performed with a variety of pressure transducers from various manufacturers. Both piezoelectric and piezoresistive devices have been tested. Effects such as thermal shock, pinching of the transducer head, and flushness of the transducer mounting have been studied. Data acquisition issues such as sampling rate and anti-aliasing filtering also have been studied. The response of pressure transducers have been compared side-by-side on an impulse test rig and on a 20-inch diameter hemisphere dropped into a pool of water. The results have identified a range of viable configurations for pressure measurement dependent on the objectives of the test program.

Vassilakos, Gregory J.↗

NASA NTRS2014

EVA Suit R and D for Performance Optimization

Designing a planetary suit is very complex and often requires difficult trade‐offs between performance, cost, mass, and system complexity. To verify that new suit designs meet requirements, full prototypes must be built and tested with human subjects. However, numerous design iterations will occur before the hardware meets those requirements. Traditional draw‐prototype‐test paradigms for R&D are prohibitively expensive with today's shrinking Government budgets. Personnel at NASA are developing modern simulation techniques which focus on human‐centric designs by creating virtual prototype simulations and fully adjustable physical prototypes of suit hardware. During the R&D design phase, these easily modifiable representations of an EVA suit's hard components will allow designers to think creatively and exhaust design possibilities before they build and test working prototypes with human subjects. It allows scientists to comprehensively benchmark current suit capabilities and limitations for existing suit sizes and sizes that do not exist. This is extremely advantageous and enables comprehensive design down‐selections to be made early in the design process, enables the use of human performance as design criteria, and enables designs to target specific populations

Cowley, Matthew S.↗

NASA NTRSDate not supplied

Simulated Ice Shapes on the High Lift Common Research Model Using LEWICE3D

Computational icing tools consist of predicting two distinct problems, the dry air aerodynamics around the iced or uniced vehicle and the accretion of ice due to inclement weather. A desire exists to advance these tools such that they can be reliably used earlier in the design process to limit the need for more costly flight and wind tunnel testing. To achieve these goals the computational tools need to be benchmarked and validated against high quality experimental data sets to raise the software’s Technology Readiness Level. An ongoing collaborative effort between NASA and Boeing Commercial Airplanes is focused on obtaining this required experimental data and subsequently benchmarking and/or validating the tools that predict the aerodynamics around the iced and uniced vehicle. Currently the scope of this effort is focused on the usage of simulated ice shapes to be representative of the iced vehicle. This presentation discusses the generation of those simulated ice shapes.

Icing↗

NASA NTRS1988

Evaluation of FIDAP on some classical laminar and turbulent benchmarks

The numerical accuracy of the fluid-dynamics code FIDAP is investigated by means of test computations on two-dimensional flows. The theoretical basis of the algorithm is briefly reviewed, and results for laminar flow in a wall-driven cavity and for both laminar and turbulent flows over a backward-facing step are presented in extensive tables and graphs and characterized in detail. Good agreement with published experimental data and previous computations is obtained for laminar flows using a version of FIDAP without streamlined upwinding (STU). For turbulent flows, the addition of STU is found to be useful, although it causes separation-zone reattachment length to be underpredicted.

Sohn, J. L.↗

NASA NTRS2004

EPS (Electric Particulate Suspension) Microgravity Technology Provides NASA with New Tools

The Electric Particulate Suspension is a fire safety ignition test system being developed at Iowa State University with NASA support for evaluating combustion properties of powders, powder-gas mixtures, and pure gases in microgravity and gravitational atmospheres (quenching distance, ignition energy, flammability limits). A separate application is the use of EPS technology to control heat transfer in vacuum and space environment enclosures. In combustion testing, ignitable powders (aluminum, magnesium) are introduced in the EPS test cell and ignited by spark, while the addition of inert particles act as quenching media. As a combustion research tool, the EPS method has potential as a benchmark design for quenching powder flames that would provide NASA with a new fire safety standard for powder ignition testing. The EPS method also supports combustion modeling by providing accurate measurement of flame-quenching distance as an important parameter in laminar flame theory since it is closely related to characteristic flame thickness and flame structure. In heat transfer applications, inert powder suspensions (copper, steel) driven by electric fields regulate heat flow between adjacent surfaces enclosures both in vacuum (or gas) and microgravity. This simple E-field control can be particularly useful in space environments where physical separation is a requirement between heat exchange surfaces.

Colver, Gerald M.↗

NASA NTRS2011

Simulation of Benchmark Cases with the Terminal Area Simulation System (TASS)

The hydrodynamic core of the Terminal Area Simulation System (TASS) is evaluated against different benchmark cases. In the absence of closed form solutions for the equations governing atmospheric flows, the models are usually evaluated against idealized test cases. Over the years, various authors have suggested a suite of these idealized cases which have become standards for testing and evaluating the dynamics and thermodynamics of atmospheric flow models. In this paper, simulations of three such cases are described. In addition, the TASS model is evaluated against a test case that uses an exact solution of the Navier-Stokes equations. The TASS results are compared against previously reported simulations of these benchmark cases in the literature. It is demonstrated that the TASS model is highly accurate, stable and robust.

Ahmad, Nashat N.↗

NASA NTRS2022

AMD Radeon e9173 Low Power PCIE GPU Single Event Effects Test Report

The AMD Radeon Embedded e9170 Graphics Processing Unit (GPU), notably the e9173 Peripheral Component Interconnect Express (PCIE) variant, is of interest to Artemis generation programs with requirements for graphics rendering, compute, artificial intelligence (Ai) with a constraints-requiring piece-part procurement and power consumption of less than 50W. In addition to collecting heavy ion data on this device, a secondary purpose of this test campaign was to validate video capture hardware and software workflows used with GPU, microprocessor and system-on-chip device testing. Five (5) test patterns from the NEPP Processor Enclave (NPE) test suite were used with the e9173. The test patterns covered the operating system’s (OS) idle contribution towards the cross section, matrix math using tensorflow-rocm, two artificial intelligence models developed at NASA GSFC, and an industry standard GPU benchmarking application called Mesa GLXGears.

NASA Technical Memorandum (TM) test report for pos↗

NASA NTRS2019

Verification Benchmarks and Validation of MAT261 for High Energy Dynamic Impact Applications

Advanced computational methods for composite structures can enable smarter testing and potentially certification by analysis. These methods, known as progressive damage and failure analysis (PDFA) methods, can predict lamina level mechanics including failure and subsequent propagation. When introduced into a commercial off the shelf finite element solver such as ABAQUS, LS-DYNA, or ANSYS, it enables end users to effectively exercise PDFA methods; however, it requires an understanding of the assumed mechanics and underlying coded response. In this paper, verification benchmarks developed under the NASA Advanced Composite Consortium for a class of PDFA methods known as continuum damage mechanics approaches are applied to the native LS-DYNA material model MAT261. As a result of the verification, an instability was discovered and subsequently corrected with an engineering solution. The results of the preliminary MAT261 simulations for high energy dynamic impact and the engineering solution are compared and a discussion about the significance is presented.

Molitor, Matthew↗

NASA NTRSDate not supplied

Benchmark Models for Classification of Radiation Type Induced in Immune Cells

NASA Biological and Physical Sciences and the Science Mission Directorate have published a benchmark dataset of mouse immune cells subjected to radiation-induced DNA damage. The dataset comprises ML-ready microscopic imagery of said cells, including labels indicating radiation type and dose. The machine learning team at NASA Interagency Implementation and Advanced Concept Team (IMPACT) created multiple benchmark models. Initially, we conducted a preliminary analysis using thresholding. The algorithm used thresholds on average brightness of the available images to classify them into their respective radiation type. We also tested machine learning approaches. Convolutional Neural Networks (CNN) emerged as the best-performing model. This poster presents the benchmark scores obtained by the models.

Vishal Perekadan↗

NASA NTRS2000

Performance Monitoring of Distributed Data Processing Systems

Test and checkout systems are essential components in ensuring safety and reliability of aircraft and related systems for space missions. A variety of systems, developed over several years, are in use at the NASA/KSC. Many of these systems are configured as distributed data processing systems with the functionality spread over several multiprocessor nodes interconnected through networks. To be cost-effective, a system should take the least amount of resource and perform a given testing task in the least amount of time. There are two aspects of performance evaluation: monitoring and benchmarking. While monitoring is valuable to system administrators in operating and maintaining, benchmarking is important in designing and upgrading computer-based systems. These two aspects of performance evaluation are the foci of this project. This paper first discusses various issues related to software, hardware, and hybrid performance monitoring as applicable to distributed systems, and specifically to the TCMS (Test Control and Monitoring System). Next, a comparison of several probing instructions are made to show that the hybrid monitoring technique developed by the NIST (National Institutes for Standards and Technology) is the least intrusive and takes only one-fourth of the time taken by software monitoring probes. In the rest of the paper, issues related to benchmarking a distributed system have been discussed and finally a prescription for developing a micro-benchmark for the TCMS has been provided.

Ojha, Anand K.↗

NASA NTRS2011

A Comparison of Methods for Assessing Space Suit Joint Ranges of Motion

Through the Advanced Exploration Systems Program, NASA is attempting to use the vast collection of space suit mobility data from 50 years worth of space suit testing to build predictive analysis tools to aid in early architecture decisions for future missions and exploration programs. However, the design engineers must first understand if and how data generated by different methodologies can be compared directly and used in an essentially interchangeable manner. To address this question, the isolated joint range of motion data from two different test series were compared. Both data sets were generated from participants wearing the Mark III Space Suit Technology Demonstrator (MK-III), Waist Entry I-suit (WEI), and minimal clothing. Additionally the two tests shared a common test subject that allowed for within subject comparisons of the methods that greatly reduced the number of variables in play. The tests varied in their methodologies: the Space Suit Comparative Technologies Evaluation used 2D photogrammetry to analyze isolated ranges of motion while the Constellation space suit benchmarking and requirements development used 3D motion capture to evaluate both isolated and functional joint ranges of motion. The isolated data from both test series were compared graphically, as percent differences, and by simple statistical analysis. The results indicated that while the methods generate results that are statistically the same (significance level p= 0.01), the differences are significant enough in the practical sense to make direct comparisons ill advised. The concluding recommendations propose direction for how to bridge the data gaps and address future mobility data collection to allow for backward compatibility.

Aitchison, Lindsay↗

NASA NTRS1992

Development of a CFD code for internal flows in liquid fueled engines

To support the design efforts of engines in which liquid propellants are used, one is often required to analyze incompressible, two-dimensional or axisymmetric flows within ducts and cavities with rotating walls and complicated geometries. The steady-state solution is of interest in most cases. This code is intended to provide a tool for efficient computational fluid dynamics (CFD) analysis of such flow problems, taking advantage of the artificial compressibility concept and the Beam-Warming numerical scheme modified for second order accurate, implicit boundary conditions. These concepts ensure a stable, robust, and accurate algorithm due to the reduced speed of sound and the accuracy of the boundary conditions. The code is dedicated only to two-dimensional or axisymmetric flows with or without swirl. Three-dimensional computation is excluded to increase efficiency and speed. This paper briefly presents the theory of the code, as well as several benchmark applications with comparison to well known analytical solutions. In all these test cases, the code produced accurate results.

Dakhoul, Youssef↗

NASA NTRS2017

Sintered Cathodes for All-Solid-State Structural Lithium-Ion Batteries

All-solid-state structural lithium ion batteries serve as both structural load-bearing components and as electrical energy storage devices to achieve system level weight savings in aerospace and other transportation applications. This multifunctional design goal is critical for the realization of next generation hybrid or all-electric propulsion systems. Additionally, transitioning to solid state technology improves upon battery safety from previous volatile architectures. This research established baseline solid state processing conditions and performance benchmarks for intercalation-type layered oxide materials for multifunctional application. Under consideration were lithium cobalt oxide and lithium nickel manganese cobalt oxide. Pertinent characteristics such as electrical conductivity, strength, chemical stability, and microstructure were characterized for future application in all-solid-state structural battery cathodes. The study includes characterization by XRD, ICP, SEM, ring-on-ring mechanical testing, and electrical impedance spectroscopy to elucidate optimal processing parameters, material characteristics, and multifunctional performance benchmarks. These findings provide initial conditions for implementing existing cathode materials in load bearing applications.

Ceramics↗