SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

All sources NASA NTRS DOE OSTI

NASA NTRS1985

An hierarchical approach to performance evaluation of expert systems

The number and size of expert systems is growing rapidly. Formal evaluation of these systems - which is not performed for many systems - increases the acceptability by the user community and hence their success. Hierarchical evaluation that had been conducted for computer systems is applied for expert system performance evaluation. Expert systems are also evaluated by treating them as software systems (or programs). This paper reports many of the basic concepts and ideas in the Performance Evaluation of Expert Systems Study being conducted at the University of Southwestern Louisiana.

Dominick, Wayne D.↗

NASA NTRS1989

Reliability and performance evaluation of systems containing embedded rule-based expert systems

A method for evaluating the reliability of real-time systems containing embedded rule-based expert systems is proposed and investigated. It is a three stage technique that addresses the impact of knowledge-base uncertainties on the performance of expert systems. In the first stage, a Markov reliability model of the system is developed which identifies the key performance parameters of the expert system. In the second stage, the evaluation method is used to determine the values of the expert system's key performance parameters. The performance parameters can be evaluated directly by using a probabilistic model of uncertainties in the knowledge-base or by using sensitivity analyses. In the third and final state, the performance parameters of the expert system are combined with performance parameters for other system components and subsystems to evaluate the reliability and performance of the complete system. The evaluation method is demonstrated in the context of a simple expert system used to supervise the performances of an FDI algorithm associated with an aircraft longitudinal flight-control system.

Beaton, Robert M.↗

NASA NTRS1985

On evaluating parallel computer systems

A workshop was held in an attempt to program real problems on the MIT Static Data Flow Machine. Most of the architecture of the machine was specified but some parts were incomplete. The main purpose for the workshop was to explore principles for the evaluation of computer systems employing new architectures. Principles explored were: (1) evaluation must be an integral, ongoing part of a project to develop a computer of radically new architecture; (2) the evaluation should seek to measure the usability of the system as well as its performance; (3) users from the application domains must be an integral part of the evaluation process; and (4) evaluation results should be fed back into the design process. It is concluded that the general organizational principles are achievable in practice from this workshop.

Adams, George B., III↗

NASA NTRS1990

Recent advances in nondestructive evaluation made possible by novel uses of video systems

Complex materials are being developed for use in future advanced aerospace systems. High temperature materials have been targeted as a major area of materials development. The development of composites consisting of ceramic matrix and ceramic fibers or whiskers is currently being aggressively pursued internationally. These new advanced materials are difficult and costly to produce; however, their low density and high operating temperature range are needed for the next generation of advanced aerospace systems. These materials represent a challenge to the nondestructive evaluation community. Video imaging techniques not only enhance the nondestructive evaluation, but they are also required for proper evaluation of these advanced materials. Specific research examples are given, highlighting the impact that video systems have had on the nondestructive evaluation of ceramics. An image processing technique for computerized determination of grain and pore size distribution functions from microstructural images is discussed. The uses of video and computer systems for displaying, evaluating, and interpreting ultrasonic image data are presented.

Generazio, Edward R.↗

NASA NTRS1991

Development of high temperature containerless processing equipment and the design and evaluation of associated systems required for microgravity materials processing and property measurements

The development of high temperature containerless processing equipment and the design and evaluation of associated systems required for microgravity materials processing and property measurements are discussed. Efforts were directed towards the following task areas: design and development of a High Temperature Acoustic Levitator (HAL) for containerless processing and property measurements at high temperatures; testing of the HAL module to establish this technology for use as a positioning device for microgravity uses; construction and evaluation of a brassboard hot wall Acoustic Levitation Furnace; construction and evaluation of a noncontact temperature measurement (NCTM) system based on AGEMA thermal imaging camera; construction of a prototype Division of Amplitude Polarimetric Pyrometer for NCTM of levitated specimens; evaluation of and recommendations for techniques to control contamination in containerless materials processing chambers; and evaluation of techniques for heating specimens to high temperatures for containerless materials experimentation.

Rey, Charles A.↗

NASA NTRS1991

Evaluation of the concept of pressure proof testing fuselage structures

The FAA and NASA have recently completed independent technical evaluations of the concept of pressure proof testing the fuselage of commercial transport airplanes. The results of these evaluations are summarized. The objectives of the evaluations were to establish the potential benefit of the pressure proof test, to quantify the most desirable proof test pressure, and to quantify the required proof test interval. The focus of the evaluations was on multiple-site cracks extending from adjacent rivet holes of a typical fuselage longitudinal lap splice joint. The FAA and NASA do not support pressure proof testing the fuselage of aging commercial transport aircraft. The argument against proof testing is as follows: (1) a single proof test does not insure an indefinite life; therefore, the proof test must be repeated at regular intervals; (2) for a proof factor of 1.33, the required proof test interval must be below 300 flights to account for uncertainties in the evaluation; (3) conducting the proof test at a proof factor of 1.5 would considerably exceed the fuselage design limit load; therefore, it is not consistent with accepted safe practices; and (4) better safety can be assured by implementing enhanced nondestructive inspection requirements, and adequate reliability can be achieved by an inspection interval several times longer than the proof test interval.

Harris, Charles E.↗

NASA NTRS1991

Evaluation of components, subsystems, and networks for high rate, high frequency space communications

The development of new space communications technologies by NASA has included both commercial applications and space science requirements. NASA's Systems Integration, Test and Evaluation (SITE) Space Communication System Simulator is a hardware based laboratory simulator for evaluating space communications technologies at the component, subsystem, system, and network level, geared toward high frequency, high data rate systems. The SITE facility is well-suited for evaluation of the new technologies required for the Space Exploration Initiative (SEI) and advanced commercial systems. Described here are the technology developments and evaluation requirements for current and planned commercial and space science programs. Also examined are the capabilities of SITE, the past, present and planned future configurations of the SITE facility, and applications of SITE to evaluation of SEI technology.

Kerczewski, Robert J.↗

NASA NTRS1992

Manned transportation system study - Evaluation of candidate transportation architectures

The overall evaluation process, the tool developed to perform the evaluation, and the evaluation results in determining the right approach to meet the nation's mannned transportation needs are presented. To address the various considerations, architecture sets consisting of the candidate transportation systems are constructed. As this methodology results in multiple architectures to examine, an architecture evaluation tool was developed to facilitate the evaluation of the architecture attribute values from the system values of the attributes.

Lance, Nicholas↗

NASA NTRS1992

Piloted evaluation of an integrated propulsion and flight control simulator

This paper describes a piloted evaluation of the integrated flight and propulsion control simulator at NASA Lewis Research Center. The purpose of this evaluation is to demonstrate the suitability and effectiveness of this fixed based simulator for advanced integrated propulsion and airframe control design. The evaluation will cover control effector gains and deadbands, control effectiveness and control authority, and heads up display functionality. For this evaluation the flight simulator is configured for transition flight using an advanced Short Take-Off and vertical Landing fighter aircraft model, a simplified high-bypass turbofan engine model, fighter cockpit, displays, and pilot effectors. The paper describes the piloted tasks used for rating displays and control effector gains. Pilot comments and simulation results confirm that the display symbology and control gains are very adequate for the transition flight task. Additionally, it is demonstrated that this small-scale, fixed base flight simulator facility can adequately perform a real time, piloted control evaluation.

Bright, Michelle M.↗

NASA NTRS1992

Proposed evaluation framework for assessing operator performance with multisensor displays

Despite aggressive work on the development of sensor fusion algorithms and techniques, no formal evaluation procedures have been proposed. Based on existing integration models in the literature, an evaluation framework is developed to assess an operator's ability to use multisensor, or sensor fusion, displays. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The operator's performance with the sensor fusion display can be compared to the models' predictions based on the operator's performance when viewing the original sensor displays prior to fusion. This allows for the determination as to when a sensor fusion system leads to: 1) poorer performance than one of the original sensor displays (clearly an undesirable system in which the fused sensor system causes some distortion or interference); 2) better performance than with either single sensor system alone, but at a sub-optimal (compared to the model predictions) level; 3) optimal performance (compared to model predictions); or, 4) super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays. An experiment demonstrating the usefulness of the proposed evaluation framework is discussed.

Foyle, David C.↗

NASA NTRS1993

Stochastic performance modeling and evaluation of obstacle detectability with imaging range sensors

Statistical modeling and evaluation of the performance of obstacle detection systems for Unmanned Ground Vehicles (UGVs) is essential for the design, evaluation, and comparison of sensor systems. In this report, we address this issue for imaging range sensors by dividing the evaluation problem into two levels: quality of the range data itself and quality of the obstacle detection algorithms applied to the range data. We review existing models of the quality of range data from stereo vision and AM-CW LADAR, then use these to derive a new model for the quality of a simple obstacle detection algorithm. This model predicts the probability of detecting obstacles and the probability of false alarms, as a function of the size and distance of the obstacle, the resolution of the sensor, and the level of noise in the range data. We evaluate these models experimentally using range data from stereo image pairs of a gravel road with known obstacles at several distances. The results show that the approach is a promising tool for predicting and evaluating the performance of obstacle detection with imaging range sensors.

Matthies, Larry↗

NASA NTRS1994

Evaluating modeling tools for the EDOS

The Earth Observing System (EOS) Data and Operations System (EDOS) Project is developing a functional, system performance model to support the system implementation phase of the EDOS which is being designed and built by the Goddard Space Flight Center (GSFC). The EDOS Project will use modeling to meet two key objectives: (1) manage system design impacts introduced by unplanned changed in mission requirements; and (2) evaluate evolutionary technology insertions throughout the development of the EDOS. To select a suitable modeling tool, the EDOS modeling team developed an approach for evaluating modeling tools and languages by deriving evaluation criteria from both the EDOS modeling requirements and the development plan. Essential and optional features for an appropriate modeling tool were identified and compared with known capabilities of several modeling tools. Vendors were also provided the opportunity to model a representative EDOS processing function to demonstrate the applicability of their modeling tool to the EDOS modeling requirements. This paper emphasizes the importance of using a well defined approach for evaluating tools to model complex systems like the EDOS. The results of this evaluation study do not in any way signify the superiority of any one modeling tool since the results will vary with the specific modeling requirements of each project.

Knoble, Gordon↗

NASA NTRS1995

Flight test evaluation of the Stanford University/United Airlines differential GPS Category 3 automatic landing system

Test flights were conducted to evaluate the capability of Differential Global Positioning System (DGPS) to provide the accuracy and integrity required for International Civil Aviation Organization (ICAO) Category (CAT) 3 precision approach and landings. These test flights were part of a Federal Aviation Administration (FAA) program to evaluate the technical feasibility of using DGPS based technology for CAT 3 precision approach and landing applications. A United Airlines Boeing 737-300 (N304UA) was equipped with DGPS receiving equipment and additional computing capability provided by Stanford University. The test flights were conducted at NASA Ames Research Center's Crows Landing Flight Facility, Crows Landing, California. The flight test evaluation was based on completing 100 approaches and autolandings; 90 touch and go, and 10 terminating with a full stop. Two types of accuracy requirements were evaluated: 1) Total system error, based on the Required Navigation Performance (RNP), and 2) Navigation sensor error, based on ICAO requirements for the Microwave Landing System (MLS). All of the approaches and autolandings were evaluated against ground truth reference data provided by a laser tracker. Analysis of these approaches and autolandings shows that the Stanford University/United Airlines system met the requirements for a successful approach and autolanding 98 out of 100 approaches and autolandings, based on the total system error requirements as specified in the FAA CAT 3 Level 2 Flight Test Plan.

Kaufmann, David N.↗

NASA NTRS1994

Advanced Video Analysis Needs for Human Performance Evaluation

Evaluators of human task performance in space missions make use of video as a primary source of data. Extraction of relevant human performance information from video is often a labor-intensive process requiring a large amount of time on the part of the evaluator. Based on the experiences of several human performance evaluators, needs were defined for advanced tools which could aid in the analysis of video data from space missions. Such tools should increase the efficiency with which useful information is retrieved from large quantities of raw video. They should also provide the evaluator with new analytical functions which are not present in currently used methods. Video analysis tools based on the needs defined by this study would also have uses in U.S. industry and education. Evaluation of human performance from video data can be a valuable technique in many industrial and institutional settings where humans are involved in operational systems and processes.

Campbell, Paul D.↗

NASA NTRS1996

UNIX-based operating systems robustness evaluation

Robust operating systems are required for reliable computing. Techniques for robustness evaluation of operating systems not only enhance the understanding of the reliability of computer systems, but also provide valuable feed- back to system designers. This thesis presents results from robustness evaluation experiments on five UNIX-based operating systems, which include Digital Equipment's OSF/l, Hewlett Packard's HP-UX, Sun Microsystems' Solaris and SunOS, and Silicon Graphics' IRIX. Three sets of experiments were performed. The methodology for evaluation tested (1) the exception handling mechanism, (2) system resource management, and (3) system capacity under high workload stress. An exception generator was used to evaluate the exception handling mechanism of the operating systems. Results included exit status of the exception generator and the system state. Resource management techniques used by individual operating systems were tested using programs designed to usurp system resources such as physical memory and process slots. Finally, the workload stress testing evaluated the effect of the workload on system performance by running a synthetic workload and recording the response time of local and remote user requests. Moderate to severe performance degradations were observed on the systems under stress.

Chang, Yu-Ming↗

NASA NTRS1995

Solar Thermal Concept Evaluation

Concentrated solar thermal energy can be utilized in a variety of high temperature applications for both terrestrial and space environments. In each application, knowledge of the collector and absorber's heat exchange interaction is required. To understand this coupled mechanism, various concentrator types and geometries, as well as, their relationship to the physical absorber mechanics were investigated. To conduct experimental tests various parts of a 5,000 watt, thermal concentrator, facility were made and evaluated. This was in anticipation at a larger NASA facility proposed for construction. Although much of the work centered on solar thermal propulsion for an upper stage (less than one pound thrust range), the information generated and the facility's capabilities are applicable to material processing, power generation and similar uses. The numerical calculations used to design the laboratory mirror and the procedure for evaluating other solar collectors are presented here. The mirror design is based on a hexagonal faceted system, which uses a spherical approximation to the parabolic surface. The work began with a few two dimensional estimates and continued with a full, three dimensional, numerical algorithm written in FORTRAN code. This was compared to a full geometry, ray trace program, BEAM 4, which optimizes the curvatures, based on purely optical considerations. Founded on numerical results, the characteristics of a faceted concentrator were construed. The numerical methodologies themselves were evaluated and categorized. As a result, the three-dimensional FORTRAN code was the method chosen to construct the mirrors, due to its overall accuracy and superior results to the ray trace program. This information is being used to fabricate and subsequently, laser map the actual mirror surfaces. Evaluation of concentrator mirrors, thermal applications and scaling the results of the 10 foot diameter mirror to a much larger concentrator, were studied. Evaluations, recommendations and pit falls regarding the structure, materials and facility design are presented.

Hawk, Clark W.↗

NASA NTRS1998

Evaluation of Portable Multi-Gas Analyzers for use by Safety Personnel

During confined space entry operations as well as Shuttle-safing operations, United Space Alliance (USA)/National Aeronautics and Space Administration (NASA) safety personnel use a variety of portable instrumentation to monitor for hazardous levels of compounds such as nitrogen dioxide (N%), monomethylhydrazine (NMM), FREON 21, ammonia (NH3), oxygen (O2), and combustibles (as hydrogen (H2)). Except for O2 and H2, each compound is monitored using a single analyzer. In many cases these analyzers are 5 to 10 years old and require frequent maintenance. In addition, they are cumbersome to carry and tend to make the job of personnel monitoring physically taxing. As part of an effort to upgrade the sensor technology background information was requested from a total of 27 manufacturers of portable multi-gas instruments. A set of criteria was established to determine which vendors would be selected for laboratory evaluation. These criteria were based on requests made by USA/NASA Safety personnel in order to meet requirements within their respective areas for confined-space and Shuttle-safing operations. Each of the 27 manufacturers of multi-gas analyzers was sent a copy of the criteria and asked to fill in the appropriate information pertaining to their instrumentation. Based on the results of the sensor criteria worksheets, a total of 9 vendors out of 27 surveyed manufacturers were chosen for evaluation. Each vendor included in the final evaluation process was requested to configure each of two analyzers with NO2, NH3, O2, and combustible sensors. A set of lab tests was designed in order to determine which of the multi-gas instruments under evaluation was best suited for use in both shuttle and confined space operations. These tests included linearity/repeatability, zero/span drift response/recovery, humidity, interference, and maintenance. At the conclusion of lab testing three vendors were selected for additional field testing. Based on the results of both the lab and field evaluations a single vendor was recommended for use by NASA/IJSA Safety personnel. Vendor selection criteria, as well as the results from both laboratory and field testing of the multi-gas analyzers, are presented as part of this paper.

Lueck, D. E.↗

NASA NTRS1997

Nondestructive Evaluation of Adhesively Bonded Joints by Acousto-Ultrasonic Technique and Acoustic Emission

Reliable applications of adhesively bonded joints require an effective nondestructive evaluation technique for their bond strength prediction. To properly evaluate factors affecting bond strength, effects of defects such as voids and disbonds on stress distribution in the overlap region must be understood. At the same time, in order to use acousto-ultrasonic (AU) technique to evaluate bond quality, the effect of these defects on dynamic response of single lap joints must be clear. The stress distribution in a single lap joint with and without defects (void or disbond) is analyzed. A bar-Theta parameter which contains adherend and adhesive thickness and properties is introduced. It is shown for bonded joints with bar-Theta greater than 10, that a symmetric void or disbond in the middle of overlap up to the 70 percent of overlap length has negligible effect on bond strength. In contrast frequency response analyses by a finite element technique showed that the dynamic response is affected significantly by the presence of voids or disbonds. These results have direct implication in the interpretations of AU results. Through transmission attenuation and a number of AU parameters for various specimens with and without defects are evaluated. It is found that although void and disbond have similar effects on bond strength (stress distribution), they have completely different effects on wave propagation characteristics. For steel-adhesive-steel specimens with voids, the attenuation changes are related to the bond strength. However, the attenuation changes for specimens with disbond are fairly constant over a disbond range. In order to incorporate the location of defects in AU parameters, a weighting function is introduced. Using an immersion system with focused transducers, a number of AU parameters are evaluated. It is found that by incorporating weighting functions in these parameters better sensitivities (AU parameters vs. bond strength) are achieved. Acoustic emission (AE) activities of steel-adhesive-steel specimens with bar-Theta equal to 3.4 are monitored. Two different formats of energy vs. time have resulted, each corresponding to the perfect specimens or the specimens with void or disbond. The relative acoustic energy and the number of events at failure are found to be a means for predicting the bond strength.

Nayeb-Hashemi, Hamid↗