Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Evaluation of Performance, Fatigue and Workload During Real-time, Reactive Telerobotic Mission Control Operations

Real-time, reactive telerobotic mission control operations require personnel to actively operate and manage remotely controlled vehicles or robots in real time. Due to the physical separation of the vehicle from the operator, such operations present many additional factors that can influence fatigue (i.e., degraded mental performance) and workload (i.e., mental and physical cost of task requirements), making it difficult to assess how long an individual can safely and accurately conduct operations. The upcoming Volatiles Investigating Polar Exploration Rover (VIPER) mission involves remotely controlling a lunar vehicle from an Earth-based mission control station. METHODS: In order to determine how long personnel could successfully maintain alertness and performance while operating a rover, we studied seven trained operators (i.e., 5 drivers, 2 real-time scientists) in a simulated mission control environment. We further assessed workload in order to determine whether perceived workload levels would change relative to time on task and by time of day. Operators completed two five-hour simulations in a randomized order, beginning at noon and at midnight. Performance was evaluated every 30 minutes using the psychomotor vigilance task (PVT), Karolinska Sleepiness Scale (KSS), and NASA Task Load Index (NASA-TLX). RESULTS: On average, participants rated themselves as sleepier (5.06 ± 2.28) on the night drives compared to the day drives (3.12 ± 1.44; P < .0001). Workload was rated higher during the day drives (37.93 ± 20.09) compared to night (32.09 ± 21.74; P < .01). Lastly, participants had no change in average reaction time between the two drives. CONCLUSIONS: From the analysis, we observed performance began to degrade after approximately three hours of driving. Our findings suggest that rotating drivers at least every three hours would be prudent to allow for breaks, and to minimize performance degradation, particularly during night shifts.

fatigue↗
NASA NTRS2003

A Gold Standards Approach to Training Instructors to Evaluate Crew Performance

The Advanced Qualification Program requires that airlines evaluate crew performance in Line Oriented Simulation. For this evaluation to be meaningful, instructors must observe relevant crew behaviors and evaluate those behaviors consistently and accurately against standards established by the airline. The airline industry has largely settled on an approach in which instructors evaluate crew performance on a series of event sets, using standardized grade sheets on which behaviors specific to event set are listed. Typically, new instructors are given a class in which they learn to use the grade sheets and practice evaluating crew performance observed on videotapes. These classes emphasize reliability, providing detailed instruction and practice in scoring so that all instructors within a given class will give similar scores to similar performance. This approach has value but also has important limitations; (1) ratings within one class of new instructors may differ from those of other classes; (2) ratings may not be driven primarily by the specific behaviors on which the company wanted the crews to be scored; and (3) ratings may not be calibrated to company standards for level of performance skill required. In this paper we provide a method to extend the existing method of training instructors to address these three limitations. We call this method the "gold standards" approach because it uses ratings from the company's most experienced instructors as the basis for training rater accuracy. This approach ties the training to the specific behaviors on which the experienced instructors based their ratings.

Baker, David P.↗
NASA NTRS1975

Performance and evaluation of the Viking lander camera performance prediction program

A computer program is described for predicting the performance of the Viking lander cameras. The predictions are primarily concerned with two objectives: (1) the picture quality of a reference test chart (of which there are three on each lander) to aid in diagnosing camera performance; and (2) the picture quality of cones with surface properties of a natural terrain to aid in predicting favorable illumination and viewing geometries and operational camera commands. Predictions made with this program are verified by experimental data obtained with a Viking-like laboratory facsimile camera.

Huck, F. O.↗
NASA NTRS2014

Cascade Distiller System Performance Testing Interim Results

The Cascade Distillation System (CDS) is a rotary distillation system with potential for greater reliability and lower energy costs than existing distillation systems. Based upon the results of the 2009 distillation comparison test (DCT) and recommendations of the expert panel, the Advanced Exploration Systems (AES) Water Recovery Project (WRP) project advanced the technology by increasing reliability of the system through redesign of bearing assemblies and improved rotor dynamics. In addition, the project improved the CDS power efficiency by optimizing the thermoelectric heat pump (TeHP) and heat exchanger design. Testing at the NASA-JSC Advanced Exploration System Water Laboratory (AES Water Lab) using a prototype Cascade Distillation Subsystem (CDS) wastewater processor (Honeywell d International, Torrance, Calif.) with test support equipment and control system developed by Johnson Space Center was performed to evaluate performance of the system with the upgrades as compared to previous system performance. The system was challenged with Solution 1 from the NASA Exploration Life Support (ELS) distillation comparison testing performed in 2009. Solution 1 consisted of a mixed stream containing human-generated urine and humidity condensate. A secondary objective of this testing is to evaluate the performance of the CDS as compared to the state of the art Distillation Assembly (DA) used in the ISS Urine Processor Assembly (UPA). This was done by challenging the system with ISS analog waste streams. This paper details the results of the AES WRP CDS performance testing.

Callahan, Michael R.↗
NASA NTRS1992

Evaluation Of Performance Of A Telerobot

Paper presents evaluation of performance of six-axis telerobot system with shared control and advanced modes of force feedback. Various tasks performed with and without force feedback. Study found force feedback reduces average time required to complete task by about 30 percent. Also reduces sum of squared forces by factor of 7 and errors by 63 percent.

Hannaford, Blake↗
NASA NTRS2010

Evaluating the Performance of Unmanned Ground Vehicle Water Detection

Water detection is a critical perception requirement for unmanned ground vehicle (UGV) autonomous navigation over cross-country terrain. During the Robotics Collaborative Technology Alliances (RCTA) program, the Jet Propulsion Laboratory (JPL) developed a set of water detection algorithms that are used to detect, localize, and avoid water bodies large enough to be a hazard to a UGV. The JPL water detection software performs the detection and localization stages using a forward-looking stereo pair of color cameras. The 3D coordinates of water body surface points are then output to a UGV's autonomous mobility system, which is responsible for planning and executing safe paths. There are three primary methods for evaluating the performance of the water detection software. Evaluations can be performed in image space on the intermediate detection product, in map space on the final localized product, or during autonomous navigation to characterize the avoidance of a variety of water bodies. This paper describes a methodology for performing the first two types of water detection performance evaluations.

stereo vision↗
NASA NTRS1988

Fabrication, evaluation, and performance of machined metal grazing incidence telescopes

The fabrication, evaluation, and performance of machined grazing incidence metal optics for applications ranging from telescopes with imaging of minutes of arc to those with imaging in the less-than-10-arcsec range are reviewed. Issues considered in the fabrication process include the choice of machining substrate, the choice of machine tool, the choice of method for removing tool marks, and the choice of a reflective surface. Means of evaluating the mirror performance include the FWHM and determination of noncircularity and surface roughness. Characteristics of previous and current grazing incidence metal mirrors are presented, with emphasis on the Einstein and Rosat optics.

Bowyer, Stuart↗
NASA NTRS1980

On evaluating the performability of degradable computing systems

If the performance of a computing system is 'degradable', performance and reliability issues must be dealt with simultaneously in the process of evaluating system effectiveness. For this purpose, a unified measure, called 'performability', is introduced and the foundations of performability modeling and evaluation are established. A critical step in the modeling process is the introduction of a 'capability function' which relates low-level system behavior to user-oriented performance levels. A hierarchical modeling scheme is used to formulate the capability function and capability is used, in turn, to evaluate performability. These techniques are then illustrated for a specific application: the performability evaluation of an aircraft computer in the environment of an air transport mission.

Meyer, J. F.↗
NASA NTRS2017

Image Navigation and Registration Performance Assessment Evaluation Tools for GOES-R ABI and GLM

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24 hour evaluation period. This paper describes the software design and implementation of IPATS and provides preliminary test results.

Image registration↗
NASA NTRS2017

Image Navigation and Registration Performance Assessment Evaluation Tools for GOES-R ABI and GLM

The GOES-R Flight Project has developed an Image Navigation and Registration (INR) Performance Assessment Tool Set (IPATS) for measuring Advanced Baseline Imager (ABI) and Geostationary Lightning Mapper (GLM) INR performance metrics in the post-launch period for performance evaluation and long term monitoring. IPATS utilizes a modular algorithmic design to allow user selection of data processing sequences optimized for generation of each INR metric. This novel modular approach minimizes duplication of common processing elements, thereby maximizing code efficiency and speed. Fast processing is essential given the large number of sub-image registrations required to generate INR metrics for the many images produced over a 24 hour evaluation period. This paper describes the software design and implementation of IPATS and provides preliminary test results.

image registration↗
NASA NTRS1993

Signal detection theory and methods for evaluating human performance in decision tasks

Signal Detection Theory (SDT) can be used to assess decision making performance in tasks that are not commonly thought of as perceptual. SDT takes into account both the sensitivity and biases in responding when explaining the detection of external events. In the standard SDT tasks, stimuli are selected in order to reveal the sensory capabilities of the observer. SDT can also be used to describe performance when decisions must be made as to the classification of easily and reliably sensed stimuli. Numbers are stimuli that are minimally affected by sensory processing and can belong to meaningful categories that overlap. Multiple studies have shown that the task of categorizing numbers from overlapping normal distributions produces performance predictable by SDT. These findings are particularly interesting in view of the similarity between the task of the categorizing numbers and that of determining the status of a mechanical system based on numerical values that represent sensor readings. Examples of the use of SDT to evaluate performance in decision tasks are reviewed. The methods and assumptions of SDT are shown to be effective in the measurement, evaluation, and prediction of human performance in such tasks.

Obrien, Kevin↗