Engineering PapersSearch

Engineering topics

Baltzley, D. R.

Publications and source records attributed to Baltzley, D. R..

Development of microcomputer-based mental acuity tests

Recent disasters have focused attention on performance problems due to the use of alcohol and controlled substances in the workplace. Environmental stressors such as thermal extremes, mixed gases, noise, motion, and vibration also have adverse effects on human performance and operator efficiency. However, the lack of a standardized, sensitive, human performance assessment battery has probably delayed the systematic study of the deleterious effects of various toxic chemicals and drugs at home and in the workplace. The collective goal of the research reported here is the development of a menu of tests embedded in a coherent package of hardware and software that may be useful in repeated-measures studies of a broad range of agents that can degrade human performance. A menu of 40 tests from the Automated Performance Test System (APTS) is described, and the series of interlocking studies supporting its development is reviewed. The APTS tests, which run on several versions of laptop portables and desktop personal computers, have been shown to be stable, reliable, and factorially rich, and to have predictive validities with holistic measures of intelligence and simulator performances. In addition, sensitivity studies have been conducted in which performance changes due to stressors, agents, and treatments were demonstrated. We believe that tests like those described here have prospective use as an adjunct to urine testing for the screening for performance loss of individuals who are granted access to workplaces and stations that impact public safety.

Non-NASA Center

Development of microcomputer-based mental acuity tests for repeated-measures studies

The purpose of this report is to detail the development of the Automated Performance Test System (APTS), a computer battery of mental acuity tests that can be used to assess human performance in the presence of toxic elements and environmental stressors. There were four objectives in the development of APTS. First, the technical requirements for developing APTS followed the tenets of the classical theory of mental tests which requires that tests meet set criteria like stability and reliability (the lack of which constitutes insensitivity). To be employed in the study of the exotic conditions of protracted space flight, a battery with multiple parallel forms is required. The second criteria was for the battery to have factorial multidimensionality and the third was for the battery to be sensitive to factors known to compromise performance. A fourth objective was for the tests to converge on the abilities entailed in mission specialist tasks. A series of studies is reported in which candidate APTS tests were subjected to an examination of their psychometric properties for repeated-measures testing. From this work, tests were selected that possessed the requisite metric properties of stability, reliability, and factor richness. In addition, studies are reported which demonstrate the predictive validity of the tests to holistic measures of intelligence.

Kennedy, R. S.

Factor analysis and predictive validity of microcomputer-based tests

11 tests were selected from two microcomputer-based performance test batteries because previously these tests exhibited rapid stability (less than 10 min, of practice) and high retest reliability efficiencies (r greater than 0.707 for each 3 min. of testing). The battery was administered three times to each of 108 college students (48 men and 60 women) and a factor analysis was performed. Two of the three identified factors appear to be related to information processing ("encoding" and "throughput/decoding"), and the third named an "output/speed" factor. The spatial, memory, and verbal tests loaded on the "encoding" factor and included Grammatical Reasoning, Pattern Comparison, Continuous Recall, and Matrix Rotation. The "throughput/decoding" tests included perceptual/numerical tests like Math Processing, Code Substitution, and Pattern Comparison. The output speed factor was identified by Tapping and Reaction Time tests. The Wonderlic Personnel Test was group administered before the first and after the last administration of the performance tests. The multiple Rs in the total sample between combined Wonderlic as a criterion and less than 5 min. of microcomputer testing on Grammatical Reasoning and Math Processing as predictors ranged between 0.41 and 0.52 on the three test administrations. Based on these results, the authors recommend a core battery which, if time permits, would consist of two tests from each factor. Such a battery is now known to permit stable, reliable, and efficient assessment.

Non-NASA Center

Psychology of computer use: IX. A menu of self-administered microcomputer-based neurotoxicology tests

This study examined the feasibility of repeated self-administration of a newly developed battery of mental acuity tests which may have application in screening for fitness-for-duty or for persons who may be exposed to environmental stress, toxic agents, or disease. 16 subjects self-administered 18 microcomputer-based tests (13 new, 5 "core"), without proctors, over 10 sessions. The hardware performed well throughout the study and the tests appeared to be easily self-administered. Stabilities and reliabilities of the tests from the "core" battery were comparable to those obtained previously under more controlled experimental conditions. Eight of the new tests exceeded minimum criteria for metric and practical requirements and can be recommended as additions to the menu. Although the average retest reliability was high, cross-correlations between tests were low, implying factorial diversity. The menu can be used to form batteries with flexible total testing time which are likely to tap different mental processes and functions.

NASA Discipline Neuroscience

A differential approach to microcomputer test battery development and implementation

The present microcomputer-based performance test battery emphasizes psychometric theory and utility for repeated-measures applications during extended exposure to various environmental stressors. In the menu that has been defined at the current state of this system's development, there are more than 30 'qualified' mental tests which stabilize in less than 10 min and possess test-retest reliabilities greater than 0.7 for a three-minute test/work period. The battery encompasses tests of cognition, information processing, psychomotor skill, memory, mood, etc. Several of the tests have demonstrated sensitivity to chemoradiotherapy, sleep loss, hypoxia, amphetamines, thermal stress, sensory deprivation, altitude, fatigue, and alcohol use. Recommendations are presented for 6-, 12-, and 22-min batteries.

Kennedy, R. S.