Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “human performance measures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Analysis of human performance differences between students and operators when using the Rancor Microworld simulator

Here, from within the umbrella of the Simplified Human Error Experimental Program (SHEEP) framework, this paper analyzes human performance differences between professional and student operators when using a simplified simulator (i.e., Rancor Microworld). This paper represents a crucial step in understanding the fidelity of the simplified simulators and student operators within the SHEEP study. This paper explores a randomized factorial experimental design that features two independent variables: participant type and event class. Six human performance measurements are considered in the experiment. The experiment is conducted using 20 professional reactor operators employed at actual nuclear power plants (NPPs), along with 20 trained students. The experimental data are analyzed via statistical analysis methods. Finally, this paper examines the differences in human performance between actual operators and students when using Rancor Microworld.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

An Empirical Study on the Use of the Rancor Microworld Simulator to Support Full-scope Data Collection

A lack of data has been identified as a major challenge in human reliability analysis (HRA). Accordingly, several institutes and researchers have tried to collect HRA data from different data sources such as actual historical measurements, expert judgements, or simulator studies. While the most recent studies predominantly focus on collecting data using full-scope simulators with actual operators, Idaho National Laboratory (INL) has begun to collect HRA data using a simplified simulator, i.e., the Rancor Microworld simulator, with student participants. Full-scope studies have been known to have several intrinsic challenges to securing enough quantity of the data due to many reasons like the high cost for performing experiments or requiring actual operators’ cooperation. The ultimate goal of INL’s effort aims to infer actual operators’ data collected from a full-scope simulator on the basis of microworld data with student subjects as well as collect additional data that could be missed in the full-scope research. As a first step to achieve this goal, this paper projects an experimental plan for investigating the differences in human performance between individuals in two groups: 1) an actual operator and 2) a student when using the Rancor Microworld simulator. A randomized factorial experiment design has been developed with two independent variables, i.e., type of scenario and type of subject. Six human performance measures, i.e., 1) time, 2) error, 3) workload, 4) situation awareness, 5) patterns of attention and 6) the number of manipulations were selected. A couple of scenarios and their procedures available to the Rancor Microworld simulator have been developed.

99 GENERAL AND MISCELLANEOUS↗

Comparison of Human Performance between Operators and Students Using Rancor Microworld Simulator: A Preliminary Result

This paper describes an experiment using the Rancor Microworld simulator to probe into differences in human performance between students and actual operators. Six human performance measures – 1) time, 2) error, 3) workload, 4) situational awareness, 5) attention patterns, and 6) number of manipulations – are measured from experiments. The experiment has been conducted for 11 operators and 20 students so far. More experiments and analyses will be continued. Further experimental studies using Rancor Microworld are expected to be able to collect additional data that may be missing from full-scope studies and contribute to items that can support human reliability data.

99 GENERAL AND MISCELLANEOUS↗

HUMAN FACTORS AND BEHAVIORAL PERFORMANCE EXPLORATION MEASURES: ASSESSING ASTRONAUT RISK

INTRODUCTION: The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures to assess behavioral health and performance risk related to future exploration class missions, and to support reduction of the Human Research Program’s (HRP) Behavioral Medicine (BMed), Team, Sleep, and Human Systems Integration Architecture (HSIA) risks. This presentation will provide an overview of the HFBP-EM program, describe its implementation across spaceflight analogs and the international space station (ISS), and discuss its applicability to audience members. TOPIC: HFBP-EM is a research program designed to develop a standard set of measures that can be used in space and space-analog research to characterize BMed, Team, Sleep, and HSIA risks. It is an ongoing research project that is used examine the validity and reliability of HFBP measures, as well as their shorter forms. It also serves as a test bed for HFBP measures being considered for the spaceflight standard measures. The suite of measures is used to test the efficacy of countermeasures. To date, HFBP-EM has been collected in Human Exploration Research Analogs campaigns 4 and 5, and the SIRIUS 19 mission in the Russian Ground Based Experiment Complex. A subset of the HFBP-EM suite was collected during spaceflight as part of HRP’s Standard Measures in Spaceflight Project. Data was collected from a total of 55 multinational astronaut and astronaut-like crewmembers (mean age: 39.5, SD = 7.6; 31% female; 91% with advanced degrees). Three broad categories of HFBP-EM measures and their relevance to HRP risks will be discussed: 1) surveys that assess team functioning (Teams risk) as well as mood and affect (Bmed risk), 2) performance-based tasks of cognitive functioning and operationally relevant performance (Bmed risk), and 3) physiological biomarkers of sleep (sleep risk) and heart rate (Bmed risk). We will provide an overview of the background of the HFBP-EM program, what the suite currently includes, and next steps in its future development. We will also discuss the application to aerospace practitioners and researchers. APPLICATION: Astronaut teams selected for future space exploration missions will face several challenges that pose significant yet still unknown risks to the behavioral health and performance of astronauts. The HFBP-EM suite provides a comprehensive assessment of behavioral health and performance in space analog and spaceflight settings. This suite can be applied to both operational and research settings to advance risk reduction research for long duration space exploration missions.

S T Bell↗

Study to design and develop remote manipulator system

Human performance measurement techniques for remote manipulation tasks and remote sensing techniques for manipulators are described for common manipulation tasks, performance is monitored by means of an on-line computer capable of measuring the joint angles of both master and slave arms as a function of time. The computer programs allow measurements of the operator's strategy and physical quantities such as task time and power consumed. The results are printed out after a test run to compare different experimental conditions. For tracking tasks, we describe a method of displaying errors in three dimensions and measuring the end-effector position in three dimensions.

Hill, J. W.↗

Human Factors Research for Space Exploration: Measurement, Modeling, and Mitigation

As part of NASA's Human Research Program, the Space Human Factors Engineering Project serves as the bridge between Human Factors research and Human Spaceflight applications. Our goal is to be responsive to the operational community while addressing issues at a sufficient level of abstraction to ensure that our tools and solutions generalize beyond the point design. In this panel, representatives from four of our research domains will discuss the challenges they face in solving current problems while also enabling future capabilities. Historically, engineering-dominated organizations have tended to view good Human Factors (HF) as a desire rather than a requirement in system design and development. Our field has made significant gains in the past decade, however; the Department of Defense, for example, now recognizes Human-System Integration (HSI), of which HF is a component, as an integral part of their divisions hardware acquisition processes. And our own agency was far more accepting of HF/HSI requirements during the most recent vehicle systems definition than in any prior cycle. Nonetheless, HF subject matter experts at NASA often find themselves in catch up mode... coping with legacy systems (hardware and software) and procedures that were designed with little regard for the human element, and too often with an attitude of we can deal with any operator issues during training. Our challenge, then, is to segregate the true knowledge gaps in Space Human Factors from the prior failures to incorporate best (or even good) HF design principles. Further, we strive to extract the overarching core HF issues from the point-design-specific concerns that capture the operators (and managers) attention. Generally, our approach embraces a 3M approach to Human Factors: Measurement, Modeling, and Mitigation. Our first step is to measure human performance, to move from subjective anecdotes to objective, quantified data. Next we model the phenomenon, using appropriate methods in our field, modifying them to suit the unique aspects of the space environment. Finally, we develop technologies, tools, and procedures to mitigate the decrements in human performance and capabilities that occur in space environments. When successful, we decrease risks to crew safety and to mission success. When extremely successful (or lucky), we devise generalizable solutions that advance the state of our practice. Our panel is composed of researchers from diverse domains of our project... from different boxes, if you will, of the Human Factors Analysis and Classification System (HFACS).

Kaiser, Mary K.↗

Human Factors and Behavioral Performance Exploration Measures Harmonized Across HERA, NEK, and ISS: Teams Risk

BACKGROUNDThe Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures to assess behavioral health and performance risk related to future exploration class missions, and to support reduction of the Human Research Program’s (HRP) Behavioral Medicine (BMed), Team, Sleep, and Human Systems Integration Architecture risks. HFBP-EM were collected during Human Exploration Research Analogs (HERA) campaigns 4 (C4) and 5 (C5), and during SIRIUS 17 and 19 missions in the Russian Ground Based Experiment Complex, NEK, to document the feasibility, flexibility, and acceptability of these measures in analogsof the spaceflight environment. A subset of the HFBP-EM suite was collected during spaceflight as part HRP’s Standard Measures in Spaceflight Project. Whenever possible, the HFBP-EM protocol and measures are kept the same across studies, however, differences across research settings (e.g., experimental manipulations, mission scenarios, mission length) and implementation of the measures require the data are harmonized to ensure comparable views across missions. The purpose of our project is to develop a harmonized database of HFBP-EM data from different settings, and to summarize the trajectory of behavioral health and performance within and between research settings. In this presentation, we will summarize the harmonized dataset and the trajectory of measures related to the Team Risk, including team performance, team cohesion, team processes, and psychological safety, over time and between and within settings.METHODSWe followed best practices for data harmonization. Characteristics of each research setting were assessed for harmonization potential, and we deemed NEK-SIRIUS 17 as inappropriate due to study aims, length, and data quality. Common variables of interest were identified. Study characteristics and key variables with which datafiles could be merged were defined as “meta-data.” HFBP-EM data from all settings were processed under a common format. We then created a harmonized team-level database designed to facilitate analyses that address HRP research gaps related to HRP’s Team risk. In this database, team cohesion, processes, performance, psychological safety, and group living were operationalized as the team mean of the crew responses for each data collection (e.g., on mission day 7). Data collected on the International Space Station (ISS) included a subset of scale items administered to participants. Data collected from ISS team members within +/- 7 days of the first data collection and every following 30 +/-4 days were aggregated to the team level. We generated figures that display the mean and variability of team constructs across research settings. We also generated plots of changes in team constructs with mission day and with percentage of the mission completed. Where possible, we compared data from spaceflight analogs with data from astronauts aboard the ISS. RESULTS AND DISCUSSIONThe team-level harmonized database was structured such that each row represents data for a team on a specific mission day. Team constructs (e.g., team cohesion) were included as columns (i.e., wide format) with repeated measures across mission days given in rows (i.e., long format). The database included data from 18 crews: five, 4-person American crews in HERA C4, four 4-person American crews in HERA C5, one 6-person multinational crew in NEK-SIRIUS 19, and eight, 2–11-person multinational crews aboard the ISS. Results provide insights into mission and campaign differences in team functioning and performance. For example, between campaign differences were observed for team processes—the interdependent team actions that orchestrate taskwork in pursuit of the team’s goals [1]. Greater between-team variability on team processes was detected during HERA C4 than during C5, and a downward trend was observed over the duration of C4, but not C5 or SIRIUS 19. This may be due to the campaign-level differences such as the sleep deprivation implemented during C4. Responses on the subset of team process items administered on the ISS indicate between-crew variability more like those observed in C4 than C5 and NEK, with some, but not all ISS crews demonstrating a downward trend over time. Additional findings will be presented. REFERENCESMarks, M. A., et al (2001) Academy of Management Review, 26(3), 356-376.

S T Bell↗

Human Factors and Behavioral Performance Exploration Measures Harmonized Across HERA, NEK, and ISS Teams Risk

The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures to assess behavioral health and performance risk related to future exploration class missions, and to support reduction of the Human Research Program’s (HRP) Behavioral Medicine (BMed), Team, Sleep, and Human Systems Integration Architecture risks. HFBP-EM were collected during Human Exploration Research Analogs (HERA) campaigns 4 (C4) and 5 (C5), and during SIRIUS 17 and 19 missions in the Russian Ground Based Experiment Complex, NEK, to document the feasibility, flexibility, and acceptability of these measures in analogs of the spaceflight environment. A subset of the HFBP-EM suite was collected during spaceflight as part HRP’s Standard Measures in Spaceflight Project. Whenever possible, the HFBP-EM protocol and measures are kept the same across studies, however, differences across research settings (e.g., experimental manipulations, mission scenarios, mission length) and implementation of the measures require the data are harmonized to ensure comparable views across missions. The purpose of our project is to develop a harmonized database of HFBP-EM data from different settings, and to summarize the trajectory of behavioral health and performance within and between research settings. In this presentation, we will summarize the harmonized dataset and the trajectory of measures related to the Team Risk, including team performance, team cohesion, team processes, and psychological safety, over time and between and within settings.

S T Bell↗

Human Factors and Behavioral Performance Exploration Measures Harmonized Across HERA, NEK, And ISS: Behavioral Medicine Risk

The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite is a set of standardized measures used to assess behavioral health and performance risks related to future exploration class space missions. The HFBP-EM addresses the Human Research Program’s (HRP) Behavioral Medicine (BMed), Team, Sleep, and Human Systems Integration Architecture risks. HFBP-EM were collected during Human Exploration Research Analog (HERA) campaigns 4 and 5, and during SIRIUS 17 and 19 missions in the Russian Ground Based Experiment Complex, NEK, to document the feasibility, flexibility, and acceptability of these measures in analogs of spaceflight environments. A subset of the HFBP-EM suite was collected in spaceflight as part of the HRP Standard Measures in Spaceflight Project. Whenever possible, the HFBP-EM protocol and measures are the same across studies, differences across research settings (e.g., experimental manipulations, mission scenarios, and mission length) and implementation of the measures require that the data are harmonized to ensure comparable views across missions. The purpose of our project was to develop a harmonized database of analyzable HFBP-EM data from spaceflight and analog settings, and to summarize the trajectory of behavioral health and performance outcomes within and between mission settings. In this presentation, we will summarize the harmonized dataset and the trajectory of BMed related measures including depression, neurobehavioral function, mood, cognition, and operationally relevant individual performance over time and by campaign and mission.

S T Bell↗

MPATH (Measuring Performance for Autonomy Teaming with Humans) Ground Control Station: Design Approach and Initial Usability Results

Envisioned future Advanced Air Mobility (AAM) operations will require a transition of aircraft command and control from onboard pilots to remote operators. The National Aeronautics and Space Administration (NASA) has developed a research ground control station (GCS) software called MPATH (Measuring Performance for Autonomy Teaming with Humans) to study the human factors of remote operators in a representative AAM environment, where small uncrewed aerial systems (sUAS; simulated or real) act as surrogates for larger AAM aircraft. A primary focus of the research being conducted with the MPATH GCS is scalability (i.e., one human managing multiple vehicles). MPATH has demonstrated to be a useful capability for human factors research and remote operations. Two initial usability studies and a multi-vehicle control assessment were recently conducted, and usability data and operator feedback were collected. Generally, participants rated MPATH high on usability and interface quality, whereas information quality was rated slightly lower. These results were supported by specific feedback. Several generalized GCS design recommendations are proposed based on the results and feedback from these flight activities. Future updates to MPATH will incorporate the proposed recommendations. In practice, these recommendations could be used by any GCS software designer or developer to promote usability and safety.

Advanced Air Mobility↗

Overview of NASA Behavioral Health and Performance Standard Measures

NASA’s Human Research Program (HRP) is developing a set of “Standard Measures” for use in spaceflight and spaceflight analog environments to monitor the risks of long-duration missions on human health and performance, including behavioral health, individual and team performance, and social processes. Based on measures selected, developed, and tested under the NASA-funded Behavioral Core Measures project (PI: D.F. Dinges) as well as other projects from NASA’s Human Factors & Behavioral Performance research portfolio, NASA’s Behavioral Health & Performance (BHP) Laboratory is further evaluating the operational feasibility, acceptability, and validity of a multidisciplinary suite of objective, subjective, behavioral, and biological measures for monitoring monitor behavioral health, individual and team performance, and social processes over time. The inaugural generation of the NASA Behavioral Health & Performance (BHP) Standard Measures includes a neurocognitive test battery, actigraphy, physical proximity sensors, cardiovascular monitors, and subjective self-reports of mood, depression, and various team and social processes and performance outcomes.

Roma, P. G.↗

Effects of scopolamine and dextroamphetamine on human performance

The effects of two drugs used to prevent symptoms of motion sickness in the operational environment were examined in this study of human performance as measured by computer-based tests of cognitive and psychomotor skills. Each subject was exposed repetitively to five tests: symbol-digit substitution, simple reaction time, pattern recognition, digit span memory, and pattern memory. Although there have been previous reports of decreases in human performance in similar testing with higher dosages of scopolamine or dextroamphetamine, no significant decrements were observed with the operational-level combined dose used in this study (0.4 mg oral scopolamine and 5.0 mg oral dextroamphetamine.) The controversy over the use of combination drug therapy in this environnment is discussed along with the indications for further research based on the findings.

Schmedtje, John F., Jr.↗