How One Functional Human Performance Requirement Influenced a Rocket: NASA Human Systems Integration Success Story
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Lack of appropriate and sufficient human performance data has been identified as a key factor affecting human reliability analysis (HRA) quality especially in the estimation of human error probability (HEP). The Scenario Authoring, Characterization, and Debriefing Application (SACADA) database was developed by the U.S. Nuclear Regulatory Commission (NRC) to address this data need. An agreement between NRC and the South Texas Project Nuclear Operating Company (STPNOC) was established to support the SACADA development with aims to make the SACADA tool suitable for implementation in the nuclear power plants' operator training program to collect operator performance information. The collected data would support the STPNOC's operator training program and be shared with the NRC for improving HRA quality. This paper discusses the SACADA data taxonomy, the theoretical foundation, the prospective data to be generated from the SACADA raw data to inform human reliability and human performance, and the considerations on the use of simulator data for HRA. Each SACADA data point consists of two information segments: context and performance results. Context is a characterization of the performance challenges to task success. The performance results are the results of performing the task. The data taxonomy uses a macrocognitive functions model for the framework. At a high level, information is classified according to the macrocognitive functions of detecting the plant abnormality, understanding the abnormality, deciding the response plan, executing the response plan, and team related aspects (i.e., communication, teamwork, and supervision). The data are expected to be useful for analyzing the relations between context, error modes and error causes in human performance.
Human factors is a critical discipline for human spaceflight. Nearly every human factors research area is relevant to space exploration -- from the ergonomics of hand tools used by astronauts, to the displays and controls of a spacecraft cockpit or mission control workstation, to levels of automation designed into rovers on Mars, to organizational issues of communication between crew and ground. This chapter focuses more on the ways in which the space environment (especially altered gravity and the isolated and confined nature of long-duration spaceflight) affects crew performance, and thus has specific novel implications for human factors research and practice. We focus on four aspects of human performance: neurovestibular integration, motor control and musculo-skeletal effects, cognitive effects, and behavioral health. We also provide a sampler of recent human factors studies from NASA.
Part of the U.S. Department of Energy’s (DOE’s) Light Water Reac- tor Sustainability (LWRS) Program, the Risk-Informed Safety Margin Charac- terization (RISMC) Pathway develops approaches to estimating and managing safety margins. RISMC simulations pair deterministic plant physics models with probabilistic risk models. As human interactions are an essential element of plant risk, it is necessary to integrate human actions into the RISMC risk framework. In this paper, we review simulation based and non simulation based human reliability analysis (HRA) methods. This paper summarizes the founda- tional information needed to develop a feasible approach to modeling human in- teractions in RISMC simulations.
The purpose of this study was to review the literature related to measuring human performance in the design and evaluation of the human-system interface (HSI) of nuclear power plant (NPP) control rooms and synthesize lessons learned and future directions for research and practice in this field. The design and evaluation of digital or hybrid HSI requires comprehensive measurement of human performance to ensure quality and safety of the nuclear power process control. Human factors evaluation frameworks have been proposed to guide the measurement of human performance constructs. However, there are few guides for selecting appropriate measures for those constructs. A systematic review of empirical research literature was conducted. Studies were identified through academic publication databases and grey literature searches. Eligible studies were coded and information regarding human performance measures was extracted and analyzed. A total of 80 studies met the criteria. Human performance measures extracted from the reviewed studies included measures of: behavioral performance; workload; situation awareness; human-human or human-machine cooperation; other cognitive performance indicators; and system performance. Behavioral performance (speed and accuracy), workload, and situation awareness were the most frequently measured constructs with validated and domain-specific instruments. The results of the literature review provided an overview of the human performance constructs and their corresponding measures for NPP control room HSI evaluation. These results can be used as an initial guide to establish appropriate and comprehensive measurements of human performance for such evaluations. Future directions in measure development are also discussed. (authors)
A challenge in understanding human performance as a function of gravity is determining which tasks to research. Initial studies began with treadmill walking, which was easy to quantify and control. However, with the development of pressurized rovers, it is less important to optimize human performance for ambulation as pressurized rovers will likely perform gross translation for them. Future crews are likely to spend much of their extravehicular activity (EVA) performing geology, construction,a nd maintenance type tasks. With these types of tasks, people have different performance strategies, and it is often difficult to quantify the task and measure steady-state metabolic rates or perform biomechanical analysis. For many of these types of tasks, subjective feedback may be the only data that can be collected. However, subjective data may not fully support a rigorous scientific comparison of human performance across different gravity levels and suit factors. NASA would benefit from having a wide variety of quantifiable tasks that allow human performance comparison across different conditions. In order to determine which tasks will effectively support scientific studies, many different tasks and data analysis techniques will need to be employed. Many of these tasks and techniques will not be effective, but some will produce quantifiable results that are sensitive enough to show performance differences. One of the primary concerns related to EVA performance is metabolic rate. The higher the metabolic rate, the faster the astronaut will exhaust consumables. The focus of this poster will be on how different tasks affect metabolic rate across different gravity levels.
A challenge in understanding human performance as a function of gravity is determining which tasks to research. Initial studies began with treadmill walking, which was easy to quantify and control. However, with the development of pressurized rovers, it is less important to optimize human performance for ambulation as rovers will likely perform gross translation for them. Future crews are likely to spend much of their extravehicular activity (EVA) performing geology, construction and maintenance type tasks, for which it is difficult to measure steady-state-workloads. To evaluate human performance in reduced gravity, we have collected metabolic, biomechanical and subjective data for different tasks at varied gravity levels. Methods: Ten subjects completed 5 different tasks including weight transfer, shoveling, treadmill walking, treadmill running and treadmill incline walking. All tasks were performed shirt-sleeved at 1-g, 3/8-g and 1/6-g. Off-loaded conditions were achieved via the Active Response Gravity Offload System. Treadmill tasks were performed for 3 minutes with reported oxygen consumption (VO2) averaged over the last 2 minutes. Shoveling was performed for 3 minutes with metabolic cost reported as ml O2 consumed per kg material shoveled. Weight transfer reports metabolic cost as liters O2 consumed to complete the task. Statistical analysis was performed via repeated measures ANOVA. Results: Statistically significant metabolic differences were noted between all 3 gravity levels for treadmill running and incline walking. For the other 3 tasks, there were significant differences between 1-g and each reduced gravity, but not between 1/6-g and 3/8-g. For weight transfer, significant differences were seen between gravities in both trial-average VO2 and time-to-completion with noted differences in strategy for task completion. Conclusion: To determine if gravity has a metabolic effect on human performance, this research may indicate that tasks should be selected that require the subject to work vertically against the force of gravity.
HUMANS TO MARS, BUT HOW MANY? USING IMPRINT HUMAN PERFORMANCE MODELS TO INFORM CREW SIZE Missions to Mars will differ from previous human spaceflight missions in that the onboard crew of astronauts will be required to operate in an Earth-independent manner due to long communication delays. Without a systematic, repeatable process to determine the number and composition of crew necessary to successfully accomplish these missions, NASA increases the risk that crew sizes may be too small to meet primary mission objectives under nominal conditions and, more consequentially, that crewmembers may not have the expertise needed to successfully respond to unforeseen failures without the real-time expertise of the Mission Control Central (MCC) team NASA currently relies upon. The NASA Engineering and Safety Center (NESC) is developing a methodology for assessing the trade space of factors that affect the number of crew for future missions. This methodology includes the consideration of results from three human performance models developed using the Improved Performance Research and Integration Tool (IMPRINT) modeling platform as well as a custom-built model on expertise trained within the crew. The custom-built crew expertise model results will be presented in the training sub-tag. Here we present results of the three IMPRINT models. Two of these models were built using IMPRINT’s Operations Model capability, with detailed task networks for specific systems and scenarios allowing for a comprehensive mental workload analysis on certain crew positions. The third model was built using IMPRINT’s Force Model capability, allowing for a higher-level manpower analysis based on crew engagement in activities performed over a longer Mars transit scenario, and how those activities may be impacted by unplanned events and new tasking unique to the Mars mission. Differences between the models will be presented, as well as examples of model results and a discussion of how those results may inform future Mars mission manpower requirements, system design, and operating procedures.
Our article documents an exploratory study for collecting and using human performance data to inform human error probability (HEP) estimates for a new human reliability analysis (HRA) method, the IntegrateD Human Event Analysis System (IDHEAS). The method was based on cognitive models and mechanisms underlying human behaviour and employs a framework of 14 crew failure modes (CFMs) to represent human failures typical for human performance in nuclear power plant (NPP) internal, at-power events [1]. A decision tree (DT) was constructed for each CFM to assess the probability of the CFM occurring in different contexts. Data needs for IDHEAS quantification are discussed. Then, the data collection framework and process is described and how the collected data were used to inform HEP estimation is illustrated with two examples. Next, five major technical challenges are identified for leveraging human performance data for IDHEAS quantification. Furthermore, these challenges reflect the data needs specific to IDHEAS. More importantly, they also represent the general issues with current human performance data and can provide insight for a path forward to support HRA data collection, use, and exchange for HRA method development, implementation, and validation.
Human performance testing of astronaut capabilities during prolonged space flight
Human factors research and development investigates the capabilities and limitations of the human within a system. Of the many variables affecting human performance in the aviation maintenance system, training is among the most important. The advent of advanced technology hardware and software has created intelligent training simulations. This paper describes one advanced technology training system under development for the Federal Aviation Administration.
Although the positive effects of implementing a human performance approach to operations can be hard to quantify, many organizations and industry areas are finding tangible benefits to such a program. Recently, a unique mentoring program was established and implemented focusing on improving the performance of managers, supervisors, and work crews, using the principles of Human Performance Improvement (HPI). The goal of this mentoring was to affect behaviors and habits that reliably implement the principles of HPI to ensure continuous improvement in implementation of an Integrated Safety Management System (ISMS) within a Conduct of Operations framework. Mentors engaged with personnel in a one-on-one, or one-on-many dialogue, which focused on what behaviors were observed, what factors underlie the behaviors, and what changes in behavior could prevent errors or events, and improve performance. A senior management sponsor was essential to gain broad management support. A clear charter and management plan describing the goals, objectives, methodology, and expected outcomes was established. Mentors were carefully selected with senior management endorsement. Mentors were assigned to projects and work teams based on the following three criteria: 1) knowledge of the work scope; 2) experience in similar project areas; and 3) perceived level of trust they would have with project management, supervision, and work teams. This program was restructured significantly when the American Reinvestment and Recovery Act (ARRA) and the associated funding came to an end. The program was restructured based on an understanding of the observations, attributed successes and identified shortfalls, and the consolidation of those lessons. Mentoring the application of proven methods for improving human performance was shown effective at increasing success in day-to-day activities and increasing confidence and level of skill of supervisors. While mentoring program effectiveness is difficult to measure, and return on investment is difficult to quantify, especially in complex and large organizations where the ability to directly correlate causal factors can be challenging, the evidence presented by Sydney Dekker, James Reason, and others who study the field of human factors does assert managing and reducing error is possible. Employment of key behaviors-HPI techniques and skills-can be shown to have a significant impact on error rates. Our mentoring program demonstrated reduced error rates and corresponding improvements in safety and production. Improved behaviors are the result, of providing a culture with consistent, clear expectations from leadership, and processes and methods applied consistently to error prevention. Mentoring, as envisioned and executed in this program, was effective in helping shift organizational culture and effectively improving safety and production. (authors)
The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a software system to simulate human performance in support of human reliability analysis (HRA) in nuclear power plants. This paper summarizes recent work to integrate HUNTER with a plant simulator, namely the Rancor Microworld Simulator. Rancor is an offshoot of earlier work at Idaho National Laboratory (INL) to support plant modernization. The graphical software tools used to mimic digital human-system interface upgrades at INL’s Human Systems Simulation Laboratory were linked to the Rancor Microworld Simulator, an INL-developed simplified plant model. HUNTER becomes a “virtual operator” coupled to the Rancor simulator, thereby allowing a tight coupling between a digital human twin and a digital twin of the plant. Rancor-HUNTER may be run through Monte Carlo iterations across a dynamic range of performance shaping factors, thereby producing distributions of human performance in terms of procedure paths, errors instantiations, and task durations. This paper overviews the various unique features of Rancor-HUNTER and presents an example run of Rancor-HUNTER for a startup scenario.
The EVA Physiology, Systems and Performance (EPSP) Project is performing tests in different analog environments to understand human performance during Extravehicular Activity (EVA) with the aim of developing more safe and efficient systems for lunar exploration missions and the Constellation Program. The project is characterizing human EVA performance in studies using several test beds, including the underwater NASA Extreme Environment Mission Operations (NEEMO) and Neutral Buoyancy Laboratory (NBL) facilities, JSC fs Partial Gravity Simulator (POGO), and the NASA Reduced Gravity Office (RGO) parabolic flight aircraft. Using these varied testing environments, NASA can gain a more complete understanding of human performance issues related to EVA and the limitations of each testing environment. Tests are focused on identifying and understanding the EVA system factors that affect human performance such as center of gravity (CG), inertial mass, ground reaction forces (GRF), suit weight, and suit pressure. The test results will lead to the development of lunar EVA systems operations concepts and design requirements that optimize human performance and exploration capabilities. METHODS: Tests were conducted in the NBL and during NEEMO missions in the NOAA Aquarius Habitat. A reconfigurable back pack with repositionable mass was used to simulate Perfect, Low, Forward, High, Aft and NASA Baseline CG locations. Subjects performed simulated exploration tasks that included ambulation, kneel and recovery, rock pick-up, and shoveling. Testing using POGO, that simulates partial gravity via pneumatic weight offload system and a similar reconfigurable rig, is underway for a subset of the same tasks. Additionally, test trials are being performed on the RGO parabolic flight aircraft. Subject performance was assessed using a modified Cooper-Harper scale to assess operator compensation required to achieve desired performance. All CG locations are based on the assumption of a standardized 6 ft 180 lb subject. RESULTS: The modified Cooper-Harper Scale assesses desired task performance described as performance in a reduced gravity environment as compared to a 1G environment. Modified Cooper-Harper ratings of . 3 indicate no improvements are needed, ratings of 4-6 indicate improvements are desirable, and ratings . 7 indicate improvements are mandatory. DISCUSSION: Differences were noted in suited CH results based on environment at the same CG and suit pressure. Additionally, results suggest that CG location affects unsuited human performance. Subjects preferred locations near their natural CG over those that are high, aft, or a combination of high and aft. Further testing and analyses are planned to compare these unsuited results to suited performance.
This presentation is part of panel discussion on Evaluating Models of Human Performance. The purpose of this panel is to discuss the increasing use of models in the world today and specifically focus on how to describe and evaluate models of human performance. My presentation will focus on discussions of generating distributions of performance, and the evaluation of different strategies for humans performing tasks with mixed initiative (Human-Automation) systems. I will also discuss issues with how to provide Human Performance modeling data to support decisions on acceptability and tradeoffs in the design of safety critical systems. I will conclude with challenges for the future.
This work intends to generate evidence of acute, incremental human performance decrement similar to that due to space radiation andits impacts on the brain, to accompany ongoing human performance modeling work. The planned work will explore the boundaries of human behavioral and performance decrement after exposure to stress, which may be expected based in part on rodent responses found afterexposure to ionizing radiation. The collection of evidence via simulation studies can characterize real human errors toward determining what stress levels lead to significantly-low levels of performance (below permissible outcome limits) which would imperilmission accomplishment. If mission-relevant animal-study-linked tasks are used, human and animal performance levels may be aligned to enable quantitative assignment of permissible exposure limits based on animal exposure studies. Ultimately, a transfer function between the performances of exposed rodents and humans under stress can be developed using shared impairment mechanisms.
This work intends to generate evidence of acute, incremental human performance decrement similar to that due to space radiation and its impacts on the brain, to accompany ongoing human performance modeling work. The planned work will explore the boundaries of human behavioral and performance decrement after expo-sure to stress, which may be expected based in part on rodent responses found after exposure to ionizing radiation. The collection of evidence via simulation studies can characterize real human errors toward determining what stress levels lead to significantly-low levels of performance (below permissible outcome limits) which would imperil mission accomplishment. If mission-relevant yet animal-study-linked tasks are used, human and animal performance levels may be aligned to enable quantitative assignment of permissible exposure limits based on animal exposure studies. Ultimately, a transfer function between the performances of exposed rodents and humans under stress can be developed using shared impairment mechanisms.
This report identifies key human-performance-related issues associated with Next Generation Air Transportation System (NextGen) research in the NASA NextGen-Airspace Project. Four Research Focus Areas (RFAs) in the NextGen-Airspace Project - namely Separation Assurance (SA), Airspace Super Density Operations (ASDO), Traffic Flow Management (TFM), and Dynamic Airspace Configuration (DAC) - were examined closely. In the course of the research, it was determined that the identified human performance issues needed to be analyzed in the context of NextGen operations rather than through basic human factors research. The main gaps in human factors research in NextGen were found in the need for accurate identification of key human-systems related issues within the context of specific NextGen concepts and better design of the operational requirements for those concepts. By focusing on human-system related issues for individual concepts, key human performance issues for the four RFAs were identified and described in this report. In addition, mixed equipage airspace with components of two RFAs were characterized to illustrate potential human performance issues that arise from the integration of multiple concepts.