Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “human performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Experimental Analysis of the Effects of Simulator Complexity on Human Performance

Human Reliability Analysis predicts accidents caused by human errors and is an important factor in Probabilistic Safety Assessment that comprehensively evaluates the safety of nuclear power plants. This study compares and analyzes the human performance of nuclear power plant operators according to the simulator complexity as part of the HRA data collection support method development project conducted by Idaho National Laboratory. This experiment was conducted by setting two types of simulators and scenarios as independent variables. The data collected by conducting the experiments in two different simulators were analyzed using an analysis of variance test and a correlation analysis, and four human performance charts were derived.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2011

Science-Based Simulation Model of Human Performance for Human Reliability Analysis

Human reliability analysis (HRA), a component of an integrated probabilistic risk assessment (PRA), is the means by which the human contribution to risk is assessed, both qualitatively and quantitatively. However, among the literally dozens of HRA methods that have been developed, most cannot fully model and quantify the types of errors that occurred at Three Mile Island. Furthermore, all of the methods lack a solid empirical basis, relying heavily on expert judgment or empirical results derived in non-reactor domains. Finally, all of the methods are essentially static, and are thus unable to capture the dynamics of an accident in progress. The objective of this work is to begin exploring a dynamic simulation approach to HRA, one whose models have a basis in psychological theories of human performance, and whose quantitative estimates have an empirical basis. This paper highlights a plan to formalize collaboration among the Idaho National Laboratory (INL), the University of Maryland, and The Ohio State University (OSU) to continue development of a simulation model initially formulated at the University of Maryland. Initial work will focus on enhancing the underlying human performance models with the most recent psychological research, and on planning follow-on studies to establish an empirical basis for the model, based on simulator experiments to be carried out at the INL and at the OSU.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

A Feasibility Study on the Integration of Human Performance Data From Diverse Sources Based on the Complexity of a Proceduralized Task

Securing the safety of socio-technical systems including nuclear facilities is the upmost goal to ensure their sustainability because historical records demonstrate that the performance degradation of human operators (e.g., human errors) is one of the crucial contributors to the occurrence of unexpected events resulting in extensive casualties and financial losses. This implies that the collection of human performance data in diverse conditions with which they could be faced during the operation of nuclear facilities. As this collection requires significant resources, it is necessary to resolve how to accomplish it with limited resources. To address this challenge, as suggested in the SHEEP framework, it is indispensable to extract valuable insights after integrating various kinds of human performance data obtained from different sources. However, a practical method to soundly integrate them seems to be still incomplete. Accordingly, the applicability of TACOM (Task Complexity) measure is investigated as a tool to identify useful information based on the integration of human performance data observed from different simulation conditions. As a result, it is expected that the TACOM measure would play an important role in addressing the technical challenge in securing human performance data.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2015

Measuring Human Performance in Simulated Nuclear Power Plant Control Rooms Using Eye Tracking

Control room modernization will be an important part of life extension for the existing light water reactor fleet. As part of modernization efforts, personnel will need to gain a full understanding of how control room technologies affect performance of human operators. Recent advances in technology enables the use of eye tracking technology to continuously measure an operator’s eye movement, which correlates with a variety of human performance constructs such as situation awareness and workload. This report describes eye tracking metrics in the context of how they will be used in nuclear power plant control room simulator studies.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2012

Integrating Human Performance and Technology

Human error is a significant factor in the cause and/or complication of events that occur in the commercial nuclear industry. In recent years, great gains have been made using Human Performance (HU) tools focused on targeting individual behaviors. However, the cost of improving HU is growing and resistance to add yet another HU tool certainly exists, particularly for those tools that increase the paperwork for operations. Improvements in HU that are the result of leveraging existing technology, such as hand-held mobile technologies, have the potential to reduce human error in controlling system configurations, safety tag-outs, and other verifications. Operator rounds, valve line-up verifications, containment closure verifications, safety & equipment protection, and system tagging can be supported by field-deployable wireless technologies. These devices can also support the availability of critical component data in the main control room and other locations. This research pilot project reviewing wireless hand-held technology is part of the Light Water Reactor Sustainability Program (LWRSP), a research and development (R&D) program sponsored by the U. S. Department of Energy (DOE). The project is being performed in close collaboration with industry R&D programs to provide the technical foundations for licensing, and managing the long-term, safe, and economical operation of current nuclear power plants. The LWRSP vision is to develop technologies and other solutions that can improve the reliability, sustain the safety, and extend the life of the current nuclear reactor fleet.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2014

A Framework for Human Performance Criteria for Advanced Reactor Operational Concepts

This report supports the determination of new Operational Concept models needed in support of the operational design of new reactors. The objective of this research is to establish the technical bases for human performance and human performance criteria frameworks, models, and guidance for operational concepts for advanced reactor designs. The report includes a discussion of operating principles for advanced reactors, the human performance issues and requirements for human performance based upon work domain analysis and current regulatory requirements, and a description of general human performance criteria. The major findings and key observations to date are that there is some operating experience that informs operational concepts for baseline designs for SFR and HGTRs, with the Experimental Breeder Reactor-II (EBR-II) as a best-case predecessor design. This report summarizes the theoretical and operational foundations for the development of a framework and model for human performance criteria that will influence the development of future Operational Concepts. The report also highlights issues associated with advanced reactor design and clarifies and codifies the identified aspects of technology and operating scenarios.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2014

The SACADA database for human reliability and human performance

Lack of appropriate and sufficient human performance data has been identified as a key factor affecting human reliability analysis (HRA) quality especially in the estimation of human error probability (HEP). The Scenario Authoring, Characterization, and Debriefing Application (SACADA) database was developed by the U.S. Nuclear Regulatory Commission (NRC) to address this data need. An agreement between NRC and the South Texas Project Nuclear Operating Company (STPNOC) was established to support the SACADA development with aims to make the SACADA tool suitable for implementation in the nuclear power plants' operator training program to collect operator performance information. The collected data would support the STPNOC's operator training program and be shared with the NRC for improving HRA quality. This paper discusses the SACADA data taxonomy, the theoretical foundation, the prospective data to be generated from the SACADA raw data to inform human reliability and human performance, and the considerations on the use of simulator data for HRA. Each SACADA data point consists of two information segments: context and performance results. Context is a characterization of the performance challenges to task success. The performance results are the results of performing the task. The data taxonomy uses a macrocognitive functions model for the framework. At a high level, information is classified according to the macrocognitive functions of detecting the plant abnormality, understanding the abnormality, deciding the response plan, executing the response plan, and team related aspects (i.e., communication, teamwork, and supervision). The data are expected to be useful for analyzing the relations between context, error modes and error causes in human performance.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2015

Human Performance Modeling for Dynamic Human Reliability Analysis

Part of the U.S. Department of Energy’s (DOE’s) Light Water Reac- tor Sustainability (LWRS) Program, the Risk-Informed Safety Margin Charac- terization (RISMC) Pathway develops approaches to estimating and managing safety margins. RISMC simulations pair deterministic plant physics models with probabilistic risk models. As human interactions are an essential element of plant risk, it is necessary to integrate human actions into the RISMC risk framework. In this paper, we review simulation based and non simulation based human reliability analysis (HRA) methods. This paper summarizes the founda- tional information needed to develop a feasible approach to modeling human in- teractions in RISMC simulations.

human reliability analysis↗
DOE OSTI2017

Human Performance Measures for the Evaluation of Nuclear Power Plant Control Room Interfaces: A Systematic Review - 265

The purpose of this study was to review the literature related to measuring human performance in the design and evaluation of the human-system interface (HSI) of nuclear power plant (NPP) control rooms and synthesize lessons learned and future directions for research and practice in this field. The design and evaluation of digital or hybrid HSI requires comprehensive measurement of human performance to ensure quality and safety of the nuclear power process control. Human factors evaluation frameworks have been proposed to guide the measurement of human performance constructs. However, there are few guides for selecting appropriate measures for those constructs. A systematic review of empirical research literature was conducted. Studies were identified through academic publication databases and grey literature searches. Eligible studies were coded and information regarding human performance measures was extracted and analyzed. A total of 80 studies met the criteria. Human performance measures extracted from the reviewed studies included measures of: behavioral performance; workload; situation awareness; human-human or human-machine cooperation; other cognitive performance indicators; and system performance. Behavioral performance (speed and accuracy), workload, and situation awareness were the most frequently measured constructs with validated and domain-specific instruments. The results of the literature review provided an overview of the human performance constructs and their corresponding measures for NPP control room HSI evaluation. These results can be used as an initial guide to establish appropriate and comprehensive measurements of human performance for such evaluations. Future directions in measure development are also discussed. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2015

Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method

Our article documents an exploratory study for collecting and using human performance data to inform human error probability (HEP) estimates for a new human reliability analysis (HRA) method, the IntegrateD Human Event Analysis System (IDHEAS). The method was based on cognitive models and mechanisms underlying human behaviour and employs a framework of 14 crew failure modes (CFMs) to represent human failures typical for human performance in nuclear power plant (NPP) internal, at-power events [1]. A decision tree (DT) was constructed for each CFM to assess the probability of the CFM occurring in different contexts. Data needs for IDHEAS quantification are discussed. Then, the data collection framework and process is described and how the collected data were used to inform HEP estimation is illustrated with two examples. Next, five major technical challenges are identified for leveraging human performance data for IDHEAS quantification. Furthermore, these challenges reflect the data needs specific to IDHEAS. More importantly, they also represent the general issues with current human performance data and can provide insight for a path forward to support HRA data collection, use, and exchange for HRA method development, implementation, and validation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2012

Mentoring Human Performance - 12480

Although the positive effects of implementing a human performance approach to operations can be hard to quantify, many organizations and industry areas are finding tangible benefits to such a program. Recently, a unique mentoring program was established and implemented focusing on improving the performance of managers, supervisors, and work crews, using the principles of Human Performance Improvement (HPI). The goal of this mentoring was to affect behaviors and habits that reliably implement the principles of HPI to ensure continuous improvement in implementation of an Integrated Safety Management System (ISMS) within a Conduct of Operations framework. Mentors engaged with personnel in a one-on-one, or one-on-many dialogue, which focused on what behaviors were observed, what factors underlie the behaviors, and what changes in behavior could prevent errors or events, and improve performance. A senior management sponsor was essential to gain broad management support. A clear charter and management plan describing the goals, objectives, methodology, and expected outcomes was established. Mentors were carefully selected with senior management endorsement. Mentors were assigned to projects and work teams based on the following three criteria: 1) knowledge of the work scope; 2) experience in similar project areas; and 3) perceived level of trust they would have with project management, supervision, and work teams. This program was restructured significantly when the American Reinvestment and Recovery Act (ARRA) and the associated funding came to an end. The program was restructured based on an understanding of the observations, attributed successes and identified shortfalls, and the consolidation of those lessons. Mentoring the application of proven methods for improving human performance was shown effective at increasing success in day-to-day activities and increasing confidence and level of skill of supervisors. While mentoring program effectiveness is difficult to measure, and return on investment is difficult to quantify, especially in complex and large organizations where the ability to directly correlate causal factors can be challenging, the evidence presented by Sydney Dekker, James Reason, and others who study the field of human factors does assert managing and reducing error is possible. Employment of key behaviors-HPI techniques and skills-can be shown to have a significant impact on error rates. Our mentoring program demonstrated reduced error rates and corresponding improvements in safety and production. Improved behaviors are the result, of providing a culture with consistent, clear expectations from leadership, and processes and methods applied consistently to error prevention. Mentoring, as envisioned and executed in this program, was effective in helping shift organizational culture and effectively improving safety and production. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Rancor-HUNTER: Using a Simulator Engine for Realistic Human Performance Modeling of Nuclear Power Operations

The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) is a software system to simulate human performance in support of human reliability analysis (HRA) in nuclear power plants. This paper summarizes recent work to integrate HUNTER with a plant simulator, namely the Rancor Microworld Simulator. Rancor is an offshoot of earlier work at Idaho National Laboratory (INL) to support plant modernization. The graphical software tools used to mimic digital human-system interface upgrades at INL’s Human Systems Simulation Laboratory were linked to the Rancor Microworld Simulator, an INL-developed simplified plant model. HUNTER becomes a “virtual operator” coupled to the Rancor simulator, thereby allowing a tight coupling between a digital human twin and a digital twin of the plant. Rancor-HUNTER may be run through Monte Carlo iterations across a dynamic range of performance shaping factors, thereby producing distributions of human performance in terms of procedure paths, errors instantiations, and task durations. This paper overviews the various unique features of Rancor-HUNTER and presents an example run of Rancor-HUNTER for a startup scenario.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Analysis of human performance differences between students and operators when using the Rancor Microworld simulator

Here, from within the umbrella of the Simplified Human Error Experimental Program (SHEEP) framework, this paper analyzes human performance differences between professional and student operators when using a simplified simulator (i.e., Rancor Microworld). This paper represents a crucial step in understanding the fidelity of the simplified simulators and student operators within the SHEEP study. This paper explores a randomized factorial experimental design that features two independent variables: participant type and event class. Six human performance measurements are considered in the experiment. The experiment is conducted using 20 professional reactor operators employed at actual nuclear power plants (NPPs), along with 20 trained students. The experimental data are analyzed via statistical analysis methods. Finally, this paper examines the differences in human performance between actual operators and students when using Rancor Microworld.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2015

Measuring Human Performance within Computer Security Incident Response Teams

Human performance has become a pertinent issue within cyber security. However, this research has been stymied by the limited availability of expert cyber security professionals. This is partly attributable to the ongoing workload faced by cyber security professionals, which is compound ed by the limited number of qualified personnel and turnover of personnel across organizations. Additionally, it is difficult to conduct research, and particularly, openly published research, due to the sensitivity inherent to cyber ope rations at most organizations. As an alternative, the current research has focused on data collection during cyber security training exercises. These events draw individuals with a range of knowledge and experience extending from seasoned professionals to recent college graduates to college students. The current paper describes research involving data collection at two separate cyber security exercises. This data collection involved multiple measures which included behavioral performance based on human - machine transactions and questionnaire - based assessments of cyber security experience.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Human performance benefits gained by dynamic instructions compared to smart PDFs

Human performance benefits gained by dynamic instructions compared to smart PDFs In recent years multiple nuclear utilities have deployed an electronic work management solution to replace the traditional paper-based processes. There are many benefits of electronic work management solutions compared to paper processes, such as a more streamlined review and approval process of work packages and a better way to track and resolve any potential bottlenecks causing delays in the review process. These benefits have been recognized where electronic work management solutions have been successfully deployed. However the utilities also hoped the new solution would help the field worker conduct his/her job more efficiently, correctly, and safely. Unfortunately, the industry is now realizing that the deployed solutions did not fully help them reach that goal. The electronic work management solutions present the work instructions as an electronic copy (i.e., a portable document format (PDF)) of the paper instruction. The PDF versions used in these electronic work management solutions have some ability for data input, notes, and mark-ups, but are unable to provide many additional benefits compared to using paper. In fact, conducting work using a PDF on a tablet can be more cumbersome than with a paper instruction. For example, flipping back and forth in a paper instruction can be time consuming, but it is not at all as frustrating as scrolling back and forth on a tablet or continuously having to navigate between tabs. The researchers at Idaho National Laboratory (INL) approached the next step beyond smart PDFs from a human factors perspective. In close collaboration with multiple utilities they investigated how to present instruction content and how to design the interaction with the instruction to improve the workers performance and efficiency. Their solution is a dynamic presentation of the instruction that guides the worker through the correct path as well as ensuring the worker is on the correct component. The solution also automatically validates input and provides guidance if unexpected conditions are identified. A well-designed solution has the opportunity to vastly reduce the risk of human errors in the field, such as preventing actions on incorrect component or unintentionally skipping steps. The human factors researchers at INL leveraged their expertise, existing human performance tools, and a great amount of involvement from field workers in multiple utilities to develop and evaluate design concepts that will provide the human performance and efficiency benefits that the electronic work management solutions fall short to deliver. This paper will describe in detail how these new design concepts improve human performance.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Human Performance Analysis Depending on Operator Expertise (Student vs. Operator) and Simulator Complexity (Rancor Microworld vs. Compact Nuclear Simulator)

Human reliability analysis (HRA) evaluates human errors and provides human error probabilities (HEPs) for application in probabilistic safety assessment (PSA), which is a comprehensive safety assessment method for nuclear power plants (NPPs). Generally, HRA methods estimate HEPs based on human reliability data collected from actual historical measurement, simulator experiments, or expert judgement. Most recent HRA data collection studies focus on collecting data via full-scope main control room (MCR) simulators with actual licensed reactor operators. Contrary to this, Idaho National Laboratory (INL) has adopted a different approach, which attempts to collect HRA data based on experiment using simplified simulators and student participants by following the Simplified Human Error Experimental Program (SHEEP). This approach has a couple of advantages compared to full-scope data collection. Representatively, it has relatively low entry point for collecting HRA data, and secures large sample sizes with reasonable cost and labor. In the previous studies, we developed the SHEEP framework, then verified whether the data collected through the framework could support a representative full-scope data collection study, i.e., the Human Reliability Data Extraction (HuREX) study. Also, we analyzed human performance measurements depending on participant type (i.e., student vs. operator). In this paper, we analyze human performance data collected from an experiment comparing operator expertise and simulator complexity when using the more simplified simulator developed by INL, i.e., Rancor Microworld and the less simplified simulator, i.e., Compact Nuclear Simulator (CNS) developed by Korea Atomic Energy Research Institute (KAERI). Analysis of variance (ANOVA) tests and correlation analysis are used for analyzing the experimental data.

99 GENERAL AND MISCELLANEOUS↗