Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “HRA”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Assessment of HRA method predictions against operating crew performance: Part II: Overall simulator data, HRA method predictions, and intra-method comparisons

This is the third in a series of four papers documenting two large-scale human reliability analysis (HRA) empirical studies – the International HRA Empirical Study and the US HRA Empirical Study. Here, the goal of the two studies was to develop an empirically-based understanding of the performance, strengths, and weaknesses of HRA methods by comparing HRA method predictions against actual operator performance in simulated accident scenarios on nuclear power plant (NPP) simulators. However, since in most cases only a single HRA team applied a given method in the International study, it was often difficult to separate analyst effects from variability in results related to the methods themselves. Since at least two HRA teams used each of the HRA methods in the US Study, intra-method comparisons were performed to identify method strengths and weaknesses independent of analyst specific effects where possible. This paper first summarizes the intra-method comparison results from the U.S. Study. Then, it discusses the reasons for the observed HRA predictive differences and the underlying methodological and guidance limitations that permitted the differences to arise. In the fourth paper, this information is combined wit h the results of the comparisons of method predictions to the actual crew data, from both the International and U.S. Studies, to develop the final conclusions about overall strengths and weaknesses of HRA methods.

97 MATHEMATICS AND COMPUTING↗

A Bayesian method for using simulator data to enhance human error probabilities assigned by existing HRA methods

In the past several years, several international organizations have begun to collect data on human performance in nuclear power plant simulators. The data collected provide a valuable opportunity to improve human reliability analysis (HRA), but these improvements will not be realized without implementation of Bayesian methods. Bayesian methods are widely used to incorporate sparse data into models in many parts of probabilistic risk assessment (PRA), but Bayesian methods have not been adopted by the HRA community. In this paper, we provide a Bayesian methodology to formally use simulator data to refine the human error probabilities (HEPs) assigned by existing HRA methods. We demonstrate the methodology with a case study, wherein we use simulator data from the Halden Reactor Project to update the probability assignments from the SPAR-H method. The case study demonstrates the ability to use performance data, even sparse data, to improve existing HRA methods. Furthermore, this paper also serves as a demonstration of the value of Bayesian methods to improve the technical basis of HRA.

99 GENERAL AND MISCELLANEOUS↗

Assessment of HRA method predictions against operating crew performance: Part III: Conclusions and achievements

This is the last in a series of three papers documenting two large-scale human reliability analysis (HRA) empirical studies – the International HRA Empirical Study and the US HRA Empirical Study. The goal of the two studies was to develop an empirically-based understanding of the performance, strengths, and weaknesses of HRA methods by comparing HRA method predictions against actual operator performance in simulated accident scenarios on nuclear power plant (NPP) simulators. This paper first addresses areas where there is convergence between the two studies and where differences lie. Then it summarizes the combined insights and conclusions, including key findings on HRA in general through lessons learned about the HRA methods assessed in the studies and specific recommendations for improving guidance, practice and methods. Then it discusses the relevance and usefulness of simulator data for HRA in general. Finally, it presents the key achievements and overall conclusions of the two studies taken together.

97 MATHEMATICS AND COMPUTING↗

Assessment of HRA method predictions against operating crew performance: Part I: Study background, design and methodology

This is the first in a series of four papers document ing two large -scale human reliability analysis (HRA) empirical studies – the International HRA Empirical Study and the US HRA Empirical Study. The two studies are the first major efforts in recent years to benchmark HRA methods by comparing HRA method predictions against actual operator performance in accident scenarios simulated on nuclear power plant (NPP) simulators. When a met hod was applied by different analyst teams, the predictions of the different teams were also compared against each other. The purpose of the comparisons was to obtain insights concerning the strengths and weaknesses of the HRA methods addressed in the studies as well as the factors contributing to inter-analyst (or intra-method) variability. The background and motivation for the studies is first presented in the article. Then, the overall study design is described with a discussion on high-level tasks and participants. Next, the methodology to achieve the high-level tasks is discussed. Finally, concluding remarks are made concerning lessons learned on benchmarking HRA methods with crew performance of scenarios on NPP simulators.

97 MATHEMATICS AND COMPUTING↗

Back to Basics: First Principles of HRA

Human Reliability Analysis (HRA) continues to suffer from a myriad of technical gaps in its foundations. Core issues have been widely discussed but remain largely unaddressed, although the path taken to this point was paved with good intentions. Now, while this characterization may seem dramatic it is not intended to throw doubt onto HRA as a discipline or to diminish the value it has on increasing safety and resilience in nuclear power. Rather, it is intended to communicate that HRA has some serious challenges and is desperately in need of a critical evaluation. To quote Dougherty [1], “the misrepresentations that will undoubtedly arise may serve to provoke the necessary creativity.” What bears noting is that in the last thirty years since Alan Swain declared that “no adequate HRA had ever been done,” there has been little effort to correct the issues he highlighted. Human factors practice is still poorly implemented, many complex systems are fundamentally incompatible with reliable human performance, and there remains poor foundational support for many of the assumptions within HRA. We propose three categories of issues in HRA, philosophical, theoretical, and empirical and potential solutions to these issues.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

MODIFICATION OF THE SPAR-H METHOD TO SUPPORT HRA FOR LEVEL 2 PSA

Currently, available Human Reliability Analysis (HRA) methods were generally developed to support Level 1 Probabilistic Safety Analysis (PSA) models. There has been an increased emphasis placed on Level 2 PSA in recent years; however, the currently used HRA methods are not ideal for this application, including the SPAR-H method. Challenges that will likely be present during a severe accident such as degraded or hazardous operating conditions, shift in control from the main control room to the technical support center, unavailability of instrumentation, and others are not routinely considered for Level 1 HRA analysis. These factors combine to create a much more uncertain condition to be accounted for in the HRA analysis. While the SPAR-H shaping factors were established to support Level 1 HRA, previous studies have shown it may be used for Level 2 HRA analysis as well. The Canadian Nuclear Safety Commission (CNSC) and Idaho National Laboratory (INL) in a joint project are investigating modifications to the SPAR-H method to create more consistency in applying the performance shaping factors used in the method for Level 2 analysis.

99 GENERAL AND MISCELLANEOUS↗

Haven't a Cue? Mapping the CUE Space as an Aid to HRA Modeling

Advances in automation present a new modeling environment for the human reliability analysis (HRA) practitioner. Many, if not most, current day HRA methods have their origin in characterizing and quantifying human performance in analog environments where mode awareness and system status indications are potentially less comprehensive, but simpler to comprehend at a glance when compared to advanced presentation systems. The introduction of highly complex automation has the potential to lead to: decreased levels of situation awareness caused by the need for increased monitoring; confusion regarding the often non-obvious causes of automation failures, and emergent system dependencies that formerly may have been uncharacterized. Understanding the relation of incoming cues available to operators during plant upset conditions, in conjunction with operating procedures, yields insight into understanding the nature of the expected operator response in this control room environment. Static systems methods such as fault trees do not contain the appropriate temporal information or necessarily specify the relationship among cues leading to operator response. In this paper, we do not attempt to replace standard performance shaping factors commonly used in HRA nor offer a new HRA method, existing methods may suffice. In this paper we strive to enhance current understanding of the basis for operator response through a technique that can be used during the qualitative portion of the HRA analysis process. The CUE map is a means to visualize the relationship among salient cues in the control room that help influence operator response, show how the cognitive map of the operator changes as information is gained or lost, and is applicable to existing as well as advanced hybrid plants and small modular reactor designs. A brief application involving loss of condensate is presented and advantages and limitations of the modeling approach and use of the CUE map are discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method

Our article documents an exploratory study for collecting and using human performance data to inform human error probability (HEP) estimates for a new human reliability analysis (HRA) method, the IntegrateD Human Event Analysis System (IDHEAS). The method was based on cognitive models and mechanisms underlying human behaviour and employs a framework of 14 crew failure modes (CFMs) to represent human failures typical for human performance in nuclear power plant (NPP) internal, at-power events [1]. A decision tree (DT) was constructed for each CFM to assess the probability of the CFM occurring in different contexts. Data needs for IDHEAS quantification are discussed. Then, the data collection framework and process is described and how the collected data were used to inform HEP estimation is illustrated with two examples. Next, five major technical challenges are identified for leveraging human performance data for IDHEAS quantification. Furthermore, these challenges reflect the data needs specific to IDHEAS. More importantly, they also represent the general issues with current human performance data and can provide insight for a path forward to support HRA data collection, use, and exchange for HRA method development, implementation, and validation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

EVALUATION OF HRA METHODOLOGIES FOR APPLICATION IN SDP WORK

This study critically evaluates human reliability analysis (HRA) methodologies applicable to regulatory probabilistic safety assessment (PSA) model, with a particular focus on their role in supporting the significance determination process (SDP) in nuclear safety assessment. Firstly, three widely utilized HRA methods – IDHEAS-ECA, SPAR-H, and ASEP/THERP – were qualitatively and quantitatively assessed. Qualitative assessments were conducted using attributes from the NEA/CSNI/R(2015)1 report, while quantitative evaluations employed regression and correlation analyses to compare predicted human error probabilities (HEPs) against empirical data. Results reveal distinct strengths, for example, IDHEAS-ECA’s robust predictive accuracy and K-HRA’s alignment with operational practices. In addition, dependency analysis and recovery analysis were critically evaluated. For dependency analysis, the methods’ handling of inter-task dependencies and their impact on HEPs were examined, while recovery analysis highlighted strategies for mitigating failure events. Furthermore, strategies were proposed to evaluate performance-shaping factors under conditions of reduced human performance, such as stress, fatigue, or cognitive overload, addressing specific challenges faced in SDP evaluations. Human errors from KINS’s operational performance information system event reports were evaluated as a case study. This study identifies gaps and provides actionable insights to ensure their validity and applicability in SDP HRA applications. This paper is a part of research conducted by KINS, and it should be noted that this result does not represent the regulatory position of KINS.

99 - GENERAL AND MISCELLANEOUS↗

Bridging Human Reliability Analysis and Psychology, Part 2: A Cognitive Framework to Support HRA

This is the second of two papers that discuss the literature review conducted as part of the U.S. Nuclear Regulatory Commission (NRC) effort to develop a hybrid human reliability analysis (HRA) method in response to Staff Requirements Memorandum (SRM) SRM-M061020. This review was conducted with the goal of strengthening the technical basis within psychology, cognitive science and human factors for the hybrid HRA method being proposed. An overview of the literature review approach and high-level structure is provided in the first paper, whereas this paper presents the results of the review. The psychological literature review encompassed research spanning the entirety of human cognition and performance, and consequently produced an extensive list of psychological processes, mechanisms, and factors that contribute to human performance. To make sense of this large amount of information, the results of the literature review were organized into a cognitive framework that identifies causes of failure of macrocognition in humans, and connects those proximate causes to psychological mechanisms and performance influencing factors (PIFs) that can lead to the failure. This cognitive framework can serve as a tool to inform HRA. Beyond this, however, the cognitive framework has the potential to also support addressing human performance issues identified in Human Factors applications.

99 GENERAL AND MISCELLANEOUS↗

P-203: Human Reliability Analysis (HRA) Training Course

Lesson 1 Objectives Review risk and reliability concepts and show how they relate to human error Review significant nuclear incidents and underlying human error Review standard terminology in HRA review brief history of HRA and different HRA methods

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

A Multi-Methods Approach to HRA and Human Performance Modeling: A Field Assessment

The Advanced Test Reactor (ATR) is a research reactor at the Idaho National Laboratory is primarily designed and used to test materials to be used in other, larger-scale and prototype reactors. The reactor offers various specialized systems and allows certain experiments to be run at their own temperature and pressure. The ATR Canal temporarily stores completed experiments and used fuel. It also has facilities to conduct underwater operations such as experiment examination or removal. In reviewing the ATR safety basis, a number of concerns were identified involving the ATR canal. A brief study identified ergonomic issues involving the manual handling of fuel elements in the canal that may increase the probability of human error and possible unwanted acute physical outcomes to the operator. In response to this concern, that refined the previous HRA scoping analysis by determining the probability of the inadvertent exposure of a fuel element to the air during fuel movement and inspection was conducted. The HRA analysis employed the SPAR-H method and was supplemented by information gained from a detailed analysis of the fuel inspection and transfer tasks. This latter analysis included ergonomics, work cycles, task duration, and workload imposed by tool and workplace characteristics, personal protective clothing, and operational practices that have the potential to increase physical and mental workload. Part of this analysis consisted of NASA-TLX analyses, combined with operational sequence analysis, computational human performance analysis (CHPA), and 3D graphical modeling to determine task failures and precursors to such failures that have safety implications. Experience in applying multiple analysis techniques in support of HRA methods is discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

AmeriFlux FLUXNET-1F US-HRA Humnoke Farm Rice Field – Field A

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-HRA Humnoke Farm Rice Field – Field A. This is the FLUXNET version of the carbon flux data for the site US-HRA Humnoke Farm Rice Field – Field A produced by applying the standard ONEFlux (1F) software. Site Description - Zero grade rice field (25 ha) under continuous rice operation for > 10 years

Runkle, Benjamin R. K. [University of Arkansas]↗

Dynamic HRA for FLEX

In the presentation, previous efforts for FLEX dynamic HRA, PRIMERA-HRA method and its application to an ELAP scenario are introduced.

99 GENERAL AND MISCELLANEOUS↗

Bayesian And Human Reliability Analysis (hra)-aided Method For The Reliability Analysis Of Software (bahamas)

The purpose of the BAHAMAS code is to provide a simplified process for performing quantitative evaluations of software reliability. The Bayesian and Human Reliability Analysis (HRA)-Aided method for the Reliability Analysis of software (BAHAMAS) was developed specifically to perform quantification under limited data conditions, i.e., when limited testing or operational data are available, such as during early development stages. BAHAMAS essentially examines the quality of a software development life cycle to determine the probability of specific types of software failure. BAHAMAS will have modules to support user input for detailed and simplified analyses. The user interface will also support software common cause failure analysis.

Wang, Congjian (0000000207789927)↗