Managing Human Performance in the BRM Workforce - Student Guide.
Abstract not provided.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
Abstract not provided.
The worldwide demand for Small Modular Reactors (SMRs) has surged in recent years due to their enhanced safety and versatility in supporting diverse industrial sectors. A unique feature of SMR operation is that a single human operator is responsible for managing multiple modules. Therefore, securing a sufficient amount of human performance data pertaining to this new environment is essential for the safe operation of SMRs. In this explanatory study, a series of experiments were conducted using the NuScale simulator, a representative SMR design, with student operators. A total of 12 student operators were assigned two types of off-normal events and asked to cope with them using paper-based procedures. Subsequently, their task performance times were compared with those of student operators responsible for a single unit based on the Task Complexity (TACOM) measure. Results indicate that the performance of student operators under the experimental conditions of this study degraded by a factor of 2 to 3, depending on the characteristics of the off-normal events.
The Human System Simulation Laboratory (HSSL) at the Idaho National Laboratory is one of few facilities of its kind that allows human factors researchers to evaluate various aspects of human performance and human system interaction for proposed reactor designs and upgrades. A basic system architecture, physical configuration and simulation capability were established to enable human factors researchers to support multiple, simultaneous simulations and also different power plant technologies. Although still evolving in terms of its technical and functional architecture, the HSSL is already proving its worth in supporting current and future nuclear industry needs for light water reactor sustainability and small modular reactors. The evolution of the HSSL is focused on continual physical and functional refinement to make it a fully equipped, reconfigurable facility where advanced research, testing and validation studies can be conducted on a wider range of reactor technologies. This requires the implementation of additional plant models to produce empirical research data on human performance with emerging human-system interaction technologies. Additional beneficiaries of this information include system designers and HRA practitioners. To ensure that results of control room crew studies will be generalizable to the existing and evolving fleet of US reactors, future expansion of the HSSL may also include other SMR plant models, plant-specific simulators and a generic plant model aligned to the current generation of pressurized water reactors (PWRs) and future advanced reactor designs. Collaboration with industry partners is also proving to be a vital component of the facility as this helps to establish a formal basis for current and future human performance experiments to support nuclear industry objectives. A long-range Program Plan has been developed for the HSSL to ensure that the facility will support not only the Department of Energy’s Light Water Reactor Sustainability Program, but also to provide human factors guidance for all future developments of the nuclear industry.
Model observer performance, computed theoretically using cascaded systems analysis (CSA), was compared to the performance of human observers in detection and discrimination tasks. Dual-energy (DE) imaging provided a wide range of acquisition and decomposition parameters for which observer performance could be predicted and measured. This work combined previously derived observer models (e.g., Fisher-Hotelling and non-prewhitening) with CSA modeling of the DE image noise-equivalent quanta (NEQ) and imaging task (e.g., sphere detection, shape discrimination, and texture discrimination) to yield theoretical predictions of detectability index (d{sup '}) and area under the receiver operating characteristic (A{sub Z}). Theoretical predictions were compared to human observer performance assessed using 9-alternative forced-choice tests to yield measurement of A{sub Z} as a function of DE image acquisition parameters (viz., allocation of dose between the low- and high-energy images) and decomposition technique [viz., three DE image decomposition algorithms: standard log subtraction (SLS), simple-smoothing of the high-energy image (SSH), and anti-correlated noise reduction (ACNR)]. Results showed good agreement between theory and measurements over a broad range of imaging conditions. The incorporation of an eye filter and internal noise in the observer models demonstrated improved correspondence with human observer performance. Optimal acquisition and decomposition parameters were shown to depend on the imaging task; for example, ACNR and SSH yielded the greatest performance in the detection of soft-tissue and bony lesions, respectively. This study provides encouraging evidence that Fourier-based modeling of NEQ computed via CSA and imaging task provides a good approximation to human observer performance for simple imaging tasks, helping to bridge the gap between Fourier metrics of detector performance (e.g., NEQ) and human observer performance.
Abstract not provided.
Abstract not provided.
Purpose: With the recently expanding interest and developments in x-ray differential phase contrast CT (DPC-CT), the evaluation of its task-specific detection performance and comparison with the corresponding absorption CT under a given radiation dose constraint become increasingly important. Mathematical model observers are often used to quantify the performance of imaging systems, but their correlations with actual human observers need to be confirmed for each new imaging method. This work is an investigation of the effects of stochastic DPC-CT noise on the correlation of detection performance between model and human observers with signal-known-exactly (SKE) detection tasks.Methods: The detectabilities of different objects (five disks with different diameters and two breast lesion masses) embedded in an experimental DPC-CT noise background were assessed using both model and human observers. The detectability of the disk and lesion signals was then measured using five types of model observers including the prewhitening ideal observer, the nonprewhitening (NPW) observer, the nonprewhitening observer with eye filter and internal noise (NPWEi), the prewhitening observer with eye filter and internal noise (PWEi), and the channelized Hotelling observer (CHO). The same objects were also evaluated by four human observers using the two-alternative forced choice method. The results from the model observer experiment were quantitatively compared to the human observer results to assess the correlation between the two techniques.Results: The contrast-to-detail (CD) curve generated by the human observers for the disk-detection experiments shows that the required contrast to detect a disk is inversely proportional to the square root of the disk size. Based on the CD curves, the ideal and NPW observers tend to systematically overestimate the performance of the human observers. The NPWEi and PWEi observers did not predict human performance well either, as the slopes of their CD curves tended to be steeper. The CHO generated the best quantitative agreement with human observers with its CD curve overlapping with that of human observer. Statistical equivalence between CHO and humans can be claimed within 11% of the human observer results, including both the disk and lesion detection experiments.Conclusions: The model observer method can be used to accurately represent human observer performance with the stochastic DPC-CT noise for SKE tasks with sizes ranging from 8 to 128 pixels. The incorporation of the anatomical noise remains to be studied.
Lack of appropriate human performance data for the development of human reliability analysis (HRA) methods has been identified as a key issue contributing to the method-to-method variability among the HRA methods. The United States Nuclear Regulatory Commission (NRC) worked with domain experts to develop the Scenario Authoring, Characterization, and Debriefing Application (SACADA) system to collect nuclear power plants' licensed operator simulator training and examination data to inform HRA. In the past two decades, significant improvements in understanding and modelling human performance in HRA have affected the perspectives of the types of data to be collected for HRA. A significant change is that human performance is strongly dependent on the context of the tasks to be performed. To incorporate this understanding, the SACADA data taxonomy collects the context and actual performance information of the training objective elements (TOEs) in nuclear plant operator simulator training. This provides a framework consistent with HRA to use context to estimate human error probabilities. It is recognized that measuring crew performance is equally important as improving operator training. SACADA is designed to support the nuclear trainers in capturing this important information that is used to identify training weaknesses and drive continuous improvement. This paper discusses the SACADA taxonomy, the SACADA system's functions, and the supporting software design to enable the SACADA system to be practically implemented in the nuclear power plants' operator simulator training program to collect data for tracking operator performance and HRA analysis. (authors)
Purpose: The purpose of this study was to investigate the correlation between model observer and human observer performance in CT imaging for the task of lesion detection and localization when the lesion location is uncertain.Methods: Two cylindrical rods (3-mm and 5-mm diameters) were placed in a 35 × 26 cm torso-shaped water phantom to simulate lesions with −15 HU contrast at 120 kV. The phantom was scanned 100 times on a 128-slice CT scanner at each of four dose levels (CTDIvol = 5.7, 11.4, 17.1, and 22.8 mGy). Regions of interest (ROIs) around each lesion were extracted to generate images with signal-present, with each ROI containing 128 × 128 pixels. Corresponding ROIs of signal-absent images were generated from images without lesion mimicking rods. The location of the lesion (rod) in each ROI was randomly distributed by moving the ROIs around each lesion. Human observer studies were performed by having three trained observers identify the presence or absence of lesions, indicating the lesion location in each image and scoring confidence for the detection task on a 6-point scale. The same image data were analyzed using a channelized Hotelling model observer (CHO) with Gabor channels. Internal noise was added to the decision variables for the model observer study. Area under the curve (AUC) of ROC and localization ROC (LROC) curves were calculated using a nonparametric approach. The Spearman's rank order correlation between the average performance of the human observers and the model observer performance was calculated for the AUC of both ROC and LROC curves for both the 3- and 5-mm diameter lesions.Results: In both ROC and LROC analyses, AUC values for the model observer agreed well with the average values across the three human observers. The Spearman's rank order correlation values for both ROC and LROC analyses for both the 3- and 5-mm diameter lesions were all 1.0, indicating perfect rank ordering agreement of the figures of merit (AUC) between the average performance of the human observers and the model observer performance.Conclusions: In CT imaging of different sizes of low-contrast lesions (−15 HU), the performance of CHO with Gabor channels was highly correlated with human observer performance for the detection and localization tasks with uncertain lesion location in CT imaging at four clinically relevant dose levels. This suggests the ability of Gabor CHO model observers to meaningfully assess CT image quality for the purpose of optimizing scan protocols and radiation dose levels in detection and localization tasks for low-contrast lesions.
Human performance and human decision making is counted upon as a crucial aspect of overall system resilience. Advanced control systems have the potential to provide operators and asset owners a wide range of data, deployed at different levels that can be used to support operator situation awareness. However, the sheer amount of data available can make it challenging for operators to assimilate information and respond appropriately. This paper reviews some of the challenges and issues associated with providing operators with actionable state awareness and argues for the over arching importance of integrating human factors as part of intelligent control systems design and implementation. It is argued that system resilience is improved by implementing human factors in operations and maintenance. This paper also introduces issues associated with resilience and data fusion and highlights areas in which human factors including field studies hold promise.
Part of the U.S. Department of Energy’s Light Water Reactor Sustainability (LWRS) Program, the Risk-Informed Safety Margin Characterization (RISMC) Pathway develops approaches to estimating and managing safety margins. RISMC simulations pair deterministic plant physics models with probabilistic risk models. As human interactions are an essential element of plant risk, it is necessary to integrate human actions into the RISMC risk model. In this report, we review simulation-based and non-simulation-based human reliability assessment (HRA) methods. Chapter 2 surveys non-simulation-based HRA methods. Conventional HRA methods target static Probabilistic Risk Assessments for Level 1 events. These methods would require significant modification for use in dynamic simulation of Level 2 and Level 3 events. Chapter 3 is a review of human performance models. A variety of methods and models simulate dynamic human performance; however, most of these human performance models were developed outside the risk domain and have not been used for HRA. The exception is the ADS-IDAC model, which can be thought of as a virtual operator program. This model is resource-intensive but provides a detailed model of every operator action in a given scenario, along with models of numerous factors that can influence operator performance. Finally, Chapter 4 reviews the treatment of timing of operator actions in HRA methods. This chapter is an example of one of the critical gaps between existing HRA methods and the needs of dynamic HRA. This report summarizes the foundational information needed to develop a feasible approach to modeling human interactions in the RISMC simulations.