Results for “Expert Judgment” — Page 2

DOE OSTI2024

An Approach to Dynamic Human Reliability Analysis and Its Data Collection Framework

Human reliability analysis (HRA) is a method for evaluating human errors in a variety of complex systems such as nuclear power plants, military systems, aircraft, and chemical plants. Most HRA methods currently used by regulatory institutes or utilities are called static HRA and are carried out by simple worksheets or simple calculators. To date, there are many unsolved or intrinsic challenges in static HRA. For example, existing static HRA does not realistically model and evaluate human actions as they would be performed at actual systems. There is no method with HRA to objectively estimate the time required for human actions despite being essential to HRA processes. In addition, many HRA methods still rely on a dataset generated prior to the 1980s, from unrelated industry experience or simply from expert judgment. Accordingly, this study attempted to research how to overcome the challenges of existing HRA via dynamic risk assessment (a.k.a., simulation-based or computation-based risk assessment) techniques. First, this study developed a dynamic HRA method, named as PRocedure-based Investigation Method of EMRALD Risk Assessment – HRA (PRIMERA-HRA). The PRIMERA-HRA mainly concentrates on providing HRA analysts with specific guidelines on how to reasonably model human actions, assign human reliability data and evaluate output of simulation within a dynamic probabilistic risk assessment tool, called as Event Modeling Risk Assessment using Linked Diagrams (EMRALD). Second, this study also developed a module for performance shaping factors (i.e., the key concept in HRA quantification) applicable to dynamic HRA, then implemented it based on PRIMERA-HRA within the EMRALD tool. Third, this study developed an HRA data collection framework to support dynamic HRA, called as Simplified Human Error Experimental Program (SHEEP). Originally, the SHEEP study aimed to support static HRA and its data collection, but recently extended the scope to the new technologies such as dynamic HRA or HRA for advanced reactors. SHEEP focuses on the use of data collected from simplified simulators to complement—but not replace—data collection studies using full-scope simulators and actual operators. To date, many experiments were conducted under the SHEEP framework. Multiple analyses, such as human performance analysis, human error analysis, task complexity analysis, learning effect analysis and time distribution analysis, were also carried out using the collected data. Then, based on the major insights, an approach to inferring full-scope data based on simplified simulator data was proposed. The PRIMERA-HRA and SHEEP research are expected to evaluate human actions more realistically than existing static HRA, provide an opportunity to collect more HRA data with reasonable cost and labor, then contribute to enhance the quality of HRA.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

An Approach to Dynamic Human Reliability Analysis and Its Data Collection Framework

Human reliability analysis (HRA) is a method for evaluating human errors in a variety of complex systems such as nuclear power plants, military systems, aircraft, and chemical plants. Most HRA methods currently used by regulatory institutes or utilities are called static HRA and are carried out by simple worksheets or simple calculators. To date, there are many unsolved or intrinsic challenges in static HRA. For example, existing static HRA does not realistically model and evaluate human actions as they would be performed at actual systems. There is no method with HRA to objectively estimate the time required for human actions despite being essential to HRA processes. In addition, many HRA methods still rely on a dataset generated prior to the 1980s, from unrelated industry experience or simply from expert judgment. Accordingly, this study attempted to research how to overcome the challenges of existing HRA via dynamic risk assessment (a.k.a., simulation-based or computation-based risk assessment) techniques. First, this study developed a dynamic HRA method, named as PRocedure-based Investigation Method of EMRALD Risk Assessment – HRA (PRIMERA-HRA). The PRIMERA-HRA mainly concentrates on providing HRA analysts with specific guidelines on how to reasonably model human actions, assign human reliability data and evaluate output of simulation within a dynamic probabilistic risk assessment tool, called as Event Modeling Risk Assessment using Linked Diagrams (EMRALD). Second, this study also developed a module for performance shaping factors (i.e., the key concept in HRA quantification) applicable to dynamic HRA, then implemented it based on PRIMERA-HRA within the EMRALD tool. Third, this study developed an HRA data collection framework to support dynamic HRA, called as Simplified Human Error Experimental Program (SHEEP). Originally, the SHEEP study aimed to support static HRA and its data collection, but recently extended the scope to the new technologies such as dynamic HRA or HRA for advanced reactors. SHEEP focuses on the use of data collected from simplified simulators to complement—but not replace—data collection studies using full-scope simulators and actual operators. To date, many experiments were conducted under the SHEEP framework. Multiple analyses, such as human performance analysis, human error analysis, task complexity analysis, learning effect analysis and time distribution analysis, were also carried out using the collected data. Then, based on the major insights, an approach to inferring full-scope data based on simplified simulator data was proposed. The PRIMERA-HRA and SHEEP research are expected to evaluate human actions more realistically than existing static HRA, provide an opportunity to collect more HRA data with reasonable cost and labor, then contribute to enhance the quality of HRA.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2021

Definitions for Testing Whether Evaluated Nuclear Data Relative Uncertainties are Realistic in Size

This document describes various tests that can be used to check whether evaluated relative uncertainties stored in nuclear-data covariances are realistic. To be more specific, these tests check whether nuclear-data uncertainties could be either over- or under-estimated given the input that usually enters the evaluation of nuclear-data mean values and covariances. Warning and error messages on the reliability of nuclear-data uncertainties will result from these tests. If uncertainties of one specific nuclear-data observable trigger warning messages from multiple tests, an evaluator should counter-check the reliability of the relative uncertainties of this particular nuclear-data covariance matrix.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI1969

Application of Nuclear Technology to Art Identification Problems: First Annual Report

Throughout the centuries, as man has become increasingly affluent, his interest in antiquities and objects of art, and the price he has been willing to pay for them, has increased. Inevitably, one result has been to attract the unscrupulous to the production and sale of counterfeit paintings, sculptures, and other works of art. The skill of forgers varies but often is highly sophisticated. However, dealers, museum curators, and other experts have also become more skillful in the detection of forgeries. Scientific tools of increasing sensitivity and sophistication have gradually been applied to the examination of the materials of art and archaeology. Such tools frequently support and render more reliable the judgment of the experts. The quality of forgeries may improve further as their makers become acquainted with the new methods of detection and in turn learn to circumvent or confound the methods. Therefore, the development of still more advanced methods of examination has great utility in the art world. This is particularly true if the ultimate effect is to make circumvention of the methods of examination so costly that the economic incentives for producing forgeries may be substantially reduced, if not eliminated.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Observations and Machine-Learned Models of Near-Surface Permafrost along the Koyukuk River, Alaska, USA

This dataset contains GeoTIFs (raster) and GeoPackages (vector) that map observations of near-surface permafrost and not-permafrost from a field campaign conducted near the village of Huslia, AK along the Koyukuk River and its floodplain in July 2018. These data were collected as part of a campaign to understand if and how permafrost impacts riverbank erosion. This problem cannot be assessed without knowing where permafrost exists. Permafrost was observed via frost probing (to a maximum depth of one meter), coring (to a maximum depth of two meters) and bank/bar excavations. An additional boat survey was performed wherein expert (Joel Rowland) judgment assessed the presence or absence of distinctive permafrost features (e.g., overhanging tundra mats, thermoerosional niching, ice wedges, active drainage of ice melt from soils). This dataset also contains the input features and results of two machine learning models (random forest and convolutional neural network) that extrapolate the observations to the full floodplain that may be useful for building, testing, or validating other machine-learned permafrost models. Permafrost data are provided as georasters of the same shape and geovectors (polylines/polygons) and are all projected into EPSG:32605. All data can be visualized with a GIS (QGIS, ArcGIS, etc.).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Materials Scorecards, Phase 2: Advanced Materials and Manufacturing Technology

This report presents updated material score cards with detailed justification of the proposed rating provided and quantifies the readiness of the advanced manufacturing of materials for nuclear applications. Based on an expanded literature review of available data, the scores in this report (Phase 2) have either been modified or remained constant as compared with Phase 1 scoring. The rating justification are provided for each scoring criteria whereas the maturity quantification of additively manufactured alloys and the knowledge gaps are discussed with reference traceability. This report focuses on the detailed justification and traceability for the adoption of additively manufactured 316SS, SS304, Alloy 800H, Graphite C/C, Alloy N, Silicon Carbide, HT9, Alloy 617, and Alloy 718. Significant variability in data and knowledge gaps exist among the identified materials. The scorecards are therefore based on published literature data, industry response to a survey, stakeholder input collected at workshops, and expert opinion. The interpretation and assessment were somewhat challenged as experimental process parameters and methodology varied and best judgment was exercised for score quantification. This assessment reflects the overall level of technical maturity for AM materials and their deployment in Gen-VI nuclear systems. These Phase 2 scorecards are likely to be revised based on additional input from stakeholders and as new research results become available.

36 MATERIALS SCIENCE↗

DOE OSTI2023

To what extent can decommissioning options for marine artificial structures move us toward environmental targets?

Switching from fossil fuels to renewable energy is key to international energy transition efforts and the move toward net zero. For many nations, this requires decommissioning of hundreds of oil and gas infrastructure in the marine environment. Current international, regional and national legislation largely dictates that structures must be completely removed at end-of-life although, increasingly, alternative decommissioning options are being promoted and implemented. Yet, a paucity of real-world case studies describing the impacts of decommissioning on the environment make decision-making with respect to which option(s) might be optimal for meeting international and regional strategic environmental targets challenging. To address this gap, we draw together international expertise and judgment from marine environmental scientists on marine artificial structures as an alternative source of evidence that explores how different decommissioning options might ameliorate pressures that drive environmental status toward (or away) from environmental objectives. Synthesis reveals that for 37 United Nations and Oslo-Paris Commissions (OSPAR) global and regional environmental targets, experts consider repurposing or abandoning individual structures, or abandoning multiple structures across a region, as the options that would most strongly contribute toward targets. This collective view suggests complete removal may not be best for the environment or society. However, different decommissioning options act in different ways and make variable contributions toward environmental targets, such that policy makers and managers would likely need to prioritise some targets over others considering political, social, economic, and ecological contexts. Current policy may not result in optimal outcomes for the environment or society.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Let’s Unleash the Network Judgment: A Self-Supervised Approach for Cloud Image Analysis

Accurate cloud type identification and coverage analysis are crucial in understanding the Earth’s radiative budget. Traditional computer vision methods rely on low-level visual features of clouds for estimating cloud coverage or sky conditions. Several handcrafted approaches have been proposed; however, scope for improvement still exists. Newer deep neural networks (DNNs) have demonstrated superior performance for cloud segmentation and categorization. These methods, however, need expert engineering intervention in the preprocessing steps—in the traditional methods—or human assistance in assigning cloud or clear sky labels to a pixel for training DNNs. Such human mediation imposes considerable time and labor costs. We present the application of a new self-supervised learning approach to autonomously extract relevant features from sky images captured by ground-based cameras, for the classification and segmentation of clouds. We evaluate a joint embedding architecture that uses self-knowledge distillation plus regularization. We use two datasets to demonstrate the network’s ability to classify and segment sky images—one with ~85,000 images collected from our ground-based camera and another with 400 labeled images from the WSISEG database. We find that this approach can discriminate full-sky images based on cloud coverage, diurnal variation, and cloud base height. Additionally, it semantically segments the cloud areas without labels. The approach shows competitive performance in all tested tasks, suggesting a new alternative for cloud characterization.

54 ENVIRONMENTAL SCIENCES↗