Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Risk Assessment Tool”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

An Approach to Dynamic Human Reliability Analysis and Its Data Collection Framework

Human reliability analysis (HRA) is a method for evaluating human errors in a variety of complex systems such as nuclear power plants, military systems, aircraft, and chemical plants. Most HRA methods currently used by regulatory institutes or utilities are called static HRA and are carried out by simple worksheets or simple calculators. To date, there are many unsolved or intrinsic challenges in static HRA. For example, existing static HRA does not realistically model and evaluate human actions as they would be performed at actual systems. There is no method with HRA to objectively estimate the time required for human actions despite being essential to HRA processes. In addition, many HRA methods still rely on a dataset generated prior to the 1980s, from unrelated industry experience or simply from expert judgment. Accordingly, this study attempted to research how to overcome the challenges of existing HRA via dynamic risk assessment (a.k.a., simulation-based or computation-based risk assessment) techniques. First, this study developed a dynamic HRA method, named as PRocedure-based Investigation Method of EMRALD Risk Assessment – HRA (PRIMERA-HRA). The PRIMERA-HRA mainly concentrates on providing HRA analysts with specific guidelines on how to reasonably model human actions, assign human reliability data and evaluate output of simulation within a dynamic probabilistic risk assessment tool, called as Event Modeling Risk Assessment using Linked Diagrams (EMRALD). Second, this study also developed a module for performance shaping factors (i.e., the key concept in HRA quantification) applicable to dynamic HRA, then implemented it based on PRIMERA-HRA within the EMRALD tool. Third, this study developed an HRA data collection framework to support dynamic HRA, called as Simplified Human Error Experimental Program (SHEEP). Originally, the SHEEP study aimed to support static HRA and its data collection, but recently extended the scope to the new technologies such as dynamic HRA or HRA for advanced reactors. SHEEP focuses on the use of data collected from simplified simulators to complement—but not replace—data collection studies using full-scope simulators and actual operators. To date, many experiments were conducted under the SHEEP framework. Multiple analyses, such as human performance analysis, human error analysis, task complexity analysis, learning effect analysis and time distribution analysis, were also carried out using the collected data. Then, based on the major insights, an approach to inferring full-scope data based on simplified simulator data was proposed. The PRIMERA-HRA and SHEEP research are expected to evaluate human actions more realistically than existing static HRA, provide an opportunity to collect more HRA data with reasonable cost and labor, then contribute to enhance the quality of HRA.

99 - GENERAL AND MISCELLANEOUS↗

Improving Quantification of Medical Evacuation Risk for Human Spaceflight in the IMPACT Model

Traditionally, mission planners have used a heuristic and qualitative approach to design medical systems based on prior experience however this approach may result in high variability and implicit bias to design and could put missions and crewmembers at risk. The Informing Mission Planning through Analysis of Complex Tradespaces (IMPACT) tool is a probabilistic risk assessment tool designed by NASA to model medical risk in long duration missions outside of low earth orbit (LEO). This tool can quantify risk metrics such as risk of crewmember death, loss of crew task time, and the need for medical evacuation to better inform and augment the more traditional approach to medical system design. The risk metric of Return to Definitive Care (RTDC) represents the likelihood of requiring medical evacuation and has been difficult to quantify in a reliable and standardized manner. Initial development of the RTDC metric was constrained due to the complexity of a medical evacuation decision and the lack of prior spaceflight data and this presentation will discuss the review and improvement process used to increase model accuracy and fidelity.

Prashant Parmar↗

Decision Support Tool for Risk Assessment & Maneuver Planning in Collision Avoidance

As the quantity of orbital debris continues to grow, so too does the rate of conjunction messages that suggest possible collisions between high value payloads and debris. The abundance of these conjunction messages, and eventual misses, has led to a culture of ignored alerts, and an increase in satellite operation costs as a result of the frequent need to plan resources for maneuver planning and execution. The loss of “trust” in conjunction alerts is due to the poorly characterized evolution in probability of collision (Pc) as time approaches the time of closest approach (TCA) between two objects, as well as the interpretation of Pc in the context of maneuver planning. To address these problems, and in collaboration with the NASA Conjunction Assessment Risk Analysis (CARA) program, the Industrial Sciences Group has developed a novel Maneuver Decision Support System (MDSS) to assist satellite operations in conjunction assessment and Maneuver planning. It provides a meaningful and intuitive Urgency metric for actionable maneuver decisions, based on the physical dynamics of conjunctions. It is based on a forecast of the evolution of Pc over time and represents an advance over current methods that are in use for satellite conjunction monitoring and planning. The result is to give satellite operators a validated decision support systems to plan for maneuver execution or mitigation or monitoring up to 3 days before TCA.

Decision Support Tool↗

Development and Validation of a Non-Invasive, Chairside Oral Cavity Cancer Risk Assessment Prototype Using Machine Learning Approach

Oral cavity cancer (OCC) is associated with high morbidity and mortality rates when diagnosed at late stages. Early detection of increased risk provides an opportunity for implementing prevention strategies surrounding modifiable risk factors and screening to promote early detection and intervention. Historical evidence identified a gap in the training of primary care providers (PCPs) surrounding the examination of the oral cavity. The absence of clinically applicable analytical tools to identify patients with high-risk OCC phenotypes at point-of-care (POC) causes missed opportunities for implementing patient-specific interventional strategies. This study developed an OCC risk assessment tool prototype by applying machine learning (ML) approaches to a rich retrospectively collected data set abstracted from a clinical enterprise data warehouse. We compared the performance of six ML classifiers by applying the 10-fold cross-validation approach. Accuracy, recall, precision, specificity, area under the receiver operating characteristic curve, and recall–precision curves for the derived voting algorithm were: 78%, 64%, 88%, 92%, 0.83, and 0.81, respectively. The performance of two classifiers, multilayer perceptron and AdaBoost, closely mirrored the voting algorithm. Integration of the OCC risk assessment tool developed by clinical informatics application into an electronic health record as a clinical decision support tool can assist PCPs in targeting at-risk patients for personalized interventional care.

60 APPLIED LIFE SCIENCES↗

Methodology and Tool for the Physical Security Analysis of Micro and Advanced Reactors

This work proposes a dynamic evaluation methodology to relax the conservatism in physical security evaluation, by leveraging an ongoing work in the Light Water Reactor Sustainability pathway. This methodology is implemented in a dynamic risk assessment tool named Event Modeling Risk Assessment using Linked Diagrams (EMRALD). The work extends EMRALD’s capability to support a sandbox feature where analysts can easily create attack scenarios and modify advanced/small modular reactor (A/SMR) security and safety features using templates. This approach saves time and cost since the analysis does not require creating detailed computer-aided design models, as is commonly required in commercial force-on-force software tools. EMRALD is completely free to use at https://emraldapp.inl.gov. We have developed basic templates including physical barriers, intrusion sensors, physical areas, and safety actions, that can be downloaded from EMRALD’s GitHub site: https://github.com/idaholab/EMRALD. These templates use generic data commonly used for training purposes, which do not reflect any actual operating nuclear reactor. Users may adjust the data in the templates with their own dataset and/or create new templates in EMRALD. The proposed methodology combines security and safety by assessing sabotage effects up to the radiological consequence to the public instead of merely the core damage state. This practice follows the industry standard for advanced non-light-water reactors currently proposed for endorsement by the Nuclear Regulatory Commission. The combination of security and safety is expressed in an achievability-consequence chart. EMRALD can be used to generate data for this chart. A hypothetical case study using a representative sodium-cooled fast reactor (SFR) facility is presented in this report to demonstrate this methodology. This case study does not contain any actual nuclear plant information. This work will benefit A/SMR vendors and utilities to implement security by design during the reactor design iteration phase, such that they do not have to perform upgrades and retrofits to the reactor after it is installed to improve its physical protection system. The tool may also be used to analyze domestic or foreign reactor designs to support the International Nuclear Security Techniques for Advanced Reactors (INSTAR) bilateral missions. Future works are planned to implement the methodology on a reference SFR reactor and a reference high-temperature gas-cooled reactor to obtain insights and lessons-learned for the A/SMR community.

97 MATHEMATICS AND COMPUTING↗

A Dynamic Risk Framework for the Physical Security of Nuclear Power Plants

This paper describes ongoing work within the Light Water Reactor Sustainability pathway at Idaho National Laboratory (INL) to optimize the security and cost of nuclear power plants. It introduces the dynamic risk assessment tool developed at INL, Event Modeling Risk Assessment using Linked Diagrams (EMRALD). EMRALD is leveraged to optimize the security posture of a nuclear power plant by integrating force-on-force (FOF) simulations and operator mitigation actions, including dynamic and flexible coping strategies (FLEX). To illustrate the methodology, four attack scenarios are modeled in a commercially available FOF simulation tool using a hypothetical nuclear power plant facility. The simulation results provide valuable insights into possible attack outcomes, as well as the probabilistic risk of a core damage event given these outcomes. Safety mitigation procedures are modeled in EMRALD dependent on the attack outcomes by considering human operator uncertainties. The results demonstrate that the number of armed responders can be optimized, while still maintaining the same protection level as the initial security posture. The proposed modeling and simulation framework of integrating FLEX equipment with FOF models enables the nuclear power plants to credit FLEX portable equipment in the plant security posture, resulting in an efficient and optimized physical security system.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

METHODOLOGY AND APPLICATION OF PHYSICAL SECURITY EFFECTIVENESS BASED ON DYNAMIC FORCE-ON-FORCE MODELING

This paper describes ongoing work within the Light Water Reactor Sustainability (LWRS) Program at Idaho National Laboratory (INL) to optimize security and cost of nuclear power plants (NPPs). It reviews the conservatisms in conventional physical security posture and regulations. It introduces the dynamic risk assessment tool developed at INL, Event Modeling Risk Assessment using Linked Diagrams (EMRALD). The dynamic assessment methodology leverages EMRALD to process results of force-on-force (FOF) simulations and crediting safety mitigation actions from probabilistic risk assessment (PRA) models as well as diverse and flexible coping strategies (FLEX) mitigation strategies. Timing information from these simulations are compared against the available time to perform mitigations obtained from Reactor Excursion and Leak Analysis Program (RELAP5) simulations. To illustrate the methodology, a station blackout (SBO) attack scenario was modeled in commercially available FOF simulation tools. The simulation results provide valuable insights into possible attack outcomes and as the probabilistic risk of a core damage event given these outcomes. Safety mitigation procedures were modeled in EMRALD, and were dependent on the attack outcomes by considering human operator uncertainties. RELAP5 simulations incorporating human and hardware uncertainties were performed to estimate the distribution of time-to-core damage. The results demonstrate that, even in the extreme case of a successful adversarial attack, plant mitigation strategies provide significantly high-likelihood of preventing radiological release. The proposed modeling and simulation framework of integrating FLEX equipment with FOF models enables the NPPs to credit FLEX portable equipment in the plant security posture, resulting in an efficient and optimized physical security.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Dynamic Risk Framework for the Optimization of Physical Security Posture of Nuclear Power Plants

This paper describes an ongoing work within the Light Water Reactor Sustainability pathway at Idaho National Laboratory (INL) to optimize security and cost of nuclear power plants. It introduces the dynamic risk assessment tool developed at INL, Event Modeling Risk Assessment using Linked Diagrams (EMRALD). EMRALD was leveraged to optimize the security posture of a nuclear power plant by integrating force-on-force (FOF) simulations and operator mitigation actions including the dynamic and flexible coping strategies (FLEX). To illustrate the methodology, four attack scenarios were modeled in a commercially available FOF simulation tool using a hypothetical nuclear power plant facility. The simulation results provide valuable insights into possible attack outcomes, as well as the probabilistic risk of core damage event given these outcomes. Safety mitigation procedures were modeled in EMRALD dependent on the attack outcomes by considering human operator uncertainties. The results demonstrate that the number of armed responders can be optimized, while still maintaining the same protection level as the initial security posture. The proposed modeling and simulation framework of integrating FLEX equipment with FOF models enables the nuclear power plants to credit FLEX portable equipment in the plant security posture, resulting in an efficient and optimized physical security system.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluation of Containment and Geomechanical Risks at Integrated Mid-Content Stacked Carbon Storage Hub Sites

The U.S. Department of Energy is leading the development of CCS through collaborative projects and programs to not only develop and demonstrate the technology but to also quantify the risks and provide tools that site operators can use to develop a site-specific understanding of their risk to enable successful project operations. This report summarizes results and findings from the application of risk-assessment tools to an industrial-scale Geologic Carbon Storage (GCS) project. Specifically, we applied the National Risk Assessment Partnership’s (NRAP) Open Integrated Assessment Model (NRAP-Open-IAM) and State of Stress Assessment Tool (SOSAT) to two candidate sites being considered for storage by the Integrated Midcontinent Stacked Carbon Storage Hub (IMSCS-Hub) project team. These sites, Sleepy Hollow Field in Nebraska and Patterson Field in Kansas, have historical oil and gas production and thus are attractive candidates to store the 50 million metric tons (Mt), which is the CarbonSAFE objective. Because these sites have historical operations, they have a significant number of existing wells that pose a risk for well leakage. Additionally, the storage formations will undergo significant pore pressure perturbation (i.e., increase due to CO 2 injection). Hence, we have selected the two NRAP tools best suited to study the risks associated with well leakage and geomechanical risks. The objective of the study was not only to assess the risk at the site, but to also improve the NRAP tools through application using real site data on an ongoing project.

54 ENVIRONMENTAL SCIENCES↗

The Use of Probabilistic Methods to Evaluate the Systems Impact of Component Design Improvements on Large Turbofan Engines

Probabilistic Structural Analysis (PSA) is now commonly used for predicting the distribution of time/cycles to failure of turbine blades and other engine components. These distributions are typically based on fatigue/fracture and creep failure modes of these components. Additionally, reliability analysis is used for taking test data related to particular failure modes and calculating failure rate distributions of electronic and electromechanical components. How can these individual failure time distributions of structural, electronic and electromechanical component failure modes be effectively combined into a top level model for overall system evaluation of component upgrades, changes in maintenance intervals, or line replaceable unit (LRU) redesign? This paper shows an example of how various probabilistic failure predictions for turbine engine components can be evaluated and combined to show their effect on overall engine performance. A generic model of a turbofan engine was modeled using various Probabilistic Risk Assessment (PRA) tools (Quantitative Risk Assessment Software (QRAS) etc.). Hypothetical PSA results for a number of structural components along with mitigation factors that would restrict the failure mode from propagating to a Loss of Mission (LOM) failure were used in the models. The output of this program includes an overall failure distribution for LOM of the system. The rank and contribution to the overall Mission Success (MS) is also given for each failure mode and each subsystem. This application methodology demonstrates the effectiveness of PRA for assessing the performance of large turbine engines. Additionally, the effects of system changes and upgrades, the application of different maintenance intervals, inclusion of new sensor detection of faults and other upgrades were evaluated in determining overall turbine engine reliability.

Packard, Michael H.↗

Orion Artemis I As Flown MMOD Analysis

Introduction The Lockheed Martin Orion spacecraft conducted the Artemis I flight around the Moon from November 16 through December 11, 2022. After the flight, an engineer from the NASA Johnson Space Center (JSC) Hypervelocity Impact Technology (HVIT) Group performed a Micrometeoroid and Orbital Debris MMOD analysis using the Bumper 3 risk assessment tool to predict the number of small impacts that would likely have occurred during the mission. Separately, a team from the same group inspected the Orion capsule for hypervelocity impact damage features. The results of the inspection were compared to those of the analysis to aid in improving the analysis, including the environment models. Scope of Work The spacecraft geometry model was created by Lockheed Martin during construction of the Artemis I Orion vehicle based on Computer Aided Design (CAD) models of the vehicle. New hypervelocity impact testing was performed to verify Ballistic Limit Equations (BLEs) used in the analysis to link impactor size and damage to the Thermal Protection System (TPS). The exact trajectory flown was recorded during the flight, including vehicle attitude. This data was used in conjunction with the ORDEM 3.2 and MEM 3 environment modeling tools to create models of particle flux impacting the spacecraft throughout the mission. Meteoroid shower forecast information was also included to account for additional particle flux associated with meteoroid showers. Inspection of the Orion capsule included the Backshell thermal tiles and the tape covering it, windows, fabric thermal materials, and small areas of other materials. Potential MMOD damage found was characterized using various techniques, including optical microscopy, computed tomography scanning, and X-ray spectroscopy. Findings The number of craters found in the Backshell tile, and their size distribution, matches well with the Bumper analysis prediction. Tape, window, and other material impacts recorded similarly align to Bumper analysis predictions. Conclusions and Recommendations This comparison of analysis with inspection of the hardware provides valuable insight into the MMOD environment and how accurately analysis tools assess the impact risk to spacecraft. As this was the first large, non-ablative returned surface from a lunar mission, this analysis extends the MMOD community’s insight beyond low Earth orbit into cis-lunar space.

MMOD↗

Orion Artemis I As Flown MMOD Analysis

Introduction The Lockheed Martin Orion spacecraft conducted the Artemis I flight around the Moon from November 16 through December 11, 2022. After the flight, an engineer from the NASA Johnson Space Center (JSC) Hypervelocity Impact Technology (HVIT) Group performed a Micrometeoroid and Orbital Debris MMOD analysis using the Bumper 3 risk assessment tool to predict the number of small impacts that would likely have occurred during the mission. Separately, a team from the same group inspected the Orion capsule for hypervelocity impact damage features. The results of the inspection were compared to those of the analysis to aid in improving the analysis, including the environment models. Scope of Work The spacecraft geometry model was created by Lockheed Martin during construction of the Artemis I Orion vehicle based on Computer Aided Design (CAD) models of the vehicle. New hypervelocity impact testing was performed to verify Ballistic Limit Equations (BLEs) used in the analysis to link impactor size and damage to the Thermal Protection System (TPS). The exact trajectory flown was recorded during the flight, including vehicle attitude. This data was used in conjunction with the ORDEM 3.2 and MEM 3 environment modeling tools to create models of particle flux impacting the spacecraft throughout the mission. Meteoroid shower forecast information was also included to account for additional particle flux associated with meteoroid showers. Inspection of the Orion capsule included the Backshell thermal tiles and the tape covering it, windows, fabric thermal materials, and small areas of other materials. Potential MMOD damage found was characterized using various techniques, including optical microscopy, computed tomography scanning, and X-ray spectroscopy. Findings The number of craters found in the Backshell tile, and their size distribution, matches well with the Bumper analysis prediction. Tape, window, and other material impacts recorded similarly align to Bumper analysis predictions. Conclusions and Recommendations This comparison of analysis with inspection of the hardware provides valuable insight into the MMOD environment and how accurately analysis tools assess the impact risk to spacecraft. As this was the first large, non-ablative returned surface from a lunar mission, this analysis extends the MMOD community’s insight beyond low Earth orbit into cis-lunar space.

MMOD↗

A risk-informed assessment tool to support review of license amendment requests for spent nuclear fuel dry cask storage systems

We report that while risk-informed safety evaluations are common methodologies used by the U.S. Nuclear Regulatory Commission (NRC), their application in the field of commercial spent nuclear fuel (SNF) dry storage has received limited attention. For instance, license amendment requests (LARs) for SNF dry cask storage systems (DCSSs) are evaluated according to U.S. NRC standard review plans (SRPs). However, risk-informed LAR review strategies could improve the understanding of critical system modifications, and lead to more predictable, efficient, and consistent LAR review processes. A methodology to develop a risk-informed LAR review tool is presented. Although focused on DCSSs, this methodology can be used to develop similar tools for a broad spectrum of safety-relevant systems. The end product (i.e., the tool) includes a tree diagram to help visualize the review risk significances assigned to a predefined set of system modifications and supporting rationale documentation. Instructions support correct tool application and provide the user with a path to incorporate currently unevaluated modifications in the tool structure. The demonstration of the methodology leads to the conclusion that risk-informed reviews of DCSS LARs are possible, although the tool precision could benefit from additional risk information. Further, the results indicate that many typical LARs involve low-risk or medium-risk modifications.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Incorporating climate change into risk-informed resilience planning

In response to the development of portfolio-wide Climate Action Plans by federal agencies, federal sites are working to incorporate the impacts of climate change into their resilience assessments. However, it can be challenging to incorporate climate change scenarios into resilience assessments given the uncertainty inherent in climate change modeling. Incorporating these factors into a resilience plan requires an understanding of what the different climate scenarios mean, as well as how to estimate potential impacts of climate change on hazard occurrence on a regional, or even local, scale under different scenarios. We discuss approaches to incorporating this data into risk-informed resilience assessment processes, such as those implemented in the Department of Energy’s (DOE) Federal Energy Management Program’s (FEMP) Technical Resilience Navigator (TRN) and the Sustainability Performance Division’s (SPD) Vulnerability Assessment and Resilience Plan (VARP) Risk Assessment Tool. We also describe the climate scenarios and the availability of hazard data for site resilience planning, based on modeling included in the International Panel on Climate Change (IPCC), the National Climate Assessment (NCA), and state-level reports. We present examples from the TRN risk assessment and the VARP Risk Assessment Tool to illustrate how sensitivity analysis can be used to incorporate climate change projections into the resilience planning process.

Rabinowitz, Hannah S.↗

Health Analysis and Research for Public Events (HARPE) Tool (Final CRADA Report)

Based on its experience in building assessment tools, Argonne National Laboratory (Argonne) has demonstrated expertise in developing comparative methodologies and question sets that provide both a physical and cyber-based risk assessment for the commercial facilities sector. A high-level risk assessment tool can be beneficial for venues and organizations that fall under a wide array of facility characterizations, ultimately accommodating the evolving landscape of threats specific to these facilities. The Health Analysis and Research for Public Events (HARPE) Tool is an assessment that seeks to help facility managers assess and mitigate aspects of safety, security, and emergency management within their venues. With the pandemic featuring prominently in today’s landscape, we have adapted and extended the scope of the HARPE tool so that it offers users the ability to integrate assessments of their preparation for, response to, and recovery from threats faced at the venue arising from the COVID-19 pandemic. Traditional threats and hazards remain prevalent in today’s landscape, and the best defense is a proactive approach to preventing and mitigating these threats. At the very core of prevention and mitigation is the first step of conducting a risk assessment—this is the gap that HARPE fills. While it is obvious that the response to COVID-19 is health and sanitation driven, leaders within the commercial facilities sector must also know where to best extend their efforts in mitigating future threats arising from the pandemic. Public events and mass gatherings are directly impacted by COVID-19; however, with the help of HARPE, leaders can focus their attention on core impact areas related to the safety and security of returning to a new normal, as they assess their risks using the Argonne-developed tool. HARPE provides an important solution to the COVID-19 situation by assisting venue managers and health officials in identifying their risks.

59 BASIC BIOLOGICAL SCIENCES↗

NASA's New Approach for Evaluating Risk Reduction Due to Space Shuttle Upgrades

As part of NASA's intensive effort to incorporate quantitative risk assessment (QRA) tools in the Agency's decision-making process concerning Space Shuttle risk, NASA has developed a powerful risk assessment tool called the Quantitative Risk Assessment System (QRAS). The QRAS is a tool designed to estimate Space Shuttle risk and evaluate Space Shuttle upgrades. This paper presents an overview of the QRAS with focus on its application for evaluating the risk reduction due to proposed Space Shuttle upgrades. The application includes a case study from the Space Shuttle main engine (SSME). The QRAS overview section of the paper includes the QRAS development process, the technical approach to model development, the QRA quantification methods and techniques, and observations concerning the complex modeling involved in QRAS. The application section of the paper describes a practical case study using QRAS models for evaluating critical Space Shuttle Program upgrades, specifically a proposed SSME nozzle upgrade. This paper presents the method for evaluating the proposed upgrade by comparing the current nozzle (old design with well-established probabilistic models) to the channel wall nozzle (new design at the preliminary design level).

Safie, Fayssal M.↗