Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “risk analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Industrial Control Systems: Cyber Security Risk Candidate Methods Analysis

In recognition of their mission and in response to continuously evolving cyber threats against nuclear facilities, Department of Energy - Nuclear Energy (DOE-NE) is building the Nuclear Energy Cyber security Research, Development, and Demonstration (RD&D) Program, which includes a cyber risk management thrust. This report supports the cyber risk management thrust objective which is to deliver "Standardized methodologies for credible risk-based identification, evaluation and prioritization of digital components." In a previous task, the Sandia National Laboratories (SNL) team presented evaluation criteria and a survey to review methods to determine the most suitable techniques. In this task we will identify and evaluate a series of candidate methodologies. In this report, 10 distinct methodologies are evaluated. The overall goal of this effort was to identify the current range of risk analysis techniques that were currently available, and how they could be applied, with an focus on industrial control systems (ICS). Overall, most of the techniques identified did fall into accepted risk analysis practices, though they generally addressed only one step of the multi-step risk management process. A few addressed multiple steps, but generally their treatment was superficial. This study revealed that the current state of security risk analysis in digital control systems was not comprehensive and did not support a science-based evaluation. The papers surveyed did use mathematical formulation to describe the addressed problems, and tied the models to some kind of experimental or experiential evidence as support. Most of the papers, however, did not use a rigorous approach to experimentally support the proposed models, nor did they have enough evidence supporting the efficacy of the models to statistically analyze model impact. Both of these issues stem from the difficulty and expense associated with collecting experimental data in this domain.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Overview of the Special Issue: A Multi-Model Framework to Achieve Consistent Evaluation of Climate Change Impacts in the United States

The Climate Change Impacts and Risk Analysis (CIRA) modeling exercise is a unique contribution to the scientific literature on climate change impacts, economic damages, and risk analysis that brings together multiple, national-scale models of impacts and damages in an integrated and consistent fashion to estimate climate change impacts, damages, and the benefits of greenhouse gas (GHG) mitigation actions in the United States. The CIRA project uses three consistent socioeconomic, emissions, and climate scenarios across all models to estimate the benefits of GHG mitigation policies: a Business As Usual (BAU) and two policy scenarios with radiative forcing (RF) stabilization targets of 4.5 W/m2 and 3.7 W/m2 in 2100. CIRA was also designed to specifically examine the sensitivity of results to uncertainties around climate sensitivity and differences in model structure. The goals of CIRA project are to 1) build a multi-model framework to produce estimates of multiple risks and impacts in the U.S., 2) determine to what degree risks and damages across sectors may be lowered from a BAU to policy scenarios, 3) evaluate key sources of uncertainty along the causal chain, and 4) provide information for multiple audiences and clearly communicate the risks and damages of climate change and the potential benefits of mitigation. This paper describes the motivations, goals, and design of the CIRA modeling exercise and introduces the subsequent papers in this special issue.

Climate Change Impacts↗

Safety Risk Knowledge Elicitation in Support of Aeronautical R and D Portfolio Management: A Case Study

Aviation is a problem domain characterized by a high level of system complexity and uncertainty. Safety risk analysis in such a domain is especially challenging given the multitude of operations and diverse stakeholders. The Federal Aviation Administration (FAA) projects that by 2025 air traffic will increase by more than 50 percent with 1.1 billion passengers a year and more than 85,000 flights every 24 hours contributing to further delays and congestion in the sky (Circelli, 2011). This increased system complexity necessitates the application of structured safety risk analysis methods to understand and eliminate where possible, reduce, and/or mitigate risk factors. The use of expert judgments for probabilistic safety analysis in such a complex domain is necessary especially when evaluating the projected impact of future technologies, capabilities, and procedures for which current operational data may be scarce. Management of an R&D product portfolio in such a dynamic domain needs a systematic process to elicit these expert judgments, process modeling results, perform sensitivity analyses, and efficiently communicate the modeling results to decision makers. In this paper a case study focusing on the application of an R&D portfolio of aeronautical products intended to mitigate aircraft Loss of Control (LOC) accidents is presented. In particular, the knowledge elicitation process with three subject matter experts who contributed to the safety risk model is emphasized. The application and refinement of a verbal-numerical scale for conditional probability elicitation in a Bayesian Belief Network (BBN) is discussed. The preliminary findings from this initial step of a three-part elicitation are important to project management practitioners as they illustrate the vital contribution of systematic knowledge elicitation in complex domains.

Shih, Ann T.↗

Distal Edge Stenosis After Stent Placement for Isolated Superior Mesenteric Artery Dissection: Mechanisms and Risk Factor Analysis

Purpose: To analyze factors potentially associated with the occurrence of distal edge stenosis after stent placement for isolated superior mesenteric artery dissection (ISMAD). Materials and Methods: Cases of consecutive patients who were diagnosed with spontaneous ISMAD between February 2010 and July 2018 were retrospectively identified. Of the 123 cases identified, 45 patients (42 men; three women) underwent endovascular stent placement and were included in the study. Univariate and multivariate analyses were used to assess factors potentially associated with distal edge stenosis. Results: The technical success rate among study patients was 100%. During 26.7 ± 17.3 months of follow-up, CT angiography demonstrated good distal edge patency in 25 patients (55.6%) and evidence of distal edge stenosis in 20 patients (44.4%). In univariate analysis, stent length (odds radio [OR] 1.03; 95% confidence interval [CI] 1.01, 1.06; P = .02), stent-to-vessel (S/V) diameter ratio (OR 2.27; 95% CI 1.35, 3.82; P < .01), and angulation at the distal edge (OR 1.05; 95% CI 1.00, 1.10; P =.03) were significantly associated with distal edge stenosis; only S/V diameter ratio (OR 3.36; 95% CI 1.41, 7.99; P < .01) and angulation at the distal edge (OR 1.12; 95% CI 1.01, 1.23; P =.03) retained this significance in multivariate analysis. Conclusions: Distal edge stenosis after stent placement for ISMAD is common. S/V diameter ratio and angulation at the distal edge are independent risk factors for distal edge stenosis in patients with ISMAD who undergo stent placement.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

WISP: Watching grid Infrastructure Stealthily through Proxies (Final Technical Report)

The complex interdependencies of cyber systems (sensors and communications), physical grids and associated electricity market operations make protecting electric power grids a significant challenge. The energy sector is constantly under new, targeted, advanced and dangerous cyber-attacks that have the potential to result in the loss of human life. These threats are further exacerbated by our need to modernize the grid. One focus of cyber security research in smart grids is the securing of the SCADA system through advanced intrusion detection systems (IDS) and bad data detection algorithms in state estimation. These methods either require full knowledge of the system topology and parameters or fail to understand the physical behaviors under attack. WISP (Watching grid Infrastructure Stealthily through Proxies) is designed to provide additional protection to the power grid using only publicly available data. In particular, WISP exploits the spatio-temporal nature of the real time locational marginal prices (LMPs), in conjunction with other information such as bids, weather, outages and load data to analyze anomalous power pricing behaviors and then correlate those observations to localize regions of interest and identify potential cyber events. WISP is non-intrusive as the tool is deployed as a service in the Cloud or on premise and provides reliable information to system operators for enhanced situational awareness, without impeding energy delivery functions. The WISP technology comprises three modules: the data-driven anomaly detection core, the vulnerability and risk analysis and the root cause analysis. The data-driven anomaly detection core performs the tasks of feature selection, anomaly detection and attack region localization. The vulnerability and risk analysis module provides system level information of the vulnerable variables and times, assisting the operators in selecting monitoring and protection nodes. The root cause analysis module takes the detection results and identifies potential operational conditions that contribute to the detected anomalies. In Phase I, we have demonstrated the feasibility and effectiveness of WISP. We developed a realistic electricity market simulator capable of generating normal and attack market data under various operational conditions. We developed a series of cyber-attack detection and analysis algorithms and evaluated them under multiple data sources. Finally, we integrated all modules into an end-to-end software, providing functions for data management, data analytics and visualization. Specifically, we have achieved: (i) real-time data acceptance from external utility interfaces with >99% acceptance rate; (ii) high performance anomaly detection algorithms with >98% detection accuracy and <0.1% false alarm rate; and (iii) ultra-low computing delay <50 milliseconds. Additionally, our team developed algorithms to identify the vulnerable variables in electricity market operations and root cause analysis functions to identify major contributors to the price spikes. These ancillary modules are necessary when deploying WISP in real world industry environment. In Phase II, we have demonstrated the effectiveness of WISP software on realistic largescale power systems. We performed red team testing for the Phase I WISP software and identified software vulnerabilities and implemented corresponding mitigation solutions. We adapted the electricity market simulator for the Texas synthetic 2000-bus system and generated datasets for the false data injection attacks. We created database and visualization interfaces for the Texas system and the ISO New England system. We performed software optimization in terms of operation efficiency, computing speed and detection accuracy. Finally, we tested the software on the Texas system and the ISO New England system and evaluated the detection performance. Overall, we achieved above 89% detection rate, below 3% false alarm rate and below 37 seconds of end-to-end detection delay.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Risk Management for CO 2 Storage Projects

Conference poster presented at American Association of Petroleum Geologists (AAPG) Carbon Capture, Utilization, and Storage (CCUS) Conference, Houston, Texas, April 25–27, 2023. There is no one-size-fits-all risk management approach for storage projects. Instead, risk management is about having a detailed process in place, adhering to that process throughout the project life cycle, and adapting the process depending on site-specific conditions, applicable regulatory requirements, and any additional requirements imposed by pursuing one or more financial incentive programs. The Plains CO 2 Reduction (PCOR) Partnership Initiative experience has demonstrated the value of managing risk analysis in concert with storage project regulatory permit requirements, which drive the geologic exhibits and site characterization needs for the permit and the risk analysis.

01 COAL, LIGNITE, AND PEAT↗

Valuing Rigor in the Risk Management Process

NASA, as an organization, takes risk management (RM) seriously, and for most projects, the risk management process is exemplar. There can be challenges, though, with defining RM processes. For example, many different risk analysis methodologies are available, they can be applied with varying degrees of rigor, and they can have different value depending on how projects use them. In particular, risk analysis methodologies vary considerably in the level of quantitative detail, with more probabilistic techniques encouraged in some situations. We discussed these processes and methodologies with ten project managers (PM) at the NASA Goddard Space Flight Center (GSFC). Our intent was not to prove with some level of statistical significance that some are more helpful than others, but rather to obtain a general understanding of how projects are identifying, and thinking, about risks. This paper describes some of the available risk processes and methodologies, and provides some insights about the benefits that can gained from their use. We provide an in-depth discussion of one quantitative methodology, Probabilistic Risk Assessments (PRAs), and conclude with a few insights from observed best practices.

Dillon, Robin L.↗

Risk Assessment at the Edge: Applying NERC CIP to Aggregated Grid-Edge Resources

Distributed energy resources (DERs) promise to deliver benefits for both utilities and consumers by dynamically interoperating utility systems with customer-owned grid-edge technologies. These small energy-consuming devices are increasingly being aggregated for participation in grid markets, planning and operations. A cyber attack penetrating the control system of aggregated DERs could negatively impact the operation of the grid. In the worst case, the power grid could be severely damaged and physical safety compromised. In this paper we analyze cybersecurity risks associated with the aggregation of DERs and develop an approach to mitigating that risk. The approaches to both cyber risk analysis and mitigation were developed during a recent research project that serves as an example of how the approaches could be applied. However, both the risk analysis and mitigation are applicable to the broader domain of all DERs. An important conclusion is that the successful cyber compromise of aggregated DERs could have a significant impact on the bulk power system. This is the case even if each individual DER falls below the threshold of compliance with bulk-grid cybersecurity standards. For this reason, we specifically investigate how National Electricity Reliability Corporation's Critical Infrastructure Protection requirements could flow down to interactions between DER aggregators and the DERs themselves in order to protect the grid from these bulk-scale cyber attack impacts.

24 POWER TRANSMISSION AND DISTRIBUTION↗

CCSI Risk Estimation: An Application of Expert Elicitation

The Carbon Capture Simulation Initiative (CCSI) is a multi-laboratory simulation-driven effort to develop carbon capture technologies with the goal of accelerating commercialization and adoption in the near future. One of the key CCSI technical challenges is representing and quantifying the inherent uncertainty and risks associated with developing, testing, and deploying the technology in simulated and real operational settings. To address this challenge, the CCSI Element 7 team developed a holistic risk analysis and decision-making framework. The purpose of this report is to document the CCSI Element 7 structured systematic expert elicitation to identify additional risk factors. We review the significance of and established approaches to expert elicitation, describe the CCSI risk elicitation plan and implementation strategies, and conclude by discussing the next steps and highlighting the contribution of risk elicitation toward the achievement of the overarching CCSI objectives.

CCSI↗

Environmental Regulations as Drivers of Materials Obsolescence

This slide presentation reviews the operations of the Principal Center for Regulatory Risk Analysis and Communication (RRAC-PC) and the impact of environmental regulations in making some materials obsolete. The center is NASA's resource for identifying and managing risks associated with changing environmental regulations. To this end the center acts as an regulatory early warning system, to review track and analyze emerging regulations, collaborate with the technical community on regulatory risk analysis and interpretation and to represent NASA's interests to the regulatory agencies. Regulations frequently result in making some materials unavailable forcing a change to another material. Processes may also be changed due to environmental regulations. For example some items that were sprayed with a chemical may now have to be painted or dipped with the chemical. Sometimes a regulation changes the use of a certain product, which does not affect the usage on Earth, but has significant implications in space. An example of this is the use of lead-free solders of basically tin, which don't appear to have any problem on Earth, but in space applications tin whiskers have resulted in several confirmed satellite failures.

Scroggins, Sharon↗

TH-EF-BRC-00: TG-100 Workshop

This Hands-on Workshop will be focused on providing participants with experience with the principal tools of TG 100 and hence start to build both competence and confidence in the use of risk-based quality management techniques. The three principal tools forming the basis of TG 100’s risk analysis: Process mapping, Failure-Modes and Effects Analysis and fault-tree analysis will be introduced with a 5 minute refresher presentation and each presentation will be followed by a 30 minute small group exercise. An exercise on developing QM from the risk analysis follows. During the exercise periods, participants will apply the principles in 2 different clinical scenarios. At the conclusion of each exercise there will be ample time for participants to discuss with each other and the faculty their experience and any challenges encountered. Learning Objectives: To review the principles of Process Mapping, Failure Modes and Effects Analysis and Fault Tree Analysis. To gain familiarity with these three techniques in a small group setting. To share and discuss experiences with the three techniques with faculty and participants. Director, TreatSafely, LLC. Director, Center for the Assessment of Radiological Sciences. Occasional Consultant to the IAEA and Varian.

60 APPLIED LIFE SCIENCES↗

TH-EF-BRC-02: FMEA

This Hands-on Workshop will be focused on providing participants with experience with the principal tools of TG 100 and hence start to build both competence and confidence in the use of risk-based quality management techniques. The three principal tools forming the basis of TG 100’s risk analysis: Process mapping, Failure-Modes and Effects Analysis and fault-tree analysis will be introduced with a 5 minute refresher presentation and each presentation will be followed by a 30 minute small group exercise. An exercise on developing QM from the risk analysis follows. During the exercise periods, participants will apply the principles in 2 different clinical scenarios. At the conclusion of each exercise there will be ample time for participants to discuss with each other and the faculty their experience and any challenges encountered. Learning Objectives: To review the principles of Process Mapping, Failure Modes and Effects Analysis and Fault Tree Analysis. To gain familiarity with these three techniques in a small group setting. To share and discuss experiences with the three techniques with faculty and participants. Director, TreatSafely, LLC. Director, Center for the Assessment of Radiological Sciences. Occasional Consultant to the IAEA and Varian.

60 APPLIED LIFE SCIENCES↗

TH-EF-BRC-01: Process Mapping

This Hands-on Workshop will be focused on providing participants with experience with the principal tools of TG 100 and hence start to build both competence and confidence in the use of risk-based quality management techniques. The three principal tools forming the basis of TG 100’s risk analysis: Process mapping, Failure-Modes and Effects Analysis and fault-tree analysis will be introduced with a 5 minute refresher presentation and each presentation will be followed by a 30 minute small group exercise. An exercise on developing QM from the risk analysis follows. During the exercise periods, participants will apply the principles in 2 different clinical scenarios. At the conclusion of each exercise there will be ample time for participants to discuss with each other and the faculty their experience and any challenges encountered. Learning Objectives: To review the principles of Process Mapping, Failure Modes and Effects Analysis and Fault Tree Analysis. To gain familiarity with these three techniques in a small group setting. To share and discuss experiences with the three techniques with faculty and participants. Director, TreatSafely, LLC. Director, Center for the Assessment of Radiological Sciences. Occasional Consultant to the IAEA and Varian.

60 APPLIED LIFE SCIENCES↗

TH-EF-BRC-04: Quality Management Program

This Hands-on Workshop will be focused on providing participants with experience with the principal tools of TG 100 and hence start to build both competence and confidence in the use of risk-based quality management techniques. The three principal tools forming the basis of TG 100’s risk analysis: Process mapping, Failure-Modes and Effects Analysis and fault-tree analysis will be introduced with a 5 minute refresher presentation and each presentation will be followed by a 30 minute small group exercise. An exercise on developing QM from the risk analysis follows. During the exercise periods, participants will apply the principles in 2 different clinical scenarios. At the conclusion of each exercise there will be ample time for participants to discuss with each other and the faculty their experience and any challenges encountered. Learning Objectives: To review the principles of Process Mapping, Failure Modes and Effects Analysis and Fault Tree Analysis. To gain familiarity with these three techniques in a small group setting. To share and discuss experiences with the three techniques with faculty and participants. Director, TreatSafely, LLC. Director, Center for the Assessment of Radiological Sciences. Occasional Consultant to the IAEA and Varian.

60 APPLIED LIFE SCIENCES↗

Prospective Coronary Heart Disease Screening in Asymptomatic Hodgkin Lymphoma Patients Using Coronary Computed Tomography Angiography: Results and Risk Factor Analysis

Purpose: To prospectively investigate the coronary artery status using coronary CT angiography (CCTA) in patients with Hodgkin lymphoma treated with combined modalities and mediastinal irradiation. Methods and Materials: All consecutive asymptomatic patients with Hodgkin lymphoma entered the study during follow-up, from August 2007 to May 2012. Coronary CT angiography was performed, and risk factors were recorded along with leukocyte telomere length (LTL) measurements. Results: One hundred seventy-nine patients entered the 5-year study. The median follow-up was 11.6 years (range, 2.1-40.2 years), and the median interval between treatment and the CCTA was 9.5 years (range, 0.5-40 years). Coronary artery abnormalities were demonstrated in 46 patients (26%). Coronary CT angiography abnormalities were detected in nearly 15% of the patients within the first 5 years after treatment. A significant increase (34%) occurred 10 years after treatment (P=.05). Stenoses were mostly nonostial. Severe stenoses were observed in 12 (6.7%) of the patients, entailing surgery with either angioplasty with stent placement or bypass grafting in 10 of them (5.5%). A multivariate analysis demonstrated that age at treatment, hypertension, and hypercholesterolemia, as well as radiation dose to the coronary artery origins, were prognostic factors. In the group of patients with LTL measurements, hypertension and LTL were the only independent risk factors. Conclusions: The findings suggest that CCTA can identify asymptomatic individuals at risk of acute coronary artery disease who might require either preventive or curative measures. Conventional risk factors and the radiation dose to coronary artery origins were independent prognostic factors. The prognostic value of LTL needs further investigation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Integrated Fire Probabilistic Risk Assessment (PRA) Modeling in Support of Operational Efficiency (Final Report)

To improve the realism of Fire PRA associated with fire progression and damage modeling or manual suppression, previous research by the Socio-Technical Risk Analysis (SoTeRiA) Research Laboratory at the University of Illinois at Urbana-Champaign focused on the development of an Integrated PRA (I-PRA) methodological framework for fire risk analysis in NPPs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

IV and V Issues in Achieving High Reliability and Safety in Critical Control System Software

Risk analysis and integrated verification and validation are two important elements in a plan for ensuring the safety of critical software systems. We describe an approach we are currently developing for integrating risk analysis, and metrics analysis, and propose a fault predictor that would integrate the results of these activities. Practical difficulties associated with our approach are also discussed, as are limitations of the proposed predictor. We conclude with a discussion of what as been learned to date, and with suggestions for future work.

validation software reliability software risk asse↗