Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “root cause analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Monitoring Extreme-scale Lustre Toolkit

We discuss the design and ongoing development of the Monitoring Extreme-scale Lustre Toolkit (MELT), a unified Lustre performance monitoring and analysis infrastructure that provides continuous, low-overhead summary information on the health and performance of Lustre, as well as on-demand, in-depth problem diagnosis and root-cause analysis. The MELT infrastructure leverages a distributed overlay network to enable monitoring of center-wide Lustre filesystems where clients are located across many network domains. We preview interactive command-line utilities that help administrators and users to observe Lustre performance at various levels of resolution, from individual servers or clients to whole filesystems, including job-level reporting. Finally, we discuss our future plans for automating the root-cause analysis of common Lustre performance problems.

97 MATHEMATICS AND COMPUTING↗

Validation Progress and Plans for ENDF/B-VIII.1β1 at ORNL [Slides]

This presentation opens with a ORNL definition of ENDF/B-VIII.1β1. Following with keff results for CE calculations with VALID. Additionally provided are Preliminary Root Cause Analysis (RCA) results. This presentation then concludes with future plans for additional validation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Gnawts

High Performance Computing (HPC) systems generate millions of inter-related event log lines per day from thousands of computers, providing feedback on both successful and unsuccessful operations within the system. Thorough analysis of these logs is often required for root cause analysis of problems and tuning for greatest performance. This "app" for the "Gnawts" log analysis software (http://www.gnawts.com) facilitates faster and deeper insights into HPC system logs.

Stearley, Jon↗

Gnawts

High Performance Computing (HPC) systems generate millions of inter-related event log lines per day from thousands of computers, providing feedback on both successful and unsuccessful operations within the system. Thorough analysis of these logs is often required for root cause analysis of problems and tuning for greatest performance. This "app" for the "Gnawts" log analysis software (http://www.gnawts.com) facilitates faster and deeper insights into HPC system logs.

Jon Stearley, Charles Snider↗

Cyber Security Lecture Series: The CERT Insider Threat Guide [Slides]

Methodology: - Analysis of Analysis of >700 documented insider threat 700 documented insider threat cases; - Root cause Root cause analysis; - Mapping to NIST 800-53; - Detailed mapping to common organizational roles and responsibilities.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Conceptual Study on Air Ingress Mitigation for VHTRs

An air-ingress accident followed by a pipe break is considered as a critical event for a very high temperature gas-cooled reactor (VHTR) safety. Following helium depressurization, it is anticipated that unless countermeasures are taken, air will enter the core through the break leading to oxidation of the in-core graphite structure. Thus, without mitigation features, this accident might lead to severe exothermic chemical reactions of graphite and oxygen depending on the accident scenario and the design. Under extreme circumstances, a loss of core structural integrity may occur and lead to a detrimental situation for the VHTR safety. This paper discusses various air-ingress mitigation concepts applicable for the VHTRs. The study begins with identifying important factors (or phenomena) associated with the air-ingress accident using a root-cause analysis. By preventing main causes of the important events identified in the root-cause diagram, the basic air-ingress mitigation ideas were conceptually developed. Among them, two concepts were finally evaluated as effective candidates. One concept is to inject helium into the lower plenum which is a direct in-vessel helium injection. The other concept is to enclose the reactor with a non-pressure boundary consisting of an opening at the bottom, which is an ex-vessel enclosure boundary. Computational fluid dynamics (CFD) methods were used to validate these concepts. As a result, it was shown that both concepts can effectively mitigate the air-ingress process. In the first concept, the injected helium replaces the air in the core and the lower plenum upper part by buoyancy force because of its low density. It prevented air from moving into the reactor core showing great potential for mitigating graphite oxidation in the core. In the second concept, the air-ingress rate is controlled by molecular diffusion through the opening at the enclosure bottom after depressurization. Some modified reactor cavity design is expected to play this role in the VHTRs.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

STUDY ON AIR INGRESS MITIGATION METHODS IN THE VERY HIGH TEMPERATURE GAS COOLED REACTOR (VHTR)

An air-ingress accident followed by a pipe break is considered as a critical event for a very high temperature gas-cooled reactor (VHTR). Following helium depressurization, it is anticipated that unless countermeasures are taken, air will enter the core through the break leading to oxidation of the in-core graphite structure. Thus, without mitigation features, this accident might lead to severe exothermic chemical reactions of graphite and oxygen. Under extreme circumstances, a loss of core structural integrity may occur along with excessive release of radiological inventory. Idaho National Laboratory under the auspices of the U.S. Department of Energy is performing research and development (R&D) that focuses on key phenomena important during challenging scenarios that may occur in the VHTR. Phenomena Identification and Ranking Table (PIRT) studies to date have identified the air ingress event, following on the heels of a VHTR depressurization, as very important (Oh et al. 2006, Schultz et al. 2006). Consequently, the development of advanced air ingress-related models and verification and validation (V&V) requirements are part of the experimental validation plan. This paper discusses about various air-ingress mitigation concepts applicable for the VHTRs. The study begins with identifying important factors (or phenomena) associated with the air-ingress accident by using a root-cause analysis. By preventing main causes of the important events identified in the root-cause diagram, the basic air-ingress mitigation ideas can be conceptually derived. The main concepts include (1) preventing structural degradation of graphite supporters; (2) preventing local stress concentration in the supporter; (3) preventing graphite oxidation; (4) preventing air ingress; (5) preventing density gradient driven flow; (4) preventing fluid density gradient; (5) preventing fluid temperature gradient; (6) preventing high temperature. Based on the basic concepts listed above, various air-ingress mitigation methods are proposed in this study. Among them, the following two mitigation ideas are extensively investigated using computational fluid dynamic codes (CFD): (1) helium injection in the lower plenum, and (2) reactor enclosure opened at the bottom. The main idea of the helium injection method is to replace air in the core and the lower plenum upper part by buoyancy force. This method reduces graphite oxidation damage in the severe locations of the reactor inside. To validate this method, CFD simulations are addressed here. A simple 2-D CFD model is developed based on the GT-MHR 600MWt design. The simulation results showed that the helium replace the air flow into the core and significantly reduce the air concentration in the core and bottom reflector potentially protecting oxidation damage. According to the simulation results, even small helium flow was sufficient to remove air in the core, mitigating the air-ingress successfully. The idea of the reactor enclosure with an opening at the bottom changes overall air-ingress mechanism from natural convection to molecular diffusion. This method can be applied to the current system by some design modification of the reactor cavity. To validate this concept, this study also uses CFD simulations based on the simplified 2-D geometry. The simulation results showed that the enclosure open at the bottom can successfully mitigate air-ingress into the reactor even after on-set natural circulation occurs.

99 GENERAL AND MISCELLANEOUS↗

TH-B-BRC-00: How to Identify and Resolve Potential Clinical Errors Before They Impact Patients Treatment: Lessons Learned

Radiation treatment consists of a chain of events influenced by the quality of machine operation, beam data commissioning, machine calibration, patient specific data, simulation, treatment planning, imaging and treatment delivery. There is always a chance that the clinical medical physicist may make or fail to detect an error in one of the events that may impact on the patient’s treatment. In the clinical scenario, errors may be systematic and, without peer review, may have a low detectability because they are not part of routine QA procedures. During treatment, there might be errors on machine that needs attention. External reviews of some of the treatment delivery components by independent reviewers, like IROC, can detect errors, but may not be timely. The goal of this session is to help junior clinical physicists identify potential errors as well as the approach of quality assurance to perform a root cause analysis to find and eliminate an error and to continually monitor for errors. A compilation of potential errors will be presented by examples of the thought process required to spot the error and determine the root cause. Examples may include unusual machine operation, erratic electrometer reading, consistent lower electron output, variation in photon output, body parts inadvertently left in beam, unusual treatment plan, poor normalization, hot spots etc. Awareness of the possibility and detection of error in any link of the treatment process chain will help improve the safe and accurate delivery of radiation to patients. Four experts will discuss how to identify errors in four areas of clinical treatment. D. Followill, NIH grant CA 180803.

60 APPLIED LIFE SCIENCES↗

TH-B-BRC-01: How to Identify and Resolve Potential Clinical Errors

Radiation treatment consists of a chain of events influenced by the quality of machine operation, beam data commissioning, machine calibration, patient specific data, simulation, treatment planning, imaging and treatment delivery. There is always a chance that the clinical medical physicist may make or fail to detect an error in one of the events that may impact on the patient’s treatment. In the clinical scenario, errors may be systematic and, without peer review, may have a low detectability because they are not part of routine QA procedures. During treatment, there might be errors on machine that needs attention. External reviews of some of the treatment delivery components by independent reviewers, like IROC, can detect errors, but may not be timely. The goal of this session is to help junior clinical physicists identify potential errors as well as the approach of quality assurance to perform a root cause analysis to find and eliminate an error and to continually monitor for errors. A compilation of potential errors will be presented by examples of the thought process required to spot the error and determine the root cause. Examples may include unusual machine operation, erratic electrometer reading, consistent lower electron output, variation in photon output, body parts inadvertently left in beam, unusual treatment plan, poor normalization, hot spots etc. Awareness of the possibility and detection of error in any link of the treatment process chain will help improve the safe and accurate delivery of radiation to patients. Four experts will discuss how to identify errors in four areas of clinical treatment. D. Followill, NIH grant CA 180803.

60 APPLIED LIFE SCIENCES↗

TH-B-BRC-02: Troubleshooting Issues with Linear Accelerator

Radiation treatment consists of a chain of events influenced by the quality of machine operation, beam data commissioning, machine calibration, patient specific data, simulation, treatment planning, imaging and treatment delivery. There is always a chance that the clinical medical physicist may make or fail to detect an error in one of the events that may impact on the patient’s treatment. In the clinical scenario, errors may be systematic and, without peer review, may have a low detectability because they are not part of routine QA procedures. During treatment, there might be errors on machine that needs attention. External reviews of some of the treatment delivery components by independent reviewers, like IROC, can detect errors, but may not be timely. The goal of this session is to help junior clinical physicists identify potential errors as well as the approach of quality assurance to perform a root cause analysis to find and eliminate an error and to continually monitor for errors. A compilation of potential errors will be presented by examples of the thought process required to spot the error and determine the root cause. Examples may include unusual machine operation, erratic electrometer reading, consistent lower electron output, variation in photon output, body parts inadvertently left in beam, unusual treatment plan, poor normalization, hot spots etc. Awareness of the possibility and detection of error in any link of the treatment process chain will help improve the safe and accurate delivery of radiation to patients. Four experts will discuss how to identify errors in four areas of clinical treatment. D. Followill, NIH grant CA 180803.

60 APPLIED LIFE SCIENCES↗

TH-B-BRC-03: Measurement and Calibration Discrepancy: Advanced Warning Guidance

Radiation treatment consists of a chain of events influenced by the quality of machine operation, beam data commissioning, machine calibration, patient specific data, simulation, treatment planning, imaging and treatment delivery. There is always a chance that the clinical medical physicist may make or fail to detect an error in one of the events that may impact on the patient’s treatment. In the clinical scenario, errors may be systematic and, without peer review, may have a low detectability because they are not part of routine QA procedures. During treatment, there might be errors on machine that needs attention. External reviews of some of the treatment delivery components by independent reviewers, like IROC, can detect errors, but may not be timely. The goal of this session is to help junior clinical physicists identify potential errors as well as the approach of quality assurance to perform a root cause analysis to find and eliminate an error and to continually monitor for errors. A compilation of potential errors will be presented by examples of the thought process required to spot the error and determine the root cause. Examples may include unusual machine operation, erratic electrometer reading, consistent lower electron output, variation in photon output, body parts inadvertently left in beam, unusual treatment plan, poor normalization, hot spots etc. Awareness of the possibility and detection of error in any link of the treatment process chain will help improve the safe and accurate delivery of radiation to patients. Four experts will discuss how to identify errors in four areas of clinical treatment. D. Followill, NIH grant CA 180803.

60 APPLIED LIFE SCIENCES↗

System Deterioration Detection and Root Cause Learning on Time Series Graphs

System deterioration detection and root cause analysis is crucial for today's industrial society. However, the design and operation of mechanic system is getting more and more complex, which makes it hard at identifying deterioration with noisy data. Our research focus on solving such problem on time-evolving sensor graphs in a streaming setting. Given a sequence of graphs, the ability to identify 1) any gradual and stable structured change and 2) the root cause components is of importance for early warning and system diagnosis. Existing methods either raise too many false alerts on instant changes or are too sensitive to noise. To address these problems, we propose Robust Failure Detection and Diagnosis (RoFaD). RoFaD can capture failure propagation given a time series of graph. By optimizing a matrix based Taylor expansion, RoFaD can identify system deterioration in the presence of noise and immediate changes, and diagnose the root cause components. Experiments on both synthetic and real world datasets demonstrate that RoFaD is more effective than the popular baselines.

97 MATHEMATICS AND COMPUTING↗

Limited Characterization of Wind Turbine Adhesives [EPIKOTE Resin MGS BPR 135G3/EPIKURE Curing Agent MGS RIMH 134 (H134i) and MGS BP20/EPIKURE Curing Agent MGS BPH 20 (rework adhesive)] and Root Insert Exterior Surface.

The National Rotor Testbed (NRT) is a wind turbine blade research program in the Sandia National Laboratories (SNL) Wind Department that has developed a new blade design. Each blade includes bonded-in, threaded metal root inserts that enable the blades to be bolted onto the wind turbine hub. Prior to installing the flight blades on the turbine, root insert strength verification tests exhibited a subset of failures below the design load on one (NRT-02) of four blades. As part of a root cause analysis for the failures, this work analyzes "scraps" of the epoxy adhesive used to bond the metal inserts into the blade and uses surface topography and x-ray fluorescence (XRF) measurements to characterize the exterior surface of the root insert. Samples were taken from inserts that exhibited both high and low loads at failure, as well as some "control inserts" to monitor the state of the surface throughout the manufacturing process. Differences in the calorimetric response of the adhesive from the separate root inserts are apparent but none of them appear to relate to the pull load required to dislodge the inserts. Two takeaways of note include: In the way that the adhesive is processed, it does not reach full cure; and, Something occurred to sample#10 such that the fully-cured adhesive has a significantly lower T g .

17 WIND ENERGY↗

Failure Analysis on Multivariate Time-series Data given Uncertain Labels

Machine failure analysis and detection is critical to today’s industrial society. Given a number of failure events on multivariate temporal data, the ability to identify 1) the discriminative patterns prior to the events and 2) the most relevant features to the failure has practical use for early warning and root cause analysis. However, since these patterns are not necessarily adjacent to the onset of failure in time, faulty labels are often with uncertainty, which makes traditional supervised detection methods inapplicable. To address the label uncertainty and learn the complicated correlation in multivariate time series, we design Failure Analysis on Multivariate Time-series Data (MAMT) that jointly selects the most failure-relevant features and time-instances by a novel dynamic and directional label diffusion process. Extensive experiments demonstrate that MAMT is more effective while more efficient than popular baselines.

97 MATHEMATICS AND COMPUTING↗

TU-C-BRE-01: KEYNOTE PRESENTATION - Emerging Frontiers in IMRT QA

As IMRT treatment processes advance and mature, so must the quality assurance processes being used to validate their delivery. In some respects, treatment delivery advancements (e.g. VMAT) have out-paced QA advancements. The purpose of this session is to describe new processes that are being implemented to bring IMRT QA up-to-date with the treatment delivery advances. It would explore emerging IMRT QA paradigms, including requirements-based IMRT QA which necessitates definition of delivery errors (e.g. patient dose error, leaf positioning error) and development of processes to ensure reliable error detection. Engineeringbased QA approaches, including use of IMRT treatment delivery process trees, fault tree analysis and failure modes effects analysis would be described. Approaches to detect errors such as (1) during treatment delivery validation using exit fluence detectors (e.g. EPIDs); (2) analysis of treatment delivery via use of machine parameter log files; (3) dose recalculation using (3a) treatment planning system; (3b) record-and-verify; or (3c) entrance and exit fluence measurement parameters would be explained. The relative advantages and disadvantages of each method would be discussed. Schemes for error classification and root cause analysis would be described – steps which are essential for future error prevention. For each QA method, testing procedures and results would be presented indicating the types of errors that can be detected, those that cannot be detected, and the reliability of the error detection method (for example determined via ROC analysis). For speakers, we are seeking to engage non-commercially biased experts. Those listed below are a sub-sample of possible qualified individuals.

60 APPLIED LIFE SCIENCES↗

Fault localization in a microfabricated surface ion trap using diamond nitrogen-vacancy center magnetometry

Here, as quantum computing hardware becomes more complex with ongoing design innovations and growing capabilities, the quantum computing community needs increasingly powerful techniques for fabrication failure root-cause analysis. This is especially true for trapped-ion quantum computing. As trapped-ion quantum computing aims to scale to thousands of ions, the electrode numbers are growing to several hundred, with likely integrated photonic components also adding to the electrical and fabrication complexity, making faults even harder to locate. In this work, we used a high-resolution quantum magnetic imaging technique, based on nitrogen-vacancy centers in diamond, to investigate short-circuit faults in an ion trap chip. We imaged currents from these short-circuit faults to ground and compared them to intentionally created faults, finding that the root cause of the faults was failures in the on-chip trench capacitors. This work, where we exploited the performance advantages of a quantum magnetic sensing technique to troubleshoot a piece of quantum computing hardware, is a unique example of the evolving synergy between emerging quantum technologies to achieve capabilities that were previously inaccessible.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

What's in a Name? Developing a Standardized Taxonomy for HVAC System Faults

Faults occurring in heating, ventilation and air-conditioning (HVAC) systems have significantly negative impacts on building energy consumption, occupant comfort, and indoor air quality. In the past thirty years, extensive research has been conducted on fault detection and diagnostics (FDD) methods, and there are now dozens of commercially available FDD software tools. Growing adoption of FDD tools has the potential to generate a massive and useful data set on fault characteristics. However, the lack of a unifying taxonomy is a significant barrier to efficient analysis and evaluation of FDD outputs. Therefore, there is a strong need to develop a robust taxonomy which can better represent and interpret FDD output data. This paper documents the development of a unifying taxonomy for HVAC system faults in commercial buildings, with initial focus on air handling units, variable air volume terminal units, and roof top unit systems. The developed fault taxonomy employs both a physical hierarchy of HVAC equipment and a cause-effect relationship model as tools to better understand and support root cause analysis for HVAC faults. A variable air volume terminal unit is used as an example to demonstrate the application of the developed fault taxonomy. The taxonomy has short-term application in a major U.S. study on fault prevalence, and promises longer term benefits to FDD software developers and building operators by creating a foundation for improved approaches to identifying and resolving HVAC faults.

Chen, Yimin↗

Comparative Analysis of ML Techniques for Data-Driven Anomaly Detection, Classification and Localization in Distribution System

High penetration of Distributed Energy Resources (DERs), fundamental load behavior changes, controllable loads, and significant increase in Electrical Vehicles (EVs) lead to complex dynamic behavior of the electric distribution system. Increasing number of components also means more measurements, more data and more data anomalies. Detecting, classifying and localizing these anomalies are important for situational awareness, and at the same time, very challenging given increasing complexity of the system. Highly accurate and high-resolution analytical techniques are needed to support anomaly detection, classification and localization (AD-C-L) for monitoring, root cause analysis and decision making. This paper provides comprehensive review and analysis of the existing spatio-temporal AD-C-L techniques within the distribution system. Challenges for specific problems in AD-C- L have been also discussed in this paper. Existing AD-C- L techniques have been categorized and synthesized for specific merits and limitations of multiple Machine Learning (ML) methodologies using common developed metrics of performance. The comparative analysis is summarized and presented with the open research challenges and path forward for future research needs.

24 POWER TRANSMISSION AND DISTRIBUTION↗