Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “root cause analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Stack Trace Analysis Tool (STAT)

STAT is a light weight debugging tool that gathers and merges stack traces from all of the processes in a parallel application. STAT uses the MRNet tree based overlay network to broadcast commands from the tool front-end to the STAT daemons and for the front-end to gather the traces from the STAT daemons. As the traces propagate through the MRNet network tree, they are merged across all tasks to fonn a single call prefix tree. The call prefix tree can be examined to identify tuks with similar function call patterns and to delineate a small set of equivalence classes. A representative task from each of these classes can then be fed into a full feature debugger like TotalView for root cause analysis.

ECP↗

TH-E-19A-01: Quality and Safety in Radiation Therapy

Clinical radiotherapy data clearly demonstrate the link between the quality and safety of radiation treatments and the outcome for patients. The medical physicist plays an essential role in this process. To ensure the highest quality treatments, the medical physicist must understand and employ modern quality improvement techniques. This extends well beyond the duties traditionally associated with prescriptive QA measures. This session will review the current best practices for improving quality and safety in radiation therapy. General elements of quality management will be reviewed including: what makes a good quality management structure, the use of prospective risk analysis such as FMEA, and the use of incident learning. All of these practices are recommended in society-level documents and are incorporated into the new Practice Accreditation program developed by ASTRO. To be effective, however, these techniques must be practical in a resource-limited environment. This session will therefore focus on practical tools such as the newly-released radiation oncology incident learning system, RO-ILS, supported by AAPM and ASTRO. With these general constructs in mind, a case study will be presented of quality management in an SBRT service. An example FMEA risk assessment will be presented along with incident learning examples including root cause analysis. As the physicist's role as “quality officer” continues to evolve it will be essential to understand and employ the most effective techniques for quality improvement. This session will provide a concrete overview of the fundamentals in quality and safety. Learning Objectives: Recognize the essential elements of a good quality management system in radiotherapy. Understand the value of incident learning and the AAPM/ASTRO ROILS incident learning system. Appreciate failure mode and effects analysis as a risk assessment tool and its use in resource-limited environments. Understand the fundamental principles of good error proofing that extends beyond traditional prescriptive QA measures.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Deep Analysis Net with Causal Embedding for Coal-fired Power Plant Fault Detection and Diagnosis (DANCE4CFDD)

Fault detection and diagnosis is critical to power plant operation to ensure attaining high reliability while reducing operation cost. As more renewable power is introduced to the power grid, traditional fossil power plants take on the extra burden of excessive load cycling to compensate the generation variability from renewable power. Such load cycling will pose more reliability challenges to power plant operation. There are a number of challenges faced by today’s asset health management system in coal- fired (or gas) power plants: 1) high-dimensional nonlinear interaction among multiple time series measurements; 2) high measurement variance induced by operational conditions/modes; 3) variation among asset types and plant configurations; and 4) a small number of faulty events to learn from. To cope with these challenges, today’s fielded asset health management systems rely heavily on manual efforts from domain experts and hand-crafted features or rules based on domain knowledge. Despite its role in plant reliability, such a practice is costly and hinders its scalability and sustainability, particularly when a plant undergoes modifications. The objective of this project is to develop a novel end-to-end AI learning system that is trainable (i.e., the AI representation of a complex system behavior can be directly learned from properly labeled data) for accurate fault detection and root cause analysis. The ability to create a fault detection model directly from time series could alleviate the efforts associated with today’s asset management solution development. In the course of this project, we have achieved the following: Created an AI model development environment incorporating state-of-the-art neural network architectures for rapid model development and evaluation; Developed novel learning strategies for training of fault detection model; Developed special-purpose neural network architecture embedded with variable association graph aiming for better interpretability; Developed a learning strategy to leverage a small number of faulty events for enhanced fault detection capability; Conducted detailed experimental study based on public benchmark datasets and demonstrated the effectiveness of the proposed solution; and Validated the developed system with data from both a coal-fired plant boiler dynamic simulation model and real-world coal-fired power plant covering multiple asset and fault types. Overall, the project attained a technology readiness level of TRL 5 from TRL 2 at the beginning of the project.

20 FOSSIL-FUELED POWER PLANTS↗

Smart connected worker edge platform for smart manufacturing: Part 2—Implementation and on‐site deployment case study

Abstract In this paper, we describe specific deployments of the Smart Connected Worker (SCW) Edge Platform for Smart Manufacturing through implementation of four instructive real‐world use cases that illustrate the role of people in a Smart Manufacturing paradigm through which affordable, scalable, accessible, and portable (ASAP) information technology (IT) acquires and contextualizes data into information for transmission to operation technologies (OT). For case one, the platform captures the relationships between energy consumption and human workflows for improved energy productivity while workers interact with machines during semiconductor manufacturing. The platform utilizes human cognition to identify anomalous machine behavior for root cause analysis of system faults via neural network (NN) that recognize alarm postures of workers with cameras. For case two, a smart assembly line is demonstrated for state monitoring and fault detection. Machine learning (ML) models are used to recognize system states and identify fault scenarios with human intervention. For case three, the platform monitors human–machine interactions to classify manufacturing machine states for proper operations and energy productivity. Internal energy states of individual or collections of manufacturing equipment are determined via NN based algorithms that disaggregate signals associated with smart metering typically deployed at manufacturing facilities. These methods predict the real time energy profile of each machine from the total energy profile of a manufacturing site. For case four, a software defined sensor system built with scientific workflow engines is demonstrated for contextualizing data from laser surface refraction for characterization, and diagnostics in the processing of additively manufactured titanium alloy.

Donovan, Richard P.↗

Morphologically-Directed Raman Spectroscopy as an Analytical Method for Subvisible Particle Characterization in Therapeutic Protein Product Quality

Abstract Subvisible particles (SVPs) are a critical quality attribute of injectable therapeutic proteins (TPs) that needs to be controlled due to potential risks associated with drug product quality. The current compendial methods routinely used to analyze SVPs for lot release provide information on particle size and count. However, chemical identification of individual particles is also important to address root-cause analysis. Herein, we introduce Morphologically-Directed Raman Spectroscopy (MDRS) for SVP characterization of TPs. The following particles were used for method development: (1) polystyrene microspheres, a traditional standard used in industry; (2) photolithographic (SU-8); and (3) ethylene tetrafluoroethylene (ETFE) particles, candidate reference materials developed by NIST. In our study, MDRS rendered high-resolution images for the ETFE particles (> 90%) ranging from 19 to 100 μm in size, covering most of SVP range, and generated comparable morphology data to flow imaging microscopy. Our method was applied to characterize particles formed in stressed TPs and was able to chemically identify individual particles using Raman spectroscopy. MDRS was able to compare morphology and transparency properties of proteinaceous particles with reference materials. The data suggests MDRS may complement the current TPs SVP analysis system and product quality characterization workflow throughout development and commercial lifecycle.

Science & Technology - Other Topics↗

Advances in catalytic production processes of biomass-derived vinyl monomers

Plastic industries currently source the majority of monomers from crude oil substances. Although we have witnessed a significant interest of companies in the utilization of sustainable feedstock materials for bio-based compound synthesis in the past decade, the transition to photosynthetic or chemosynthetic plant-based production in a circular carbon economy is largely slow due to complex biomass processing, costs and related reaction factors. The upgrade of the separated platform chemicals with a deeper supporting understanding of processes, models and a root–cause analysis about the underlying distribution challenges of engineered transformation mechanisms, catalyzed conversion pathways and selectivity would be beneficial to advance applied scientific development, bio-refining and manufacturing output amount. This review provides a summary, assessment and perspective for three important polymer-forming vinyl molecules, i.e. acrylic acid, methacrylic acid and styrene. These provide a backbone to produce acrylates, polystyrene, resins, rubbers, protective surface coatings, adhesives, textiles and other obtained copolymers. A succinct analytical overview on the thermo-catalytic intermediate routes for property-wise drop-in alternatives is presented. Sugars, acrolein, allyl alcohol, ethylbenzene, glycerol, 3-hydroxypropionic acid, isobutene, itaconic acid and lactic acid are considered as the main starting reactants. Catalysts span mixed metal oxides, silicates, native or impregnated zeolite frameworks (HBEA, HZSM, and MFI) and hetero-poly acids as well as homogeneous base hydroxides or platinum group metals, supported on carbon, alumina and sulfates. Finally, the article concludes with a brief state sum-up of the results, topics and opportunities for systematic future research or scaling.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Coincident learning for beam-based rf station fault identification using phase information at the SLAC linac coherent light source

Anomalies in radio-frequency (rf) stations can result in unplanned downtime and performance degradation in linear accelerators such as SLAC’s Linac Coherent Light Source (LCLS). Detecting these anomalies is challenging due to the complexity of accelerator systems, high data volume, and scarcity of labeled fault data. Prior work identified faults using beam-based detection, combining rf amplitude and beam position monitor data. Due to the simplicity of the rf amplitude data, classical methods are sufficient to identify faults, but the recall is constrained by the low-frequency and asynchronous characteristics of the data. In this work, we leverage high-frequency, time-synchronous rf phase data to enhance anomaly detection in the LCLS accelerator. Due to the complexity of phase data, classical methods fail, and we instead train deep neural networks within the Coincident Anomaly Detection (CoAD) framework. We find that applying CoAD to phase data detects nearly 3 times as many anomalies as when applied to amplitude data, while achieving broader coverage across rf stations. Furthermore, the rich structure of phase data enables us to cluster anomalies into distinct physical categories. Through the integration of auxiliary system status bits, we link clusters to specific fault signatures, providing additional granularity for uncovering the root cause of faults. We also investigate interpretability via Shapley values, confirming that the learned models focus on the most informative regions of the data and providing insight for cases where the model makes mistakes. This work demonstrates that phase-based anomaly detection for rf stations improves both diagnostic coverage and root cause analysis in accelerator systems and that deep neural networks are essential for effective analysis.

Accelerator Physics (physics.acc-ph)↗

A Machine Learning Framework to Deconstruct the Primary Drivers for Electricity Market Price Events

As the electricity grid is moving towards a 100% Renewable Energy Source Bulk Power Grid, the overall operations of the power system operations and electricity markets are changing. The electricity markets are not only dispatching resources economically but also taking into account various controllable actions like renewable curtailment, transmission congestion mitigation, and energy storage optimization to make sure the grid is operating reliably. As a result, price formations in electricity markets have become quite complex. Traditional root cause analysis and statistical approaches are rendered inapplicable to analyze and infer the main drivers behind price formation in the modern grid and markets with variable renewable energy (VRE). In this paper, we propose a machine learning analysis framework to deconstruct some primary drivers for price formation in modern electricity markets with high renewable energy and the outcomes can be utilized for various critical aspects of market design, renewable dispatch and curtailment, operations, and cyber-security applications. The framework can be applied to any ISO or market data and in this paper it is applied to open-source publicly available datasets from California Independent System Operator (CAISO) and ISO New England.

machine learning (ML), electricity markets, Renewa↗

SU-D-201-07: A Survey of Radiation Oncology Residents’ Training and Preparedness to Lead Patient Safety Programs in Clinics

Purpose: Safety and quality has garnered increased attention in radiation oncology, and physicians and physicists are ideal leaders of clinical patient safety programs. However, it is not clear whether residency programs incorporate formal patient safety training and adequately equip residents to assume this leadership role. A national survey was conducted to evaluate medical and physics residents’ exposure to safety topics and their confidence with the skills required to lead clinical safety programs. Methods: Radiation oncology residents were identified in collaboration with ARRO and AAPM. The survey was released in February 2016 via email using REDCap. This included questions about exposure to safety topics, confidence leading safety programs, and interest in training opportunities (i.e. workshops). Residents rated their exposure, skills, and confidence on 4 or 5-point scales. Medical and physics residents responses were compared using chi-square tests. Results: Responses were collected from 56 of 248 (22%) physics and 139 of 690 (20%) medical residents. More than two thirds of all residents had no or only informal exposure to incident learning systems (ILS), root cause analysis (RCA), failure mode and effects analysis (FMEA), and the concept of human factors engineering (HFE). Likewise, 63% of residents had not heard of RO-ILS. Response distributions were similar, however more physics residents had formal exposure to FMEA (p<0.0001) and felt they were adequately trained to lead FMEAs in clinic (p<0.001) than medical residents. Only 36% of residents felt their patient safety training was adequate, and 58% felt more training would benefit their education. Conclusion: These results demonstrate that, despite increasing desire for patient safety training, medical and physics residents’ exposure to relevant concepts is low. Physics residents had more exposure to FMEA than medical residents, and were more confident in leading FMEA. This suggests that increasing resident exposure to specific topics may increase their confidence.

60 APPLIED LIFE SCIENCES↗

TU-FG-209-07: Medical Physics 1.0 Versus Medical Physics 2.0: A Case Study

Purpose: To illustrate how performance analytics can identify performance decrement in digital radiography systems. Methods: Subsequent to a radiologist’s image quality complaint, four different advanced methods contributed to root cause analysis. Our system was a GE Revolution XQi digital radiography unit. Initially, we reviewed weekly GE Quality Assurance Procedures (QAP) results in a database dating from 2001. Next, we evaluated objective image quality metrics of individual PA Chest radiographs acquired. These images were anonymized, securely transferred, and analyzed by the Duke University Clinical Imaging Physics Group with software previously described{sup 1} and validated{sup 2}. Third, we compared the exposure-dependent SNR{sup 2} (NEQ) of the unit with previously established confidence limits{sup 3}. Finally, we explored our service database to reveal events that might affect detector performance. Results: QAP reported a decrease in CNR reflected in a significant increase in lung noise(Ln), mediastinum noise(Mn), and subdiaphragm-lung contrast(Slc) with a significant decrease in lung grey level(Lgl) after detector replacement. Most change occurred during week 1, before the QAP indicated one-half the ultimate decrease in CNR. After detector recalibration, QAP CNR improved, but was not restored to previous levels. Lgl and Slc were no longer significantly different from before, however Ln and Mn remained significantly different. Exposure-dependent SNR2 show the detector to be operating within limits in October 2006 but subsequently became miscalibrated sometime before acquisition of the 2011–2014 data. Service records revealed catastrophic failure of the Image Detection Controller that contained the 2007 calibration. Traditional metrics did not indicate that the system was performing outside of normal limits. Conclusion: Performance analytics are powerful tools whose proper application could allow early intervention in degraded system performance. The image-quality metrics appear to be highly sensitive to system performance and are reported with every acquisition rather than at arbitrary intervals. Confidence intervals may require customization for individual systems or detectors.

60 APPLIED LIFE SCIENCES↗

Review—Thermal Safety Management in Li-Ion Batteries: Current Issues and Perspectives

Approaches for thermal management of lithium-ion (Li-ion) batteries do not always keep pace with advances in energy storage and power delivering capabilities. Root-cause analysis and empirical evidence indicate that thermal runaway (TR) in cells and cell-to-cell thermal propagation are due to adverse changes in physical and chemical characteristics internal to the cell. However, industry widely uses battery management systems (BMS) originally designed for aqueous-based batteries to manage Li-ion batteries. Even the "best" BMS that monitor both voltage and outside-surface temperature of each cell are not capable of preventing TR or TR propagation, because voltage and surface-mounted temperature sensors do not track fast-emerging adverse events inside a cell. Most BMS typically include a few thermistors mounted on select cells to monitor their surface temperature. Technology to track intra-cell changes that are TR precursors is becoming available. Simultaneously, the complex pathways resulting in cell-to-cell TR propagation are being successfully modelled and mapped. Innovative solutions to prevent TR and thermal propagation are being advanced. These include modern BMS for rapid monitoring the internal health of each individual cell and physical as well as chemical methods to reduce the deleterious effects of rapid cell-to-cell heat and material transport in case of TR.

25 ENERGY STORAGE↗

Resolving Turbine Degradation

The supercritical carbon dioxide (S-CO2) Brayton Cycle has gained significant attention in the last decade as an advanced power cycle capable of achieving high efficiency power conversion. Sandia National Laboratories, with support from the U.S. Department of Energy Office of Nuclear Energy (US DOE-NE), has been conducting research and development in order to deliver a technology that is ready for commercialization. Root cause analysis has been performed on the Recompression Loop at Sandia National Laboratories. It was found that particles throughout the loop are stainless steel, likely alloy 316 based upon the elemental composition. Deployment of a filter scheme is underway to both protect the turbomachinery and also for purposes of determining the specific cause for the particulate. Shake down tests of electric resistance (ER) as a potential in-situ monitoring scheme shows promise in high temperature systems. A modified instrument was purchased and held at 650°C for more than 1.5 months to date without issue. Quantitative measurements of this instrument will be benchmarked against witness samples in the future, but all qualitative trends to date are as to be expected. ER is a robust method for corrosion monitoring, but very slow at responding and can take several weeks under conditions to see obvious changes in behavior. Electrochemical noise was identified as an advanced technique that should be pursued for the ability to identify transients that would lead to poor material performance.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Immersion Cooling of Electronics in DoD Installations

A considerable amount of energy is consumed to cool electronic equipment in data centers. A method for substantially reducing the energy needed for this cooling was demonstrated. The method involves immersing electronic equipment in a non-conductive liquid that changes phase from a liquid to a gas. The liquid used was 3M Novec 649. Two-phase immersion cooling using this liquid is not viable at this time. The primary obstacles are IT equipment failures and costs. However, the demonstrated technology met the performance objectives for energy efficiency and greenhouse gas reduction. Before commercialization of this technology can occur, a root cause analysis of the failures should be completed, and the design changes proven.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Thermal-Hydraulics Modeling and Simulations of Hot Pool Using the SAS-CFD Coupled Code

The main goal of this activity is to test the dynamic coupling of the SAS4A/SASSYS-1 (SAS) and CFD models, using a recently patched version of the SAS code intended to address an undocumented limitation that hindered the Versatile Test Reactor (VTR) simulation efforts in FY21. As described in previous VTR calculation reports, the undocumented limitation in SAS v5.4 does not allow the user to activate the CFD coupling option during restart calculations. Since the analysts were unaware of this limitation, prior SAS-CFD simulation results for the protected station blackout (PSBO) transient were erroneous. Root-cause analysis was performed to determine the cause of this undocumented limitation in SAS v5.4, the SAS software was updated in a new patch, and the SAS-CFD simulations were repeated with this patched software. The results of the SAS-CFD simulations documented in this report show that the software patch does address the cited issue, and that the patched software indeed supports the activation of the CFD coupling model in restart calculations. The SAS development team will determine the schedule for implementing the patch in an official software release. This report documents updated SAS-CFD simulations of the PSBO transient response in the VTR. The hot pool is modeled with the CFD code STAR-CCM+, which is coupled at the flow boundaries to the SAS model of the primary heat transport system. SAS computes the mass flow rate and temperature at each core subassembly outlet, the thermal insulation cavity bypass, and the IHX inlet windows. CFD in turn computes the absolute pressure and temperature at each of these boundaries. The SAS code will ignore the temperature data at flow boundaries where flow is directed into the hot pool, i.e., at the core subassembly outlets unless flow reversal occurs. Similarly, CFD will ignore temperature data at boundaries where the flow is directed out of the hot pool, i.e., at the IHX inlets except under flow reversal. The focus of this work is to ensure that the SAS software patch addresses the undocumented limitation described in prior VTR calculation reports, rather than the accurate assessment of thermal stratification in the VTR during protected transients. This motivates the development of a new, simplified CFD model with a coarser mesh to accelerate the testing process. The updated model, and simplifying assumptions, are documented in this report. In future work, the thermal stratification assessment should be performed in more detail. The simplified CFD model can be improved by performing grid convergence studies sensitivity studies of turbulence parameters (e.g., Prandtl number, turbulence production and dissipation parameters) on temperature distributions and thermal stratification.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Weapon Systems Risk-Assessment Tool Review

To anticipate, and potentially mitigate, future problems in aging weapon systems, four unique riskassessment techniques were analyzed, including root-cause analysis tools, six-sigma problemsolving approaches, and lean six-sigma tools. Identifying the most efficient process, or tool, is crucial for successful application to current and future weapon systems, subsystems, and components. The following processes were reviewed: Fault Tree Analysis, Failure Modes and Effects Analysis, Bow-Tie Analysis, and Hazard and Operability Study. A systematic assessment was performed to determine the most desirable method, and included investigating qualitative versus quantitative characteristics, scope, process durations, advantages, and limitations. Presented results will outline the study findings and further illustrate a capacity to identify future issues and/or concerns, and ultimately, reduce risk.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Structural Characterization of Deployed Thermoplastic and Thermoset Composite Tidal Turbine Blades

The National Renewable Energy Laboratory worked with Verdant Power to manufacture, and characterize, novel thermoplastic composite blades on their Gen5d 5 m diameter turbines at the Roosevelt Island Tidal Energy (RITE) site in the East River in N.Y. to demonstrate a low-cost manufacturing process for marine energy structures. Verdant had designed, manufactured, and deployed epoxy thermoset composite blades on three Gen5d turbines in October 2020. At a maintenance cycle in May 2021, a Gen5d turbine equipped with the NREL thermoplastic blades was deployed and retrieved in October 2021. Modal, static and fatigue structural characterization was performed on both blade types before and after the deployment. The static and modal test results showed that the thermoplastic blades were slightly stiffer than the epoxy blades both dry and after the deployment. The epoxy blades had about 8% increase in strain at the applied load after the deployment, whereas the thermoplastic blade strains were not changed significantly. Ultimately the thermoplastic blade failed during fatigue testing due to a crack which is thought to have initiated between the internal foam and the laminate at the location of the internal instrumentation. The Verdant Power Gen5d epoxy blades did not have this internal instrumentation and did not have this failure, performing adequately through the operational period. A lack of design information and fatigue data for both the thermoplastic laminates and the adhesive used means that further work is needed to fully understand his failure and the root cause analysis is ongoing. This paper provides details on the thermoplastic blade manufacturing, materials, test methodology and results.

17 WIND ENERGY↗

Investigating Anomalies in Compute Clusters: An Unsupervised Learning Approach

As compute clusters continue to grow in scale and complexity, the frequency of detected anomalies in their operation significantly increases. Timely detection of anomalous events is vital to maintain system efficiency and availability. This study presents an attentionbased graph neural network (GNN) for detecting anomalies in clusters at the compute node level and for providing detailed root cause analysis. We show the effectiveness of attention-based GNNs to accurately detect and localize anomalies on real-world datasets.

Lu, Yiyang↗

Mitigating field emission in SSR2 cryomodules for PIP-II

The SSR2 cavities for PIP-II have consistently been affected by field emission since the first cold tests with the unity coupler. A comprehensive root cause analysis was conducted to investigate the origin of this issue and to identify the fabrication, processing, and handling factors that have the greatest impact on field emission onset. New techniques were developed and effectively implemented to achieve field emission-free SSR2 cavities. In addition, effort was dedicated both to relating the radiation level measured at the test stand with the expected levels in the LINAC tunnel and to understand the evolution of field emission through the assembly steps. The challenge of overcoming field emission also led to a reassessment of design choices, enhancing our understanding of their effects on cavity performance.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗