Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software defect analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Novel Solar Panel Defect Detection Hardware and Defect Analysis Software (CRADA Final Report)

The CRADA work involved 1) the development of a machine learning software architecture to automatically detect defects within Electroluminescence images of solar panels, and 2) demonstrations of the usefulness of UV Fluorescence (UVF) defect detection for a wide variety of defect types across many different solar panel technologies with different field or environmental chamber histories.

14 SOLAR ENERGY↗
DOE OSTI2025

Novel Solar Panel Defect Detection Hardware and Defect Analysis Software (CRADA Final Report)

The CRADA work involved 1) the development of a machine learning software architecture to automatically detect defects within Electroluminescence images of solar panels, and 2) demonstrations of the usefulness of UV Fluorescence (UVF) defect detection for a wide variety of defect types across many different solar panel technologies with different field or environmental chamber histories.

14 SOLAR ENERGY↗
DOE OSTI2024

Root Cause Correlation Analysis of Software Failures via Orthogonal Defect Classification and Natural Language Processing

Systems theoretic process analysis (STPA) is becoming an increasingly popular technique to assess how complex digital software systems can fail. Rather than defining failures by their observable failure events, which may be sparse especially for safety rated nuclear digital instrumentation and control systems (DI&C), failures are defined as postulated unsafe actions under specific contextual conditions. This permits a top-down analysis of system hazards and identifies whether imposed constraints and requirements can sufficiently address undesirable hazards. However, STPA is a qualitative approach at identifying inadequacies in the development process and cannot currently be used to quantify unsafe action likelihoods for probabilistic risk assessment. Therefore, in this work, we examine the root causes of software failure and explore whether a consistent correlation can be linked to specific unsafe action classes. We implement Lbl2Vec, an unsupervised document classification and retrieval algorithm, on a database of 4,096 software defect reports acquired from various open-source software systems. By analyzing sentence structure, embedded labels, and word vectors, we show that certain defect types positively correlate to specific unsafe action classes over others. The correlations developed can be used to estimate the failure probability of safety intended DI&C systems which provides a licensing basis for nuclear plant modernization efforts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Root Cause Correlation Analysis of Software Failures via Orthogonal Defect Classification and Natural Language Processing

Systems theoretic process analysis (STPA) is becoming an increasingly popular technique to assess how complex digital software systems can fail. Rather than defining failures by their observable failure events, which may be sparse especially for safety rated nuclear digital instrumentation and control systems (DI&C), failures are defined as postulated unsafe actions under specific contextual conditions. This permits a top-down analysis of system hazards and identifies whether imposed constraints and requirements can sufficiently address undesirable hazards. However, STPA is a qualitative approach at identifying inadequacies in the development process and cannot currently be used to quantify unsafe action likelihoods for probabilistic risk assessment. Therefore, in this work, we examine the root causes of software failure and explore whether a consistent correlation can be linked to specific unsafe action classes. We implement Lbl2Vec, an unsupervised document classification and retrieval algorithm, on a database of 4,096 software defect reports acquired from various open-source software systems. By analyzing sentence structure, embedded labels, and word vectors, we show that certain defect types positively correlate to specific unsafe action classes over others. The correlations developed can be used to estimate the failure probability of safety intended DI&C systems which provides a licensing basis for nuclear plant modernization efforts.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Application of Orthogonal Defect Classification for Software Reliability Analysis

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify software reliability (or unreliability) while still leveraging the strength of the existing methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Application of Orthogonal Defect Classification for Software Reliability Analysis

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify if the software is reliable (or unreliable) while still leveraging the strength of the existing methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

CDB-AP: An application for coincidence Doppler broadening spectroscopy analysis

Coincidence Doppler Broadening (CDB) Positron Annihilation Spectroscopy (PAS) is a material analysis technique that can be used to non-destructively measure characteristics of structural defects in samples. Analyzing and comparing large datasets obtained using this technique, however, can be complicated and time intensive. The Coincidence Doppler Broadening Analysis Program (CDB-AP) is a graphical user interface that facilitates rapid analysis of many data files while using transparent processes. It is already used in three laboratories at Idaho National Laboratory and can be used in laboratories worldwide.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Quantitative Risk Analysis of High Safety Significant Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants using IRADIC Technology

This report documents the activities performed by Idaho National Laboratory (INL) during fiscal year (FY) 2021 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, digital instrumentation and control (DI&C) Risk Assessment project. In FY-2019, the RISA Pathway initiated a project to develop a risk assessment strategy for delivering a strong technical basis to support effective, licensable, and secure DI&C technologies for digital upgrades/designs. An integrated risk assessment technology for the DI&C systems (IRADIC technology) was proposed for this strategy, which aims to (1) provide a best-estimate risk-informed capability to quantitatively and accurately estimate the safety margin obtained from plant modernization, especially for the High Safety Significant Safety-related (HSSSR) DI&C systems, (2) develop an advanced risk assessment technology to support transition from analog to DI&C technologies for nuclear industry, (3) assure the long-term safety and reliability of vital HSSSR DI&C systems, (4) reduce uncertainty in costs and support integration of DI&C systems in the plant. To achieve these technical goals and deal with the expensive licensing justifications from regulatory insights, the IRADIC technology is instructive for nuclear vendors and utilities to effectively lower the costs associated with digital compliance and speed industry advances by: (1) defining an integrated risk-informed analysis process for DI&C upgrade, including hazard analysis, reliability analysis, and consequence analysis, (2) applying systematic and risk-informed tools to address common cause failures (CCFs) and quantify responding failure probabilities for DI&C technologies, particularly software CCFs, (3) evaluating the impact of digital failures at the individual level, system level, and plant level, (4) providing insights and suggestions on designs to manage the risks; thus, to support the development, licensing, and deployment of advanced DI&C technologies on nuclear power plant (NPPs). In this report, an approach for performing software CCF analysis, given limited data, is developed and demonstrated using a case study of a highly redundant digital reactor trip system. Consequence analysis is also performed based on different accident scenarios. Results indicate that plant modernization including the improvement of HSSSR DI&C systems will make great benefits to plant safety by providing more safety margins to accident management. In addition, a novel approach is proposed in this report for the quantification of software hazards when sufficient operational and testing data available. The method incorporates software development quality as well as strong analysis techniques to identify and link software defects to potential failure modes. The approach includes both semantic and test-based analysis to detect failures that can exist in different stages of the software development life cycle. This method is applied to an advanced human system interface relevant to reactor trip safety developed from the APR 1400 design.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2016

Quantitative Analysis Guidance in Safety Software Validation

Quantitative analysis in software development has been a challenging topic over the years in safety software. While qualitative processes for vigorous safety software verification and validation (V and V) have been provided through standard such as IEEE 1012, quantitative analysis for V and V tasks such as correctness, completeness or accuracy evaluation have not been formally defined. In practice, there are quantitative analyses in terms of using software metrics. Many of these software metrics are useful in analyzing the test results. Some of them are used for providing guidance in code evaluation activities e.g. numbers of line of codes not exceeding certain limits, recursive calls are not allowed, etc. However, few can be used for providing quantitative analysis guidance for the V and V tasks such as completeness evaluation. AREVA Federal Services (AFS) has provided services for many nuclear projects in US. Through compliance with IEEE 1012, AFS V and V processes have provided vigorous qualitative processes ensuring quality level of the software products used in the project meeting the required nuclear software level. In addition, quantitative analysis is developed to provide structured validation framework ensuring 'zero defect' in the software products. This paper describes some aspects of the quantitative approaches using a sample safety application. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

XtalCAMP: a comprehensive program for the analysis and visualization of scanning Laue X-ray micro-/nanodiffraction data

XtalCAMP is a software package based on the MATLAB platform, which is suitable for, but not limited to, the analysis and visualization of scanning Laue X-ray micro-/nanodiffraction data. The main objective of the software is to provide complementary functionalities to the Laue indexing software packages used at several synchrotron beamlines. Here, the graphical user interfaces allow the easy analysis of characteristic microstructure features, including real-time intensity mapping for a quick examination of phase, grain and defect distribution, 2D color-coded mapping of microstructural properties from the output of other Laue indexing software, crystal orientation visualization, grain boundary characterization based on orientation/misorientation calculation, principal strain/stress analysis, and strain ellipsoid representation, as well as a series of additional toolkits. As an example, XtalCAMP is applied to the microstructural investigation of a solution-heat-treated Ni-based superalloy manufactured using a laser 3D-printing technique, and a deformed natural quartzite from Val Bregaglia in the Central Alps.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Failure Mechanism Traceability and Application in Human System Interface of Nuclear Power Plants using RESHA

In recent years, there has been considerable effort to modernize existing and new nuclear power plants with digital instrumentation and control systems (DI&C). However, there has also been considerable concern both by industry and regulatory bodies for the risk and consequence analysis of these systems. Of particular concern are digital common cause failures (CCFs) specifically related to software defects. These “misbehaviors” by the software can occur in both the control and monitoring of a system. While many new methods have been proposed to identify potential software failure modes, such as Systems-theoretic Process Analysis (STPA), Hazard and Consequence Analysis for Digital Systems (HAZCADS), etc., these methods are focused primarily on the control action pathway of a system. In contrast, the information feedback pathway lacks unsafe control actions (UCAs), which are typically related to software basic events; thus, assessment of software basic events in such systems is unclear. In this work, we present the idea of intermediate processors and unsafe information flow (UIF) to help safety analysts trace failure mechanisms in the feedback pathway and how they can be integrated into a fault tree for improved assessment capability. The concepts presented are demonstrated in two comprehensive case studies, a smart sensor integrated platform for unmanned autonomous vehicles and another on a representative advanced human system interface (HSI) for safety critical plant monitoring. The qualitative software basic events are identified, and a fault tree analysis is conducted based on a modified Redundancy-guided Systems-theoretic Hazard Analysis (RESHA) methodology. The case studies demonstrate the use of UIF and intermediate processors in the fault tree to improve traceability of software failures in highly complex digital instrumentation feedback. The improved method can also clarify fault tree construction when multiple component dependencies are present in the system.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Failure Mechanism Traceability and Application in Human System Interface of Nuclear Power Plants using RESHA

In recent years, there has been considerable effort to modernize existing and new nuclear power plants with digital instrumentation and control systems (DI&C). However, there has also been considerable concern both by industry and regulatory bodies for the risk and consequence analysis of these systems. Of particular concern are digital common cause failures (CCFs) specifically related to software defects. These “misbehaviors” by the software can occur in both the control and monitoring of a system. While many new methods have been proposed to identify potential software failure modes, such as Systems-theoretic Process Analysis (STPA), Hazard and Consequence Analysis for Digital Systems (HAZCADS), etc., these methods are focused primarily on the control action pathway of a system. In contrast, the information feedback pathway lacks unsafe control actions (UCAs), which are typically related to software basic events; thus, assessment of software basic events in such systems is unclear. In this work, we present the idea of intermediate processors and unsafe information flow (UIF) to help safety analysts trace failure mechanisms in the feedback pathway and how they can be integrated into a fault tree for improved assessment capability. The concepts presented are demonstrated in two comprehensive case studies, a smart sensor integrated platform for unmanned autonomous vehicles and another on a representative advanced human system interface (HSI) for safety critical plant monitoring. The qualitative software basic events are identified, and a fault tree analysis is conducted based on a modified Redundancy-guided Systems-theoretic Hazard Analysis (RESHA) methodology. The case studies demonstrate the use of UIF and intermediate processors in the fault tree to improve traceability of software failures in highly complex digital instrumentation feedback. The improved method can also clarify fault tree construction when multiple component dependencies are present in the system.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Combining In-situ Diagnostics and Data Analytics for Discovery of Process-Structure-Property Relationships in AM parts – A Step Toward Digital Twins

In-situ additive manufacturing (AM) diagnostic tools (e.g., optical/infrared imaging, acoustic, etc.) already exist to correlate process anomalies to printed part defects. This current work aimed to augment existing capabilities by: 1) Incorporating in-situ imaging w/ machine learning (ML) image processing software (ORNL- developed "Peregrine") for AM process anomaly detection 2) Synchronizing multiple in-situ sensors for simultaneous analysis of AM build events 3) Correlating in-situ AM process data, generated part defects and part mechanical properties The key R&D question investigated was to determine if these new combined hardware/software tools could be used to successfully quantify defect distributions for parts build via SNL laser powder bed fusion (LPBF) machines, aiming to better understand data-driven process-structure-property- performance relationships. High resolution optical cameras and acoustic microphones were successfully integrated in two LPBF machines and linked to the Peregrine ML software. The software was successfully calibrated on both machines and used to image hundreds of layers of multiple builds to train the ML software in identifying printed part vs powder. The software's validation accuracy to identify this aspect increased from 56% to 98.8% over three builds. Lighting conditions inside the chamber were found to significantly impact ML algorithm predictions from in-situ sensors, so these were tailored to each machine's internal framework. Finally, 3D part reconstructions were successfully generated for a build from the compressed stack of layer-wise images. Resolution differences nearest and furthest from the optical camera were discussed. Future work aims to improve optical resolution, increase process anomalies identified, and integrate more sensor modalities.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Picometer-Precision Atomic Position Tracking through Electron Microscopy

The modern aberration-corrected scanning electron microscopes have successfully achieved direct visualization of atomic columns with sub-angstrom resolution. With this significant progress, advanced image quantification and analysis is still at its early stages. In this work, we present the complete pathway for the metrology of atomic resolution STEM images. This includes: 1) tips for acquiring high-quality STEM images; 2) denoising and drift-correction for enhancing measurement accuracy; 3) obtaining initial atom positions; 4) indexing the atoms based on unit cell vectors; 4) quantifying the atom column positions with either 2D-gaussian single peak fitting or 5) multi-peak fitting routines for slightly overlapping atomic columns; 6) quantification of lattice distortion/strain within the crystal structures or at the defects/interfaces where the lattice periodicity is disrupted, and 7) some common methods to visualize and present the analysis. Furthermore, a simple self-developed free MATLAB app (EASY-STEM) with a graphical user interface (GUI) will be introduced that can help with the analysis of STEM images without the need for writing dedicated analysis code or software. The advanced data analysis methods presented here can be applied for the local quantification of defect relaxations, local structural distortions, local phase transformations, and non-centrosymmetry in a wide range of materials.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Simplified inelastic constitutive models for ASME Section III, Division 5 design by inelastic analysis

This report describes the development of simplified, universal constitutive model that captures the high temperature monotonic and cyclic behavior of a range of commonly-used high temperature materials. The goal of the work is to provide a simple, universal constitutive model to replace the current bespoke models for Grade 91, 316H, and Alloy 617 included in Nonmandatory Appendix HBB-Z of the ASME Boiler & Pressure Vessel Code, and to extend this model to cover Alloy 800H. We initiated this work in response to feedback from reactor vendors and other Code users requesting simplified models, compared to the current models, that are easier to implement and use in commercial finite element analysis software. This report describes the completion of this effort by developing a model to correct the defects in standard model forms presently used for high temperature material modeling, described in past work, developing and implementing new numerical methods to train this model against test data, and then actually training the model for the four materials. The report provides a complete mathematical description of the model along with the tabulated material coefficients for the four materials. The final step will be to formulate an ASME Code change to introduce the new models into the Code.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Methodology for Thermodynamic Analysis Coupled with Computational Fluid Dynamics Modeling for Casting a Novel Aluminum–Cerium Alloy

In this paper, we present the results of computational fluid dynamics (CFD) analysis to assess castability, porosity, molten metal fluidity and other technological properties of a new Al-Ce alloy. A thermodynamic analysis of a new Al-Ce alloy is done to obtain the physical properties as a function of temperature across both solid and liquid phases. These properties are then used to build the CFD of model the full casting process from initial pouring through to final solidification of the part, here an example of a heavy duty mor mount is used. While several excellent commercial CFD codes exists this process shows that CFD can be used to assess the capability of the alloy to properly fill the mold, as well as give predictions where scattered porosity or large-scale defects may occur in the casting. Further, unlike the commercially available software (e.g., ProCAST, SOLIDCast , MAGMASOFT®) the complex 3D-analysis of the stress / strain fields in cast parts is not performed at this time. However, the availability of free software for assessing the required thermodynamic / thermo-physical properties of new alloys (OpenCALPHAD) and CFD codes such as OpenFOAM® makes the developed option attractive and economical, especially for the analysis of new Al-Ce alloys, for which the available data does not exist.

36 MATERIALS SCIENCE↗
DOE OSTI2016

Transient terahertz photoconductivity measurements of minority-carrier lifetime in tin sulfide thin films: Advanced metrology for an early stage photovoltaic material

Materials research with a focus on enhancing the minority-carrier lifetime of the light-absorbing semiconductor is crucial to advancing solar energy technology for both early stage and mature material platforms alike. Tin sulfide (SnS) is an absorber material with several clear advantages for manufacturing and deployment, but the record power conversion efficiency remains below 5%. We report measurements of bulk and interface minority-carrier recombination rates in SnS thin films using optical-pump, terahertz-probe transient photoconductivity (TPC) measurements. Post-growth thermal annealing in H 2 S gas increases the minority-carrier lifetime, and oxidation of the surface reduces the surface recombination velocity. However, the minority-carrier lifetime remains below 100 ps for all tested combinations of growth technique and post-growth processing. Vast improvement in SnS solar cell performance will hinge on finding and mitigating as-yet-unknown recombination-active defects. We describe in detail our methodology for TPC experiments, and we share our data analysis routines in the form freely available software.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗