Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “defects metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Source Lines Counter (SLiC) Version 4.0

Source Lines Counter (SLiC) is a software utility designed to measure software source code size using logical source statements and other common measures for 22 of the programming languages commonly used at NASA and the aerospace industry. Such metrics can be used in a wide variety of applications, from parametric cost estimation to software defect analysis. SLiC has a variety of unique features such as automatic code search, automatic file detection, hierarchical directory totals, and spreadsheet-compatible output. SLiC was written for extensibility; new programming language support can be added with minimal effort in a short amount of time. SLiC runs on a variety of platforms including UNIX, Windows, and Mac OSX. Its straightforward command-line interface allows for customization and incorporation into the software build process for tracking development metrics. T

Monson, Erik W.↗

JPL/NASA/IEEE Test Effectiveness Workshop

(none given)From OBJECTIVES: Specific objectives of the working group are to support the innovation, development, evaluation and implementation of test methods, metrics and tools based on failure engineering/physics and/or root cause evaluations. Data sources systems and tools shall be developed and implemented that: 1) provide improved preventions, controls, analyses and tests (PACT) & field failure data collection, 2) facilities data analysis, archiving, retrieval, failure physics and/or root cause evaluations and 3) enable new and existing technology suitability evaluations to be performed.

effectiveness concurrent engineering metrics test ↗

Software Simulates Sight: Flat Panel Mura Detection

In the increasingly sophisticated world of high-definition flat screen monitors and television screens, image clarity and the elimination of distortion are paramount concerns. As the devices that reproduce images become more and more sophisticated, so do the technologies that verify their accuracy. By simulating the manner in which a human eye perceives and interprets a visual stimulus, NASA scientists have found ways to automatically and accurately test new monitors and displays. The Spatial Standard Observer (SSO) software metric, developed by Dr. Andrew B. Watson at Ames Research Center, measures visibility and defects in screens, displays, and interfaces. In the design of such a software tool, a central challenge is determining which aspects of visual function to include while accuracy and generality are important, relative simplicity of the software module is also a key virtue. Based on data collected in ModelFest, a large cooperative multi-lab project hosted by the Optical Society of America, the SSO simulates a simplified model of human spatial vision, operating on a pair of images that are viewed at a specific viewing distance with pixels having a known relation to luminance. The SSO measures the visibility of foveal spatial patterns, or the discriminability of two patterns, by incorporating only a few essential components of vision. These components include local contrast transformation, a contrast sensitivity function, local masking, and local pooling. By this construction, the SSO provides output in units of "just noticeable differences" (JND) a unit of measure based on the assumed smallest difference of sensory input detectable by a human being. Herein is the truly amazing ability of the SSO, while conventional methods can manipulate images, the SSO models human perception. This set of equations actually defines a mathematical way of working with an image that accurately reflects the way in which the human eye and mind behold a stimulus. The SSO is intended for a wide variety of applications, such as evaluating vision from unmanned aerial vehicles, measuring visibility of damage to aircraft and to the space shuttles, predicting outcomes of corrective laser eye surgery, inspecting displays during the manufacturing process, estimating the quality of compressed digital video, evaluating legibility of text, and predicting discriminability of icons or symbols in a graphical user interface.

Source record↗

Assessment of Segmentation-Induced Deviations of Porosity Metrics in Powder Bed Fusion Additively Manufactured Components

Post processing X-ray computational tomography (CT) inspection data for additively manufactured (AM) components can induce deviations in defect quantification, affecting subsequent fatigue and failure predictions. To assess the influence and potential impact of segmentation-induced measurement deviations, this paper applies several segmentation techniques to X-ray CT data for powder bed fusion Ti-6Al-4V specimens exhibiting porosity conditions. X-ray CT reconstructions were segmented with varying techniques including Otsu’s thresholding, random forest, k-nearest neighbors, and the multilayer perceptron. Metrics such as pore size and global porosity were compared for internal validity. Then, top-down X-ray CT measurements of surface-breaking porosity were compared to optical profilometry for cross-validation.

Data fusion↗

Explainable artificial intelligence relates perovskite luminescence images to current-voltage metrics

As the demand for low-cost, high-efficiency solar energy technologies grows, metal halide perovskite (MHP) solar cells have emerged as a promising candidate for next-generation photovoltaics due to their high power conversion efficiencies. However, their poor durability and issues with manufacturing consistency remain significant barriers to commercialization. In this work, we develop deep learning models to support materials characterization and provide insight into features and processes influencing performance. The models are trained using transfer learning of a pretrained model to predict relevant current-voltage (IV) metrics based on different combinations of input electroluminescence (EL) and photoluminescence (PL) images of MHP devices. We examine which image types are most informative in accurately predicting different IV metrics. Additionally, we use explainable artificial intelligence (XAI) techniques to provide insights into specific spatial features in the devices that drive differences in performance. We find that stabilized luminescence images (e.g. those collected after biasing the devices for at least 1 min) are better for predicting metrics of open-circuit voltage (by PL) and short-circuit current (by PL with EL), but that predicting fill factor and overall power output may use the time-evolution of EL images. Based on attribution masks generated by integrated gradients for each device performance metric, we further suggest different loss mechanisms associated with categories of large and small spatial defects. Overall, this case study highlights the potential applicability of XAI methodology for streamlining MHP device analysis and accelerating detailed understanding of the relationships between spatial defects and impacts on performance.

14 SOLAR ENERGY↗

Design for Inspection: A Formalized Approach to Evaluating the Inspectability of Aerospace Structures Early in the Design Process

NDE engineers are often confronted with structural design choices that present challenges to meeting inspection requirements. These challenges at best increase the resources needed to design an inspection solution and, at worst, require resource intensive redesign of the structure. If the inspectability of structure can be determined early in the design cycle, these challenging inspection scenarios can be avoided. Therefore, there exists a need for a resource friendly formalized approach to gauge the inspectability of a structure. This paper proposes the use of a novel inspectability metric to meet this need. The inspectability metric is a standardized, automation friendly procedure that uses simulations to determine inspectability. It provides a suite of simulation tests to interrogate the ability to find defects and the sensitivity to variability. The testing rubric is designed to maximize the coverage of the parameter space while minimizing the number of simulations needed. In this preliminary study, we will demonstrate how the inspectability metric is able to determine the inspectability of a structure as a function of changes in the structure’s design.

Peter Juarez↗

Controlling Oxidation of Nb in Oxygen Abundant Environments

Modern particle accelerators depend on Superconducting Radio Frequency (SRF) cavities made from high-purity niobium (Nb) to achieve optimal performance, including high quality factors and strong accelerating gradients. However, when exposed to air, niobium naturally forms a complex oxide layer that can introduce surface imperfections and carbon contamination. This work examines an alternative oxidation strategy under oxygen-rich conditions to better regulate the oxide formation process. The ultimate objective is to improve surface uniformity and cleanliness, thereby reducing defect density and enhancing performance. We used Confocal Microscopy, Scanning Electron Microscopy (SEM), and X-Ray Photoelectron Spectroscopy (XPS) to analyze surface changes. We used standard metrics, like Arithmetic Average Roughness (Ra) and Root Mean Square (Rq). Three oxidation methods were applied: short, extended, and a repeated HF and H₂O₂ oxidation process. Preliminary results show promising reductions in carbon contamination and surface defects.

Romero, Juan [Fermilab]↗

A Novel Additive Manufacturing Process Metric for Predicting Spatter-related Porosity in Laser Powder Bed Fusion

Components fabricated using the powder bed fusion laser beam metallic (PBF) additive manufacturing (AM) process comprise a multitude of sequential weld passes. Porosity defects resulting from weld pass inconsistencies are a concern for PBF materials and have a strong adverse effect on the mechanical properties. In an effort to understand and avoid spatter induced porosity, this work aims to provide a novel computational technique that can be used to quantify and predict the sequence-sensitive impact of spatter upon the PBF process stability and consequential porosity in as-printed material. A novel spatter impact AM model-based process metric (AM-PM) is introduced to model and quantify the impact that spatter has on the PBF process. The occurrence of spatter induced porosity is studied using thermal rise, lack of fusion, and spatter impact AM-PMs synchronized with porosity measured by high-resolution X-ray computed tomography. Six cylindrical specimens were designed to compare the AM-PM correlations with porosity across two different laser powers and three hatch scanning strategies. A point field based computational approach is shown to be effective for testing the influence of the different AM-PMs and interrogating the physical process conditions underlying the porosity formation. Further, characterization using optical metallography and scanning electron microscopy indicated that both keyhole and lack of fusion porosity correlated with the spatter impact AM-PM, which can be exploited to predict and control spatter related porosity by the hatch strategy. Efforts to predict porosity composition within PBF material should incorporate the PBF process disturbances that can result from spatter. The spatter impact AM-PM can be readily incorporated into the development of defect prediction models at the part scale.

Additive Manufacturing↗

Full Life-Cycle Defect Management Assessment: Initial Inspection Data Collection Results and Research Questions for Further Study

It is often the case in software projects that when schedule and budget resources are limited, the Verification and Validation (V&V) activities suffer. Fewer V&V activities can be afforded and moreover, short-term challenges can result in V&V activities being scaled back or dropped altogether. As a result, too often the default solution is to save activities for improving software quality until too late in the life-cycle, relying on late-term code inspections followed by thorough testing activities to reduce defect counts to acceptable levels. As many project managers realize, however, this is a resource-intensive way of achieving the required quality for software. The Full Life-cycle Defect Management Assessment Initiative, funded by NASA s Office of Safety and Mission Assurance under the Software Assurance Research Program, aims to address these problems by: Improving the effectiveness of early life-cycle V&V activities to make their benefits more attractive to team leads. Specifically, we focus on software inspection, a proven method that can be applied to any software work product, long before executable code has been developed; Better communicating this effectiveness to software development teams, along with suggestions for parameters to improve in the future to increase effectiveness; Analyzing the impact of early life-cycle V&V on the effectiveness and cost required for late life-cycle V&V activities, such as testing, in order to make the tradeoffs more apparent. This white paper reports on an initial milestone in this work, the development of a preliminary model of inspection effectiveness across multiple NASA Centers. This model contributes toward reaching our project goals by: Allowing an examination of inspection parameters, across different types of projects and different work products, for an analysis of factors that impact defect detection effectiveness. Allowing a comparison of this NASA-specific model to existing recommendations in the literature regarding how to plan effective inspections. Forming a baseline model which can be extended to incorporate factors describing: the numbers and types of defects that are missed by inspections; how such defects flow downstream through software development phases; how effectively they can be caught by testing activities in the late stages of development. The model has been implemented in a prototype web-enabled decision-support tool which allows developers to enter their inspection data and receive feedback based on a comparison against the model. The tool also allows users to access reusable materials (such as checklists) from projects included in the baseline. Both the tool itself and the model underlying it will continue to be extended throughout the remainder of this initiative. As results of analyzing inspection effectiveness for defect containment are determined, they can be shared via the tool and also via updates to existing training courses on metrics and software inspections. Moreover, the tool will help satisfy key CMMI requirements for the NASA Centers, as it will enable NASA to take a global view across peer review results for various types of projects to identify systemic problems. This analysis can result in continuous improvements to the approach to verification.

Shull, Forrest↗

Shuttle Wing Leading Edge Root Cause NDE Team Findings and Implementation of Quantitative Flash Infrared Thermography

Comparison metrics can be established to reliably and repeatedly establish the health of the joggle region of the Orbiter Wing Leading Edge reinforced carbon carbon (RCC) panels. Using these metrics can greatly reduced the man hours needed to perform, wing leading edge scanning for service induced damage. These time savings have allowed for more thorough inspections to be preformed in the necessary areas with out affecting orbiter flow schedule. Using specialized local inspections allows for a larger margin of safety by allowing for more complete characterizations of panel defects. The presence of the t-seal during thermographic inspection can have adverse masking affects on ability properly characterize defects that exist in the joggle region of the RCC panels. This masking affect dictates the final specialized inspection should be preformed with the t-seal removed. Removal of the t-seal and use of the higher magnification optics has lead to the most effective and repeatable inspection method for characterizing and tracking defects in the wing leading edge. Through this study some inadequacies in the main health monitoring system for the orbiter wing leading edge have been identified and corrected. The use of metrics and local specialized inspection have lead to a greatly increased reliability and repeatable inspection of the shuttle wing leading edge.

Burke, Eric R.↗

Correlations of Additive Manufacturing Model-Based Process Metrics With Spatter-Induced Porosity in the Powder Bed Fusion-Laser Beam/Metallic Process

Components fabricated using the powder bed fusion laser beam metallic (PBF-LB/M) additive manufacturing (AM) process comprise a multitude of sequential weld passes. Qualifying materials for components in critical applications requires a thorough understanding of pertinent processing-microstructure-property relationships. Porosity defects have a strong adverse effect on the mechanical properties of a material. The morphology of porosity defects created by lack of fusion in PBF-LB/M often exhibit high aspect ratios that can act as stress concentrators and become crack initiation sites. The occurrence of spatter induced porosity is studied using synchronized AM model-based process metrics and porosity measured by high-resolution X-ray computed tomography. A novel AM process metric is introduced to quantify the relative exposure to spatter ejecta impacts and incorporation throughout the sequence of the PBF-LB/M process. Further characterization using optical metallography and scanning electron microscopy indicated that both keyhole and lack of fusion porosity correlated statistically with the spatter ejecta impact field of the PBF-LB/M process. Both keyhole and lack of fusion porosity can be predicted by the spatter exposure process metric, which can be exploited to control the fusion sequence.

Additive Manufacturing↗

Metric isometries, holography, and continuous symmetry operators

In the AdS/CFT correspondence, a topological symmetry operator of the boundary conformal field theory (CFT) is dual to a dynamical brane in the gravitational bulk. Said differently, this predicts a dynamical brane for every global symmetry of the boundary CFT. We analyze this correspondence for continuous symmetries which arise from a consistent truncation of isometries on the “internal” factor 𝑋 of AdS × 𝑋. In the extra-dimensional geometry, these branes are associated with various metric singularities and do not arise from wrapped D-branes. Boosts relate configurations interpreted as topological symmetry operators and heavy defects in the CFT. From the perspective of the AdS factor, with gravity and bulk gauge fields, these are codimension-2 Gukov-Witten-like vortex configurations which are the gravity duals of 0-form symmetry operators. These effective branes come with an asymptotic tension and size which is also fully fixed by bulk dynamics. We use this higher-dimensional perspective to determine properties of the worldvolume theory for these branes. We also discuss how these considerations generalize to more general quantum field theories engineered via string theory which need not possess a semiclassical gravity dual.

anomalies↗

Correlations Between Porosity, Spatter, and Process Metrics for Powder Bed Fusion Laser Beam Metallic Additive Manufacturing

Components fabricated using the powder bed fusion laser beam metallic (PBF-LB/M)additive manufacturing process are the result of a multitude of weld passes conducted sequentially. Qualifying components for aerospace applications requires a thorough understanding of the process-structure-properties relationships. Porosity defects are known to have a strong adverse effect on the mechanical properties of a component. In particular, porosity defects created by lack of fusion have high aspect ratio morphologies leading to stress concentrations that become crack initiation sites. In the present work, the occurrence of spatter induced lack of fusion porosity was studied using synchronized in-situ process monitoring, additive manufacturing model-based process metrics, and high-resolution X-ray computed tomography. The results show that lack of fusion porosity is statistically correlated with unremoved welding spatter ejecta of the PBF-LB/M process and process metrics related to the hatching strategy.

Qualification↗

Integration of Design Data Into Automated Fiber Placement Process Planning Metrics

With the ever-expanding aviation industry, a need is arising for more rapid production of composite aircraft to meet increasing demand. State-of-the-art aircraft such as the Boeing 787showcase 50% composite material usage by weight, highlighting this emerging industry-wide adoption of the material system. Currently, many of the large structures associated with these aircraft are manufactured additively via Automated Fiber Placement (AFP). The AFP process shows great potential for efficient manufacturing, however unavoidable defects still occur because of tool surface geometry, placement errors, or poor process planning, resulting in decreased quality and throughput. Due to such effects, it is critical to incorporate design for manufacturing (DFM) principles to achieve the optimal manufacturing plan and resulting structure. This work will develop a methodology for incorporating design information into process planning metrics in an automated fashion to achieve an optimal set of process inputs.The analysis incorporates HyperX, Computer Aided Process Planning (CAPP) and Vericut Composite Programming (VCP). Safety margins from HyperX are imported into CAPP where AFP defects are mapped to the values. The resulting margins are then incorporated into the CAPP manufacturability algorithms, creating a design informed process planning analysis

Automated Fiber Placement↗

Toward Intelligent Software Defect Detection

Source code level software defect detection has gone from state of the art to a software engineering best practice. Automated code analysis tools streamline many of the aspects of formal code inspections but have the drawback of being difficult to construct and either prone to false positives or severely limited in the set of defects that can be detected. Machine learning technology provides the promise of learning software defects by example, easing construction of detectors and broadening the range of defects that can be found. Pinpointing software defects with the same level of granularity as prominent source code analysis tools distinguishes this research from past efforts, which focused on analyzing software engineering metrics data with granularity limited to that of a particular function rather than a line of code.

Benson, Markland J.↗

Spectro-Microscopic Analysis of Soot Particle Composition and Source Attribution

Ambient soot particles significantly impact Earth’s radiative balance, human health, and atmospheric visibility. Their microstructural properties depend on formation and aging mechanisms, which vary by emission source and atmospheric processes. Hence, accurately identifying sources of soot enhances our understanding of their physicochemical properties and atmospheric implications. This study used a multi-modal approach to characterize and attribute sources of submicron soot particles collected in Israel during new particle formation events, biomass burning episodes, and background atmospheric conditions. Synchrotron-based X-ray microscopy was used to map soot (elemental carbon), organic carbon, and inorganic species. Implemented atomic force microscopy showed highly diverse phase states, with soot consistently exhibiting a solid-like phase. Automated µ-Raman analysis was subsequently performed on ~690 particles, identifying three soot classes based on spectral features corresponding to the "Defect" (D) and "Graphite" (G) bands of soot. We applied two-peak and five-peak fitting approaches to deconvolute the “Defect” peaks (D1, D2, D3, and D4) and G band from average Raman, revealing varying degrees of graphitic order. The degree of graphitic order was determined from metrics such as the D3 peak area, often observed when soot was internally mixed with organic material. Raman spectral features, along with temporal variations in particle classes contributions, suggest that Particle Type 1 corresponds to traffic related soot and Particle Type 2 to less graphitic soot from biomass burning, while Particle Type 3 is associated with more heterogeneous particulate representative of soot-OC mixtures emitted during new particle formation and biomass burning episodes.

Rivera-Adorno, Felipe (ORCID:0000000273557999)↗

The development and application of composite complexity models and a relative complexity metric in a software maintenance environment

A great deal of effort is now being devoted to the study, analysis, prediction, and minimization of software maintenance expected cost, long before software is delivered to users or customers. It has been estimated that, on the average, the effort spent on software maintenance is as costly as the effort spent on all other software costs. Software design methods should be the starting point to aid in alleviating the problems of software maintenance complexity and high costs. Two aspects of maintenance deserve attention: (1) protocols for locating and rectifying defects, and for ensuring that noe new defects are introduced in the development phase of the software process; and (2) protocols for modification, enhancement, and upgrading. This article focuses primarily on the second aspect, the development of protocols to help increase the quality and reduce the costs associated with modifications, enhancements, and upgrades of existing software. This study developed parsimonious models and a relative complexity metric for complexity measurement of software that were used to rank the modules in the system relative to one another. Some success was achieved in using the models and the relative metric to identify maintenance-prone modules.

Hops, J. M.↗