Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probability of detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Binomial Test Method for Determining Probability of Detection Capability for Fracture Critical Applications

The capability of an inspection system is established by applications of various methodologies to determine the probability of detection (POD). One accepted metric of an adequate inspection system is that for a minimum flaw size and all greater flaw sizes, there is 0.90 probability of detection with 95% confidence (90/95 POD). Directed design of experiments for probability of detection (DOEPOD) has been developed to provide an efficient and accurate methodology that yields estimates of POD and confidence bounds for both Hit-Miss or signal amplitude testing, where signal amplitudes are reduced to Hit-Miss by using a signal threshold Directed DOEPOD uses a nonparametric approach for the analysis or inspection data that does require any assumptions about the particular functional form of a POD function. The DOEPOD procedure identifies, for a given sample set whether or not the minimum requirement of 0.90 probability of detection with 95% confidence is demonstrated for a minimum flaw size and for all greater flaw sizes (90/95 POD). The DOEPOD procedures are sequentially executed in order to minimize the number of samples needed to demonstrate that there is a 90/95 POD lower confidence bound at a given flaw size and that the POD is monotonic for flaw sizes exceeding that 90/95 POD flaw size. The conservativeness of the DOEPOD methodology results is discussed. Validated guidelines for binomial estimation of POD for fracture critical inspection are established.

Generazio, Edward R.↗
NASA NTRS2008

Probability of Detection Study on Impact Damage to Honeycomb Composite Structure using Thermographic Inspection

A probability of detection study was performed for the detection of impact damage using flash heating infrared thermography on a full scale honeycomb composite structure. The honeycomb structure was an intertank structure from a previous NASA technology demonstration program. The intertank was fabricated from IM7/8552 carbon fiber/epoxy facesheets and aluminum honeycomb core. The intertank was impacted in multiple locations with a range of impact energies utilizing a spherical indenter. In a single blind study, the intertank was inspected with thermography before and after impact damage was incurred. Following thermographic inspection several impact sites were sectioned from the intertank and cross-sectioned for microscopic comparisons of NDE detection and actual damage incurred. The study concluded that thermographic inspection was a good method of detecting delamination damage incurred by impact. The 90/95 confidence level on the probability of detection was close to the impact energy that delaminations were first observed through cross-sectional analysis.

Hodge, Andrew J.↗
NASA NTRS2012

Directed Design of Experiments for Validating Probability of Detection Capability of a Testing System

A method of validating a probability of detection (POD) testing system using directed design of experiments (DOE) includes recording an input data set of observed hit and miss or analog data for sample components as a function of size of a flaw in the components. The method also includes processing the input data set to generate an output data set having an optimal class width, assigning a case number to the output data set, and generating validation instructions based on the assigned case number. An apparatus includes a host machine for receiving the input data set from the testing system and an algorithm for executing DOE to validate the test system. The algorithm applies DOE to the input data set to determine a data set having an optimal class width, assigns a case number to that data set, and generates validation instructions based on the case number.

Generazio, Edward R.↗
NASA NTRS2014

Interrelationships Between Receiver/Relative Operating Characteristics Display, Binomial, Logit, and Bayes' Rule Probability of Detection Methodologies

Unknown risks are introduced into failure critical systems when probability of detection (POD) capabilities are accepted without a complete understanding of the statistical method applied and the interpretation of the statistical results. The presence of this risk in the nondestructive evaluation (NDE) community is revealed in common statements about POD. These statements are often interpreted in a variety of ways and therefore, the very existence of the statements identifies the need for a more comprehensive understanding of POD methodologies. Statistical methodologies have data requirements to be met, procedures to be followed, and requirements for validation or demonstration of adequacy of the POD estimates. Risks are further enhanced due to the wide range of statistical methodologies used for determining the POD capability. Receiver/Relative Operating Characteristics (ROC) Display, simple binomial, logistic regression, and Bayes' rule POD methodologies are widely used in determining POD capability. This work focuses on Hit-Miss data to reveal the framework of the interrelationships between Receiver/Relative Operating Characteristics Display, simple binomial, logistic regression, and Bayes' Rule methodologies as they are applied to POD. Knowledge of these interrelationships leads to an intuitive and global understanding of the statistical data, procedural and validation requirements for establishing credible POD estimates.

Generazio, Edward R.↗
NASA NTRS1991

Open-loop frequency acquisition for suppressed-carrier biphase signals using one-pole arm filters

Open loop frequency acquisition performance is discussed for suppressed carrier binary phase shift keyed signals in terms of the probability of detecting the carrier frequency offset when the arms of the Costas loop detector have one pole filters. The approach, which does not require symbol timing, uses fast Fourier transforms (FFTs) to detect the carrier frequency offset. The detection probability, which depends on both the 3 dB arm filter bandwidth and the received symbol signal to noise ratio, is derived and is shown to be independent of symbol timing. It is shown that the performance of this technique is slightly better that other open loop acquisition techniques which use integrators in the arms and whose detection performance varies with symbol timing.

Shah, B.↗
NASA NTRS2008

Directed Design of Experiments for Validating Probability of Detection Capability of NDE Systems (DOEPOD)

The capability of an inspection system is established by applications of various methodologies to determine the probability of detection (POD). One accepted metric of an adequate inspection system is that there is 95% confidence that the POD is greater than 90% (90/95 POD). Directed design of experiments for probability of detection (DOEPOD) has been developed to provide an efficient and accurate methodology that yields observed POD and confidence bounds for both Hit- Miss or signal amplitude testing. Specifically, DOEPOD demands utilization of observance of occurrences. Directed DOEPOD does not assume prescribed POD logarithmic or similar functions with assumed adequacy over a wide range of flaw sizes and inspection system technologies, so that multi-parameter curve fitting or model optimization approaches to generate a POD curve are not required.

Generazio, Edward R.↗
NASA NTRS1994

Probability of detection of defects in coatings with electronic shearography

The goal of this research was to utilize statistical methods to evaluate the probability of detection (POD) of defects in coatings using electronic shearography. The coating system utilized in the POD studies was to be the paint system currently utilized on the external casings of the NASA Space Transportation System (STS) Revised Solid Rocket Motor (RSRM) boosters. The population of samples was to be large enough to determine the minimum defect size for 90 percent probability of detection of 95 percent confidence POD on these coatings. Also, the best methods to excite coatings on aerospace components to induce deformations for measurement by electronic shearography were to be determined.

Maddux, Gary A.↗
NASA NTRS2008

Terahertz Imaging and Backscatter Radiography Probability of Detection Study for Space Shuttle Foam Inspections

This slide presentation reviews the use of terahertz imaging and Backscatter Radiography in a probability of detection study of the foam on the external tank (ET) shedding and damaging the shuttle orbiter. Non-destructive Examination (NDE) is performed as one method of preventing critical foam debris during the launch. Conventional NDE methods for inspection of the foam are assessed and the deficiencies are reviewed. Two methods for NDE inspection are reviewed: Backscatter Radiography (BSX) and Terahertz (THZ) Imaging. The purpose of the Probability of Detection (POD) study was to assess performance and reliability of the use of BSX and or THZ as an appropriate NDE method. The study used a test article with inserted defects, and a sample of blanks included to test for false positives. The results of the POD study are reported.

Ussery, Warren↗
NASA NTRS1979

Pioneer Venus Star Sensor

The design predictions and orbital performance verification of the solid state star scanner used in the Onboard Attitude Control of the Pioneer Venus Orbiter and Multiprobe are presented. The star sensor extended the scanner use to active despin control, and it differs from previous sensors in solid state detection, redundant electronics for reliability, larger field of view, and large dynamic spin range. The star scanner hardware and design performance based on the ability to predict all noise sources, signal magnitudes, and expected detection probability are discussed. In-flight data collected to verify sensor ground calibration are tabulated and plotted in predicted accuracy curves. It is concluded that the Pioneer Venus Star Sensor has demonstrated predictable star calibration in the range of .1 magnitude uncertainties and usable star catalogs of 100 stars with very high probabilities of detection, which were much better than expected and well within the mission requirements.

Gutshall, R. L.↗
NASA NTRS1995

Optimum detection of tones transmitted by a spacecraft

The performance of a scheme proposed for automated routine monitoring of deep-space missions is presented. The scheme uses four different tones (sinusoids) transmitted from the spacecraft (S/C) to a ground station with the positive identification of each of them used to indicate different states of the S/C. Performance is measured in terms of detection probability versus false alarm probability with detection signal-to-noise ratio as a parameter. The cases where the phase of the received tone is unknown and where both the phase and frequency of the received tone are unknown are treated separately. The decision rules proposed for detecting the tones are formulated from average-likelihood ratio and maximum-likelihood ratio tests, the former resulting in optimum receiver structures.

Simon, M. K.↗
NASA NTRS2007

Directed Design of Experiments (DOE) for Determining Probability of Detection (POD) Capability of NDE Systems (DOEPOD)

This viewgraph presentation reviews some of the issues that people who specialize in Non destructive evaluation (NDE) have with determining the statistics of the probability of detection. There is discussion of the use of the binominal distribution, and the probability of hit. The presentation then reviews the concepts of Directed Design of Experiments for Validating Probability of Detection of Inspection Systems (DOEPOD). Several cases are reviewed, and discussed. The concept of false calls is also reviewed.

Generazio, Ed↗
NASA NTRS2021

Guidebook for Limited Sample Probability of Detection (LS-POD) Demonstration for Signal-Response Nondestructive Evaluation (NDE) Methods

This document provides guidance for performing limited sample probability of detection (LS-POD) demonstration testing with smaller numbers of flawed specimens than the 29 required for the Point Estimate POD method referenced in NASA Standard 5009B. This document is specifically applicable to NASA programs and projects where NASA Special NDE methods are used to inspect fracture critical human spaceflight metallic hardware when the minimum number of flawed specimens required for the Point Estimate POD method referenced in NASA Standard 5009B (2019) are not available.

Limited Sample Probability of Detection↗
NASA NTRSDate not supplied

Assessing Risk Due to Small Sample Size in Probability of Detection Analysis Using Tolerance Intervals

Small sample size (e.g.6-30) poses risk in results of probability of detection (POD) analysis using tolerance intervals. This method is also called as the limited sample or LS POD. The analysis is performed either during NDE procedure qualification or for assessment of reliability of an NDE procedure. The risk is primarily due to sampling error. Smaller samples are not likely to be random to the population or representative of the population. The small samples are likely to be biased. Biased samples have smaller standard deviation compared to the population. POD analysis with small biased sample can lead to overestimation of POD. Many sampling schemes are available in statistics to mitigate sampling risk. Primary objective of POD analysis is to determine a decision threshold from signal response measurements of a sample such that it is less than or equal to population decision threshold for 90% POD. Sampling error implies that this NDE reliability condition is violated. One of sampling types is called a representative sample. Representative samples reduce variance in POD estimates but also reduce magnitude of the error. Sampling sensitivity analysis for some sampling types is performed here using repetitive random sampling or Monte Carlo method. Six sampling types are considered for comparison. Some of the sampling types are similar to drawing a representative sample. LS POD model assumes random sampling. Therefore, random sampling is used as a basis for comparison with each sampling type. The sampling types used in the analysis are, A. Nominal and worst-case sampling, B. Worst-case sampling, C. Nominal case sampling, D. Random sampling, E. Random target, and sub-target sampling. F. Nominal target and sub-target sampling. Results of Monte Carlo simulation indicate that type F sampling can mitigate sampling risk and is also more practical to implement. Type A sampling may also mitigate the sampling risk, but it may be less practical to implement.

Ajay M Koshti↗
NASA NTRS2022

Guidebook for the Design and Analysis of a NASA Standard Nondestructive Evaluation (NDE) Probability of Detection (POD) Study

Purpose: This document provides guidance on the design and analysis of a NASA Standard nondestructive evaluation (NDE) probability of detection (POD) study. A Standard NDE flaw size is considered to be conservative such that most inspectors, trained and certified in the specific NDE method, are expected to provide at least 90/95 POD for that flaw size to inspect fracture-critical hardware. Scope: This document is specifically applicable to NASA Technical Standards that establish the NDE requirements for any NASA system or component, flight or ground, where fracture control and a quantitative demonstration of POD is a requirement, including NASA-STD-5009B, Nondestructive Evaluation Requirements for Fracture-Critical Metallic Components, and NASA-STD-5019A,Fracture Control Requirements for Spaceflight Hardware.

Probability of Detection↗
NASA NTRS2008

Probability of Detection Demonstration Transferability

The ongoing Mars Science Laboratory (MSL) Propellant Tank Penetrant Nondestructive Evaluation (NDE) Probability of Detection (POD) Assessment (NESC activity) has surfaced several issues associated with liquid penetrant POD demonstration testing. This presentation lists factors that may influence the transferability of POD demonstration tests. Initial testing will address the liquid penetrant inspection technique. Some of the factors to be considered in this task are crack aspect ratio, the extent of the crack opening, the material and the distance between the inspection surface and the inspector's eye.

Parker, Bradford H.↗
NASA NTRS2011

Effect of Liquid Penetrant Sensitivity on Probability of Detection

The objective of the task is to investigate the effect of liquid penetrant sensitivity level on probability of detection (POD) of cracks in various metals. NASA-STD-5009 currently requires the use of only sensitivity level 4 liquid penetrants for NASA Standard Level inspections. This requirement is based on the fact that the data used to establish the reliably detectable flaw sizes penetrant inspection was from studies performed in the 1970s using penetrant deemed to be equivalent only to modern day sensitivity level 4 penetrants. However, many NDE contractors supporting NASA Centers routinely use sensitivity level 3 penetrants. Because of the new NASA-STD-5009 requirement, these contractors will have to either shift to sensitivity level 4 penetrants or perform formal POD demonstration tests to qualify their existing process. We propose a study to compare the POD generated for two penetrant manufactures, Sherwin and Magnaflux, and for the two most common penetrant inspection methods, water washable and post emulsifiable, hydrophilic. NDE vendors local to GSFC will be employed. A total of six inspectors will inspect a set of crack panels with a broad range of fatigue crack sizes. Each inspector will perform eight inspections of the panel set using the combination of methods and sensitivity levels described above. At least one inspector will also perform multiple inspections using a fixed technique to investigate repeatability. The hit/miss data sets will be evaluated using both the NASA generated DOEPOD software and the MIL-STD-1823 software.

Parker, Bradford H.↗
NASA NTRS1995

Probability of detection of defects in coatings with electronic shearography

The goal of this research was to utilize statistical methods to evaluate the probability of detection (POD) of defects in coatings using electronic shearography. The coating system utilized in the POD studies was to be the paint system currently utilized on the external casings of the NASA space transportation system reusable solid rocket motor boosters. The population of samples was to be large enough to determine the minimum defect size for 90-percent POD of 95-percent confidence POD on these coatings. Also, the best methods to excite coatings on aerospace components to induce deformations for measurement by electronic shearography were to be determined.

Russell, S. S.↗
NASA NTRS2007

Directed Design of Experiments (DOE) for Determining Probability of Detection (POD) Capability of NDE Systems (DOEPOD)

This viewgraph presentation reviews some of the problems that are encountered by designers of Non-Destructive Examination (NDE) have in determining the probability of detection. According to the author "[the] NDE community should not blindly accept statistical results due to lack of knowledge." This is an attempt to bridge the gap between people doing NDE, and statisticians.

Generazio, Edward R.↗