Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probability of detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Assessing Reliability of NDE Flaw Detection Using Smaller Number of Demonstration Data Points

The paper provides an engineering analysis approach for assessing reliability of NDE flaw detection using smaller number of demonstration data points. It explores dependence of probability of detection (POD), probability of false positive (POF), on contrast-to-noise ratio, and net decision threshold-to-noise ratio in a simulated data; and draws some generically applicable inferences to devise the approach. ASTM nondestructive evaluation standards provide requirements on signal-to-noise ratio and/or contrast-to-noise ratio in order to provide reliable flaw detection and limit false positive calls. POD analysis of inspection test data results in an estimated flaw size, denoted by 𝑎90/95. This flaw size has 90% POD and minimum 95% confidence. POF is also estimated in the analysis. POD demonstration requires specimens with flaws of known size. In many situations, it is very expensive to produce the large number of flaws required for the POD analysis. In some situations, only real flaws can truly represent the flaws for demonstration. Real flaws of correct size and location in part configuration specimen may be difficult to produce, if not impossible. Here, an engineering analysis approach is devised using simulation to assess reliability of NDE technique when a limited number of flaws are available for demonstration. In this simulation, a technique is considered reliable, if it provides flaw detectability size equal to or better than the theoretical 𝑎90𝑡ℎ used in simulation and also provides a POF less than or equal to a chosen value. The paper uses simulated signal response versus flaw size data to devise the approach. Linear correlation is used between the signal response data and flaw size. POD software mh1823 uses generalized linear model (GLM) in POD analysis after transforming the flaw size and signal response, if needed, using logarithm. Therefore, this approach is in agreement with the linear signal correlation used in mh1823. Using the POD analysis of data, generic conditions on contrast-to-noise ratio and net decision threshold-to-noise ratio are derived for reliable flaw detection. In order to assess technique reliability using the engineering approach, signal response-to-flaw size correlation about the flaw size of concern is needed. In addition, measurement of noise is also needed. If the technique meets the above requirements, assumption of linear signal-to-flaw size correlation and conditions on noise, then the technique can be assessed using this analysis as it fits the underlying POD model used here. The approach is conservative and is designed to provide a larger flaw size compared to the POD approach. Such NDE technique assessment approach, although, not as rigorous as POD, can be cost effective if the larger flaw size can be tolerated. Typically, this is a situation for all quality control NDE inspections. Here, an NDE technique needs to be reliable and 𝑎90/95 is not estimated, but the assessed flaw size is assumed to be larger than the unknown a90 due to conservative factors or margins. Applicability of the approach for assessing reliability of flaw detection in x-ray radiography and 2D imaging in general is also explored.

Koshti, Ajay M.↗
NASA NTRS1970

Investigation of an Optimum Detection Scheme for a Star-Field Mapping System

An investigation was made to determine the optimum detection scheme for a star-field mapping system that uses coded detection resulting from starlight shining through specially arranged multiple slits of a reticle. The computer solution of equations derived from a theoretical model showed that the greatest probability of detection for a given star and background intensity occurred with the use of a single transparent slit. However, use of multiple slits improved the system's ability to reject the detection of undesirable lower intensity stars, but only by decreasing the probability of detection for lower intensity stars to be mapped. Also, it was found that the coding arrangement affected the root-mean-square star-position error and that detection is possible with error in the system's detected spin rate, though at a reduced probability.

Aldridge, M. D.↗
NASA NTRS2007

Applicability of a Conservative Margin Approach for Assessing NDE Flaw Detectability

Nondestructive Evaluation (NDE) procedures are required to detect flaws in structures with a high percentage detectability and high confidence. Conventional Probability of Detection (POD) methods are statistical in nature and require detection data from a relatively large number of flaw specimens. In many circumstances, due to the high cost and long lead time, it is impractical to build the large set of flaw specimens that is required by the conventional POD methodology. Therefore, in such situations it is desirable to have a flaw detectability estimation approach that allows for a reduced number of flaw specimens but provides a high degree of confidence in establishing the flaw detectability size. This paper presents an alternative approach called the conservative margin approach (CMA). To investigate the applicability of the CMA approach, flaw detectability sizes determined by the CMA and POD approaches have been compared on actual datasets. The results of these comparisons are presented and the applicability of the CMA approach is discussed.

Koshti, ajay M.↗
NASA NTRS2017

Some Observations on Damage Tolerance Analyses in Pressure Vessels

AIAA standards S080 and S081 are applicable for certification of metallic pressure vessels (PV) and composite overwrap pressure vessels (COPV), respectively. These standards require damage tolerance analyses with a minimum reliable detectible flaw/crack and demonstration of safe life four times the service life with these cracks at the worst-case location in the PVs and oriented perpendicular to the maximum principal tensile stress. The standards require consideration of semi-elliptical surface cracks in the range of aspect ratios (crack depth a to half of the surface length c, i.e., (a/c) of 0.2 to 1). NASA-STD-5009 provides the minimum reliably detectible standard crack sizes (90/95 probability of detection (POD) for several non-destructive evaluation (NDE) methods (eddy current (ET), penetrant (PT), radiography (RT) and ultrasonic (UT)) for the two limits of the aspect ratio range required by the AIAA standards. This paper tries to answer the questions: can the safe life analysis consider only the life for the crack sizes at the two required limits, or endpoints, of the (a/c) range for the NDE method used or does the analysis need to consider values within that range? What would be an appropriate method to interpolate 90/95 POD crack sizes at intermediate (a/c) values? Several procedures to develop combinations of a and c within the specified range are explored. A simple linear relationship between a and c is chosen to compare the effects of seven different approaches to determine combinations of aj and cj that are between the (a/c) endpoints. Two of the seven are selected for evaluation: Approach I, the simple linear relationship, and a more conservative option, Approach III. For each of these two Approaches, the lives are computed for initial semi-elliptic crack configurations in a plate subjected to remote tensile fatigue loading with an R-ratio of 0.1, for an assumed material evaluated using NASGRO (registered 4) version 8.1. These calculations demonstrate that for this loading, using Approach I and the initial detectable crack sizes at the (a/c) endpoints in 5009 specified for the ET and UT NDE methods, the smallest life is not at the two required limits of the (a/c) range, but rather is at an intermediate configuration in the range (a/c) of 0.4 to 0.6. Similar analyses using both Approach I and III with the initial detectable crack size at the (a/c) endpoints in 5009 for PT NDE showed the smallest life may be at an (a/c) endpoint or an intermediate (a/c), depending upon which Approach is used. As such, analyses that interrogate only the two (a/c) values of 0.2 and 1 may result in unconservative life predictions. The standard practice may need to be revised based on these results.

Raju, Ivatury S.↗
NASA NTRS2007

NASA NDE Program

This viewgraph presentation describes the NASA Nondestructive Evaluation (NDE) Program. The contents include: 1) NASA NDE Program; 2) Nondestructive Evaluation Requirements for Fracture Critical Components; 3) Directed Design of Experiments for Probability of Detection (DOEPOD) A8002L data from NTIAC Capabilities Data Book, 1997; 4) Directed Design of Experiments for Probability of Detection (DOEPOD) Remove 94 samples from A8002L data; and 5) A8002L data from NTIAC Capabilities Data Book, 1997

Generazio, Edward R.↗
NASA NTRSDate not supplied

Importance of Contrast-to-Noise Ratio Sensitivity Function in Nondestructive Evaluation

A reliable nondestructive evaluation (NDE) technique provides minimum 90% probability of detection (POD) with 95% confidence for detection of cracklike flaws of a specific size. This requirement comes from fracture control. Fracture control is a risk assessment and control approach for preventing structural failure of fracture critical hardware during its service life. One of the approaches of fracture control is damage tolerance safe life analysis, which assumes that NDE reliably detectable size flaw may exist in the hardware post nondestructive evaluation. Analysis and/or testing are performed to verify that the hardware will not fail during its service life despite existence of such a flaw. NDE methods are conventionally qualified by probability of detection (POD) demonstration testing to ensure reliable flaw detection. Here, a novel and alternative to POD flaw detection reliability approach that uses contrast-to-noise ratio (CNR) is given. The approach uses CNR sensitivity function (SF) and CNR. CNR SF is the minimum CNR needed for reliable flaw detection as a function of certain flaw indication characteristics. Primary difference between POD approaches and CNR flaw detection reliability approach is resolution of flaw detection system. POD approach does not account for the resolution of the system, while CNR approach accounts for the flaw detection resolution. Resolution is determined from the modulation transfer function (MTF) of the flaw detection system. CNR flaw detection reliability approach emphasizes quantitative assessment of “how well each flaw indication is detected”. Therefore, CNR approach is helpful in reducing number of flaws in the sample used in NDE procedure qualification, resulting in cost and time savings. CNR approach is also a case of multi-hit flaw detection analysis which has better flaw detectability size than conventional single-hit flaw detectability. Thus, CNR approach, where applicable, may be superior to conventional POD approach. The paper is an overview of development of CNR modeling, CNR SF modeling and measurement by the author. The paper gives key references to currently used NDE procedure POD qualification approaches including those specific to CNR and CNR SF development in multi-hit flaw detection in NDE. The paper covers core topics in nondestructive evaluation engineering.

Contrast-to-noise ratio↗
NASA NTRS2012

A Search Model for Imperfectly Detected Targets

Under the assumptions that 1) the search region can be divided up into N non-overlapping sub-regions that are searched sequentially, 2) the probability of detection is unity if a sub-region is selected, and 3) no information is available to guide the search, there are two extreme case models. The search can be done perfectly, leading to a uniform distribution over the number of searches required, or the search can be done with no memory, leading to a geometric distribution for the number of searches required with a success probability of 1/N. If the probability of detection P is less than unity, but the search is done otherwise perfectly, the searcher will have to search the N regions repeatedly until detection occurs. The number of searches is thus the sum two random variables. One is N times the number of full searches (a geometric distribution with success probability P) and the other is the uniform distribution over the integers 1 to N. The first three moments of this distribution were computed, giving the mean, standard deviation, and the kurtosis of the distribution as a function of the two parameters. The model was fit to the data presented last year (Ahumada, Billington, & Kaiwi, 2 required to find a single pixel target on a simulated horizon. The model gave a good fit to the three moments for all three observers.

Ahumada, Albert↗
NASA NTRS2005

Global Positioning System (GPS) Precipitable Water in Forecasting Lightning at Spaceport Canaveral

Using meteorology data, focusing on precipitable water (PW), obtained during the 2000-2003 thunderstorm seasons in Central Florida, this paper will, one, assess the skill and accuracy measurements of the current Mazany forecasting tool and, two, provide additional forecasting tools that can be used in predicting lightning. Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) are located in east Central Florida. KSC and CCAFS process and launch manned (NASA Space Shuttle) and unmanned (NASA and Air Force Expendable Launch Vehicles) space vehicles. One of the biggest cost impacts is unplanned launch scrubs due to inclement weather conditions such as thunderstorms. Each launch delay/scrub costs over a quarter million dollars, and the need to land the Shuttle at another landing site and return to KSC costs approximately $ 1M. Given the amount of time lost and costs incurred, the ability to accurately forecast (predict) when lightning will occur can result in significant cost and time savings. All lightning prediction models were developed using binary logistic regression. Lightning is the dependent variable and is binary. The independent variables are the Precipitable Water (PW) value for a given time of the day, the change in PW up to 12 hours, the electric field mill value, and the K-index value. In comparing the Mazany model results for the 1999 period B against actual observations for the 2000-2003 thunderstorm seasons, differences were found in the False Alarm Rate (FAR), Probability of Detection (POD) and Hit Rate (H). On average, the False Alarm Rate (FAR) increased by 58%, the Probability of Detection (POD) decreased by 31% and the Hit Rate decreased by 20%. In comparing the performance of the 6 hour forecast period to the performance of the 1.5 hour forecast period for the Mazany model, the FAR was lower by 15% and the Hit Rate was higher by 7%. However, the POD for the 6 hour forecast period was lower by 16% as compared to the POD of the 1.5 hour forecast period. Neither forecast period performed at the accuracy measures expected. A 2-Hr Forecasting Tool was developed to support a Phase I Lightning Advisory, which requires a 30-minute lead time for predicting lightning.

Kehrer, Kristen↗
NASA NTRS2012

Vehicle Detection for RCTA/ANS (Autonomous Navigation System)

Using a stereo camera pair, imagery is acquired and processed through the JPLV stereo processing pipeline. From this stereo data, large 3D blobs are found. These blobs are then described and classified by their shape to determine which are vehicles and which are not. Prior vehicle detection algorithms are either targeted to specific domains, such as following lead cars, or are intensity- based methods that involve learning typical vehicle appearances from a large corpus of training data. In order to detect vehicles, the JPL Vehicle Detection (JVD) algorithm goes through the following steps: 1. Take as input a left disparity image and left rectified image from JPLV stereo. 2. Project the disparity data onto a two-dimensional Cartesian map. 3. Perform some post-processing of the map built in the previous step in order to clean it up. 4. Take the processed map and find peaks. For each peak, grow it out into a map blob. These map blobs represent large, roughly vehicle-sized objects in the scene. 5. Take these map blobs and reject those that do not meet certain criteria. Build descriptors for the ones that remain. Pass these descriptors onto a classifier, which determines if the blob is a vehicle or not. The probability of detection is the probability that if a vehicle is present in the image, is visible, and un-occluded, then it will be detected by the JVD algorithm. In order to estimate this probability, eight sequences were ground-truthed from the RCTA (Robotics Collaborative Technology Alliances) program, totaling over 4,000 frames with 15 unique vehicles. Since these vehicles were observed at varying ranges, one is able to find the probability of detection as a function of range. At the time of this reporting, the JVD algorithm was tuned to perform best at cars seen from the front, rear, or either side, and perform poorly on vehicles seen from oblique angles.

Brennan, Shane↗
NASA NTRS1985

Microwave responses of the western North Atlantic

Features and objects in the Western North Atlantic Ocean - the Eastern Seaboard of the United States - are observed from Earth orbit by passive microwaves. The intensities of their radiated flux signatures are measured and displayed in color as a microwave flux image. The features of flux emitting objects such as the course of the Gulf Stream and the occurrence of cold eddies near the Gulf Stream are identified by contoured patterns of relative flux intensities. The flux signatures of ships and their wakes are displayed and discussed. Metal data buoys and aircraft are detected. Signal to clutter ratios and probabilities of detection are computed from their measured irradiances. Theoretical models and the range equations that explain passive microwave detection using the irradiances of natural sources are summarized.

Stacey, J. M.↗
NASA NTRS1984

Note on the Optimum Search Strategy for Uniformly Distributed CW Transmitters

The relative probability of detecting randomly distributed CW transmitters as a function of the fraction of the sky which is searched (in a fixed time) is given. It is shown that the probability of detecting such a class of transmitters with a given receiving system is a maximum if the entire sky is searched. The particular case of a search in which the number of directions searched is equal to the telescope gain and the integration time per beam element is equal to the reciprocal of the channel bandwidth is discussed.

Gulkis, S.↗
NASA NTRS1985

Optimum search strategy for randomly distributed CW transmitters

The relative probability of detecting randomly distributed CW transmitters as a function of the fraction of the sky which is searched (in a fixed time interval) is given. It is shown that the probability of detecting such a class of transmitters with a given receiving system is a maximum if the entire sky is searched, provided that the receiving system is sufficiently sensitive to detect the nearest transmitter in the allocated time and that the integration time - bandwidth product in a specified direction is greater than 8.

Gulkis, S.↗
NASA NTRS2017

Reliably Detectable Flaw Size for NDE Methods that Use Calibration

Probability of detection (POD) analysis is used in assessing reliably detectable flaw size in nondestructive evaluation (NDE). MIL-HDBK-1823 and associated mh1823 POD software gives most common methods of POD analysis. In this paper, POD analysis is applied to an NDE method, such as eddy current testing, where calibration is used. NDE calibration standards have known size artificial flaws such as electro-discharge machined (EDM) notches and flat bottom hole (FBH) reflectors which are used to set instrument sensitivity for detection of real flaws. Real flaws such as cracks and crack-like flaws are desired to be detected using these NDE methods. A reliably detectable crack size is required for safe life analysis of fracture critical parts. Therefore, it is important to correlate signal responses from real flaws with signal responses form artificial flaws used in calibration process to determine reliably detectable flaw size.

Koshti, Ajay M.↗
NASA NTRS1990

Summer 1988 TDWR microburst analysis

The Terminal Doppler Weather Radar (TDWR) testbed system was operated during the months of July to August 1988 in a live operational demonstration providing microburst (and related weather hazard) protection to the Stapleton International Airport in Denver, CO. During this time period, the performance of the detection system was carefully monitored in an effort to determine the reliability of the system. Initial performance analysis indicates that the microburst detection component of TDWR satisfies the basic performance goals of 90 percent probability of detection and 10 percent probability of false alarm. An in-depth study of the system performance, based on analysis of both dual-Doppler radar observations and surface mesonet measurements, is in progress to provide a detailed understanding of the observability of microbursts by the radar, the ability of the algorithms to detect microburst observed by the radar, and the timeliness and accuracy of the microburst alarms provided to operational users.

Merritt, Mark W.↗
NASA NTRS1990

Echo size and asymmetry - Impact on NEXRAD storm identification

The effects of echo shape and radar viewing angle on detecting small thunderstorms with the NEXRAD storm identification algorithms are examined. The amorphous low-level echo shapes are modeled as ellipses with major axes ranging from 5-15 km and minor axes varying between 2-5 km. The model echoes are then used to create a 'probability of detection' chart that demonstrates the impact of storm asymmetry on cell identification. The algorithm performance on small thunderstorms observed near Huntsville, Alabama and Kennedy Space Center, Florida is examined. A new algorithm based on the analysis of 15 storms observed in Florida, Alabama, and New Mexico is proposed that would identify storms as having lightning if 40 dBZ reflectivity is present at the -10 C level and the echo top exceeds 9 km. This algorithm would have a 100 percent probability of detecting lightning producing storms 4-33 min before the first flash, a 7 percent false alarm rate and a critical success index of 93 percent.

Buechler, Dennis E.↗
NASA NTRS1974

Vertex evoked potentials in a rating-scale detection task: Relation to signal probability

Vertex evoked potentials were recorded from human subjects performing in an auditory detection task with rating scale responses. Three values of a priori probability of signal presentation were tested. The amplitudes of the N1 and P3 components of the vertex potential associated with correct detections of the signal were found to be systematically related to the strictness of the response criterion and independent of variations in a priori signal probability. No similar evoked potential components were found associated with signal absent judgements (misses and correct rejections) regardless of the confidence level of the judgement or signal probability. These results strongly support the contention that the form of the vertex evoked response is closely correlated with the subject's psychophysical decision regarding the presence or absence of a threshold level signal.

Squires, K. C.↗
NASA NTRS2003

Geoscience Laser Altimeter System: Characteristics and Performance of the Altimeter Receiver

The Geoscience Laser Altimeter System (GLAS) on board ICESat spacecraft measures the surface height (altimetry) via the time of flight of its 1064 nm laser pulse. The GLAS laser transmitter produces 6 ns wide pulses with 70 mJ energy at 1064 nm at a 40 Hz rate. The altimeter receiver consists of a telescope, aft optics, a silicon avalanche photodiode, and electronic amplifiers. The transmitted and echo pulse waveforms are digitized at 1 GHz rate. The laser pulse time of flight is determined on the ground from the two digitized pulse waveforms and their positions in the full waveform record (about 5.4 ms ong) by computing the pulse centroids or by curve fitting. The GLAS receiver algorithms in on board software selects the two waveform segments containing the transmitted and the echo pulses and sends them to ground. The probability of echo pulse detection and the accuracy of time of flight measurement depend on the received signal level, the background light within the receiver field of view, the inherent detector and amplifier noise, the quantization of the digitizer, and some times by cloud obscurations. A receiver model has been developed to calculate the probability of detection and accuracy of the altimeter measurements with these noise sources. From prelaunch testing, the minimum detectable echo pulse energy for 90% detection probability was about 0.1 fj/pulse onto the detector. Such a receiver sensitivity allows GLAS to measure the surface height through clouds with optical density less than 2. The echo pulse energy required to achieve 10 cm ranging accuracy was found to be about 3 times higher than the minimum detectable signal level. The smallest single shot range measurement error, which was determined by ranging to a fixed target with strong echo pulses and no background light, was 2 to 3cm. The maximum linear response echo pulse energy was 10 fJ/pulse for the strongest echo signals, assuming a Lambertian scattering snow surface, clear sky atmosphere transmission, and no pulse width spreading due to surface slopes. Results from the initial 38 days of GLAS operation on-orbit with Laser 1, showed the echo pulse energies varied, as expected, over a wide dynamic range due to the variability of atmosphere transmission and Earth surface characteristics. The receiver was able to reliably detect the ground surface echoes and measure time of flight under such dynamic conditions, except when there were dense clouds. When over Antarctica, the echo pulse energies were several times stronger than predicted. This suggests that the 1064 nm backscattering from the snow pack and ice-sheet &ce are not completely Lambertian but is somewhat peaked at opposit.ion. With Laser 1, the peak amplitude of the echo pulses from flat ice sheets under clear sky conditions exceeded the linear response range of the receiver, causing some pulse waveform distortion due to saturation. We have characterized the effects of receiver saturation on the time of flight, pulse width, and pulse energy measurements for flat surface by testing a night spare detector in the lab with simulated echo pulses. A data processing algorithm that minimizes the errors due to saturation for these measurements are described.

Sun, Xiao-Li↗