Results for “outlier detection” — Page 3

NASA NTRS2009

Gear Fault Detection Effectiveness as Applied to Tooth Surface Pitting Fatigue Damage

A study was performed to evaluate fault detection effectiveness as applied to gear tooth pitting fatigue damage. Vibration and oil-debris monitoring (ODM) data were gathered from 24 sets of spur pinion and face gears run during a previous endurance evaluation study. Three common condition indicators (RMS, FM4, and NA4) were deduced from the time-averaged vibration data and used with the ODM to evaluate their performance for gear fault detection. The NA4 parameter showed to be a very good condition indicator for the detection of gear tooth surface pitting failures. The FM4 and RMS parameters performed average to below average in detection of gear tooth surface pitting failures. The ODM sensor was successful in detecting a significant amount of debris from all the gear tooth pitting fatigue failures. Excluding outliers, the average cumulative mass at the end of a test was 40 mg.

Lewicki, David G.↗

NASA NTRS2010

Gear Fault Detection Effectiveness as Applied to Tooth Surface Pitting Fatigue Damage

A study was performed to evaluate fault detection effectiveness as applied to gear-tooth-pitting-fatigue damage. Vibration and oil-debris monitoring (ODM) data were gathered from 24 sets of spur pinion and face gears run during a previous endurance evaluation study. Three common condition indicators (RMS, FM4, and NA4 [Ed. 's note: See Appendix A-Definitions D were deduced from the time-averaged vibration data and used with the ODM to evaluate their performance for gear fault detection. The NA4 parameter showed to be a very good condition indicator for the detection of gear tooth surface pitting failures. The FM4 and RMS parameters perfomu:d average to below average in detection of gear tooth surface pitting failures. The ODM sensor was successful in detecting a significant 8lDOunt of debris from all the gear tooth pitting fatigue failures. Excluding outliers, the average cumulative mass at the end of a test was 40 mg.

Lewicki, David G.↗

NASA NTRS2020

Object and Gas Source Detection with Robotic Platforms in Perceptually-Degraded Environments

In exploration-oriented robotic missions for disaster relief in unknown subterranean environments, it is of prime importance for a human supervisor to rapidly gain situational awareness of salient objects within the environment. In this paper we present an automated object detection pipeline that is adaptable to heterogeneous robots with arbitrary sensor configurations. It has been deployed in time-critical scenarios with multiple collaborative robots in a variety of demanding underground environments. For visually observable objects, detections are made in both the visible and thermal spectra using a state-of-the-art machine learning framework for object detection and classification. Our pipeline can be rapidly adapted to a specific task by using a small, structured dataset to fine-tune a pre-trained convolutional neural network (CNN). Relative localization is separated from the CNN for speed of operation. A robust architecture for localization is used with outlier rejection and a hierarchy of fall-back distance measurement methods. Point-source objects such as gas and WiFi hotspots can also be detected, by tracking signal strength over time and presenting an intuitive visualization on a map. Observations of each object types are presented to the operator in ranked confidence order for final evaluation.

Agha-mohammadi, Ali-akbar↗

NASA NTRS2010

In Situ and Lidar Observations of Tropopause Subvisible Cirrus Clouds During TC4

During the Tropical Composition, Clouds, and Climate Coupling (TC4) experiment in July-August 2007, the NASA WB-57F and ER-2 aircraft made coordinated flights through a tropopause subvisible cirrus (SVC) layer off the Pacific Coast of Central America. The ER-2 aircraft was equipped with a remote sensing payload that included the cloud physics lidar (CPL). The WB-57F payload included cloud microphysical and trace gas measurements, and the aircraft made four vertical profiles through the SVC layer shortly after the ER-2 flew over. The in situ and remotely sensed data are used to quantify the meteorological and microphysical properties of the SVC layer, and these data are compared to the limited set of SVC measurements that have previously been made. It is found that the layer encountered was particularly tenuous, with optical depths (tau) between about 10(exp -4) and 10(exp -3). From the in situ and other meteorological data, radiative heating rate perturbations of approx.0.05-0.1 K/day are calculated. These heating rates are smaller than previous estimates for tropopause SVC, consistent with the smaller tau in the present study. Coverage statistics based on CPL data from other TC4 flights indicate that this cloud was not an outlier among the sampled population. SVC with properties similar to the one presented here are below the detection limit of space \based lidars such as CALIPSO, and a comparison with the TC4 statistics suggests that a majority (>50%) of tropopause SVC (with tau < 0.01) could be unaccounted for in studies using CALIPSO data.

Davis, Sean↗

NASA NTRSDate not supplied

Topographic Slant Range Modeling and Fault Detection for Precision Planetary Landing

This work presents a novel landing site relative topographic measurement model for aslant range sensor being utilized for precision planetary landing operations. The measurement model accounts for the local terrain the slant range sensor captures and leverages knowledge of the estimated landing site provided by the navigation filter. Notably, in contrast to previous works, the new model does not rely on surface normal approximation, reducing the model’s sensitivity to noisy digital elevation maps which represent the local topography. In addition to the measurement model, this work introduces a novel fault detection method, denoted the probabilistic inspection of topographic filter altitude likelihood (PITFAL) algorithm, that implements a statistical outlier rejection algorithm. PITFAL is designed for multi-beam slant range sensors, such as the Navigation Doppler LIDAR (NDL), and identifies statistically inconsistent range estimates through a consensus check on the set of apparent altitudes computed for each individual beam. These models are numerically validated by the Safe and Precise Landing Capability Evolution (SPLICE) project’s high-fidelity terrestrial and lunar lander simulations.

Davis W Adams↗

NASA NTRS2025

Topographic Slant Range Modeling and Fault Detection for Precision Planetary Landing

This work presents a novel landing site relative topographic measurement model for aslant range sensor being utilized for precision planetary landing operations. The measurement model accounts for the local terrain the slant range sensor captures and leverages knowledge of the estimated landing site provided by the navigation filter. Notably, in contrast to previous works, the new model does not rely on surface normal approximation, reducing the model’s sensitivity to noisy digital elevation maps which represent the local topography. In addition to the measurement model, this work introduces a novel fault detection method, denoted the probabilistic inspection of topographic filter altitude likelihood (PITFAL) algorithm, that implements a statistical outlier rejection algorithm. PITFAL is designed for multi-beam slant range sensors, such as the Navigation Doppler LIDAR (NDL), and identifies statistically inconsistent range estimates through a consensus check on the set of apparent altitudes computed for each individual beam. These models are numerically validated by the Safe and Precise Landing Capability Evolution (SPLICE) project’s high-fidelity terrestrial and lunar lander simulations.

Davis W Adams↗

NASA NTRSDate not supplied

On The Processing of Log Files for Monitoring Antenna Health

In order to improve the quality of geodetic results, we have developed an infrastructure for timely processing of telemetry from IVS observing stations. We check every hour for new log files with telemetry from both VLBI observing sessions, single dish experiments, and stow-in data collection and automatically process them. The telemetry data we use is the system temperature, phase calibration phases and amplitudes, system equivalent flux density, and the differences between formatter clock and GPS clock. For the system temperature and phase calibration, processing includes filtering out outliers and computing averages and rms of the scatter in each scan. Furthermore, for the phase calibration we also compute the group delay and detect spurious signals. Cleaned and post-processed telemetry is archived. Our process detects abnormalities, such as, anomalously high system temperature, unstable phase calibration phases, jumps in the GPS and formatter clock differences, and others. With our procedure, the latency of detection of station abnormalities is reduced to less than two hours. Early detection of abnormalities reduces the amount of affected data since station personnel get early alerts. We discuss our experience of running this system since 2022.

Phase Calibration↗

NASA NTRSDate not supplied

On The Processing of Log Files for Monitoring Antenna Health

In order to improve the quality of geodetic results, we have developed an infrastructure for timely processing of telemetry from IVS observing stations. We check every hour for new log files with telemetry from both VLBI observing sessions, single dish experiments, and stow-in data collection and automatically process them. The telemetry data we use is the system temperature, phase calibration phases and amplitudes, system equivalent flux density, and the differences between formatter clock and GPS clock. For the system temperature and phase calibration, processing includes filtering out outliers and computing averages and rms of the scatter in each scan. Furthermore, for the phase calibration we also compute the group delay and detect spurious signals. Cleaned and post-processed telemetry is archived. Our process detects abnormalities, such as, anomalously high system temperature, unstable phase calibration phases, jumps in the GPS and formatter clock differences, and others. With our procedure, the latency of detection of station abnormalities is reduced to less than two hours. Early detection of abnormalities reduces the amount of affected data since station personnel get early alerts. We discuss our experience of running this system since 2022.

VLBI↗

NASA NTRS2011

Multiple-Beam Detection of Fast Transient Radio Sources

A method has been designed for using multiple independent stations to discriminate fast transient radio sources from local anomalies, such as antenna noise or radio frequency interference (RFI). This can improve the sensitivity of incoherent detection for geographically separated stations such as the very long baseline array (VLBA), the future square kilometer array (SKA), or any other coincident observations by multiple separated receivers. The transients are short, broadband pulses of radio energy, often just a few milliseconds long, emitted by a variety of exotic astronomical phenomena. They generally represent rare, high-energy events making them of great scientific value. For RFI-robust adaptive detection of transients, using multiple stations, a family of algorithms has been developed. The technique exploits the fact that the separated stations constitute statistically independent samples of the target. This can be used to adaptively ignore RFI events for superior sensitivity. If the antenna signals are independent and identically distributed (IID), then RFI events are simply outlier data points that can be removed through robust estimation such as a trimmed or Winsorized estimator. The alternative "trimmed" estimator is considered, which excises the strongest n signals from the list of short-beamed intensities. Because local RFI is independent at each antenna, this interference is unlikely to occur at many antennas on the same step. Trimming the strongest signals provides robustness to RFI that can theoretically outperform even the detection performance of the same number of antennas at a single site. This algorithm requires sorting the signals at each time step and dispersion measure, an operation that is computationally tractable for existing array sizes. An alternative uses the various stations to form an ensemble estimate of the conditional density function (CDF) evaluated at each time step. Both methods outperform standard detection strategies on a test sequence of VLBA data, and both are efficient enough for deployment in real-time, online transient detection applications.

Thompson, David R.↗

NASA NTRS2005

Algorithm for Identifying Erroneous Rain-Gauge Readings

An algorithm analyzes rain-gauge data to identify statistical outliers that could be deemed to be erroneous readings. Heretofore, analyses of this type have been performed in burdensome manual procedures that have involved subjective judgements. Sometimes, the analyses have included computational assistance for detecting values falling outside of arbitrary limits. The analyses have been performed without statistically valid knowledge of the spatial and temporal variations of precipitation within rain events. In contrast, the present algorithm makes it possible to automate such an analysis, makes the analysis objective, takes account of the spatial distribution of rain gauges in conjunction with the statistical nature of spatial variations in rainfall readings, and minimizes the use of arbitrary criteria. The algorithm implements an iterative process that involves nonparametric statistics.

Rickman, Doug↗

NASA NTRS2013

Are Soft Short Tests Good Indicators of Internal Li-ion Cell Defects?

The self discharge test at full state of charge, may not be a good one to detect subtle defects since the li-ion chemistry has the highest self discharge at full state of charge. One should characterize self discharge versus storage time for each cell manufacturer/design to differentiate between normal self discharge and that due to a subtle manufacturing defect. The various soft short test methods indicate that if this test is carried out at full discharge (0% SOC) with all capacity removed (by lowering the current load in a stepwise manner to the same end of discharge voltage), then the cells need to be placed in storage for more than 72 hours to get a good analysis on the presence of subtle defects since it takes more than 72 hours to achieve voltage stabilization. If the cells are to be charged up even to a small percentage (ex. 1%), 72 hours are sufficient to determine issues. However, the pass/fail criteria should be based on a valid OCV decline. Less than 10 mV voltage decline is not a good method to detect subtle defects. As mentioned in the first bullet, self discharge is a competing reaction when a charge is introduced and hence a characterization of the self discharge versus storage time is required to fully correlate voltage decline to a failure due to a subtle defect. Soft short test method cannot be relied on for defect detection because cells with and without voltage decline seemed to have similar defects and characteristics. Screening methods such as internal resistance and capacity as well as a 3-sigma range for OCV, mass and dimensions should be used to screen out outliers. A very critical aspect in the understanding of subtle defects is to carry out destructive analysis of cells from every lot to confirm the quality of production and screen all cells and batteries in a stringent manner to have a high quality set of flight cells. Self Discharge Test: Fully charged cells shall be placed in Open circuit stand for 72 hours (OCV measurement twice a day); continue for total of 14 days with 1 reading per day 2. Soft Short Test 1: Fully charge; cells discharged to manufacturer's end of disch. Voltage (EODV) cutoff at C/5 rate; stand for 30 minutes; discharge with C/500 to the same EODV. stand for another 30 minutes; discharge the cells again using C/1000 current to the same EODV. OCV measurements twice a day for 72 hours and then for total of 14 days (data collection same as in 1.) 3. Soft Short Test 2: Fully charge; cells discharged to the manuf. EODV with a C/13 constant current; provide a 10 hour rest, discharge again to the same EODV with a current of C/250, provide a 10 hour rest, discharge again using a C/250 rate, provide a 24 hour rest, charge using C/250 to 3.15 V (for ~12 hours). OCV measurements twice a day for at 72 hours. (data collection same as in 1.) 4. Soft Short Test 3: Fully charge; cells shall be discharged using C/10 current to manuf. EODV. Allow the cell to remain at Open circuit for 10 seconds. Discharge the cell at C/20 rate to the same EODV, hold open circuit for 24 hours. Discharge the cells at C/200 rate to the same end of voltage cutoff and hold open circuit for 24 hours. Discharge the cells one more time at C/200 rate to the same EODV and hold open circuit for 36 hours. Charge at C/200 rate to 3.15 V and hold for 3 days. Record OCV during the open circuit stand periods every 12 hours and at the beginning and end of the 3 day hold (include the 12 hour OCV recording during this time also). Capacity Cycling: Cells with declining voltages - one cell from each manufacturer chosen for cycling Destructive Physical Analysis (DPA): Cells with and without decline chosen from each lot for DPA.

Jeevarajan, J.↗

NASA NTRS2011

Updating the Standard Spatial Observer for Contrast Detection

Watson and Ahmuada (2005) constructed a Standard Spatial Observer (SSO) model for foveal luminance contrast signal detection based on the Medelfest data (Watson, 1999). Here we propose two changes to the model, dropping the oblique effect from the CSF and using the cone density data of Curcio et al. (1990) to estimate the variation of sensitivity with eccentricity. Dropping the complex images, and using medians to exclude outlier data points, the SSO model now accounts for essentially all the predictable variance in the data, with an RMS prediction error of only 0.67 dB.

Ahumada, Albert J.↗

NASA NTRSDate not supplied

Anomaly Detection for the Roman Space Telescope Wide Field Instrument’s Science Data Processing Pipeline

The Roman Space Telescope (RST) Wide Field Instrument (WFI) will be utilizing a preliminary Science Data Processing (SDP) pipeline during its Integration and Test, and to some extent during Operations, to track basic statistics and identify known features such as cosmic rays, snowballs as well as possible anomalies in raw detector data. In our detectors, these anomalies appear as jumps in the ramp of a readout and are classified as cosmic rays if they appear as a streak or snowballs if they’re more circular. The WFI employs an array of 18 H4RG-10 detectors that collect image samples. Each set of raw frames within a non-destructive exposure is packaged by the SDP pipeline into image cubes for each detector. Each cube is a time series of 4096 × 4096 accumulating pixel frames. The preliminary analysis pipeline is used to locate anomalies in these time-series accumulation frames and identify the type of anomaly, either natural phenomena or detector characteristic. To compare different methods, we’ve implemented both heuristic-based and data-driven methods to identify anomalies. For the heuristic-based approach, we identify snowballs and cosmic rays by the size and shape of outlier pixel clusters between consecutive frames. For data driven methods, we evaluated a Convolutional Neural Network (CNN) model, and more traditional methods like Principal Component Analysis (PCA). CNN is a supervised learning/classification method. Thus, we used a labeled dataset of anomalies to perform segmentation of the image and identify anomalies. We used previously identified cosmic rays and snowballs to measure the accuracy and efficiency of the mentioned approaches. In evaluating these methods, we aim to pick the best fit for the SDP pipeline’s anomaly detection in terms of both performance and runtime.

Paul Horton↗

NASA NTRS2003

Water Ice Clouds in the Martian Atmosphere: A Comparison of Two Methods and Eras

Similar cloud features are seen in maps generated with each method with no obvious outliers. The temperature differencing method appears to possibly be somewhat more sensitive to weaker water ice signatures. We have also generated correlation plots comparing the two methods. At strong delta-T signals, the correlation between the two methods is quite good, and therefore extraction of opacities from earlier Viking data may be possible for these stronger detection levels. Weaker detections do not, however, show such a good correlation. We are currently analyzing why the correlation becomes poor at weak signal levels, though it may be due to the fact that the differencing method may be more sensitive to thin cloud hazes. Results of this ongoing analysis will be presented. A comparison of the Viking and Mars Global Surveyor (MGS) eras are also presented.

A S Hale↗

NASA NTRS2018

Maximum Sample Temperature for Mars Sample Return: A Historical Perspective

Since the first Mars Sample Return (MSR) report published by the Jet Propulsion Laboratory (JPL) in 1974 [1], a series of panels, reports, and white papers have recognized the importance of sample temperature and offered an informed sample maximum temperature (henceforth SMT) limit for returning martian samples to Earth. The Mars Sample Handling and Requirements Panel (MSHARP, 1999) stated that "[t]he main issue in sample preservation is temperature" [2]. More recently, the Mars Exploration Program Analysis Group (MEPAG)'s "Science Priorities for Mars Sample Return" report (2008), declared that "[s]ignificant loss, particularly to biological studies, occurs if samples reach +50C for three hours", whereby "scientific objectives related to life goals could be seriously compromised" [3]. By contrast, the Mars 2020 mission has adopted a SMT of +60C as spelled out in Beaty et al., 2016 [4]. Samples will be collected and then deposited on the surface in sealed tubes for possible retrieval and return to Earth. Beaty et al. [4] calculates that the samples will experience maximum temperatures of ~+30 to +60C, depending on latitude. At present, there is no mission requirement for the measurement/data logging of sample temperature during this period. We will explore the history of martian SMTs, as they have been recorded since 1974 [1], effectively representing input across multiple generations of Mars scientists. Ten separate publications present SMTs for MSR samples [1-10]. One report [10] is for a mission concept specifically designed to exclude life detection investigations, and recommended an SMT of 50C. Another did not specify a temperature, recommending "Mars ambient temperature" [5]. Of the remaining eight, SMTs are given as: -30C [1], -20C [3], 60C [4], -73 to 41C depending on sample type [6], -40C [7], -43 to 13C depending on type [2,8], and -33C [9]. If we restrict the temperatures to samples highlighted in the Mars 2020 mission goals, i.e. organics-bearing and sedimentary rocks, then the average SMT is -28+/-39C (n=8). Applying a Dixon's Q Test at P=0.05 (two-tailed), the 60C SMT [4] fails with Q=0.602 versus Qcrit=0.526. Excluding the outlier produces an average SMT of -40+/-17C (n=7). Therefore, the average SMT expressed by the Mars science community over the past 44 years (two generations) is a sample temperature no greater than -40C. The difference in chemical reaction rates between this average SMT and Beaty et al [4] can be estimated using the Arrhenius equation. Assuming a generic chemical reaction with an activation energy of 50 kJ/mol and a pre-exponential factor invariant with temperature, this reaction will proceed 2300x faster at 60C than at -40C. To illustrate the effects of the increased reaction rate, consider 10 ppb of alanine in a Mars 2020 cache, and assume that it becomes unmeasurable if it degrades to 1 ppb, as per the Mars 2020 Organic Contamination Panel contamination limits [11]. If we illustrate the effect with an arbitrary degradation rate such that the alanine will become undetectable in ten years at -40C, then the same 10 ppb alanine degrades beyond detectability in only 38 days at 60C. Further research is required to quantify expected analyte losses in the cached samples due to thermal processing.

Fries, Marc↗

NASA NTRS2010

Material condition assessment with eddy current sensors

Eddy current sensors and sensor arrays are used for process quality and material condition assessment of conducting materials. In an embodiment, changes in spatially registered high resolution images taken before and after cold work processing reflect the quality of the process, such as intensity and coverage. These images also permit the suppression or removal of local outlier variations. Anisotropy in a material property, such as magnetic permeability or electrical conductivity, can be intentionally introduced and used to assess material condition resulting from an operation, such as a cold work or heat treatment. The anisotropy is determined by sensors that provide directional property measurements. The sensor directionality arises from constructs that use a linear conducting drive segment to impose the magnetic field in a test material. Maintaining the orientation of this drive segment, and associated sense elements, relative to a material edge provides enhanced sensitivity for crack detection at edges.

Goldfine, Neil J.↗

NASA NTRSDate not supplied

Empirical Hydrometeor Type Identification from GMI Brightness Temperature Measurements

Brightness temperatures (TB) from GMI and related sensors contain information about the types and amounts of precipitation particles in a column. Approaches like GPROF or machine learning are good for providing precipitation estimates and other quantified information, but it can be difficult to understand why / how a given set of TBs traces to a given retrieval solution. Outlier TBs that are not well-represented in a training sample can lead to dubious solutions. Our goal is to use the scattering signatures at multiple frequencies to determine whether hail is present, or otherwise graupel, or otherwise snow, or otherwise liquid rain without a substantial precipitation ice component. (A hierarchical approach is employed, so a prediction of hail can include the presence of all other categories, but a prediction of snow implies a lack of graupel or hail, and a prediction of liquid rain implies a lack of any detectable precipitation ice.)

Daniel J. Cecil↗

NASA NTRSDate not supplied

Hydrometeor Identification from GMI Radiometer, Trained Using Polarimetric Radar

Brightness temperatures (TB) from GMI and related sensors contain information about the types and amounts of precipitation particles in a column. Approaches like GPROF or machine learning are good for providing precipitation estimates and other quantified information, but it can be difficult to understand why / how a given set of TBs traces to a given retrieval solution. Outlier TBs that are not well-represented in a training sample can lead to dubious solutions. Our goal is to use the scattering signatures at multiple frequencies to determine whether hail is present, or otherwise graupel, or otherwise snow, or otherwise liquid rain without a substantial precipitation ice component. (A hierarchical approach is employed, so a prediction of hail can include the presence of all other categories, but a prediction of snow implies a lack of graupel or hail, and a prediction of liquid rain implies a lack of any detectable precipitation ice.)

Daniel J. Cecil↗