Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “false positive analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Toward Intelligent Software Defect Detection

Source code level software defect detection has gone from state of the art to a software engineering best practice. Automated code analysis tools streamline many of the aspects of formal code inspections but have the drawback of being difficult to construct and either prone to false positives or severely limited in the set of defects that can be detected. Machine learning technology provides the promise of learning software defects by example, easing construction of detectors and broadening the range of defects that can be found. Pinpointing software defects with the same level of granularity as prominent source code analysis tools distinguishes this research from past efforts, which focused on analyzing software engineering metrics data with granularity limited to that of a particular function rather than a line of code.

Benson, Markland J.↗

Fairfax Water Resources: Estimating Urban Flood Susceptibility, Historical Flooding Extent, and Land Cover Change in Fairfax County, Virginia to Aid in Flood Mitigation Planning

Between 2000 and 2020, Fairfax County, Virginia experienced extreme weather events that caused severe flooding and degradation of roads, businesses, and other public property. A single flood event on July 8th, 2019 resulted in $14.8 million in damages. These flood events routinely impact the community, often resulting in power outages, school closures, and downed trees. The Fairfax County Department of Public Works and Environmental Services partnered with DEVELOP to explore how remotely sensed data could be integrated to support its current flood mitigation efforts. This project used environmental factors such as elevation, slope, and topographic wetness index from Earth observation derived data to map flood susceptibility. We utilized Landsat 5 Thematic Mapper (TM), Landsat 7 Enhanced Thematic Mapper Plus (ETM+), Landsat 8 Operational Land Imager (OLI), Sentinel-1 C-Band Synthetic Aperture Radar (C-SAR), and Sentinel-2 Multispectral Instrument (MSI) to map historic flooding events in Fairfax County. These maps will support flood management practices for the Fairfax County Department of Public Works and Environmental Services through the integration of remotely sensed data. Our results show that developed areas in the county are more susceptible to flooding, coinciding with analysis of flood factors, which indicated that imperviousness and tree canopy were the most influential drivers in flood susceptibility. Other results show that using Earth observations to map historical flooding is limited in urban areas due to false positives from SAR imagery between water and shadows. Further research is necessary to evolve the historical flood mapping technique if Earth observations are to be incorporated in future historical flood analysis.

Kaitlynn Hietpas↗

CST: A Tool for Optimizing the Efficiency and Effectiveness of Static-Code Analysis Tools

Static Code Analysis (SCA) is a vital component of NASA IV&V’s mission assurance for safety-critical software as it reduces the likelihood of software-induced hazards impacting mission success. Static Code Analysis achieves this by identifying hazards that may not have been otherwise detectable by typical code reviews or other testing. Using SCA tools, however, can be intimidating due to steep learning curves, especially considering tool performance and defect coverage varies greatly. Because of this variation amongst SCA tools, understanding which tools support certain defects and which do not, as well as understanding how to run an analysis based on steps that are unique to each tool, can be difficult to both new and experienced analysts alike. To mitigate this, the SCAWG or the IV&V Static Code Analysis Working Group, created the SCA Checker Taxonomy and Starting Point Profiles. The Checker Selection Tool (CST) incorporates these two SCAWG products into an interactive tool which allows the user to: select organized categories of defects they would like the SCA tools to discover, select default checkers depending on their mission type (e.g. flight), and configure multiple SCA tools at once. C/C++, Java, and Python defect checkers from four common SCA tools were utilized in this iteration of the CST. This iteration also includes the addition of training, SCA tool specific help, and taxonomy guide links, into its design to help users new to Static Code Analysis learn how to perform SCA more efficiently. The CST has been subject to beta testing by experienced static code analysts from the SCAWG to ensure a usable and accurate final product. The implications of the CST in the mission assurance of NASA safety-critical software are profound, as the CST can help identify and reduce false positives and false negatives, fundamentally improving overall SCA efficiency and accuracy.

static code analysis↗

Application of Fault Management Theory to the Quantitative Selection of a Launch Vehicle Abort Trigger Suite

The theory of System Health Management (SHM) and of its operational subset Fault Management (FM) states that FM is implemented as a "meta" control loop, known as an FM Control Loop (FMCL). The FMCL detects that all or part of a system is now failed, or in the future will fail (that is, cannot be controlled within acceptable limits to achieve its objectives), and takes a control action (a response) to return the system to a controllable state. In terms of control theory, the effectiveness of each FMCL is estimated based on its ability to correctly estimate the system state, and on the speed of its response to the current or impending failure effects. This paper describes how this theory has been successfully applied on the National Aeronautics and Space Administration's (NASA) Space Launch System (SLS) Program to quantitatively estimate the effectiveness of proposed abort triggers so as to select the most effective suite to protect the astronauts from catastrophic failure of the SLS. The premise behind this process is to be able to quantitatively provide the value versus risk trade‐off for any given abort trigger, allowing decision makers to make more informed decisions. All current and planned crewed launch vehicles have some form of vehicle health management system integrated with an emergency launch abort system to ensure crew safety. While the design can vary, the underlying principle is the same: detect imminent catastrophic vehicle failure, initiate launch abort, and extract the crew to safety. Abort triggers are the detection mechanisms that identify that a catastrophic launch vehicle failure is occurring or is imminent and cause the initiation of a notification to the crew vehicle that the escape system must be activated. While ensuring that the abort triggers provide this function, designers must also ensure that the abort triggers do not signal that a catastrophic failure is imminent when in fact the launch vehicle can successfully achieve orbit. That is, the abort triggers must have low false negative rates to be sure that real crew‐threatening failures are detected, and also low false positive rates to ensure that the crew does not abort from non‐crew‐threatening launch vehicle behaviors. The analysis process described in this paper is a compilation of over six years of lessons learned and refinements from experiences developing abort triggers for NASA's Constellation Program (Ares I Project) and the SLS Program, as well as the simultaneous development of SHM/FM theory. The paper will describe the abort analysis concepts and process, developed in conjunction with SLS Safety and Mission Assurance (S&MA) to define a common set of mission phase, failure scenario, and Loss of Mission Environment (LOME) combinations upon which the SLS Loss of Mission (LOM) Probabilistic Risk Assessment (PRA) models are built. This abort analysis also requires strong coordination with the Multi‐Purpose Crew Vehicle (MPCV) and SLS Structures and Environments (STE) to formulate a series of abortability tables that encapsulate explosion dynamics over the ascent mission phase. The design and assessment of abort conditions and triggers to estimate their Loss of Crew (LOC) Benefits also requires in‐depth integration with other groups, including Avionics, Guidance, Navigation and Control(GN&C), the Crew Office, Mission Operations, and Ground Systems. The outputs of this analysis are a critical input to SLS S&MA's LOC PRA models. The process described here may well be the first full quantitative application of SHM/FM theory to the selection of a sensor suite for any aerospace system.

Lo, Yunnhon↗

Data-driven landslide nowcasting at the global scale

Landslides affect nearly every country in the world each year. To better understand this global hazard, the Landslide Hazard Assessment for Situational Awareness (LHASA) model was developed previously. LHASA version 1 combines satellite precipitation estimates with a global landslide susceptibility map to produce a gridded map of potentially hazardous areas from 60° North-South every 3 h. LHASA version 1 categorizes the world’s land surface into three ratings: high, moderate, and low hazard with a single decision tree that first determines if the last seven days of rainfall were intense, then evaluates landslide susceptibility. LHASA version 2 has been developed with a data-driven approach. The global susceptibility map was replaced with a collection of explanatory variables, and two new dynamically varying quantities were added: snow and soil moisture. Along with antecedent rainfall, these variables modulated the response to current daily rainfall. In addition, the Global Landslide Catalog (GLC) was supplemented with several inventories of rainfall-triggered landslide events. These factors were incorporated into the machine-learning framework XGBoost, which was trained to predict the presence or absence of landslides over the period 2015–2018, with the years 2019–2020 reserved for model evaluation. As a result of these improvements, the new global landslide nowcast was twice as likely to predict the occurrence of historical landslides as LHASA version 1, given the same global false positive rate. Furthermore, the shift to probabilistic outputs allows users to directly manage the trade-off between false negatives and false positives, which should make the nowcast useful for a greater variety of geographic settings and applications. In a retrospective analysis, the trained model ran over a global domain for 5 years, and results for LHASA version 1 and version 2 were compared. Due to the importance of rainfall and faults in LHASA version 2, nowcasts would be issued more frequently in some tropical countries, such as Colombia and Papua New Guinea; at the same time, the new version placed less emphasis on arid regions and areas far from the Pacific Rim. LHASA version 2 provides a nearly real-time view of global landslide hazard for a variety of stakeholders.

XGBoos↗

Follow-up Imaging of Disk Candidates from the Disk Detective Citizen Science Project: New Discoveries and False Positives in WISE Circumstellar Disk Surveys

The Disk Detective citizen science project aims to find new stars with excess 22 m emission from circumstellar dust in the All WISE data release from the Wide-field Infrared Survey Explorer. We evaluated 261 Disk Detective objects of interest with imaging with the Robo-AO adaptive optics instrument on the 1.5 m telescope at Palomar Observatory and with RetroCam on the 2.5 m du Pont Telescope at Las Campanas Observatory to search for background objects at 0 15–12 separations from each target. Our analysis of these data leads us to reject 7% of targets. Combining this result with statistics from our online image classification efforts implies that at most7.9%±0.2% of All WISE-selected infrared excesses are good disk candidates. Applying our false-positive rates to other surveys, we find that the infrared excess searches of McDonald et al. and Marton et al. all have false-positiverates >70%. Moreover, we find that all 13 disk candidates in Theissen & West with W4 signal-to-noise ratio >3are false positives. We present 244 disk candidates that have survived vetting by follow-up imaging. Of these,213 are newly identified disk systems. Twelve of these are candidate members of comoving pairs based on Gaia astrometry, supporting the hypothesis that warm dust is associated with binary systems. We also note the discovery of 22 m excess around two known members of the Scorpius–Centaurus association, and we identifyknown disk host WISEA J164540.79-310226.6 as a likely Sco-Cen member. Thirty of these disk candidates arecloser than 125 pc (including 26 debris disks), making them good targets for both direct-imaging exoplanetsearches.

Wide-field Infrared Survey Explorer↗

Validation of Atmosphere/Ionosphere Signals Associated with Major Earthquakes by Multi-Instrument Space-Borne and Ground Observations

The latest catastrophic earthquake in Japan (March 2011) has renewed interest in the important question of the existence of pre-earthquake anomalous signals related to strong earthquakes. Recent studies have shown that there were precursory atmospheric/ionospheric signals observed in space associated with major earthquakes. The critical question, still widely debated in the scientific community, is whether such ionospheric/atmospheric signals systematically precede large earthquakes. To address this problem we have started to investigate anomalous ionospheric / atmospheric signals occurring prior to large earthquakes. We are studying the Earth's atmospheric electromagnetic environment by developing a multisensor model for monitoring the signals related to active tectonic faulting and earthquake processes. The integrated satellite and terrestrial framework (ISTF) is our method for validation and is based on a joint analysis of several physical and environmental parameters (thermal infrared radiation, electron concentration in the ionosphere, lineament analysis, radon/ion activities, air temperature and seismicity) that were found to be associated with earthquakes. A physical link between these parameters and earthquake processes has been provided by the recent version of Lithosphere-Atmosphere-Ionosphere Coupling (LAIC) model. Our experimental measurements have supported the new theoretical estimates of LAIC hypothesis for an increase in the surface latent heat flux, integrated variability of outgoing long wave radiation (OLR) and anomalous variations of the total electron content (TEC) registered over the epicenters. Some of the major earthquakes are accompanied by an intensification of gas migration to the surface, thermodynamic and hydrodynamic processes of transformation of latent heat into thermal energy and with vertical transport of charged aerosols in the lower atmosphere. These processes lead to the generation of external electric currents in specific regions of the atmosphere and the modifications, by dc electric fields, in the ionosphere-atmosphere electric circuit. We retrospectively analyzed temporal and spatial variations of four different physical parameters (gas/radon counting rate, lineaments change, long-wave radiation transitions and ionospheric electron density/plasma variations) characterizing the state of the lithosphere/atmosphere coupling several days before the onset of the earthquakes. Validation processes consist in two phases: A. Case studies for seven recent major earthquakes: Japan (M9.0, 2011), China (M7.9, 2008), Italy (M6.3, 2009), Samoa (M7, 2009), Haiti (M7.0, 2010) and, Chile (M8.8, 2010) and B. A continuous retrospective analysis was preformed over two different regions with high seismicity- Taiwan and Japan for 2003-2009. Satellite, ground surface, and troposphere data were obtained from Terra/ASTER, Aqua/AIRS, POES and ionospheric variations from DEMETER and COSMIC-I data. Radon and GPS/TEC were obtaining from monitoring sites in Taiwan, Japan and Italy and from global ionosphere maps (GIM) respectively. Our analysis of ground and satellite data during the occurrence of 7 global earthquakes has shown the presence of anomalies in the atmosphere. Our results for Tohoku M9.0 earthquake show that on March 7th, 2011 (4 days before the main shock and 1 day before the M7.2 foreshock of March 8, 2011) a rapid increase of emitted infrared radiation was observed by the satellite data and an anomaly was developed near the epicenter. The GPS/TEC data indicate an increase and variation in electron density reaching a maximum value on March 8. From March 3 to 11 a large increase in electron concentration was recorded at all four Japanese ground-based ionosondes, which returned to normal after the main earthquake. Similar approach for analyzing atmospheric and ionospheric parameters has been applied for China (M7.9, 2008), Italy (M6.3, 2009), Samoa (M7, 2009), Haiti (M7.0, 2010) and Chile (M8.8, 2010) eahquakes. Results have revealed the presence of related variations of these parameters implying their connection with the earthquake process. The second phase (B) of this validation included 102 major earthquakes (M>5.9) in Taiwan and Japan. We have found anomalous behavior before all of these events with no false negatives. False alarm ratio for false positives is less then 10% and has been calculated for the same month of the earthquake occurrence for the entire period of analysis (2003-2009). The commonalities for detecting atmospheric/ionospheric anomalies are: i.) Regularly appearance over regions of maximum stress (i.e., along plate boundaries); ii.) Anomaly existence over land and sea; and iii) association with M>5.9 earthquakes not deeper than 100km. Due to their long duration over the same region these anomalies are not consistent with a meteorological origin. Our initial results from the ISTF validation of multi-instrument space-borne and ground observations show a systematic appearance of atmospheric anomalies near the epicentral area, one to seven (average) days prior to the largest earthquakes, and suggest that it could be explained by a coupling process between the observed physical parameters and the pre-earthquake preparation processes.

Ouzounov, Dimitar↗

Predicting protein functions from redundancies in large-scale protein interaction networks

Interpreting data from large-scale protein interaction experiments has been a challenging task because of the widespread presence of random false positives. Here, we present a network-based statistical algorithm that overcomes this difficulty and allows us to derive functions of unannotated proteins from large-scale interaction data. Our algorithm uses the insight that if two proteins share significantly larger number of common interaction partners than random, they have close functional associations. Analysis of publicly available data from Saccharomyces cerevisiae reveals >2,800 reliable functional associations, 29% of which involve at least one unannotated protein. By further analyzing these associations, we derive tentative functions for 81 unannotated proteins with high certainty. Our method is not overly sensitive to the false positives present in the data. Even after adding 50% randomly generated interactions to the measured data set, we are able to recover almost all (approximately 89%) of the original associations.

Proteins/chemistry/metabolism↗

Visible - Near Infrared Spectral Indices for Mapping Mineralogy and Chemistry with OSIRIS-REx

The primary objective of the Origins, Spectral Interpretation, Resource Identification, SecurityRegolith Explorer (OSIRIS-REx) mission is to return to Earth a pristine sample of carbonaceous material from the primitive asteroid (101955) Bennu. To support compositional mapping as part of sample site selection and characterization, we tested 95 spectral parameters on visible to near infrared laboratory reflectance data of minerals and carbonaceous meteorites to find which of these parameters reliably identified spectral features of interest. Most spectral parameters had high positive detection rates when used on spectra of pure, single component materials. The meteorite spectra have fewer and weaker absorption features and, as a result, fewer detections with the spectral parameters. Parameters targeting absorptions at 0.7 and 2.7 – 3 µm, which arise due to hydrated minerals, were most successful for the meteorites. Based on these results, we have identified a set of 17 parameters that are most likely to be useful at Bennu and spectral analogs. These parameters detect olivines, pyroxenes, carbonates, water/OH-bearing minerals, serpentines, ferric minerals, and organics. Particle size and albedo are known to affect band depth but had a negligible impact on parameter accuracy. The effect of instrument-like noise added to the laboratory spectra can result in more false positive detections, but these exhibit large errors. Our study has determined the prioritization of spectral parameters used for OSIRISREx spectral analysis and mapping and informs the reliability of all parameter-derived data products.

Hannah H Kaplan↗

A Catalog of Kepler Habitable Zone Exoplanet Candidates

The NASA Kepler mission ha s discovered thousands of new planetary candidates, many of which have been confirmed through follow-up observations. A primary goal of the mission is to determine the occurrence rate of terrestrial-size planets within the Habitable Zone (HZ) of their host stars. Here we provide a list of HZ exoplanet candidates from the Kepler Q1–Q17 Data Release 24 data-vetting process. This work was undertaken as part of the Kepler HZ Working Group. We use a variety of criteria regarding HZ boundaries and planetary sizes to produce complete lists of HZ candidates, including a catalog of 104 candidates within the optimistic HZ and 20 candidates with radii less than two Earth radii within the conservative HZ. We cross-match our HZ candidates with the stellar properties and confirmed planet properties from Data Release 25 to provide robust stellar parameters and candidate dispositions. We also include false-positive probabilities recently calculated by Morton et al. for each of the candidates within our catalogs to aid in their validation. Finally, we performed dynamical analysis simulations for multi-planet systems that contain candidates with radii less than two Earth radii as a step toward validation of those systems.

Astrobiology↗

Obtaining Accurate Change Detection Results from High-Resolution Satellite Sensors

Multi-date acquisitions of high-resolution imaging satellites (e.g. GeoEye and WorldView), can display local changes of current economic interest. However, their large data volume precludes effective manual analysis, requiring image co-registration followed by image-to-image change detection, preferably with minimal analyst attention. We have recently developed an automatic change detection procedure that minimizes false-positives. The processing steps include: (a) Conversion of both the pre- and post- images to reflectance values (this step is of critical importance when different sensors are involved); reflectance values can be either top-of-atmosphere units or have full aerosol optical depth calibration applied using bi-directional reflectance knowledge. (b) Panchromatic band image-to-image co-registration, using an orthorectified base reference image (e.g. Digital Orthophoto Quadrangle) and a digital elevation model; this step can be improved if a stereo-pair of images have been acquired on one of the image dates. (c) Pan-sharpening of the multispectral data to assure recognition of change objects at the highest resolution. (d) Characterization of multispectral data in the post-image ( i.e. the background) using unsupervised cluster analysis. (e) Band ratio selection in the post-image to separate surface materials of interest from the background. (f) Preparing a pre-to-post change image. (g) Identifying locations where change has occurred involving materials of interest.

multispectral↗

The NANOGrav 11 yr data set: Evolution of Gravitational-wave Background Statistics

An ensemble of inspiraling supermassive black hole binaries should produce a stochastic background of very low frequency gravitational waves. This stochastic background is predicted to be a power law, with a gravitational-wave strain spectral index of −2/3, and it should be detectable by a network of precisely timed millisecond pulsars, widely distributed on the sky. This paper reports a new “time slicing” analysis of the 11 yr data release from the North American Nanohertz Observatory for Gravitational Waves (NANOGrav) using 34 millisecond pulsars. Methods to flag potential “false-positive” signatures are developed, including techniques to identify responsible pulsars. Mitigation strategies are then presented. We demonstrate how an incorrect noise model can lead to spurious signals, and we show how independently modeling noise across 30 Fourier components, spanning NANOGrav’s frequency range, effectively diagnoses and absorbs the excess power in gravitational-wave searches. This results in a nominal, and expected, progression of our gravitational-wave statistics. Additionally, we show that the first interstellar medium event in PSR J1713+0747 pollutes the common red-noise process with low spectral index noise, and we use a tailored noise model to remove these effects.

J S Hazboun↗

Advanced Ultrasonic Diagnosis of Extremity Trauma: The Faster Exam

Ultrasound is of prO)len accuracy in abdominal and thoracic trauma and may be useful to diagnose extremity injury in situations where radiography is not available such as military and space applications. We prospectively evaluated the utility of extremity , ultrasound performed by trained, non-physician personnel in patients with extremity trauma, to simulate remote aerospace or military applications . Methods: Patients with extremity trauma were identified by history, physical examination, and radiographic studies. Ultrasound examination was performed bilaterally by nonphysician personnel with a portable ultrasound device using a 10-5 MHz linear probe, Images were video-recorded for later analysis against radiography by Fisher's exact test. The average time of examination was 4 minutes. Ultrasound accurately diagnosed extremity, injury in 94% of patients with no false positive exams; accuracy was greater in mid-shaft locations and least in the metacarpa/metatarsals. Soft tissue/tendon injury was readily visualized . Extremity ultrasound can be performed quickly and accurately by nonphysician personnel with excellent accuracy. Blinded verification of the utility of ultrasound in patients with extremity injury should be done to determine if Extremity and Respiratory evaluation should be added to the FAST examination (the FASTER exam) and verify the technique in remote locations such as military and aerospace applications.

Dulchavsky, S. A.↗

Satellite Conjunction Assessment Risk Analysis for "Dilution Region" Events: Issues and Operational Approaches

An important activity within Space Traffic Management is the detection and prevention of possible on-orbit collisions between space objects. The principal parameter for assessing collision likelihood is the probability of collision, which is widely accepted among conjunction assessment practitioners; but it possesses a known deficiency in that it can produce a false sense of safety when the orbital position uncertainties for the conjuncting objects are high. The probability of collision is said to be “diluted” in such a situation and to understate the possible risk; certain approaches have been recommended by researchers to provide (largely conservative) risk estimates and remediation methodologies in these cases. The present analysis explores two of the main proposals for quantifying and remediating possible risk in the dilution region and quantifies their operational implications. These implications with regard to imputed additional workload are considerable, especially in anticipating the conjunction event levels expected with the deployment of the USAF Space Fence radar. This effort has been undertaken as part of a larger enterprise that seeks to clarify the philosophical and statistical underpinnings of the conjunction risk assessment process. The analysis presented herein argues that a form of hypothesis testing is implicitly used in conjunction assessment risk analysis, and that there are a number of conceptual and practical reasons for constructing the associated null hypothesis to counsel against a satellite conjunction remediation action. In short, it is concluded that, for the purposes of determining whether a conjunction remediation action should be pursued, dilution-region probabilities of collision should be treated no differently from those produced under other circumstances.

Probability of collision↗

Machine Learning-Based Atmospheric Phenomena Detection Platform

As the number of Earth pointing satellites has increased over the last several decades, the data volume retrieved from instruments onboard these satellites has also increased. It is expected that this trend will continue as more data intensive missions and small satellite constellations are launched. Currently, feature detection - namely atmospheric phenomena - in these datasets is performed manually and is thus not scalable with the growing data archives. Recent advancements in computational efficiency allow for the Earth science community to leverage machine learning to identify interesting atmospheric phenomena. Given the wide range of distinctive features in various atmospheric phenomena, a specialized machine learning model is required for accurate detection of these phenomena independently. The Phenomena Portal, developed at NASA IMPACT, is designed to provide visualization for the output from these machine learning models. In addition, detected events for each atmospheric phenomena are stored in a database that can be used to more easily use/subset larger spatiotemporal datasets. The user interface also incorporates additional features to enhance the user experience including spatiotemporal analysis, multiple base layer images, and a slider to filter events with lower probabilities of positive detection. Each detection supports user feedback on whether the detection is true or false that can then be stored and used to improve the machine learning model performance.

Gurung, Iksha↗

String Midpoint Monitoring for Li-Ion Batteries

The paper introduces the midpoint monitoring method for detecting cell voltage imbalance in a series string of 8 electrochemical cells. Monte Carlo analysis is performed for normal cell End of Discharge open and closed circuit voltage behavior to assess the extent to which derived guard band voltage limits will detect over discharged cells, provide false positive indication, or fail to detect over discharged cells. Forward work is proposed to refine the battery monitoring method for operational use in 28V lithium ion batteries.

Russell, S.↗

The effect of abnormal cell proportion on specimen classifier performance

An analysis is presented of the results obtained from a cell classifier which is confronted with an abnormal/normal cell ratio which is different from the ratio assumed in the calibration of the classifier. False negative and false positive error rates are determined in advance for classifier operation, along with the necessary sample size in order to validate the predicted distributions. Changes are demonstrated to happen only regarding the false negative rate, where reductions in the abnormal cell rate below the expected rates would cause totally unreliable data. Substantial overproduction of abnormal cells would be quickly noticeable, while production rates beyond, but close to, the expected rates would only require more extensive sampling. Classifier systems for 10% proportions of abnormal cells are concluded to be possible, but difficulties are present with much lower rates

Castleman, K. R.↗

Using Trajectory Smoothness Metrics to Identify Drones in Radar Track Data

The identification of unmanned aircraft systems (UAS) using trajectory data is considered. Specifically, a number of smoothness metrics are proposed, which can be used to distinguish UAS from other aerial objects even when they are engaged in accelerative maneuvers (non-constant-velocity flight). The metrics are evaluated on a data set from a UAS sense-and-avoid field test, which contains track data of aerial objects recorded by a vehicle-board radar system during a flight test. The metrics are found to effectively differentiate UAS from other objects such as birds for this data set. In addition, an initial statistical performance analysis of one of the smoothness metrics is undertaken, using 15 data sets deriving from multiple flight tests. The smoothness metric is shown to identify the target UAS with 95% accuracy (95% true positive rate), while achieving a false positive rate of less than 9%.

Sandip Roy↗