Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Classification bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Selecting class weights to minimize classification bias in acreage estimation

Preliminary results of experiments being performed to select optimal class weights for use with the maximum likelihood classifier in acreage estimation using remote sensor imagery are presented. These weights will be optimal in the sense that the bias will be minimized in the proportion estimate obtained from the classification results by sample counting. The procedure was tested using Landsat MSS data from an 8 by 9.6 km area of ground truth in Finney County, Kansas.

Belcher, W. M.↗

Crop identification technology assessment for remote sensing (CITARS). Volume 10: Interpretation of results

The CITARS was an experiment designed to quantitatively evaluate crop identification performance for corn and soybeans in various environments using a well-defined set of automatic data processing (ADP) techniques. Each technique was applied to data acquired to recognize and estimate proportions of corn and soybeans. The CITARS documentation summarizes, interprets, and discusses the crop identification performances obtained using (1) different ADP procedures; (2) a linear versus a quadratic classifier; (3) prior probability information derived from historic data; (4) local versus nonlocal recognition training statistics and the associated use of preprocessing; (5) multitemporal data; (6) classification bias and mixed pixels in proportion estimation; and (7) data with differnt site characteristics, including crop, soil, atmospheric effects, and stages of crop maturity.

Bizzell, R. M.↗

The intercrater plains of Mercury and the Moon: Their nature, origin and role in terrestrial planet evolution. Measurement and errors of crater statistics

Planetary imagery techniques, errors in measurement or degradation assignment, and statistical formulas are presented with respect to cratering data. Base map photograph preparation, measurement of crater diameters and sampled area, and instruments used are discussed. Possible uncertainties, such as Sun angle, scale factors, degradation classification, and biases in crater recognition are discussed. The mathematical formulas used in crater statistics are presented.

Leake, M. A.↗

Creating a Canonical Scientific and Technical Information Classification System for NCSTRL+

The purpose of this paper is to describe the new subject classification system for the NCSTRL+ project. NCSTRL+ is a canonical digital library (DL) based on the Networked Computer Science Technical Report Library (NCSTRL). The current NCSTRL+ classification system uses the NASA Scientific and Technical (STI) subject classifications, which has a bias towards the aerospace, aeronautics, and engineering disciplines. Examination of other scientific and technical information classification systems showed similar discipline-centric weaknesses. Traditional, library-oriented classification systems represented all disciplines, but were too generalized to serve the needs of a scientific and technically oriented digital library. Lack of a suitable existing classification system led to the creation of a lightweight, balanced, general classification system that allows the mapping of more specialized classification schemes into the new framework. We have developed the following classification system to give equal weight to all STI disciplines, while being compact and lightweight.

Tiffany, Melissa E.↗

Uncertainty methodology for in-flight thrust determination

A methodology is proposed for the evaluation of uncertainty in the in-flight determination of aircraft thrust, which provides error traceability to a national standards laboratory, and is independent of the procedure used to calculate or measure thrust in flight, thereby yielding a consistent means for the evaluation of measurement capabilities. Attention is given to the factors of measurement error, precision, bias, uncertainty, error estimation and classification, error propagation, ground testing, and the related problems of model bias error, model precision error, and the uncertainty limit.

Adams, G. R.↗

An ad hoc map evaluation procedure

An ad hoc map evaluation procedure is proposed which is most suitable for evaluating low-resolution classification maps against high resolution ground truth maps, such as maps against interpreted aircraft photographs. Commonly practiced sampling and evaluation procedures are impracticable in this context because of difficulties in registration and in comparing the samples. This ad hoc procedure is designed to overcome these two major problems, and its practicability is discussed. Two widely accepted parameters are estimated by the new procedure; namely, the probability of correct classification and the proportion biases. Statistical qualifications are also provided.

Kan, E. P.↗

The Dark Energy Survey Supernova Programme: Modelling Selection Efficiency and Observed Core-collapse Supernova Contamination

The analysis of current and future cosmological surveys of Type Ia supernovae (SNe Ia) at high redshift depends on the accuratephotometric classification of the SN events detected. Generating realistic simulations of photometric SN surveys constitutes anessential step for training and testing photometric classification algorithms, and for correcting biases introduced by selectioneffects and contamination arising from core-collapse SNe in the photometric SN Ia samples. We use published SN time-seriesspectrophotometric templates, rates, luminosity functions, and empirical relationships between SNe and their host galaxies toconstruct a framework for simulating photometric SN surveys. We present this framework in the context of the Dark EnergySurvey (DES) 5-yr photometric SN sample, comparing our simulations of DES with the observed DES transient populations.We demonstrate excellent agreement in many distributions, including Hubble residuals, between our simulations and data.We estimate the core collapse fraction expected in the DES SN sample after selection requirements are applied and beforephotometric classification. After testing different modelling choices and astrophysical assumptions underlying our simulation,we find that the predicted contamination varies from 7.2 to 11.7 per cent, with an average of 8.8 per cent and an r.m.s. of 1.1 percent. Our simulations are the first to reproduce the observed photometric SN and host galaxy properties in high-redshift surveyswithout fine-tuning the input parameters. The simulation methods presented here will be a critical component of the cosmologyanalysis of the DES photometric SN Ia sample: correcting for biases arising from contamination, and evaluating the associatedsystematic uncertainty.

M Vincenzi↗

Evaluation of signature extension algorithms

The author has identified the following significant results. One of the major findings was that nearly all of the bias in the proportion estimates of the multisegment training and classification procedure resulted from the particular configuration of the signature set used for classification, rather than from peculiarities of the recognition sample segments. This meant that the proportion estimation bias could be accurately corrected simply by estimating the bias on the original six training segments. The bias corrected proportion estimates of the multisegment training and classification procedure were extremely accurate and had a low variance when compared to local training and classification. This finding may have important ramifications for reducing the cost and increasing the accuracy of bias correction procedures.

Nalepka, R. F.↗

Some properties of the Svalgaard A/C index

Several properties of the A/C index of polar cap variations introduced by L. Svalgaard in 1972 have been found to vary with time. In the presatellite era, C days, as measured by the Ap index, are almost twice as geomagnetically active as A days, while in the modern epoch they have essentially identical activity. Prior to 1962 there were over 40% more A days than C days per year, while during the modern epoch there are essentially equal numbers of A days and C days. In view of this strong bias to assigning a 'toward' classification on geomagnetically active days it is recommended that the Svalgaard A/C classification not be used in studies of geomagnetic activity. It is also recommended that a full and thorough documentation of the index be prepared and/or that others undertake to compile such a classification separately.

Russell, C. T.↗

TRMM Precipitation Radar Reflectivity Profiles Compared to High-Resolution Airborne and Ground-Based Radar Measurements

In this paper, TRMM (Tropical Rainfall Measuring Mission Satellite) Precipitation Radar (PR) products are evaluated by means of simultaneous comparisons with data from the high-altitude ER-2 Doppler Radar (EDOP), as well as ground-based radars. The comparison is aimed primarily at the vertical reflectivity structure, which is of key importance in TRMM rain type classification and latent heating estimation. The radars used in this study have considerably different viewing geometries and resolutions, demanding non-trivial mapping procedures in common earth-relative coordinates. Mapped vertical cross sections and mean profiles of reflectivity from the PR, EDOP, and ground-based radars are compared for six cases. These cases cover a stratiform frontal rainband, convective cells of various sizes and stages, and a hurricane. For precipitating systems that are large relative to the PR footprint size, PR reflectivity profiles compare very well to high-resolution measurements thresholded to the PR minimum reflectivity, and derived variables such as bright band height and rain types are accurate, even at high PR incidence angles. It was found that for, the PR reflectivity of convective cells small relative to the PR footprint is weaker than in reality. Some of these differences can be explained by non-uniform beam filling. For other cases where strong reflectivity gradients occur within a PR footprint, the reflectivity distribution is spread out due to filtering by the PR antenna illumination pattern. In these cases, rain type classification may err and be biased towards the stratiform type, and the average reflectivity tends to be underestimated. The limited sensitivity of the PR implies that the upper regions of precipitation systems remain undetected and that the PR storm top height estimate is unreliable, usually underestimating the actual storm top height. This applies to all cases but the discrepancy is larger for smaller cells where limited sensitivity is compounded by incomplete beam filling. Users of level three TRMM PR products should be aware of this scale dependency.

Heymsfield, G. M.↗

Bias and design in software specifications

Implementation bias in a specification is an arbitrary constraint in the solution space. Presented here is a model of bias in software specifications. Bias is defined in terms of the specification process and a classification of the attributes of the software product. Our definition of bias provides insight into both the origin and the consequences of bias. It also shows that bias is relative and essentially unavoidable. Finally, we describe current work on defining a measure of bias, formalizing our model, and relating bias to software defects.

Straub, Pablo A.↗

CALIPSO Lidar Level 3 Aerosol Profile Product: Version 3 Algorithm Design

The CALIPSO (Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations) level 3 aerosol profile product reports globally gridded, quality-screened, monthly mean aerosol extinction profiles retrieved by CALIOP (the Cloud-Aerosol Lidar with Orthogonal Polarization). This paper describes the quality screening and averaging methods used to generate the version 3 product. The fundamental input data are CALIOP level 2 aerosol extinction profiles and layer classification information (aerosol, cloud, and clear-air). Prior to aggregation, the extinction profiles are quality-screened by a series of filters to reduce the impact of layer detection errors, layer classification errors, extinction retrieval errors, and biases due to an intermittent signal anomaly at the surface. The relative influence of these filters are compared in terms of sample rejection frequency, mean extinction, and mean aerosol optical depth (AOD). The “extinction QC flag” filter is the most influential in preventing high-biases in level 3 mean extinction, while the “misclassified cirrus fringe” filter is most aggressive at rejecting cirrus misclassified as aerosol. The impact of quality screening on monthly mean aerosol extinction is investigated globally and regionally. After applying quality filters, the level 3 algorithm calculates monthly mean AOD by vertically integrating the monthly mean quality-screened aerosol extinction profile. Calculating monthly mean AOD by integrating the monthly mean extinction profile prevents a low bias that would result from alternately integrating the set of extinction profiles first and then averaging the resultant AOD values together. Ultimately, the quality filters reduce level 3 mean AOD by −24 and −31 % for global ocean and global land, respectively, indicating the importance of quality screening.

Tackett, Jason L.↗

Sampling for area estimation - A comparison of full-frame sampling with the sample segment approach

The objective of this investigation was to evaluate the effect of sampling on the accuracy (precision and bias) of crop area estimates made from classifications of Landsat MSS data. Full-frame classifications of wheat and non-wheat for eighty counties in Kansas were repetitively sampled to simulate alternative sampling plans. Four sampling schemes involving different numbers of samples and different size sampling units were evaluated. The precision of the wheat area estimates increased as the segment size decreased and the number of segments was increased. Although the average bias associated with the various sampling schemes was not significantly different, the maximum absolute bias was directly related to sampling unit size.

Hixson, M. M.↗

Sampling for area estimation: A comparison of full-frame sampling with the sample segment approach

The effect of sampling on the accuracy (precision and bias) of crop area estimates made from classifications of LANDSAT MSS data was investigated. Full-frame classifications of wheat and non-wheat for eighty counties in Kansas were repetitively sampled to simulate alternative sampling plants. Four sampling schemes involving different numbers of samples and different size sampling units were evaluated. The precision of the wheat area estimates increased as the segment size decreased and the number of segments was increased. Although the average bias associated with the various sampling schemes was not significantly different, the maximum absolute bias was directly related to sampling unit size.

Hixson, M. M.↗

An automated and repeatable data analysis procedure for remote sensing applications

A new multispectral data analysis procedure, based on LARSYS, has been developed which substantially reduces the influence of the analyst. The analysis is automated, including the interpretation of clustering results. The classification results obtained are repeatable and not biased by analyst subjectivity during the analysis.

Davis, B. J.↗

NASA Guidelines for Promoting Scientific and Research Integrity

The National Aeronautics and Space Administration (NASA) seeks to explore and expand human knowledge of the Earth, solar system, and universe and to enable the development of aeronautical and space exploration systems. NASA's ability to achieve these purposes depends on the integrity of the research and technology activities the agency conducts and supports. The NASA workforce - as well as all external entities who review proposals for or receive NASA funding - must maintain the highest standards of scientific integrity. These responsibilities include selecting the most meritorious research activities through open and fair competition, peer review and other appropriate merit review processes, and avoidance of actual and perceived conflicts of interest; avoiding fabrication, falsification, or plagiarism in proposing, performing, or reviewing research, or in reporting research results; openly sharing results and methods not subject to classification or privacy standards; disclosing assumptions and biases in sharing and applying scientific information and data; and acting honestly and transparently in using and serving on advisory committees and in engaging in professional development activities.

Guidelines↗

Large Area Crop Inventory Experiment (LACIE). Review of LACIE methodology, a project evaluation of technical acceptability

The author has identified the following significant results. Results indicated that the LANDSAT data and the classification technology can estimate the small grains area within a sample segment accurately and reliably enough to meet the LACIE goals. Overall, the LACIE estimates in a 9 x 11 kilometer segment agree well with ground and aircraft determined area within these segments. The estimated c.v. of the random classification error was acceptably small. These analyses confirmed that bias introduced by various factors, such as LANDSAT spatial resolution, lack of spectral resolution, classifier bias, and repeatability, was not excessive in terms of the required performance criterion. Results of these tests did indicate a difficulty in differentiating wheat from other closely related small grains. However, satisfactory wheat area estimates were obtained through the reduction of the small grain area estimates in accordance with relative amounts of these crops as determined from historic data; these procedures are being further refined.

Source record↗

Satellite Sampling and Retrieval Errors in Regional Monthly Rain Estimates from TMI AMSR-E, SSM/I, AMSU-B and the TRMM PR

Passive and active microwave rain sensors onboard earth-orbiting satellites estimate monthly rainfall from the instantaneous rain statistics collected during satellite overpasses. It is well known that climate-scale rain estimates from meteorological satellites incur sampling errors resulting from the process of discrete temporal sampling and statistical averaging. Sampling and retrieval errors ultimately become entangled in the estimation of the mean monthly rain rate. The sampling component of the error budget effectively introduces statistical noise into climate-scale rain estimates that obscure the error component associated with the instantaneous rain retrieval. Estimating the accuracy of the retrievals on monthly scales therefore necessitates a decomposition of the total error budget into sampling and retrieval error quantities. This paper presents results from a statistical evaluation of the sampling and retrieval errors for five different space-borne rain sensors on board nine orbiting satellites. Using an error decomposition methodology developed by one of the authors, sampling and retrieval errors were estimated at 0.25 resolution within 150 km of ground-based weather radars located at Kwajalein, Marshall Islands and Melbourne, Florida. Error and bias statistics were calculated according to the land, ocean and coast classifications of the surface terrain mask developed for the Goddard Profiling (GPROF) rain algorithm. Variations in the comparative error statistics are attributed to various factors related to differences in the swath geometry of each rain sensor, the orbital and instrument characteristics of the satellite and the regional climatology. The most significant result from this study found that each of the satellites incurred negative longterm oceanic retrieval biases of 10 to 30%.

Fisher, Brad↗