Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

Ice classification algorithm development and verification for the Alaska SAR Facility using aircraft imagery

The Alaska SAR Facility (ASF) at the University of Alaska, Fairbanks is a NASA program designed to receive, process, and archive SAR data from ERS-1 and to support investigations that will use this regional data. As part of ASF, specialized subsystems and algorithms to produce certain geophysical products from the SAR data are under development. Of particular interest are ice motion, ice classification, and ice concentration. This work focuses on the algorithm under development for ice classification, and the verification of the algorithm using C-band aircraft SAR imagery recently acquired over the Alaskan arctic.

Holt, Benjamin↗

SDSS IV MaNGA: visual morphological and statistical characterization of the DR15 sample

ABSTRACT We present a detailed visual morphological classification for the 4614 MaNGA galaxies in SDSS Data Release 15, using image mosaics generated from a combination of r band (SDSS and deeper DESI Legacy Surveys) images and their digital post-processing. We distinguish 13 Hubble types and identify the presence of bars and bright tidal debris. After correcting the MaNGA sample for volume completeness, we calculate the morphological fractions, the bi-variate distribution of type and stellar mass M* – where we recognize a morphological transition ‘valley’ around S0a-Sa types – and the variations of the g − i colour and luminosity-weighted age over this distribution. We identified bars in 46.8 per cent of galaxies, present in all Hubble types later than S0. This fraction amounts to a factor ∼2 larger when compared with other works for samples in common. We detected 14 per cent of galaxies with tidal features, with the fraction changing with M* and morphology. For 355 galaxies, the classification was uncertain; they are visually faint, mostly of low/intermediate masses, low concentrations, and discy in nature. Our morphological classification agrees well with other works for samples in common, though some particular differences emerge, showing that our image procedures allow us to identify a wealth of added value information as compared to SDSS-based previous estimates. Based on our classification, we also propose an alternative criteria for the E–S0 separation, in the structural semimajor to semiminor axis versus bulge to total light ratio (b/a − B/T) and concentration versus semimajor to semiminor axis (C − b/a) space.

Vázquez-Mata, J. A. (ORCID:0000000186941204)↗

Initial exploration of the ASRS database

We applied a standard classification algorithm to a subset of NASA/FAA Aviation Safety Reporting System (ASRS) database. The subset concerned incidents of aircraft altitude deviations. We are exploring the database to address questions such as: Are there 'natural' classes into which the data will fall? How would these classes correspond to recognizable events or situations? Beyond addressing these we want the data to determine directions for further study. We conducted experiments on different data subsections and analyzed diagnostics such as 'message length reduction'; these characterize the classification in terms of its significance and information content. The classification effort was successful in revealing relationships in the data that were in consonance with other studies of the data and expert opinion.

Kraft, Richard↗

Parallel sorting algorithm classification: is manual instrumentation necessary?

Understanding parallel algorithms is crucial for accelerating scientific simulations on complex, distributed memory, high-performance computers. Modern algorithm classification approaches learn semantics directly from source code to differentiate between algorithms, however, accessing source code is not always possible. We can learn about parallel algorithms from observing their performance, as programs running the same algorithms and using the same hardware should exhibit similar performance characteristics. We present an approach to learn algorithm classes from parallel performance data directly in order to classify algorithms without access to the source code. We extend previous work to enable classifying parallel sorting algorithms using automatic instrumentation instead of requiring manual region annotations in the source code. In this work, we design and demonstrate a study for classification of parallel sorting algorithms using parallel performance data collected from automatic instrumentation, and evaluate the performance of our new methodology on classification. We leverage Caliper to collect the performance data, Thicket for our exploratory data analysis (EDA), and PyTorch and Scikit-learn to evaluate the effectiveness of random forests, support vector machines (SVMs), decision trees, neural networks, and logistic regressions on parallel performance data. Additionally, we study noise in parallel performance data, whether the removal of noise and pre-processing of the data is necessary to accurately classify parallel sorting algorithms, and determine the effectiveness of features created from performance data. In conclusion, we demonstrate classification accuracy for these five different models of up to 97.7% across four different parallel algorithm classes.

Algorithm Classification↗

Radiometric responsivity determination for Feature Identification and Location Experiment (FILE) flown on space shuttle mission

A procedure was developed to obtain the radiometric (radiance) responsivity of the Feature Identification and Local Experiment (FILE) instrument in preparation for its flight on Space Shuttle Mission 41-G (November 1984). This instrument was designed to obtain Earth feature radiance data in spectral bands centered at 0.65 and 0.85 microns, along with corroborative color and color-infrared photographs, and to collect data to evaluate a technique for in-orbit autonomous classification of the Earth's primary features. The calibration process incorporated both solar radiance measurements and radiative transfer model predictions in estimating expected radiance inputs to the FILE on the Shuttle. The measured data are compared with the model predictions, and the differences observed are discussed. Application of the calibration procedure to the FILE over an 18-month period indicated a constant responsivity characteristic. This report documents the calibration procedure and the associated radiometric measurements and predictions that were part of the instrument preparation for flight.

Wilson, R. G.↗

NCUBE - A clustering algorithm based on a discretized data space

Cluster analysis involves the unsupervised grouping of data. The process provides an automatic procedure for generating known training samples for pattern classification. NCUBE, the clustering algorithm presented, is based upon the concept of imposing a gridwork on the data space. The NCUBE computer implementation of this concept provides an easily derived form of piecewise linear discrimination. This piecewise linear discrimination permits the separation of some types of data groups that are not linearly separable.

Eigen, D. J.↗

LANDSAT data for coastal zone management

The lack of adequate, current data on land and water surface conditions in New Jersey led to the search for better data collections and analysis techniques. Four-channel MSS data of Cape May County and access to the OSER computer interpretation system were provided by NASA. The spectral resolution of the data was tested and a surface cover map was produced by going through the steps of supervised classification. Topics covered include classification; change detection and improvement of spectral and spatial resolution; merging LANDSAT and map data; and potential applications for New Jersey.

Mckenzie, S.↗

The LANDSAT-1 multispectral scanner as a tool in the classification of inland lakes

Relationships between LANDSAT-1 multispectral scanner (MSS) data and the trophic status of a group of lakes in the north-northeastern part of the United States were studied by predicting the magnitudes of two trophic state indicators, estimating lake position on a multivariate trophic scale, and automatically classifying lakes according to their trophic state. Initially, the principal component ordination was employed with 100 lakes. MSS data for some 20 lakes was then extracted from computer-compatible tapes (CCT) using a binary marking technique. The output was in the form of descriptive statistics and photographic concatenations. Color ratios were incorporated into regression models for the prediction of Secchi disc transparency, chlorophyll a, and lake position on the tropic scale. Results indicate that the LANDSAT-1 system, although handicapped by low spectral and spatial resolutions as well as excessive cloud cover, can be used as a supplemental data source in lake survey programs.

Boland, D. H. P.↗

Using Spaceborne Ku-Band Scatterometer for Global Snow Cover Monitoring

We demonstrate for the first time the utility of spaceborne Ku-band scatterometer for global snow cover monitoring. Satellite radar data were collected over the globe by the NASA Scatterometer (NSCAT) operated at 14 GHz on board the Japanese ADEOS spacecraft from September 1996 to June 1997, spanning the 1997 seasonal snow season. First, we present backscatter signature of dry and wet snow to facilitate the interpretation of NSCAT backscatter evolution over snow cover regions. Surface field experiments indicated that dry snow backscatter at Ku band is approximately 40 times stronger than that at C band. Thus, Ku-band scatterometer measurements are sensitive to snow cover, which is typically transparent to C-band scatterometer returns. Furthermore, Ku-band backscatter does not saturate for most of natural snow depths as compared to radar responses at 19 GHz and 37 GHz or higher frequencies which have more limited penetration depths into snow. Ku-band backscatter is also sensitive to wetness in snow, which is appropriate to detect early snow melt conditions. Using the snow backscatter characteristics, we investigate NSCAT backscatter evolution over global snow cover regions throughout the 1997 snow season. The results reveal detail delineations between different regional snow areas. We show the correlation of these delineations with the boundaries of different global snow classes defined by the U.S. Army Cold Regions Research and Engineering Laboratory snow classification system. Using in-situ snow depth data from the U.S. National Climatic Data Center, we show that Ku-band backscatter corresponds very well to the trend of snow melt while snow mapping products (U.S. Climate Prediction Center gridded snow charts) from visible sensors does not reflect the fast snow melt trend. To illustrate the practical application of global snow monitoring with spaceborne Ku-band scatterometer, we present NSCAT backscatter response corresponding to the snow event leading to the 1997 Flood of the Century over the U.S. Northern plains and the Canadian prarie region, which caused loss of lives and several billion dollars in flood related damages and cleanup costs. Finally, we show that the fixed incidence configuration of Seawinds scatterometers, to be launched on QuickSCAT and on ADEOS-2 in the near future, is better for snow monitoring and then discuss the use of future high-resolution scatterometers for global snow mapping.

Nghiem, S. V.↗

Results of the Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC)

Abstract Next-generation surveys like the Legacy Survey of Space and Time (LSST) on the Vera C. Rubin Observatory (Rubin) will generate orders of magnitude more discoveries of transients and variable stars than previous surveys. To prepare for this data deluge, we developed the Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC), a competition that aimed to catalyze the development of robust classifiers under LSST-like conditions of a nonrepresentative training set for a large photometric test set of imbalanced classes. Over 1000 teams participated in PLAsTiCC, which was hosted in the Kaggle data science competition platform between 2018 September 28 and 2018 December 17, ultimately identifying three winners in 2019 February. Participants produced classifiers employing a diverse set of machine-learning techniques including hybrid combinations and ensemble averages of a range of approaches, among them boosted decision trees, neural networks, and multilayer perceptrons. The strong performance of the top three classifiers on Type Ia supernovae and kilonovae represent a major improvement over the current state of the art within astronomy. This paper summarizes the most promising methods and evaluates their results in detail, highlighting future directions both for classifier development and simulation needs for a next-generation PLAsTiCC data set.

79 ASTRONOMY AND ASTROPHYSICS↗

Testing of the Support Vector Machine for Binary-Class Classification

The Support Vector Machine is a powerful algorithm, useful in classifying data in to species. The Support Vector Machines implemented in this research were used as classifiers for the final stage in a Multistage Autonomous Target Recognition system. A single kernel SVM known as SVMlight, and a modified version known as a Support Vector Machine with K-Means Clustering were used. These SVM algorithms were tested as classifiers under varying conditions. Image noise levels varied, and the orientation of the targets changed. The classifiers were then optimized to demonstrate their maximum potential as classifiers. Results demonstrate the reliability of SMV as a method for classification. From trial to trial, SVM produces consistent results

autonomous target recognition systemr↗

Preliminary Assessment of JERS-1 SAR to Discriminating Boreal Landscape Features for the Boreal Forest Mapping Project

This paper presents an overview of the JERS-1 North American Boreal Forest Mapping Project and a preliminary assessment of JERS-1 SAR imagery for application to discriminating features applicable to boreal landscape processes. The present focus of the JERS-1 North American Boreal Forest Mapping Project is the production of continental scale wintertime and summertime SAR mosaics of the North American boreal forest for distribution to the science community. As part of this effort, JERS-1 imagery has been collected over much of Alaska and Canada during the 1997-98 winter and 1998 summer seasons. To complete the mosaics, these data will be augmented with data collected during previous years. These data will be made available to the scientific community via CD ROM containing these and similar data sets compiled from companion studies of Asia and Europe. Regional landscape classification with SAR is important for the baseline information it will provide about distribution of woodlands, positions of treeline, current forest biomass, distribution of wetlands, and extent of major rivercourses. As well as setting the stage for longer term change detection, comparisons across several years provides additional baseline information about short-term landscape change. Rapid changes, including those driven by fire, permafrost heat balance, flooding, and insect outbreaks can dominate boreal systems. We examine JERS-1 imagery covering selected sites in Alaska and Canada to assess quality and applicability to such relevant ecological and hydrological issues. The data are generally of high quality and illustrate many potential applications. A texture-based classification scheme is applied to selected regions to assess the applicability of these data for distinguishing distribution of such landcover types as wetland, tundra, woodland and forested landscapes.

McDonald, Kyle↗

Unified architecture for data-driven metadata tagging of building automation systems

This article presents a Unified Architecture (UA) for automated point tagging of Building Automation System (BAS) data, based on a combination of data-driven approaches. Advanced energy analytics applications—including fault detection and diagnostics and supervisory control—have emerged as a significant opportunity for improving the performance of our built environment. Effective application of these analytics depends on harnessing structured data from the various building control and monitoring systems, but typical BAS implementations do not employ any standardized metadata schema. While standards such as Project Haystack and Brick Schema have been developed to address this issue, the process of structuring the data, i.e., tagging the points to apply a standard metadata schema, has, to date, been a manual process. This process is typically costly, labor-intensive, and error-prone. In this work we address this gap by proposing a UA that automates the process of point tagging by leveraging the data accessible through connection to the BAS, including time-series data and the raw point names. The UA intertwines supervised classification and unsupervised clustering techniques from machine learning and leverages both their deterministic and probabilistic outputs to inform the point tagging process. Furthermore, we extend the UA to embed additional input and output data-processing modules that are designed to address the challenges associated with the real-time deployment of this automation solution. We test the UA on two datasets for real-life buildings: (i) commercial retail buildings and (ii) office buildings from the National Renewable Energy Laboratory (NREL) campus. We report the proposed methodology correctly applied 85–90% and 70–75% of the tags in each of these test scenarios, respectively for two significantly different building types used for testing UA's fully-functional prototype. The proposed UA, therefore, offers promising approach for automatically tagging BAS data as it reaches close to 90% accuracy. Further building upon this framework to algorithmically identify the equipment type and their relationships is an apt future research direction to pursue.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A vegetational and ecological resource analysis from space and high flight photography

A hierarchial classification of vegetation and related resources is considered that is applicable to convert remote sensing data in space and aerial synoptic photography. The numerical symbolization provides for three levels of vegetational classification and three levels of classification of environmental features associated with each vegetational class. It is shown that synoptic space photography accurately projects how urban sprawl affects agricultural land use areas and ecological resources.

Poulton, C. E.↗

Deep Learning for Automated Detection and Identification of Migrating American Eel Anguilla rostrata from Imaging Sonar Data

Adult American eels (Anguilla rostrata) are vulnerable to hydropower turbine mortality during outmigration from growth habitat in inland waters to the ocean where they spawn. Imaging sonar is a reliable and proven technology for monitoring of fish passage and migration; however, there is no efficient automated method for eel detection. We designed a deep learning model for automated detection of adult American eels from sonar data. The method employs convolution neural network (CNN) to distinguish between 14 images of eels and non-eel objects. Prior to image classification with CNN, background subtraction and wavelet denoising were applied to enhance sonar images. The CNN model was first trained and tested on data obtained from a laboratory experiment, which yielded overall accuracies of >98% for image-based classification. Then, the model was trained and tested on field data that were obtained near the Iroquois Dam located on the St. Lawrence River; the accuracy achieved was commensurate with that of human experts.

13 HYDRO ENERGY↗

Computer analysis of X-band radar data

The effectiveness of using currently available computer techniques for interpretation of MSS data to interpret SAR imagery for forest monitoring was assessed. Data were gathered with NASA's airborne APQ-102 dual-polarized, X-band SAR in a flight at 60,000 ft. Microdensitometry was employed to digitize the HH- and HV-polarized imagery. A ground spatial resolution of 15 m was obtained, control points were identified, a second order biquadratic transformation was applied to compensate for orientation, and rms errors were calculated. A second data set was taken with 30 m resolution in order to simulate thematic mapper operation. Classification was performed with pixel-by-pixel and textural classification algorithms. A statistical analysis was also carried out to find any significant differences between classifiers in a data set for a given classifier. Each polarization featured an independent distortion which required appropriate preprocessing to correct. Further studies are recommended with multiple frequencies viewing and multiple polarizations and look angles to define the actual forest classifications that can be made with the SAR imagery.

Knowlton, D. J.↗

The ERTS-1 investigation (ER-600): A compendium of analysis results of the utility of ERTS-1 data for land resources management

The results of the ERTS-1 investigations conducted by the Earth Observations Division at the NASA Lyndon B. Johnson Space Center are summarized in this report, which is an overview of documents detailing individual investigations. Conventional image interpretation and computer-aided classification procedures were the two basic techniques used in analyzing the data for detecting, identifying, locating, and measuring surface features related to earth resources. Data from the ERTS-1 multispectral scanner system were useful for all applications studied, which included agriculture, coastal and estuarine analysis, forestry, range, land use and urban land use, and signature extension. Percentage classification accuracies are cited for the conventional and computer-aided techniques.

Erb, R. B.↗

Mitigating Algorithmic Bias in Cancer Site Classification Models

Purpose Integrating artificial intelligence in cancer diagnostics has improved tumor classification beyond rule-based systems. Despite these advancements, these models may still encode demographic biases. We conducted a large-scale, applied bias-probing study of a deep learning–based cancer site classifier to quantify race information encoded in document embeddings. We then evaluated how performance changes when race-correlated embedding dimensions are removed in a post-training sensitivity analysis. Methods The cancer site classifier was trained using 3.5 million electronic cancer pathology reports from six of the National Cancer Institute's SEER registries. We trained a hierarchical self-attention network to generate 400-dimensional document embeddings. These embeddings were used to train two downstream, gradient-boosted decision tree classifiers: one to classify the cancer sites and another to predict racial categories. We identified overlapping features by intersecting the top 50 feature-importance rankings from the site and race models and computed their cumulative feature importance in each model. As a post hoc sensitivity analysis, we progressively pruned these overlapping dimensions, retrained the site model, and compared overall macro-F1 and accuracy, race-stratified macro-F1, and group fairness metrics on the basis of demographic parity and equalized odds before and after pruning. Results The analysis revealed minimal feature overlap between the cancer site and race prediction models, and the cumulative importance scores indicated a negligible influence of racial information on clinical predictions. Post-training pruning of overlapping features did not compromise the models' diagnostic accuracy, with a 0.07% loss in accuracy. Conclusion Our findings demonstrate that HiSAN-generated embeddings from SEER data can be used effectively in cancer site classification without significant demographic bias influencing the outcomes. Post-training pruning therefore functions as a practical audit and sensitivity check.

Shivanna, Abhishek [ORNL] (ORCID:0009000665228593)↗