Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

‘Flux+Mutability’: a conditional generative approach to one-class classification and anomaly detection

Abstract Anomaly Detection is becoming increasingly popular within the experimental physics community. At experiments such as the Large Hadron Collider, anomaly detection is growing in interest for finding new physics beyond the Standard Model. This paper details the implementation of a novel Machine Learning architecture, called Flux+Mutability, which combines cutting-edge conditional generative models with clustering algorithms. In the ‘flux’ stage we learn the distribution of a reference class. The ‘mutability’ stage at inference addresses if data significantly deviates from the reference class. We demonstrate the validity of our approach and its connection to multiple problems spanning from one-class classification to anomaly detection. In particular, we apply our method to the isolation of neutral showers in an electromagnetic calorimeter and show its performance in detecting anomalous dijets events from standard QCD background. This approach limits assumptions on the reference sample and remains agnostic to the complementary class of objects of a given problem. We describe the possibility of dynamically generating a reference population and defining selection criteria via quantile cuts. Remarkably this flexible architecture can be deployed for a wide range of problems, and applications like multi-class classification or data quality control are left for further exploration.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DeepAstroUDA: semi-supervised universal domain adaptation for cross-survey galaxy morphology classification and anomaly detection

Abstract Artificial intelligence methods show great promise in increasing the quality and speed of work with large astronomical datasets, but the high complexity of these methods leads to the extraction of dataset-specific, non-robust features. Therefore, such methods do not generalize well across multiple datasets. We present a universal domain adaptation method, DeepAstroUDA , as an approach to overcome this challenge. This algorithm performs semi-supervised domain adaptation (DA) and can be applied to datasets with different data distributions and class overlaps. Non-overlapping classes can be present in any of the two datasets (the labeled source domain, or the unlabeled target domain), and the method can even be used in the presence of unknown classes. We apply our method to three examples of galaxy morphology classification tasks of different complexities (three-class and ten-class problems), with anomaly detection: (1) datasets created after different numbers of observing years from a single survey (Legacy Survey of Space and Time mock data of one and ten years of observations); (2) data from different surveys (Sloan Digital Sky Survey (SDSS) and DECaLS); and (3) data from observing fields with different depths within one survey (wide field and Stripe 82 deep field of SDSS). For the first time, we demonstrate the successful use of DA between very discrepant observational datasets. DeepAstroUDA is capable of bridging the gap between two astronomical surveys, increasing classification accuracy in both domains (up to 40 % on the unlabeled data), and making model performance consistent across datasets. Furthermore, our method also performs well as an anomaly detection algorithm and successfully clusters unknown class samples even in the unlabeled target dataset.

79 ASTRONOMY AND ASTROPHYSICS↗

Semisupervised Classification of Texts Using Particle Learning for Probabilistic Automata

This chapter presents a novel online learning system for classification of email texts based on particle learning for composite mixture models involving probabilistic automata. The composite mixture structure allows specification of a joint probability model for heterogeneous collections of independent variables without requiring complex embeddings via generalized linear models or copula techniques. The chapter is organized as follows. Section 12.2 presents a hierarchical model representation of a class of probabilistic automata and derives the particle learning algorithm for obtaining parameter estimates. Section 12.3 describes a framework for semisupervised text classification problems based on a composite mixture model formulation. Section 12.4 discusses an application of the classifier to a spam detection dataset. Section 12.5 concludes with a discussion of computational considerations and future work.

97 MATHEMATICS AND COMPUTING↗

Automatic Fault Characterization via Abnormality-Enhanced Classification

Enterprise and high-performance computing systems are growing extremely large and complex, employing hundreds to hundreds of thousands of processors and software/hardware stacks built by many people across many organizations. As the growing scale of these machines increases the frequency of faults, system complexity makes these faults difficult to detect and to diagnose. Current system management techniques, which focus primarily on efficient data access and query mechanisms, require system administrators to examine the behavior of various system services manually. Growing system complexity is making this manual process unmanageable: administrators require more effective management tools that can detect faults and help to identify their root causes. System administrators need timely notification when a fault is manifested that includes the type of fault, the time period in which it occurred and the processor on which it originated. Statistical modeling approaches can accurately characterize system behavior. However, the complex effects of system faults make these tools difficult to apply effectively. This paper investigates the application of classification and clustering algorithms to fault detection and characterization. We show experimentally that naively applying these methods achieves poor accuracy. Further, we design novel techniques that combine classification algorithms with information on the abnormality of application behavior to improve detection and characterization accuracy. Our experiments demonstrate that these techniques can detect and characterize faults with 65% accuracy, compared to just 5% accuracy for naive approaches.

97 MATHEMATICS AND COMPUTING↗

Domain-Adapted Convolutional Networks for Satellite Image Classification: A Large-Scale Interactive Learning Workflow

Satellite imagery often exhibits large spatial extent areas that encompass object classes with considerable variability. This often limits large-scale model generalization with machine learning algorithms. Notably, acquisition conditions, including dates, sensor position, lighting condition, and sensor types, often translate into class distribution shifts introducing complex nonlinear factors and hamper the potential impact of machine learning classifiers. Here, this article investigates the challenge of exploiting satellite images using convolutional neural networks (CNN) for settlement classification where the class distribution shifts are significant. We present a large-scale human settlement mapping workflow based-off multiple modules to adapt a pretrained CNN to address the negative impact of distribution shift on classification performance. To extend a locally trained classifier onto large spatial extents areas we introduce several submodules: First, a human-in-the-loop element for relabeling of misclassified target domain samples to generate representative examples for model adaptation; second, an efficient hashing module to minimize redundancy and noisy samples from the mass-selected examples; and third, a novel relevance ranking module to minimize the dominance of source example on the target domain. The workflow presents a novel and practical approach to achieve large-scale domain adaptation with binary classifiers that are based-off CNN features. Experimental evaluations are conducted on areas of interest that encompass various image characteristics, including multisensors, multitemporal, and multiangular conditions. Domain adaptation is assessed on source–target pairs through the transfer loss and transfer ratio metrics to illustrate the utility of the workflow.

47 OTHER INSTRUMENTATION↗

A complete electrical shock hazard classification system and its application

Current electrical safety standards evolved to address the hazards of 60-Hz power that are faced primarily by electricians, linemen, and others performing facility and utility work. As a result, this leaves a substantial gap in the management of electrical hazards in Research and Development (R&D) and specialized high voltage and high power equipment. We find substantial use of direct current (dc) electrical energy, and the use of capacitors, inductors, batteries, and radiofrequency (RF) power. The electrical hazards of these forms of electricity and their systems are different than for 50/60 Hz power. This paper proposes a method of classifying all of the electrical shock hazards found in all types of R&D and utilization equipment. Examples of the variation of these hazards from NFPA 70E include (a) high voltage can be harmless, if the available current is sufficiently low, (b) low voltage can be harmful if the available current/power is high, (c) high voltage capacitor hazards are unique and include severe reflex action, affects on the heart, and tissue damage, and (d) arc flash hazard analysis for dc and capacitor systems are not provided in existing standards. This work has led to a comprehensive electrical hazard classification system that is based on various research conducted over the past 100 years, on analysis of such systems in R&D, and on decades of experience. Lastly, the new comprehensive electrical shock hazard classification system uses a combination of voltage, shock current available, fault current available, power, energy, and waveform to classify all forms of electrical hazards.

42 ENGINEERING↗

Use of Convolutional Neural Network Image Classification and High-Speed Ion Probe Data Toward Real-Time Detonation Characterization in a Water-Cooled Rotating Detonation Engine

As rotating detonation engines (RDEs) progress in maturity, the importance of monitoring advancements toward development of active control becomes more critical. Experimental RDE data processing at time scales which satisfy real-time diagnostics will likely require the use of machine learning. This study aims to develop and deploy a novel real-time monitoring technique capable of determining detonation wave number, direction, frequency, and individual wave speeds throughout experimental RDE operational windows. To do so, the diagnostic integrates image classification by a convolutional neural network (CNN) and ionization current signal analysis. Wave mode identification through single-image CNN classification bypasses the need to evaluate sequential images and offers instantaneous identification of the wave mode present in the RDE annulus. Here, real-time processing speeds are achieved due to low data volumes required by the methodology, namely one short-exposure image and a short window of sensor data to generate each diagnostic output. The diagnostic acquires live data using a modified experimental setup alongside Pylon and PyDAQmx libraries within a python data acquisition environment. Lab-deployed diagnostic results are presented across varying wave modes, operating conditions, and data quality, currently executed at 3–4 Hz with a variety of iteration speed optimization options to be considered as future work. These speeds exceed that of conventional techniques and offer a proven structure for real-time RDE monitoring. The demonstrated ability to analyze detonation wave presence and behavior during RDE operation will certainly play a vital role in the development of RDE active control, necessary for RDE technology maturation toward industrial integration.

42 ENGINEERING↗

SU-D-207B-02: Early Grade Classification in Meningioma Patients Combining Radiomics and Semantics Data

Purpose: The clinical management of meningioma is guided by its grade and biologic behavior. Currently, diagnosis of tumor grade follows surgical resection and histopathologic review. Reliable techniques for pre-operative determination of tumor behavior are needed. We investigated the association between imaging features extracted from preoperative gadolinium-enhanced T1-weighted MRI and meningioma grade. Methods: We retrospectively examined the pre-operative MRI for 139 patients with de novo WHO grade I (63%) and grade II (37%) meningiomas. We investigated the predictive power of ten semantic radiologic features as determined by a neuroradiologist, fifteen radiomic features, and tumor location. Conventional (volume and diameter) imaging features were added for comparison. AUC was computed for continuous and χ{sup 2} for discrete variables. Classification was done using random forest. Performance was evaluated using cross validation (1000 iterations, 75% training and 25% validation). All p-values were adjusted for multiple testing. Results: Significant association was observed between meningioma grade and tumor location (p<0.001) and two semantic features including intra-tumoral heterogeneity (p<0.001) and overt hemorrhage (p=0.01). Conventional (AUC 0.61–0.67) and eleven radiomic (AUC 0.60–0.70) features were significant from random (p<0.05, Noether test). Median AUC values for classification of tumor grade were 0.57, 0.71, 0.72 and 0.77 respectively for conventional, radiomic, location, and semantic features after using random forest. By combining all imaging data (semantic, radiomic, and location), the median AUC was 0.81, which offers superior predicting power to that of conventional imaging descriptors for meningioma as well as radiomic features alone (p<0.05, permutation test). Conclusion: We demonstrate a strong association between radiologic features and meningioma grade. Pre-operative prediction of tumor behavior based on imaging features offers promise for guiding personalized medicine and improving patient management.

60 APPLIED LIFE SCIENCES↗

Cloud Type Classification (cldtype) Value-Added Product

The Cloud Type (cldtype) value-added product (VAP) provides an automated cloud type classification based on macrophysical quantities derived from vertically pointing lidar and radar. Up to 10 layers of clouds are classified into seven cloud types based on predetermined and site-specific thresholds of cloud top, base and thickness. Examples of thresholds for selected U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility sites are provided in Tables 1 and 2. Inputs for the cldtype VAP include lidar and radar cloud boundaries obtained from the Active Remotely Sensed Cloud Location (ARSCL) and Surface Meteorological Systems (MET) data. Rain rates from MET are used to determine when radar signal attenuation precludes accurate cloud detection. Temporal resolution and vertical resolution for cldtype are 1 minute and 30 m respectively and match the resolution of ARSCL. The cldtype classification is an initial step for further categorization of clouds. It was developed for use by the Shallow Cumulus VAP to identify potential periods of interest to the LASSO model and is intended to find clouds of interest for a variety of users.

54 ENVIRONMENTAL SCIENCES↗

FY2018 Discovery Through Situational Awareness: Anomalies, Oscillations, and Classification

This technical report is a summary of work performed under the DOE GMLC program under the task titled “Discovery through Situational Awareness”. The focus of this work was to apply big data, statistical techniques to PMU data to do the following: 1) baseline PMU data and find anomalies with a focus on phase angle pairs, 2) identify the frequencies of dominant modal oscillations between different parts of a power system, and 3) identify and classify frequency events in PMU data. This work was performed on PMU data from the Western Interconnect. Many of these algorithms will be applied to wide area phase angle pair data on the Eastern Interconnect in a tool called ESAMS (Eastern Interconnect Situational Awareness Monitoring System). ESAMS was built by EPG (Electric Power Group) and PNNL and is currently being installed on the Eastern Interconnect. The results discussed in this report were made from 14 PMUs from data ranging from Oct 2016 to May 2018. The PMU data were measured 60 times each second. Fourteen phase angle pairs were included, with reactive and active power being calculated at 14 sites. All results have been de-identified for this report. The methodologies applied in the ESAMS tool are described in Section 2. A baseline of PMU data is created using the last 120 days of data. This baseline describes typical behavior as understood from the data. The baseline is then applied to the next day’s data and anomalies from that baseline are identified. Plots are created to help describe what is anomalous during that specific moment in time. These algorithms are currently being installed on the Eastern Interconnect. FY19 work will include discussing the results and findings from the ESAMS tool. A new method of identifying the frequencies of dominant modal oscillations between different parts of a power system is described in Section 3. A list of 199 frequency events provided by Bonneville Power Administration were used to create algorithms to detect frequency events and to create classification rules that can be used to identify future frequency events. Section 4 discusses the results the performance of 7 different event detection, clustering-based methods. Accuracy percentages ranged from 93.59% to 99.16%, with most methods being very fast. GBM (Gradient Boosting Machine) performed well and quickly. These 7 different methods were also tested to determine how well each built classification rules on training data and then applied those rules to identify future frequency events. Accuracy percentages ranged from 89.09% to 99.9%, with all methods performing quickly. GLM (General Linear Model) was viewed as the top performer when considering accuracy and processing time. Because the list of events consisted of 80% of them as active power events and only 20% as faults, all methods struggled to identify events as faults. Small faults were especially difficult to identify. A separate algorithm was created to help with this. Additional work will be done in FY19 on event detection using more data and more events and refinements to the methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Power System Event Classification and Localization Using a Convolutional Neural Network

Detection and timely identification of power system disturbances are essential for situation awareness and reliable electricity grid operation. Because records of actual events in the system are limited, ensemble simulation-based events are needed to provide adequate data for building event-detection models through deep learning; e.g., a convolutional neural network (CNN). An ensemble numerical simulation-based training data set have been generated through dynamic simulations performed on the Polish system with various types of faults in different locations. Such data augmentation is proven to be able to provide adequate data for deep learning. The synchronous generators’ frequency signals are used and encoded into images for developing and evaluating CNN models for classification of fault types and locations. With a time-domain stacked image set as the benchmark, two different time-series encoding approaches, i.e., wavelet decomposition-based frequency-domain stacking and polar coordinate system-based Gramian Angular Field (GAF) stacking, are also adopted to evaluate and compare the CNN model performance and applicability. The various encoding approaches are suitable for different fault types and spatial zonation. With optimized settings of the developed CNN models, the classification and localization accuracies can go beyond 84 and 91%, respectively.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Immunophenotype Discovery, Hierarchical Organization, and Template-Based Classification of Flow Cytometry Samples

We describe algorithms for discovering immunophenotypes from large collections of flow cytometry samples and using them to organize the samples into a hierarchy based on phenotypic similarity. The hierarchical organization is helpful for effective and robust cytometry data mining, including the creation of collections of cell populations’ characteristic of different classes of samples, robust classification, and anomaly detection. We summarize a set of samples belonging to a biological class or category with a statistically derived template for the class. Whereas individual samples are represented in terms of their cell populations (clusters), a template consists of generic meta-populations (a group of homogeneous cell populations obtained from the samples in a class) that describe key phenotypes shared among all those samples. We organize an FC data collection in a hierarchical data structure that supports the identification of immunophenotypes relevant to clinical diagnosis. A robust template-based classification scheme is also developed, but our primary focus is in the discovery of phenotypic signatures and inter-sample relationships in an FC data collection. This collective analysis approach is more efficient and robust since templates describe phenotypic signatures common to cell populations in several samples while ignoring noise and small sample-specific variations. We have applied the template-based scheme to analyze several datasets, including one representing a healthy immune system and one of acute myeloid leukemia (AML) samples. The last task is challenging due to the phenotypic heterogeneity of the several subtypes of AML. However, we identified thirteen immunophenotypes corresponding to subtypes of AML and were able to distinguish acute promyelocytic leukemia (APL) samples with the markers provided. Clinically, this is helpful since APL has a different treatment regimen from other subtypes of AML. Core algorithms used in our data analysis are available in the flowMatch package at www.bioconductor.org. It has been downloaded nearly 6,000 times since 2014.

59 BASIC BIOLOGICAL SCIENCES↗

Improving Text Classification with Large Language Model-Based Data Augmentation

Large Language Models (LLMs) such as ChatGPT possess advanced capabilities in understanding and generating text. These capabilities enable ChatGPT to create text based on specific instructions, which can serve as augmented data for text classification tasks. Previous studies have approached data augmentation (DA) by either rewriting the existing dataset with ChatGPT or generating entirely new data from scratch. However, it is unclear which method is better without comparing their effectiveness. This study investigates the application of both methods to two datasets: a general-topic dataset (Reuters news data) and a domain-specific dataset (Mitigation dataset). Our findings indicate that: 1. ChatGPT generated new data consistently enhanced model’s classification results for both datasets. 2. Generating new data generally outperforms rewriting existing data, though crafting the prompts carefully is crucial to extract the most valuable information from ChatGPT, particularly for domain-specific data. 3. The augmentation data size affects the effectiveness of DA; however, we observed a plateau after incorporating 10 samples. 4. Combining the rewritten sample with new generated sample can potentially further improve the model’s performance.

97 MATHEMATICS AND COMPUTING↗

An Accurate Vegetation and Non-Vegetation Differentiation Approach Based on Land Cover Classification

Accurate vegetation detection is important for many applications, such as crop yield estimation, land cover land use monitoring, urban growth monitoring, drought monitoring, etc. Popular conventional approaches to vegetation detection incorporate the normalized difference vegetation index (NDVI), which uses the red and near infrared (NIR) bands, and enhanced vegetation index (EVI), which uses red, NIR, and the blue bands. Although NDVI and EVI are efficient, their accuracies still have room for further improvement. In this paper, we propose a new approach to vegetation detection based on land cover classification. That is, we first perform an accurate classification of 15 or more land cover types. The land covers such as grass, shrub, and trees are then grouped into vegetation and other land cover types such as roads, buildings, etc. are grouped into non-vegetation. Similar to NDVI and EVI, only RGB and NIR bands are needed in our proposed approach. If Laser imaging, Detection, and Ranging (LiDAR) data are available, our approach can also incorporate LiDAR in the detection process. Results using a well-known dataset demonstrated that the proposed approach is feasible and achieves more accurate vegetation detection than both NDVI and EVI. In particular, a Support Vector Machine (SVM) approach performed 6% better than NDVI and 50% better than EVI in terms of overall accuracy (OA).

54 ENVIRONMENTAL SCIENCES↗

Classification of Wetland Vegetation Based on NDVI Time Series from the HLS Dataset

Natural wetlands are intrinsically heterogeneous and typically composed of a mosaic of ecosystem patches with different vegetation types. Hydrological and biogeochemical processes in wetlands vary strongly among these ecosystem patches. To date, most remote sensing classification approaches for wetland vegetation either rely on coarse images that cannot capture the spatial variability of wetland vegetation or rely on very-high-resolution multi-spectral images that are detailed but very sporadic in time (less than once per year). This study aimed to use NDVI time series, generated from NASA’s HLS dataset, to classify vegetation patches. We demonstrate our approach at a temperate, coastal lake, estuarine marsh. To classify vegetation patches, a standard time series library of the four land-cover patch types was built from referencing specific locations that were identified as “pure” pixels. These were identified using a single-time high-resolution image. We calculated the distance between the HLS-NDVI time series at each pixel and the “pure”-pixel standards for each land-cover type. The resulting true-positive classified rate was >73% for all patch types other than water lily. The classification accuracy was higher in pixels of a more uniform composition. A set of vegetation maps was created for the years 2016 to 2020 at our research site to identify the vegetation changes at the site as it is affected by rapid water elevation increases in Lake Erie. Our results reveal how changes in water elevation have changed the patch distribution in significant ways, leading to the local extinction of cattail by 2019 and a continuous increase in the area cover of water lily patches.

54 ENVIRONMENTAL SCIENCES↗

AICCA: AI-Driven Cloud Classification Atlas

Clouds play an important role in the Earth’s energy budget, and their behavior is one of the largest uncertainties in future climate projections. Satellite observations should help in understanding cloud responses, but decades and petabytes of multispectral cloud imagery have to date received only limited use. This study describes a new analysis approach that reduces the dimensionality of satellite cloud observations by grouping them via a novel automated, unsupervised cloud classification technique based on a convolutional autoencoder, an artificial intelligence (AI) method good at identifying patterns in spatial data. Our technique combines a rotation-invariant autoencoder and hierarchical agglomerative clustering to generate cloud clusters that capture meaningful distinctions among cloud textures, using only raw multispectral imagery as input. Cloud classes are therefore defined based on spectral properties and spatial textures without reliance on location, time/season, derived physical properties, or pre-designated class definitions. We use this approach to generate a unique new cloud dataset, the AI-driven cloud classification atlas (AICCA), which clusters 22 years of ocean images from the Moderate Resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua and Terra instruments—198 million patches, each roughly 100 km × 100 km (128 × 128 pixels)—into 42 AI-generated cloud classes, a number determined via a newly-developed stability protocol that we use to maximize richness of information while ensuring stable groupings of patches. AICCA thereby translates 801 TB of satellite images into 54.2 GB of class labels and cloud top and optical properties, a reduction by a factor of 15,000. The 42 AICCA classes produce meaningful spatio-temporal and physical distinctions and capture a greater variety of cloud types than do the nine International Satellite Cloud Climatology Project (ISCCP) categories—for example, multiple textures in the stratocumulus decks along the West coasts of North and South America. We conclude that our methodology has explanatory power, capturing regionally unique cloud classes and providing rich but tractable information for global analysis. AICCA delivers the information from multi-spectral images in a compact form, enables data-driven diagnosis of patterns of cloud organization, provides insight into cloud evolution on timescales of hours to decades, and helps democratize climate research by facilitating access to core data.

97 MATHEMATICS AND COMPUTING↗

LAMOST OBSERVATIONS IN THE KEPLER FIELD: SPECTRAL CLASSIFICATION WITH THE MKCLASS CODE

The LAMOST-Kepler project was designed to obtain high-quality, low-resolution spectra of many of the stars in the Kepler field with the Large Sky Area Multi Object Fiber Spectroscopic Telescope (LAMOST) spectroscopic telescope. To date 101,086 spectra of 80,447 objects over the entire Kepler field have been acquired. Physical parameters, radial velocities, and rotational velocities of these stars will be reported in other papers. In this paper we present MK spectral classifications for these spectra determined with the automatic classification code MKCLASS. We discuss the quality and reliability of the spectral types and present histograms showing the frequency of the spectral types in the main table organized according to luminosity class. Finally, as examples of the use of this spectral database, we compute the proportion of A-type stars that are Am stars, and identify 32 new barium dwarf candidates.

79 ASTRONOMY AND ASTROPHYSICS↗

SPECTRAL CLASSIFICATION AND PROPERTIES OF THE O Vz STARS IN THE GALACTIC O-STAR SPECTROSCOPIC SURVEY (GOSSS)

On the basis of the Galactic O Star Spectroscopic Survey (GOSSS), we present a detailed systematic investigation of the O Vz stars. The currently used spectral classification criteria are rediscussed, and the Vz phenomenon is recalibrated through the addition of a quantitative criterion based on the equivalent widths of the He i λ 4471, He ii λ 4542, and He ii λ 4686 spectral lines. The GOSSS O Vz and O V populations resulting from the newly adopted spectral classification criteria are comparatively analyzed. The locations of the O Vz stars are probed, showing a concentration of the most extreme cases toward the youngest star-forming regions. The occurrence of the Vz spectral peculiarity in a solar-metallicity environment, as predicted by the fastwind code, is also investigated, confirming the importance of taking into account several processes for the correct interpretation of the phenomenon.

79 ASTRONOMY AND ASTROPHYSICS↗