Fast query-optimized kernel machine classification via incremental approximate nearest support vectors
Support vector machines (and other kernel machines) offer robust modern machine learning methods for nonlinear classfication.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Support vector machines (and other kernel machines) offer robust modern machine learning methods for nonlinear classfication.
We present a new approximation to the maximum likelihood classifier to discriminate between M-ary and M'-ary phase-shift-keying transmitted on an additive white Gaussian noise (AWGN) channel and received noncoherentl, partially coherently, or coherently.
A self-organizing map (SOM) is a type of competitive artificial neural network, which projects the high dimensional input space of the training samples into a low dimensional space with the topology relations preserved. This makes SOMs supportive of organizing and visualizing complex data sets and have been pervasively used among numerous disciplines with different applications. Notwithstanding its wide applications, the self-organizing map is perplexed by its inherent randomness, which produces dissimilar SOM patterns even when being trained on identical training samples with the same parameters every time, and thus causes usability concerns for other domain practitioners and precludes more potential users from exploring SOM based applications in a broader spectrum. Motivated by this practical concern, we propose a deterministic approach as a supplement to the standard self-organizing map. In accordance with the theoretical design, the experimental results with satellite cloud data demonstrate the effective and efficient organization as well as simplification capabilities of the proposed approach.
We trained two Random Forest (RF) machine-learning models for cloud mask and cloud thermodynamic phase detection using spectral observations from VIIRS on Suomi NPP (SNPP). Observations from CALIOP were carefully selected to provide reference labels. The two RF models were trained for all-day and daytime-only conditions using a 4-year collocated VIIRS/CALIOP dataset from 2013 to 2016. Due to the orbit difference, the collocated CALIOP and SNPP VIIRS training samples cover a broad viewing zenith angle range, which is a great benefit to overall model performance. The all-day model uses 3 VIIRS infrared (IR) bands (8.6,11, and 12 μm) and the daytime model uses 5 Near-IR (NIR) and Shortwave-IR (SWIR) bands (0.86, 1.24, 1.38, 1.64 and 2.25 μm) together with the 3 IR bands to detect clear, liquid water, and ice cloud pixels. Up to 7 surface types, namely, ocean/water, forest, cropland, grassland, snow/ice, barren/desert, and shrubland, were considered separately to enhance performance for both models. Detection of cloudy pixels and thermodynamic phase with the two RF models were compared against collocated CALIOP products from 2017. It is shown that, with a conservative screening process that excludes the most challenging cloudy pixels for passive remote sensing, the two RF models have high accuracy rates in comparison with the CALIOP reference for both cloud detection and thermodynamic phase. Other existing SNPP VIIRS and Aqua MODIS cloud mask and phase products are also evaluated, with results showing that the two RF models and the MODIS MYD06 optical property phase product are the top 3 algorithms with respect to lidar observations during the daytime. During the nighttime, the RF all-day model works best for both cloud detection and phase, in particular for pixels over snow/ice surfaces. The present RF models can be extended to other similar passive instruments if training samples can be collected from CALIOP or other lidars. However, the quality of reference labels and potential sampling issues that may impact model performance would need further attention.
The accurate identification of biosignatures (indications of life) from data taken from remote or in situ planetary exploration is one of the most important challenges in astrobiology, the interdisciplinary field examining habitability and the potential for extraterrestrial life. This study employs machine learning algorithms to optimize the identification of biosignatures, with an emphasis on those which are agnostic to a specific biochemical basis. We exploit the wealth of terrestrial data available from biogenic and abiogenic systems to enhance efficient feature prioritization. Our dataset, pulled from public databases and laboratory recorded measurements, includes elemental abundance, isotopic fractionation, and VNIR/Raman spectra The data curation process included standardization for detection limits and ranges. Subsequent feature extraction yielded detailed inputs for machine learning, including combinations of elemental content, isotopic ratios, and parameters of spectral peaks and troughs. Feature significance was evaluated across diverse machine learning methodologies, such as k-nearest neighbors, logistic regression, Random Forest, support vector machines, and Gaussian Naïve Bayes, along with a combined voting classifier. We utilized Receiver Operating Characteristic Area Under the Curve (ROC AUC) across 2,000 50% test-train splits as a robust metric of model performance. Results revealed a promising ROC AUC of 0.853 for the combined voting classifier. Removing elemental abundance data notably reduced model accuracy (13% decrease in AUC), highlighting its critical role in biosignature detection. Several other individual data features exhibited significance within their respective data types, offering additional granularity. This research fortifies the relevance of machine learning to astrobiology, potentially enhancing life detection missions by allowing algorithmic prioritization of high-interest samples for further investigation. Future work will refine data standardization, expand the dataset to include more terrestrial systems, and incorporate convolutional neural networks for spectral feature extraction. The potential for public data sharing is also under exploration, reinforcing our commitment to collective scientific advancement.
We present AviSense, an SDR-based real-time, versatile system for monitoring aviation bands. AviSense detects and characterizes signal activities to enable practical and effective anomaly detection. We identify and tackle the challenges posed by a diverse set of critical aviation bands and technologies. We evaluate our methodology with real-world aviation signal measurements and demonstrate that we can classify aviation signals as normal with 99% accuracy. We also provide an exhaustive evaluation of our anomalous signal detection capability and show that we can accurately classify anomalous signals with 99% accuracy, with few exceptions. We also demonstrate that AviSense can effectively distinguish between different types of anomalies. We build a prototype implementation of AviSense for distributed monitoring.
The US Department of Energy is conducting analyses to inform future decisions regarding an integrated waste management system for the acceptance of spent nuclear fuel (SNF) from commercial nuclear reactor sites. The ability to prepare SNF for shipment from reactor sites is likely to be restricted by ongoing operations at those sites. This report examines the extent to which those operations will restrict the reactor sites' availability to prepare SNF for shipment. Specifically, the analysis focuses on the impact and frequency of refueling operations within the commercial reactor sites in the US. In this report, a characterization of reactor sites into families is described. This characterization is based on the number of operating reactors on site, the length of refueling cycles for those reactors, and the configuration of spent fuel pools on site. Each reactor family is analyzed to estimate the amount of time for which each reactor site in the family would be available to prepare SNF shipments. This analysis is a work in progress, and the results are used to inform the development of new models of an integrated waste management system for commercial SNF. (authors)
Canadian Nuclear Laboratories (CNL) is developing a Near Surface Disposal Facility (NSDF) to be constructed at its Chalk River Laboratories (CRL) site. In general, a NSDF is a facility for radioactive waste disposal, under an engineered cover, located at or within a few meters of the earth's surface. The NSDF will establish a safe, local and permanent means for the disposal of low level radioactive waste. The NSDF is intended to dispose historic waste currently in interim storage as well as waste arising from building decommissioning and environmental remediation activities. The NSDF is to be composed of engineered containment mound, waste water treatment plant and other supporting facilities and infrastructures that are needed to preserve radioactive waste. The NSDF life cycle will comprise two distinct phases: pre closure and post closure. The pre closure phase involves construction, operation and closure activities. The post closure phase includes institutional control and post-institutional control to ensure long term safety and radiological acceptability of the disposal facility. As part of the evolving activities for the NSDF project, a process is developed in accordance with Canadian regulations and International Atomic Energy Agency (IAEA) principles to classify systems that comprise NSDF for safe operation, long term safety of the disposal facility and the protection of workers, the public and the environment. This paper describes the methodology developed to classify Structures, Systems and Components (SSCs) important to safety in post closure phase and determine their design rules. The design rules are the relevant codes, standards and proven engineering practices that should be applied, as appropriate, to the design of SSCs to meet the applicable design requirements. (authors)
The present work explores alternative approaches for in situ monitoring with near real-time data analysis and imaging of dry casks using muons. Monitoring can provide useful signals about the cask contents in a yes/no decision format faster and with fewer muons than traditional imaging. Imaging can be performed as a second step in this process if specific information about the location of the fuel assemblies is needed. To explore and analyze these two modalities, simulations of muon scattering and displacement were performed for various scenarios, including vertical and horizontal fully loaded dry casks, half-loaded dry casks, dry casks with one row of fuel assemblies missing, dry casks with one fuel assembly missing, and empty dry casks. This work demonstrates monitoring can provide fast and reliable indication about the contents of the cask. For 100,000 muons, a few minutes of measurement time with a 3.6 m{sup 2} detector at a 45 deg. zenith angle, 90% detection probability for missing fuel assemblies can be achieved with a false alarm rate lower than 1%. If a positive signal is detected, then longer measurements can be performed and coupled with muon imaging algorithms to determine the location of missing nuclear material. In these cases, transmission muon radiography can produce images of acceptable resolution for all scenarios. In the horizontal dry cask case, all scenarios can be identified and separated adequately. In the vertical dry cask case, similar conclusions can be drawn, but because of shadowing from other fuel assemblies, the location of a missing fuel assembly cannot be identified in the 2-D transmission map. However, views from different directions may resolve this. (authors)
Power system protection devices have transitioned over the past few decades from mechanical to analog devices, then to solid state and finally digital. Relays and their associated critical network of equipment have significantly increased in complexity. Even internally, relays have gained significant intricacy, with relatively simple overcurrent or differential functions now being assisted by a myriad of other functions. This is necessary as the grid becomes more complex, but it brings increased difficulty in monitoring and upkeep. Misoperation caused by improper relay settings or malicious actions is a constant challenge faced by all utilities. These improper settings can be difficult to identify and may require exhaustive post-mortem analysis, typically after a major outage event has already occurred. A mechanism is needed for monitoring the behavior of protection systems to validate that they act and perform as expected. This work presents a concept for a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. As a first step in its development, an experimental dataset is generated, and a random forest model is implemented with high accuracy in distinguishing four power system scenarios.
Risk decisions in many third-party risk management (TPRM) workflows rely on static inherent risk questionnaires (IRQ). These static forms provide a snapshot of the vendor from the business users’ perspective, as these requests are processed without cross-referencing for evidence. Consequently, responses can be misinformed or embellished with inaccuracies, thereby masking the vendor’s true risk to the enterprise. This paper presents a multi-stage verification framework to augment IRQs with web evidence and a deterministic ensemble of large language model assessors to reclassify risk. In a case study of 100 submissions previously misclassified as low risk, the proposed framework correctly identified 76% of the cases as high risk, while the existing workflow identified none. McNemar’s continuity corrected statistics of 74 were obtained with a two sided p-value of 2.65 × 10-23, indicating a significantly more effective workflow compared to the legacy model.
This presentation applies open set recognition to classify unknown waveforms, enabling systems to not only identify known types but also reliably detect when waveforms fall outside the training distribution. This approach enhances robustness by avoiding forced misclassification of novel or anomalous signals.
Cryo-electron tomography (cryo-ET) enables structural characterization of biomolecules under near-native conditions. Existing approaches for interpreting the resulting three-dimensional volumes are computationally expensive and have difficulty interpreting density associated with small proteins/complexes. To explore alternate approaches for identifying proteins in cryo-ET data we pursued a Graph Network and topologically invariant approach. Here, we report on a fast algorithm that classifies particles by searching for nuances of evolutionarily conversed motifs and the geometrical characteristics of protein structure. GRIP-Tomo 2.0 is a machine-learning pipeline that extracts interpretable topological features of protein structures within noisy experimental backgrounds. Compared to version 1.0, the new pipeline includes three upgrades that significantly improve performance including synthetic tomogram generation simulating realistic noise, graph-based persistent feature extraction as protein fingerprints, and high-performance computing acceleration. GRIP-Tomo 2.0 achieves over 90% accuracy in classifying between proteins and noise using both real and synthetic datasets which represents a foundational step toward advancing cryo-ET workflows and empowering automated visual proteomics.
Accurately classifying microscopic damage helps automate the repair and recycling of National Ignition Facility optics and informs the study of damage initiation and growth. This complex 12-class problem previously required human experts to distinguish and label the various damage morphologies. Finding image analysis methods to extract and calculate distinguishing features would be time consuming and challenging, so we sought to automate this task by using convolutional neural networks (CNNs) pretrained on the ImageNet database to take advantage of its automated feature discovery and extraction. We compared three model architectures on this dataset and found the one with highest overall accuracy, 99.17%, was a novel hybrid architecture, one in which we removed the final decision-making layer of the deep learner and replaced it with an ensemble of decision trees (EDT). This combines the power of feature extraction by CNNs with the decision-making strength of EDT. The accuracy of the hybrid architecture over the deep learning alone is shown to be significantly improved. Furthermore, we applied this novel hybrid architecture to an entirely different dataset, one containing images of repaired damage sites, and improved on the previously published findings, also with a demonstrably significant increase in accuracy over using the deep learner alone.
Abstract not provided
The ability to understand where, when, and why humans move across space and time has always been essential to research areas such as urban planning, transportation, population dynamics, and emergency preparedness and response. The increasing sources of activity data is generating novel opportunities to understand human dynamics that previously was not possible; Geo-located user generated content from mobile devices and sensors allow a level of spatial and temporal granularity that could possibly answer the reasons for human movement at a high-resolution. This work discusses a broad array of research agenda in human dynamics and land use by proposing an explicit model that assists in delineating and articulating the opportunities, challenges, and limitations of using new forms of unauthoritated data, such as social media in main-stream GIS research. We study mobile phone call volume and GPS locations to characterize human activity patterns and provide inference on land use. Later, we demonstrate the ability of geo-located social media posts to provide insight on population density estimates for special events and Points of Interest detection. The chapter underpins the need to utilize new forms of data collection mechanism as well as their use to augment our understanding of human dynamics research and future application of geographical information systems.