Engineering Papers⌕ Search

DOE OSTI · 3626704

Knowledge Distillation for Anomaly Detection

Abstract

Unsupervised deep learning techniques are widely used to identify anomalous behaviour. The performance of such methods is a product of the amount of training data and the model size. However, the size is often a limiting factor for the deployment on resource-constrained devices. Here, we present a novel procedure based on knowledge distillation for compressing an unsupervised anomaly detection model into a supervised deployable one and we suggest a set of techniques to improve the detection sensitivity. Compressed models perform comparably to their larger counterparts while significantly reducing the size and memory footprint.

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Pol, Adrian Alan, Govorkova, Ekaterina, Gronroos, Sonja, Chernyavskaya, Nadezda, Harris, Philip, Pierini, Maurizio, Ojalvo, Isobel, Elmer, Peter. 2023-10-04. Knowledge Distillation for Anomaly Detection. https://doi.org/10.14428/esann%2F2023.es2023-159. https://engineeringpapers.com/record/osti%3A3626704/knowledge-distillation-for-anomaly-detection

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Engineering Papers by Indiciae: BibTeX · RIS.