Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 104 of the 104 references it cites were found in a registry or an index.

Deep Learning for Anomaly Detection: A Review

Open access
Pang, Guansong, Shen, Chunhua, Cao, Longbing, Hengel, Anton Van Den · 2022 · ACM Computing Surveys

Abstract

Anomaly detection, a.k.a. outlier detection or novelty detection, has been a lasting yet active research area in various research communities for several decades. There are still some unique problem complexities and challenges that require advanced approaches. In recent years, deep learning enabled anomaly detection, i.e., deep anomaly detection , has emerged as a critical direction. This article surveys the research of deep anomaly detection with a comprehensive taxonomy, covering advancements in 3 high-level categories and 11 fine-grained categories of the methods. We review their key intuitions, objective functions, underlying assumptions, advantages, and disadvantages and discuss how they address the aforementioned challenges. We further discuss a set of possible future opportunities and new perspectives on addressing the challenges.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3439950

Cites

104 of 104 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

    Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 1×

    “Large-scale unsupervised/self-supervised representation learning has gained tremendous success in enabling downstream learning tasks [35, 122].”
    Background
  • Support-vector networks

    Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421

  • Gradient-based learning applied to document recognition

    Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×

    “As shown in [6], one-class support vector machines (SVM) can be first initialized with the VGG models pre-trained on ILSVRC and then fine-tuned to improve anomaly classification on the MNIST data [78].”
    Method
  • BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

    Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 1×

    “Large-scale unsupervised/self-supervised representation learning has gained tremendous success in enabling downstream learning tasks [35, 122].”
    Background
  • ImageNet Large Scale Visual Recognition Challenge

    Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 1×

    “The VGG model pre-trained on the ILSVRC benchmark [134] is shown to be effective to extract expressive appearance features for this purpose [66].”
    Method
  • Reducing the dimensionality of data with neural networks

    Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928

  • Representation Learning: A Review and New Perspectives

    Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×

    “Compared to the dimension reduction methods that are popular in anomaly detection, such as principal component analysis (PCA) [21, 140, 180] and random projection [80, 112, 123], deep learning techniques have been demonstrating substantially better capability in extracting semanticrich features and non-linear feature…”
    Method
  • Deep Contextualized Word Representations

    Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · cited 1×

    “s important in these scenarios. 8.3 Large-scale Normality Learning Large-scale unsupervised/self-supervised representation learning has gained tremendous success in enabling downstream learning tasks [36, 123]. This is particular important for learning tasks, in which it is difficult to obtain sufficient labeled data,…”
    BackgroundInfluential
  • Anomaly detection: A survey

    Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 3×

    “s trained with purely normal training data to be unsupervised approach. However, this setting is different from the general sense of an unsupervised setting. To avoid unnecessary confusion, following [2,28], these methods are referred to as semi-supervised methods hereafter. ACM Comput. Surv., Vol. xx, No. x, Article…”
    BackgroundMethod
  • Improved Techniques for Training GANs

    Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965 · cited 1×

    “while the discrimination loss is defined based on the feature matching technique [136]: lfm (x, zγ ) = h(x) − h (G (zγ )) 1, (9)”
    Method

Show all 91 references

Research works printed but not linked: 75

  1. Charu C. Aggarwal . 2017. Outlier Analysis . Springer . Charu C. Aggarwal. 2017. Outlier Analysis. Springer.
  2. Samet Akcay , Amir Atapour-Abarghouei , and Toby P . Breckon . 2018 . GANomaly: Semi-supervised anomaly detection via adversarial training. In ACCV. Springer , 622--637. Samet Akcay, Amir Atapour-Abarghouei, and Toby P. Breckon. 2018. GANomaly: Semi-supervised anomaly detection via adversarial training. In ACCV. Springer, 622--637.
  3. Elie Aljalbout Vladimir Golkov Yawar Siddiqui Maximilian Strobel and Daniel Cremers. 2018. Clustering with deep learning: Taxonomy and new methods. arXiv:1801.07648. Retrieved from https://arxiv.org/abs/1801.07648. Elie Aljalbout Vladimir Golkov Yawar Siddiqui Maximilian Strobel and Daniel Cremers. 2018. Clustering with deep learning: Taxonomy and new methods. arXiv:1801.07648. Retrieved from https://arxiv.org/abs/1801.07648. · arXiv
  4. J. Andrews , Thomas Tanay , Edward J. Morton , and Lewis D . Griffin . 2016 . Transfer representation-learning for anomaly detection. In PMLR. J. Andrews, Thomas Tanay, Edward J. Morton, and Lewis D. Griffin. 2016. Transfer representation-learning for anomaly detection. In PMLR.
  5. Fabrizio Angiulli and Clara Pizzuti . 2002. Fast outlier detection in high dimensional spaces . In PKDD. Springer , 15--27. Fabrizio Angiulli and Clara Pizzuti. 2002. Fast outlier detection in high dimensional spaces. In PKDD. Springer, 15--27.
  6. Martin Arjovsky Soumith Chintala and Léon Bottou. 2017. Wasserstein generative adversarial networks. In ICML. 214--223. Martin Arjovsky Soumith Chintala and Léon Bottou. 2017. Wasserstein generative adversarial networks. In ICML. 214--223.
  7. Fatemeh Azmandian , Ayse Yilmazer , Jennifer G. Dy , Javed A. Aslam , and David R . Kaeli . 2012 . GPU-accelerated feature selection for outlier detection using the local kernel density ratio. In ICDM. IEEE , 51--60. Fatemeh Azmandian, Ayse Yilmazer, Jennifer G. Dy, Javed A. Aslam, and David R. Kaeli. 2012. GPU-accelerated feature selection for outlier detection using the local kernel density ratio. In ICDM. IEEE, 51--60.
  8. Yuri Burda , Harri Edwards , Deepak Pathak , Amos Storkey , Trevor Darrell , and Alexei A . Efros . 2019 . Large-scale study of curiosity-driven learning. In ICLR. Yuri Burda, Harri Edwards, Deepak Pathak, Amos Storkey, Trevor Darrell, and Alexei A. Efros. 2019. Large-scale study of curiosity-driven learning. In ICLR.
  9. Yuri Burda Harrison Edwards Amos Storkey and Oleg Klimov. 2019. Exploration by random network distillation. In ICLR. Yuri Burda Harrison Edwards Amos Storkey and Oleg Klimov. 2019. Exploration by random network distillation. In ICLR.
  10. Longbing Cao , Philip S. Yu , Chengqi Zhang , and Yanchang Zhao . 2010. Domain Driven Data Mining . Springer . Longbing Cao, Philip S. Yu, Chengqi Zhang, and Yanchang Zhao. 2010. Domain Driven Data Mining. Springer.
  11. Raghavendra Chalapathy , Aditya Krishna Menon, and Sanjay Chawla . 2018 . Anomaly detection using one-class neural networks. arXiv:1802.06360. Retrieved from https://arxiv.org/abs/1802.06360. Raghavendra Chalapathy, Aditya Krishna Menon, and Sanjay Chawla. 2018. Anomaly detection using one-class neural networks. arXiv:1802.06360. Retrieved from https://arxiv.org/abs/1802.06360. · arXiv
  12. Ting Chen Lu-An Tang Yizhou Sun Zhengzhang Chen and Kai Zhang. 2016. Entity embedding-based anomaly detection for heterogeneous categorical events. In IJCAI. 1396--1403. Ting Chen Lu-An Tang Yizhou Sun Zhengzhang Chen and Kai Zhang. 2016. Entity embedding-based anomaly detection for heterogeneous categorical events. In IJCAI. 1396--1403.
  13. Zihang Dai , Zhilin Yang , Fan Yang , William W. Cohen , and Russ R . Salakhutdinov . 2017 . Good semi-supervised learning that requires a bad gan. In NeurIPS. 6510--6520. Zihang Dai, Zhilin Yang, Fan Yang, William W. Cohen, and Russ R. Salakhutdinov. 2017. Good semi-supervised learning that requires a bad gan. In NeurIPS. 6510--6520.
  14. Nat Dilokthanakul Pedro A. M. Mediano Marta Garnelo Matthew C. H. Lee Hugh Salimbeni Kai Arulkumaran and Murray Shanahan. 2017. Deep unsupervised clustering with gaussian mixture variational autoencoders. In ICLR. Nat Dilokthanakul Pedro A. M. Mediano Marta Garnelo Matthew C. H. Lee Hugh Salimbeni Kai Arulkumaran and Murray Shanahan. 2017. Deep unsupervised clustering with gaussian mixture variational autoencoders. In ICLR.
  15. Carl Doersch. 2016. Tutorial on variational autoencoders. arXiv:1606.05908. Retrieved from https://arxiv.org/abs/1606.05908. Carl Doersch. 2016. Tutorial on variational autoencoders. arXiv:1606.05908. Retrieved from https://arxiv.org/abs/1606.05908. · arXiv
  16. Jeff Donahue Philipp Krähenbühl and Trevor Darrell. 2017. Adversarial feature learning. In ICLR. Jeff Donahue Philipp Krähenbühl and Trevor Darrell. 2017. Adversarial feature learning. In ICLR.
  17. Shaohua Fan Chuan Shi and Xiao Wang. 2018. Abnormal event detection via heterogeneous information network embedding. In CIKM. 1483--1486. Shaohua Fan Chuan Shi and Xiao Wang. 2018. Abnormal event detection via heterogeneous information network embedding. In CIKM. 1483--1486.
  18. Soroush Fatemifar , Shervin Rahimzadeh Arashloo , Muhammad Awais, and Josef Kittler. 2019 . Spoofing attack detection by anomaly detection. In ICASSP. IEEE , 8464--8468. Soroush Fatemifar, Shervin Rahimzadeh Arashloo, Muhammad Awais, and Josef Kittler. 2019. Spoofing attack detection by anomaly detection. In ICASSP. IEEE, 8464--8468.
  19. Kamran Ghasedi Dizaji Amirhossein Herandi Cheng Deng Weidong Cai and Heng Huang. 2017. Deep clustering via joint convolutional autoencoder embedding and relative entropy minimization. In ICCV. 5736--5745. Kamran Ghasedi Dizaji Amirhossein Herandi Cheng Deng Weidong Cai and Heng Huang. 2017. Deep clustering via joint convolutional autoencoder embedding and relative entropy minimization. In ICCV. 5736--5745.
  20. Izhak Golan and Ran El-Yaniv. 2018. Deep anomaly detection using geometric transformations. In NeurIPS. 9758--9769. Izhak Golan and Ran El-Yaniv. 2018. Deep anomaly detection using geometric transformations. In NeurIPS. 9758--9769.
  21. Ian Goodfellow , Yoshua Bengio , and Aaron Courville . 2016. Deep Learning . MIT Press . Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT Press.
  22. Karol Gregor Ivo Danihelka Andriy Mnih Charles Blundell and Daan Wierstra. 2014. Deep AutoRegressive networks. In ICML. 1242--1250. Karol Gregor Ivo Danihelka Andriy Mnih Charles Blundell and Daan Wierstra. 2014. Deep AutoRegressive networks. In ICML. 1242--1250.
  23. Kathrin Grosse Praveen Manoharan Nicolas Papernot Michael Backes and Patrick McDaniel. 2017. On the (statistical) detection of adversarial examples. arXiv:1702.06280. Retrieved from https://arxiv.org/abs/1702.06280. Kathrin Grosse Praveen Manoharan Nicolas Papernot Michael Backes and Patrick McDaniel. 2017. On the (statistical) detection of adversarial examples. arXiv:1702.06280. Retrieved from https://arxiv.org/abs/1702.06280. · arXiv
  24. Michael Gutmann and Aapo Hyvärinen. 2010. Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In AISTATS. 297--304. Michael Gutmann and Aapo Hyvärinen. 2010. Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In AISTATS. 297--304.
  25. Mahmudul Hasan , Jonghyun Choi , Jan Neumann , Amit K. Roy-Chowdhury , and Larry S . Davis . 2016 . Learning temporal regularity in video sequences. In CVPR. 733--742. Mahmudul Hasan, Jonghyun Choi, Jan Neumann, Amit K. Roy-Chowdhury, and Larry S. Davis. 2016. Learning temporal regularity in video sequences. In CVPR. 733--742.
  26. Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR. 770--778. Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR. 770--778.
  27. Dan Hendrycks and Kevin Gimpel. 2017. A baseline for detecting misclassified and out-of-distribution examples in neural networks. In ICLR. Dan Hendrycks and Kevin Gimpel. 2017. A baseline for detecting misclassified and out-of-distribution examples in neural networks. In ICLR.
  28. Jun-Ting Hsieh Bingbin Liu De-An Huang Li F Fei-Fei and Juan Carlos Niebles. 2018. Learning to decompose and disentangle representations for video prediction. In NeurIPS. 517--526. Jun-Ting Hsieh Bingbin Liu De-An Huang Li F Fei-Fei and Juan Carlos Niebles. 2018. Learning to decompose and disentangle representations for video prediction. In NeurIPS. 517--526.
  29. Yi-an Huang, Wei Fan , Wenke Lee , and Philip S . Yu . 2003 . Cross-feature analysis for detecting ad-hoc routing anomalies. In ICDCS. IEEE , 478--487. Yi-an Huang, Wei Fan, Wenke Lee, and Philip S. Yu. 2003. Cross-feature analysis for detecting ad-hoc routing anomalies. In ICDCS. IEEE, 478--487.
  30. Radu Tudor Ionescu , Fahad Shahbaz Khan , Mariana-Iuliana Georgescu, and Ling Shao. 2019 . Object-centric auto-encoders and dummy anomalies for abnormal event detection in video. In CVPR. 7842--7851. Radu Tudor Ionescu, Fahad Shahbaz Khan, Mariana-Iuliana Georgescu, and Ling Shao. 2019. Object-centric auto-encoders and dummy anomalies for abnormal event detection in video. In CVPR. 7842--7851.
  31. Xinwei Jiang , Junbin Gao , Xia Hong , and Zhihua Cai . 2014. Gaussian processes autoencoder for dimensionality reduction . In PAKDD. Springer , 62--73. Xinwei Jiang, Junbin Gao, Xia Hong, and Zhihua Cai. 2014. Gaussian processes autoencoder for dimensionality reduction. In PAKDD. Springer, 62--73.
  32. Fabian Keller , Emmanuel Muller , and Klemens Bohm . 2012. HiCS: High contrast subspaces for density-based outlier ranking . In ICDE. IEEE , 1037--1048. Fabian Keller, Emmanuel Muller, and Klemens Bohm. 2012. HiCS: High contrast subspaces for density-based outlier ranking. In ICDE. IEEE, 1037--1048.
  33. Tung Kieu , Bin Yang , Chenjuan Guo , and Christian S . Jensen . 2019 . Outlier detection for time series with recurrent autoencoder ensembles. In IJCAI. Tung Kieu, Bin Yang, Chenjuan Guo, and Christian S. Jensen. 2019. Outlier detection for time series with recurrent autoencoder ensembles. In IJCAI.
  34. Alex Krizhevsky , Ilya Sutskever , and Geoffrey E . Hinton . 2012 . Imagenet classification with deep convolutional neural networks. In NeurIPS. 1097--1105. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In NeurIPS. 1097--1105.
  35. Kimin Lee Honglak Lee Kibok Lee and Jinwoo Shin. 2018. Training confidence-calibrated classifiers for detecting out-of-distribution samples. In ICLR. Kimin Lee Honglak Lee Kibok Lee and Jinwoo Shin. 2018. Training confidence-calibrated classifiers for detecting out-of-distribution samples. In ICLR.
  36. Ping Li , Trevor J. Hastie , and Kenneth W . Church . 2006 . Very sparse random projections. In KDD. 287--296. Ping Li, Trevor J. Hastie, and Kenneth W. Church. 2006. Very sparse random projections. In KDD. 287--296.
  37. Weixian Liao , Yifan Guo , Xuhui Chen , and Pan Li. 2018. A unified unsupervised gaussian mixture variational autoencoder for high dimensional outlier detection . In IEEE Big Data. IEEE , 1208--1217. Weixian Liao, Yifan Guo, Xuhui Chen, and Pan Li. 2018. A unified unsupervised gaussian mixture variational autoencoder for high dimensional outlier detection. In IEEE Big Data. IEEE, 1208--1217.
  38. Xialei Liu , Joost van de Weijer , and Andrew D . Bagdanov . 2018 . Leveraging unlabeled data for crowd counting by learning to rank. In CVPR. 7661--7669. Xialei Liu, Joost van de Weijer, and Andrew D. Bagdanov. 2018. Leveraging unlabeled data for crowd counting by learning to rank. In CVPR. 7661--7669.
  39. Yusha Liu Chun-Liang Li and Barnabás Póczos. 2018. Classifier two sample test for video anomaly detection. In BMVC. Yusha Liu Chun-Liang Li and Barnabás Póczos. 2018. Classifier two sample test for video anomaly detection. In BMVC.
  40. Cewu Lu Jianping Shi and Jiaya Jia. 2013. Abnormal event detection at 150 fps in matlab. In ICCV. 2720--2727. Cewu Lu Jianping Shi and Jiaya Jia. 2013. Abnormal event detection at 150 fps in matlab. In ICCV. 2720--2727.
  41. Weixin Luo , Wen Liu , and Shenghua Gao . 2017. Remembering history with convolutional lstm for anomaly detection . In ICME. IEEE , 439--444. Weixin Luo, Wen Liu, and Shenghua Gao. 2017. Remembering history with convolutional lstm for anomaly detection. In ICME. IEEE, 439--444.
  42. Justin Ma , Lawrence K. Saul , Stefan Savage , and Geoffrey M . Voelker . 2009 . Identifying suspicious URLs: An application of large-scale online learning. In ICML. ACM , 681--688. Justin Ma, Lawrence K. Saul, Stefan Savage, and Geoffrey M. Voelker. 2009. Identifying suspicious URLs: An application of large-scale online learning. In ICML. ACM, 681--688.
  43. Alireza Makhzani and Brendan Frey. 2014. K-sparse autoencoders. In ICLR. Alireza Makhzani and Brendan Frey. 2014. K-sparse autoencoders. In ICLR.
  44. Erik Marchi , Fabio Vesperini , Felix Weninger , Florian Eyben , Stefano Squartini , and Björn Schuller . 2015. Non-linear prediction with LSTM recurrent neural networks for acoustic novelty detection . In IJCNN. IEEE , 1--7. Erik Marchi, Fabio Vesperini, Felix Weninger, Florian Eyben, Stefano Squartini, and Björn Schuller. 2015. Non-linear prediction with LSTM recurrent neural networks for acoustic novelty detection. In IJCNN. IEEE, 1--7.
  45. Michael Mathieu Camille Couprie and Yann LeCun. 2016. Deep multi-scale video prediction beyond mean square error. In ICLR. Michael Mathieu Camille Couprie and Yann LeCun. 2016. Deep multi-scale video prediction beyond mean square error. In ICLR.
  46. Luke Metz Ben Poole David Pfau and Jascha Sohl-Dickstein. 2017. Unrolled generative adversarial networks. In ICLR. Luke Metz Ben Poole David Pfau and Jascha Sohl-Dickstein. 2017. Unrolled generative adversarial networks. In ICLR.
  47. Cuong Phuc Ngo , Amadeus Aristo Winarto , Connie Kou Khor Li, Sojeong Park, Farhan Akram, and Hwee Kuan Lee. 2019 . Fence GAN: Towards better anomaly detection. arXiv:1904.01209. Retrieved from https://arxiv.org/abs/1904.01209. Cuong Phuc Ngo, Amadeus Aristo Winarto, Connie Kou Khor Li, Sojeong Park, Farhan Akram, and Hwee Kuan Lee. 2019. Fence GAN: Towards better anomaly detection. arXiv:1904.01209. Retrieved from https://arxiv.org/abs/1904.01209. · arXiv
  48. Minh-Nghia Nguyen and Ngo Anh Vien . 2018. Scalable and interpretable one-class svms with deep learning and random fourier features . In ECML-PKDD. Springer , 157--172. Minh-Nghia Nguyen and Ngo Anh Vien. 2018. Scalable and interpretable one-class svms with deep learning and random fourier features. In ECML-PKDD. Springer, 157--172.
  49. Min-hwan Oh and Garud Iyengar. 2019. Sequential anomaly detection using inverse reinforcement learning. In KDD. 1480--1490. Min-hwan Oh and Garud Iyengar. 2019. Sequential anomaly detection using inverse reinforcement learning. In KDD. 1480--1490.
  50. Guansong Pang , Longbing Cao , Ling Chen , and Huan Liu . 2016. Unsupervised feature selection for outlier detection by modelling hierarchical value-feature couplings . In ICDM. IEEE , 410--419. Guansong Pang, Longbing Cao, Ling Chen, and Huan Liu. 2016. Unsupervised feature selection for outlier detection by modelling hierarchical value-feature couplings. In ICDM. IEEE, 410--419.
  51. Guansong Pang Anton van den Hengel Chunhua Shen and Longbing Cao. 2020. Deep reinforcement learning for unknown anomaly detection. arXiv:2009.06847. Retrieved from https://arxiv.org/abs/2009.06847. Guansong Pang Anton van den Hengel Chunhua Shen and Longbing Cao. 2020. Deep reinforcement learning for unknown anomaly detection. arXiv:2009.06847. Retrieved from https://arxiv.org/abs/2009.06847. · arXiv
  52. Guansong Pang Chunhua Shen Huidong Jin and Anton van den Hengel. 2019. Deep weakly-supervised anomaly detection. arXiv:1910.13601. Retrieved from https://arxiv.org/abs/1910.13601. Guansong Pang Chunhua Shen Huidong Jin and Anton van den Hengel. 2019. Deep weakly-supervised anomaly detection. arXiv:1910.13601. Retrieved from https://arxiv.org/abs/1910.13601. · arXiv
  53. Andrea Paudice , Luis Muñoz-González , Andras Gyorgy , and Emil C . Lupu . 2018 . Detection of adversarial training examples in poisoning attacks through anomaly detection. arXiv:1802.03041. Retrieved from https://arxiv.org/abs/1802.03041. Andrea Paudice, Luis Muñoz-González, Andras Gyorgy, and Emil C. Lupu. 2018. Detection of adversarial training examples in poisoning attacks through anomaly detection. arXiv:1802.03041. Retrieved from https://arxiv.org/abs/1802.03041. · arXiv
  54. Daniel Pérez-Cabo , David Jiménez-Cabello , Artur Costa-Pazo , and Roberto J . López-Sastre. 2019. Deep anomaly detection for generalized face anti-spoofing . In CVPR Workshops. Daniel Pérez-Cabo, David Jiménez-Cabello, Artur Costa-Pazo, and Roberto J. López-Sastre. 2019. Deep anomaly detection for generalized face anti-spoofing. In CVPR Workshops.
  55. Ali Rahimi and Benjamin Recht. 2008. Random features for large-scale kernel machines. In NeurIPS. 1177--1184. Ali Rahimi and Benjamin Recht. 2008. Random features for large-scale kernel machines. In NeurIPS. 1177--1184.
  56. Jie Ren Peter J. Liu Emily Fertig Jasper Snoek Ryan Poplin Mark Depristo Joshua Dillon and Balaji Lakshminarayanan. 2019. Likelihood ratios for out-of-distribution detection. In NeurIPS. 14680--14691. Jie Ren Peter J. Liu Emily Fertig Jasper Snoek Ryan Poplin Mark Depristo Joshua Dillon and Balaji Lakshminarayanan. 2019. Likelihood ratios for out-of-distribution detection. In NeurIPS. 14680--14691.
  57. Salah Rifai Pascal Vincent Xavier Muller Xavier Glorot and Yoshua Bengio. 2011. Contractive auto-encoders: Explicit invariance during feature extraction. In ICML. 833--840. Salah Rifai Pascal Vincent Xavier Muller Xavier Glorot and Yoshua Bengio. 2011. Contractive auto-encoders: Explicit invariance during feature extraction. In ICML. 833--840.
  58. Olaf Ronneberger , Philipp Fischer , and Thomas Brox . 2015 . U-net: Convolutional networks for biomedical image segmentation . In MICCAI. Springer , 234--241. Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In MICCAI. Springer, 234--241.
  59. Volker Roth. 2005. Outlier detection with one-class kernel fisher discriminants. In NeurIPS. 1169--1176. Volker Roth. 2005. Outlier detection with one-class kernel fisher discriminants. In NeurIPS. 1169--1176.
  60. Lukas Ruff , Nico Görnitz , Lucas Deecke , Shoaib Ahmed Siddiqui , Robert Vandermeulen, Alexander Binder, Emmanuel Müller, and Marius Kloft. 2018 . Deep one-class classification. In ICML. 4390--4399. Lukas Ruff, Nico Görnitz, Lucas Deecke, Shoaib Ahmed Siddiqui, Robert Vandermeulen, Alexander Binder, Emmanuel Müller, and Marius Kloft. 2018. Deep one-class classification. In ICML. 4390--4399.
  61. Lukas Ruff Robert A. Vandermeulen Nico Görnitz Alexander Binder Emmanuel Müller Klaus-Robert Müller and Marius Kloft. 2020. Deep semi-supervised anomaly detection. In ICLR. Lukas Ruff Robert A. Vandermeulen Nico Görnitz Alexander Binder Emmanuel Müller Klaus-Robert Müller and Marius Kloft. 2020. Deep semi-supervised anomaly detection. In ICLR.
  62. Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. In ICLR. Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. In ICLR.
  63. Mahito Sugiyama and Karsten Borgwardt. 2013. Rapid distance-based outlier detection via sampling. In NeurIPS. 467--475. Mahito Sugiyama and Karsten Borgwardt. 2013. Rapid distance-based outlier detection via sampling. In NeurIPS. 467--475.
  64. Ilya Sutskever , Oriol Vinyals , and Quoc V . Le . 2014 . Sequence to sequence learning with neural networks. In NeurIPS. 3104--3112. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In NeurIPS. 3104--3112.
  65. Lucas Theis Wenzhe Shi Andrew Cunningham and Ferenc Huszár. 2017. Lossy image compression with compressive autoencoders. In ICLR. Lucas Theis Wenzhe Shi Andrew Cunningham and Ferenc Huszár. 2017. Lossy image compression with compressive autoencoders. In ICLR.
  66. Yu Tian , Gabriel Maicas , Leonardo Zorron Cheng Tao Pu , Rajvinder Singh, Johan W. Verjans, and Gustavo Carneiro. 2020 . Few-shot anomaly detection for polyp frames from colonoscopy. In MICCAI. Yu Tian, Gabriel Maicas, Leonardo Zorron Cheng Tao Pu, Rajvinder Singh, Johan W. Verjans, and Gustavo Carneiro. 2020. Few-shot anomaly detection for polyp frames from colonoscopy. In MICCAI.
  67. Pascal Vincent , Hugo Larochelle , Isabelle Lajoie , Yoshua Bengio , and Pierre-Antoine Manzagol . 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11 (Dec . 2010 ), 3371--3408. Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol. 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11 (Dec. 2010), 3371--3408.
  68. Siqi Wang Yijie Zeng Xinwang Liu En Zhu Jianping Yin Chuanfu Xu and Marius Kloft. 2019. Effective end-to-end unsupervised outlier detection via inlier priority of discriminative network. In NeurIPS. 5960--5973. Siqi Wang Yijie Zeng Xinwang Liu En Zhu Jianping Yin Chuanfu Xu and Marius Kloft. 2019. Effective end-to-end unsupervised outlier detection via inlier priority of discriminative network. In NeurIPS. 5960--5973.
  69. Junyuan Xie Ross Girshick and Ali Farhadi. 2016. Unsupervised deep embedding for clustering analysis. In ICML. 478--487. Junyuan Xie Ross Girshick and Ali Farhadi. 2016. Unsupervised deep embedding for clustering analysis. In ICML. 478--487.
  70. Wei Xu , Ling Huang , Armando Fox , David Patterson , and Michael Jordan . 2009. Online system problem detection by mining patterns of console logs . In ICDM. IEEE , 588--597. Wei Xu, Ling Huang, Armando Fox, David Patterson, and Michael Jordan. 2009. Online system problem detection by mining patterns of console logs. In ICDM. IEEE, 588--597.
  71. Houssam Zenati , Manon Romain , Chuan-Sheng Foo , Bruno Lecouat , and Vijay Chandrasekhar . 2018. Adversarially learned anomaly detection . In ICDM. IEEE , 727--736. Houssam Zenati, Manon Romain, Chuan-Sheng Foo, Bruno Lecouat, and Vijay Chandrasekhar. 2018. Adversarially learned anomaly detection. In ICDM. IEEE, 727--736.
  72. Ke Zhang , Marcus Hutter , and Huidong Jin . 2009. A new local distance-based outlier detection approach for scattered real-world data . In PAKDD. Springer , 813--822. Ke Zhang, Marcus Hutter, and Huidong Jin. 2009. A new local distance-based outlier detection approach for scattered real-world data. In PAKDD. Springer, 813--822.
  73. Chong Zhou and Randy C . Paffenroth . 2017 . Anomaly detection with robust deep autoencoders. In KDD. ACM , 665--674. Chong Zhou and Randy C. Paffenroth. 2017. Anomaly detection with robust deep autoencoders. In KDD. ACM, 665--674.
  74. Jun-Yan Zhu Taesung Park Phillip Isola and Alexei A Efros. 2017. Unpaired image-to-image translation using cycle-consistent adversarial networks. In ICCV. 2223--2232. Jun-Yan Zhu Taesung Park Phillip Isola and Alexei A Efros. 2017. Unpaired image-to-image translation using cycle-consistent adversarial networks. In ICCV. 2223--2232.
  75. Bo Zong , Qi Song , Martin Renqiang Min , Wei Cheng, Cristian Lumezanu, Daeki Cho, and Haifeng Chen. 2018 . Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In ICLR. Bo Zong, Qi Song, Martin Renqiang Min, Wei Cheng, Cristian Lumezanu, Daeki Cho, and Haifeng Chen. 2018. Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In ICLR.

Cited by

See all 2,837

Metadata

Authors
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D.
Affiliations
  • The University of Adelaide (AU)
  • University of Technology Sydney (AU)
Venue
ACM Computing Surveys
Published
2021-03-05
Volume
54
Issue
2
Pages
1-38
ISSN
  • 0360-0300 (ISSN-L)
  • 1557-7341
OpenAlex
W3040266635
Cited by
2,837
References
91
Citations by year
2026: 484 · 2025: 629 · 2024: 604 · 2023: 524 · 2022: 396 · 2021: 185
FWCI
151.07
Type
journal article
Language
en
Open access
Locations
  • ACM Computing Surveys (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Singapore Management University Institutional Knowledge (InK) (Singapore Management University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
Keywords
deep anomaly detection, outlier detection, novelty detection, deep learning, objective function, underlying assumptions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Deep Learning for Anomaly Detection: A Review. https://app.cochat.ai/papers/10.1145/3439950
The paper
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022). Deep Learning for Anomaly Detection: A Review. ACM Computing Surveys. https://doi.org/10.1145/3439950

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.