The DOI matches its Crossref record; 366 of the 366 references it cites were found in a registry or an index.
A Unifying Review of Deep and Shallow Anomaly Detection
Open accessAbstract
Deep learning approaches to anomaly detection (AD) have recently improved the state of the art in detection performance on complex data sets, such as large collections of images or text. These results have sparked a renewed interest in the AD problem and led to the introduction of a great variety of new methods. With the emergence of numerous such methods, including approaches based on generative models, one-class classification, and reconstruction, there is a growing need to bring methods of this field into a systematic and unified perspective. In this review, we aim to identify the common underlying principles and the assumptions that are often made implicitly by various methods. In particular, we draw connections between classic “shallow” and novel deep approaches and show how this relation might cross-fertilize or extend both directions. We further provide an empirical assessment of major existing methods that are enriched by the use of recent explainability techniques and present specific worked-through examples together with practical advice. Finally, we outline critical open challenges and identify specific paths for future research in AD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Cited by
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3060483 · Cited by 1,477
“However, for unsupervised problems, such as anomaly detection or clustering, although deep models have also reached successes [27], [155], [156], shallow models (e.”
BackgroundSelf-citationCombining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical Systems
Keith, J. A., Vassilev-Galindo, V., Cheng, B., Chmiela, S., Gastegger, M., Müller, K.-R., & Tkatchenko, A. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00107 · Cited by 849
A Comprehensive Survey on Graph Anomaly Detection With Deep Learning
Ma, X., Wu, J., Xue, S., Yang, J., Zhou, C., Sheng, Q. Z., Xiong, H., & Akoglu, L. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3118815 · Cited by 835
Gudovskiy, D., Ishizaka, S., & Kozuka, K. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00188 · Cited by 669
SPot-the-Difference Self-supervised Pre-training for Anomaly Detection and Segmentation
Zou, Y., Jeong, J., Pemula, L., Zhang, D., & Dabeer, O. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20056-4_23 · Cited by 651
Deep Isolation Forest for Anomaly Detection
Xu, H., Pang, G., Wang, Y., & Wang, Y. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3270293 · Cited by 556
Machine Learning for Electrocatalyst and Photocatalyst Design and Discovery
Mai, H., Le, T. C., Chen, D., Winkler, D. A., & Caruso, R. A. (2022) · Chemical Reviews · doi:10.1021/acs.chemrev.2c00061 · Cited by 552
Generalized Out-of-Distribution Detection: A Survey
Yang, J., Zhou, K., Li, Y., & Liu, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02117-4 · Cited by 884
GAN-based anomaly detection: A review
Xia, X., Pan, X., Li, N., He, X., Ma, L., Zhang, X., & Ding, N. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.12.093 · Cited by 392
DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detection
Yang, Y., Zhang, C., Zhou, T., Wen, Q., & Sun, L. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599295 · Cited by 387
Graph Neural Networks for Anomaly Detection in Industrial Internet of Things
Wu, Y., Dai, H.-N., & Tang, H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3094295 · Cited by 338
Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals
Zhang, Y., Chen, Y., Wang, J., & Pan, Z. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3102110 · Cited by 312
Artificial intelligence for modeling and understanding extreme weather and climate events
Camps-Valls, G., Fernández-Torres, M.-Á., Cohrs, K.-H., Höhl, A., Castelletti, A., Pacal, A., Robin, C., Martinuzzi, F., Papoutsis, I., Prapas, I., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-56573-8 · Cited by 288
Deep Learning for Unsupervised Anomaly Localization in Industrial Images: A Survey
Tao, X., Gong, X., Zhang, X., Yan, S., & Adak, C. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3196436 · Cited by 228
A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Images
Cui, Y., Liu, Z., & Lian, S. (2022) · arXiv · doi:10.48550/arxiv.2204.11161 · Cited by 154
“However, in many application scenarios, it is difficult to collect a sufficient number of samples [82].”
BackgroundA Survey on Explainable Anomaly Detection
Li, Z., Zhu, Y., & Van Leeuwen, M. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3609333 · Cited by 139
“Moreover, it may also be known as an unusual, irregular, atypical, inconsistent, unexpected, rare, erroneous, faulty, fraudulent, malicious, unnatural, or strange object [182].”
BackgroundEXplainable Artificial Intelligence (XAI)—From Theory to Methods and Applications
Ortigossa, E. S., Gonçalves, T., & Nonato, L. G. (2024) · IEEE Access · doi:10.1109/access.2024.3409843 · Cited by 124
Unsupervised Image Anomaly Detection and Segmentation Based on Pretrained Feature Mapping
Wan, Q., Gao, L., Li, X., & Wen, L. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3182385 · Cited by 120
“The two tasks are longstanding problems in automatic industrial scenarios and are difficult to solve due to the unknowable distribution of the anomalies [5].”
BackgroundDemystifying MLOps and Presenting a Recipe for the Selection of Open-Source Tools
Ruf, P., Madan, M., Reich, C., & Ould-Abdeslam, D. (2021) · Applied Sciences · doi:10.3390/app11198861 · Cited by 112
Semantic anomaly detection with large language models
Elhafsi, A., Sinha, R., Agia, C., Schmerling, E., Nesnas, I. A. D., & Pavone, M. (2023) · Autonomous Robots · doi:10.1007/s10514-023-10132-6 · Cited by 101
Industrial Image Anomaly Localization Based on Gaussian Clustering of Pretrained Feature
Wan, Q., Gao, L., Li, X., & Wen, L. (2022) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2021.3094452 · Cited by 94
Barbado, A., Corcho, Ó., & Benjamins, R. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116100 · Cited by 77
Guha Roy, A., Ren, J., Azizi, S., Loh, A., Natarajan, V., Mustafa, B., Pawlowski, N., Freyberg, J., Liu, Y., Beaver, Z., et al. (2022) · Medical Image Analysis · doi:10.1016/j.media.2021.102274 · Cited by 77
Review on Deep Learning Approaches for Anomaly Event Detection in Video Surveillance
Jebur, S. A., Hussein, K. A., Hoomod, H. K., Alzubaidi, L., & Santamaría, J. (2022) · Electronics · doi:10.3390/electronics12010029 · Cited by 69
Zheng, Y., Wang, X., Deng, R., Bao, T., Zhao, R., & Wu, L. (2022) · 2022 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme52920.2022.9859925 · Cited by 80
Yepmo, V., Smits, G., & Pivert, O. (2022) · Data & Knowledge Engineering · doi:10.1016/j.datak.2021.101946 · Cited by 52
Self-Supervised Learning for Anomaly Detection With Dynamic Local Augmentation
Yoa, S., Lee, S., Kim, C., & Kim, H. J. (2021) · IEEE Access · doi:10.1109/access.2021.3124525 · Cited by 38
Gonaygunta, H., Nadella, G. S., Pramod Pawar, P., & Kumar, D. (2024) · 2024 Systems and Information Engineering Design Symposium (SIEDS) · doi:10.1109/sieds61124.2024.10534661 · Cited by 39
Logit Inducing With Abnormality Capturing for Semi-Supervised Image Anomaly Detection
Wan, Q., Gao, L., & Li, X. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3205674 · Cited by 22
A General-Purpose Method for Applying Explainable AI for Anomaly Detection
Sipple, J., & Youssef, A. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-16564-1_16 · Cited by 18
Transfer Learning Gaussian Anomaly Detection by Fine-tuning Representations
Rippel, O., Chavan, A., Lei, C., & Merhof, D. (2022) · Proceedings of the 2nd International Conference on Image Processing and Vision Engineering · doi:10.5220/0011063900003209 · Cited by 17
“For a general, exhaustive overview over AD we refer to [46].”
BackgroundMAMo: Leveraging Memory and Attention for Monocular Video Depth Estimation
Yasarla, R., Cai, H., Jeong, J., Shi, Y., Garrepalli, R., & Porikli, F. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00804 · Cited by 15
Hong, A. E., Malinovsky, P. P., & Damodaran, S. K. (2024) · Digital Threats: Research and Practice · doi:10.1145/3604434 · Cited by 11
Anomaly detection for high-content image-based phenotypic cell profiling
Shpigler, A., Kolet, N., Golan, S., Weisbart, E., & Zaritsky, A. (2025) · Cell Systems · doi:10.1016/j.cels.2025.101429 · Cited by 5
One-Class Intrusion Detection with Dynamic Graphs
Liuliakov, A., Schulz, A., Hermes, L., & Hammer, B. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-44216-2_44 · Cited by 5
Metadata
- Authors
- Ruff, L., Kauffmann, J. R., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R.
- Venue
- Proceedings of the IEEE
- Published
- 2021-05
- Volume
- 109
- Issue
- 5
- Pages
- 756-795
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W3089028909
- Cited by
- 914
- References
- 366
- FWCI
- 50.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.