The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Real-World Anomaly Detection in Surveillance Videos
Open accessAbstract
Surveillance videos are able to capture a variety of realistic anomalies. In this paper, we propose to learn anomalies by exploiting both normal and anomalous videos. To avoid annotating the anomalous segments or clips in training videos, which is very time consuming, we propose to learn anomaly through the deep multiple instance ranking framework by leveraging weakly labeled training videos, i.e. the training labels (anomalous or normal) are at video-level instead of clip-level. In our approach, we consider normal and anomalous videos as bags and video segments as instances in multiple instance learning (MIL), and automatically learn a deep anomaly ranking model that predicts high anomaly scores for anomalous video segments. Furthermore, we introduce sparsity and temporal smoothness constraints in the ranking loss function to better localize anomaly during training. We also introduce a new large-scale first of its kind dataset of 128 hours of videos. It consists of 1900 long and untrimmed real-world surveillance videos, with 13 realistic anomalies such as fighting, road accident, burglary, robbery, etc. as well as normal activities. This dataset can be used for two tasks. First, general anomaly detection considering all anomalies in one group and all normal activities in another group. Second, for recognizing each of 13 anomalous activities. Our experimental results show that our MIL method for anomaly detection achieves significant improvement on anomaly detection performance as compared to the state-of-the-art approaches. We provide the results of several recent deep learning baselines on anomalous activity recognition. The low recognition performance of these baselines reveals that our dataset is very challenging and opens more opportunities for future work. The dataset is available at: http://crcv.ucf.edu/projects/real-world.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2014) · Cited by 33,419
(2010) · International Conference on Machine Learning · Cited by 13,995
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
(2010) · Cited by 8,261
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
Solving the multiple instance problem with axis-parallel rectangles
Dietterich, T. G., Lathrop, R. H., & Lozano-Pérez, T. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(96)00034-3 · Cited by 2,866
NetVLAD: CNN Architecture for Weakly Supervised Place Recognition
Arandjelovic, R., Gronat, P., Torii, A., Pajdla, T., & Sivic, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.572 · Cited by 2,584
Abnormal crowd behavior detection using social force model
Mehran, R., Oyama, A., & Shah, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206641 · Cited by 1,672
Self-citation
Cited by
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240
CutPaste: Self-Supervised Learning for Anomaly Detection and Localization
Li, C.-L., Sohn, K., Yoon, J., & Pfister, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00954 · Cited by 1,107
Zhong, J.-X., Li, N., Kong, W., Liu, S., Li, T. H., & Li, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00133 · Cited by 588
End-to-End Learning of Visual Representations From Uncurated Instructional Videos
Miech, A., Alayrac, J.-B., Smaira, L., Laptev, I., Sivic, J., & Zisserman, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00990 · Cited by 580
Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learning
Tian, Y., Pang, G., Chen, Y., Singh, R., Verjans, J. W., & Carneiro, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00493 · Cited by 557
Not only Look, But Also Listen: Learning Multimodal Violence Detection Under Weak Supervision
Wu, P., Liu, J., Shi, Y., Sun, Y., Shao, F., Wu, Z., & Yang, Z. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58577-8_20 · Cited by 482
Anomaly Detection in Video Sequence With Appearance-Motion Correspondence
Nguyen, T. N., & Meunier, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00136 · Cited by 459
Object-Centric Auto-Encoders and Dummy Anomalies for Abnormal Event Detection in Video
Ionescu, R. T., Khan, F. S., Georgescu, M.-I., & Shao, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00803 · Cited by 425
MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection
Feng, J.-C., Hong, F.-T., & Zheng, W.-S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01379 · Cited by 355
Anomaly Detection in Video via Self-Supervised and Multi-Task Learning
Georgescu, M.-I., Barbalau, A., Ionescu, R. T., Shahbaz Khan, F., Popescu, M., & Shah, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01255 · Cited by 350
Self-citationA comprehensive review on deep learning-based methods for video anomaly detection
Nayak, R., Pati, U. C., & Das, S. K. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2020.104078 · Cited by 324
CNN features with bi-directional LSTM for real-time anomaly detection in surveillance networks
Ullah, W., Ullah, A., Haq, I. U., Muhammad, K., Sajjad, M., & Baik, S. W. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09406-3 · Cited by 310
Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection
Ristea, N.-C., Madan, N., Ionescu, R. T., Nasrollahi, K., Khan, F. S., Moeslund, T. B., & Shah, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01321 · Cited by 315
Self-citationSelf-Training Multi-Sequence Learning with Transformer for Weakly Supervised Video Anomaly Detection
Li, S., Liu, F., & Jiao, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20028 · Cited by 280
Self-Trained Deep Ordinal Regression for End-to-End Video Anomaly Detection
Pang, G., Yan, C., Shen, C., van den Hengel, A., & Bai, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01219 · Cited by 257
RWF-2000: An Open Large Scale Video Database for Violence Detection
Cheng, M., Cai, K., & Li, M. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9412502 · Cited by 255
Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detection
Ding, C., Pang, G., & Shen, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00724 · Cited by 197
Deep Learning-Based Anomaly Detection in Video Surveillance: A Survey
Duong, H.-T., Le, V.-T., & Hoang, V. T. (2023) · Sensors · doi:10.3390/s23115024 · Cited by 178
TransCNN: Hybrid CNN and transformer mechanism for surveillance anomaly detection
Ullah, W., Hussain, T., Ullah, F. U. M., Lee, M. Y., & Baik, S. W. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106173 · Cited by 128
Lee, Y., & Kang, P. (2022) · arXiv · doi:10.48550/arxiv.2203.10808 · Cited by 123
Mohammadian Rad, N., Van Laarhoven, T., Furlanello, C., & Marchiori, E. (2018) · Sensors · doi:10.3390/s18103533 · Cited by 76
Anomaly Detection in Videos for Video Surveillance Applications using Neural Networks
Franklin, R. J., Mohana, & Dabbagol, V. (2020) · 2020 Fourth International Conference on Inventive Systems and Control (ICISC) · doi:10.1109/icisc47916.2020.9171212 · Cited by 79
Review on Deep Learning Approaches for Anomaly Event Detection in Video Surveillance
Jebur, S. A., Hussein, K. A., Hoomod, H. K., Alzubaidi, L., & Santamaría, J. (2022) · Electronics · doi:10.3390/electronics12010029 · Cited by 69
Transformer-Based Spatio-Temporal Unsupervised Traffic Anomaly Detection in Aerial Videos
Tran, T. M., Bui, D. C., Nguyen, T. V., & Nguyen, K. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3376399 · Cited by 63
Weakly Supervised Video Anomaly Detection via Transformer-Enabled Temporal Relation Learning
Zhang, D., Huang, C., Liu, C., & Xu, Y. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3175092 · Cited by 58
TDS-Net: Transformer enhanced dual-stream network for video Anomaly Detection
Hussain, A., Ullah, W., Khan, N., Khan, Z. A., Kim, M. J., & Baik, S. W. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124846 · Cited by 47
MLVU: Benchmarking Multi-task Long Video Understanding
Zhou, J., Shu, Y., Zhao, B., Wu, B., Liang, Z., Xiao, S., Qin, M., Yang, X., Xiong, Y., Zhang, B., et al. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.01278 · Cited by 44
Video-Bench: A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models
Ning, M., Zhu, B., Xie, Y., Lin, B., Cui, J., Yuan, L., Chen, D., & Yuan, L. (2023) · arXiv · doi:10.48550/arxiv.2311.16103 · Cited by 36
Cai, L., Huang, S., Zhang, Y., Lu, J., & Zhang, Y. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103631 · Cited by 33
Nazir, A., Mitra, R., Sulieman, H., & Kamalov, F. (2023) · Sensors · doi:10.3390/s23135811 · Cited by 30
Paulraj, S., & Vairavasundaram, S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109496 · Cited by 27
Class-incremental learning network for real-time anomaly recognition in surveillance environments
Hussain, A., Ullah, W., Khan, N., Khan, Z. A., Yar, H., & Baik, S. W. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2025.112064 · Cited by 24
Mancy, H., & Naith, Q. H. (2025) · IEEE Access · doi:10.1109/access.2025.3551207 · Cited by 23
Toward Explainable Deep Anomaly Detection
Pang, G., & Aggarwal, C. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3470794 · Cited by 23
A Semantic-Enhanced Method Based On Deep SVDD for Pixel-Wise Anomaly Detection
Hu, C., Chen, K., & Shao, H. (2021) · 2021 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428370 · Cited by 24
Natha, S., Siraj, M., Ahmed, F., Altamimi, M., & Syed, M. (2025) · IEEE Access · doi:10.1109/access.2025.3574835 · Cited by 22
Yun, S., Masukawa, R., Na, M., & Imani, M. (2025) · 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv61041.2025.00464 · Cited by 14
Vision transformer embedded video anomaly detection using attention driven recurrence
Muna, U. M., Biswas, S., Zarif, S. A. A. M., Deori, P. J., Tajwar, T., & Shatabda, S. (2025) · Array · doi:10.1016/j.array.2025.100471 · Cited by 15
Time-Series Multi-Instance Learning for Weakly Supervised Industrial Fault Detection
Liu, C., He, S., Li, S., Shi, Z., & Meng, W. (2025) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3523591 · Cited by 8
Metadata
- Authors
- Sultani, W., Chen, C., & Shah, M.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 6479-6488
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2783882151
- Cited by
- 2,140
- References
- 41
- FWCI
- 56.59
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.