A Background-Agnostic Framework with Adversarial Training for Abnormal Event Detection in Video
Open accessThe DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Abstract
Abnormal event detection in video is a complex computer vision problem that has attracted significant attention in recent years. The complexity of the task arises from the commonly-adopted definition of an abnormal event, that is, a rarely occurring event that typically depends on the surrounding context. Following the standard formulation of abnormal event detection as outlier detection, we propose a background-agnostic framework that learns from training videos containing only normal events. Our framework is composed of an object detector, a set of appearance and motion auto-encoders, and a set of classifiers. Since our framework only looks at object detections, it can be applied to different scenes, provided that normal events are defined identically across scenes and that the single main factor of variation is the background. This makes our method background agnostic, as we rely strictly on objects that can cause anomalies, and not on the background. To overcome the lack of abnormal data during training, we propose an adversarial learning strategy for the auto-encoders. We create a scene-agnostic set of out-of-domain pseudo-abnormal examples, which are correctly reconstructed by the auto-encoders before applying gradient ascent on the pseudo-abnormal examples. We further utilize the pseudo-abnormal examples to serve as abnormal examples when training appearance-based and motion-based binary classifiers to discriminate between normal and abnormal latent features and reconstructions. Furthermore, to ensure that the auto-encoders focus only on the main object inside each bounding box image, we introduce a branch that learns to segment the main object. We compare our framework with the state-of-the-art methods on four benchmark data sets, using various evaluation metrics. Compared to existing methods, the empirical results indicate that our approach achieves favorable performance on all data sets. In addition, we provide region-based and track-based annotations for two large-scale abnormal event detection data sets from the literature, namely ShanghaiTech and Subway.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“Instead of concatenating the features as in U-Net, we sum up the corresponding activation maps, as in ResNet [73].”
MethodU-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 2×
“We train the auto-encoders using the Adam optimizer [75] with the learning rate η = 10−4, keeping the default values for the other parameters of Adam.”
MethodGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“The resulting activation maps are subsequently passed through a neural network that follows the LeNet architecture [71], except that the spatial support of the conv filters is always 3 × 3 and the pooling operation is max-pooling instead of averagepooling.”
MethodMicrosoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
(2016) · Cited by 31,590
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939 · cited 8×
“Ionescu et al. [6] was the first work to propose an object-centric framework, employing a single-stage detection framework (SSD [49] with Feature Pyramid Networks (FPN) [50]) on each frame in order to extract objects of interest.”
MethodInfluentialHe, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
YOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141 · cited 6×
“Even though the results obtained with YOLOv3 [64] are not very encouraging, we have decided to continue the experiments with YOLOv3 [64], as it detects four times more objects than SSD-FPN, while having a lower false positive rate.”
MethodInfluentialA Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)
Khanam, Z., Achari, V. P. S., Boukhennoufa, I., Jindal, A., & Singh, A. K. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.ng-res.2024.2 · Cited by 14,040
(2010) · International Conference on Machine Learning · Cited by 13,995
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Real-World Anomaly Detection in Surveillance Videos
Sultani, W., Chen, C., & Shah, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00678 · Cited by 2,140
Self-citationGong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930 · cited 6×
“7% and a macro-averaged frame-level AUC of TABLE 4 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [8], [9], [11], [13], [14], [15], [16], [17], [18], [20], [24], [25], [26], [30], [34], [35], [38], [39], [41], [42], [43], [44]…”
BackgroundMethodResultInfluentialAbnormal crowd behavior detection using social force model
Mehran, R., Oyama, A., & Shah, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206641 · Cited by 1,672 · cited 11×
“In terms of the frame-level AUC scores, our cross-domain model outperforms in-domain methods such as [8], [14], [15], [16], [34] (see Table 4).”
BackgroundMethodInfluentialSelf-citationFuture Frame Prediction for Anomaly Detection - A New Baseline
Liu, W., Luo, W., Lian, D., & Gao, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00684 · Cited by 1,530
Anomaly detection in crowded scenes
Mahadevan, V., Li, W., Bhalodia, V., & Vasconcelos, N. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539872 · Cited by 1,512 · cited 9×
“Remarkably, our cross-domain results on Avenue [12], ShanghaiTech [13], Subway [23] and UCSD Ped2 [14] surpass many of the recently reported in-domain results (see Section 4.”
BackgroundMethodResultInfluentialAnomaly Detection with Robust Deep Autoencoders
Zhou, C., & Paffenroth, R. C. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098052 · Cited by 1,436 · cited 3×
“time series [59], images [60], [61], [62] or network traffic analysis [60], [63].”
BackgroundMethodAbnormal Event Detection at 150 FPS in MATLAB
Lu, C., Shi, J., & Jia, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.338 · Cited by 1,436 · cited 9×
“Remarkably, our cross-domain results on Avenue [12], ShanghaiTech [13], Subway [23] and UCSD Ped2 [14] surpass many of the recently reported in-domain results (see Section 4.”
BackgroundResultInfluentialLearning Temporal Regularity in Video Sequences
Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A. K., & Davis, L. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.86 · Cited by 1,397 · cited 10×
“Other recent approaches [5], [11], [13], [17], [20], [25], [26], [27], [31], [38], [39], [56] employed deep learning in order to detect the anomalous frames in a video.”
BackgroundMethodResultInfluentialA sparse texture representation using local affine regions
Lazebnik, S., Schmid, C., & Ponce, J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.151 · Cited by 1,123 · cited 1×
“Instead, it contains texture images [68], flower images [69], anime images, butterfly images and some categories from Tiny ImageNet that are unrelated to abnormal event detection, such as hourglass and acorn.”
BackgroundAnomaly Detection and Localization in Crowded Scenes
Li, W., Mahadevan, V., & Vasconcelos, N. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.111 · Cited by 1,017 · cited 3×
“Most of the recent works treat abnormal event detection as an outlier detection task [2], [3], [4], [5], [7], [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21], [22], [24], [25], [26], [27], [28], [30], [32], [51], learning a model using only normal data.”
BackgroundLearning Memory-Guided Normality for Anomaly Detection
Park, H., Noh, J., & Ham, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01438 · Cited by 929
Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors
Adam, A., Rivlin, E., Shimshoni, I., & Reinitz, D. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70825 · Cited by 918 · cited 9×
“Remarkably, our cross-domain results on Avenue [12], ShanghaiTech [13], Subway [23] and UCSD Ped2 [14] surpass many of the recently reported in-domain results (see Section 4.”
BackgroundMethodResultInfluentialA Revisit of Sparse Coding Based Anomaly Detection in Stacked RNN Framework
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.45 · Cited by 895 · cited 9×
“Remarkably, our cross-domain results on Avenue [12], ShanghaiTech [13], Subway [23] and UCSD Ped2 [14] surpass many of the recently reported in-domain results (see Section 4.”
BackgroundResultInfluentialA Visual Vocabulary for Flower Classification
Nilsback, M.-E., & Zisserman, A. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.42 · Cited by 824 · cited 1×
“Instead, it contains texture images [68], flower images [69], anime images, butterfly images and some categories from Tiny ImageNet that are unrelated to abnormal event detection, such as hourglass and acorn.”
BackgroundSparse reconstruction cost for abnormal event detection
Cong, Y., Yuan, J., & Liu, J. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995434 · Cited by 801 · cited 7×
“TABLE 3 Frame-level AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [3], [5], [6], [7], [19], [29], [32], [33], [34], [36] on the Subway data set.”
BackgroundResultInfluentialKim, J., & Grauman, K. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206569 · Cited by 768 · cited 10×
“6%), leading to superior performance with respect to in-domain methods such as [5], [8], [14], [15], [17], [24], [34], [35] (see Table 4).”
BackgroundMethodInfluentialLearning Deep Representations of Appearance and Motion for Anomalous Event Detection
Xu, D., Ricci, E., Yan, Y., Song, J., & Sebe, N. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.8 · Cited by 550
Online detection of unusual events in videos via dynamic sparse coding
Zhao, B., Fei-Fei, L., & Xing, E. P. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995524 · Cited by 532 · cited 3×
“Most of the recent works treat abnormal event detection as an outlier detection task [2], [3], [4], [5], [7], [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21], [22], [24], [25], [26], [27], [28], [30], [32], [51], learning a model using only normal data.”
BackgroundChaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes
Wu, S., Moore, B. E., & Shah, M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539882 · Cited by 525 · cited 1×
“Existing abnormal event detection methods can be categorized into distance-based approaches [6], [7], [17], [24], [25], [27], [29], [31], [52], [53], [54], reconstructionbased models [5], [11], [12], [13], [16], [18], [26], [32], [41], [42], probabilistic models [2], [3], [8], [14], [15], [23], [55], [56], [57] and ch…”
Self-citationAbnormal event detection in videos using generative adversarial nets
Ravanbakhsh, M., Nabi, M., Sangineto, E., Marcenaro, L., Regazzoni, C., & Sebe, N. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296547 · Cited by 515 · cited 10×
“Other recent approaches [5], [11], [13], [17], [20], [25], [26], [27], [31], [38], [39], [56] employed deep learning in order to detect the anomalous frames in a video.”
BackgroundMethodInfluentialDetecting anomalous events in videos by learning deep representations of appearance and motion
Xu, D., Yan, Y., Ricci, E., & Sebe, N. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.10.010 · Cited by 474 · cited 9×
“Other recent approaches [5], [11], [13], [17], [20], [25], [26], [27], [31], [38], [39], [56] employed deep learning in order to detect the anomalous frames in a video.”
BackgroundMethodResultInfluentialDeep-anomaly: Fully convolutional neural network for fast anomaly detection in crowded scenes
Sabokrou, M., Fayyaz, M., Fathy, M., Moayed, Z., & Klette, R. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.02.006 · Cited by 470 · cited 1×
“Existing abnormal event detection methods can be categorized into distance-based approaches [6], [7], [17], [24], [25], [27], [29], [31], [52], [53], [54], reconstructionbased models [5], [11], [12], [13], [16], [18], [26], [32], [41], [42], probabilistic models [2], [3], [8], [14], [15], [23], [55], [56], [57] and ch…”
Anomaly Detection in Video Sequence With Appearance-Motion Correspondence
Nguyen, T. N., & Meunier, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00136 · Cited by 459 · cited 10×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
BackgroundMethodInfluentialObject-Centric Auto-Encoders and Dummy Anomalies for Abnormal Event Detection in Video
Ionescu, R. T., Khan, F. S., Georgescu, M.-I., & Shao, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00803 · Cited by 425 · cited 10×
“[6] was the first work to propose an object-centric framework, employing a single-stage detection framework (SSD [49] with Feature Pyramid Networks (FPN) [50]) on each frame in order to extract objects of interest.”
BackgroundMethodResultInfluentialSelf-citationSabokrou, M., Fayyaz, M., Fathy, M., & Klette, R. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2670780 · Cited by 386 · cited 6×
“Other recent approaches [5], [11], [13], [17], [20], [25], [26], [27], [31], [38], [39], [56] employed deep learning in order to detect the anomalous frames in a video.”
BackgroundMethodInfluentialUnmasking the Abnormal Events in Video
Ionescu, R. T., Smeureanu, S., Alexe, B., & Popescu, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.315 · Cited by 335 · cited 10×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
BackgroundMethodResultInfluentialSelf-citationVideo anomaly detection based on local statistical aggregates
Saligrama, V., & Chen, Z. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247917 · Cited by 332 · cited 4×
“TABLE 3 Frame-level AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [3], [5], [6], [7], [19], [29], [32], [33], [34], [36] on the Subway data set.”
ResultInfluentialSelFlow: Self-Supervised Learning of Optical Flow
Liu, P., Lyu, M., King, I., & Xu, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00470 · Cited by 323 · cited 4×
“The slowest component of our framework is SelFlow [67], which runs at 20 FPS on mini-batches of 32 frames.”
MethodInfluentialIntegrating prediction and reconstruction for anomaly detection
Tang, Y., Zhao, L., Zhang, S., Gong, C., Li, G., & Yang, J. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.11.024 · Cited by 282 · cited 9×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
BackgroundMethodInfluentialOutlier Detection for Time Series with Recurrent Autoencoder Ensembles
Kieu, T., Yang, B., Guo, C., & Jensen, C. S. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/378 · Cited by 272 · cited 3×
“time series [59], images [60], [61], [62] or network traffic analysis [60], [63].”
BackgroundMethodJoint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledge
Hinami, R., Mei, T., & Satoh, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.391 · Cited by 268 · cited 2×
“Other recent approaches [5], [11], [13], [17], [20], [25], [26], [27], [31], [38], [39], [56] employed deep learning in order to detect the anomalous frames in a video.”
BackgroundSelf-Trained Deep Ordinal Regression for End-to-End Video Anomaly Detection
Pang, G., Yan, C., Shen, C., van den Hengel, A., & Bai, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01219 · Cited by 257
Cheng, K.-W., Chen, Y.-T., & Fang, W.-H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298909 · Cited by 234 · cited 9×
“For the Entrance video, we follow [3], [7] and split the video in 53% frames for training and 47% frames for testing.”
BackgroundMethodResultInfluentialPlug-and-Play CNN for Crowd Motion Analysis: An Application in Abnormal Event Detection
Ravanbakhsh, M., Nabi, M., Mousavi, H., Sangineto, E., & Sebe, N. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00188 · Cited by 216
Few-Shot Scene-Adaptive Anomaly Detection
Lu, Y., Yu, F., Reddy, M. K. K., & Wang, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58558-7_8 · Cited by 207
A Discriminative Framework for Anomaly Detection in Large Videos
Del Giorno, A., Bagnell, J. A., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_21 · Cited by 204 · cited 10×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
BackgroundMethodResultInfluentialRobust Anomaly Detection in Images Using Adversarial Autoencoders
Beggel, L., Pfeiffer, M., & Bischl, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-46150-8_13 · Cited by 196
Cloze Test Helps: Effective Video Anomaly Detection via Learning to Complete Video Events
Yu, G., Wang, S., Cai, Z., Zhu, E., Xu, C., Yin, J., & Kloft, M. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413973 · Cited by 193 · cited 8×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
BackgroundMethodInfluentialA Deep One-Class Neural Network for Anomalous Event Detection in Complex Scenes
Wu, P., Liu, J., & Shen, F. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2933554 · Cited by 191 · cited 10×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
BackgroundResultInfluentialOld Is Gold: Redefining the Adversarially Learned One-Class Classifier Training Paradigm
Zaigham Zaheer, M., Lee, J.-H., Astrid, M., & Lee, S.-I. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01419 · Cited by 186 · cited 4×
“UCSD Ped2 is one of the most popular benchmarks in video anomaly detection, with a broad range of methods reporting results on it [4], [5], [6], [8], [9], [11], [13], [14], [15], [16], [17], [18], [20], [24], [25], [26], [30], [34], [35], [38], [39], [41], [42], [43], [44], [47], [48].”
BackgroundInfluentialLearning deep event models for crowd anomaly detection
Feng, Y., Yuan, Y., & Lu, X. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.09.063 · Cited by 180 · cited 1×
“Existing abnormal event detection methods can be categorized into distance-based approaches [6], [7], [17], [24], [25], [27], [29], [31], [52], [53], [54], reconstructionbased models [5], [11], [12], [13], [16], [18], [26], [32], [41], [42], probabilistic models [2], [3], [8], [14], [15], [23], [55], [56], [57] and ch…”
Street Scene: A new dataset and evaluation protocol for video anomaly detection
Ramachandra, B., & Jones, M. J. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093457 · Cited by 180 · cited 10×
“[24] did not provide the region-based and track-based annotations required to compute RBDC and TBDC on ShanghaiTech and Subway, we labeled these data sets ourselves.”
BackgroundMethodResultInfluentialA Survey of Single-Scene Video Anomaly Detection
Ramachandra, B., Jones, M., & Vatsavai, R. R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3040591 · Cited by 173
BMAN: Bidirectional Multi-Scale Aggregation Networks for Abnormal Event Detection
Lee, S., Kim, H. G., & Ro, Y. M. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2948286 · Cited by 170 · cited 9×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
BackgroundMethodInfluentialVideo parsing for abnormality detection
Antic, B., & Ommer, B. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126525 · Cited by 164 · cited 4×
“Most of the recent works treat abnormal event detection as an outlier detection task [2], [3], [4], [5], [7], [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21], [22], [24], [25], [26], [27], [28], [30], [32], [51], learning a model using only normal data.”
BackgroundInfluentialDeep Appearance Features for Abnormal Behavior Detection in Video
Smeureanu, S., Ionescu, R. T., Popescu, M., & Alexe, B. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68548-9_70 · Cited by 153 · cited 6×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
BackgroundInfluentialSelf-citationDual Discriminator Generative Adversarial Network for Video Anomaly Detection
Dong, F., Zhang, Y., & Nie, X. (2020) · IEEE Access · doi:10.1109/access.2020.2993373 · Cited by 150 · cited 9×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
BackgroundMethodInfluentialDetecting Abnormal Events in Video Using Narrowed Normality Clusters
Ionescu, R. T., Smeureanu, S., Popescu, M., & Alexe, B. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00212 · Cited by 137 · cited 10×
“For the Exit video, similar to [7], [12], we use the first 15 minutes for training and the rest of the video for testing.”
BackgroundMethodInfluentialSelf-citationScene-Aware Context Reasoning for Unsupervised Abnormal Event Detection in Videos
Sun, C., Jia, Y., Hu, Y., & Wu, Y. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413887 · Cited by 134
Continual Learning for Anomaly Detection in Surveillance Videos
Doshi, K., & Yilmaz, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00135 · Cited by 131 · cited 9×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
BackgroundMethodInfluentialOnline growing neural gas for anomaly detection in changing surveillance scenes
Sun, Q., Liu, H., & Harada, T. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.09.016 · Cited by 127 · cited 1×
“Existing abnormal event detection methods can be categorized into distance-based approaches [6], [7], [17], [24], [25], [27], [29], [31], [52], [53], [54], reconstructionbased models [5], [11], [12], [13], [16], [18], [26], [32], [41], [42], probabilistic models [2], [3], [8], [14], [15], [23], [55], [56], [57] and ch…”
Learning a distance function with a Siamese network to localize anomalies in videos
Ramachandra, B., Jones, M., & Vatsavai, R. R. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093417 · Cited by 126 · cited 10×
“[25], we obtain a considerable improvement of 23.”
BackgroundMethodInfluentialAny-Shot Sequential Anomaly Detection in Surveillance Videos
Doshi, K., & Yılmaz, Y. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00475 · Cited by 116
Classifier Two Sample Test for Video Anomaly Detections.
Liu, Y., Li, C., & Póczos, B. (2018) · British Machine Vision Conference (BMVC) · Cited by 115
Video anomaly detection based on locality sensitive hashing filters
Zhang, Y., Lu, H., Zhang, L., Ruan, X., & Sakai, S. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.11.018 · Cited by 112 · cited 5×
“Most of the recent works treat abnormal event detection as an outlier detection task [2], [3], [4], [5], [7], [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21], [22], [24], [25], [26], [27], [28], [30], [32], [51], learning a model using only normal data.”
BackgroundInfluentialCluster Attention Contrast for Video Anomaly Detection
Wang, Z., Zou, Y., & Zhang, Z. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413529 · Cited by 109 · cited 5×
“TABLE 1 Micro-averaged AUC, macro-averaged AUC, RBDC and TBDC scores (in %) of our approach compared to the state-of-the-art methods [4], [5], [6], [7], [9], [11], [12], [13], [16], [18], [19], [24], [25], [31], [33], [34], [35], [38], [39], [40], [41], [45], [46], [47] on the Avenue data set.”
MethodInfluentialAnomaly Detection using a Convolutional Winner-Take-All Autoencoder
Tran, H. T. M., & Hogg, D. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.139 · Cited by 92 · cited 1×
“Existing abnormal event detection methods can be categorized into distance-based approaches [6], [7], [17], [24], [25], [27], [29], [31], [52], [53], [54], reconstructionbased models [5], [11], [12], [13], [16], [18], [26], [32], [41], [42], probabilistic models [2], [3], [8], [14], [15], [23], [55], [56], [57] and ch…”
STAN: Spatio-Temporal Adversarial Networks for Abnormal Event Detection
Lee, S., Kim, H. G., & Ro, Y. M. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462388 · Cited by 90
Generative Adversarial Attributed Network Anomaly Detection
Chen, Z., Liu, B., Wang, M., Dai, P., Lv, J., & Bo, L. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3412070 · Cited by 89 · cited 3×
“time series [59], images [60], [61], [62] or network traffic analysis [60], [63].”
BackgroundMethodUnsupervised Behavior-Specific Dictionary Learning for Abnormal Event Detection
Ren, H., Liu, W., Olsen, S. I., Escalera, S., & Moeslund, T. B. (2015) · British Machine Vision Conference (BMVC) · doi:10.5244/c.29.28 · Cited by 67 · cited 3×
“A handful of preliminary works [3], [12], [28], [32], [51] proposed to build a dictionary of atoms representing normal events, labeling the events that are not represented in the dictionary as abnormal.”
BackgroundResultZhang, X., Yang, S., Zhang, J., & Zhang, W. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107394 · Cited by 60 · cited 4×
“Most of the recent works treat abnormal event detection as an outlier detection task [2], [3], [4], [5], [7], [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21], [22], [24], [25], [26], [27], [28], [30], [32], [51], learning a model using only normal data.”
BackgroundInfluentialOnline Detection of Abnormal Events Using Incremental Coding Length
Dutta, J., & Banerjee, B. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9799 · Cited by 56
Adversarial Training for Satire Detection: Controlling for Confounding Variables
McHardy, R., Adel, H., & Klinger, R. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1069 · Cited by 33
TAM-Net: Temporal Enhanced Appearance-to-Motion Generative Network for Video Anomaly Detection
Ji, X., Li, B., & Zhu, Y. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207231 · Cited by 26 · cited 4×
“UCSD Ped2 is one of the most popular benchmarks in video anomaly detection, with a broad range of methods reporting results on it [4], [5], [6], [8], [9], [11], [13], [14], [15], [16], [17], [18], [20], [24], [25], [26], [30], [34], [35], [38], [39], [41], [42], [43], [44], [47], [48].”
BackgroundInfluentialLipschitz Continuous Autoencoders in Application to Anomaly Detection.
Kim, Y.-G., Kwon, Y., Chang, H., & Paik, M. C. (2020) · International Conference on Artificial Intelligence and Statistics · Cited by 15
Cited by
Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection
Ristea, N.-C., Madan, N., Ionescu, R. T., Nasrollahi, K., Khan, F. S., Moeslund, T. B., & Shah, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01321 · Cited by 315
Self-citationUBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detection
Acsintoae, A., Florescu, A., Georgescu, M.-I., Mare, T., Sumedrea, P., Ionescu, R. T., Khan, F. S., & Shah, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01951 · Cited by 185
“Legend: † – computed based on the tracks from [18]; ‡ – computed based on tracks from [43].”
InfluentialSelf-citationWeakly Supervised Video Anomaly Detection via Transformer-Enabled Temporal Relation Learning
Zhang, D., Huang, C., Liu, C., & Xu, Y. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3175092 · Cited by 58
Metadata
- Authors
- Georgescu, M. I., Ionescu, R., Khan, F. S., Popescu, M., & Shah, M.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021
- Volume
- 44
- Issue
- 9
- Pages
- 1-1
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3082213779
- Cited by
- 187
- References
- 79
- FWCI
- 11.56
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.