The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Real-World Anomaly Detection in Surveillance Videos
Open accessAbstract
Surveillance videos are able to capture a variety of realistic anomalies. In this paper, we propose to learn anomalies by exploiting both normal and anomalous videos. To avoid annotating the anomalous segments or clips in training videos, which is very time consuming, we propose to learn anomaly through the deep multiple instance ranking framework by leveraging weakly labeled training videos, i.e. the training labels (anomalous or normal) are at video-level instead of clip-level. In our approach, we consider normal and anomalous videos as bags and video segments as instances in multiple instance learning (MIL), and automatically learn a deep anomaly ranking model that predicts high anomaly scores for anomalous video segments. Furthermore, we introduce sparsity and temporal smoothness constraints in the ranking loss function to better localize anomaly during training. We also introduce a new large-scale first of its kind dataset of 128 hours of videos. It consists of 1900 long and untrimmed real-world surveillance videos, with 13 realistic anomalies such as fighting, road accident, burglary, robbery, etc. as well as normal activities. This dataset can be used for two tasks. First, general anomaly detection considering all anomalies in one group and all normal activities in another group. Second, for recognizing each of 13 anomalous activities. Our experimental results show that our MIL method for anomaly detection achieves significant improvement on anomaly detection performance as compared to the state-of-the-art approaches. We provide the results of several recent deep learning baselines on anomalous activity recognition. The low recognition performance of these baselines reveals that our dataset is very challenging and opens more opportunities for future work. The dataset is available at: http://crcv.ucf.edu/projects/real-world.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2014) · Cited by 33,419
(2010) · International Conference on Machine Learning · Cited by 13,995
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
(2010) · Cited by 8,261
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
Solving the multiple instance problem with axis-parallel rectangles
Dietterich, T. G., Lathrop, R. H., & Lozano-Pérez, T. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(96)00034-3 · Cited by 2,866
NetVLAD: CNN Architecture for Weakly Supervised Place Recognition
Arandjelovic, R., Gronat, P., Torii, A., Pajdla, T., & Sivic, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.572 · Cited by 2,584
Abnormal crowd behavior detection using social force model
Mehran, R., Oyama, A., & Shah, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206641 · Cited by 1,672
Self-citationStatic Analysis of Shape in TensorFlow Programs
The Theano Development Team, Al‐Rfou, R., Alain, G., Almahairi, A., Angermueller, C., Bahdanau, D., Ballas, N., Bastien, F., Bayer, J., Belikov, A., et al. (2016) · arXiv (Cornell University) · doi:10.4230/lipics.ecoop.2020.15 · Cited by 1,589
Abnormal Event Detection at 150 FPS in MATLAB
Lu, C., Shi, J., & Jia, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.338 · Cited by 1,436
Support Vector Machines for Multiple-Instance Learning
Andrews, S. J., Tsochantaridis, I., & Hofmann, T. (2002) · neural information processing systems · Cited by 1,401
Learning Temporal Regularity in Video Sequences
Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A. K., & Davis, L. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.86 · Cited by 1,397
Learning Fine-Grained Image Similarity with Deep Ranking
Wang, J., Song, Y., Leung, T., Rosenberg, C., Wang, J., Philbin, J., Chen, B., & Wu, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.180 · Cited by 1,269
Large-scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G. D., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · Cited by 1,266
Anomaly Detection and Localization in Crowded Scenes
Li, W., Mahadevan, V., & Vasconcelos, N. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.111 · Cited by 1,017
Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors
Adam, A., Rivlin, E., Shimshoni, I., & Reinitz, D. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70825 · Cited by 918
Deep Image Retrieval: Learning Global Representations for Image Search
Gordo, A., Almazán, J., Revaud, J., & Larlus, D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_15 · Cited by 787
Deep feature learning with relative distance comparison for person re-identification
Ding, S., Lin, L., Wang, G., & Chao, H. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.04.005 · Cited by 684
Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models
Kratz, L., & Nishino, K. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206771 · Cited by 644
Learning Deep Representations of Appearance and Motion for Anomalous Event Detection
Xu, D., Ricci, E., Yan, Y., Song, J., & Sebe, N. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.8 · Cited by 550
Traffic monitoring and accident detection at intersections
Kamijo, S., Matsushita, Y., Ikeuchi, K., & Sakauchi, M. (2000) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/6979.880968 · Cited by 536
Online detection of unusual events in videos via dynamic sparse coding
Zhao, B., Fei-Fei, L., & Xing, E. P. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995524 · Cited by 532
Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes
Wu, S., Moore, B. E., & Shah, M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539882 · Cited by 525
Self-citationTube Convolutional Neural Network (T-CNN) for Action Detection in Videos
Hou, R., Chen, C., & Shah, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.620 · Cited by 375
Self-citationLearning object motion patterns for anomaly detection and improved object detection
Basharat, A., Gritai, A., & Shah, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587510 · Cited by 373
Self-citationViolence detection using Oriented VIolent Flows
Gao, Y., Liu, H., Sun, X., Wang, C., & Liu, Y. (2016) · Image and Vision Computing · doi:10.1016/j.imavis.2016.01.006 · Cited by 283
Highlight Detection with Pairwise Deep Ranking for First-Person Video Summarization
Yao, T., Mei, T., & Rui, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.112 · Cited by 276
Abnormal detection using interaction energy potentials
Cui, X., Liu, Q., Gao, M., & Metaxas, D. N. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995558 · Cited by 240
A Markov Clustering Topic Model for mining behaviour in video
Hospedales, T., Gong, S., & Xiang, T. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459342 · Cited by 239
Person-on-person violence detection in video data
Datta, A., Shah, M. A., & Lobo, N. D. V. (2003) · doi:10.1109/icpr.2002.1044748 · Cited by 216
Self-citationVideo parsing for abnormality detection
Antic, B., & Ommer, B. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126525 · Cited by 164
Probabilistic Modeling of Scene Dynamics for Applications in Visual Surveillance
Saleemi, I., Shafique, K. H., & Shah, M. A. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.175 · Cited by 160
Self-citationVideo2GIF: Automatic Generation of Animated GIFs from Video
Gygli, M., Song, Y., & Cao, L. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.114 · Cited by 158
Context-Aware Activity Recognition and Anomaly Detection in Video
Zhu, Y., Nayak, N. M., & Roy-Chowdhury, A. K. (2013) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2234722 · Cited by 121
Angry Crowds: Detecting Violent Events in Videos
Mohammadi, S., Perina, A., Galoogahi, H. K., & Murino, V. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46478-7_1 · Cited by 96
Multi-modal human aggression detection
Kooij, J. F. P., Liem, M. C., Krijnders, J. D., Andringa, T., & Gavrila, D. M. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.06.009 · Cited by 75
Notice of Removal: Novel dataset for fine-grained abnormal behavior understanding in crowd
Rabiee, H., Haddadnia, J., Mousavi, H., Kalantarzadeh, M., Nabi, M., & Murino, V. (2016) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2016.7738074 · Cited by 72
Bergeron, C., Zaretzki, J. M., Breneman, C. M., & Bennett, K. P. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390163 · Cited by 46
Triplet Similarity Embedding for Face VerificationPreprint
Sankaranarayanan, S., Alavi, A., & Chellappa, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03418 · Cited by 41
Cited by
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240
CutPaste: Self-Supervised Learning for Anomaly Detection and Localization
Li, C.-L., Sohn, K., Yoon, J., & Pfister, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00954 · Cited by 1,107
Zhong, J.-X., Li, N., Kong, W., Liu, S., Li, T. H., & Li, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00133 · Cited by 588
End-to-End Learning of Visual Representations From Uncurated Instructional Videos
Miech, A., Alayrac, J.-B., Smaira, L., Laptev, I., Sivic, J., & Zisserman, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00990 · Cited by 580
Metadata
- Authors
- Sultani, W., Chen, C., & Shah, M.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 6479-6488
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2783882151
- Cited by
- 2,140
- References
- 41
- FWCI
- 56.59
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.