The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Object-Centric Auto-Encoders and Dummy Anomalies for Abnormal Event Detection in Video
Abstract
Abnormal event detection in video is a challenging vision problem. Most existing approaches formulate abnormal event detection as an outlier detection task, due to the scarcity of anomalous data during training. Because of the lack of prior information regarding abnormal events, these methods are not fully-equipped to differentiate between normal and abnormal events. In this work, we formalize abnormal event detection as a one-versus-rest binary classification problem. Our contribution is two-fold. First, we introduce an unsupervised feature learning framework based on object-centric convolutional auto-encoders to encode both motion and appearance information. Second, we propose a supervised classification approach based on clustering the training samples into normality clusters. A one-versus-rest abnormal event classifier is then employed to separate each normality cluster from the rest. For the purpose of training the classifier, the other clusters act as dummy anomalies. During inference, an object is labeled as abnormal if the highest classification score assigned by the one-versus-rest classifiers is negative. Comprehensive experiments are performed on four benchmarks: Avenue, ShanghaiTech, UCSD and UMN. Our approach provides superior results on all four data sets. On the large-scale ShanghaiTech data set, our method provides an absolute gain of 8.4% in terms of frame-level AUC compared to the state-of-the-art method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
(2007) · doi:10.5555/1283383.1283494 · Cited by 7,364
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
Vlfeat: an open and portable library of computer vision algorithms
Vedaldi, A., & Fulkerson, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874249 · Cited by 2,664
Centroidal Voronoi Tessellations: Applications and Algorithms
Du, Q., Faber, V., & Gunzburger, M. (1999) · SIAM Review · doi:10.1137/s0036144599352836 · Cited by 2,244
Real-World Anomaly Detection in Surveillance Videos
Sultani, W., Chen, C., & Shah, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00678 · Cited by 2,140
Abnormal crowd behavior detection using social force model
Mehran, R., Oyama, A., & Shah, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206641 · Cited by 1,672
Future Frame Prediction for Anomaly Detection - A New Baseline
Liu, W., Luo, W., Lian, D., & Gao, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00684 · Cited by 1,530
Anomaly detection in crowded scenes
Mahadevan, V., Li, W., Bhalodia, V., & Vasconcelos, N. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539872 · Cited by 1,512
Abnormal Event Detection at 150 FPS in MATLAB
Lu, C., Shi, J., & Jia, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.338 · Cited by 1,436
Learning Temporal Regularity in Video Sequences
Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A. K., & Davis, L. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.86 · Cited by 1,397
Anomaly Detection and Localization in Crowded Scenes
Li, W., Mahadevan, V., & Vasconcelos, N. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.111 · Cited by 1,017
A Revisit of Sparse Coding Based Anomaly Detection in Stacked RNN Framework
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.45 · Cited by 895
Sparse reconstruction cost for abnormal event detection
Cong, Y., Yuan, J., & Liu, J. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995434 · Cited by 801
Kim, J., & Grauman, K. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206569 · Cited by 768
Learning Deep Representations of Appearance and Motion for Anomalous Event Detection
Xu, D., Ricci, E., Yan, Y., Song, J., & Sebe, N. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.8 · Cited by 550
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · arXiv · doi:10.48550/arxiv.1807.05520 · Cited by 533
Online detection of unusual events in videos via dynamic sparse coding
Zhao, B., Fei-Fei, L., & Xing, E. P. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995524 · Cited by 532
Abnormal event detection in videos using generative adversarial nets
Ravanbakhsh, M., Nabi, M., Sangineto, E., Marcenaro, L., Regazzoni, C., & Sebe, N. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296547 · Cited by 515
Detecting anomalous events in videos by learning deep representations of appearance and motion
Xu, D., Yan, Y., Ricci, E., & Sebe, N. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.10.010 · Cited by 474
Sabokrou, M., Fayyaz, M., Fathy, M., & Klette, R. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2670780 · Cited by 386
Krähenbühl, P., & Koltun, V. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_47 · Cited by 336
Unmasking the Abnormal Events in Video
Ionescu, R. T., Smeureanu, S., Alexe, B., & Popescu, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.315 · Cited by 335
Self-citationVideo anomaly detection based on local statistical aggregates
Saligrama, V., & Chen, Z. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247917 · Cited by 332
Joint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledge
Hinami, R., Mei, T., & Satoh, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.391 · Cited by 268
Cheng, K.-W., Chen, Y.-T., & Fang, W.-H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298909 · Cited by 234
Plug-and-Play CNN for Crowd Motion Analysis: An Application in Abnormal Event Detection
Ravanbakhsh, M., Nabi, M., Mousavi, H., Sangineto, E., & Sebe, N. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00188 · Cited by 216
A Discriminative Framework for Anomaly Detection in Large Videos
Del Giorno, A., Bagnell, J. A., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_21 · Cited by 204
Learning to segment moving objects in videos
Fragkiadaki, K., Arbelaez, P., Felsen, P., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299035 · Cited by 193
Video parsing for abnormality detection
Antic, B., & Ommer, B. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126525 · Cited by 164
Deep Appearance Features for Abnormal Behavior Detection in Video
Smeureanu, S., Ionescu, R. T., Popescu, M., & Alexe, B. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68548-9_70 · Cited by 134
Self-citationDetecting Abnormal Events in Video Using Narrowed Normality Clusters
Ionescu, R. T., Smeureanu, S., Popescu, M., & Alexe, B. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00212 · Cited by 124
Self-citationVideo anomaly detection based on locality sensitive hashing filters
Zhang, Y., Lu, H., Zhang, L., Ruan, X., & Sakai, S. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.11.018 · Cited by 112
Classifier Two Sample Test for Video Anomaly Detections.
Liu, Y., Li, C., & Póczos, B. (2018) · Cited by 62
Unsupervised Behavior-Specific Dictionary Learning for Abnormal Event Detection
Ren, H., Liu, W., Olsen, S. I., Escalera, S., & Moeslund, T. B. (2015) · British Machine Vision Conference (BMVC) · doi:10.5244/c.29.28 · Cited by 60
Online Detection of Abnormal Events Using Incremental Coding Length
Dutta, J., & Banerjee, B. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9799 · Cited by 51
Cited by
Diffusion Models in Vision: A Survey
Croitoru, F.-A., Hondru, V., Ionescu, R. T., & Shah, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3261988 · Cited by 1,859
Self-citationReconstruction by inpainting for visual anomaly detection
Zavrtanik, V., Kristan, M., & Skočaj, D. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107706 · Cited by 732
Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection
Ristea, N.-C., Madan, N., Ionescu, R. T., Nasrollahi, K., Khan, F. S., Moeslund, T. B., & Shah, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01321 · Cited by 315
Self-citationIntegrating prediction and reconstruction for anomaly detection
Tang, Y., Zhao, L., Zhang, S., Gong, C., Li, G., & Yang, J. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.11.024 · Cited by 282
Self-Trained Deep Ordinal Regression for End-to-End Video Anomaly Detection
Pang, G., Yan, C., Shen, C., van den Hengel, A., & Bai, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01219 · Cited by 257
Metadata
- Authors
- Ionescu, R. T., Khan, F. S., Georgescu, M.-I., & Shao, L.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 7834-7843
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2960737790
- Cited by
- 425
- References
- 40
- FWCI
- 19.83
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.