The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Integrating prediction and reconstruction for anomaly detection
Abstract
Abstract Anomaly detection in videos refers to identifying events that rarely or shouldn’t happen in a certain context. Among all existing methods, the idea of reconstruction or future frame prediction is predominant for detecting anomalies. Reconstruction methods try to minimize the reconstruction errors of training data, but cannot guarantee large reconstruction errors for abnormal events. Future frame prediction methods follow the concept that normal events are predictable while abnormal ones are unpredictable. However, the results may drop rapidly since prediction is not robust to the noise in real-world surveillance videos. In this paper, we propose an approach that combines the advantages and balances the disadvantages of these two methods. An end-to-end network is designed to conduct future frame prediction and reconstruction sequentially. Future frame prediction makes the reconstruction errors large enough to facilitate the identification of abnormal events, while reconstruction helps enhance the predicted future frames from normal events. Specifically, we connect two U-Net blocks in the generator. One block works in the form of frame prediction, and the other tries to reconstruct the frames generated by the former block. Experiments over several benchmark datasets demonstrate the superiority of our method over previous state-of-the-art approaches, while running in real-time at 30 frames per second.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861
Future Frame Prediction for Anomaly Detection - A New Baseline
Liu, W., Luo, W., Lian, D., & Gao, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00684 · Cited by 1,530
Anomaly detection in crowded scenes
Mahadevan, V., Li, W., Bhalodia, V., & Vasconcelos, N. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539872 · Cited by 1,512
Abnormal Event Detection at 150 FPS in MATLAB
Lu, C., Shi, J., & Jia, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.338 · Cited by 1,436
A Revisit of Sparse Coding Based Anomaly Detection in Stacked RNN Framework
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.45 · Cited by 895
Sparse reconstruction cost for abnormal event detection
Cong, Y., Yuan, J., & Liu, J. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995434 · Cited by 801
Adversarially Learned One-Class Classifier for Novelty Detection
Sabokrou, M., Khalooei, M., Fathy, M., & Adeli, E. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00356 · Cited by 765
Proceedings of the 25th ACM international conference on Multimedia
(2017) · doi:10.1145/3123266 · Cited by 618
Abnormal Event Detection in Videos Using Spatiotemporal Autoencoder
Chong, Y. S., & Tay, Y. H. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59081-3_23 · Cited by 596
Remembering history with convolutional LSTM for anomaly detection
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019325 · Cited by 582
FlowNet: Learning Optical Flow with Convolutional Networks
Fischer, P., Dosovitskiy, A., Ilg, E., Haeusser, P., Hazırbaş, C., Golkov, V., van der Smagt, P., Cremers, D., & Brox, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06852 · Cited by 562
Spatio-Temporal AutoEncoder for Video Anomaly Detection
Zhao, Y., Deng, B., Shen, C., Liu, Y., Lu, H., & Hua, X.-S. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123451 · Cited by 559
Twenty-Ninth AAAI Conference on Artificial Intelligence
Albrecht, S. V., Crandall, J. W., & Ramamoorthy, R. (2015) · National Conference on Artificial Intelligence · Cited by 464
Anomaly Detection in Video Sequence With Appearance-Motion Correspondence
Nguyen, T. N., & Meunier, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00136 · Cited by 459
Object-Centric Auto-Encoders and Dummy Anomalies for Abnormal Event Detection in Video
Ionescu, R. T., Khan, F. S., Georgescu, M.-I., & Shao, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00803 · Cited by 425
2018 IEEE Winter Conference on Applications of Computer Vision (WACV)
(2018) · doi:10.1109/wacv41190.2018 · Cited by 350
Unmasking the Abnormal Events in Video
Ionescu, R. T., Smeureanu, S., Alexe, B., & Popescu, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.315 · Cited by 335
Joint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledge
Hinami, R., Mei, T., & Satoh, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.391 · Cited by 268
Cheng, K.-W., Chen, Y.-T., & Fang, W.-H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298909 · Cited by 234
A Discriminative Framework for Anomaly Detection in Large Videos
Del Giorno, A., Bagnell, J. A., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_21 · Cited by 204
Learning Temporal Regularity in Video SequencesPreprint
Hasan, M., Choi, J., Neumann, J., Roy–Chowdhury, A. K., & Davis, L. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.04574 · Cited by 154
Blind image quality prediction by exploiting multi-level deep representations
Gao, F., Yu, J., Zhu, S., Huang, Q., & Tian, Q. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.04.016 · Cited by 121
Video anomaly detection based on locality sensitive hashing filters
Zhang, Y., Lu, H., Zhang, L., Ruan, X., & Sakai, S. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.11.018 · Cited by 112
Autoencoder with recurrent neural networks for video forgery detection
D'Avino, D., Cozzolino, D., Poggi, G., & Verdoliva, L. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.7.mwsf-330 · Cited by 109
Biologically inspired image quality assessment
Gao, F., & Yu, J. (2015) · Signal Processing · doi:10.1016/j.sigpro.2015.08.012 · Cited by 68
Proceedings of the on Thematic Workshops of ACM Multimedia 2017
Wu, W., Yan, S., Tian, Q., & Zimmermann, R. (2017) · doi:10.1145/3126686 · Cited by 59
Munawar, A., Vinayavekhin, P., & Magistris, G. D. (2017) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2017.118 · Cited by 54
Video Imagination from a Single Image with Transformation Generation
Chen, B., Wang, W., & Wang, J. (2017) · Thematic Workshops of ACM Multimedia · doi:10.1145/3126686.3126737 · Cited by 53
Online Detection of Abnormal Events Using Incremental Coding Length
Dutta, J., & Banerjee, B. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9799 · Cited by 51
A Discriminative Framework for Anomaly Detection in Large VideosPreprint
Del Giorno, A., Bagnell, J. A., & Hebert, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.08938 · Cited by 32
Cited by
Anomaly Detection in Video via Self-Supervised and Multi-Task Learning
Georgescu, M.-I., Barbalau, A., Ionescu, R. T., Shahbaz Khan, F., Popescu, M., & Shah, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01255 · Cited by 350
Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection
Ristea, N.-C., Madan, N., Ionescu, R. T., Nasrollahi, K., Khan, F. S., Moeslund, T. B., & Shah, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01321 · Cited by 315
SwinAnomaly: Real-Time Video Anomaly Detection Using Video Swin Transformer and SORT
Bajgoti, A., Gupta, R., Balaji, P., Dwivedi, R., Siwach, M., & Gupta, D. (2023) · IEEE Access · doi:10.1109/access.2023.3321801 · Cited by 38
Li, N., Chang, F., & Liu, C. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.12.023 · Cited by 36
Metadata
- Authors
- Tang, Y., Zhao, L., Zhang, S., Gong, C., Li, G., & Yang, J.
- Venue
- Pattern Recognition Letters
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 129
- Pages
- 123-130
- ISSN
- 0167-8655 (ISSN-L)
- OpenAlex
- W2987146532
- Cited by
- 282
- References
- 39
- FWCI
- 10.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.