The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Future Frame Prediction for Anomaly Detection - A New Baseline
Open accessAbstract
Anomaly detection in videos refers to the identification of events that do not conform to expected behavior. However, almost all existing methods tackle the problem by minimizing the reconstruction errors of training data, which cannot guarantee a larger reconstruction error for an abnormal event. In this paper, we propose to tackle the anomaly detection problem within a video prediction framework. To the best of our knowledge, this is the first work that leverages the difference between a predicted future frame and its ground truth to detect an abnormal event. To predict a future frame with higher quality for normal events, other than the commonly used appearance (spatial) constraints on intensity and gradient, we also introduce a motion (temporal) constraint in video prediction by enforcing the optical flow between predicted frames and ground truth frames to be consistent, and this is the first work that introduces a temporal constraint into the video prediction task. Such spatial and motion constraints facilitate the future frame prediction for normal events, and consequently facilitate to identify those abnormal events that do not conform the expectation. Extensive experiments on both a toy dataset and some publicly available datasets validate the effectiveness of our method in terms of robustness to the uncertainty in normal events and the sensitivity to abnormal events. All codes are released in https://github.com/StevenLiuWen/ano_pred_cvpr2018.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
Human Detection Using Oriented Histograms of Flow and Appearance
Dalal, N., Triggs, B., & Schmid, C. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744047_33 · Cited by 1,652
Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
Denton, E., Chintala, S., Szlam, A. D., & Fergus, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.05751 · Cited by 1,541
Anomaly detection in crowded scenes
Mahadevan, V., Li, W., Bhalodia, V., & Vasconcelos, N. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539872 · Cited by 1,512
Abnormal Event Detection at 150 FPS in MATLAB
Lu, C., Shi, J., & Jia, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.338 · Cited by 1,436
Learning Temporal Regularity in Video Sequences
Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A. K., & Davis, L. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.86 · Cited by 1,397
Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors
Adam, A., Rivlin, E., Shimshoni, I., & Reinitz, D. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70825 · Cited by 918
A Revisit of Sparse Coding Based Anomaly Detection in Stacked RNN Framework
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.45 · Cited by 895
Self-citationSparse reconstruction cost for abnormal event detection
Cong, Y., Yuan, J., & Liu, J. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995434 · Cited by 801
Kim, J., & Grauman, K. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206569 · Cited by 768
Abnormal Event Detection in Videos Using Spatiotemporal Autoencoder
Chong, Y. S., & Tay, Y. H. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59081-3_23 · Cited by 596
Remembering history with convolutional LSTM for anomaly detection
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019325 · Cited by 582
Self-citationLearning Deep Representations of Appearance and Motion for Anomalous Event Detection
Xu, D., Ricci, E., Yan, Y., Song, J., & Sebe, N. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.8 · Cited by 550
Online detection of unusual events in videos via dynamic sparse coding
Zhao, B., Fei-Fei, L., & Xing, E. P. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995524 · Cited by 532
Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes
Wu, S., Moore, B. E., & Shah, M. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539882 · Cited by 525
Abnormal event detection in videos using generative adversarial nets
Ravanbakhsh, M., Nabi, M., Sangineto, E., Marcenaro, L., Regazzoni, C., & Sebe, N. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296547 · Cited by 515
Decomposing Motion and Content for Natural Video Sequence Prediction
Villegas, R., Yang, J., Hong, S., Lin, X., & Lee, H. (2017) · arXiv · doi:10.48550/arxiv.1706.08033 · Cited by 488
Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning
Lotter, W. E., Kreiman, G., & Cox, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08104 · Cited by 368
Unmasking the Abnormal Events in Video
Ionescu, R. T., Smeureanu, S., Alexe, B., & Popescu, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.315 · Cited by 335
Semi-Supervised Adapted HMMs for Unusual Event Detection
Zhang, D., Gatica-Perez, D., Bengio, S., & McCowan, I. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.316 · Cited by 277
Joint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledge
Hinami, R., Mei, T., & Satoh, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.391 · Cited by 268
A Discriminative Framework for Anomaly Detection in Large Videos
Del Giorno, A., Bagnell, J. A., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_21 · Cited by 204
Anomaly Detection in Video Using Predictive Convolutional Long Short-Term Memory Networks
Medel, J. R., & Savakis, A. E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00390 · Cited by 194
Generating the Future with Adversarial Transformers
Vondrick, C., & Torralba, A. B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.319 · Cited by 166
Deep Appearance Features for Abnormal Behavior Detection in Video
Smeureanu, S., Ionescu, R. T., Popescu, M., & Alexe, B. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68548-9_70 · Cited by 134
Online growing neural gas for anomaly detection in changing surveillance scenes
Sun, Q., Liu, H., & Harada, T. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.09.016 · Cited by 118
Goal-based trajectory analysis for unusual behaviour detection in intelligent surveillance
Tung, F., Zelek, J., & Clausi, D. A. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2010.11.003 · Cited by 115
Transformation-Based Models of Video SequencesPreprint
van Amersfoort, J., Kannan, A., Ranzato, M., Szlam, A. D., Tran, D., & Chintala, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08435 · Cited by 61
Video Imagination from a Single Image with Transformation Generation
Chen, B., Wang, W., & Wang, J. (2017) · Thematic Workshops of ACM Multimedia · doi:10.1145/3126686.3126737 · Cited by 50
Cited by
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
Gong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930
Towards Total Recall in Industrial Anomaly Detection
Roth, K., Pemula, L., Zepeda, J., Scholkopf, B., Brox, T., & Gehler, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01392 · Cited by 1,810
PaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization
Defard, T., Setkov, A., Loesch, A., & Audigier, R. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68799-1_35 · Cited by 1,415
Deep learning modelling techniques: Current progress, applications, advantages, and challenges
Ahmed, S. F., Alam, M. S. B., Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., Mofijur, M., Shawkat Ali, A. B. M., & Gandomi, A. H. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10466-8 · Cited by 1,079
Metadata
- Authors
- Liu, W., Luo, W., Lian, D., & Gao, S.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 6536-6545
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2963610939
- Cited by
- 1,530
- References
- 41
- FWCI
- 40.88
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.