The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Future Frame Prediction for Anomaly Detection - A New Baseline
Open accessAbstract
Anomaly detection in videos refers to the identification of events that do not conform to expected behavior. However, almost all existing methods tackle the problem by minimizing the reconstruction errors of training data, which cannot guarantee a larger reconstruction error for an abnormal event. In this paper, we propose to tackle the anomaly detection problem within a video prediction framework. To the best of our knowledge, this is the first work that leverages the difference between a predicted future frame and its ground truth to detect an abnormal event. To predict a future frame with higher quality for normal events, other than the commonly used appearance (spatial) constraints on intensity and gradient, we also introduce a motion (temporal) constraint in video prediction by enforcing the optical flow between predicted frames and ground truth frames to be consistent, and this is the first work that introduces a temporal constraint into the video prediction task. Such spatial and motion constraints facilitate the future frame prediction for normal events, and consequently facilitate to identify those abnormal events that do not conform the expectation. Extensive experiments on both a toy dataset and some publicly available datasets validate the effectiveness of our method in terms of robustness to the uncertainty in normal events and the sensitivity to abnormal events. All codes are released in https://github.com/StevenLiuWen/ano_pred_cvpr2018.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Cited by
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
Gong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930
Towards Total Recall in Industrial Anomaly Detection
Roth, K., Pemula, L., Zepeda, J., Scholkopf, B., Brox, T., & Gehler, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01392 · Cited by 1,810
PaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization
Defard, T., Setkov, A., Loesch, A., & Audigier, R. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68799-1_35 · Cited by 1,415
Deep learning modelling techniques: Current progress, applications, advantages, and challenges
Ahmed, S. F., Alam, M. S. B., Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., Mofijur, M., Shawkat Ali, A. B. M., & Gandomi, A. H. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10466-8 · Cited by 1,079
DRÆM – A discriminatively trained reconstruction embedding for surface anomaly detection
Zavrtanik, V., Kristan, M., & Skocaj, D. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00822 · Cited by 1,086
Anomaly Detection via Reverse Distillation from One-Class Embedding
Deng, H., & Li, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00951 · Cited by 892
Reconstruction by inpainting for visual anomaly detection
Zavrtanik, V., Kristan, M., & Skočaj, D. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107706 · Cited by 732
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Grauman, K., Westbury, A., Byrne, E., Chavis, Z., Furnari, A., Girdhar, R., Hamburger, J., Jiang, H., Liu, M., Liu, X., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01842 · Cited by 630
Generalized Out-of-Distribution Detection: A Survey
Yang, J., Zhou, K., Li, Y., & Liu, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02117-4 · Cited by 884
Latent Space Autoregression for Novelty Detection
Abati, D., Porrello, A., Calderara, S., & Cucchiara, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00057 · Cited by 508
Anomaly Detection in Video Sequence With Appearance-Motion Correspondence
Nguyen, T. N., & Meunier, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00136 · Cited by 459
AnomalyNet: An Anomaly Detection Network for Video Surveillance
Zhou, J. T., Du, J., Zhu, H., Peng, X., Liu, Y., & Goh, R. S. M. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2900907 · Cited by 363
MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection
Feng, J.-C., Hong, F.-T., & Zheng, W.-S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01379 · Cited by 355
Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videos
Morais, R., Le, V., Tran, T., Saha, B., Mansour, M., & Venkatesh, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01227 · Cited by 341
Liu, Z., Nie, Y., Long, C., Zhang, Q., & Li, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01333 · Cited by 328
A comprehensive review on deep learning-based methods for video anomaly detection
Nayak, R., Pati, U. C., & Das, S. K. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2020.104078 · Cited by 324
Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals
Zhang, Y., Chen, Y., Wang, J., & Pan, Z. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3102110 · Cited by 312
A Review on Deep Learning Techniques for Video Prediction
Oprea, S., Martinez-Gonzalez, P., Garcia-Garcia, A., Castro-Vargas, J. A., Orts-Escolano, S., Garcia-Rodriguez, J., & Argyros, A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3045007 · Cited by 301
Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection
Ristea, N.-C., Madan, N., Ionescu, R. T., Nasrollahi, K., Khan, F. S., Moeslund, T. B., & Shah, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01321 · Cited by 315
Integrating prediction and reconstruction for anomaly detection
Tang, Y., Zhao, L., Zhang, S., Gong, C., Li, G., & Yang, J. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.11.024 · Cited by 282
Attention Guided Anomaly Localization in Images
Venkataramanan, S., Peng, K.-C., Singh, R. V., & Mahalanobis, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_29 · Cited by 247
Deep Learning-Based Anomaly Detection in Video Surveillance: A Survey
Duong, H.-T., Le, V.-T., & Hoang, V. T. (2023) · Sensors · doi:10.3390/s23115024 · Cited by 178
TransCNN: Hybrid CNN and transformer mechanism for surveillance anomaly detection
Ullah, W., Hussain, T., Ullah, F. U. M., Lee, M. Y., & Baik, S. W. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106173 · Cited by 128
A neural network trained for prediction mimics diverse features of biological neurons and perception
Lotter, W., Kreiman, G., & Cox, D. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0170-9 · Cited by 128
Transformer-Based Spatio-Temporal Unsupervised Traffic Anomaly Detection in Aerial Videos
Tran, T. M., Bui, D. C., Nguyen, T. V., & Nguyen, K. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3376399 · Cited by 63
Weakly Supervised Video Anomaly Detection via Transformer-Enabled Temporal Relation Learning
Zhang, D., Huang, C., Liu, C., & Xu, Y. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3175092 · Cited by 58
TDS-Net: Transformer enhanced dual-stream network for video Anomaly Detection
Hussain, A., Ullah, W., Khan, N., Khan, Z. A., Kim, M. J., & Baik, S. W. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124846 · Cited by 47
Enhanced Surveillance Video Compression with Dual Reference Frames Generation
Zhao, L., Wang, S., Wang, S., Ye, Y., Ma, S., & Gao, W. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3073114 · Cited by 43
Unsupervised deep learning to detect agitation from videos in people with dementia
Khan, S. S., Mishra, P. K., Javed, N., Ye, B., Newman, K., Mihailidis, A., & Iaboni, A. (2022) · IEEE Access · doi:10.1109/access.2022.3143990 · Cited by 44
SwinAnomaly: Real-Time Video Anomaly Detection Using Video Swin Transformer and SORT
Bajgoti, A., Gupta, R., Balaji, P., Dwivedi, R., Siwach, M., & Gupta, D. (2023) · IEEE Access · doi:10.1109/access.2023.3321801 · Cited by 38
Li, N., Chang, F., & Liu, C. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.12.023 · Cited by 36
Nazir, A., Mitra, R., Sulieman, H., & Kamalov, F. (2023) · Sensors · doi:10.3390/s23135811 · Cited by 30
Paulraj, S., & Vairavasundaram, S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109496 · Cited by 27
A Semantic-Enhanced Method Based On Deep SVDD for Pixel-Wise Anomaly Detection
Hu, C., Chen, K., & Shao, H. (2021) · 2021 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428370 · Cited by 24
MT-CMVAD: A Multi-Modal Transformer Framework for Cross-Modal Video Anomaly Detection
Ding, H., Lou, S., Ye, H., & Chen, Y. (2025) · Applied Sciences · doi:10.3390/app15126773 · Cited by 14
Yun, S., Masukawa, R., Na, M., & Imani, M. (2025) · 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv61041.2025.00464 · Cited by 14
Metadata
- Authors
- Liu, W., Luo, W., Lian, D., & Gao, S.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 6536-6545
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2963610939
- Cited by
- 1,530
- References
- 41
- FWCI
- 40.88
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.