AnoPCN: Video Anomaly Detection via Deep Predictive Coding Network
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Video anomaly detection is a challenging problem due to the ambiguity and complexity of how anomalies are defined. Recent approaches for this task mainly utilize deep reconstruction methods and deep prediction ones, but their performances suffer when they cannot guarantee either higher reconstruction errors for abnormal events or lower prediction errors for normal events. Inspired by the predictive coding mechanism explaining how brains detect events violating regularities, we address the Anomaly detection problem with a novel deep Predictive Coding Network, termed as AnoPCN, which consists of a Predictive Coding Module (PCM) and an Error Refinement Module (ERM). Specifically, PCM is designed as a convolutional recurrent neural network with feedback connections carrying frame predictions and feedforward connections carrying prediction errors. By using motion information explicitly, PCM yields better prediction results. To further solve the problem of narrow regularity score gaps in deep reconstruction methods, we decompose reconstruction into prediction and refinement, introducing ERM to reconstruct current prediction error and refine the coarse prediction. AnoPCN unifies reconstruction and prediction methods in an end-to-end framework, and it achieves state-of-the-art performance with better prediction results and larger regularity score gaps on three benchmark datasets including ShanghaiTech Campus, CUHK Avenue, and UCSD Ped2.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
Predictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579
Self-Supervised Video Representation Learning with Odd-One-Out Networks
Fernando, B., Bilen, H., Gavves, E., & Gould, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.607 · Cited by 421
Research works printed but not linked: 39
- Abadi Mart'in, 2016, et almbox
- Abati Davide, 2019, Latent Space Autoregression for Novelty Detection. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) .
- Chalasani Rakesh, 2013, Deep predictive coding networks. arXiv preprint arXiv:1301.3541 · arXiv
- 10.1109/CVPR.2015.7298909 · DOI · Paper page
- 10.1109/CVPR.2011.5995434 · DOI · Paper page
- 10.1007/11744047_33 · DOI · Paper page
- 10.1145/2964284.2967290 · DOI
- 10.1007/978-3-319-46454-1_21 · DOI · Paper page
- Kuan Han Haiguang Wen Yizhen Zhang Di Fu Eugenio Culurciello and Zhongming Liu. 2018. Deep predictive coding network with local recurrent processing for object recognition. In Advances in Neural Information Processing Systems. 9221--9233. Kuan Han Haiguang Wen Yizhen Zhang Di Fu Eugenio Culurciello and Zhongming Liu. 2018. Deep predictive coding network with local recurrent processing for object recognition. In Advances in Neural Information Processing Systems. 9221--9233.
- Hasan Mahmudul, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 733--742
- Isola Phillip, Proceedings of the IEEE conference on computer vision and pattern recognition . 1125--1134
- 10.1109/CVPR.2009.5206569 · DOI · Paper page
- Diederik, 2014, Kingma and Jimmy Ba
- Jan Kremlávc, 2016, Cortex, 80
- Krizhevsky Alex, 2012, Hinton
- 10.1109/ICCV.2017.79 · DOI · Paper page
- Li Weixin, 2014, Anomaly detection and localization in crowded scenes, 10.1109/TPAMI.2013.111 · DOI · Paper page
- 10.1109/CVPR.2018.00684 · DOI · Paper page
- Lotter William, 2016, Deep predictive coding networks for video prediction and unsupervised learning. arXiv preprint arXiv:1605.08104 · arXiv
- 10.1109/ICCV.2013.338 · DOI · Paper page
- 10.1109/ICME.2017.8019325 · DOI · Paper page
- 10.1109/ICCV.2017.45 · DOI · Paper page
- 10.1109/CVPR.2010.5539872 · DOI · Paper page
- Mathieu Michael, 2015, Deep multi-scale video prediction beyond mean square error. arXiv preprint arXiv:1511.05440 · arXiv
- Medel Jefferson Ryan, 2016, Anomaly detection in video using predictive convolutional long short-term memory networks. arXiv preprint arXiv:1612.00390 · arXiv
- Rao Rajesh P.N., 1999, Ballard
- 10.1109/ICIP.2017.8296547 · DOI · Paper page
- Simonyan Karen, 2014, Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 · arXiv
- 10.1523/JNEUROSCI.3365-17.2018 · DOI · Paper page
- Stefanics Gábor, 2014, Jan Kremlávc ek, and István Czigler
- 10.1016/j.patcog.2016.09.016 · DOI
- 10.1109/CVPR.2015.7298594 · DOI · Paper page
- 10.5244/C.31.139 · DOI
- 10.1007/978-3-319-46484-8_2 · DOI · Paper page
- 10.1145/3240508.3240615 · DOI
- 10.1109/CVPR.2010.5539882 · DOI · Paper page
- Xu Dan, 2015, Learning deep representations of appearance and motion for anomalous event detection. arXiv preprint arXiv:1510.01553 · arXiv
- Zhao Bin, 2011, CVPR
- 10.1145/3123266.3123451 · DOI · Paper page
Cited by
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
“This research line is popular in video anomaly detection [1, 86, 167].”
MethodDeep learning modelling techniques: Current progress, applications, advantages, and challenges
Ahmed, S. F., Alam, M. S. B., Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., Mofijur, M., Shawkat Ali, A. B. M., & Gandomi, A. H. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10466-8 · Cited by 1,079
Liu, Z., Nie, Y., Long, C., Zhang, Q., & Li, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01333 · Cited by 328
PVASS-MDD: Predictive Visual-Audio Alignment Self-Supervision for Multimodal Deepfake Detection
Yu, Y., Liu, X., Ni, R., Yang, S., Zhao, Y., & Kot, A. C. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3309899 · Cited by 63
SwinAnomaly: Real-Time Video Anomaly Detection Using Video Swin Transformer and SORT
Bajgoti, A., Gupta, R., Balaji, P., Dwivedi, R., Siwach, M., & Gupta, D. (2023) · IEEE Access · doi:10.1109/access.2023.3321801 · Cited by 38
“For instance, Ye et al. [21] presented a Predictive Coding Network that, initially, predicts future frames using a ConvLSTM with predictive coding.”
Method
Metadata
- Authors
- Ye, M., Peng, X., Gan, W., Wu, W., & Qiao, Y.
- Venue
- Proceedings of the 27th ACM International Conference on Multimedia
- Publisher
- ACM
- Published
- 2019-10-15
- Pages
- 1805-1813
- OpenAlex
- W2981650061
- Cited by
- 197
- References
- 8
- FWCI
- 6.61
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- the Joint Lab of CAS-HK
- National Natural Science Foundation of China (U1613211)
- Natural Science Foundation of China (U1813218)
- Shenzhen Basic Research Program (JCYJ20170818164704758)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AnoPCN: Video Anomaly Detection via Deep Predictive Coding Network. https://app.cochat.ai/papers/10.1145/3343031.3350899
- The paper
- Ye, M., Peng, X., Gan, W., Wu, W., & Qiao, Y. (2019). AnoPCN: Video Anomaly Detection via Deep Predictive Coding Network. Proceedings of the 27th ACM International Conference on Multimedia. https://doi.org/10.1145/3343031.3350899
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.