The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection
Abstract
Weakly supervised video anomaly detection (WS-VAD) is to distinguish anomalies from normal events based on discriminative representations. Most existing works are limited in insufficient video representations. In this work, we develop a multiple instance self-training framework (MIST) to efficiently refine task-specific discriminative representations with only video-level annotations. In particular, MIST is composed of 1) a multiple instance pseudo label generator, which adapts a sparse continuous sampling strategy to produce more reliable clip-level pseudo labels, and 2) a self-guided attention boosted feature encoder that aims to automatically focus on anomalous regions in frames while extracting task-specific representations. Moreover, we adopt a self-training scheme to optimize both components and finally obtain a task-specific feature encoder. Extensive experiments on two public datasets demonstrate the efficacy of our method, and our method performs comparably to or even better than existing supervised and weakly supervised methods, specifically obtaining a frame-level AUC 94.83% on ShanghaiTech.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Unsupervised word sense disambiguation rivaling supervised methods
Yarowsky, D. (1995) · Proceedings of the 33rd annual meeting on Association for Computational Linguistics - · doi:10.3115/981658.981684 · Cited by 2,385
Semi-supervised Learning by Entropy Minimization
Grandvalet, Y., & Bengio, Y. (2004) · neural information processing systems · Cited by 2,268
Real-World Anomaly Detection in Surveillance Videos
Sultani, W., Chen, C., & Shah, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00678 · Cited by 2,140
Gong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930
Future Frame Prediction for Anomaly Detection - A New Baseline
Liu, W., Luo, W., Lian, D., & Gao, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00684 · Cited by 1,530
Unsupervised Domain Adaptation for Semantic Segmentation via Class-Balanced Self-training
Zou, Y., Yu, Z., Vijaya Kumar, B. V. K., & Wang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_18 · Cited by 1,464 · cited 2×
“Then, we produce pseudo labels Ŷ a = {ŷa i }i=1 for anomalous video by performing smoothing and normalization on estimated scores to supervise the learning of the proposed self-guided attention boosted feature encoder, forming as two-stage self-training scheme [10, 36, 35].”
BackgroundMethodAbnormal Event Detection at 150 FPS in MATLAB
Lu, C., Shi, J., & Jia, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.338 · Cited by 1,436
Learning Temporal Regularity in Video Sequences
Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A. K., & Davis, L. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.86 · Cited by 1,397
A Revisit of Sparse Coding Based Anomaly Detection in Stacked RNN Framework
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.45 · Cited by 895
Confidence Regularized Self-Training
Zou, Y., Yu, Z., Liu, X., Kumar, B. V. K. V., & Wang, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00608 · Cited by 811
Zhong, J.-X., Li, N., Kong, W., Liu, S., Li, T. H., & Li, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00133 · Cited by 588
Self-labeled techniques for semi-supervised learning: taxonomy, software and empirical study
Triguero, I., García, S., & Herrera, F. (2015) · Knowledge and Information Systems · doi:10.1007/s10115-013-0706-y · Cited by 573
Spatio-Temporal AutoEncoder for Video Anomaly Detection
Zhao, Y., Deng, B., Shen, C., Liu, Y., Lu, H., & Hua, X.-S. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123451 · Cited by 559
Online detection of unusual events in videos via dynamic sparse coding
Zhao, B., Fei-Fei, L., & Xing, E. P. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995524 · Cited by 532
Not only Look, But Also Listen: Learning Multimodal Violence Detection Under Weak Supervision
Wu, P., Liu, J., Shi, Y., Sun, Y., Shao, F., Wu, Z., & Yang, Z. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58577-8_20 · Cited by 482
Deep Learning is Robust to Massive Label Noise
Rolnick, D., Veit, A., Belongie, S., & Shavit, N. (2017) · arXiv · doi:10.48550/arxiv.1705.10694 · Cited by 402
Weakly Supervised Action Localization by Sparse Temporal Pooling Network
Nguyen, P., Han, B., Liu, T., & Prasad, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00706 · Cited by 402
AnomalyNet: An Anomaly Detection Network for Video Surveillance
Zhou, J. T., Du, J., Zhu, H., Peng, X., Liu, Y., & Goh, R. S. M. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2900907 · Cited by 363
CNN features with bi-directional LSTM for real-time anomaly detection in surveillance networks
Ullah, W., Ullah, A., Haq, I. U., Muhammad, K., Sajjad, M., & Baik, S. W. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09406-3 · Cited by 310
Self-Trained Deep Ordinal Regression for End-to-End Video Anomaly Detection
Pang, G., Yan, C., Shen, C., van den Hengel, A., & Bai, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01219 · Cited by 257
A Markov Clustering Topic Model for mining behaviour in video
Hospedales, T., Gong, S., & Xiang, T. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459342 · Cited by 239
Zhang, J., Qing, L., & Miao, J. (2019) · 2019 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2019.8803657 · Cited by 205
Weakly Supervised Video Anomaly Detection via Center-Guided Discriminative Learning
Wan, B., Fang, Y., Xia, X., & Mei, J. (2020) · 2020 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme46284.2020.9102722 · Cited by 197
Weakly Supervised Coupled Networks for Visual Sentiment Analysis
Yang, J., She, D., Lai, Y.-K., Rosin, P. L., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00791 · Cited by 158
Motion-Aware Feature for Improved Video Anomaly DetectionPreprint
Zhu, Y., & Newsam, S. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.10211 · Cited by 150
Exploring Background-bias for Anomaly Detection in Surveillance Videos
Liu, K., & Ma, H. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350998 · Cited by 146
Why Can't I Dance in the Mall? Learning to Mitigate Scene Bias in Action RecognitionPreprint
Choi, J., Gao, C., Messou, J. C. E., & Huang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.05534 · Cited by 137
Margin Learning Embedded Prediction for Video Anomaly Detection with A Few Anomalies
Liu, W., Luo, W., Li, Z., Zhao, P., & Gao, S. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/419 · Cited by 136
Unsupervised and Semi-Supervised Domain Adaptation for Action Recognition from Drones
Choi, J., Sharma, G., Chandraker, M. K., & Huang, J. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093511 · Cited by 112
MINI-Net: Multiple Instance Ranking Network for Video Highlight Detection
Hong, F.-T., Huang, X., Li, W., & Zheng, W. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58601-0_21 · Cited by 82
Self-citationSemi-Supervised Logistic Regression
Amini, M.-R., & Gallinari, P. (2002) · HAL · Cited by 63
Video Anomaly Detection for Smart Surveillance
Zhu, S., Chen, C., & Sultani, W. (2020) · Springer eBooks · doi:10.1007/978-3-030-03243-2_845-1 · Cited by 44
Cited by
Weakly Supervised Video Anomaly Detection via Transformer-Enabled Temporal Relation Learning
Zhang, D., Huang, C., Liu, C., & Xu, Y. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3175092 · Cited by 58
Nazir, A., Mitra, R., Sulieman, H., & Kamalov, F. (2023) · Sensors · doi:10.3390/s23135811 · Cited by 30
Paulraj, S., & Vairavasundaram, S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109496 · Cited by 27
Metadata
- Authors
- Feng, J.-C., Hong, F.-T., & Zheng, W.-S.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 14004-14013
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3168600998
- Cited by
- 355
- References
- 36
- FWCI
- 24.93
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.