The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Self-Training Multi-Sequence Learning with Transformer for Weakly Supervised Video Anomaly Detection
Open accessAbstract
Weakly supervised Video Anomaly Detection (VAD) using Multi-Instance Learning (MIL) is usually based on the fact that the anomaly score of an abnormal snippet is higher than that of a normal snippet. In the beginning of training, due to the limited accuracy of the model, it is easy to select the wrong abnormal snippet. In order to reduce the probability of selection errors, we first propose a Multi-Sequence Learning (MSL) method and a hinge-based MSL ranking loss that uses a sequence composed of multiple snippets as an optimization unit. We then design a Transformer-based MSL network to learn both video-level anomaly probability and snippet-level anomaly scores. In the inference stage, we propose to use the video-level anomaly probability to suppress the fluctuation of snippet-level anomaly scores. Finally, since VAD needs to predict the snippet-level anomaly scores, by gradually reducing the length of selected sequence, we propose a self-training strategy to gradually refine the anomaly scores. Experimental results show that our method achieves significant improvements on ShanghaiTech, UCF-Crime, and XD-Violence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354 · cited 1×
“Similar to (Tian et al. 2021), the Backbone uses pre-trained weights on the action recognition datasets (Karpathy et al. 2014; Kay et al. 2017).”
MethodThe Kinetics Human Action Video Dataset
Kay, W., Carreira, J., Simonyan, K., Zhang, B., Hillier, C., Vijayanarasimhan, S., Viola, F., Green, T., Back, T., Natsev, P., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06950 · Cited by 2,593
CvT: Introducing Convolutions to Vision Transformers
Wu, H., Xiao, B., Codella, N., Liu, M., Dai, X., Yuan, L., & Zhang, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00009 · Cited by 2,444
Liu, Z., Ning, J., Cao, Y., Wei, Y., Zhang, Z., Lin, S., & Hu, H. (2021) · arXiv · doi:10.48550/arxiv.2106.13230 · Cited by 2,294
Liu, Z., Ning, J., Cao, Y., Wei, Y., Zhang, Z., Lin, S., & Hu, H. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00320 · Cited by 2,294
Real-World Anomaly Detection in Surveillance Videos
Sultani, W., Chen, C., & Shah, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00678 · Cited by 2,140
Gong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930
The kinetics human action video dataset
Kay, W. (2024) · TIB Data Manager · doi:10.57702/jtuxnt5m · Cited by 1,646
Anomaly Detection and Localization in Crowded Scenes
Li, W., Mahadevan, V., & Vasconcelos, N. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.111 · Cited by 1,017
A Revisit of Sparse Coding Based Anomaly Detection in Stacked RNN Framework
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.45 · Cited by 895
Semi-Supervised Self-Training of Object Detection Models
Rosenberg, C., Hebert, M., & Schneiderman, H. (2005) · 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1 · doi:10.1109/acvmot.2005.107 · Cited by 796
ConViT: improving vision transformers with soft convolutional inductive biases
d’Ascoli, S., Touvron, H., Leavitt, M. L., Morcos, A. S., Biroli, G., & Sagun, L. (2022) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/ac9830 · Cited by 782
Zhong, J.-X., Li, N., Kong, W., Liu, S., Li, T. H., & Li, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00133 · Cited by 588
Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learning
Tian, Y., Pang, G., Chen, Y., Singh, R., Verjans, J. W., & Carneiro, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00493 · Cited by 557
Online detection of unusual events in videos via dynamic sparse coding
Zhao, B., Fei-Fei, L., & Xing, E. P. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995524 · Cited by 532
Not only Look, But Also Listen: Learning Multimodal Violence Detection Under Weak Supervision
Wu, P., Liu, J., Shi, Y., Sun, Y., Shao, F., Wu, Z., & Yang, Z. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58577-8_20 · Cited by 482
Co-Scale Conv-Attentional Image Transformers
Xu, W., Xu, Y., Chang, T., & Tu, Z. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00983 · Cited by 375
LocalViT: Analyzing Locality in Vision Transformers
Li, Y., Zhang, K., Cao, J., Timofte, R., Magno, M., Benini, L., & Van Goo, L. (2023) · 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342025 · Cited by 372
Semi-supervised self-training for decision tree classifiers
Tanha, J., van Someren, M., & Afsarmanesh, H. (2017) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-015-0328-7 · Cited by 266
Self-Trained Deep Ordinal Regression for End-to-End Video Anomaly Detection
Pang, G., Yan, C., Shen, C., van den Hengel, A., & Bai, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01219 · Cited by 257
ResT: An Efficient Transformer for Visual RecognitionPreprint
Zhang, Q., & Yang, Y.-B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.13677 · Cited by 218
Zhang, J., Qing, L., & Miao, J. (2019) · 2019 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2019.8803657 · Cited by 205
Appearance-Motion Memory Consistency Network for Video Anomaly Detection
Cai, R., Zhang, H., Liu, W., Gao, S., & Hao, Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16177 · Cited by 204
Weakly Supervised Video Anomaly Detection via Center-Guided Discriminative Learning
Wan, B., Fang, Y., Xia, X., & Mei, J. (2020) · 2020 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme46284.2020.9102722 · Cited by 197
Training data-efficient image transformers & distillation through attention
Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., & Jégou, H. (2020) · arXiv · doi:10.48550/arxiv.2012.12877 · Cited by 182
Motion-Aware Feature for Improved Video Anomaly DetectionPreprint
Zhu, Y., & Newsam, S. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.10211 · Cited by 150
Exploring Background-bias for Anomaly Detection in Surveillance Videos
Liu, K., & Ma, H. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350998 · Cited by 124
ConTNet: Why not use convolution and transformer at the same time?Preprint
Yan, H., Li, Z., Li, W., Wang, C., Wu, M., & Zhang, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.13497 · Cited by 92
Yu, F. R., Zhang, M., Dong, H., Hu, S., Dong, B., & Zhang, L. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17285 · Cited by 91
An anomaly-introduced learning method for abnormal event detection
He, C., Shao, J., & Sun, J. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5255-z · Cited by 83
Anomaly detection in video sequences: A benchmark and computational model
Wan, B., Jiang, W., Fang, Y., Luo, Z., & Ding, G. (2021) · IET Image Processing · doi:10.1049/ipr2.12258 · Cited by 82
Zheng, H., Zhang, Y., Yang, L., Wang, C., & Chen, D. Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6175 · Cited by 51
Transformer in Convolutional Neural NetworksPreprint
Liu, Y., Sun, G., Qiu, Y., Zhang, L., Chhatkuli, A., & Gool, L. V. (2021) · arXiv (Cornell University) · Cited by 49
A Universal Quaternion Hypergraph Network for Multimodal Video Question Answering
Guo, Z., Zhao, J., Jiao, L., Liu, X., & Liu, F. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3120544 · Cited by 45
Self-citationSemi-Supervised PolSAR Image Classification Based on Self-Training and Superpixels
Li, Y., Xing, R., Jiao, L., et al. (2019) · Remote Sensing · doi:10.3390/rs11161933 · Cited by 31
Self-citationSinkhorn Label Allocation: Semi-Supervised Classification via Annealed Self-TrainingPreprint
Tai, K. S., Bailis, P. D., & Valiant, G. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.08622 · Cited by 29
Improving semi-supervised self-training with embedded manifold transduction
Tao, Y., Zhang, D., Cheng, S., et al. (2016) · Transactions of the Institute of Measurement and Control · doi:10.1177/0142331216658091 · Cited by 9
Self-Training using Selection Network for Semi-supervised Learning
Jeong, J., Lee, S., & Kwak, N. (2020) · International Conference on Pattern Recognition Applications and Methods · doi:10.5220/0008940900230032 · Cited by 5
Cited by
Transformer-Based Spatio-Temporal Unsupervised Traffic Anomaly Detection in Aerial Videos
Tran, T. M., Bui, D. C., Nguyen, T. V., & Nguyen, K. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3376399 · Cited by 63
Nazir, A., Mitra, R., Sulieman, H., & Kamalov, F. (2023) · Sensors · doi:10.3390/s23135811 · Cited by 30
Metadata
- Authors
- Li, S., Liu, F., & Jiao, L.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2022-06-28
- Volume
- 36
- Issue
- 2
- Pages
- 1395-1403
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W4283811196
- Cited by
- 280
- References
- 45
- FWCI
- 32.50
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.