The DOI matches its DataCite record; 70 of the 72 references it cites were found in a registry or an index.
Self-supervised Co-training for Video Representation Learning
Open accessAbstract
The objective of this paper is visual-only self-supervised video representation learning. We make the following contributions: (i) we investigate the benefit of adding semantic-class positives to instance-based Info Noise Contrastive Estimation (InfoNCE) training, showing that this form of supervised contrastive learning leads to a clear improvement in performance; (ii) we propose a novel self-supervised co-training scheme to improve the popular infoNCE loss, exploiting the complementary information from different views, RGB streams and optical flow, of the same data source by using one view to obtain positive class samples for the other; (iii) we thoroughly evaluate the quality of the learnt representation on two different downstream tasks: action recognition and video retrieval. In both cases, the proposed approach demonstrates state-of-the-art or comparable performance with other self-supervised approaches, whilst being significantly more efficient to train, i.e. requiring far less training data to achieve similar performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Self-citationTwo-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Self-citationRepresentation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
Combining labeled and unlabeled data with co-training
Blum, A. L., & Mitchell, T. M. (1998) · Conference on Learning Theory · doi:10.1145/279943.279962 · Cited by 5,597
(1999) · Cited by 5,147
The Kinetics Human Action Video DatasetPreprint
Kay, W., Carreira, J., Simonyan, K., Zhang, B., Hillier, C., Vijayanarasimhan, S., Viola, F., Green, T., Back, T., Natsev, P., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06950 · Cited by 5,004
Self-citation
Research works printed but not linked: 3
- [5][5] Y. M. Asano, C. Rupprecht, and A. Vedaldi. Self-labelling via simultaneous clustering and representation learning. In Proc. ICLR , 2020. 2 -
- [22][22] I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In NeurIPS , pages 2672-2680, 2014. 3 -
- [32][32] X. Ji, J. F. Henriques, and A. Vedaldi. Invariant information clustering for unsupervised image classification and segmentation. In Proc. ICCV , pages 9865-9874, 2019. 2 -
Cited by
Sorted by citations
Dense Contrastive Learning for Self-Supervised Visual Pre-Training
Wang, X., Zhang, R., Shen, C., Kong, T., & Li, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00304 · Cited by 660
A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
Gui, J., Chen, T., Zhang, J., Cao, Q., Sun, Z., Luo, H., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3415112 · Cited by 730
Spatiotemporal Contrastive Video Representation Learning
Qian, R., Meng, T., Gong, B., Yang, M., Wang, H., Belongie, S., & Cui, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00689 · Cited by 489
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
Tong, Z., Song, Y., Wang, J., & Wang, L. (2022) · arXiv · doi:10.48550/arxiv.2203.12602 · Cited by 909
Self-Supervised Representation Learning: Introduction, advances, and challenges
Ericsson, L., Gouk, H., Loy, C. C., & Hospedales, T. M. (2022) · IEEE Signal Processing Magazine · doi:10.1109/msp.2021.3134634 · Cited by 433
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations
Dwibedi, D., Aytar, Y., Tompson, J., Sermanet, P., & Zisserman, A. (2021) · arXiv · doi:10.48550/arxiv.2104.14548 · Cited by 405
Self-citationWith a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations
Dwibedi, D., Aytar, Y., Tompson, J., Sermanet, P., & Zisserman, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00945 · Cited by 404
Self-citationBalanced Contrastive Learning for Long-Tailed Visual Recognition
Zhu, J., Wang, Z., Chen, J., Chen, Y. P., & Jiang, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00678 · Cited by 265
Dual Contrastive Learning for Unsupervised Image-to-Image Translation
Han, J., Shoeiby, M., Petersson, L., & Armin, M. A. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00084 · Cited by 258
3D Human Action Representation Learning via Cross-View Consistency Pursuit
Li, L., Wang, M., Ni, B., Wang, H., Yang, J., & Zhang, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00471 · Cited by 236
“Concurrent work CoCLR [10] leverages multi-modal information for video representation via co-training, which doesn’t consider the contrastive context.”
Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing
Bannur, S., Hyland, S., Liu, Q., Pérez-García, F., Ilse, M., Castro, D. C., Boecking, B., Sharma, H., Bouzid, K., Thieme, A., et al. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01442 · Cited by 227
A large-scale study on unsupervised spatiotemporal representation learning
Feichtenhofer, C., Fan, H., Xiong, B., Girshick, R., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00331 · Cited by 222
Audio-Visual Instance Discrimination with Cross-Modal Agreement
Morgado, P. M., Vasconcelos, N. M., & Misra, I. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01229 · Cited by 227
TCLR: Temporal contrastive learning for video representation
Dave, I. R., Gupta, R., Rizve, M. N., & Shah, M. A. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103406 · Cited by 165
Zhong, H., Wu, J., Chen, C., Huang, J., Deng, M., Nie, L., Lin, Z., & Hua, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00909 · Cited by 157
Self-supervised learning for videos: A survey
Schiappa, M. C., Rawat, Y. S., & Shah, M. (2023) · ACM Computing Surveys · doi:10.1145/3577925 · Cited by 155
Sequence-to-Sequence Contrastive Learning for Text Recognition
Aberdam, A., Litman, R., Tsiper, S., Anschel, O., Slossberg, R., Mazor, S., Manmatha, R., & Perona, P. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01505 · Cited by 152
CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations
Zolfaghari, M., Zhu, Y., Gehler, P., & Brox, T. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00148 · Cited by 153
Self-supervised Video Object Segmentation by Motion Grouping
Yang, C., Lamdouar, H., Lu, E., Zisserman, A., & Xie, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00709 · Cited by 153
Self-citationBridging Video-text Retrieval with Multiple Choice Questions
Ge, Y., Ge, Y., Liu, X., Li, D., Shan, Y., Qie, X., & Luo, P. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01569 · Cited by 138
A Multihead Attention Self-Supervised Representation Model for Industrial Sensors Anomaly Detection
Qiao, Y., Lü, J., Wang, T., Liu, K., Zhang, B., & Snoussi, H. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3280337 · Cited by 132
CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flow
Sui, X., Li, S., Geng, X., Wu, Y., Xu, X., Liu, Y., Goh, R. S. M., & Zhu, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01708 · Cited by 122
A Comprehensive Study of Deep Video Action RecognitionPreprint
Zhu, Y., Li, X., Liu, C., Zolfaghari, M., Xiong, Y., Wu, C., Zhang, Z., Tighe, J., Manmatha, R., & Li, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06567 · Cited by 212
Self-supervised Video Transformer
Ranasinghe, K., Naseer, M., Khan, S. H., Khan, F. S., & Ryoo, M. S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00289 · Cited by 128
Multi-Intention Oriented Contrastive Learning for Sequential Recommendation
Li, X., Sun, A., Zhao, M., Yu, J. X., Zhu, K., Jin, D., Yu, M., & Yu, R. (2023) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3539597.3570411 · Cited by 118
Robust Audio-Visual Instance Discrimination
Morgado, P. M., Misra, I., & Vasconcelos, N. M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01274 · Cited by 108
RSPNet: Relative Speed Perception for Unsupervised Video Representation Learning
Chen, P., Huang, D. Y., He, D., Long, X., Zeng, R., Wen, S., Tan, M., & Gan, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16189 · Cited by 108
Blind Image Quality Assessment via Cross-View Consistency
Zhu, Y., Li, Y., Sun, W., Min, X., Zhai, G., & Yang, X. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3224319 · Cited by 98
Wang, J., Gao, Y., Li, K., Lin, Y., Ma, A. J., Cheng, H., Peng, P., Huang, F., Ji, R., & Sun, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01163 · Cited by 99
Broaden Your Views for Self-Supervised Video Learning
Recasens, A., Luc, P., Alayrac, J.-B., Wang, L., Strub, F., Tallec, C., Malinowski, M., Pătrăucean, V., Altché, F., Valko, M., et al. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00129 · Cited by 98
Self-citationPose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification
Zheng, K., Lan, C., Zeng, W., Liu, J., Zhang, Z., & Zha, Z.-J. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475610 · Cited by 89
Unsupervised Deraining: Where Contrastive Learning Meets Self-similarity
Ye, Y., Yu, C., Chang, Y., Zhu, L., Zhao, X.-L., Yan, L., & Tian, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00573 · Cited by 91
Hu, M., Wu, C., & Zhang, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3218795 · Cited by 88
Learning from Temporal Gradient for Semi-supervised Action Recognition
Xiao, J., Jing, L., Zhang, L., He, J., She, Q., Zhou, Z., Yuille, A., & Li, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00325 · Cited by 84
Robust Contrastive Learning against Noisy Views
Chuang, C.-Y., Hjelm, R. D., Wang, X., Vineet, V., Joshi, N., Torralba, A. B., Jegelka, S., & Song, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01617 · Cited by 90
Contrastive Learning Enhanced Intrusion Detection
Yue, Y., Chen, X., Han, Z., Zeng, X., & Zhu, Y. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3218843 · Cited by 87
MVFNet: Multi-View Fusion Network for Efficient Video Recognition
Wu, W., He, D., Lin, T., Li, F., Gan, C., & Ding, E. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16401 · Cited by 79
Multi-View Action Recognition using Contrastive Learning
Shah, K., Shah, A., Lau, C. P., de Melo, C. M., & Chellapp, R. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00338 · Cited by 73
Temporal Alignment Networks for Long-term Video
Han, T., Xie, W., & Zisserman, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00292 · Cited by 72
Self-citationDissecting self-supervised learning methods for surgical computer vision
Ramesh, S., Srivastav, V., Alapatt, D., Yu, T., Murali, A., Sestini, L., Nwoye, C. I., Hamoud, I., Sharma, S., Fleurentin, A., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102844 · Cited by 81
Home Action Genome: Cooperative Compositional Action Understanding
Rai, N., Chen, H., Ji, J., Desai, R., Kozuka, K., Ishizaka, S., Adeli, E., & Niebles, J. C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01103 · Cited by 68
Learning Cross-Modal Contrastive Features for Video Domain Adaptation
Kim, D., Tsai, Y., Zhuang, B., Yu, X., Sclaroff, S., Saenko, K., & Chandraker, M. K. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01336 · Cited by 68
Unsupervised Pre-training for Temporal Action Localization Tasks
Zhang, C., Yang, T., Weng, J., Cao, M., Wang, J., & Zou, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01364 · Cited by 62
Ye, J., Xiao, Q., Wang, J., Zhang, H., Deng, J., & Lin, Y. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3130826 · Cited by 61
Motion-aware Contrastive Video Representation Learning via Foreground-background Merging
Ding, S., Li, M., Yang, T., Qian, R., Xu, H., Chen, Q., Wang, J., & Xiong, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00949 · Cited by 63
Probabilistic Representations for Video Contrastive Learning
Park, J., Lee, J., Kim, I.-J., & Sohn, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01430 · Cited by 59
Video Contrastive Learning with Global Context
Kuang, H., Zhu, Y., Zhang, Z., Li, X., Tighe, J., Schwertfeger, S., Stachniss, C., & Li, M. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00358 · Cited by 58
MAR: M asked Autoencoders for Efficient A ction R ecognition
Qing, Z., Zhang, S., Huang, Z., Wang, X., Wang, Y., Lv, Y., Gao, C., & Sang, N. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3263288 · Cited by 76
Self-supervised object detection from audio-visual correspondence
Afouras, T., Asano, Y. M., Fagan, F., Vedaldi, A., & Metze, F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01032 · Cited by 56
Multiview Pseudo-Labeling for Semi-supervised Learning from Video
Xiong, B., Fan, H., Grauman, K. L., & Feichtenhofer, C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00712 · Cited by 56
Shot Contrastive Self-Supervised Learning for Scene Boundary Detection
Chen, S., Nie, X., Fan, D., Zhang, D., Bhat, V., & Hamid, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00967 · Cited by 62
Contrast and Order Representations for Video Self-supervised Learning
Hu, K., Shao, J., Liu, Y., Raj, B., Savvides, M., & Shen, Z. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00784 · Cited by 56
Video Pose Distillation for Few-Shot, Fine-Grained Sports Action Recognition
Hong, J. W., Fisher, M., Gharbi, M., & Fatahalian, K. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00912 · Cited by 54
Wang, H., Ahn, E., & Kim, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20143 · Cited by 54
Boundary-sensitive Pre-training for Temporal Localization in Videos
Xu, M., Pérez-Rúa, J.-M., Escorcia, V. A., Martínez, B., Zhu, X., Zhang, L., Ghanem, B., & Xiang, T. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00713 · Cited by 58
On Compositions of Transformations in Contrastive Self-Supervised Learning
Patrick, M., Asano, Y. M., Kuznetsova, P., Fong, R., Henriques, J. F., Zweig, G., & Vedaldi, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00944 · Cited by 65
Time-Equivariant Contrastive Video Representation Learning
Jenni, S., & Jin, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00982 · Cited by 54
Vi2CLR: Video and Image for Visual Contrastive Learning of Representation
Diba, A., Sharma, V., Safdari, R., Lotfi, D., Sarfraz, M. S., Stiefelhagen, R., & Van Gool, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00153 · Cited by 53
Video Representation Learning with Visual Tempo ConsistencyPreprint
Yang, C., Xu, Y., Dai, B., & Zhou, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15489 · Cited by 76
Multi-view self-supervised learning on heterogeneous graphs for recommendation
Zhang, Y., Zhang, Y., Liao, W., Li, X., & Wang, X. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113056 · Cited by 52
Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendation
Qiu, R., Huang, Z. H., & Yin, H. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00063 · Cited by 51
An Improved Inter-Intra Contrastive Learning Framework on Self-Supervised Video Representation
Tao, L., Wang, X., & Yamasaki, T. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3141051 · Cited by 50
VideoLT: Large-scale Long-tailed Video Recognition
Zhang, X., Wu, Z., Weng, Z., Fu, H., Chen, J., Jiang, Y., & Davis, L. S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00786 · Cited by 52
Liu, D., Wang, T., Liu, S., Wang, R., Yao, S., & Abdelzaher, T. (2021) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn52240.2021.9522151 · Cited by 52
HyRSM++: Hybrid relation guided temporal set matching for few-shot action recognition
Wang, X., Zhang, S., Qing, Z., Zuo, Z., Gao, C., Jin, R., & Sang, N. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110110 · Cited by 51
ASCNet: Self-supervised Video Representation Learning with Appearance-Speed Consistency
Huang, D. Y., Wu, W., Hu, W.-W., Liu, X., He, D., Wu, Z., Wu, X., Tan, M., & Ding, E. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00799 · Cited by 47
Exploring Intra- and Inter-Video Relation for Surgical Semantic Scene Segmentation
Jin, Y., Yu, Y., Chen, C., Zhao, Z., Heng, P., & Stoyanov, D. V. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3177077 · Cited by 49
Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learning
Li, L., Zhou, T., Wang, W., Yang, L., Li, J., & Yang, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00852 · Cited by 48
Region Embedding With Intra and Inter-View Contrastive Learning
Zhang, L., Long, C., & Cong, G. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3220874 · Cited by 54
Max-Margin Contrastive Learning
Shah, A., Sra, S., Chellappa, R., & Cherian, A. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20796 · Cited by 44
Self-Supervised Video Representation Learning with Meta-Contrastive Network
Lin, Y., Guo, X., & Lu, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00813 · Cited by 42
Masked Motion Encoding for Self-Supervised Video Representation Learning
Sun, X., Chen, P., Chen, L., Li, C., Li, T. H., Tan, M., & Gan, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00222 · Cited by 48
Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives
Hoffmann, D. T., Behrmann, N., Gall, J., Brox, T., & Noroozi, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19972 · Cited by 44
Zhu, Y., Shuai, H., Liu, G., & Liu, Q. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3169469 · Cited by 41
Dense Contrastive Learning for Self-Supervised Visual Pre-TrainingPreprint
Wang, X., Zhang, R., Shen, C., Kong, T., & Li, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.09157 · Cited by 38
Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimization
Qian, R., Li, Y., Liu, H., See, J., Ding, S., Liu, X., Li, D., & Lin, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00789 · Cited by 35
A Survey of Computer Vision Technologies in Urban and Controlled-environment Agriculture
Luo, J., Li, B., & Leung, C. (2023) · ACM Computing Surveys · doi:10.1145/3626186 · Cited by 38
Self-Supervised Point Cloud Representation Learning via Separating Mixed Shapes
Sun, C., Zheng, Z., Wang, X., Xu, M., & Yang, Y. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3206664 · Cited by 40
Neighbor-Guided Consistent and Contrastive Learning for Semi-Supervised Action Recognition
Wu, J., Sun, W., Gan, T., Ding, N., Jiang, F., Shen, J., & Nie, L. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3265261 · Cited by 34
SPARTAN: Self-supervised Spatiotemporal Transformers Approach to Group Activity Recognition
Chappa, N. V. S. R., Nguyen, P., Nelson, A., Seo, H., Li, X., Dobbs, P. D., & Luu, K. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00544 · Cited by 37
ODCR: Orthogonal Decoupling Contrastive Regularization for Unpaired Image Dehazing
Wang, Z., Zhao, H., Peng, J., Yao, L., & Zhao, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02407 · Cited by 32
Shi, X., Jin, Y., Dou, Q., & Heng, P. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102158 · Cited by 32
Motion-Focused Contrastive Learning of Video Representations
Li, R., Zhang, Y., Qiu, Z., Yao, T., Liu, D., & Mei, T. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00211 · Cited by 33
Khaertdinov, B., Asteriadis, S., & Ghaleb, E. (2022) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2022.3180591 · Cited by 31
Learning Sound Localization Better from Semantically Similar Samples
Senocak, A., Ryu, H., Kim, J., & Kweon, I. S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747867 · Cited by 31
SLIC: Self-Supervised Learning with Iterative Clustering for Human Action Videos
Khorasgani, S. H., Chen, Y., & Shkurti, F. (2022) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52688.2022.01562 · Cited by 34
Self-Supervised Visual Learning by Variable Playback Speeds Prediction of a Video
Cho, H., Kim, T., Chang, H. J., & Hwang, W. (2021) · IEEE Access · doi:10.1109/access.2021.3084840 · Cited by 58
Long Short View Feature Decomposition via Contrastive Video Representation Learning
Behrmann, N., Fayyaz, M., Gall, J., & Noroozi, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00911 · Cited by 30
Unsupervised Deraining: Where Asymmetric Contrastive Learning Meets Self-Similarity
Chang, Y., Guo, Y., Ye, Y., Yu, C., Zhu, L., Zhao, X.-L., Yan, L., & Tian, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3321311 · Cited by 31
Focalized contrastive view-invariant learning for self-supervised skeleton-based action recognition
Men, Q., Ho, E. S. L., Shum, H. P. H., & Leung, H. W. H. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.03.070 · Cited by 28
S3L: Spectrum Transformer for Self-Supervised Learning in Hyperspectral Image Classification
Guo, H., & Liu, W. (2024) · Remote Sensing · doi:10.3390/rs16060970 · Cited by 28
Contrastive Learning with Cross-Modal Knowledge Mining for Multimodal Human Activity Recognition
Brinzea, R., Khaertdinov, B., & Asteriadis, S. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892522 · Cited by 27
Contextualized Spatio-Temporal Contrastive Learning with Self-Supervision
Yuan, L., Qian, R., Cui, Y., Gong, B., Schroff, F., Yang, M., Adam, H., & Liu, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01359 · Cited by 28
VicTR: Video-conditioned Text Representations for Activity Recognition
Kahatapitiya, K., Arnab, A., Nagran, A., & Ryoo, M. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01755 · Cited by 26
ViewCLR: Learning Self-supervised Video Representation for Unseen Viewpoints
Das, S., & Ryoo, M. S. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00553 · Cited by 26
Enhanced bare-bones particle swarm optimization based evolving deep neural networks
Li, Z., Lim, C. P., & Liu, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120642 · Cited by 26
XKD: Cross-Modal Knowledge Distillation with Domain Alignment for Video Representation Learning
Sarkar, P., & Etemad, A. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i13.29407 · Cited by 36
See Your Emotion from Gait Using Unlabeled Skeleton Data
Lu, H., Hu, X., & Hu, B. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25272 · Cited by 26
Exploring Relations in Untrimmed Videos for Self-Supervised Learning
Luo, D., Zhou, Y., Fang, B., Zhou, Y., Wu, D., & Wang, W. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3473342 · Cited by 24
SCEHR: Supervised Contrastive Learning for Clinical Risk Prediction using Electronic Health Records
Zang, C., & Wang, F. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00097 · Cited by 27
Metadata
- Authors
- Han, T., Xie, W., & Zisserman, A.
- Affiliations
- University of Oxford (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2010.09709
- OpenAlex
- W3094454579
- Cited by
- 292
- References
- 72
- Citations by year
- 2025: 22 · 2024: 31 · 2023: 79 · 2022: 74 · 2021: 81 · 2020: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- self-supervised learning, video representation learning, co-training, InfoNCE, supervised contrastive learning, optical flow, human action recognition, video retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
