Self-supervised Co-training for Video Representation Learning
Open accessAbstract
The objective of this paper is visual-only self-supervised video representation learning. We make the following contributions: (i) we investigate the benefit of adding semantic-class positives to instance-based Info Noise Contrastive Estimation (InfoNCE) training, showing that this form of supervised contrastive learning leads to a clear improvement in performance; (ii) we propose a novel self-supervised co-training scheme to improve the popular infoNCE loss, exploiting the complementary information from different views, RGB streams and optical flow, of the same data source by using one view to obtain positive class samples for the other; (iii) we thoroughly evaluate the quality of the learnt representation on two different downstream tasks: action recognition and video retrieval. In both cases, the proposed approach demonstrates state-of-the-art or comparable performance with other self-supervised approaches, whilst being significantly more efficient to train, i.e. requiring far less training data to achieve similar performance.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,268 · see citing works
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347 · see citing works
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857 · see citing works
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570 · see citing works
Self-citationTwo-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756 · see citing works
Self-citationRepresentation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242 · see citing works
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691 · see citing works
Combining labeled and unlabeled data with co-training
Blum, A. L., & Mitchell, T. M. (1998) · Conference on Learning Theory · doi:10.1145/279943.279962 · Cited by 5,597 · see citing works
(1999) · Cited by 5,147 · see citing works
Ucf101: A dataset of 101 human actions classes from videos in the wild
Soomro, K., Zamir, A. R., & Shah, M. (2012) · arXiv · doi:10.48550/arxiv.1212.0402 · Cited by 4,575 · see citing works
SlowFast Networks for Video Recognition
Feichtenhofer, C., Fan, H., Malik, J., & He, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00630 · Cited by 4,007 · see citing works
Hmdb: a large video database for human motion recognition
Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., & Serre, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126543 · Cited by 3,965 · see citing works
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846 · see citing works
The Kinetics Human Action Video DatasetPreprint
Kay, W., Carreira, J., Simonyan, K., Zhang, B., Hillier, C., Vijayanarasimhan, S., Viola, F., Green, T., Back, T., Natsev, P., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06950 · Cited by 3,711 · see citing works
Self-citationA Closer Look at Spatiotemporal Convolutions for Action Recognition
Tran, D., Wang, H., Torresani, L., Ray, J., LeCun, Y., & Paluri, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00675 · Cited by 3,672 · see citing works
Supervised Contrastive Learning
Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., & Krishnan, D. (2020) · arXiv · doi:10.48550/arxiv.2004.11362 · Cited by 3,569 · see citing works
Zhang, R., Isola, P., & Efros, A. A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,361 · see citing works
Convolutional Two-Stream Network Fusion for Video Action Recognition
Feichtenhofer, C., Pinz, A. J., & Zisserman, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.213 · Cited by 2,842 · see citing works
Self-citationUnsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775 · see citing works
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674 · see citing works
Unsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629 · see citing works
Improved Baselines with Momentum Contrastive LearningPreprint
Chen, X., Fan, H., Girshick, R., & He, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04297 · Cited by 2,579 · see citing works
Tian, Y., Krishnan, D., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_45 · Cited by 1,997 · see citing works
Learning deep representations by mutual information estimation and maximization
Hjelm, R. D., Fedorov, A., Lavoie-Marchildon, S., Grewal, K., Bachman, P., Trischler, A., & Bengio, Y. (2018) · arXiv · doi:10.48550/arxiv.1808.06670 · Cited by 1,991 · see citing works
A Duality Based Approach for Realtime TV-L 1 Optical Flow
Zach, C., Pock, T., & Bischof, H. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74936-3_22 · Cited by 1,658 · cited 1× · see citing works
“The optical flow is computed with the un-supervised TV-L1 algorithm [67], and the same pre-processing procedure is used as in [11].”
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Gutmann, M. U., & Hyvärinen, A. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 1,588 · see citing works
Self-Supervised Learning of Pretext-Invariant Representations
Misra, I., & van der Maaten, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00674 · Cited by 1,435 · see citing works
X3D: Expanding Architectures for Efficient Video Recognition
Feichtenhofer, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00028 · Cited by 1,262 · see citing works
Exploring the Limits of Language ModelingPreprint
Józefowicz, R., Vinyals, O., Schuster, M., Shazeer, N., & Wu, Y.-H. (2016) · arXiv.org · doi:10.48550/arxiv.1602.02410 · Cited by 1,202 · see citing works
Data-Efficient Image Recognition with Contrastive Predictive Coding
Hénaff, O. J., Srinivas, A., De Fauw, J., Razavi, A., Doersch, C., Eslami, S. M. A., & Oord, A. V. D. (2019) · arXiv · doi:10.48550/arxiv.1905.09272 · Cited by 1,014 · see citing works
Arandjelović, R., & Zisserman, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.73 · Cited by 836 · see citing works
Self-citationShuffle and Learn: Unsupervised Learning Using Temporal Order Verification
Misra, I., Zitnick, C. L., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_32 · Cited by 779 · see citing works
Multi-task Self-Supervised Visual Learning
Doersch, C., & Zisserman, A. (2017) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2017.226 · Cited by 682 · see citing works
Self-citationAgrawal, P., Carreira, J., & Malik, J. (2015) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2015.13 · Cited by 639 · see citing works
End-to-End Learning of Visual Representations From Uncurated Instructional Videos
Miech, A., Alayrac, J.-B., Smaira, L., Laptev, I., Šivic, J., & Zisserman, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00990 · Cited by 622 · see citing works
Self-citationAnticipating Visual Representations from Unlabeled Video
Vondrick, C., Pirsiavash, H., & Torralba, A. B. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.18 · Cited by 538 · see citing works
Unsupervised Representation Learning by Sorting Sequences
Lee, H.-Y., Huang, J., Singh, M., & Yang, M. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.79 · Cited by 529 · see citing works
Spatiotemporal Contrastive Video Representation Learning
Qian, R., Meng, T., Gong, B., Yang, M., Wang, H., Belongie, S., & Cui, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00689 · Cited by 462 · see citing works
Learning Correspondence From the Cycle-Consistency of Time
Wang, X., Jabri, A., & Efros, A. A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00267 · Cited by 452 · see citing works
Arandjelović, R., & Zisserman, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_27 · Cited by 448 · see citing works
Self-citationLocal Aggregation for Unsupervised Learning of Visual Embeddings
Zhuang, C., Zhai, A., & Yamins, D. L. K. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00610 · Cited by 422 · see citing works
Self-Supervised Spatiotemporal Learning via Video Clip Order Prediction
Xu, D., Xiao, J., Zhao, Z., Shao, J., Xie, D., & Zhuang, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01058 · Cited by 417 · see citing works
Tracking Emerges by Colorizing Videos
Vondrick, C., Shrivastava, A., Fathi, A., Guadarrama, S., & Murphy, K. P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_24 · Cited by 393 · see citing works
Video Representation Learning by Dense Predictive Coding
Han, T., Xie, W., & Zisserman, A. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00186 · Cited by 383 · see citing works
Self-citationCooperative Learning of Audio and Video Models from Self-Supervised SynchronizationPreprint
Korbar, B., Tran, D., & Torresani, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00230 · Cited by 331 · see citing works
Learning and Using the Arrow of Time
Wei, D., Lim, J. J., Zisserman, A., & Freeman, W. T. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00840 · Cited by 318 · see citing works
Self-citationSelf-Supervised Video Representation Learning with Space-Time Cubic Puzzles
Kim, D., Cho, D., & Kweon, I. S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018545 · Cited by 314 · see citing works
Self-Supervised Learning by Cross-Modal Audio-Video Clustering
Alwassel, H., Mahajan, D., Korbar, B., Torresani, L., Ghanem, B., & Tran, D. (2019) · arXiv · doi:10.48550/arxiv.1911.12667 · Cited by 298 · see citing works
Unsupervised Pre-Training of Image Features on Non-Curated Data
Caron, M., Bojanowski, P., Mairal, J., & Joulin, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00305 · Cited by 258 · see citing works
Learning Video Representations using Contrastive Bidirectional TransformerPreprint
Sun, C., Baradel, F., Murphy, K. P., & Schmid, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05743 · Cited by 258 · see citing works
SpeedNet: Learning the Speediness in Videos
Benaim, S., Ephrat, A., Lang, O., Mosseri, I., Freeman, W. T., Rubinstein, M., Irani, M., & Dekel, T. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00994 · Cited by 234 · see citing works
Learning Image Representations Tied to Ego-Motion
Jayaraman, D., & Grauman, K. L. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.166 · Cited by 229 · see citing works
Self-supervised Video Representation Learning by Pace Prediction
Wang, J., Jiao, J., & Liu, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_30 · Cited by 223 · see citing works
Memory-Augmented Dense Predictive Coding for Video Representation Learning
Han, T., Xie, W., & Zisserman, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58580-8_19 · Cited by 211 · see citing works
Self-citationRethinking Spatiotemporal Feature Learning For Video Understanding.
Xie, S., Sun, C., Huang, J., Tu, Z., & Murphy, K. P. (2017) · Cited by 205 · see citing works
D3D: Distilled 3D Networks for Video Action Recognition
Stroud, J., Ross, D. A., Sun, C., Deng, J., & Sukthankar, R. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093274 · Cited by 194 · see citing works
MAST: A Memory-Augmented Self-Supervised Tracker
Lai, Z., Lu, E., & Xie, W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00651 · Cited by 176 · see citing works
Self-citationVideo Cloze Procedure for Self-Supervised Spatio-Temporal Learning
Luo, D., Liu, C., Zhou, Y., Yang, D., Ma, C., Ye, Q., & Wang, W. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6840 · Cited by 151 · see citing works
Self-Supervised Spatiotemporal Feature Learning via Video Rotation PredictionPreprint
Jing, L., Yang, X., Liu, J., & Tian, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11387 · Cited by 149 · see citing works
Evolving Losses for Unsupervised Video Representation Learning
Piergiovanni, A., Angelova, A., & Ryoo, M. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00021 · Cited by 134 · see citing works
Multi-modal Self-Supervision from Generalized Data TransformationsPreprint
Patrick, M., Asano, Y. M., Кузнецова, П., Fong, R., Henriques, J. F., Zweig, G., & Vedaldi, A. (2021) · arXiv (Cornell University) · Cited by 117 · see citing works
Improving Spatiotemporal Self-supervision by Deep Reinforcement Learning
Büchler, U., Brattoli, B., & Ommer, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_47 · Cited by 114 · see citing works
DynamoNet: Dynamic Action and Motion Network
Diba, A., Sharma, V., Gool, L. V., & Stiefelhagen, R. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00629 · Cited by 111 · see citing works
Contrastive Bidirectional Transformer for Temporal Representation Learning
Sun, C., Baradel, F., Murphy, K. P., & Schmid, C. (2019) · Cited by 109 · see citing works
Self-supervised Learning for Video Correspondence FlowPreprint
Lai, Z., & Xie, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.00875 · Cited by 104 · see citing works
Self-citationDance With Flow: Two-In-One Stream Action Detection
Zhao, J., & Snoek, C. G. M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01017 · Cited by 101 · see citing works
Learning visual groups from co-occurrences in space and time
Isola, P., Zoran, D., Krishnan, D., & Adelson, E. H. (2015) · arXiv · doi:10.48550/arxiv.1511.06811 · Cited by 90 · see citing works
Oops! Predicting Unintentional Action in Video
Epstein, D., Chen, B., & Vondrick, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00100 · Cited by 82 · see citing works
Self-supervised Spatiotemporal Feature Learning by Video Geometric TransformationsPreprint
Jing, L., & Tian, Y. (2018) · arXiv (Cornell University) · Cited by 62 · see citing works
Self-Supervised Video Representation Learning With Odd-One-Out NetworksPreprint
Fernando, B., Bilen, H., Gavves, E., & Gould, S. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06646 · Cited by 4 · see citing works
Flagged first, then by citations
2 of the 72 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- [5][5] Y. M. Asano, C. Rupprecht, and A. Vedaldi. Self-labelling via simultaneous clustering and representation learning. In Proc. ICLR , 2020. 2 -
- [22][22] I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In NeurIPS , pages 2672-2680, 2014. 3 -
- [32][32] X. Ji, J. F. Henriques, and A. Vedaldi. Invariant information clustering for unsupervised image classification and segmentation. In Proc. ICCV , pages 9865-9874, 2019. 2 -
Cited by
Sorted by citations
Dense Contrastive Learning for Self-Supervised Visual Pre-Training
Wang, X., Zhang, R., Shen, C., Kong, T., & Li, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00304 · Cited by 660 · see citing works
A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
Gui, J., Chen, T., Zhang, J., Cao, Q., Sun, Z., Luo, H., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3415112 · Cited by 622 · see citing works
Spatiotemporal Contrastive Video Representation Learning
Qian, R., Meng, T., Gong, B., Yang, M., Wang, H., Belongie, S., & Cui, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00689 · Cited by 462 · see citing works
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
Tong, Z., Song, Y., Wang, J., & Wang, L. (2022) · arXiv · doi:10.48550/arxiv.2203.12602 · Cited by 909 · see citing works
Self-Supervised Representation Learning: Introduction, advances, and challenges
Ericsson, L., Gouk, H., Loy, C. C., & Hospedales, T. M. (2022) · IEEE Signal Processing Magazine · doi:10.1109/msp.2021.3134634 · Cited by 433 · see citing works
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations
Dwibedi, D., Aytar, Y., Tompson, J., Sermanet, P., & Zisserman, A. (2021) · arXiv · doi:10.48550/arxiv.2104.14548 · Cited by 405 · see citing works
Self-citationWith a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations
Dwibedi, D., Aytar, Y., Tompson, J., Sermanet, P., & Zisserman, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00945 · Cited by 404 · see citing works
Self-citationBalanced Contrastive Learning for Long-Tailed Visual Recognition
Zhu, J., Wang, Z., Chen, J., Chen, Y. P., & Jiang, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00678 · Cited by 246 · see citing works
Dual Contrastive Learning for Unsupervised Image-to-Image Translation
Han, J., Shoeiby, M., Petersson, L., & Armin, M. A. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00084 · Cited by 245 · see citing works
3D Human Action Representation Learning via Cross-View Consistency Pursuit
Li, L., Wang, M., Ni, B., Wang, H., Yang, J., & Zhang, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00471 · Cited by 236 · see citing works
“Concurrent work CoCLR [10] leverages multi-modal information for video representation via co-training, which doesn’t consider the contrastive context.”
Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing
Bannur, S., Hyland, S., Liu, Q., Pérez-García, F., Ilse, M., Castro, D. C., Boecking, B., Sharma, H., Bouzid, K., Thieme, A., et al. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01442 · Cited by 227 · see citing works
A large-scale study on unsupervised spatiotemporal representation learning
Feichtenhofer, C., Fan, H., Xiong, B., Girshick, R., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00331 · Cited by 222 · see citing works
Audio-Visual Instance Discrimination with Cross-Modal Agreement
Morgado, P. M., Vasconcelos, N. M., & Misra, I. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01229 · Cited by 218 · see citing works
TCLR: Temporal contrastive learning for video representation
Dave, I. R., Gupta, R., Rizve, M. N., & Shah, M. A. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103406 · Cited by 165 · see citing works
Zhong, H., Wu, J., Chen, C., Huang, J., Deng, M., Nie, L., Lin, Z., & Hua, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00909 · Cited by 157 · see citing works
Self-supervised learning for videos: A survey
Schiappa, M. C., Rawat, Y. S., & Shah, M. (2023) · ACM Computing Surveys · doi:10.1145/3577925 · Cited by 155 · see citing works
Sequence-to-Sequence Contrastive Learning for Text Recognition
Aberdam, A., Litman, R., Tsiper, S., Anschel, O., Slossberg, R., Mazor, S., Manmatha, R., & Perona, P. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01505 · Cited by 149 · see citing works
CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations
Zolfaghari, M., Zhu, Y., Gehler, P., & Brox, T. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00148 · Cited by 146 · see citing works
Self-supervised Video Object Segmentation by Motion Grouping
Yang, C., Lamdouar, H., Lu, E., Zisserman, A., & Xie, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00709 · Cited by 140 · see citing works
Self-citationBridging Video-text Retrieval with Multiple Choice Questions
Ge, Y., Ge, Y., Liu, X., Li, D., Shan, Y., Qie, X., & Luo, P. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01569 · Cited by 131 · see citing works
A Multihead Attention Self-Supervised Representation Model for Industrial Sensors Anomaly Detection
Qiao, Y., Lü, J., Wang, T., Liu, K., Zhang, B., & Snoussi, H. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3280337 · Cited by 127 · see citing works
CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flow
Sui, X., Li, S., Geng, X., Wu, Y., Xu, X., Liu, Y., Goh, R. S. M., & Zhu, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01708 · Cited by 122 · see citing works
A Comprehensive Study of Deep Video Action RecognitionPreprint
Zhu, Y., Li, X., Liu, C., Zolfaghari, M., Xiong, Y., Wu, C., Zhang, Z., Tighe, J., Manmatha, R., & Li, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06567 · Cited by 172 · see citing works
Self-supervised Video Transformer
Ranasinghe, K., Naseer, M., Khan, S. H., Khan, F. S., & Ryoo, M. S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00289 · Cited by 123 · see citing works
Multi-Intention Oriented Contrastive Learning for Sequential Recommendation
Li, X., Sun, A., Zhao, M., Yu, J. X., Zhu, K., Jin, D., Yu, M., & Yu, R. (2023) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3539597.3570411 · Cited by 118 · see citing works
Robust Audio-Visual Instance Discrimination
Morgado, P. M., Misra, I., & Vasconcelos, N. M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01274 · Cited by 108 · see citing works
RSPNet: Relative Speed Perception for Unsupervised Video Representation Learning
Chen, P., Huang, D. Y., He, D., Long, X., Zeng, R., Wen, S., Tan, M., & Gan, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16189 · Cited by 107 · see citing works
Blind Image Quality Assessment via Cross-View Consistency
Zhu, Y., Li, Y., Sun, W., Min, X., Zhai, G., & Yang, X. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3224319 · Cited by 95 · see citing works
Wang, J., Gao, Y., Li, K., Lin, Y., Ma, A. J., Cheng, H., Peng, P., Huang, F., Ji, R., & Sun, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01163 · Cited by 99 · see citing works
Broaden Your Views for Self-Supervised Video Learning
Recasens, A., Luc, P., Alayrac, J.-B., Wang, L., Strub, F., Tallec, C., Malinowski, M., Pătrăucean, V., Altché, F., Valko, M., et al. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00129 · Cited by 90 · see citing works
Self-citationPose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification
Zheng, K., Lan, C., Zeng, W., Liu, J., Zhang, Z., & Zha, Z.-J. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475610 · Cited by 89 · see citing works
Unsupervised Deraining: Where Contrastive Learning Meets Self-similarity
Ye, Y., Yu, C., Chang, Y., Zhu, L., Zhao, X.-L., Yan, L., & Tian, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00573 · Cited by 86 · see citing works
Hu, M., Wu, C., & Zhang, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3218795 · Cited by 85 · see citing works
Learning from Temporal Gradient for Semi-supervised Action Recognition
Xiao, J., Jing, L., Zhang, L., He, J., She, Q., Zhou, Z., Yuille, A., & Li, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00325 · Cited by 84 · see citing works
Robust Contrastive Learning against Noisy Views
Chuang, C.-Y., Hjelm, R. D., Wang, X., Vineet, V., Joshi, N., Torralba, A. B., Jegelka, S., & Song, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01617 · Cited by 79 · see citing works
Contrastive Learning Enhanced Intrusion Detection
Yue, Y., Chen, X., Han, Z., Zeng, X., & Zhu, Y. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3218843 · Cited by 78 · see citing works
MVFNet: Multi-View Fusion Network for Efficient Video Recognition
Wu, W., He, D., Lin, T., Li, F., Gan, C., & Ding, E. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16401 · Cited by 77 · see citing works
Multi-View Action Recognition using Contrastive Learning
Shah, K., Shah, A., Lau, C. P., de Melo, C. M., & Chellapp, R. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00338 · Cited by 73 · see citing works
Temporal Alignment Networks for Long-term Video
Han, T., Xie, W., & Zisserman, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00292 · Cited by 72 · see citing works
Self-citationDissecting self-supervised learning methods for surgical computer vision
Ramesh, S., Srivastav, V., Alapatt, D., Yu, T., Murali, A., Sestini, L., Nwoye, C. I., Hamoud, I., Sharma, S., Fleurentin, A., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102844 · Cited by 70 · see citing works
Home Action Genome: Cooperative Compositional Action Understanding
Rai, N., Chen, H., Ji, J., Desai, R., Kozuka, K., Ishizaka, S., Adeli, E., & Niebles, J. C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01103 · Cited by 68 · see citing works
Learning Cross-Modal Contrastive Features for Video Domain Adaptation
Kim, D., Tsai, Y., Zhuang, B., Yu, X., Sclaroff, S., Saenko, K., & Chandraker, M. K. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01336 · Cited by 68 · see citing works
Unsupervised Pre-training for Temporal Action Localization Tasks
Zhang, C., Yang, T., Weng, J., Cao, M., Wang, J., & Zou, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01364 · Cited by 62 · see citing works
Ye, J., Xiao, Q., Wang, J., Zhang, H., Deng, J., & Lin, Y. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3130826 · Cited by 61 · see citing works
Motion-aware Contrastive Video Representation Learning via Foreground-background Merging
Ding, S., Li, M., Yang, T., Qian, R., Xu, H., Chen, Q., Wang, J., & Xiong, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00949 · Cited by 63 · see citing works
Probabilistic Representations for Video Contrastive Learning
Park, J., Lee, J., Kim, I.-J., & Sohn, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01430 · Cited by 59 · see citing works
Video Contrastive Learning with Global Context
Kuang, H., Zhu, Y., Zhang, Z., Li, X., Tighe, J., Schwertfeger, S., Stachniss, C., & Li, M. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00358 · Cited by 58 · see citing works
MAR: M asked Autoencoders for Efficient A ction R ecognition
Qing, Z., Zhang, S., Huang, Z., Wang, X., Wang, Y., Lv, Y., Gao, C., & Sang, N. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3263288 · Cited by 72 · see citing works
Self-supervised object detection from audio-visual correspondence
Afouras, T., Asano, Y. M., Fagan, F., Vedaldi, A., & Metze, F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01032 · Cited by 56 · see citing works
Multiview Pseudo-Labeling for Semi-supervised Learning from Video
Xiong, B., Fan, H., Grauman, K. L., & Feichtenhofer, C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00712 · Cited by 56 · see citing works
Shot Contrastive Self-Supervised Learning for Scene Boundary Detection
Chen, S., Nie, X., Fan, D., Zhang, D., Bhat, V., & Hamid, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00967 · Cited by 57 · see citing works
Contrast and Order Representations for Video Self-supervised Learning
Hu, K., Shao, J., Liu, Y., Raj, B., Savvides, M., & Shen, Z. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00784 · Cited by 55 · see citing works
Video Pose Distillation for Few-Shot, Fine-Grained Sports Action Recognition
Hong, J. W., Fisher, M., Gharbi, M., & Fatahalian, K. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00912 · Cited by 54 · see citing works
Wang, H., Ahn, E., & Kim, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20143 · Cited by 54 · see citing works
Boundary-sensitive Pre-training for Temporal Localization in Videos
Xu, M., Pérez-Rúa, J.-M., Escorcia, V. A., Martínez, B., Zhu, X., Zhang, L., Ghanem, B., & Xiang, T. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00713 · Cited by 54 · see citing works
On Compositions of Transformations in Contrastive Self-Supervised Learning
Patrick, M., Asano, Y. M., Kuznetsova, P., Fong, R., Henriques, J. F., Zweig, G., & Vedaldi, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00944 · Cited by 65 · see citing works
Time-Equivariant Contrastive Video Representation Learning
Jenni, S., & Jin, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00982 · Cited by 53 · see citing works
Vi<sup>2</sup>CLR: Video and Image for Visual Contrastive Learning of Representation
Diba, A., Sharma, V., Safdari, R., Lotfi, D., Sarfraz, M. S., Stiefelhagen, R., & Van Gool, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00153 · Cited by 53 · see citing works
Video Representation Learning with Visual Tempo ConsistencyPreprint
Yang, C., Xu, Y., Dai, B., & Zhou, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15489 · Cited by 64 · see citing works
Multi-view self-supervised learning on heterogeneous graphs for recommendation
Zhang, Y., Zhang, Y., Liao, W., Li, X., & Wang, X. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113056 · Cited by 52 · see citing works
Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendation
Qiu, R., Huang, Z. H., & Yin, H. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00063 · Cited by 51 · see citing works
An Improved Inter-Intra Contrastive Learning Framework on Self-Supervised Video Representation
Tao, L., Wang, X., & Yamasaki, T. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3141051 · Cited by 50 · see citing works
VideoLT: Large-scale Long-tailed Video Recognition
Zhang, X., Wu, Z., Weng, Z., Fu, H., Chen, J., Jiang, Y., & Davis, L. S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00786 · Cited by 50 · see citing works
Liu, D., Wang, T., Liu, S., Wang, R., Yao, S., & Abdelzaher, T. (2021) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn52240.2021.9522151 · Cited by 50 · see citing works
HyRSM++: Hybrid relation guided temporal set matching for few-shot action recognition
Wang, X., Zhang, S., Qing, Z., Zuo, Z., Gao, C., Jin, R., & Sang, N. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110110 · Cited by 47 · see citing works
ASCNet: Self-supervised Video Representation Learning with Appearance-Speed Consistency
Huang, D. Y., Wu, W., Hu, W.-W., Liu, X., He, D., Wu, Z., Wu, X., Tan, M., & Ding, E. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00799 · Cited by 46 · see citing works
Exploring Intra- and Inter-Video Relation for Surgical Semantic Scene Segmentation
Jin, Y., Yu, Y., Chen, C., Zhao, Z., Heng, P., & Stoyanov, D. V. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3177077 · Cited by 49 · see citing works
Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learning
Li, L.-L., Zhou, T.-F., Wang, W.-G., Yang, L., Li, J.-W., & Yang, Y. (2022) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52688.2022.00852 · Cited by 63 · see citing works
Region Embedding With Intra and Inter-View Contrastive Learning
Zhang, L., Long, C., & Cong, G. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3220874 · Cited by 54 · see citing works
Max-Margin Contrastive Learning
Shah, A., Sra, S., Chellappa, R., & Cherian, A. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20796 · Cited by 42 · see citing works
Self-Supervised Video Representation Learning with Meta-Contrastive Network
Lin, Y., Guo, X., & Lu, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00813 · Cited by 42 · see citing works
Masked Motion Encoding for Self-Supervised Video Representation Learning
Sun, X., Chen, P., Chen, L., Li, C., Li, T. H., Tan, M., & Gan, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00222 · Cited by 41 · see citing works
Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives
Hoffmann, D. T., Behrmann, N., Gall, J., Brox, T., & Noroozi, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19972 · Cited by 40 · see citing works
Zhu, Y., Shuai, H., Liu, G., & Liu, Q. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3169469 · Cited by 41 · see citing works
Dense Contrastive Learning for Self-Supervised Visual Pre-TrainingPreprint
Wang, X., Zhang, R., Shen, C., Kong, T., & Li, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.09157 · Cited by 38 · see citing works
Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimization
Qian, R., Li, Y., Liu, H., See, J., Ding, S., Liu, X., Li, D., & Lin, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00789 · Cited by 35 · see citing works
A Survey of Computer Vision Technologies in Urban and Controlled-environment Agriculture
Luo, J., Li, B., & Leung, C. (2023) · ACM Computing Surveys · doi:10.1145/3626186 · Cited by 36 · see citing works
Self-Supervised Point Cloud Representation Learning via Separating Mixed Shapes
Sun, C., Zheng, Z., Wang, X., Xu, M., & Yang, Y. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3206664 · Cited by 40 · see citing works
Neighbor-Guided Consistent and Contrastive Learning for Semi-Supervised Action Recognition
Wu, J., Sun, W., Gan, T., Ding, N., Jiang, F., Shen, J., & Nie, L. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3265261 · Cited by 34 · see citing works
SPARTAN: Self-supervised Spatiotemporal Transformers Approach to Group Activity Recognition
Chappa, N. V. S. R., Nguyen, P., Nelson, A., Seo, H., Li, X., Dobbs, P. D., & Luu, K. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00544 · Cited by 35 · see citing works
ODCR: Orthogonal Decoupling Contrastive Regularization for Unpaired Image Dehazing
Wang, Z., Zhao, H., Peng, J., Yao, L., & Zhao, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02407 · Cited by 32 · see citing works
Shi, X., Jin, Y., Dou, Q., & Heng, P. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102158 · Cited by 32 · see citing works
Motion-Focused Contrastive Learning of Video Representations
Li, R., Zhang, Y., Qiu, Z., Yao, T., Liu, D., & Mei, T. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00211 · Cited by 33 · see citing works
Khaertdinov, B., Asteriadis, S., & Ghaleb, E. (2022) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2022.3180591 · Cited by 33 · see citing works
Learning Sound Localization Better from Semantically Similar Samples
Senocak, A., Ryu, H., Kim, J., & Kweon, I. S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747867 · Cited by 31 · see citing works
SLIC: Self-Supervised Learning with Iterative Clustering for Human Action Videos
Khorasgani, S. H., Chen, Y., & Shkurti, F. (2022) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52688.2022.01562 · Cited by 34 · see citing works
Self-Supervised Visual Learning by Variable Playback Speeds Prediction of a Video
Cho, H., Kim, T., Chang, H. J., & Hwang, W. (2021) · IEEE Access · doi:10.1109/access.2021.3084840 · Cited by 52 · see citing works
Long Short View Feature Decomposition via Contrastive Video Representation Learning
Behrmann, N., Fayyaz, M., Gall, J., & Noroozi, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00911 · Cited by 30 · see citing works
Unsupervised Deraining: Where Asymmetric Contrastive Learning Meets Self-Similarity
Chang, Y., Guo, Y., Ye, Y., Yu, C., Zhu, L., Zhao, X.-L., Yan, L., & Tian, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3321311 · Cited by 29 · see citing works
Focalized contrastive view-invariant learning for self-supervised skeleton-based action recognition
Men, Q., Ho, E. S. L., Shum, H. P. H., & Leung, H. W. H. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.03.070 · Cited by 28 · see citing works
S3L: Spectrum Transformer for Self-Supervised Learning in Hyperspectral Image Classification
Guo, H., & Liu, W. (2024) · Remote Sensing · doi:10.3390/rs16060970 · Cited by 28 · see citing works
Contrastive Learning with Cross-Modal Knowledge Mining for Multimodal Human Activity Recognition
Brinzea, R., Khaertdinov, B., & Asteriadis, S. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892522 · Cited by 27 · see citing works
Contextualized Spatio-Temporal Contrastive Learning with Self-Supervision
Yuan, L., Qian, R., Cui, Y., Gong, B., Schroff, F., Yang, M., Adam, H., & Liu, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01359 · Cited by 27 · see citing works
VicTR: Video-conditioned Text Representations for Activity Recognition
Kahatapitiya, K., Arnab, A., Nagran, A., & Ryoo, M. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01755 · Cited by 26 · see citing works
ViewCLR: Learning Self-supervised Video Representation for Unseen Viewpoints
Das, S., & Ryoo, M. S. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00553 · Cited by 26 · see citing works
Enhanced bare-bones particle swarm optimization based evolving deep neural networks
Li, Z., Lim, C. P., & Liu, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120642 · Cited by 26 · see citing works
XKD: Cross-Modal Knowledge Distillation with Domain Alignment for Video Representation Learning
Sarkar, P., & Etemad, A. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i13.29407 · Cited by 26 · see citing works
See Your Emotion from Gait Using Unlabeled Skeleton Data
Lu, H., Hu, X., & Hu, B. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25272 · Cited by 26 · see citing works
Exploring Relations in Untrimmed Videos for Self-Supervised Learning
Luo, D., Zhou, Y., Fang, B., Zhou, Y., Wu, D., & Wang, W. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3473342 · Cited by 24 · see citing works
SCEHR: Supervised Contrastive Learning for Clinical Risk Prediction using Electronic Health Records
Zang, C., & Wang, F. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00097 · Cited by 25 · see citing works
- Authors
- Han, T., Xie, W., & Zisserman, A.
- Affiliations
- University of Oxford (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2010.09709
- OpenAlex
- W3094454579
- Cited by
- 292
- References
- 72
- Citations by year
- 2025: 22 · 2024: 31 · 2023: 79 · 2022: 74 · 2021: 81 · 2020: 4 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- self-supervised learning, video representation learning, co-training, InfoNCE, supervised contrastive learning, optical flow, human action recognition, video retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
