The DOI matches its Crossref record; 181 of the 181 references it cites were found in a registry or an index.
A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
Open accessAbstract
Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised learning (SSL), a subset of unsupervised learning, aims to learn discriminative features from unlabeled data without relying on human-annotated labels. SSL has garnered significant attention recently, leading to the development of numerous related algorithms. However, there is a dearth of comprehensive studies that elucidate the connections and evolution of different SSL variants. This paper presents a review of diverse SSL methods, encompassing algorithmic aspects, application domains, three key trends, and open research questions. First, we provide a detailed introduction to the motivations behind most SSL algorithms and compare their commonalities and differences. Second, we explore representative applications of SSL in domains such as image processing, computer vision, and natural language processing. Lastly, we discuss the three primary trends observed in SSL research and highlight the open questions that remain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“SSL demonstrates remarkable potential for uncovering subtle, previously unknown features within data, as well as for removing human subjectivity from the labeling process.”
From A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys (2026) · cites this paper as Gui et al. 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Masked Autoencoders Are Scalable Vision Learners
He, K., Chen, X., Xie, S., Li, Y., Dollar, P., & Girshick, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01553 · Cited by 8,489
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
Emerging Properties in Self-Supervised Vision Transformers
Caron, M., Touvron, H., Misra, I., Jegou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00951 · Cited by 5,638
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336
Hmdb: a large video database for human motion recognition
Kuehne, H., Jhuang, H., Garrote, E., Poggio, T., & Serre, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126543 · Cited by 3,965
Exploring Simple Siamese Representation Learning
Chen, X., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01549 · Cited by 3,725
Unsupervised Feature Learning via Non-parametric Instance Discrimination
Wu, Z., Xiong, Y., Yu, S. X., & Lin, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00393 · Cited by 3,664
Supervised Contrastive Learning
Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., & Krishnan, D. (2020) · arXiv · doi:10.48550/arxiv.2004.11362 · Cited by 3,569
Scene Parsing through ADE20K Dataset
Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., & Torralba, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.544 · Cited by 3,326
Zhang, R., Isola, P., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,178
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775
Swin Transformer V2: Scaling Up Capacity and Resolution
Liu, Z., Hu, H., Lin, Y., Yao, Z., Xie, Z., Wei, Y., Ning, J., Cao, Y., Zhang, Z., Dong, L., et al. (2021) · arXiv · doi:10.48550/arxiv.2111.09883 · Cited by 2,679
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
Unsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629
Swin Transformer V2: Scaling Up Capacity and Resolution
Liu, Z., Hu, H., Lin, Y., Yao, Z., Xie, Z., Wei, Y., Ning, J., Cao, Y., Zhang, Z., Dong, L., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01170 · Cited by 2,484
Unsupervised Representation Learning by Predicting Image Rotations
Gidaris, S., Singh, P., & Komodakis, N. (2018) · arXiv · doi:10.48550/arxiv.1803.07728 · Cited by 2,477 · cited 4×
“…The SS-GAN [144] is defined by combining the objective functions of GANs with the concept of rotation [7] L where V ( G, D ) represents the objective function of GANs as given in (18), and r ∼ R refers to a rotation selected from a set of possible rotations, similar to the concept presented in [7].”
BackgroundMethodInfluentialZero-shot text-to-image generation
Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., Chen, M., & Sutskever, I. (2021) · arXiv · doi:10.48550/arxiv.2102.12092 · Cited by 2,417
Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036
Tian, Y., Krishnan, D., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_45 · Cited by 1,997
Semantic Understanding of Scenes Through the ADE20K Dataset
Zhou, B., Zhao, H., Puig, X., Xiao, T., Fidler, S., Barriuso, A., & Torralba, A. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1140-0 · Cited by 1,831
An Empirical Study of Training Self-Supervised Vision Transformers
Chen, X., Xie, S., & He, K. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00950 · Cited by 1,648
The kinetics human action video dataset
Kay, W. (2024) · TIB Data Manager · doi:10.57702/jtuxnt5m · Cited by 1,646
Self-Supervised Learning of Pretext-Invariant Representations
Misra, I., & van der Maaten, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00674 · Cited by 1,435
Network Dissection: Quantifying Interpretability of Deep Visual Representations
Bau, D., Zhou, B., Khosla, A., Oliva, A., & Torralba, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.354 · Cited by 1,389
FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation
Yang, Y., Feng, C., Shen, Y., & Tian, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00029 · Cited by 1,313
GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose
Yin, Z., & Shi, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00212 · Cited by 1,256
SimMIM: a Simple Framework for Masked Image Modeling
Xie, Z., Zhang, Z., Cao, Y., Lin, Y., Bao, J., Yao, Z., Dai, Q., & Hu, H. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00943 · Cited by 1,255
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3130191 · Cited by 1,231
Self-citationVideoBERT: A Joint Model for Video and Language Representation Learning
Sun, C., Myers, A., Vondrick, C., Murphy, K., & Schmid, C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00756 · Cited by 1,172
Self-supervised Learning: Generative or Contrastive
Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., & Tang, J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090866 · Cited by 1,087
Self-citationSupersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047
Data-Efficient Image Recognition with Contrastive Predictive Coding
Hénaff, O. J., Srinivas, A., De Fauw, J., Razavi, A., Doersch, C., Eslami, S. M. A., & Oord, A. V. D. (2019) · arXiv · doi:10.48550/arxiv.1905.09272 · Cited by 1,014
AVA: A Video Dataset of Spatio-Temporally Localized Atomic Visual Actions
Gu, C., Sun, C., Ross, D. A., Vondrick, C., Pantofaru, C., Li, Y., Vijayanarasimhan, S., Toderici, G., Ricco, S., Sukthankar, R., et al. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00633 · Cited by 986
Learning Representations for Automatic Colorization
Larsson, G., Maire, M., & Shakhnarovich, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_35 · Cited by 946
Joint Unsupervised Learning of Deep Representations and Image Clusters
Yang, J., Parikh, D., & Batra, D. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.556 · Cited by 879
Exploring Plain Vision Transformer Backbones for Object Detection
Li, Y., Mao, H., Girshick, R., & He, K. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20077-9_17 · Cited by 809
Arandjelovic, R., & Zisserman, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.73 · Cited by 782
Shuffle and Learn: Unsupervised Learning Using Temporal Order Verification
Misra, I., Zitnick, C. L., & Hebert, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_32 · Cited by 779
Self-Supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation
Wang, Y., Zhang, J., Kan, M., Shan, S., & Chen, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01229 · Cited by 770
Self-citationDiscriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks
Dosovitskiy, A., Fischer, P., Springenberg, J. T., Riedmiller, M., & Brox, T. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2496141 · Cited by 762
S4L: Self-Supervised Semi-Supervised Learning
Zhai, X., Oliver, A., Kolesnikov, A., & Beyer, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00156 · Cited by 750
Revisiting Self-Supervised Visual Representation Learning
Kolesnikov, A., Zhai, X., & Beyer, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00202 · Cited by 675
Dense Contrastive Learning for Self-Supervised Visual Pre-Training
Wang, X., Zhang, R., Shen, C., Kong, T., & Li, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00304 · Cited by 660
Learning a Predictable and Generative Vector Representation for Objects
Girdhar, R., Fouhey, D. F., Rodriguez, M., & Gupta, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_29 · Cited by 646
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction
Zhang, R., Isola, P., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.76 · Cited by 616
Masked Autoencoders for Point Cloud Self-supervised Learning
Pang, Y., Wang, W., Tay, F. E. H., Liu, W., Tian, Y., & Yuan, L. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20086-1_35 · Cited by 605
Masked Feature Prediction for Self-Supervised Visual Pre-Training
Wei, C., Fan, H., Xie, S., Wu, C.-Y., Yuille, A., & Feichtenhofer, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01426 · Cited by 587
End-to-End Learning of Visual Representations From Uncurated Instructional Videos
Miech, A., Alayrac, J.-B., Smaira, L., Laptev, I., Sivic, J., & Zisserman, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00990 · Cited by 580
Real-time user-guided image colorization with learned deep priors
Zhang, R., Zhu, J.-Y., Isola, P., Geng, X., Lin, A. S., Yu, T., & Efros, A. A. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073703 · Cited by 569
Image as a Foreign Language: BEIT Pretraining for Vision and Vision-Language Tasks
Wang, W., Bao, H., Dong, L., Bjorck, J., Peng, Z., Liu, Q., Aggarwal, K., Mohammed, O. K., Singhal, S., Som, S., et al. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01838 · Cited by 561
Time-Contrastive Networks: Self-Supervised Learning from Video
Sermanet, P., Lynch, C., Chebotar, Y., Hsu, J., Jang, E., Schaal, S., Levine, S., & Brain, G. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8462891 · Cited by 546
Unsupervised Representation Learning by Sorting Sequences
Lee, H.-Y., Huang, J.-B., Singh, M., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.79 · Cited by 534
PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models
Menon, S., Damian, A., Hu, S., Ravi, N., & Rudin, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00251 · Cited by 532
Graph Self-Supervised Learning: A Survey
Liu, Y., Jin, M., Pan, S., Zhou, C., Zheng, Y., Xia, F., & Yu, P. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3172903 · Cited by 510
Look into Person: Self-Supervised Structure-Sensitive Learning and a New Benchmark for Human Parsing
Gong, K., Liang, X., Zhang, D., Shen, X., & Lin, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.715 · Cited by 506
Colorization as a Proxy Task for Visual Understanding
Larsson, G., Maire, M., & Shakhnarovich, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.96 · Cited by 458
Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images
Huang, T., Li, S., Jia, X., Lu, H., & Liu, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01454 · Cited by 448
GPT-GNN: Generative Pre-Training of Graph Neural Networks
Hu, Z., Dong, Y., Wang, K., Chang, K.-W., & Sun, Y. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403237 · Cited by 446
Learning Correspondence From the Cycle-Consistency of Time
Wang, X., Jabri, A., & Efros, A. A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00267 · Cited by 445
Spatiotemporal Contrastive Video Representation Learning
Qian, R., Meng, T., Gong, B., Yang, M.-H., Wang, H., Belongie, S., & Cui, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00689 · Cited by 443
Learning Features by Watching Objects Move
Pathak, D., Girshick, R., Dollar, P., Darrell, T., & Hariharan, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.638 · Cited by 436
Self-Supervised Video Representation Learning with Odd-One-Out Networks
Fernando, B., Bilen, H., Gavves, E., & Gould, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.607 · Cited by 421
RhythmNet: End-to-End Heart Rate Estimation From Face via Spatial-Temporal Representation
Niu, X., Shan, S., Han, H., & Chen, X. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2947204 · Cited by 420
Self-Supervised Spatiotemporal Learning via Video Clip Order Prediction
Xu, D., Xiao, J., Zhao, Z., Shao, J., Xie, D., & Zhuang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01058 · Cited by 415
Self-supervised learning for recommender systems: A survey
Yu, J., Yin, H., Xia, X., Chen, T., Li, J., & Huang, Z. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3282907 · Cited by 413
Self-citationBoosting Few-Shot Visual Learning With Self-Supervision
Gidaris, S., Bursuc, A., Komodakis, N., Perez, P. P., & Cord, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00815 · Cited by 409
Arandjelović, R., & Zisserman, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_27 · Cited by 403
Agrawal, P., Carreira, J., & Malik, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.13 · Cited by 395
Test-Time Training with Self-Supervision for Generalization under Distribution Shifts
Sun, Y., Wang, X., Liu, Z., Miller, J., Efros, A. A., & Hardt, M. (2019) · arXiv · doi:10.48550/arxiv.1909.13231 · Cited by 393
Video Representation Learning by Dense Predictive Coding
Han, T., Xie, W., & Zisserman, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00186 · Cited by 377
Xie, Z., Lin, Y., Zhang, Z., Cao, Y., Lin, S., & Hu, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01641 · Cited by 370
Look into Person: Joint Body Parsing & Pose Estimation Network and a New Benchmark
Liang, X., Gong, K., Shen, X., & Lin, L. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2820063 · Cited by 365
Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data
Manas, O., Lacoste, A., Giro-i-Nieto, X., Vazquez, D., & Rodriguez, P. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00928 · Cited by 354
Zhao, Y., Birdal, T., Deng, H., & Tombari, F. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00110 · Cited by 351
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
Giorgi, J., Nitski, O., Wang, B., & Bader, G. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.72 · Cited by 350
DetCo: Unsupervised Contrastive Learning for Object Detection
Xie, E., Ding, J., Wang, W., Zhan, X., Xu, H., Sun, P., Li, Z., & Luo, P. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00828 · Cited by 333
Scaling and Benchmarking Self-Supervised Visual Representation Learning
Goyal, P., Mahajan, D., Gupta, A., & Misra, I. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00649 · Cited by 330
Self-Supervised GANs via Auxiliary Rotation Loss
Chen, T., Zhai, X., Ritter, M., Lucic, M., & Houlsby, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01243 · Cited by 328
Self-citationRepresentation Learning by Learning to Count
Noroozi, M., Pirsiavash, H., & Favaro, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.628 · Cited by 324
Learning and Using the Arrow of Time
Wei, D., Lim, J., Zisserman, A., & Freeman, W. T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00840 · Cited by 315
Boosting Self-Supervised Learning via Knowledge Transfer
Noroozi, M., Vinjimoor, A., Favaro, P., & Pirsiavash, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00975 · Cited by 296
Self-supervised Co-training for Video Representation Learning
Han, T., Xie, W., & Zisserman, A. (2020) · arXiv · doi:10.48550/arxiv.2010.09709 · Cited by 292
Advancing Plain Vision Transformer Toward Remote Sensing Foundation Model
Wang, D., Zhang, Q., Xu, Y., Zhang, J., Du, B., Tao, D., & Zhang, L. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3222818 · Cited by 287
Self-citationICE: Inter-instance Contrastive Encoding for Unsupervised Person Re-identification
Chen, H., Lagadec, B., & Bremond, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01469 · Cited by 283
Contrastive Learning with Stronger Augmentations
Wang, X., & Qi, G.-J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3203630 · Cited by 266
Contrastive Learning with Stronger Augmentations
Wang, X., & Qi, G.-J. (2021) · arXiv · doi:10.48550/arxiv.2104.07713 · Cited by 266
Knowledge Distillation Meets Self-supervision
Xu, G., Liu, Z., Li, X., & Loy, C. C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_34 · Cited by 264
VConv-DAE: Deep Volumetric Shape Learning Without Object Labels
Sharma, A., Grau, O., & Fritz, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_20 · Cited by 254
Multiresolution Tree Networks for 3D Point Cloud Processing
Gadelha, M., Wang, R., & Maji, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_7 · Cited by 242
BEVT: BERT Pretraining of Video Transformers
Wang, R., Chen, D., Wu, Z., Chen, Y., Dai, X., Liu, M., Jiang, Y.-G., Zhou, L., & Yuan, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01432 · Cited by 234
SpeedNet: Learning the Speediness in Videos
Benaim, S., Ephrat, A., Lang, O., Mosseri, I., Freeman, W. T., Rubinstein, M., Irani, M., & Dekel, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00994 · Cited by 232
Vision-language navigation with self-supervised auxiliary reasoning tasks
Zhu, F., Zhu, Y., Chang, X., & Liang, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01003 · Cited by 223
A large-scale study on unsupervised spatiotemporal representation learning
Feichtenhofer, C., Fan, H., Xiong, B., Girshick, R., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00331 · Cited by 222
Learning Image Representations Tied to Ego-Motion
Jayaraman, D., & Grauman, K. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.166 · Cited by 213
Video-Based Remote Physiological Measurement via Cross-Verified Feature Disentangling
Niu, X., Yu, Z., Han, H., Li, X., Shan, S., & Zhao, G. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_18 · Cited by 213
Revealing the Dark Secrets of Masked Image Modeling
Xie, Z., Geng, Z., Hu, J., Zhang, Z., Hu, H., & Cao, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01391 · Cited by 211
Self-supervised Video Representation Learning by Pace Prediction
Wang, J., Jiao, J., & Liu, Y.-H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_30 · Cited by 210
Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning
Chen, T., Liu, S., Chang, S., Cheng, Y., Amini, L., & Wang, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00078 · Cited by 205
Self-citationMemory-Augmented Dense Predictive Coding for Video Representation Learning
Han, T., Xie, W., & Zisserman, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58580-8_19 · Cited by 202
Joint Generative and Contrastive Learning for Unsupervised Person Re-identification
Chen, H., Wang, Y., Lagadec, B., Dantcheva, A., & Bremond, F. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00204 · Cited by 196
A Theoretical Analysis of Contrastive Unsupervised Representation Learning
Arora, S., Khandeparkar, H., Khodak, M., Plevrakis, O., & Saunshi, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09229 · Cited by 191
Learning Classification with Unlabeled Data
de Sa, V. R. (1993) · Cited by 190
Cross-Domain Self-Supervised Multi-task Feature Learning Using Synthetic Imagery
Ren, Z., & Lee, Y. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00086 · Cited by 190
Hu, Q., Wang, X., Hu, W., & Qi, G.-J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00113 · Cited by 185
PointPWC-Net: Cost Volume on Point Clouds for (Self-)Supervised Scene Flow Estimation
Wu, W., Wang, Z. Y., Li, Z., Liu, W., & Fuxin, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58558-7_6 · Cited by 177
Video Cloze Procedure for Self-Supervised Spatio-Temporal Learning
Luo, D., Liu, C., Zhou, Y., Yang, D., Ma, C., Ye, Q., & Wang, W. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6840 · Cited by 174
Contrastive Masked Autoencoders are Stronger Vision Learners
Huang, Z., Jin, X., Lu, C., Hou, Q., Cheng, M.-M., Fu, D., Shen, X., & Feng, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3336525 · Cited by 174
Partially View-aligned Representation Learning with Noise-robust Contrastive Loss
Yang, M., Li, Y., Huang, Z., Liu, Z., Hu, P., & Peng, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00119 · Cited by 171
MAST: A Memory-Augmented Self-Supervised Tracker
Lai, Z., Lu, E., & Xie, W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00651 · Cited by 170
Transitive Invariance for Self-Supervised Visual Representation Learning
Wang, X., He, K., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.149 · Cited by 168
Video Playback Rate Perception for Self-Supervised Spatio-Temporal Representation Learning
Yao, Y., Liu, C., Luo, D., Zhou, Y., & Ye, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00658 · Cited by 168
Dense Optical Flow Prediction from a Static Image
Walker, J., Gupta, A., & Hebert, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.281 · Cited by 163
Rubik’s Cube+: A self-supervised feature learning framework for 3D medical image analysis
Zhu, J., Li, Y., Hu, Y., Ma, K., Zhou, S. K., & Zheng, Y. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101746 · Cited by 161
Self-Supervised Scene De-Occlusion
Zhan, X., Pan, X., Dai, B., Liu, Z., Lin, D., & Loy, C. C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00384 · Cited by 161
OmniMAE: Single Model Masked Pretraining on Images and Videos
Girdhar, R., El-Nouby, A., Singh, M., Alwala, K. V., Joulin, A., & Misra, I. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01003 · Cited by 158
Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cut
Wang, Y., Shen, X., Hu, S. X., Yuan, Y., Crowley, J. L., & Vaufreydaz, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01414 · Cited by 155
Self-supervised learning for videos: A survey
Schiappa, M. C., Rawat, Y. S., & Shah, M. (2023) · ACM Computing Surveys · doi:10.1145/3577925 · Cited by 155
Self-organization for object extraction using a multilayer neural network and fuzziness measures
Ghosh, A. K., Pal, N. R., & Pal, S. K. (1993) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.1993.390285 · Cited by 152
Siamese Image Modeling for Self-Supervised Vision Representation Learning
Tao, C., Zhu, X., Su, W., Huang, G. M., Li, B., Zhou, J., Qiao, Y., Wang, X., & Dai, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00212 · Cited by 147
Li, C., Tang, T., Wang, G., Peng, J., Wang, B., Liang, X., & Chang, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01206 · Cited by 141
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers
Dong, X., Bao, J., Zhang, T., Chen, D., Zhang, W., Yuan, L., Chen, D., Wen, F., Yu, N., & Guo, B. (2023) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v37i1.25130 · Cited by 141
Zhou, H.-Y., Lu, C., Yang, S., Han, X., & Yu, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00348 · Cited by 140
On Feature Decorrelation in Self-Supervised Learning
Hua, T., Wang, W., Xue, Z., Ren, S., Wang, Y., & Zhao, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00946 · Cited by 140
Video Jigsaw: Unsupervised Learning of Spatiotemporal Context for Video Action Recognition
Ahsan, U., Madhok, R., & Essa, I. A. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00025 · Cited by 136
Broaden Your Views for Self-Supervised Video Learning
Recasens, A., Luc, P., Alayrac, J.-B., Wang, L., Strub, F., Tallec, C., Malinowski, M., Pătrăucean, V., Altché, F., Valko, M., et al. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00129 · Cited by 135
DynamoNet: Dynamic Action and Motion Network
Diba, A., Sharma, V., Gool, L. V., & Stiefelhagen, R. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00629 · Cited by 130
A Broad Study on the Transferability of Visual Representations with Contrastive Learning
Islam, A., Chen, C.-F., Panda, R., Karlinsky, L., Radke, R. J., & Feris, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00872 · Cited by 130
Instance Localization for Self-supervised Detection Pretraining
Yang, C., Wu, Z., Zhou, B., & Lin, S. C.-F. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00398 · Cited by 130
Improvements to Context Based Self-Supervised Learning
Mundhenk, T. N., Ho, D., & Chen, B. Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00973 · Cited by 123
Improving Spatiotemporal Self-supervision by Deep Reinforcement Learning
Büchler, U., Brattoli, B., & Ommer, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_47 · Cited by 123
Learning from Noisy Data with Robust Representation Learning
Li, J., Xiong, C., & Hoi, S. C. H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00935 · Cited by 123
Self-Supervised Learning of Visual Features through Embedding Images into Text Topic Spaces
Gómez, L., Patel, Y., Rusiñol, M., Karatzas, D., & Jawahar, C. V. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.218 · Cited by 109
Unsupervised Learning of Edges
Li, Y., Paluri, M., Rehg, J. M., & Dollár, P. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.179 · Cited by 107
3D Human Pose Machines with Self-supervised Learning
Wang, K., Lin, L., Jiang, C., Qian, C., & Wei, P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2892452 · Cited by 104
A Practical Contrastive Learning Framework for Single-Image Super-Resolution
Wu, G., Jiang, J., & Liu, X. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3290038 · Cited by 104
Improving Contrastive Learning by Visualizing Feature Transformation
Zhu, R., Zhao, B., Liu, J., Sun, Z., & Chen, C. W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01014 · Cited by 99
Self-citationTowards Discriminative Representation Learning for Unsupervised Person Re-identification
Isobe, T., Li, D., Tian, L., Chen, W., Shan, Y., & Wang, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00841 · Cited by 99
Free Supervision from Video Games
Krähenbühl, P. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00312 · Cited by 97
Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognition
Yang, M., Liao, M., Lu, P., Wang, J., Zhu, S., Luo, H., Tian, Q. C., & Bai, X. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547784 · Cited by 95
Self-citationZhang, L., & Zhu, Z. (2019) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2019.00051 · Cited by 92
On Data Scaling in Masked Image Modeling
Xie, Z., Zhang, Z., Cao, Y., Lin, Y., Wei, Y., Dai, Q., & Hu, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00999 · Cited by 91
Self-Supervised Deep Visual Odometry With Online Adaptation
Li, S., Wang, X., Cao, Y., Xue, F., Yan, Z., & Zha, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00637 · Cited by 90
MeshMAE: Masked Autoencoders for 3D Mesh Data Analysis
Liang, Y., Zhao, S., Yu, B., Zhang, J., & He, F. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20062-5_3 · Cited by 90
Self-citationGILE: A Generalized Input-Label Embedding for Text Classification
Pappas, N., & Henderson, J. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00259 · Cited by 88
Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework
Tao, C., Wang, H., Zhu, X., Dong, J., Song, S., Huang, G. M., & Dai, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01403 · Cited by 88
Understanding Masked Image Modeling via Learning Occlusion Invariant Feature
Kong, X., & Zhang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00604 · Cited by 79
Self-Supervised Learning of Video-Induced Visual Invariances
Tschannen, M., Djolonga, J., Ritter, M., Mahendran, A., Houlsby, N., Gelly, S., & Lučić, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01382 · Cited by 76
Self-supervised Video Representation Learning by Context and Motion Decoupling
Huang, L., Yu, L., Wang, B., Pan, P., Xu, Y., & Jin, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01367 · Cited by 76
Contrast and Order Representations for Video Self-supervised Learning
Hu, K., Shao, J., Liu, Y., Raj, B., Savvides, M., & Shen, Z. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00784 · Cited by 74
Pre-Training Transformers as Energy-Based Cloze Models
Clark, K., Luong, M.-T., Le, Q. V., & Manning, C. D. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.20 · Cited by 70
SdAE: Self-distillated Masked Autoencoder
Chen, Y., Liu, Y., Jiang, D., Zhang, X., Dai, W., Xiong, H., & Tian, Q. C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20056-4_7 · Cited by 70
Task Programming: Learning Data Efficient Behavior Representations
Sun, J. J., Kennedy, A., Zhan, E., Anderson, D. J., Yue, Y., & Perona, P. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00290 · Cited by 69
Enhancing Unsupervised Video Representation Learning by Decoupling the Scene and the Motion
Wang, J., Gao, Y., Li, K., Hu, J., Jiang, X., Guo, X., Ji, R., & Sun, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17215 · Cited by 64
Unsupervised Visual Representation Learning by Graph-Based Consistent Constraints
Li, D., Hung, W.-C., Huang, J., Wang, S., Ahuja, N., & Yang, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46493-0_41 · Cited by 61
Unsupervised Learning from Video to Detect Foreground Objects in Single Images
Croitoru, I., Bogolin, S.-V., & Leordeanu, M. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.465 · Cited by 60
Self-Supervised Video Representation Learning with Meta-Contrastive Network
Lin, Y., Guo, X., & Lu, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00813 · Cited by 57
Self-Supervised Learning via Conditional Motion Propagation
Zhan, X., Pan, X., Liu, Z., Lin, D., & Loy, C. C. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00198 · Cited by 53
Realistic Face Reenactment via Self-Supervised Disentangling of Identity and Pose
Zeng, X., Pan, Y., Wang, M., Zhang, J., & Liu, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6970 · Cited by 50
Self-citationGood Helper Is around You: Attention-Driven Masked Image Modeling
Liu, Z., Gui, J., & Luo, H. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25269 · Cited by 50
Self-citationOnline Depth Learning Against Forgetting in Monocular Videos
Zhang, Z., Lathuilière, S., Ricci, E., Sebe, N., Yan, Y., & Yang, J. J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00455 · Cited by 49
Distilling Localization for Self-Supervised Representation Learning
Zhao, N., Wu, Z., Lau, R. W. H., & Lin, S. C.-F. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17312 · Cited by 49
Temporally Coherent Embeddings for Self-Supervised Video Representation Learning
Knights, J., Harwood, B., Ward, D., Vanderkop, A., Mackenzie-Ross, O., & Moghadam, P. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412071 · Cited by 46
Conditional Self-Supervised Learning for Few-Shot Classification
An, Y., Xue, H., Zhao, X., & Zhang, L. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/295 · Cited by 45
MimCo: Masked Image Modeling Pre-training with Contrastive Teacher
Zhou, Q., Yu, C., Luo, H., Wang, Z., & Li, H. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548173 · Cited by 37
Self-citationSelf-supervised learning for fair recommender systems
Liu, H., Lin, H., Fan, W., Ren, Y., Xu, B., Zhang, X., Wen, D., Zhao, N., Lin, Y., & Yang, L. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109126 · Cited by 28
RePre: Improving Self-Supervised Vision Transformer with Reconstructive Pre-training
Wang, L., Liang, F., Li, Y., Zhang, H., Ouyang, W., & Shao, J. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/200 · Cited by 28
Learn from Unlabeled Videos for Near-duplicate Video Retrieval
He, X., Pan, Y., Tang, M., Lv, Y., & Peng, Y. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3532010 · Cited by 21
RegionCL: Exploring Contrastive Region Pairs for Self-supervised Representation Learning
Xu, Y., Zhang, Q., Zhang, J., & Tao, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19827-4_28 · Cited by 20
Self-citationSpeech2Action: Cross-Modal Supervision for Action Recognition
Nagrani, A., Sun, C., Ross, D., Sukthankar, R., Schmid, C., & Zisserman, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01033 · Cited by 12
Video Representation Learning with Graph Contrastive Augmentation
Zhang, J., Xu, X., Shen, F., Yao, Y., Shao, J., & Zhu, X. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475510 · Cited by 6
Self-citationAggNet for Self-supervised Monocular Depth Estimation: Go An Aggressive Step Furthe
Chen, Z., Ye, X., Du, L., Yang, W., Huang, L., Tan, X., Shi, Z., Shen, F., & Ding, E. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475287 · Cited by 6
Cited by
A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
Mienye, I. D., & Swart, T. G. (2024) · Information · doi:10.3390/info15120755 · Cited by 330
Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects
Zhang, K., Wen, Q., Zhang, C., Cai, R., Jin, M., Liu, Y., Zhang, J. Y., Liang, Y., Pang, G., Song, D., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3387317 · Cited by 295
Self-citationHila, A. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02426-3 · Cited by 14
Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges
Liu, P., Tao, Q., & Zhou, J. T. (2024) · arXiv · doi:10.48550/arxiv.2406.06965 · Cited by 6
A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys
Luo, Y., Myers, A. D., Drlica-Wagner, A., Dematties, D., Borchani, S., Valdes, F., Dey, A., Schlegel, D., Zhou, R., & DESI Legacy Imaging Surveys Team (2026) · The Open Journal of Astrophysics · doi:10.33232/001c.158430 · Cited by 1
Metadata
- Authors
- Gui, J., Chen, T., Zhang, J., Cao, Q., Sun, Z., Luo, H., & Tao, D.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024-12
- Volume
- 46
- Issue
- 12
- Pages
- 9052-9071
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4399728346
- Cited by
- 552
- References
- 181
- FWCI
- 81.85
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.