The DOI matches its DataCite record; 53 of the 53 references it cites were found in a registry or an index.
Representation Learning with Contrastive Predictive Coding
Open accessAbstract
While supervised learning has enabled great progress in many applications, unsupervised learning has not seen such widespread adoption, and remains an important and challenging endeavor for artificial intelligence. In this work, we propose a universal unsupervised learning approach to extract useful representations from high-dimensional data, which we call Contrastive Predictive Coding. The key insight of our model is to learn such representations by predicting the future in latent space by using powerful autoregressive models. We use a probabilistic contrastive loss which induces the latent space to capture information that is maximally useful to predict future samples. It also makes the model tractable by using negative sampling. While most prior work has focused on evaluating representations for a particular modality, we demonstrate that our approach is able to learn useful representations achieving strong performance on four distinct domains: speech, images, text and reinforcement learning in 3D environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, Contrastive Predictive Coding (CPC) [80,143] utilizes a contrastive future prediction task, and it was found that predicting one or two timesteps in the future is (too) easy and results in poor performance, whereas predicting multiple timesteps into the future is much more complex, and leads to very effective representations.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [143]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Using this contrastive loss, self-supervised networks learn to make the representations similar for positive pairs, and dissimilar for negative pairs, and hence are able to cluster similar (or positive) samples together and push apart dissimilar (or negative) samples.”
From Detecting galaxy tidal features using self-supervised representation learning (2024) · cites this paper as Oord et al. 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It means that InfoNCE loss maximizes the agreement of two different augmented sequences' representations from the same sequence while minimizing the agreement with other negative sequences.”
From Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-Supervised Action Recognition (2022) · cites this paper as Oord, Li, and Vinyals 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We introduce the Contrastive Predictive Coding (CPC) framework to human activity recognition, which captures the long-term temporal structure of sensor data streams.”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [58]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As mentioned in [58], either 𝑐 𝑡 (the output of 𝑔 𝑒𝑛𝑐 ) or 𝑧 𝑡 (the output of 𝑔 𝑎𝑟 ) can be utilized as the representation.”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [58]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The framework for data augmentation and batch formation plays a critical role in multi-view similarity learning [12,16,44,115], where we start by following the popular SimCLR [16] method.”
From MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain (2024) · cites this paper as [16]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“We note that this is a common setting for self-supervised contrastive learners with NCE objectives (Gutmann & Hyvärinen, 2010;Oord et al., 2018), including SimCLR (Chen et al., 2020) and SimCSE (Gao et al., 2021).”
From The Platonic Representation Hypothesis (2024) · cites this paper as Oord et al., 2018
The cited source says what the claim attributes to it.
In the citing paper
“The key insight behind this approach is that predicting just the next future timestep involves exploiting the local smoothness of the signal, whereas predicting multiple subsequent timesteps requires inferring the global structure of time-series data.”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“Haresamudram et al. [80] adapted Contrastive Predictive Coding (CPC [143]) for HAR, emphasizing the importance of temporal structure in sensor data representation.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as [143]
The cited source says what the claim attributes to it.
In the citing paper
“Contrastive predictive coding (CPC) proposed by [109] provides a contrastive learning framework to perform the prediction task using InfoNCE loss.”
From Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects (2024) · cites this paper as [109]
The cited source says what the claim attributes to it.
In the citing paper
“It can be seen that CPC does not directly predict future observations x t + k . Instead, it tries to preserve the mutual information of c t and x t + k .”
From Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects (2024) · cites this paper as [109]
The cited source says what the claim attributes to it.
In the citing paper
“This contrastive loss, or InfoNCE loss (Oord et al. 2018), is minimised when the similarity is high for positive pairs and low for negative pairs.”
From Detecting galaxy tidal features using self-supervised representation learning (2024) · cites this paper as Oord et al. 2018
The cited source says what the claim attributes to it.
In the citing paper
“To evaluate the performance of our TS-TCC model, we follow the standard linear benchmarking evaluation scheme [Oord et al. , 2018; Chen et al. , 2020]. Particularly, we train a linear classifier (single MLP layer) on top of a frozen self-supervised pretrained encoder model.”
From Time-Series Representation Learning via Temporal and Contextual Contrasting (2021) · cites this paper as Oord et al. , 2018
The cited source says what the claim attributes to it.
In the citing paper
“Contrastive-based methods usually use a contrastive similarity metric, such as InfoNCE loss [109].”
From Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects (2024) · cites this paper as [109]
The cited source says what the claim attributes to it.
In the citing paper
“This results in representations that encode the high-level information between temporally separated parts of the time-series signal [58], thereby leading to improved downstream recognition performance.”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“Contrastive Predictive Coding (CPC) [58], which is the focus of this work, performs contrastive learning over multiple future timestep predictions.”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“This framework has resulted in excellent representation learning performance across domains such as computer vision [12, 33, 35], natural language [49], speech recognition [6, 58] and time-series data [39].”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“If extra context from the past is useful for classification, then 𝑐 𝑡 can be used; else 𝑧 𝑡 may be more effective.”
From Contrastive Predictive Coding for Human Activity Recognition (2021) · cites this paper as [58]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“SimCLR aims to maximize the learned representation similarity between augmented views of the same input.”
From MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain (2024) · cites this paper as [16]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 1×
“More recent advancements in autoregressive modeling such as masked convolutional architectures [18, 19] or self-attention networks [20] could help improve results further.”
BackgroundImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“These techniques made manually specified features largely redundant and have greatly improved state-of-the-art in several real-world applications [1, 2, 3].”
MethodAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“We use the Adam optimizer [32] with a learning rate of 2e-4, and use 8 GPUs each with a minibatch of 8 examples from which the negative samples in the contrastive loss are drawn.”
MethodImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 1×
“In our visual representation experiments we use the ILSVRC ImageNet competition dataset [34].”
MethodBatch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“We did not use Batch-Norm [38].”
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · cited 2×
“In Word2Vec [9] neighbouring words are predicted using a contrastive loss.”
BackgroundLearning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“These techniques made manually specified features largely redundant and have greatly improved state-of-the-art in several real-world applications [1, 2, 3].”
BackgroundSelf-citationFaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267 · cited 1×
“For example, the techniques proposed by [21, 22, 23] were based on triplet losses using a max-margin approach to separate positive from negative examples.”
MethodLayer NormalizationPreprint
Ba, J., Kiros, J., & Hinton, G. E. (2016) · arXiv.org · doi:10.48550/arxiv.1607.06450 · Cited by 13,762 · cited 1×
“[41] is the same skip-thought model with layer normalization trained for 1M iterations. evaluate with 10-fold cross-validation for MR, CR, Subj, MPQA and use the train/test split for TREC.”
Method
Research works printed but not linked: 4
- [12][12] Michael Gutmann and Aapo Hyvärinen. Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics , pages 297-304, 2010. -
- [31][31] Daniel Povey, Arnab Ghoshal, Gilles Boulianne, Lukas Burget, Ondrej Glembek, Nagendra Goel, Mirko Hannemann, Petr Motlicek, Yanmin Qian, Petr Schwarz, et al. The kaldi speech recognition toolkit. In IEEE 2011 workshop on automatic speech recognition and understanding . IEEE Signal Processing Society, 2011. -
- [33][33] Laurens van der Maaten and Geoffrey Hinton. Visualizing data using t-sne. Journal of machine learning research , 9(Nov):2579-2605, 2008. -
- [48][48] Sida Wang and Christopher D. Manning. Baselines and bigrams: Simple, good sentiment and topic classification. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers - Volume 2 , ACL '12, pages 90-94, 2012. -
Cited by
Sorted by citations
Items 701–800 of 1,066
Locally Linear Unbiased Randomization Network for Cross-Scene Hyperspectral Image Classification
Zhao, H., Zhang, J., Lin, L., Wang, J., Gao, S., & Zhang, Z. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3321347 · Cited by 75
Qian, S., Xue, D., Fang, Q., & Xu, C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3188547 · Cited by 68
“Among the existing MI estimators, the InfoNCE [57] lower bound provides a low-variance estimation of MI for high dimensional data, albeit being biased [58].”
MethodMulti-Task Momentum Distillation for Multimodal Sentiment Analysis
Lin, R., & Hu, H. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3282410 · Cited by 75
“Following CPC [67] and SupCon [65], we maximize a lower bound on MI ( T, S ) by minimizing the InfoNCE loss, which is defined as: where D ( S ) contains | D k ( S ) | positive sample S in the same sentiment classes and | D ( S ) \ D k ( S ) | negative samples drawn from the proposal distribution of…”
MethodSelf-Supervised Intra-Modal and Cross-Modal Contrastive Learning for Point Cloud Understanding
Wu, Y., Liu, J., Gong, M., Gong, P., Fan, X., Qin, A. K., Miao, Q., & Ma, W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3284591 · Cited by 75
AstroCLIP: a cross-modal foundation model for galaxies
Parker, L., Lanusse, F., Golkar, S., Sarra, L., Cranmer, M., Bietti, A., Eickenberg, M., Krawezik, G. P., McCabe, M., Morel, R., et al. (2024) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stae1450 · Cited by 134
Variational Positive-Incentive Noise: How Noise Benefits Models
Zhang, H., Huang, S., Guo, Y., & Li, X. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3575295 · Cited by 103
Revisiting Self-Supervised Visual Representation LearningPreprint
Kolesnikov, A., Zhai, X., & Beyer, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09005 · Cited by 96
GPT-GNN: Generative Pre-Training of Graph Neural NetworksPreprint
Hu, Z., Dong, Y., Wang, K., Chang, K.-W., & Sun, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15437 · Cited by 84
A Framework For Contrastive Self-Supervised Learning And Designing A New ApproachPreprint
Falcon, W., & Cho, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.00104 · Cited by 112
Liu, J., Capurro, D., Nguyen, A., & Verspoor, K. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104466 · Cited by 66
Self-supervised representation learning from electroencephalography signals
Banville, H. J., Albuquerque, I., Hyvärinen, A., Moffat, G., Engemann, D. A., & Gramfort, A. (2019) · HAL · Cited by 71
Personalized Trajectory Prediction via Distribution Discrimination
Chen, G., Li, J., Zhou, N., Ren, L., & Lu, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01529 · Cited by 65
Sequential Recommendation with Multiple Contrast Signals
Wang, C., Ma, W., Chen, C., Zhang, M., Liu, Y., & Ma, S. (2022) · ACM Transactions on Information Systems · doi:10.1145/3522673 · Cited by 72
CLEAR: Cluster-Enhanced Contrast for Self-Supervised Graph Representation Learning
Luo, X., Ju, W., Qu, M., Gu, Y., Chen, C., Deng, M., Hua, X., & Zhang, M. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3177775 · Cited by 66
Adversarial Unsupervised Domain Adaptation for Hand Gesture Recognition Using Thermal Images
Dayal, A., Aishwarya, M., Abhilash, S. K., Mohan, C. K., Kumar, A., & Cenkeramaddi, L. R. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3235379 · Cited by 71
“Apart from this, there are several contrastive loss-based learning methods that force the representation of similar images to be closer and dissimilar images to be far [37], [38].”
BackgroundYu, Y., Liu, Q., Wu, L., Yu, R., Yu, S. L., & Zhang, Z. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25611 · Cited by 70
Self-supervised Graph-level Representation Learning with Adversarial Contrastive Learning
Luo, X., Ju, W., Gu, Y., Mao, Z., Liu, L., Yuan, Y., & Zhang, M. (2023) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3624018 · Cited by 68
“To maximize the similarity between each positive pair {z� , z ′ � } in comparison to a bank of negative samples N = { n� | � = 1, · · · , � } , the noisecontrastive estimation loss [52] adopted is a softmax form:”
MethodUnsupervised Feature Learning to Improve Transferability of Landslide Susceptibility Representations
Zhu, Q., Chen, L., Hu, H., Pirasteh, S., Li, H., & Xie, X. H. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3006192 · Cited by 68
Lee, K. S., Tran, N.-T., & Cheung, N. M. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00399 · Cited by 68
Contrastive Learning of Structured World ModelsPreprint
Kipf, T., van der Pol, E., & Welling, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.12247 · Cited by 180
A Good Image Generator Is What You Need for High-Resolution Video Synthesis
Tian, Y., Ren, J., Chai, M., Olszewski, K., Peng, X., Metaxas, D. N., & Tulyakov, S. (2021) · arXiv · doi:10.48550/arxiv.2104.15069 · Cited by 88
Solving Inefficiency of Self-supervised Representation Learning
Wang, G., Wang, K., Wang, G., Torr, P. H. S., & Lin, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00937 · Cited by 65
Are Labels Necessary for Neural Architecture Search?
Liu, C., Dollár, P., He, K., Girshick, R., Yuille, A., & Xie, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58548-8_46 · Cited by 72
Xia, W., Zhang, C., Weng, C., Yu, M., & Yu, D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414973 · Cited by 70
Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination
Wang, X., Liu, Z., & Yu, S. X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01240 · Cited by 86
Self-supervised Video Representation Learning by Context and Motion Decoupling
Huang, L., Yu, L., Wang, B., Pan, P., Xu, Y., & Jin, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01367 · Cited by 63
On Representation Knowledge Distillation for Graph Neural Networks
Joshi, C. K., Liu, F., Xun, X., Lin, J., & Foo, C.-S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3223018 · Cited by 81
Speaker Normalization for Self-Supervised Speech Emotion Recognition
Gat, I., Aronowitz, H., Zhu, W., Morais, E. D. S., & Hoory, R. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747460 · Cited by 69
Multi-Centroid Representation Network for Domain Adaptive Person Re-ID
Wu, Y., Huang, T., Yao, H., Zhang, C., Shao, Y., Han, C., Gao, C., & Sang, N. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20178 · Cited by 70
Self-Supervised Material and Texture Representation Learning for Remote Sensing Tasks
Akiva, P., Purri, M., & Leotta, M. J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00803 · Cited by 75
Bai, L., Du, S., Zhang, X., Wang, H., Liu, B., & Ouyang, S. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3198972 · Cited by 66
BYOL for Audio: Exploring Pre-Trained General-Purpose Audio Representations
Niizumi, D., Takeuchi, D., Ohishi, Y., Harada, N., & Kashino, K. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3221007 · Cited by 84
Hyperspectral Image Classification With Contrastive Graph Convolutional Network
Yu, W., Wan, S., Li, G., Yang, J. J., & Gong, C. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3240721 · Cited by 64
Hierarchical Contrast for Unsupervised Skeleton-Based Action Representation Learning
Dong, J., Sun, S., Liu, Z., Chen, S., Liu, B., & Wang, X. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25127 · Cited by 66
Chen, X., Yang, R., Xue, Y., Song, B., & Wang, Z. (2024) · Control Engineering Practice · doi:10.1016/j.conengprac.2024.105900 · Cited by 66
AVLTrack: Dynamic Sparse Learning for Aerial Vision-Language Tracking
Xue, Y., Zhong, B., Jin, G., Shen, T., Tan, L., Li, N., & Zheng, Y. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3549953 · Cited by 68
“We employ the weighted focal loss [45] as classification loss L cls , L 1 loss, and GIoU loss [46] as regression loss L reg , and InfoNCE loss [47] as modal alignment loss L ma .”
Contrastive Learning of Structured World Models
Kipf, T., van der Pol, E., & Welling, M. (2020) · Data Archiving and Networked Services (DANS) · Cited by 63
On Learning Universal Representations Across LanguagesPreprint
Wei, X., Weng, R., Hu, Y., Xing, L., Yu, H., & Luo, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.15960 · Cited by 70
Wang, P., Wen, J., Si, C., Qian, Y., & Wang, L. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3207577 · Cited by 70
Wang, S., Yang, C., & Chen, L. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms26146799 · Cited by 65
Learning to Anticipate Egocentric Actions by Imagination
Wu, Y., Zhu, L., Wang, X., Yang, Y., & Wu, F. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3040521 · Cited by 70
Semi-Supervised Contrastive Learning With Similarity Co-Calibration
Zhang, Y., Zhang, X., Li, J., Qiu, R. C., Xu, H., & Tian, Q. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3158069 · Cited by 67
Home Action Genome: Cooperative Compositional Action Understanding
Rai, N., Chen, H., Ji, J., Desai, R., Kozuka, K., Ishizaka, S., Adeli, E., & Niebles, J. C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01103 · Cited by 68
Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation
Yan, A., He, Z., Lü, X., Jiang, D., Chang, E., Gentili, A., McAuley, J., & Hsu, C. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.336 · Cited by 79
Modeling Two-Way Selection Preference for Person-Job Fit
Chen, Y., Hou, Y., Song, Y., Zhang, T., Wen, J.-R., & Zhao, W. X. (2022) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3523227.3546752 · Cited by 82
Unsupervised graph-level representation learning with hierarchical contrasts
Ju, W., Gu, Y., Luo, X., Wang, Y., Yuan, H., Zhong, H., & Zhang, M. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.11.019 · Cited by 66
Automated Spatio-Temporal Graph Contrastive Learning
Zhang, Q., Huang, C., Xia, L., Wang, Z., Li, Z., & Yiu, S. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583304 · Cited by 71
“where L denotes the self-supervised loss, which is composed of two terms: the InfoNCE loss [16] LNCE, and the Information BottleNeck (InfoBN) LBN.”
CLIP goes 3D: Leveraging Prompt Tuning for Language Grounded 3D Recognition
Hegde, D., Valanarasu, J. M. J., & Patel, V. M. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00217 · Cited by 87
“The contrastive losses (InfoNCE objective [41]) between 3D-image features; and 3D-text features are defined by:”
BackgroundmT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs
Chi, Z., Dong, L., Ma, S., Huang, S., Singhal, S., Mao, X.-L., Huang, H., Song, X., & Wei, F. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.125 · Cited by 67
Improving Weakly Supervised Visual Grounding by Contrastive Knowledge Distillation
Wang, L., Huang, J. L., Li, Y., Xu, K., Yang, Z., & Yu, D. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01387 · Cited by 75
Self-citationCao, Z., Li, X., Feng, Y., Chen, S., Xia, C., & Zhao, L. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.015 · Cited by 64
Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwriting
Bhunia, A. K., Chowdhury, P. N., Yang, Y., Hospedales, T. M., Xiang, T., & Song, Y.-Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00562 · Cited by 65
Distilling Holistic Knowledge with Graph Neural Networks
Zhou, S., Wang, Y., Chen, D., Chen, J., Wang, X., Wang, C., & Bu, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01022 · Cited by 72
Interpolation-Based Contrastive Learning for Few-Label Semi-Supervised Learning
Yang, X., Hu, X., Zhou, S., Liu, X., & Zhu, E. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3186512 · Cited by 63
Superpixel Contracted Neighborhood Contrastive Subspace Clustering Network for Hyperspectral Images
Cai, Y., Zhang, Z., Ghamisi, P., et al. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3179637 · Cited by 63
Lattice Network for Lightweight Image Restoration
Luo, X., Qu, Y., Xie, Y., Zhang, Y., Li, C., & Fu, Y. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3194090 · Cited by 71
“The InfoNCE loss [47] is usually used to pull in the anchor and the positive sample and push away the anchor and the negative sample.”
Offline-Online Associated Camera-Aware Proxies for Unsupervised Person Re-Identification
Wang, M., Li, J., Lai, B., Gong, X., & Hua, X. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3213193 · Cited by 66
LogEncoder: Log-Based Contrastive Representation Learning for Anomaly Detection
Qi, J., Luan, Z., Huang, S., Fung, C., Yang, H., Li, H., Zhu, D., & Qian, D. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3239522 · Cited by 69
“According to previous research [28], it can significantly improve downstream tasks, including anomaly detection.”
BackgroundMethodResultGeneralized Parametric Contrastive Learning
Cui, J., Zhong, Z., Tian, Z., Liu, S., Yu, B., & Jia, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3278694 · Cited by 79
“An effective contrastive loss function, called InfoNCE [53], is where q is a query representation, k + is for the positive (similar) key sample, and { k − } denotes negative (dissimilar) key samples. τ is a temperature hyper-parameter.”
BackgroundContraBERT: Enhancing Code Pre-trained Models via Contrastive Learning
Liu, S., Wu, B., Xie, X., Meng, G., & Liu, Y. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00207 · Cited by 90
“InfoNCE tries to classify the query vector q into its similar sample k + and pushes it away from dissimilar samples in the set K .”
InfluentialZeng, Q., Xie, Y., Lu, Z., & Xia, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01504 · Cited by 68
“And in this work, we adopt the InfoNCE loss [26] to help hθ learn more universal representation on Dl ∪ Du, instead of only focusing on the Dl.”
MethodHalvagal, M. S., & Zenke, F. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01460-y · Cited by 76
“Together, these results suggest that LPL’s combination of Hebbian, predictive and In SSL, the two most common causes for failure to disentangle representations are representational and dimensional collapse (Supplementary Fig.”
BackgroundInfluentialA systematic review of generalization research in medical image classification
Matta, S. C., Lamard, M., Zhang, P., Guilcher, A. L., Borderie, L., Cochener, B., & Quellec, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109256 · Cited by 83
“The network was optimized using an extended version of InfoNCE loss [138].”
MethodContrastive Representation DistillationPreprint
Tian, Y., Krishnan, D., & Isola, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.10699 · Cited by 1,079
Decoupling Representation Learning from Reinforcement Learning
Stooke, A., Lee, K., Abbeel, P., & Laskin, M. (2020) · arXiv · doi:10.48550/arxiv.2009.08319 · Cited by 123
Intriguing Properties of Contrastive LossesPreprint
Chen, T., Luo, C., & Li, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02803 · Cited by 71
Partial success in closing the gap between human and machine vision
Geirhos, R., Narayanappa, K., Mitzkus, B., Thieringer, T., Bethge, M., Wichmann, F. A., & Brendel, W. (2021) · arXiv · doi:10.48550/arxiv.2106.07411 · Cited by 129
Self-Supervised Learning of Video-Induced Visual Invariances
Tschannen, M., Djolonga, J., Ritter, M., Mahendran, A., Houlsby, N., Gelly, S., & Lučić, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01382 · Cited by 63
Spatial Contrastive Learning for Few-Shot Classification
Ouali, Y., Hudelot, C., & Tami, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86486-6_41 · Cited by 68
Investigating Self-Supervised Learning for Speech Enhancement and Separation
Huang, Z., Watanabe, S., Yang, S.-W., Garcia, L. P., & Khudanpur, S. P. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746303 · Cited by 72
Rethinking Sampling Strategies for Unsupervised Person Re-Identification
Han, X., Yu, X., Li, G., Zhao, J. C., Pan, G., Ye, Q., Jiao, J., & Han, Z. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3224325 · Cited by 69
Unsupervised Pre-training for Temporal Action Localization Tasks
Zhang, C., Yang, T., Weng, J., Cao, M., Wang, J., & Zou, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01364 · Cited by 62
Transformer-Based Masked Autoencoder With Contrastive Loss for Hyperspectral Image Classification
Cao, X., Lin, H., Guo, S., Xiong, T., & Jiao, L. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3315678 · Cited by 67
Binh, L. M., & Woo, S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19886 · Cited by 63
Improved Speech Representations with Multi-Target Autoregressive Predictive Coding
Chung, Y.-A., & Glass, J. R. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.213 · Cited by 55
Hsieh, T.-A., Yu, C., Fu, S., Lu, X., & Tsao, Y. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-582 · Cited by 58
Ye, J., Xiao, Q., Wang, J., Zhang, H., Deng, J., & Lin, Y. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3130826 · Cited by 61
On the Development and Practice of AI Technology for Contemporary Popular Music Production
Deruty, E., Grachten, M., Lattner, S., et al. (2022) · Transactions of the International Society for Music Information Retrieval · doi:10.5334/tismir.100 · Cited by 61
Medical Visual Question Answering via Conditional Reasoning and Contrastive Learning
Liu, B., Zhan, L.-M., Xu, L., & Wu, X.-M. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3232411 · Cited by 63
“CPC [45] pioneered in using a contrastive objective (InfoNCE loss) to learn data representations with a context auto-encoding task and achieved promising results in various domains including speech, image, and text.”
BackgroundMethodFan, C., Lei, Y., Sun, Y., & Mo, L. (2023) · Energy · doi:10.1016/j.energy.2023.127972 · Cited by 61
Progressive Spatio-Temporal Prototype Matching for Text-Video Retrieval
Li, P., Xie, C.-W., Zhao, L., Xie, H., Ge, J., Zheng, Y., Zhao, D., & Zhang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00379 · Cited by 62
“The InfoNCE loss [55, 75] is employed to optimize the prototype matching within a batch.”
MethodOnline Prototype Learning for Online Continual Learning
Wei, Y., Ye, J., Huang, Z., Zhang, J., & Shan, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01720 · Cited by 67
InstructTTS: Modelling Expressive TTS in Discrete Latent Space With Natural Language Style Prompt
Yang, D., Liu, S., Huang, R., Weng, C., & Meng, H. M. L. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3402088 · Cited by 125
“Specifi-cally, we follow the training strategy proposed in SimCSE [47], which using an InfoNCE loss [48] objective to fine-tune our pre-trained RoBERTa model.”
MethodMusic ControlNet: Multiple Time-Varying Controls for Music Generation
Wu, S.-L., Donahue, C., Watanabe, S., & Bryan, N. J. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3399026 · Cited by 103
“The text and audio embedding spaces are learned via a contrastive objective [42].”
BackgroundFormal Limitations on the Measurement of Mutual InformationPreprint
McAllester, D., & Stratos, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.04251 · Cited by 117
Video Representation Learning with Visual Tempo ConsistencyPreprint
Yang, C., Xu, Y., Dai, B., & Zhou, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15489 · Cited by 76
InfoBERT: Improving Robustness of Language Models from An Information Theoretic PerspectivePreprint
Wang, B., Wang, S., Cheng, Y., Gan, Z., Jia, R., Li, B., & Liu, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02329 · Cited by 93
Contrastive Learning with Adversarial ExamplesPreprint
Ho, C.-H., & Vasconcelos, N. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.12050 · Cited by 102
Contrastive Distillation on Intermediate Representations for Language Model Compression
Sun, S., Gan, Z., Fang, Y., Cheng, Y., Wang, S., & Liu, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.36 · Cited by 77
Pri3D: Can 3D Priors Help 2D Representation Learning?
Hou, J., Xie, S., Graham, B., Dai, A., & Nießner, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00564 · Cited by 66
Meta-TTS: Meta-Learning for Few-Shot Speaker Adaptive Text-to-Speech
Huang, S.-F., Lin, C.-J., Liu, D.-R., Chen, Y.-C., & Lee, H.-Y. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3167258 · Cited by 61
Zhu, M., Fan, J., Yang, Q., & Chen, T. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3131152 · Cited by 61
User-Centric Conversational Recommendation with Multi-Aspect User Modeling
Li, S., Xie, R., Zhu, Y., Ao, X., Zhuang, F., & He, Q. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3532074 · Cited by 68
Motion-aware Contrastive Video Representation Learning via Foreground-background Merging
Ding, S., Li, M., Yang, T., Qian, R., Xu, H., Chen, Q., Wang, J., & Xiong, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00949 · Cited by 63
Compound Domain Generalization via Meta-Knowledge Encoding
Chen, C., Li, J., Han, X., Liu, X., & Yu, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00698 · Cited by 66
CASTing Your Model: Learning to Localize Improves Self-Supervised Representations
Selvaraju, R. R., Desai, K., Johnson, J., & Naik, N. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01091 · Cited by 61
Maximum Entropy Generators for Energy-Based ModelsPreprint
Kumar, R., Ozair, S., Goyal, A., Courville, A. C., & Bengio, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08508 · Cited by 107
Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningPreprint
Gunel, B., Du, J., Conneau, A., & Stoyanov, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.01403 · Cited by 483
Weakly Supervised Prostate Tma Classification Via Graph Convolutional Networks
Wang, J., Chen, R. J., Lu, M. Y., Baras, A. S., & Mahmood, F. (2020) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi45749.2020.9098534 · Cited by 69
Liang, H., Jiang, C., Feng, D., Chen, X., Xu, H., Liang, X., Zhang, W., Li, Z., & Gool, L. V. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00328 · Cited by 66
Metadata
- Authors
- Oord, A. V. D., Li, Y., & Vinyals, O.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1807.03748
- OpenAlex
- W4297808394
- Cited by
- 6,242
- References
- 50
- Citations by year
- 2026: 77 · 2025: 660 · 2024: 1288 · 2023: 1444 · 2022: 1043 · 2021: 1173 · 2020: 454 · 2019: 88 · 2018: 15
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Keywords
- contrastive predictive coding, unsupervised feature learning, autoregressive models, negative sampling, high-dimensional data, speech representation, image representation, text representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
