The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
XSimGCL: Towards Extremely Simple Graph Contrastive Learning for Recommendation
Open accessAbstract
Contrastive learning (CL) has recently been demonstrated critical in improving recommendation performance. The underlying principle of CL-based recommendation models is to ensure the consistency between representations derived from different graph augmentations of the user-item bipartite graph. This self-supervised approach allows for the extraction of general features from raw data, thereby mitigating the issue of data sparsity. Despite the effectiveness of this paradigm, the factors contributing to its performance gains have yet to be fully understood. This paper provides novel insights into the impact of CL on recommendation. Our findings indicate that CL enables the model to learn more evenly distributed user and item representations, which alleviates the prevalent popularity bias and promoting long-tail items. Our analysis also suggests that the graph augmentations, previously considered essential, are relatively unreliable and of limited significance in CL-based recommendation. Based on these findings, we put forward an eXtremelySimpleGraphContrastiveLearning method (XSimGCL) for recommendation, which discards the ineffective graph augmentations and instead employs a simple yet effective noise-based embedding augmentation to generate views for CL. A comprehensive experimental study on four large and highly sparse benchmark datasets demonstrates that, though the proposed method is extremely simple, it can smoothly adjust the uniformity of learned representations and outperforms its graph augmentation-based counterparts by a large margin in both recommendation accuracy and training efficiency. The code and used datasets are released athttps://github.com/Coder-Yu/SELFRec.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242 · cited 3×
“The InfoNCE loss [22] is formulated as: where i and j are users/items in B , z i and z i are L 2 normalized representations learned from two different dropout-based graph augmentations (namely z i = e (cid:4) i e (cid:4) i (cid:5) 2 ), and τ > 0 (e.g., 0.2) is the temperature which controls the…”
BackgroundMethodInfluentialLightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., & Wang, M. (2020) · Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3397271.3401063 · Cited by 4,430
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846
Neural Graph Collaborative Filtering
Wang, X., He, X., Wang, M., Feng, F., & Chua, T.-S. (2019) · Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3331184.3331267 · Cited by 3,823
SimCSE: Simple Contrastive Learning of Sentence Embeddings
Gao, T., Yao, X., & Chen, D. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.552 · Cited by 2,851
Kernel density estimation via diffusion
Botev, Z. I., Grotowski, J. F., & Kroese, D. P. (2010) · The Annals of Statistics · doi:10.1214/10-aos799 · Cited by 1,689
Session-Based Recommendation with Graph Neural Networks
Wu, S., Tang, Y., Zhu, Y., Wang, L., Xie, X., & Tan, T. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301346 · Cited by 1,532
Self-supervised Graph Learning for Recommendation
Wu, J., Wang, X., Feng, F., He, X., Chen, L., Lian, J., & Xie, X. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3462862 · Cited by 1,488
He, R., & McAuley, J. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883037 · Cited by 1,459
Graph Neural Networks in Recommender Systems: A Survey
Wu, S., Sun, F., Zhang, W., Xie, X., & Cui, B. (2023) · ACM Computing Surveys · doi:10.1145/3535101 · Cited by 1,326
Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects
Ni, J., Li, J., & McAuley, J. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1018 · Cited by 1,200
Self-supervised Learning: Generative or Contrastive
Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., & Tang, J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090866 · Cited by 1,087
Chen, D., Lin, Y., Li, W., Li, P., Zhou, J., & Sun, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5747 · Cited by 1,043
Graph Contrastive Learning with Augmentations
You, Y., Chen, T., Sui, Y., Chen, T., Wang, Z., & Shen, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13902 · Cited by 824
Self-citationS3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization
Zhou, K., Wang, H., Zhao, W. X., Zhu, Y., Wang, S., Zhang, F., Wang, Z., & Wen, J.-R. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3411954 · Cited by 789
Bias and Debias in Recommender System: A Survey and Future Directions
Chen, J., Dong, H., Wang, X., Feng, F., Wang, M., & He, X. (2023) · ACM Transactions on Information Systems · doi:10.1145/3564284 · Cited by 741
Are Graph Augmentations Necessary?: Simple Graph Contrastive Learning for Recommendation
Yu, J., Yin, H., Xia, X., Chen, T., Cui, L., & Nguyen, Q. V. H. (2022) · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3477495.3531937 · Cited by 664
Self-citationContrastive Learning for Sequential Recommendation
Xie, X., Sun, F., Liu, Z., Wu, S., Gao, J., Zhang, J., Ding, B., & Cui, B. (2022) · 2022 IEEE 38th International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00099 · Cited by 663
Chen, L., Wu, L., Hong, R., Zhang, K., & Wang, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5330 · Cited by 634
Disentangled Graph Collaborative Filtering
Wang, X., Jin, H., Zhang, A., He, X., Xu, T., & Chua, T.-S. (2020) · Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3397271.3401137 · Cited by 624
Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learning
Lin, Z., Tian, C., Hou, Y., & Zhao, W. X. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3512104 · Cited by 572
Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendation
Xia, X., Yin, H., Yu, J., Wang, Q., Cui, L., & Zhang, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16578 · Cited by 570
Self-citationSelf-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendation
Yu, J., Yin, H., Li, J., Wang, Q., Hung, N. Q. V., & Zhang, X. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449844 · Cited by 519
Self-citationContrastive Learning for Representation Degeneration Problem in Sequential Recommendation
Qiu, R., Huang, Z., Yin, H., & Wang, Z. (2022) · Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3488560.3498433 · Cited by 460
Self-citationSelf-supervised learning for recommender systems: A survey
Yu, J., Yin, H., Xia, X., Chen, T., Li, J., & Huang, Z. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3282907 · Cited by 413
Self-citationChallenging the long tail recommendation
Yin, H., Cui, B., Li, J., Yao, J., & Chen, C. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2311906.2311916 · Cited by 283
Self-citationGraph Neural Networks for Recommender System
Gao, C., Wang, X., He, X., & Li, Y. (2022) · Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3488560.3501396 · Cited by 283
Self-supervised Learning for Large-scale Item Recommendations
Yao, T., Yi, X., Cheng, D. Z., Yu, F., Chen, T., Menon, A., Hong, L., Chi, E. H., Tjoa, S., Kang, J. (., et al. (2021) · Proceedings of the 30th ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3481952 · Cited by 253
Self-citationSocially-Aware Self-Supervised Tri-Training for Recommendation
Yu, J., Yin, H., Gao, M., Xia, X., Zhang, X., & Viet Hung, N. Q. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467340 · Cited by 228
Self-citationDisentangled Self-Supervision in Sequential Recommenders
Ma, J., Zhou, C., Yang, H., Cui, P., Wang, X., & Zhu, W. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403091 · Cited by 225
MixGCF: An Improved Training Method for Graph Neural Network-based Recommender Systems
Huang, T., Dong, Y., Ding, M., Yang, Z., Feng, W., Wang, X., & Tang, J. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467408 · Cited by 207
Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems
Zhou, C., Ma, J., Zhang, J., Zhou, J., & Yang, H. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467102 · Cited by 199
Self-Supervised Graph Co-Training for Session-based Recommendation
Xia, X., Yin, H., Yu, J., Shao, Y., & Cui, L. (2021) · Proceedings of the 30th ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482388 · Cited by 199
Self-citationEnhancing Social Recommendation With Adversarial Graph Convolutional Networks
Yu, J., Yin, H., Li, J., Gao, M., Huang, Z., & Cui, L. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3033673 · Cited by 191
Self-citationLearning Spread-Out Local Feature Descriptors
Zhang, X., Yu, F. X., Kumar, S., & Chang, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.492 · Cited by 162
Contrastive Cross-domain Recommendation in Matching
Xie, R., Liu, Q., Wang, L., Liu, S., Zhang, B., & Lin, L. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539125 · Cited by 160
Scalability and sparsity issues in recommender datasets: a survey
Singh, M. (2018) · Knowledge and Information Systems · doi:10.1007/s10115-018-1254-2 · Cited by 159
Neural Memory Streaming Recommender Networks with Adversarial Training
Wang, Q., Yin, H., Hu, Z., Lian, D., Wang, H., & Huang, Z. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220004 · Cited by 158
Self-citationDouble-Scale Self-Supervised Hypergraph Learning for Group Recommendation
Zhang, J., Gao, M., Yu, J., Guo, L., Li, J., & Yin, H. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482426 · Cited by 157
Self-citationAdaptive Implicit Friends Identification over Heterogeneous Network for Social Recommendation
Yu, J., Gao, M., Li, J., Yin, H., & Liu, H. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3271725 · Cited by 149
Self-citationBootstrapping User and Item Representations for One-Class Collaborative Filtering
Lee, D., Kang, S., Ju, H., Park, C., & Yu, H. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462935 · Cited by 135
SelfCF: A Simple Framework for Self-supervised Collaborative Filtering
Zhou, X., Sun, A., Liu, Y., Zhang, J., & Miao, C. (2023) · ACM Transactions on Recommender Systems · doi:10.1145/3591469 · Cited by 131
Social Recommendation with Self-Supervised Metagraph Informax Network
Long, X., Huang, C., Xu, Y., Xu, H., Dai, P., Xia, L., & Bo, L. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482480 · Cited by 127
Try This Instead: Personalized and Interpretable Substitute Recommendation
Chen, T., Yin, H., Ye, G., Huang, Z. H., Wang, Y., & Wang, M. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401042 · Cited by 121
Self-citationNext Point-of-Interest Recommendation on Resource-Constrained Mobile Devices
Wang, Q., Yin, H., Chen, T., Huang, Z. H., Wang, H., Zhao, Y., & Nguyen, Q. V. H. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380170 · Cited by 107
Self-citationJoint Modeling of Users' Interests and Mobility Patterns for Point-of-Interest Recommendation
Yin, H., Cui, B., Huang, Z. H., Wang, W., Wu, X., & Zhou, X. (2015) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2733373.2806339 · Cited by 81
Self-citationOn-Device Next-Item Recommendation with Self-Supervised Knowledge Distillation
Xia, X., Yin, H., Yu, J., Wang, Q., Xu, G., & Nguyen, Q. V. H. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531775 · Cited by 79
Self-citationSequence-Aware Factorization Machines for Temporal Predictive Analytics
Chen, T., Yin, H., Nguyen, Q. V. H., Peng, W.-C., Li, X., & Zhou, X. (2020) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde48307.2020.00125 · Cited by 74
Self-citationYe, H., Li, X., Yao, Y., & Tong, H. (2022) · ACM Transactions on Information Systems · doi:10.1145/3568396 · Cited by 74
Spatio-Temporal Recommendation in Social Media
Yin, H., & Cui, B. (2016) · SpringerBriefs in computer science · doi:10.1007/978-981-10-0748-4 · Cited by 70
Self-citationEfficient On-Device Session-Based Recommendation
Xia, X., Yu, J., Wang, Q., Yang, C., Nguyen, Q. V. H., & Yin, H. (2023) · ACM Transactions on Information Systems · doi:10.1145/3580364 · Cited by 36
Self-citation
Cited by
Self-supervised learning for recommender systems: A survey
Yu, J., Yin, H., Xia, X., Chen, T., Li, J., & Huang, Z. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3282907 · Cited by 413
Self-citation
Metadata
- Authors
- Yu, J., Xia, X., Chen, T., Cui, L., Hung, N. Q. V., & Yin, H.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2023
- Pages
- 1-14
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W4381786098
- Cited by
- 322
- References
- 54
- FWCI
- 75.43
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.