Self-supervised learning for recommender systems: A survey
Open accessAbstract
In recent years, neural architecture-based recommender systems have achieved tremendous success, but they still fall short of expectation when dealing with highly sparse data. Self-supervised learning (SSL), as an emerging technique for learning from unlabeled data, has attracted considerable attention as a potential solution to this issue. This survey paper presents a systematic and timely review of research efforts on self-supervised recommendation (SSR). Specifically, we propose an exclusive definition of SSR, on top of which we develop a comprehensive taxonomy to divide existing SSR methods into four categories: contrastive, generative, predictive, and hybrid. For each category, we elucidate its concept and formulation, the involved methods, as well as its pros and cons. Furthermore, to facilitate empirical comparison, we release an open-source library SELFRec (https://github.com/Coder-Yu/SELFRec), which incorporates a wide range of SSR models and benchmark datasets. Through rigorous experiments using this library, we derive and report some significant findings regarding the selection of self-supervised signals for enhancing recommendation. Finally, we shed light on the limitations in the current research and outline the future research directions.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
NLU is fundamental in applications like sentiment analysis, language translation, information extraction, and more.
“NLU is fundamental in applications like sentiment analysis, language translation, information extraction, and more [194], [195], [196].”
From From Google Gemini to OpenAI Q* (Q-Star): A Survey on Reshaping the Generative Artificial Intelligence (AI) Research Landscape (2025) · cites this paper as [195]
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347 · see citing works
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
Matrix Factorization Techniques for Recommender Systems
Koren, Y., Bell, R. M., & Volinsky, C. (2009) · Computer · doi:10.1109/mc.2009.263 · Cited by 11,232 · see citing works
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000 · see citing works
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242 · see citing works
Combining labeled and unlabeled data with co-training
Blum, A. L., & Mitchell, T. M. (1998) · Conference on Learning Theory · doi:10.1145/279943.279962 · Cited by 5,597 · see citing works
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 1× · see citing works
“Particularly, collaborative methods, where the generative/predictive task serves the contrastive task by dynamically generating samples, offer significant advantages in training effectiveness over static counterparts [64], [106], [134].”
BackgroundHe, X., Deng, K., Wang, X., Li, Y., Zhang, Y., & Wang, M. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401063 · Cited by 5,083 · see citing works
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361 · cited 2× · see citing works
“In graph structures, local refers to nodes, and global refers to graphs, while in sequence structures, local refers to items and global refers to sequences.”
BackgroundMethodLiu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352 · cited 2× · see citing works
“In graph structures, local refers to nodes, and global refers to graphs, while in sequence structures, local refers to items and global refers to sequences.”
BackgroundMethodALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308 · see citing works
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Grill, J.-B., Strub, F., Altché, F., Tallec, C., Richemond, P. H., Buchatskaya, E., Doersch, C., Pires, B. A., Guo, Z. D., Azar, M. G., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.07733 · Cited by 3,846 · see citing works
Wide & Deep Learning for Recommender Systems
Cheng, H.-T., Koç, L., Harmsen, J., Shaked, T., Chandra, T., Aradhye, H., Anderson, G., Corrado, G. S., Chai, W., Ispir, M., et al. (2016) · Workshop on Deep Learning for Recommender Systems (DLRS) · doi:10.1145/2988450.2988454 · Cited by 3,547 · see citing works
Deep Neural Networks for YouTube Recommendations
Covington, P., Adams, J., & Sargin, E. (2016) · Proceedings of the 10th ACM Conference on Recommender Systems · doi:10.1145/2959100.2959190 · Cited by 3,539 · see citing works
Self-Attentive Sequential Recommendation
Kang, W.-C., & McAuley, J. (2018) · Proceedings · doi:10.1109/icdm.2018.00035 · Cited by 3,229 · see citing works
BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer
Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., & Jiang, P. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3357895 · Cited by 2,558 · see citing works
Introduction to Recommender Systems Handbook
Ricci, F., Rokach, L., & Shapira, B. (2011) · Recommender Systems Handbook · doi:10.1007/978-0-387-85820-3_1 · Cited by 2,378 · see citing works
Deep Interest Network for Click-Through Rate Prediction
Zhou, G., Zhu, X., Song, C., Fan, Y., Zhu, H., Ma, X., Yan, Y., Jin, J., Li, H., & Gai, K. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219823 · Cited by 2,128 · see citing works
Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036 · see citing works
Learning deep representations by mutual information estimation and maximization
Hjelm, R. D., Fedorov, A., Lavoie-Marchildon, S., Grewal, K., Bachman, P., Trischler, A., & Bengio, Y. (2018) · arXiv · doi:10.48550/arxiv.1808.06670 · Cited by 1,991 · see citing works
Self-supervised Learning: Generative or Contrastive
Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., & Tang, J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090866 · Cited by 1,890 · see citing works
Deep Learning Based Recommender System
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2019) · ACM Computing Surveys · doi:10.1145/3285029 · Cited by 1,523 · see citing works
Self-supervised Graph Learning for Recommendation
Wu, J., Wang, X., Feng, F., et al. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462862 · Cited by 1,482 · see citing works
Modeling Task Relationships in Multi-task Learning with Multi-gate Mixture-of-Experts
Ma, J., Zhao, Z., Yi, X., Chen, J., Hong, L., & Ed, H. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220007 · Cited by 1,329 · see citing works
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization
Nowozin, S., Cseke, B., & Tomioka, R. (2016) · arXiv · doi:10.48550/arxiv.1606.00709 · Cited by 1,183 · see citing works
Tri-training: exploiting unlabeled data using three classifiers
Zhou, Z., & Li, M. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.186 · Cited by 1,176 · see citing works
Collaborative Denoising Auto-Encoders for Top-N Recommender Systems
Wu, Y., DuBois, C., Zheng, A. X., & Ester, M. (2016) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2835776.2835837 · Cited by 1,025 · see citing works
S3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization
Zhou, K., Wang, H., Zhao, W. X., Zhu, Y., Wang, S., Zhang, F., Wang, Z., & Wen, J.-R. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411954 · Cited by 945 · see citing works
Qiu, J., Chen, Q., Dong, Y., Zhang, J., Yang, H., Ding, M., Wang, K., & Tang, J. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403168 · Cited by 834 · see citing works
Contrastive Learning for Sequential Recommendation
Xie, X., Sun, F., Liu, Z., Wu, S., Gao, J., Zhang, J., Ding, B., & Cui, B. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00099 · Cited by 810 · see citing works
Bias and Debias in Recommender System: A Survey and Future Directions
Chen, J., Dong, H., Wang, X., Feng, F., Wang, M., & He, X. (2023) · ACM Transactions on Information Systems · doi:10.1145/3564284 · Cited by 741 · see citing works
Understanding the Behaviour of Contrastive Loss
Wang, F., & Liu, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00252 · Cited by 698 · see citing works
Are Graph Augmentations Necessary?
Yu, J., Yin, H., Xia, X., Chen, T., Cui, L., & Nguyen, Q. V. H. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531937 · Cited by 679 · see citing works
Self-citationImproving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learning
Lin, Z., Tian, C., Hou, Y., et al. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512104 · Cited by 627 · see citing works
Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendation
Xia, X., Yin, H., Yu, J., Wang, Q., Cui, L., & Zhang, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16578 · Cited by 614 · see citing works
Self-citationPrototypical Contrastive Learning of Unsupervised Representations
Li, J., Zhou, P., Xiong, C., & Hoi, S. C. H. (2020) · arXiv · doi:10.48550/arxiv.2005.04966 · Cited by 611 · see citing works
Self-citationGraph Self-Supervised Learning: A Survey
Liu, Y., Jin, M., Pan, S., Zhou, C. D., Zheng, Y., Xia, F., & Yu, P. S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3172903 · Cited by 564 · see citing works
Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendation
Yu, J., Yin, H., Li, J., Wang, Q., Nguyen, Q. V. H., & Zhang, X. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449844 · Cited by 560 · see citing works
Self-citationGeng, S., Liu, S., Fu, Z., Ge, Y., & Zhang, Y. (2022) · Proceedings of the 16th ACM Conference on Recommender Systems · doi:10.1145/3523227.3546767 · Cited by 556 · see citing works
Knowledge Graph Contrastive Learning for Recommendation
Yang, Y., Huang, C., Xia, L., & Li, C. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3532009 · Cited by 522 · see citing works
RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithms
Zhao, W. X., Mu, S., Hou, Y., Lin, Z., Chen, Y., Pan, X., Li, K., Lu, Y., Wang, H., Tian, C., et al. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482016 · Cited by 521 · see citing works
Hu, Z., Dong, Y., Wang, K., Chang, K.-W., & Sun, Y. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403237 · Cited by 517 · see citing works
Contrastive Learning for Representation Degeneration Problem in Sequential Recommendation
Qiu, R., Huang, Z. H., Yin, H., & Wang, Z. (2022) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3488560.3498433 · Cited by 497 · see citing works
Self-citationHypergraph Contrastive Collaborative Filtering
Xia, L., Huang, C., Xu, Y., et al. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3532058 · Cited by 446 · see citing works
Intent Contrastive Learning for Sequential Recommendation
Chen, Y., Liu, Z., Li, J., et al. (2022) · ACM Web Conference (WWW) · doi:10.1145/3485447.3512090 · Cited by 415 · see citing works
Self-citationSelf-Supervised Learning of Graph Neural Networks: A Unified Review
Xie, Y., Zhao, X., Zhang, J., Wang, Z., & Ji, S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3170559 · Cited by 411 · see citing works
Data augmentation approaches in natural language processing: A survey
Li, B., Hou, Y., & Che, W. (2022) · AI Open · doi:10.1016/j.aiopen.2022.03.001 · Cited by 357 · see citing works
XSimGCL: Towards Extremely Simple Graph Contrastive Learning for Recommendation
Yu, J., Xia, X., Chen, T., Cui, L., Nguyen, Q. V. H., & Yin, H. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3288135 · Cited by 327 · see citing works
Self-citationSelf-Supervised Learning on Graphs: Contrastive, Generative, or Predictive
Wu, L., Lin, H., Tan, C., Gao, Z., & Li, S. Z. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3131584 · Cited by 322 · see citing works
Contrastive Learning for Cold-Start Recommendation
Wei, Y., Wang, X., Li, Q., et al. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475665 · Cited by 322 · see citing works
Challenging the long tail recommendation
Yin, H., Cui, B., Li, J., Yao, J., & Chen, C. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2311906.2311916 · Cited by 313 · see citing works
Self-citationTowards Universal Sequence Representation Learning for Recommender Systems
Hou, Y., Mu, S., Zhao, W. X., Li, Y., Ding, B., & Wen, J.-R. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539381 · Cited by 313 · see citing works
Pre-training of Graph Augmented Transformers for Medication Recommendation
Shang, J., Ma, T., Xiao, C., & Sun, J. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/825 · Cited by 311 · see citing works
Self-supervised Learning for Large-scale Item Recommendations
Yao, T., Yi, X., Cheng, D. Z., Yu, F., Chen, T., Menon, A. K., Hong, L., Ed, H., Tjoa, S., Kang, J., et al. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3481952 · Cited by 291 · see citing works
Self-citationSelf-Supervised Learning for Multimedia Recommendation
Tao, Z., Liu, X., Xia, Y., Wang, X., Yang, L., Huang, X., & Chua, T. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3187556 · Cited by 270 · see citing works
Data Augmentation for Deep Graph Learning
Ding, K., Xu, Z., Tong, H., & Liu, H. (2022) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3575637.3575646 · Cited by 244 · see citing works
Disentangled Self-Supervision in Sequential Recommenders
Ma, J., Zhou, C., Yang, H., Cui, P., Wang, X., & Zhu, W. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403091 · Cited by 235 · see citing works
Self-Supervised Reinforcement Learning for Recommender Systems
Xin, X., Karatzoglou, A., Arapakis, I., & Jose, J. M. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401147 · Cited by 228 · see citing works
A Survey on Adversarial Recommender Systems
Deldjoo, Y., Noia, T. D., & Merra, F. A. (2021) · ACM Computing Surveys · doi:10.1145/3439729 · Cited by 228 · see citing works
Socially-Aware Self-Supervised Tri-Training for Recommendation
Yu, J., Yin, H., Gao, M., et al. (2021) · doi:10.1145/3447548.3467340 · Cited by 227 · see citing works
Self-citationSocial Influence-Based Group Representation Learning for Group Recommendation
Yin, H., Wang, Q., Zheng, K., Li, Z., Yang, J., & Zhou, X. (2019) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2019.00057 · Cited by 222 · see citing works
Self-citationGao, M. Z., Chen, L., He, X., & Zhou, A. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3209987 · Cited by 218 · see citing works
Huang, T., Dong, Y., Ding, M., Yang, Z., Feng, W., Wang, X., & Tang, J. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467408 · Cited by 212 · see citing works
Enhancing Social Recommendation With Adversarial Graph Convolutional Networks
Yu, J., Yin, H., Li, J., Gao, M., Huang, Z. H., & Cui, L. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3033673 · Cited by 199 · see citing works
Self-citationSelf-Supervised Graph Co-Training for Session-based Recommendation
Xia, X., Yin, H., Yu, J., et al. (2021) · Proceedings of the ... ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482388 · Cited by 196 · see citing works
Self-citationEmpowering News Recommendation with Pre-trained Language Models
Wu, C., Wu, F., Qi, T., & Huang, Y. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463069 · Cited by 176 · see citing works
Learning Vector-Quantized Item Representation for Transferable Sequential Recommenders
Hou, Y., He, Z., McAuley, J., & Zhao, W. X. (2023) · Proceedings of the ACM Web Conference 2023 · doi:10.1145/3543507.3583434 · Cited by 172 · see citing works
Parameter-Efficient Transfer from Sequential Behaviors for User Modeling and Recommendation
Yuan, F., He, X., Karatzoglou, A., & Zhang, L. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401156 · Cited by 162 · see citing works
Fast-adapting and privacy-preserving federated recommender system
Wang, Q., Yin, H., Chen, T., Yu, J., Zhou, A., & Zhang, X. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00700-6 · Cited by 151 · see citing works
Self-citationThe World is Binary: Contrastive Learning for Denoising Next Basket Recommendation
Qin, Y., Wang, P., & Li, C. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462836 · Cited by 145 · see citing works
Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems
Zhou, C., Ma, J., Zhang, J., Zhou, J., & Yang, H. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467102 · Cited by 145 · see citing works
Self-supervised Pretraining of Visual Features in the Wild
Goyal, P., Caron, M., Lefaudeux, B., Xu, M., Wang, P., Pai, V., Singh, M., Liptchinsky, V., Misra, I., Joulin, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.01988 · Cited by 141 · see citing works
Augmenting Sequential Recommendation with Pseudo-Prior Items via Reversely Pre-training Transformer
Liu, Z., Fan, Z., Wang, Y., et al. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463036 · Cited by 140 · see citing works
Double-Scale Self-Supervised Hypergraph Learning for Group Recommendation
Zhang, J., Gao, M., Yu, J., et al. (2021) · Proceedings of the ... ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482426 · Cited by 136 · see citing works
Self-citationBipartite Graph Embedding via Mutual Information Maximization
Cao, J., Lin, X., Guo, S., Liu, L., Liu, T., & Wang, B. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441783 · Cited by 130 · see citing works
On the Effectiveness of Sampled Softmax Loss for Item Recommendation
Wu, J.-C., Wang, X., Gao, X., Chen, J.-W., Fu, H.-C., Qiu, T.-Y., & He, X.-N. (2022) · ACM Trans. Inf. Syst. · doi:10.1145/3637061 · Cited by 128 · see citing works
Future Data Helps Training: Modeling Future Contexts for Session-based Recommendation
Yuan, F.-J., He, X.-N., Jiang, H.-C., Guo, G., Xiong, J., Xu, Z., & Xiong, Y. (2019) · The Web Conference · doi:10.1145/3366423.3380116 · Cited by 121 · see citing works
Bootstrapping User and Item Representations for One-Class Collaborative Filtering
Lee, D., Kang, S., Ju, H., et al. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462935 · Cited by 118 · see citing works
Collaborative User Network Embedding for Social Recommender Systems
Zhang, C., Yu, L., Wang, Y., Shah, C. S., & Zhang, X. (2017) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611974973.43 · Cited by 117 · see citing works
Social Recommendation with Self-Supervised Metagraph Informax Network
Long, X., Huang, C., Xu, Y., et al. (2021) · Proceedings of the ... ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482480 · Cited by 117 · see citing works
Chen, T., Yin, H., Ye, G., Huang, Z. H., Wang, Y., & Wang, M. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401042 · Cited by 115 · see citing works
Self-citationEnhanced Graph Learning for Collaborative Filtering via Mutual Information Maximization
Yang, Y., Wu, L., Hong, R., et al. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462928 · Cited by 113 · see citing works
U-BERT: Pre-training User Representations for Improved Recommendation
Qiu, Z., Wu, X., Gao, J., & Fan, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16557 · Cited by 112 · see citing works
Contrastive Cross-domain Recommendation in Matching
Xie, R., Liu, Q., Wang, L., Liu, S., Zhang, B., & Lin, L. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539125 · Cited by 112 · see citing works
Next Point-of-Interest Recommendation on Resource-Constrained Mobile Devices
Wang, Q., Yin, H., Chen, T., Huang, Z. H., Wang, H., Zhao, Y., & Nguyen, Q. V. H. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380170 · Cited by 107 · see citing works
Self-citationSelfCF: A Simple Framework for Self-supervised Collaborative Filtering
Zhou, X., Sun, A., Liu, Y., et al. (2023) · ACM Transactions on Recommender Systems · doi:10.1145/3591469 · Cited by 103 · see citing works
Sankar, A., Wu, Y., Wu, Y., et al. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401116 · Cited by 102 · see citing works
Enhancing Collaborative Filtering with Generative Augmentation
Wang, Q., Yin, H., Wang, H., Nguyen, Q. V. H., Huang, Z. H., & Cui, L. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330873 · Cited by 101 · see citing works
Self-citationUNBERT: User-News Matching BERT for News Recommendation
Zhang, Q., Li, J., Jia, Q., Wang, C., Zhu, J., Wang, Z., & He, X. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/462 · Cited by 101 · see citing works
Self-citationAdversarial and Contrastive Variational Autoencoder for Sequential Recommendation
Xie, Z., Liu, C., Zhang, Y., et al. (2021) · doi:10.1145/3442381.3449873 · Cited by 98 · see citing works
Pre-Training Graph Neural Networks for Cold-Start Users and Items Representation
Hao, B., Zhang, J., Yin, H., et al. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441738 · Cited by 96 · see citing works
Self-citationBackdoor Attacks on Self-Supervised Learning
Saha, A., Tejankar, A., Koohpayegani, S. A., & Pirsiavash, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01298 · Cited by 94 · see citing works
Pre-training Graph Transformer with Multimodal Side Information for Recommendation
Liu, Y., Yang, S., Lei, C., Wang, G., Tang, H., Zhang, J., Sun, A., & Miao, C. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475709 · Cited by 86 · see citing works
Recommender systems based on generative adversarial networks: A problem-driven perspective
Gao, M., Zhang, J., Yu, J., et al. (2020) · Information Sciences · doi:10.1016/j.ins.2020.09.013 · Cited by 85 · see citing works
Self-citationContrastive Self-supervised Sequential Recommendation with Robust AugmentationPreprint
Liu, Z., Chen, Y., Li, J., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.06479 · Cited by 81 · see citing works
Self-citationJoint Modeling of Users' Interests and Mobility Patterns for Point-of-Interest Recommendation
Yin, H., Cui, B., Huang, Z. H., et al. (2015) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2733373.2806339 · Cited by 79 · see citing works
Self-citationHeterogeneous Graph Contrastive Learning Network for Personalized Micro-Video Recommendation
Cai, D., Qian, S., Fang, Q., et al. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3151026 · Cited by 69 · see citing works
Spatio-Temporal Recommendation in Social Media
Yin, H., & Cui, B. (2016) · SpringerBriefs in computer science · doi:10.1007/978-981-10-0748-4 · Cited by 68 · see citing works
Self-citationHyperbolic Hypergraphs for Sequential Recommendation
Li, Y., Chen, H., Sun, X., et al. (2021) · Proceedings of the ... ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482351 · Cited by 68 · see citing works
Sparsity, scalability, and distribution in recommender systems
Riedl, J., & Sarwar, B. M. (2001) · Cited by 67 · see citing works
Sequential Recommendation with Multiple Contrast Signals
Wang, C., Ma, W., Chen, C., Zhang, M., Liu, Y., & Ma, S. (2022) · ACM Transactions on Information Systems · doi:10.1145/3522673 · Cited by 65 · see citing works
On-Device Next-Item Recommendation with Self-Supervised Knowledge Distillation
Xia, X., Yin, H., Yu, J., et al. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531775 · Cited by 62 · see citing works
Self-citationHyper Meta-Path Contrastive Learning for Multi-Behavior Recommendation
Yang, H., Chen, H., Li, L., et al. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00090 · Cited by 60 · see citing works
Data Poisoning Attack against Recommender System Using Incomplete and Perturbed Data
Zhang, H., Tian, C., Li, Y., Su, L., Yang, N., Zhao, W. X., & Gao, J. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467233 · Cited by 55 · see citing works
Curriculum Pre-training Heterogeneous Subgraph Transformer for Top-NRecommendation
Wang, H., Zhou, K., Zhao, W. X., et al. (2022) · ACM Transactions on Information Systems · doi:10.1145/3528667 · Cited by 54 · see citing works
Pre-training Graph Neural Network for Cross Domain Recommendation
Wang, C., Liang, Y., Liu, Z., Zhang, T., & Yu, P. S. (2021) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi52975.2021.00026 · Cited by 52 · see citing works
Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendation
Qiu, R., Huang, Z. H., & Yin, H. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00063 · Cited by 51 · see citing works
Self-citationContrastive Learning for Recommender SystemPreprint
Liu, Z., Ma, Y., Ouyang, Y., & Xiong, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.01317 · Cited by 49 · see citing works
PTUM: Pre-training User Model from Unlabeled User Behaviors via Self-supervision
Wu, C., Wu, F., Qi, T., Lian, J., Huang, Y., & Xie, X. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.174 · Cited by 43 · see citing works
Learning Transferable User Representations with Sequential Behaviors via Contrastive Pre-training
Cheng, M., Yuan, F., Liu, Q., Xin, X., & Chen, E. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00015 · Cited by 43 · see citing works
Unsupervised Graph Poisoning Attack via Contrastive Loss Back-propagation
Zhang, S., Chen, H., Sun, X., et al. (2022) · ACM Web Conference (WWW) · doi:10.1145/3485447.3512179 · Cited by 43 · see citing works
Contrastive Curriculum Learning for Sequential User Behavior Modeling via Data Augmentation
Bian, S., Zhao, W. X., Zhou, K., et al. (2021) · Proceedings of the ... ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3481905 · Cited by 39 · see citing works
MISS: Multi-Interest Self-Supervised Learning Framework for Click-Through Rate Prediction
Guo, W., Zhang, C., He, Z., Qin, J., Guo, H., Chen, B., Tang, R., He, X., & Zhang, R. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00059 · Cited by 38 · see citing works
Knowledge Transfer via Pre-training for Recommendation: A Review and Prospect
Zeng, Z., Xiao, C., Yao, Y., Xie, R., Liu, Z., Lin, F., Lin, L., & Sun, M. (2021) · Frontiers in Big Data · doi:10.3389/fdata.2021.602071 · Cited by 37 · see citing works
Improving Transformer-based Sequential Recommenders through Preference Editing
Ma, M., Ren, P., Chen, Z., Ren, Z., Liang, H., Ma, J., & de Rijke, M. (2022) · ACM Transactions on Information Systems · doi:10.1145/3564282 · Cited by 37 · see citing works
General-Purpose User Embeddings based on Mobile App Usage
Zhang, J., Bai, B., Lin, Y., Liang, J., Bai, K., & Wang, F. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403334 · Cited by 35 · see citing works
Efficient On-Device Session-Based Recommendation
Xia, X., Yu, J., Wang, Q., et al. (2023) · ACM Transactions on Information Systems · doi:10.1145/3580364 · Cited by 35 · see citing works
Self-citationOne4all User Representation for Recommender Systems in E-commercePreprint
Shin, K., Kwak, H., Kim, K.-M., et al. (2021) · arXiv.org · doi:10.48550/arxiv.2106.00573 · Cited by 33 · see citing works
Chen, X., Liu, D., Lei, C., Li, R., Zha, Z.-J., & Xiong, Z. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3356051 · Cited by 32 · see citing works
A Multi-strategy-based Pre-training Method for Cold-start Recommendation
Hao, B., Yin, H., Zhang, J., et al. (2022) · ACM Transactions on Information Systems · doi:10.1145/3544107 · Cited by 31 · see citing works
Self-citationGray-Box Shilling Attack: An Adversarial Learning Approach
Wang, Z., Gao, M., Li, J., Zhang, J., & Zhong, J. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3512352 · Cited by 28 · see citing works
Self-citationA Survey of Pretraining on Graphs: Taxonomy, Methods, and ApplicationsPreprint
Xia, J., Zhu, Y., Du, Y., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.07893 · Cited by 27 · see citing works
Wu, L., He, X., Wang, X., Zhang, K., & Wang, M. (2021) · arXiv (Cornell University) · Cited by 26 · see citing works
Improving Sequential Recommendation Consistency with Self-Supervised Imitation
Xu, Y., Chen, H., Song, Y., Zhao, X., & Ding, Z. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/457 · Cited by 22 · see citing works
UPRec: User-Aware Pre-training for Recommender SystemsPreprint
Xiao, C., Xie, R., Yao, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.10989 · Cited by 14 · see citing works
Moreira, G. D. S. P., Rabhi, S., Ak, R., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05124 · Cited by 10 · see citing works
Graph Neural Pre-training for Enhancing Recommendations using Side InformationPreprint
Meng, Z., Liu, S., Macdonald, C., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03936 · Cited by 8 · see citing works
Predictive and Contrastive: Dual-Auxiliary Learning for Recommendation
Tao, Y., Gao, M., Yu, J., et al. (2022) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3185714 · Cited by 7 · see citing works
Self-citationImproving Sequential Recommendations via Bidirectional Temporal Data Augmentation with Pre-trainingPreprint
Jiang, J., Zhang, P., Luo, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.06460 · Cited by 4 · see citing works
Huang, L., Liu, Y., Zhou, X., You, A., Li, M., Wang, B., Zhang, Y., Pan, P., & Xu, Y. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3481541 · Cited by 3 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805
Flagged first, then by citations
Cited by
Sorted by citations
McIntosh, T. R., Susnjak, T., Liu, T., Watters, P., Xu, D., Liu, D., & Halgamuge, M. N. (2025) · Technologies · doi:10.3390/technologies13020051 · Cited by 102 · see citing works
“…each contributing uniquely to the field: • Supervised Learning: Supervised learning, a foundational approach in AI, uses labeled datasets to guide models towards accurate predictions, and it has been integral to various applications, including image recognition and NLP [163], [164], [165].”
BackgroundMethodRoy, F., Ding, X., Choo, K. K. R., & Zhou, P. (2024) · arXiv · doi:10.48550/arxiv.2409.12651
- Authors
- Yu, J., Yin, H., Xia, X., Chen, T., Li, J., & Huang, Z.
- Affiliations
- The University of Queensland (AU)
- University of Virginia (US)
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2024-01
- Volume
- 36
- Issue
- 1
- Pages
- 335-355
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W4379382506
- Cited by
- 413
- References
- 132
- Citations by year
- 2026: 87 · 2025: 163 · 2024: 114 · 2023: 44 · 2022: 5
- FWCI
- 95.75
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- ARC Future Fellowship (FT210100624)
- ARC Industrial Transformation Training Centre for Uniquely Australian Foods (IC200100022)
- Discovery Project (DP190101985)
- Discovery Early Career Researcher Award (DE230101033)
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Keywords
- self-supervised learning, recommender systems, data sparsity, contrastive learning, generative models, prediction model, hybrid model, benchmark dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review