The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
LLMRec: Large Language Models with Graph Augmentation for Recommendation
Open accessAbstract
The problem of data sparsity has long been a challenge in recommendation systems, and previous studies have attempted to address this issue by incorporating side information. However, this approach often introduces side effects such as noise, availability issues, and low data quality, which in turn hinder the accurate modeling of user preferences and adversely impact recommendation performance. In light of the recent advancements in large language models (LLMs), which possess extensive knowledge bases and strong reasoning capabilities, we propose a novel framework called LLMRec that enhances recommender systems by employing three simple yet effective LLM-based graph augmentation strategies. Our approach leverages the rich content available within online platforms (e.g., Netflix, MovieLens) to augment the interaction graph in three ways: (i) reinforcing user-item interaction egde, (ii) enhancing the understanding of item node attributes, and (iii) conducting user node profiling, intuitively from the natural language perspective. By employing these strategies, we address the challenges posed by sparse implicit feedback and low-quality side information in recommenders. Besides, to ensure the quality of the augmentation, we develop a denoised data robustification mechanism that includes techniques of noisy implicit feedback pruning and MAE-based feature enhancement that help refine the augmented data and improve its reliability. Furthermore, we provide theoretical analysis to support the effectiveness of LLMRec and clarify the benefits of our method in facilitating model optimization. Experimental results on benchmark datasets demonstrate the superiority of our LLM-based augmentation approach over state-of-the-art techniques. To ensure reproducibility, we have made our code and augmented data publicly available at: https://github.com/HKUDS/LLMRec.git.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., & Wang, M. (2020) · Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3397271.3401063 · Cited by 4,430
Neural Graph Collaborative Filtering
Wang, X., He, X., Wang, M., Feng, F., & Chua, T.-S. (2019) · Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3331184.3331267 · Cited by 3,823
Graph Neural Networks for Social Recommendation
Fan, W., Ma, Y., Li, Q., He, Y., Zhao, E., Tang, J., & Yin, D. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313488 · Cited by 1,984
Self-citationSelf-supervised Graph Learning for Recommendation
Wu, J., Wang, X., Feng, F., He, X., Chen, L., Lian, J., & Xie, X. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3462862 · Cited by 1,488
VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback
He, R., & McAuley, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9973 · Cited by 992
MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embedding
Fu, X., Zhang, J., Meng, Z., & King, I. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380297 · Cited by 976
A Survey of Recommendation Systems: Recommendation Models, Techniques, and Application Fields
Ko, H., Lee, S., Park, Y., & Choi, A. (2022) · Electronics · doi:10.3390/electronics11010141 · Cited by 658
Conference on Neural Information Processing Systems
Liu, L., Zhou, T., Long, G., Jiang, J., & Zhang, C. (2019) · UTS ePRESS (University of Technology Sydney) · Cited by 593
A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multi-Modal
Liang, K., Meng, L., Liu, M., Liu, Y., Tu, W., Wang, S., Zhou, S., Liu, X., Sun, F., & He, K. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3417451 · Cited by 553
Graph-Refined Convolutional Network for Multimedia Recommendation with Implicit Feedback
Wei, Y., Wang, X., Nie, L., He, X., & Chua, T.-S. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413556 · Cited by 373
Mining Latent Structures for Multimedia Recommendation
Zhang, J., Zhu, Y., Liu, Q., Wu, S., Wang, S., & Wang, L. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475259 · Cited by 354
Contrastive Learning for Cold-Start Recommendation
Wei, Y., Wang, X., Li, Q., Nie, L., Li, Y., Li, X., & Chua, T.-S. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475665 · Cited by 331
Denoising Implicit Feedback for Recommendation
Wang, W., Feng, F., He, X., Nie, L., & Chua, T.-S. (2021) · Proceedings of the 14th ACM International Conference on Web Search and Data Mining · doi:10.1145/3437963.3441800 · Cited by 290
Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisited
Yuan, Z., Yuan, F., Song, Y., Li, Y., Fu, J., Yang, F., Pan, Y., & Ni, Y. (2023) · arXiv · doi:10.48550/arxiv.2303.13835 · Cited by 267
Heterogeneous Graph Contrastive Learning for Recommendation
Chen, M., Huang, C., Xia, L., Wei, W., Xu, Y., & Luo, R. (2023) · Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3539597.3570484 · Cited by 236
Self-citationMulti-level Cross-view Contrastive Learning for Knowledge-aware Recommender System
Zou, D., Wei, W., Mao, X.-L., Wang, Z., Qiu, M., Zhu, F., & Cao, X. (2022) · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3477495.3532025 · Cited by 226
Self-citationAugmenting Sequential Recommendation with Pseudo-Prior Items via Reversely Pre-training Transformer
Liu, Z., Fan, Z., Wang, Y., & Yu, P. S. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463036 · Cited by 221
MixGCF: An Improved Training Method for Graph Neural Network-based Recommender Systems
Huang, T., Dong, Y., Ding, M., Yang, Z., Feng, W., Wang, X., & Tang, J. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467408 · Cited by 207
Self-citationEfficient Neural Matrix Factorization without Sampling for Recommendation
Chen, C., Zhang, M., Zhang, Y., Liu, Y., & Ma, S. (2020) · ACM Transactions on Information Systems · doi:10.1145/3373807 · Cited by 204
Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisited
Yuan, Z., Yuan, F., Song, Y., Li, Y., Fu, J., Yang, F., Pan, Y., & Ni, Y. (2023) · Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3539618.3591932 · Cited by 200 · cited 1×
“Firstly , LLMRec embraces the shift from an ID-based recommendation framework to a modality-based paradigm [18, 46].”
BackgroundLearn from Relational Correlations and Periodic Events for Temporal Knowledge Graph Reasoning
Liang, K., Meng, L., Liu, M., Liu, Y., Tu, W., Wang, S., Zhou, S., & Liu, X. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591711 · Cited by 196
Heterogeneous Graph Masked Autoencoders
Tian, Y., Dong, K., Zhang, C., Zhang, C., & Chawla, N. V. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26192 · Cited by 191
CauseRec: Counterfactual User Sequence Synthesis for Sequential Recommendation
Zhang, S., Yao, D., Zhao, Z., Chua, T.-S., & Wu, F. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462908 · Cited by 188
Counterfactual Data-Augmented Sequential Recommendation
Wang, Z., Zhang, J., Xu, H., Chen, X., Zhang, Y., Zhao, W. X., & Wen, J.-R. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462855 · Cited by 183
Bootstrapping User and Item Representations for One-Class Collaborative Filtering
Lee, D., Kang, S., Ju, H., Park, C., & Yu, H. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462935 · Cited by 173
LightFR: Lightweight Federated Recommendation with Privacy-preserving Matrix Factorization
Zhang, H., Luo, F., Wu, J., He, X., & Li, Y. (2022) · ACM Transactions on Information Systems · doi:10.1145/3578361 · Cited by 167
Revisiting Negative Sampling vs. Non-sampling in Implicit Recommendation
Chen, C., Ma, W., Zhang, M., Wang, C., Liu, Y., & Ma, S. (2022) · ACM Transactions on Information Systems · doi:10.1145/3522672 · Cited by 141
Knowledge Graph Contrastive Learning Based on Relation-Symmetrical Structure
Liang, K., Liu, Y., Zhou, S., Tu, W., Wen, Y., Yang, X., Dong, X., & Liu, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3282989 · Cited by 139
Hierarchical User Intent Graph Network for Multimedia Recommendation
Wei, Y., Wang, X., He, X., Nie, L., Rui, Y., & Chua, T. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3088307 · Cited by 105
Meng, C., Zhao, Z., Guo, W., Zhang, Y., Wu, H., Gao, C., Li, D., Li, X., & Tang, R. (2023) · ACM Transactions on Information Systems · doi:10.1145/3606369 · Cited by 73
Effective and Efficient Training for Sequential Recommendation using Recency Sampling
Petrov, A. V., & Macdonald, C. (2022) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3523227.3546785 · Cited by 38
Multi-Relational Contrastive Learning for Recommendation
Wei, W., Xia, L., & Huang, C. (2023) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3604915.3608807 · Cited by 38
Self-citation
Cited by
A survey on large language models for recommendation
Wu, L., Zheng, Z., Qiu, Z., Wang, H., Gu, H., Shen, T., Qin, C., Zhu, C., Zhu, H., Liu, Q., et al. (2024) · World Wide Web · doi:10.1007/s11280-024-01291-2 · Cited by 515
Recommender Systems in the Era of Large Language Models (LLMs)
Zhao, Z., Fan, W., Li, J., Liu, Y., Mei, X., Wang, Y., Wen, Z., Wang, F., Zhao, X., Tang, J., et al. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3392335 · Cited by 481
Self-citationA survey on LLM-based multi-agent systems: Workflow, infrastructure, and challenges
Li, X., Wang, S., Zeng, S., Wu, Y., & Yang, Y. (2024) · Vicinagearth · doi:10.1007/s44336-024-00009-2 · Cited by 404
When large language models meet personalization: perspectives of challenges and opportunities
Chen, J., Liu, Z., Huang, X., Wu, C., Liu, Q., Jiang, G., Pu, Y., Lei, Y., Chen, X., Wang, X., et al. (2024) · World Wide Web · doi:10.1007/s11280-024-01276-1 · Cited by 367
“LLMRec [81] adopts LLM-based graph augmentation strategies to enrich the information of items and further designs denoise methods to ensure the augmentation.”
Large Language Models are Zero-Shot Rankers for Recommender Systems
Hou, Y., Zhang, J., Lin, Z., Lu, H., Xie, R., McAuley, J., & Zhao, W. X. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-56060-6_24 · Cited by 327
Metadata
- Authors
- Wei, W., Ren, X., Tang, J., Wang, Q., Su, L., Cheng, S., Wang, J., Yin, D., & Huang, C.
- Venue
- Proceedings of the 17th ACM International Conference on Web Search and Data Mining
- Publisher
- ACM
- Published
- 2024-03-04
- Pages
- 806-815
- OpenAlex
- W4392367398
- Cited by
- 268
- References
- 34
- FWCI
- 105.33
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.