CoChat
Sign Up
PreprintCited by 146Recommender Systems and TechniquesInformation Retrieval and Search BehaviorAdvanced Bandit Algorithms Research

The DOI matches its DataCite record.

CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendation

Open access
Zhang, Yang, Feng, Fuli, Zhang, Jizhi, Bao, Keqin, Wang, Qifan, He, Xiangnan·2023·arXiv
DOI 10.48550/arxiv.2310.19488arXiv 2310.19488
Open this paper in CoChat — free accountOpen PDF

Abstract

Leveraging Large Language Models as Recommenders (LLMRec) has gained significant attention and introduced fresh perspectives in user preference modeling. Existing LLMRec approaches prioritize text semantics, usually neglecting the valuable collaborative information from user-item interactions in recommendations. While these text-emphasizing approaches excel in cold-start scenarios, they may yield sub-optimal performance in warm-start situations. In pursuit of superior recommendations for both cold and warm start scenarios, we introduce CoLLM, an innovative LLMRec methodology that seamlessly incorporates collaborative information into LLMs for recommendation. CoLLM captures collaborative information through an external traditional model and maps it to the input token embedding space of LLM, forming collaborative embeddings for LLM usage. Through this external integration of collaborative information, CoLLM ensures effective modeling of collaborative information without modifying the LLM itself, providing the flexibility to employ various collaborative information modeling techniques. Extensive experiments validate that CoLLM adeptly integrates collaborative information into LLMs, resulting in enhanced recommendation performance. We release the code and data at https://github.com/zyang1580/CoLLM.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2310.19488

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • CoLLM captures and maps collaborative information through external traditional models, forming collaborative embeddings used by LLMs.

    “CoLLM (Zhang et al., 2023) captures and maps the collaborative information through external traditional models, forming collaborative embeddings used by LLMs.”

    From A Survey on LLM-powered Agents for Recommender Systems (2025) · cites this paper as Zhang et al., 2023

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 57

  1. L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray et al., "Training language models to follow instructions with hu- man feedback," Advances in Neural Information Processing Systems, pp. 27 730-27 744, 2022.
  2. T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al., "Language models are few-shot learners," Advances in neural information processing systems, pp. 1877-1901, 2020.
  3. H. Touvron, T. Lavril, G. Izacard, X. Martinet, M.-A. Lachaux, T. Lacroix, B. Rozière, N. Goyal, E. Hambro, F. Azhar et al., "Llama: Open and efficient foundation language models," arXiv:2302.13971, 2023. · arXiv
  4. W. X. Zhao, K. Zhou, J. Li, T. Tang, X. Wang, Y. Hou, Y. Min, B. Zhang, J. Zhang, Z. Dong et al., "A survey of large language models," arXiv:2303.18223, 2023. · arXiv
  5. J. Li, D. Li, S. Savarese, and S. C. H. Hoi, "Blip-2: Boot- strapping language-image pre-training with frozen image encoders and large language models," in International Con- ference on Machine Learning, 2023, pp. 19 730-19 742.
  6. K. Singhal, S. Azizi, T. Tu, S. S. Mahdavi, J. Wei, H. W. Chung, N. Scales, A. Tanwani, H. Cole-Lewis, S. Pfohl et al., "Large language models encode clinical knowledge," Nature, vol. 620, no. 7972, pp. 172-180, 2023.
  7. I. Singh, V. Blukis, A. Mousavian, A. Goyal, D. Xu, J. Trem- blay, D. Fox, J. Thomason, and A. Garg, "Progprompt: Generating situated robot task plans using large language models," in 2023 IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 11 523-11 530.
  8. L. Yang, H. Chen, Z. Li, X. Ding, and X. Wu, "Give us the facts: Enhancing large language models with knowledge graphs for fact-aware language modeling," IEEE Transac- tions on Knowledge and Data Engineering, pp. 1-20, 2024.
  9. S. Sanner, K. Balog, F. Radlinski, B. Wedin, and L. Dixon, "Large language models are competitive near cold-start recommenders for language-and item-based preferences," in Proceedings of the 17th ACM Conference on Recommender Systems, 2023, pp. 890-896.
  10. L. Wu, Z. Zheng, Z. Qiu, H. Wang, H. Gu, T. Shen, C. Qin, C. Zhu, H. Zhu, Q. Liu et al., "A survey on large language models for recommendation," arXiv:2305.19860, 2023. · arXiv
  11. Z. Zhao, W. Fan, J. Li, Y. Liu, X. Mei, Y. Wang, Z. Wen, F. Wang, X. Zhao, J. Tang, and Q. Li, "Recommender systems in the era of large language models (llms)," IEEE Trans. Knowl. Data Eng., pp. 1-20, 2024.
  12. K. Bao, J. Zhang, Y. Zhang, W. Wang, F. Feng, and X. He, "Tallrec: An effective and efficient tuning framework to align large language model with recommendation," in Proceedings of the 17th ACM Conference on Recommender Systems, 2023, p. 1007-1014.
  13. J. Zhang, K. Bao, Y. Zhang, W. Wang, F. Feng, and X. He, "Is chatgpt fair for recommendation? evaluating fairness in large language model recommendation," in Proceedings of the 17th ACM Conference on Recommender Systems, 2023, pp. 993-999.
  14. Y. Koren, R. Bell, and C. Volinsky, "Matrix factorization techniques for recommender systems," Computer, vol. 42, no. 8, pp. 30-37, 2009.
  15. R. He and J. McAuley, "Ups and downs: Modeling the visual evolution of fashion trends with one-class collab- orative filtering," in proceedings of the 25th international conference on world wide web, 2016, pp. 507-517.
  16. Y. Zhang, H. DING, Z. Shui, Y. Ma, J. Zou, A. Deoras, and H. Wang, "Language models as recommender systems: Evaluations and limitations," in I (Still) Can't Believe It's Not Better! NeurIPS 2021 Workshop, 2021.
  17. S. Dai, N. Shao, H. Zhao, W. Yu, Z. Si, C. Xu, Z. Sun, X. Zhang, and J. Xu, "Uncovering chatgpt's capabilities in recommender systems," in Proceedings of the 17th ACM Conference on Recommender Systems, 2023, p. 1126-1132.
  18. Y. Gao, T. Sheng, Y. Xiang, Y. Xiong, H. Wang, and J. Zhang, "Chat-rec: Towards interactive and explainable llms-augmented recommender system," arXiv, 2023.
  19. W.-C. Kang, J. Ni, N. Mehta, M. Sathiamoorthy, L. Hong, E. Chi, and D. Z. Cheng, "Do llms understand user pref- erences? evaluating llms on user rating prediction," arXiv, 2023.
  20. K. Bao, J. Zhang, W. Wang, Y. Zhang, Z. Yang, Y. Luo, F. Feng, X. He, and Q. Tian, "A bi-step grounding paradigm for large language models in recommendation systems," arXiv:2308.08434, 2023. · arXiv
  21. J. Zhang, R. Xie, Y. Hou, W. X. Zhao, L. Lin, and J.-R. Wen, "Recommendation as instruction following: A large language model empowered recommendation approach," arXiv:2305.07001, 2023. · arXiv
  22. J. Lin, R. Shan, C. Zhu, K. Du, B. Chen, S. Quan, R. Tang, Y. Yu, and W. Zhang, "Rella: Retrieval-enhanced large language models for lifelong sequential behavior compre- hension in recommendation," in The Web Conference 2024.
  23. X. Li, B. Chen, L. Hou, and R. Tang, "Ctrl: Connect tabular and language model for ctr prediction," arXiv, 2023.
  24. L. Wu, X. He, X. Wang, K. Zhang, and M. Wang, "A survey on accuracy-oriented neural recommendation: From col- laborative filtering to information-rich recommendation," IEEE Trans. Knowl. Data Eng., vol. 35, pp. 4425-4445, 2023.
  25. X. Luo, Y. Zhou, Z. Liu, and M. Zhou, "Fast and accurate non-negative latent factor analysis of high-dimensional and sparse matrices in recommender systems," IEEE Trans. Knowl. Data Eng., vol. 35, no. 4, pp. 3897-3911, 2023.
  26. G. Delétang, A. Ruoss, P.-A. Duquenne, E. Catt, T. Ge- newein, C. Mattern, J. Grau-Moya, L. K. Wenliang, M. Aitchison, L. Orseau et al., "Language modeling is compression," arXiv:2309.10668, 2023. · arXiv
  27. J. Xu, H. Zhou, C. Gan, Z. Zheng, and L. Li, "Vocabulary learning via optimal transport for neural machine transla- tion," in ACL/IJCNLP 2021, 2021, pp. 7361-7373.
  28. X. He, K. Deng, X. Wang, Y. Li, Y. Zhang, and M. Wang, "Lightgcn: Simplifying and powering graph convolution network for recommendation," in Proceedings of the 43rd International ACM SIGIR conference on research and develop- ment in Information Retrieval, 2020, pp. 639-648.
  29. J. Lin, X. Dai, Y. Xi, W. Liu, B. Chen, X. Li, C. Zhu, H. Guo, Y. Yu, R. Tang et al., "How can recommender systems benefit from large language models: A survey," arXiv:2306.05817, 2023. · arXiv
  30. Q. Ai, T. Bai, Z. Cao, Y. Chang, J. Chen, Z. Chen, Z. Cheng, S. Dong, Z. Dou, F. Feng et al., "Information retrieval meets large language models: A strategic report from chinese ir community," AI Open, vol. 4, pp. 80-90, 2023.
  31. J. Liu, C. Liu, R. Lv, K. Zhou, and Y. Zhang, "Is chatgpt a good recommender? a preliminary study," arXiv:2304.10149, 2023. · arXiv
  32. Y. Feng, S. Liu, Z. Xue, Q. Cai, L. Hu, P. Jiang, K. Gai, and F. Sun, "A large language model enhanced conversational recommender system," CoRR, vol. abs/2308.06212, 2023. · arXiv
  33. X. Huang, J. Lian, Y. Lei, J. Yao, D. Lian, and X. Xie, "Rec- ommender ai agent: Integrating large language models for interactive recommendations," arXiv:2308.16505, 2023. · arXiv
  34. J. Wei, J. Wei, Y. Tay, D. Tran, A. Webson, Y. Lu, X. Chen, H. Liu, D. Huang, D. Zhou et al., "Larger language models do in-context learning differently," arXiv:2303.03846, 2023. · arXiv
  35. Y. Zhu, L. Wu, Q. Guo, L. Hong, and J. Li, "Collabora- tive large language model for recommender systems," in Proceedings of the ACM on Web Conference 2024, 2024, pp. 3162-3172.
  36. B. Zheng, Y. Hou, H. Lu, Y. Chen, W. X. Zhao, M. Chen, and J.-R. Wen, "Adapting large language models by inte- grating collaborative semantics for recommendation," in 2024 IEEE 40th International Conference on Data Engineering (ICDE). IEEE, 2024, pp. 1435-1448.
  37. A. Muhamed, I. Keivanloo, S. Perera, J. Mracek, Y. Xu, Q. Cui, S. Rajagopalan, B. Zeng, and T. Chilimbi, "Ctr-bert: Cost-effective knowledge distillation for billion-parameter teacher models," in NeurIPS Efficient Natural Language and Speech Processing Workshop, 2021.
  38. S. Wu, H. Fei, L. Qu, W. Ji, and T.-S. Chua, "Next-gpt: Any- to-any multimodal llm," arXiv:2309.05519, 2023. · arXiv
  39. D. Zhu, J. Chen, X. Shen, X. Li, and M. Elhoseiny, "MiniGPT-4: Enhancing vision-language understanding with advanced large language models," in The Twelfth International Conference on Learning Representations, 2024.
  40. D. Zhang, S. Li, X. Zhang, J. Zhan, P. Wang, Y. Zhou, and X. Qiu, "SpeechGPT: Empowering large language mod- els with intrinsic cross-modal conversational abilities," in EMNLP, 2023.
  41. D. Driess, F. Xia, M. S. M. Sajjadi, C. Lynch, A. Chowd- hery, B. Ichter, A. Wahid, J. Tompson, Q. Vuong, T. Yu, W. Huang, Y. Chebotar, P. Sermanet, D. Duckworth, S. Levine, V. Vanhoucke, K. Hausman, M. Toussaint, K. Gr- eff, A. Zeng, I. Mordatch, and P. Florence, "Palm-e: an embodied multimodal language model," in Proceedings of the 40th International Conference on Machine Learning, 2023.
  42. E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, "Lora: Low-rank adaptation of large language models," in ICLR, 2022.
  43. I. Gim, G. Chen, S.-s. Lee, N. Sarda, A. Khandelwal, and L. Zhong, "Prompt cache: Modular attention reuse for low- latency inference," arXiv:2311.04934, 2023. · arXiv
  44. F. M. Harper and J. A. Konstan, "The movielens datasets: History and context," Acm transactions on interactive intelli- gent systems (tiis), vol. 5, no. 4, pp. 1-19, 2015.
  45. W. Wang, Y. Xu, F. Feng, X. Lin, X. He, and T.-S. Chua, "Dif- fusion recommender model," in SIGIR, 2023, p. 832-841.
  46. Y. Ji, A. Sun, J. Zhang, and C. Li, "A critical study on data leakage in recommender system offline evaluation," ACM Trans. Inf. Syst., vol. 41, no. 3, pp. 75:1-75:27, 2023.
  47. Y. Zhang, F. Feng, C. Wang, X. He, M. Wang, Y. Li, and Y. Zhang, "How to retrain recommender system? a sequential meta-learning method," in Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2020, pp. 1479-1488.
  48. Y. Liu, Q. Liu, Y. Tian, C. Wang, Y. Niu, Y. Song, and C. Li, "Concept-aware denoising graph neural network for micro-video recommendation," in Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 2021, pp. 1099-1108.
  49. W.-C. Kang and J. McAuley, "Self-attentive sequential rec- ommendation," in ICDM, 2018, pp. 197-206.
  50. G. Zhou, X. Zhu, C. Song, Y. Fan, H. Zhu, X. Ma, Y. Yan, J. Jin, H. Li, and K. Gai, "Deep interest network for click- through rate prediction," in Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, 2018, pp. 1059-1068.
  51. Z. Zhang and B. Wang, "Prompt learning for news rec- ommendation," in Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2023, pp. 227-237.
  52. J. Devlin, M. Chang, K. Lee, and K. Toutanova, "BERT: pre- training of deep bidirectional transformers for language understanding," in NAACL-HLT, 2019, pp. 4171-4186.
  53. S. Geng, S. Liu, Z. Fu, Y. Ge, and Y. Zhang, "Recommenda- tion as language processing (rlp): A unified pretrain, per- sonalized prompt & predict paradigm (p5)," in Proceedings of the 16th ACM Conference on Recommender Systems, 2022, pp. 299-315.
  54. D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization," in ICLR, 2015.
  55. T. G. Dietterich, "Ensemble methods in machine learn- ing," in International workshop on multiple classifier systems. Springer, 2000, pp. 1-15.
  56. Y. Xu, L. Zhu, Z. Cheng, J. Li, Z. Zhang, and H. Zhang, "Multi-modal discrete collaborative filtering for efficient cold-start recommendation," IEEE Transactions on Knowl- edge and Data Engineering, vol. 35, no. 1, pp. 741-755, 2023.
  57. A. Yang, B. Yang, B. Hui, B. Zheng, B. Yu, C. Zhou, C. Li, C. Li, D. Liu, F. Huang et al., "Qwen2 technical report," arXiv preprint arXiv:2407.10671, 2024. · arXiv

Cited by

Sorted by citations

Metadata

Authors
Zhang, Y., Feng, F., Zhang, J., Bao, K., Wang, Q., & He, X.
Affiliations
  • University of Science and Technology of China (CN)
  • Meta (United States) (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
Volume
37
Issue
5
Pages
2329-2340
ISSN
1041-4347 (ISSN-L)
DOI
10.48550/arxiv.2310.19488
arXiv
2310.19488
OpenAlex
W4407403520
Cited by
146
References
0
Citations by year
2026: 54 · 2025: 68 · 2024: 24
FWCI
78.42
Type
journal article
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • IEEE Transactions on Knowledge and Data Engineering (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
National Natural Science Foundation of China (62121002, U24B20180)
Topics
  • Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
Keywords
collaborative information, collaborative filtering, cold-start users, user-item interactions, embedding alignment, hybrid recommendation model, user preference modeling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review