CoChat
Sign Up
PreprintCited by 1Recommender Systems and TechniquesInformation Retrieval and Search BehaviorTopic Modeling

Bridging the Gap: Self-Optimized Fine-Tuning for LLM-based Recommender Systems

Open access
Tang, Heng, Liu, Feng, Chen, Xinbo, Chen, Jiawei, Wang, Bohao, Zhang, Changwang, Wang, Jun, Sun, Yuegang +2 more·2025·arXiv
DOI 10.48550/arxiv.2505.20771arXiv 2505.20771
Open this paper in CoChat — free accountOpen PDF

Abstract

Recent years have witnessed extensive exploration of Large Language Models (LLMs) on the field of Recommender Systems (RS). There are currently two commonly used strategies to enable LLMs to have recommendation capabilities: 1) The "Guidance-Only" strategy uses in-context learning to exploit and amplify the inherent semantic understanding and item recommendation capabilities of LLMs; 2) The "Tuning-Only" strategy uses supervised fine-tuning (SFT) to fine-tune LLMs with the aim of fitting them to real recommendation data. However, neither of these strategies can effectively bridge the gap between the knowledge space of LLMs and recommendation, and their performance do not meet our expectations. To better enable LLMs to learn recommendation knowledge, we combine the advantages of the above two strategies and proposed a novel "Guidance+Tuning" method called Self-Optimized Fine-Tuning (SOFT), which adopts the idea of curriculum learning. It first employs self-distillation to construct an auxiliary easy-to-learn but meaningful dataset from a fine-tuned LLM. Then it further utilizes a self-adaptive curriculum scheduler to enable LLMs to gradually learn from simpler data (self-distilled data) to more challenging data (real RS data). Extensive experiments demonstrate that SOFT significantly enhances the recommendation accuracy (37.59\% on average) of LLM-based methods. The code is available via https://anonymous.4open.science/r/Self-Optimized-Fine-Tuning-264E

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2505.20771

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In recommendation systems, self-optimized fine-tuning enables LLM-based recommender systems to learn from their own successful recommendation patterns, creating a feedback loop that enhances personalization over time.

    “In recommendation systems, techniques such as self-optimized fine-tuning (Tang et al., 2025) enable LLM-based recommender systems to learn from their own successful recommendation patterns, creating a feedback loop that enhances personalization over time.”

    From A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence (2025) · cites this paper as Tang et al., 2025

    Section 3.1 describes using a fine-tuned LLM’s own outputs to create training data, and Section 3.2 describes adapting the training curriculum to the model’s progress. The paper does not say it selects successful recommendations to learn from or establishes an ongoing feedback loop that improves personalization over time; it reports improved recommendation performance from fine-tuning. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • The system generates high-quality recommendation demonstrations from successful user interactions and uses these to fine-tune the underlying language model, ultimately leading to more accurate and personalized recommendations.

    “The system generates highquality recommendation demonstrations from successful user interactions and uses these to fine-tune the underlying language model, ultimately leading to more accurate and personalized recommendations.”

    From A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence (2025) · cites this paper as Tang et al., 2025

    Section 3.1 describes using a fine-tuned LLM’s outputs on user-history inputs to construct an auxiliary dataset for further training, and Section 4.2 reports improved recommendation performance. But the paper calls these outputs easy-to-learn data, not high-quality demonstrations selected from successful user interactions; the Introduction reports that exact-item prediction accuracy was below 1%. (LLM, conf=0.87)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 34

  1. Keqin Bao, Jizhi Zhang, Wenjie Wang, Yang Zhang, Zhengyi Yang, Yancheng Luo, Chong Chen, Fuli Feng, and Qi Tian. 2023. A bi-step grounding paradigm for large language models in recommenda- tion systems. arXiv preprint arXiv:2308.08434. · arXiv
  2. Yoshua Bengio, Jérôme Louradour, Ronan Collobert, and Jason Weston. 2009. Curriculum learning. In ICML, pages 41-48.
  3. Jianxin Chang, Chen Gao, Yu Zheng, Yiqun Hui, Yanan Niu, Yang Song, Depeng Jin, and Yong Li. 2021. Sequential recommendation with graph neural net- works. In Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval, pages 378-387.
  4. Huayu Chen, Guande He, Lifan Yuan, Ganqu Cui, Hang Su, and Jun Zhu. 2024a. Noise contrastive align- ment of language models with explicit rewards. arXiv preprint arXiv:2402.05369. · arXiv
  5. Yuxin Chen, Junfei Tan, An Zhang, Zhengyi Yang, Leheng Sheng, Enzhi Zhang, Xiang Wang, and Tat- Seng Chua. 2024b. On softmax direct preference optimization for recommendation. arXiv preprint arXiv:2406.09215. · arXiv
  6. Yu Cui, Feng Liu, Pengbo Wang, Bohao Wang, Heng Tang, Yi Wan, Jun Wang, and Jiawei Chen. 2024. Distillation matters: empowering sequential recom- menders to match the performance of large language models. In RecSys, pages 507-517.
  7. Tommaso Furlanello, Zachary Lipton, Michael Tschan- nen, Laurent Itti, and Anima Anandkumar. 2018. Born again neural networks. In ICML, pages 1607- 1616.
  8. Yunfan Gao, Tao Sheng, Youlin Xiang, Yun Xiong, Haofen Wang, and Jiawei Zhang. 2023. Chat- rec: Towards interactive and explainable llms- augmented recommender system. arXiv preprint arXiv:2303.14524. · arXiv
  9. Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, and 1 others. 2024. The llama 3 herd of models. arXiv preprint arXiv:2407.21783. · arXiv
  10. B Hidasi. 2015. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939. · arXiv
  11. Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021. Lora: Low-rank adap- tation of large language models. arXiv preprint arXiv:2106.09685. · arXiv
  12. Jiaxin Huang, Shixiang Shane Gu, Le Hou, Yuexin Wu, Xuezhi Wang, Hongkun Yu, and Jiawei Han. 2022. Large language models can self-improve. arXiv preprint arXiv:2210.11610. · arXiv
  13. Wang-Cheng Kang and Julian McAuley. 2018. Self- attentive sequential recommendation. In ICDM, pages 197-206. IEEE.
  14. Sein Kim, Hongseok Kang, Seungyoon Choi, Donghyun Kim, Minchul Yang, and Chanyoung Park. 2024. Large language models meet collaborative fil- tering: An efficient all-round llm-based recommender system. In SIGKDD, pages 1395-1406.
  15. Lei Li, Yongfeng Zhang, and Li Chen. 2023. Prompt distillation for efficient llm-based recommendation. In CIKM, page 1348-1357.
  16. Jiayi Liao, Sihang Li, Zhengyi Yang, Jiancan Wu, Yancheng Yuan, Xiang Wang, and Xiangnan He. 2024. Llara: Large language-recommendation as- sistant. In SIGIR, pages 1785-1795.
  17. Xinyu Lin, Wenjie Wang, Yongqi Li, Shuo Yang, Fuli Feng, Yinwei Wei, and Tat-Seng Chua. 2024. Data- efficient fine-tuning for llm-based recommendation. In SIGIR, pages 365-374.
  18. Qijiong Liu, Nuo Chen, Tetsuya Sakai, and Xiao-Ming Wu. 2024. Once: Boosting content-based recom- mendation with both open-and closed-source large language models. In WSDM, page 452-461.
  19. Rafael Rafailov, Archit Sharma, Eric Mitchell, Christo- pher D Manning, Stefano Ermon, and Chelsea Finn. 2024. Direct preference optimization: Your language model is secretly a reward model. In NeurIPS, vol- ume 36.
  20. Xubin Ren, Wei Wei, Lianghao Xia, Lixin Su, Suqi Cheng, Junfeng Wang, Dawei Yin, and Chao Huang. 2024. Representation learning with large language models for recommendation. In WWW, pages 3464- 3475.
  21. Wentao Shi, Xiangnan He, Yang Zhang, Chongming Gao, Xinyue Li, Jizhi Zhang, Qifan Wang, and Fuli Feng. 2024. Large language models are learnable planners for long-term recommendation. In SIGIR, page 1893-1903.
  22. Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019. Bert4rec: Se- quential recommendation with bidirectional encoder representations from transformer. In CIKM, pages 1441-1450.
  23. Zhiqing Sun, Yikang Shen, Qinhong Zhou, Hongxin Zhang, Zhenfang Chen, David Cox, Yiming Yang, and Chuang Gan. 2024a. Principle-driven self- alignment of language models from scratch with min- imal human supervision. In NeurIPS, volume 36.
  24. Zhongxiang Sun, Zihua Si, Xiaoxue Zang, Kai Zheng, Yang Song, Xiao Zhang, and Jun Xu. 2024b. Large language models enhanced collaborative filtering. In CIKM, pages 2178-2188.
  25. Jiaxi Tang and Ke Wang. 2018. Personalized top-n se- quential recommendation via convolutional sequence embedding. In WSDM, pages 565-573.
  26. Lei Wang and Ee-Peng Lim. 2023. Zero-shot next- item recommendation using large pretrained language models. arXiv preprint arXiv:2304.03153. · arXiv
  27. Xin Wang, Yudong Chen, and Wenwu Zhu. 2021. A survey on curriculum learning. In TPAMI, volume 44, pages 4555-4576. IEEE.
  28. Yizhong Wang, Yeganeh Kordi, Swaroop Mishra, Al- isa Liu, Noah A Smith, Daniel Khashabi, and Han- naneh Hajishirzi. 2022. Self-instruct: Aligning lan- guage models with self-generated instructions. arXiv preprint arXiv:2212.10560. · arXiv
  29. Wei Wei, Xubin Ren, Jiabin Tang, Qinyong Wang, Lixin Su, Suqi Cheng, Junfeng Wang, Dawei Yin, and Chao Huang. 2024. Llmrec: Large language models with graph augmentation for recommendation. In WSDM, pages 806-815.
  30. Yunjia Xi, Weiwen Liu, Jianghao Lin, Xiaoling Cai, Hong Zhu, Jieming Zhu, Bo Chen, Ruiming Tang, Weinan Zhang, and Yong Yu. 2024. Towards open- world recommendation with knowledge augmenta- tion from large language models. In RecSys, pages 12-22.
  31. Shenghao Yang, Weizhi Ma, Peijie Sun, Qingyao Ai, Yiqun Liu, Mingchen Cai, and Min Zhang. 2024a. Se- quential recommendation with latent relations based on large language model. In SIGIR, pages 335-344.
  32. Zhaorui Yang, Tianyu Pang, Haozhe Feng, Han Wang, Wei Chen, Minfeng Zhu, and Qian Liu. 2024b. Self- distillation bridges distribution gap in language model fine-tuning. arXiv preprint arXiv:2402.13669. · arXiv
  33. Zhengyi Yang, Xiangnan He, Jizhi Zhang, Jiancan Wu, Xin Xin, Jiawei Chen, and Xiang Wang. 2023. A generic learning framework for sequential recommen- dation with distribution shifts. In SIGIR, pages 331- 340.
  34. Eric Zelikman, YH Wu, Jesse Mu, and Noah D Good- man. 2024. Star: Self-taught reasoner bootstrapping reasoning with reasoning. In NeurIPS, volume 1126.

Cited by

Sorted by citations

Authors
Tang, H., Liu, F., Chen, X., Chen, J., Wang, B., Zhang, C., Wang, J., Sun, Y., Hu, B., & Wang, C.
Affiliations
  • Zhejiang University (CN)
  • South China University of Technology (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2505.20771
arXiv
2505.20771
OpenAlex
W4415036299
Cited by
0
References
0
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
LLM-based recommender systems, curriculum learning, self-distillation, in-context learning, supervised fine-tuning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review