When large language models meet personalization: perspectives of challenges and opportunities
Open accessThe DOI matches its Crossref record; 329 of the 329 references it cites were found in a registry or an index; 90 of the 219 sources its claims cite were checked for support.
Abstract
Perspective paper arguing that LLMs change personalization from passive recommendation to active, tool-using personalized assistance.
Overview
CoChat Summary
TL;DR
This perspective/survey paper examines how large language models can be integrated into personalization systems, shifting from passive recommendation toward active, tool-augmented assistance. It maps LLM roles across personalization and outlines open challenges in deployment, model capacity, and evaluation.
Key findings
- The paper organizes LLM use for personalization into roles including knowledge base, content interpreter, explainer, common system reasoner, conversational agent, tool-learning, and personalized content creator, arguing for a progression from low-level capability use to complex tool integration.
- Zero-shot and few-shot LLM recommenders show some capability, with few-shot learners performing better than zero-shot, but the paper reports a substantial gap compared with traditional recommenders and finetuned LLMs such as P5 and M6-Rec.
- In the knowledge-base role, LLMs can support knowledge graph completion and construction, but hallucination/ambiguity remains a challenge; on the KoLA benchmark, top-ranked GPT-4 achieves 0.012 Precision and 0.013 Recall on Named Entity Recognition, versus 0.712 Precision and 0.706 Recall for the task-specific model PL-Marker.
- Open challenges include scaling computational resources, achieving efficient response times, laborious data collection, long-text modeling (e.g., ChatGPT’s 4096-token context window), interpretability/explainability, evaluation metrics, and trade-offs among helpfulness, honesty, and harmlessness.
Methods
- This is a perspective/survey paper; the Data Availability statement says no datasets were generated or analysed.
- The main analysis is a narrative synthesis of personalization techniques and LLM capabilities, with tables summarizing datasets, tasks, and approaches (e.g., LLMs as knowledge base, content interpreter, zero/few-shot learners, and tool-learning approaches).
- No experimental design, statistical analysis, or primary empirical evaluation is reported.
Limitations
- The paper states open challenges: deployment difficulties (computational resources, response time, data collection), LLM capacities (long text modeling, interpretability/explainability), and evaluation (metrics, helpfulness/honesty/harmlessness trade-off).
- It notes that LLMs are black boxes, explanations may be insincere or inconsistent with recommendations, and training-data biases/errors can affect recommendations.
- Evident from the text: as a perspective/survey, it does not provide primary empirical validation, and the Data Availability statement confirms no datasets were generated or analysed.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
59 Valid · 50 Not valid · 48 Not checked · 105 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“According to the KoLA [84], a benchmark for evaluating word knowledge of LLMs, even the top-ranked GPT4 just achieves 0.012 in Precision and 0.013 in Recall on the task Named Entity Recognition , which falls far short of the performance (0.712 in Precision and 0.706 in Recall) of the task-specific models PL-Marker [85].”
What the sources say
- Disputedcites [84] Yu, J., Wang, X., Tu, S., Cao, S., Zhang-Li, D., Lv, X., Peng, H., Yao, Z., Zhang, X., Li, H., et al.: Kola: Carefully benchmarking world knowledge of large language models. arXiv:2306.09296 (2023) sourceExperimental — accuracy not yet measured
Table 32 (absolute performance on FewNERD task 2-4; page unavailable) reports GPT-4 precision of 12.4% and recall of 14.5%, not the claimed 0.012 and 0.013. Our copy does not report the stated PL-Marker comparison. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [85] Ye, D., Lin, Y., Li, P., Sun, M.: Packed levitated marker for entity and relation extraction. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (vol. 1: long papers), pp. 4904–4917 (2022) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
Every source the paper cites for this claim was checked and supports it.
In the paper
“With the development of large language models, there is an observation that LLMs exhibit reasoning abilities [2, 161] when they are sufficiently large, which is fundamental for human intelligence for decision-making and problem-solving.”
What the sources say
- Supportedcites [2] Huang, J., Chang, K.C.-C.: Towards reasoning in large language models: a survey. arXiv:2212.10403 (2022) source
The Introduction says large language models have been shown to exhibit emergent behaviors, including the ability to “reason,” when large enough. Section 5 likewise reports that reasoning ability appears to emerge at a certain scale. The paper cautions that this observed performance does not establish whether LLMs truly reason, but the citing sentence describes it as an observation. (LLM, conf=0.91)
- Supportedcites [161] Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al.: Emergent abilities of large language models. arXiv:2206.07682 (2022) source
Section 2 (p. 2) defines emergent abilities as appearing in larger models but not smaller ones. Section 4 (p. 5) gives multi-step reasoning as an example: chain-of-thought prompting improves performance only at a sufficiently large scale. The paper also notes that scale is not the only factor in emergence. (LLM, conf=0.91)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In-context learning [167-173] is one of the emergent abilities of LLMs that differentiate LLMsfrompreviouspre-trainedlanguagemodels,where,givenanaturallanguageinstruction and task demonstrations, LLMs would generate the output by completing the word sequence without training or tuning [3].”
What the sources say
- Partly supportedcites [167] Dong, Q., Li, L., Dai, D., Zheng, C., Wu, Z., Chang, B., Sun, X., Xu, J., Sui, Z.: A survey for in-context learning. arXiv:2301.00234 (2022) sourceExperimental — accuracy not yet measured
The Introduction (p. 1) describes in-context learning as an emerging ability of LLMs, and §5.1.1 (p. 6) says pretrained models may acquire emergent ICL abilities at large scale. The paper does not establish the broader comparison that ICL differentiates LLMs from previous pretrained language models as a class. (LLM, conf=0.82)
- Partly supportedcites [168] Dai, D., Sun, Y., Dong, L., Hao, Y., Sui, Z., Wei, F.: Why can gpt learn in-context? language models secretly perform gradient descent as meta optimizers. arXiv:2212.10559 (2022) sourceExperimental — accuracy not yet measured
The Introduction describes in-context learning as a strong emergent ability of large pretrained language models. It does not establish the claimed distinction from previous pretrained language models; its comparison concerns performance against smaller models with supervised finetuning. (LLM, conf=0.82)
- Partly supportedcites [169] Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., Zettlemoyer, L.: Rethinking the role of demonstrations: What makes in-context learning work?. arXiv:2202.12837 (2022) sourceExperimental — accuracy not yet measured
The Introduction (§1) identifies in-context learning as inference from demonstrations by large language models, and Related Work (§2) says it occurs without gradient updates. Neither passage establishes that it is an emergent ability distinguishing LLMs from earlier pre-trained language models; the paper also includes GPT-2 Large among the models it studies (§2). Page numbers are unavailable in our copy. (LLM, conf=0.83)
- Partly supportedcites [170] Levy, I., Bogin, B., Berant, J.: Diverse demonstrations improve in-context compositional generalization. arXiv:2212.06800 (2022) sourceExperimental — accuracy not yet measured
The Introduction describes in-context learning as few-shot inference in which large language models use prompts containing examples. Section 3.4 says that “pure” in-context learning keeps model parameters frozen and has largely been restricted to very large language models. The paper does not establish that in-context learning is an emergent ability that differentiates LLMs from earlier pretrained language models. (LLM, conf=0.84)
- Not matchedcites [171] Xie, S.M., Raghunathan, A., Liang, P., Ma, T.: An explanation of in-context learning as implicit bayesian inference. In: International Conference on Learning Representations
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites [172] Olsson, C., Elhage, N., Nanda, N., Joseph, N., DasSarma, N., Henighan, T., Mann, B., Askell, A., Bai, Y., Chen, A., et al.: In-context learning and induction heads. arXiv:2209.11895 (2022) sourceExperimental — accuracy not yet measured
The In-context Learning section (p. 4) calls in-context learning emergent and describes models adapting to tasks through prompts without retraining. It does not establish that this ability differentiates LLMs from previous pre-trained language models; it says emergent in-context learning was already noted in GPT-2. (LLM, conf=0.86)
- Partly supportedcites [173] Akyürek, E., Schuurmans, D., Andreas, J., Ma, T., Zhou, D.: What learning algorithm is in-context learning? investigations with linear models. arXiv:2211.15661 (2022) sourceExperimental — accuracy not yet measured
The Introduction (p. 1) describes in-context learning as a surprising behavior observed in large language models, and §2.2 (p. 3) says it can emerge in models trained on general text. The paper does not say that this ability differentiates LLMs from previous pre-trained language models. (LLM, conf=0.83)
- Supportedcites [3] Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al.: Language models are few-shot learners. Adv. Neural. Inf. Process. Syst. 33, 1877–1901 (2020) source
The citation to Brown et al. is attached to the description of how in-context learning works. The Introduction (p. 3) says a pretrained language model can be conditioned on an instruction and/or demonstrations and complete further instances by predicting what comes next; Related Work (p. 40) says this occurs without updating the weights. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Thanks to LLMs' remarkable generative ability in language tasks, they are ideal for tackling the aforementioned challenges [152].”
What the sources say
- Partly supportedcites [152] Bommasani, R., Hudson, D.A., Adeli, E., Altman, R., Arora, S., Arx, S., Bernstein, M.S., Bohg, J., Bosselut, A., Brunskill, E., et al.: On the opportunities and risks of foundation models. arXiv:2108.07258 (2021) sourceExperimental — accuracy not yet measured
Section 2.1 (p. 22) describes highly coherent language generation and says generative models have become a primary tool in NLP. Section 2.5 (p. 44) says their generative capabilities could help address challenges, but qualifies this by saying success depends on how effectively the models can be used. That supports their potential, not the unqualified assertion that LLMs are ideal for the unspecified challenges. (LLM, conf=0.83)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“In addition to valuing the suggestions made by a recommendation model, users are also interested in the comprehensible justifications for these recommendations [124, 125].”
What the sources say
- Not checked — no full text of the sourcecites [124] Wang, X., Chen, Y., Yang, J., Wu, L., Wu, Z., Xie, X.: A reinforcement learning framework for explainable recommendation. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 587–596 (2018). IEEE source
- Supportedcites [125] Gao, J., Wang, X., Wang, Y., Xie, X.: Explainable recommendation through attentive multi-view learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 3622–3629 (2019) source
The Introduction (p. 1) treats explanations of why an item is recommended as important and says they may help users make better decisions. It also identifies generating explanations that ordinary users can understand as a goal; the Study on Explainability (p. 7) evaluates their usefulness to users. (LLM, conf=0.89)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
44 more claims · 10 with their cited sources checked
Create a free account to see all 262 claims and to verify the 82 references still open.
- Probably not a substantial claim. 179
- It may state two separate claims as one. 91
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Large Language Models (LLMs) have made significant progress in open-ended dialogue, yet their inability to retain and retrieve relevant information from long-term interactions limits their effectiveness in applications requiring sustained personalization.”
From In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents (2025) · cites this paper as Chen et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“yet their inherent statelessness poses a significant challenge for maintaining coherent, personalized conversations over time (Chen et al., 2024; Li et al., 2024b; Tseng et al., 2024)”
From In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents (2025) · cites this paper as Chen et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 8 LLMs as conversational agent
“and RLHF proposed in InstructGPT [3].”
§ 8 LLMs as conversational agent
“models like InstructGPT [37]”
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“Early work [139–141] mainly relied on recurrent neural networks (e.g., LSTM [142], GRU [143]).”
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472 · cited 1×
“As the generative model evolves, it eventually emerges as the transformer architecture [23], acting as the foundational blocks for BERT [256] and GPT [206] in the field of NLP, and for Vision Transformer (ViT) [257] and Swin Transformer [258] in the field of CV.”
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534 · cited 2×
“As the generative model evolves, it eventually emerges as the transformer architecture [23], acting as the foundational blocks for BERT [256] and GPT [206] in the field of NLP, and for Vision Transformer (ViT) [257] and Swin Transformer [258] in the field of CV.”
Self-citationEfficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302 · cited 2×
“Visual ChatGPT[228] combines visual foundation models like BLIP [231], Stable Diffusion [232], etc.”
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Research works printed but not linked: 17
- Bengio, Y., Ducharme, R., Vincent, P.: A neural probabilistic language model. Adv. Neural. Inf. Process. Syst. 13 (2000)
- Kenton, J.D.M.-W.C., Toutanova, L.K.: Bert: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of NAACL-HLT, pp. 4171–4186 (2019)
- Yu, X., Ren, X., Gu, Q., Sun, Y., Han, J.: Collaborative filtering with entity similarity regularization in heterogeneous information networks. IJCAI HINA 27 (2013)
- Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. Adv. Neural. Inf. Process. Syst. 26 (2013)
- Le, Q.V., Mikolov, T.: Distributed representations of sentences and documents. In: ICML. JMLR Workshop and Conference Proceedings, vol. 32, pp. 1188–1196. JMLR.org (2014)
- Kumar, V., Khattar, D., Gupta, S., Gupta, M., Varma, V.: Deep neural architecture for news recommendation. In: CLEF (Working Notes). CEUR Workshop Proceedings, vol. 1866. CEUR-WS.org (2017)
- Liu, Q., Zhu, J., Dai, Q., Wu, X.: Boosting deep ctr prediction with a plug-and-play pre-trainer for news recommendation. In: Proceedings of the 29th International Conference on Computational Linguistics, pp. 2823–2833 (2022)
- Muhamed, A., Keivanloo, I., Perera, S., Mracek, J., Xu, Y., Cui, Q., Rajagopalan, S., Zeng, B., Chilimbi, T.: Ctr-bert: cost-effective knowledge distillation for billion-parameter teacher models. In: NeurIPS Efficient Natural Language and Speech Processing Workshop (2021)
- Bills, S., Cammarata, N., Mossing, D., Tillman, H., Gao, L., Goh, G., Sutskever, I., Leike, J., Wu, J., Saunders, W.: Language models can explain neurons in language models (2023)
- Xie, S.M., Raghunathan, A., Liang, P., Ma, T.: An explanation of in-context learning as implicit bayesian inference. In: International Conference on Learning Representations
- Qiu, X., Huang, X.: Convolutional neural tensor network architecture for community-based question answering. In: Twenty-Fourth International Joint Conference on Artificial Intelligence (2015)
- Zhou, H., Huang, M., Zhu, X.: Context-aware natural language generation for spoken dialogue systems. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 2032–2041 (2016)
- Li, J., Li, D., Xiong, C., Hoi, S.: Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. In: International Conference on Machine Learning, pp. 12888–12900 (2022). PMLR
- Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. Adv. Neural. Inf. Process. Syst. 27 (2014)
- Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al.: Learning transferable visual models from natural language supervision. In: International Conference on Machine Learning, pp. 8748–8763 (2021). PMLR
- Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., Chen, M., Sutskever, I.: Zero-shot text-to-image generation. In: International Conference on Machine Learning, pp. 8821–8831 (2021). PMLR
- Hu, E.J., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., Chen, W., et al.: Lora: low-rank adaptation of large language models. In: International Conference on Learning Representations (2021)
Cited by
A Survey on Large Language Models for Recommendation
Wu, L., Zheng, Z., Qiu, Z., Wang, H., Gu, H., Shen, T., Qin, C., Zhu, C., Zhu, H., Liu, Q., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.19860 · Cited by 515
Self-citationA survey on large language models for recommendation
Wu, L., Zheng, Z., Qiu, Z., Wang, H., Gu, H., Shen, T., Qin, C., Zhu, C., Zhu, H., Liu, Q., et al. (2024) · World Wide Web · doi:10.1007/s11280-024-01291-2 · Cited by 515
Self-citationHow Can Recommender Systems Benefit from Large Language Models: A Survey
Lin, J., Dai, X., Xi, Y., Liu, W., Chen, B., Zhang, H., Liu, Y., Wu, C., Li, X., Zhu, C., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3678004 · Cited by 242
Self-citationIndustrial applications of large language models
Raza, M., Jahangir, Z., Riaz, M. B., Saeed, M. J., & Sattar, M. A. (2025) · Scientific Reports · doi:10.1038/s41598-025-98483-1 · Cited by 163
“Jin et al., 65 discuss the applications of LLMs in human computer interaction, personalization systems and recommendation system.”
A survey of personalized large language models: progress and future directions
Liu, J., Qiu, Z., Li, Z., Dai, Q., Yu, W., Zhu, J., Hu, M., Yang, M., Chua, T.-S., & King, I. (2025) · arXiv · doi:10.48550/arxiv.2502.11528 · Cited by 146
Metadata
- Authors
- Chen, J., Liu, Z., Huang, X., Wu, C., Liu, Q., Jiang, G., Pu, Y., Lei, Y., Chen, X., Wang, X., Zheng, K., Lian, D., & Chen, E.
- Affiliations
- Beijing Academy of Artificial Intelligence (CN)
- University of Science and Technology of China (CN)
- University of Electronic Science and Technology of China (CN)
- Corresponding author
- Liu, Zheng
- Huang, Xu
- Wu, Chenwang
- Liu, Qi
- Jiang, Gangwei
- Pu, Yuanhao
- Lei, Yuxuan
- Chen, Xiaolong
- Wang, Xingmei
- Zheng, Kai
- Lian, Defu
- Chen, Enhong
- Venue
- World Wide Web
- Published
- 2024-06-28
- Volume
- 27
- Issue
- 4
- ISSN
- 1386-145X (ISSN-L)
- 1573-1413
- OpenAlex
- W4400118952
- Cited by
- 367
- References
- 236
- Citations by year
- 2026: 126 · 2025: 194 · 2024: 43
- FWCI
- 135.88
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- World Wide Web (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Hong Kong University of Science and Technology
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- large language models, personalization, personalized services, human-AI interaction, tool calling, function calling, recommender systems, search engines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: When large language models meet personalization: perspectives of challenges and opportunities. https://app.cochat.ai/papers/10.1007/s11280-024-01276-1
- The paper
- Chen, J., Liu, Z., Huang, X., Wu, C., Liu, Q., Jiang, G., Pu, Y., Lei, Y., Chen, X., Wang, X., Zheng, K., Lian, D., & Chen, E. (2024). When large language models meet personalization: perspectives of challenges and opportunities. World Wide Web. https://doi.org/10.1007/s11280-024-01276-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.





