When large language models meet personalization: perspectives of challenges and opportunities
Open accessThe DOI matches its Crossref record; 329 of the 329 references it cites were found in a registry or an index; 90 of the 219 sources its claims cite were checked for support.
Abstract
Perspective paper arguing that LLMs change personalization from passive recommendation to active, tool-using personalized assistance.
Overview
CoChat Summary
TL;DR
This perspective/survey paper examines how large language models can be integrated into personalization systems, shifting from passive recommendation toward active, tool-augmented assistance. It maps LLM roles across personalization and outlines open challenges in deployment, model capacity, and evaluation.
Key findings
- The paper organizes LLM use for personalization into roles including knowledge base, content interpreter, explainer, common system reasoner, conversational agent, tool-learning, and personalized content creator, arguing for a progression from low-level capability use to complex tool integration.
- Zero-shot and few-shot LLM recommenders show some capability, with few-shot learners performing better than zero-shot, but the paper reports a substantial gap compared with traditional recommenders and finetuned LLMs such as P5 and M6-Rec.
- In the knowledge-base role, LLMs can support knowledge graph completion and construction, but hallucination/ambiguity remains a challenge; on the KoLA benchmark, top-ranked GPT-4 achieves 0.012 Precision and 0.013 Recall on Named Entity Recognition, versus 0.712 Precision and 0.706 Recall for the task-specific model PL-Marker.
- Open challenges include scaling computational resources, achieving efficient response times, laborious data collection, long-text modeling (e.g., ChatGPT’s 4096-token context window), interpretability/explainability, evaluation metrics, and trade-offs among helpfulness, honesty, and harmlessness.
Methods
- This is a perspective/survey paper; the Data Availability statement says no datasets were generated or analysed.
- The main analysis is a narrative synthesis of personalization techniques and LLM capabilities, with tables summarizing datasets, tasks, and approaches (e.g., LLMs as knowledge base, content interpreter, zero/few-shot learners, and tool-learning approaches).
- No experimental design, statistical analysis, or primary empirical evaluation is reported.
Limitations
- The paper states open challenges: deployment difficulties (computational resources, response time, data collection), LLM capacities (long text modeling, interpretability/explainability), and evaluation (metrics, helpfulness/honesty/harmlessness trade-off).
- It notes that LLMs are black boxes, explanations may be insincere or inconsistent with recommendations, and training-data biases/errors can affect recommendations.
- Evident from the text: as a perspective/survey, it does not provide primary empirical validation, and the Data Availability statement confirms no datasets were generated or analysed.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
59 Valid · 50 Not valid · 48 Not checked · 105 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“According to the KoLA [84], a benchmark for evaluating word knowledge of LLMs, even the top-ranked GPT4 just achieves 0.012 in Precision and 0.013 in Recall on the task Named Entity Recognition , which falls far short of the performance (0.712 in Precision and 0.706 in Recall) of the task-specific models PL-Marker [85].”
What the sources say
- Disputedcites [84] Yu, J., Wang, X., Tu, S., Cao, S., Zhang-Li, D., Lv, X., Peng, H., Yao, Z., Zhang, X., Li, H., et al.: Kola: Carefully benchmarking world knowledge of large language models. arXiv:2306.09296 (2023) sourceExperimental — accuracy not yet measured
Table 32 (absolute performance on FewNERD task 2-4; page unavailable) reports GPT-4 precision of 12.4% and recall of 14.5%, not the claimed 0.012 and 0.013. Our copy does not report the stated PL-Marker comparison. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [85] Ye, D., Lin, Y., Li, P., Sun, M.: Packed levitated marker for entity and relation extraction. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (vol. 1: long papers), pp. 4904–4917 (2022) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
Every source the paper cites for this claim was checked and supports it.
In the paper
“With the development of large language models, there is an observation that LLMs exhibit reasoning abilities [2, 161] when they are sufficiently large, which is fundamental for human intelligence for decision-making and problem-solving.”
What the sources say
- Supportedcites [2] Huang, J., Chang, K.C.-C.: Towards reasoning in large language models: a survey. arXiv:2212.10403 (2022) source
The Introduction says large language models have been shown to exhibit emergent behaviors, including the ability to “reason,” when large enough. Section 5 likewise reports that reasoning ability appears to emerge at a certain scale. The paper cautions that this observed performance does not establish whether LLMs truly reason, but the citing sentence describes it as an observation. (LLM, conf=0.91)
- Supportedcites [161] Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al.: Emergent abilities of large language models. arXiv:2206.07682 (2022) source
Section 2 (p. 2) defines emergent abilities as appearing in larger models but not smaller ones. Section 4 (p. 5) gives multi-step reasoning as an example: chain-of-thought prompting improves performance only at a sufficiently large scale. The paper also notes that scale is not the only factor in emergence. (LLM, conf=0.91)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In-context learning [167-173] is one of the emergent abilities of LLMs that differentiate LLMsfrompreviouspre-trainedlanguagemodels,where,givenanaturallanguageinstruction and task demonstrations, LLMs would generate the output by completing the word sequence without training or tuning [3].”
What the sources say
- Partly supportedcites [167] Dong, Q., Li, L., Dai, D., Zheng, C., Wu, Z., Chang, B., Sun, X., Xu, J., Sui, Z.: A survey for in-context learning. arXiv:2301.00234 (2022) sourceExperimental — accuracy not yet measured
The Introduction (p. 1) describes in-context learning as an emerging ability of LLMs, and §5.1.1 (p. 6) says pretrained models may acquire emergent ICL abilities at large scale. The paper does not establish the broader comparison that ICL differentiates LLMs from previous pretrained language models as a class. (LLM, conf=0.82)
- Partly supportedcites [168] Dai, D., Sun, Y., Dong, L., Hao, Y., Sui, Z., Wei, F.: Why can gpt learn in-context? language models secretly perform gradient descent as meta optimizers. arXiv:2212.10559 (2022) sourceExperimental — accuracy not yet measured
The Introduction describes in-context learning as a strong emergent ability of large pretrained language models. It does not establish the claimed distinction from previous pretrained language models; its comparison concerns performance against smaller models with supervised finetuning. (LLM, conf=0.82)
- Partly supportedcites [169] Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., Zettlemoyer, L.: Rethinking the role of demonstrations: What makes in-context learning work?. arXiv:2202.12837 (2022) sourceExperimental — accuracy not yet measured
The Introduction (§1) identifies in-context learning as inference from demonstrations by large language models, and Related Work (§2) says it occurs without gradient updates. Neither passage establishes that it is an emergent ability distinguishing LLMs from earlier pre-trained language models; the paper also includes GPT-2 Large among the models it studies (§2). Page numbers are unavailable in our copy. (LLM, conf=0.83)
- Partly supportedcites [170] Levy, I., Bogin, B., Berant, J.: Diverse demonstrations improve in-context compositional generalization. arXiv:2212.06800 (2022) sourceExperimental — accuracy not yet measured
The Introduction describes in-context learning as few-shot inference in which large language models use prompts containing examples. Section 3.4 says that “pure” in-context learning keeps model parameters frozen and has largely been restricted to very large language models. The paper does not establish that in-context learning is an emergent ability that differentiates LLMs from earlier pretrained language models. (LLM, conf=0.84)
- Not matchedcites [171] Xie, S.M., Raghunathan, A., Liang, P., Ma, T.: An explanation of in-context learning as implicit bayesian inference. In: International Conference on Learning Representations
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites [172] Olsson, C., Elhage, N., Nanda, N., Joseph, N., DasSarma, N., Henighan, T., Mann, B., Askell, A., Bai, Y., Chen, A., et al.: In-context learning and induction heads. arXiv:2209.11895 (2022) sourceExperimental — accuracy not yet measured
The In-context Learning section (p. 4) calls in-context learning emergent and describes models adapting to tasks through prompts without retraining. It does not establish that this ability differentiates LLMs from previous pre-trained language models; it says emergent in-context learning was already noted in GPT-2. (LLM, conf=0.86)
- Partly supportedcites [173] Akyürek, E., Schuurmans, D., Andreas, J., Ma, T., Zhou, D.: What learning algorithm is in-context learning? investigations with linear models. arXiv:2211.15661 (2022) sourceExperimental — accuracy not yet measured
The Introduction (p. 1) describes in-context learning as a surprising behavior observed in large language models, and §2.2 (p. 3) says it can emerge in models trained on general text. The paper does not say that this ability differentiates LLMs from previous pre-trained language models. (LLM, conf=0.83)
- Supportedcites [3] Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al.: Language models are few-shot learners. Adv. Neural. Inf. Process. Syst. 33, 1877–1901 (2020) source
The citation to Brown et al. is attached to the description of how in-context learning works. The Introduction (p. 3) says a pretrained language model can be conditioned on an instruction and/or demonstrations and complete further instances by predicting what comes next; Related Work (p. 40) says this occurs without updating the weights. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Thanks to LLMs' remarkable generative ability in language tasks, they are ideal for tackling the aforementioned challenges [152].”
What the sources say
- Partly supportedcites [152] Bommasani, R., Hudson, D.A., Adeli, E., Altman, R., Arora, S., Arx, S., Bernstein, M.S., Bohg, J., Bosselut, A., Brunskill, E., et al.: On the opportunities and risks of foundation models. arXiv:2108.07258 (2021) sourceExperimental — accuracy not yet measured
Section 2.1 (p. 22) describes highly coherent language generation and says generative models have become a primary tool in NLP. Section 2.5 (p. 44) says their generative capabilities could help address challenges, but qualifies this by saying success depends on how effectively the models can be used. That supports their potential, not the unqualified assertion that LLMs are ideal for the unspecified challenges. (LLM, conf=0.83)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“In addition to valuing the suggestions made by a recommendation model, users are also interested in the comprehensible justifications for these recommendations [124, 125].”
What the sources say
- Not checked — no full text of the sourcecites [124] Wang, X., Chen, Y., Yang, J., Wu, L., Wu, Z., Xie, X.: A reinforcement learning framework for explainable recommendation. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 587–596 (2018). IEEE source
- Supportedcites [125] Gao, J., Wang, X., Wang, Y., Xie, X.: Explainable recommendation through attentive multi-view learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 3622–3629 (2019) source
The Introduction (p. 1) treats explanations of why an item is recommended as important and says they may help users make better decisions. It also identifies generating explanations that ordinary users can understand as a goal; the Study on Explainability (p. 7) evaluates their usefulness to users. (LLM, conf=0.89)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
44 more claims · 10 with their cited sources checked
Create a free account to see all 262 claims and to verify the 82 references still open.
- Probably not a substantial claim. 179
- It may state two separate claims as one. 91
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Large Language Models (LLMs) have made significant progress in open-ended dialogue, yet their inability to retain and retrieve relevant information from long-term interactions limits their effectiveness in applications requiring sustained personalization.”
From In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents (2025) · cites this paper as Chen et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“yet their inherent statelessness poses a significant challenge for maintaining coherent, personalized conversations over time (Chen et al., 2024; Li et al., 2024b; Tseng et al., 2024)”
From In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents (2025) · cites this paper as Chen et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 8 LLMs as conversational agent
“and RLHF proposed in InstructGPT [3].”
§ 8 LLMs as conversational agent
“models like InstructGPT [37]”
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“Early work [139–141] mainly relied on recurrent neural networks (e.g., LSTM [142], GRU [143]).”
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472 · cited 1×
“As the generative model evolves, it eventually emerges as the transformer architecture [23], acting as the foundational blocks for BERT [256] and GPT [206] in the field of NLP, and for Vision Transformer (ViT) [257] and Swin Transformer [258] in the field of CV.”
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534 · cited 2×
“As the generative model evolves, it eventually emerges as the transformer architecture [23], acting as the foundational blocks for BERT [256] and GPT [206] in the field of NLP, and for Vision Transformer (ViT) [257] and Swin Transformer [258] in the field of CV.”
Self-citationEfficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302 · cited 2×
“Visual ChatGPT[228] combines visual foundation models like BLIP [231], Stable Diffusion [232], etc.”
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Matrix Factorization Techniques for Recommender Systems
Koren, Y., Bell, R., & Volinsky, C. (2009) · Computer · doi:10.1109/mc.2009.263 · Cited by 11,673 · cited 1×
“Traditional solutions, such as matrix factorization [10] and”
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 1×
“The impact of scaling is illustrated by the scaling laws [24], [25], which numerically uncover the power-law relationship”
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712 · cited 1×
“focused on deep-learning-based generative models, including Generative Adversarial Networks (GANs) [252], Variational AutoEncoders (VAEs) [253], Normalizing Flows [254], and diffusion-based models [255] for high-quality image generation.”
Amazon.com recommendations: item-to-item collaborative filtering
Linden, G., Smith, B., & York, J. (2003) · IEEE Internet Computing · doi:10.1109/mic.2003.1167344 · Cited by 5,403
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 1×
“Language models perform the probabilistic modeling for the generation of natural language[26,27],i.e.,presentedwithonespecificcontext,thelanguagemodelsmakepredictions forthewordswhicharetobegeneratedforthefuturesteps.”
GroupLens: an open architecture for collaborative filtering of netnews
Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., & Riedl, J. (1994) · Proceedings of the 1994 ACM conference on Computer supported cooperative work - CSCW '94 · doi:10.1145/192844.192905 · Cited by 5,058
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Self-citationChain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
Self-citationTraining language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208 · cited 3×
“RecLLM further fine-tunes some modules of it using synthetic data generated by a user simulator through RLHF [37] technique.”
QLoRA: Efficient Finetuning of Quantized LLMs
Dettmers, T., Pagnoni, A., Holtzman, A., & Zettlemoyer, L. (2023) · arXiv · doi:10.48550/arxiv.2305.14314 · Cited by 3,832
Neural Graph Collaborative Filtering
Wang, X., He, X., Wang, M., Feng, F., & Chua, T.-S. (2019) · Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3331184.3331267 · Cited by 3,823 · cited 1×
“Deep learning-based methods offer approaches to capture high-order interactions by employing techniques like attention mechanisms [17], [18] and graph based networks [19] to mining complex relationships between user and item.”
Self-citationLearning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317
Training Language Models to Follow Instructions with Human Feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117
Self-Attentive Sequential Recommendation
Kang, W.-C., & McAuley, J. (2018) · 2018 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2018.00035 · Cited by 3,011 · cited 1×
“Self-Attentions [20] and Gated Recurrent Units (GRUs) [21] are popular choices for modeling sequential data in recommender systems.”
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Feng, Z., Guo, D., Tang, D., Duan, N., Feng, X., Gong, M., Shou, L., Qin, B., Liu, T., Jiang, D., et al. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.139 · Cited by 2,824 · cited 1×
“The multi-modal generation has become an essential aspect of AIGC, which learns the multimodal connection and interaction, typically including vision language generation [274], text audio generation [275], text graph generation [276], text Code Generation [277].”
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Content-Based Recommendation Systems
Pazzani, M. J., & Billsus, D. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-72079-9_10 · Cited by 2,600 · cited 1×
“To address these limitations, contentbased filtering [12] emerged, which considers the content of”
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590
Self-citationBERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer
Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., & Jiang, P. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3357895 · Cited by 2,558
KGAT: Knowledge Graph Attention Network for Recommendation
Wang, X., He, X., Cao, Y., Liu, M., & Chua, T.-S. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330989 · Cited by 2,147
Self-citationDeep Interest Network for Click-Through Rate Prediction
Zhou, G., Zhu, X., Song, C., Fan, Y., Zhu, H., Ma, X., Yan, Y., Jin, J., Li, H., & Gai, K. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219823 · Cited by 2,128 · cited 1×
“Deep learning-based methods offer approaches to capture high-order interactions by employing techniques like attention mechanisms [17, 18] and graph-based networks [19] to mine complex relationships between user and item.”
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Dong, Z., Hou, Y., Zhang, B., Min, Y., Zhang, J., Liu, P., et al. (2026) · Frontiers of Computer Science · doi:10.1007/s11704-026-60308-3 · Cited by 2,093
Self-citationA Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
Self-citationNewsWeeder: Learning to Filter Netnews
Lang, K. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50048-7 · Cited by 2,051 · cited 2×
“Statistical models like TF-IDF, Minimum Description Length (MDL) [86], and bag-of-words have been traditionally used to encode textual data such as news articles and documents into continuous value vectors.”
Language Models as Knowledge Bases?
Petroni, F., Rocktäschel, T., Riedel, S., Lewis, P., Bakhtin, A., Wu, Y., & Miller, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1250 · Cited by 1,834 · cited 1×
“The inherent nature of large language models can introduce ambiguity or inaccurate provenance [66].”
Collaborative Knowledge Base Embedding for Recommender Systems
Zhang, F., Yuan, N. J., Lian, D., Xie, X., & Ma, W.-Y. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939673 · Cited by 1,749
Self-citationRecommender systems in e-commerce
Schafer, J. B., Konstan, J., & Riedl, J. (1999) · Proceedings of the 1st ACM conference on Electronic commerce · doi:10.1145/336992.337035 · Cited by 1,684 · cited 1×
“Item-based explainable methods relate recommendations to familiar items [131], explaining that the recommended item bears similarity to others the user prefers , which are prevalent on platforms like Amazon [132] and Netflix [133].”
Collaborative Deep Learning for Recommender Systems
Wang, H., Wang, N., & Yeung, D.-Y. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783273 · Cited by 1,657 · cited 2×
“In recent years, deep learning has gained significant attention in the field of recommender systems due to its ability to model complex patterns and interactions in user-item data [16].”
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Cernocky, J., & Khudanpur, S. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947611 · Cited by 1,568
Collaborative topic modeling for recommending scientific articles
Wang, C., & Blei, D. M. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020480 · Cited by 1,527 · cited 1×
“information, such as user profiles, item-side information [13], [14], such as item brands and item categories, and interactionbased information [15], such as reviews and comments.”
NICE: Non-linear Independent Components Estimation
Dinh, L., Krueger, D., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1410.8516 · Cited by 1,493
Deep Interest Evolution Network for Click-Through Rate Prediction
Zhou, G., Mou, N., Fan, Y., Pi, Q., Bian, W.-J., Zhou, C., Zhu, X., & Gai, K. (2018) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.1809.03672 · Cited by 1,452
Evaluating Large Language Models Trained on Code
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03374 · Cited by 1,436
The Netflix Recommender System: Algorithms, Business Value, and Innovation
Gomez-Uribe, C. A., & Hunt, N. (2016) · ACM Transactions on Management Information Systems · doi:10.1145/2843948 · Cited by 1,418
Vinyals, O., & Le, Q. (2015) · arXiv · doi:10.48550/arxiv.1506.05869 · Cited by 1,400
Emergent Abilities of Large Language Models
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.07682 · Cited by 1,264
Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects
Ni, J., Li, J., & McAuley, J. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1018 · Cited by 1,200 · cited 1×
“Therefore, Ni et al. [146] used such information as guided input to BERT to obtain a controllable justification.”
In-context Learning and Induction Heads
Olsson, C., Elhage, N., Nanda, N., Joseph, N., DasSarma, N., Henighan, T., Mann, B., Askell, A., Bai, Y., Chen, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2209.11895 · Cited by 1,170
RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems
Wang, H., Zhang, F., Wang, J., Zhao, M., Li, W., Xie, X., & Guo, M. (2018) · Proceedings of the 27th ACM International Conference on Information and Knowledge Management · doi:10.1145/3269206.3271739 · Cited by 1,160
How Much Knowledge Can You Pack into the Parameters of a Language Model?
Roberts, A., Raffel, C. A., & Shazeer, N. (2020) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2002.08910 · Cited by 1,159
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T. L., Cao, Y., & Narasimhan, K. (2023) · arXiv · doi:10.48550/arxiv.2305.10601 · Cited by 1,158
Toolformer: Language Models Can Teach Themselves to Use Tools
Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Zettlemoyer, L., Cancedda, N., & Scialom, T. (2023) · arXiv · doi:10.48550/arxiv.2302.04761 · Cited by 1,150
Deep Interest Evolution Network for Click-Through Rate Prediction
Zhou, G., Mou, N., Fan, Y., Pi, Q., Bian, W., Zhou, C., Zhu, X., & Gai, K. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015941 · Cited by 1,099 · cited 1×
“Deep learning-based methods offer approaches to capture high-order interactions by employing techniques like attention mechanisms [17, 18] and graph-based networks [19] to mine complex relationships between user and item.”
DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation
Zhang, Y., Sun, S., Galley, M., Chen, Y.-C., Brockett, C., Gao, X., Gao, J., Liu, J., & Dolan, B. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.18653/v1/2020.acl-demos.30 · Cited by 1,076 · cited 3×
“To address this challenge, there are currently two approaches being explored: fine-tuning [215] and tool learning [225, 226].”
DKN: Deep Knowledge-Aware Network for News Recommendation
Wang, H., Zhang, F., Xie, X., & Guo, M. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186175 · Cited by 1,034 · cited 2×
“DKN [41] utilizes an attention mechanism to aggregate historical information related to candidate items.”
Knowledge Graph Convolutional Networks for Recommender Systems
Wang, H., Zhao, M., Xie, X., Li, W., & Guo, M. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313417 · Cited by 1,021 · cited 2×
“Unified methods, such as RippleNet [48], KGCN [49], KGAT [50], AKUPM [51], IntentGC [52] refine the representations of entities in the knowledge graph by leveraging embedding propagation techniques.”
One-Class Collaborative Filtering
Pan, R., Zhou, Y., Cao, B., Liu, N. N., Lukose, R., Scholz, M., & Yang, Q. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.16 · Cited by 1,015 · cited 1×
“Regardingthe development of recommender systems, they have evolved significantly over the years, with collaborative filtering [8, 9] being one of the earliest and most influential approaches.”
How Can We Know What Language Models Know?
Jiang, Z., Xu, F. F., Araki, J., & Neubig, G. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00324 · Cited by 1,002 · cited 1×
“The ability of Large Language Models to retrieve factual knowledge as explicit knowledge bases [53–56, 56– 61] has been stirred discussed , which presents an opportunity to construct more comprehensive knowledge graphs within recommender systems.”
Neural Responding Machine for Short-Text Conversation
Shang, L., Lu, Z., & Li, H. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1152 · Cited by 978 · cited 1×
“Generative methods [179], [180], [181] utilize a sequence-to-sequence model structure to generate responses,”
Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language ModelsPreprint
Wang, L., Xu, W., Lan, Y.-H., Hu, Z.-Q., Lan, Y.-S., Lee, R. K.-W., & Lim, E.-P. (2023) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2305.04091 · Cited by 946
Training Compute-Optimal Large Language Models
Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D. D. L., Hendricks, L. A., Welbl, J., Clark, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.15556 · Cited by 929
Unifying user-based and item-based collaborative filtering approaches by similarity fusion
Wang, J., de Vries, A. P., & Reinders, M. J. T. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148257 · Cited by 847 · cited 1×
“Traditionalsolutions,suchas matrixfactorization[10]anduser/item-basedapproaches[11],extractpotentiallyinteresting itemsbasedontheideathatuserswhohaveshownsimilarpreferencesinthepastarelikelyto havesimilarpreferencesinthefuture.”
A Network-based End-to-End Trainable Task-oriented Dialogue System
Wen, T.-H., Vandyke, D., Mrkšić, N., Gasic, M., Rojas Barahona, L. M., Su, P.-H., Ultes, S., & Young, S. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1042 · Cited by 778 · cited 1×
“Another approach is to employ an end-to-end method [195], [196], [197], training an encoderdecoder model to handle all the processing steps collectively.”
LaMDA: Language Models for Dialog Applications
Thoppilan, R., De Freitas, D., Hall, J., Shazeer, N., Kulshreshtha, A., Cheng, H.-T., Jin, A., Bos, T., Baker, L., Du, Y., et al. (2022) · arXiv · doi:10.48550/arxiv.2201.08239 · Cited by 778 · cited 3×
“LaMDA [222] learns to use a toolset that includes an IR system, a translator, and a calculator through fine-tuning to generate more factual responses.”
InfluentialA Neural Network Approach to Context-Sensitive Generation of Conversational Responses
Sordoni, A., Galley, M., Auli, M., Brockett, C., Ji, Y., Mitchell, M., Nie, J.-Y., Gao, J., & Dolan, B. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1020 · Cited by 764 · cited 1×
“Generative methods [179], [180], [181] utilize a sequence-to-sequence model structure to generate responses,”
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., & Zettlemoyer, L. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.759 · Cited by 755 · cited 1×
“In-context learning [148], [149], [150], [151], [152], [153], [154]”
Explainable Recommendation: A Survey and New Perspectives
Zhang, Y., & Chen, X. (2020) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000066 · Cited by 755 · cited 1×
“explanations, which can be broadly categorized into itembased, user-based, and attribute-based explanations[113].”
Self-citationRethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., & Zettlemoyer, L. (2022) · arXiv · doi:10.48550/arxiv.2202.12837 · Cited by 752
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2021) · arXiv · doi:10.48550/arxiv.2112.10752 · Cited by 737
Extracting Training Data from Large Language Models
Carlini, N., Tramer, F., Wallace, E., Jagielski, M., Herbert-Voss, A., Lee, K., Roberts, A., Brown, T., Song, D., Erlingsson, U., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07805 · Cited by 727 · cited 1×
“Previous work [269] has demonstrated that large language models, especially GPT-2 [270], memorize and leak individual training examples.”
Large Language Models are Zero-Shot Rankers for Recommender SystemsPreprint
Hou, Y., Zhang, J.-J., Lin, Z.-H., Lu, H., Xie, R.-B., McAuley, J., & Zhao, W. (2023) · European Conference on Information Retrieval · doi:10.48550/arxiv.2305.08845 · Cited by 692
Explainable Recommendation a survey and new perspectives
Zhang, Y., & Chen, X. (2020) · Cited by 689
Self-citationHow Much Knowledge Can You Pack into the Parameters of a Language Model?
Roberts, A., Raffel, C., & Shazeer, N. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.437 · Cited by 638 · cited 1×
“The ability of Large Language Models to retrieve factual knowledge as explicit knowledge bases [38], [39], [40], [41], [42], [43], [40], [41], [44], [45], [46] has been stirred discussed, which presents an opportunity to construct more comprehensive knowledge graphs within recommender systems.”
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
Ahn, M., Brohan, A., Brown, N., Chebotar, Y., Cortes, O., David, B., Finn, C., Fu, C., Gopalakrishnan, K., Hausman, K., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.01691 · Cited by 624
Multitask Prompted Training Enables Zero-Shot Task Generalization
Sanh, V., Webson, A., Raffel, C., Bach, S. H., Sutawika, L., Alyafeai, Z., Chaffin, A., Stiegler, A., Scao, T. L., Raja, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2110.08207 · Cited by 612 · cited 1×
“Another one is the instruct following capability [36, 37].”
ReAct: Synergizing Reasoning and Acting in Language Models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.03629 · Cited by 608
REALM: Retrieval-Augmented Language Model Pre-Training
Guu, K., Lee, K., Tung, Z., Pasupat, P., & Chang, M.-W. (2020) · arXiv · doi:10.48550/arxiv.2002.08909 · Cited by 574
Geng, S., Liu, S., Fu, Z., Ge, Y., & Zhang, Y. (2022) · Proceedings of the 16th ACM Conference on Recommender Systems · doi:10.1145/3523227.3546767 · Cited by 556 · cited 1×
“However, there still exists a substantial gap when compared to traditional recommendation models, particularly fine-tuned large language models designed specifically for recommenders, such as P5 [174] and M6-Rec [175].”
The Second Dialog State Tracking Challenge
Henderson, M., Thomson, B., & Williams, J. D. (2014) · Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL) · doi:10.18653/v1/w14-4337 · Cited by 538
A Survey on Conversational Recommender Systems
Jannach, D., Manzoor, A., Cai, W., & Chen, L. (2022) · ACM Computing Surveys · doi:10.1145/3453154 · Cited by 521 · cited 1×
“Conversational Recommender Systems [24, 25] mark a remarkable stride forward in the realm of personalized assistance.”
A survey on large language models for recommendation
Wu, L., Zheng, Z., Qiu, Z., Wang, H., Gu, H., Shen, T., Qin, C., Zhu, C., Zhu, H., Liu, Q., et al. (2024) · World Wide Web · doi:10.1007/s11280-024-01291-2 · Cited by 515 · cited 3×
“tive of learning mechanisms, LLM4Rec [5] delves into both Discriminative LLM for Recommendation and Generative LLM for Recommendation.”
Self-citationA Survey on Large Language Models for Recommendation
Wu, L., Zheng, Z., Qiu, Z., Wang, H., Gu, H., Shen, T., Qin, C., Zhu, C., Zhu, H., Liu, Q., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.19860 · Cited by 515
Self-citationA Categorical Archive of ChatGPT Failures
Borji, A. (2023) · doi:10.21203/rs.3.rs-2895792/v1 · Cited by 514
A Categorical Archive of ChatGPT Failures
Borji, A. (2023) · arXiv · doi:10.48550/arxiv.2302.03494 · Cited by 514
Session-based Recommendations with Recurrent Neural Networks
Hidasi, B., Karatzoglou, A., Baltrunas, L., & Tikk, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06939 · Cited by 509
Embedding-based News Recommendation for Millions of Users
Okura, S., Tagami, Y., Ono, S., & Tajima, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098108 · Cited by 499 · cited 1×
“[94]evaluatediffer-ent network architectures, including word-models and GRU networks, for representing user states.”
Recommender Systems in the Era of Large Language Models (LLMs)
Zhao, Z., Fan, W., Li, J., Liu, Y., Mei, X., Wang, Y., Wen, Z., Wang, F., Zhao, X., Tang, J., et al. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3392335 · Cited by 481 · cited 3×
“Fan et al [7], on the other hand, conduct a review with a focus on pre-training, fine-tuning, and prompting approaches.”
The role of transparency in recommender systems
Sinha, R., & Swearingen, K. (2002) · CHI '02 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/506443.506619 · Cited by 477 · cited 1×
“In contrast, user-based explanations [134] leverage social relationships to make recommendations by explaining that users with similar interests also favor the recommended item .”
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Shen, Y., Song, K., Tan, X., Li, D., Lu, W., & Zhuang, Y. (2023) · arXiv · doi:10.48550/arxiv.2303.17580 · Cited by 477
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Shen, Y., Song, K., Tan, X., Li, D., Lu, W., & Zhuang, Y. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1657 · Cited by 475
Bao, K., Zhang, J., Zhang, Y., Wang, W., Feng, F., & He, X. (2023) · Proceedings of the 17th ACM Conference on Recommender Systems · doi:10.1145/3604915.3608857 · Cited by 469 · cited 1×
“TALLRe [119] explores the ability of large language models for the sequential recommendation.”
Cao, Y., Li, S., Liu, Y., Yan, Z., Dai, Y., Yu, P. S., & Sun, L. (2023) · arXiv · doi:10.48550/arxiv.2303.04226 · Cited by 463
Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks
Huang, J., Zhao, W. X., Dou, H., Wen, J.-R., & Chang, E. Y. (2018) · The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval · doi:10.1145/3209978.3210017 · Cited by 461
Neural Belief Tracker: Data-Driven Dialogue State Tracking
Mrkšić, N., Ó Séaghdha, D., Wen, T.-H., Thomson, B., & Young, S. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1163 · Cited by 459 · cited 1×
“…dialogue systems, a common approach [24, 204] is to treat the response generation as a pipeline and handle it separately using four components: dialogue understanding [205, 206], dialogue state tracking [207–209], dialogue policy learning [24, 210], and natural language generation [211, 212].”
Collaborative Variational Autoencoder for Recommender Systems
Li, X., & She, J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098077 · Cited by 442 · cited 1×
“CVAE [89] introduces a collaborative variational autoencoder that learns probabilistic textual features.”
Towards Reasoning in Large Language Models: A Survey
Huang, J., & Chang, K. C.-C. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.67 · Cited by 428
Towards Reasoning in Large Language Models: A Survey
Huang, J., & Chang, K. C.-C. (2022) · arXiv · doi:10.48550/arxiv.2212.10403 · Cited by 428
Mesnil, G., He, X., Deng, L., & Bengio, Y. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-596 · Cited by 413 · cited 1×
“For task-oriented dialogue systems, a common approach [185], [186] is to treat the response generation as a pipeline and handle it separately using four components: dialogue understanding [187], [188], dialogue state tracking [189], [190], [191], dialogue policy learning [192], [185], and natural language generation […”
Talking about Large Language Models
Shanahan, M. (2024) · Communications of the ACM · doi:10.1145/3624724 · Cited by 381 · cited 1×
“Secondly, the language models are pre-trained at scale with a massive amount of unlabeled corpus [3, 30–32].”
Conversational Recommender System
Sun, Y., & Zhang, Y. (2018) · The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval · doi:10.1145/3209978.3210002 · Cited by 378 · cited 4×
“The attribute-based QA approach [24, 216–218] utilizes a pipeline method within the dialogue system.”
InfluentialSymbolic Knowledge Distillation: from General Language Models to Commonsense Models
West, P., Bhagavatula, C., Hessel, J., Hwang, J. D., Jiang, L., Bras, R. J. L., Lu, X., Welleck, S., & Choi, Y. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.341 · Cited by 363 · cited 1×
“symbolic-kg [64] distills commonsense facts from GPT3 and then finetune the small student model to generate knowledge graphs.”
Neural News Recommendation with Multi-Head Self-Attention
Wu, C., Wu, F., Ge, S., Qi, T., Huang, Y., & Xie, X. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1671 · Cited by 347 · cited 2×
“NRMS [81] and CPRS [82] utilize multi-head self-attention networks to learn word representations.”
Self-citationPlan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models
Wang, L., Xu, W., Lan, Y., Hu, Z., Lan, Y., Lee, R. K.-W., & Lim, E.-P. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.147 · Cited by 344
SHINE: Signed Heterogeneous Information Network Embedding for Sentiment Link Prediction
Wang, H., Zhang, F., Hou, M., Xie, X., Guo, M., & Liu, Q. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159666 · Cited by 334
Self-citationNeural News Recommendation with Long- and Short-term User Representations
An, M., Wu, F., Wu, C., Zhang, K., Liu, Z., & Xie, X. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1033 · Cited by 332 · cited 2×
“For example, NPA [96] and LSTUR [97] incorporate attention mechanisms to determine the importance of words after CNN layers.”
Self-citationLarge Language Models are Zero-Shot Rankers for Recommender Systems
Hou, Y., Zhang, J., Lin, Z., Lu, H., Xie, R., McAuley, J., & Zhao, W. X. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-56060-6_24 · Cited by 327
NPA: Neural News Recommendation with Personalized Attention
Wu, C., Wu, F., An, M., Huang, J., Huang, Y., & Xie, X. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330665 · Cited by 326
Self-citationBai, Y., Kadavath, S., Kundu, S., Askell, A., Kernion, J., Jones, A., Chen, A., Goldie, A., Mirhoseini, A., & Kaplan, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.08073 · Cited by 326
A Deep Architecture for Semantic Matching with Multiple Positional Sentence Representations
Wan, S., Lan, Y., Guo, J., Xu, J., Pang, L., & Cheng, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10342 · Cited by 322 · cited 1×
“Generative methods [198–200] utilize a sequence-to-sequence model structure to generate responses, while retrieval-based methods [201–203] transform the task of generating responses into a retrieval problem by searching for the most relevant response in a response database based on…”
Towards Conversational Search and Recommendation: System Ask, User Respond
Zhang, Y., Chen, X., Ai, Q., Yang, L., & Croft, W. B. (2018) · Proceedings of the 27th ACM International Conference on Information and Knowledge Management · doi:10.1145/3269206.3271776 · Cited by 319 · cited 1×
“One direct scenario is the conversational search and recommendation [40].”
Self-citationRecurrent neural networks for language understanding
Yao, K., Zweig, G., Hwang, M.-Y., Shi, Y., & Yu, D. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-569 · Cited by 315 · cited 1×
“For task-oriented dialogue systems, a common approach [185], [186] is to treat the response generation as a pipeline and handle it separately using four components: dialogue understanding [187], [188], dialogue state tracking [189], [190], [191], dialogue policy learning [192], [185], and natural language generation […”
Neural Rating Regression with Abstractive Tips Generation for Recommendation
Li, P., Wang, Z., Ren, Z., Bing, L., & Lam, W. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080822 · Cited by 313 · cited 2×
“…explanation methods are tightly coupled with specific recommendation models (e.g., NETE [141]), or directly design a new recommendation model (e.g., NRT [139], 123 PETER [144]), and they are often powerless when faced with existing advanced recommendation models, which limits their generalizability.”
Towards Universal Sequence Representation Learning for Recommender Systems
Hou, Y., Mu, S., Zhao, W. X., Li, Y., Ding, B., & Wen, J.-R. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539381 · Cited by 313
A Unified Generative Framework for Various NER Subtasks
Yan, H., Gui, T., Dai, J., Guo, Q., Zhang, Z., & Qiu, X. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.451 · Cited by 299
Uncovering ChatGPT's Capabilities in Recommender Systems
Dai, S., Shao, N., Zhao, H., Yu, W., Si, Z., Xu, C., Sun, Z., Zhang, X., & Xu, J. (2023) · arXiv · doi:10.48550/arxiv.2305.02182 · Cited by 298
NAS-bench-101: Towards reproducible neural architecture search
Ying, C., Klein, A., Real, E., Christiansen, E., Murphy, K., & Hutter, F. (2019) · arXiv · doi:10.48550/arxiv.1902.09635 · Cited by 297
LLMs for knowledge graph construction and reasoning: recent capabilities and future opportunities
Zhu, Y., Wang, X., Chen, J., Qiao, S., Ou, Y., Yao, Y., Deng, S., Chen, H., & Zhang, N. (2024) · World Wide Web · doi:10.1007/s11280-024-01297-w · Cited by 294 · cited 2×
“Existing methods in knowledge graphs fall short of handling incomplete KGs [47] and constructing KGs with text corpus [48] and many researchers attempt to leverage”
Self-citationTaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIsPreprint
Liang, Y., Wu, C., Song, T., Wu, W., Xia, Y., Liu, Y., Ou, Y., Lu, S., Ji, L., Mao, S., et al. (2023) · Intelligent Computing · doi:10.48550/arxiv.2303.16434 · Cited by 290
Self-citationSemantic Path based Personalized Recommendation on Weighted Heterogeneous Information Networks
Shi, C., Zhang, Z., Luo, P., Yu, P. S., Yue, Y., & Wu, B. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806528 · Cited by 287 · cited 1×
“Path-based approaches, such as Hete-MF [44], SemRec [45], RuleRec [46], EIUM [47], exploit the semantic connectivity information present in the knowledge graph to regularize the user and item representations.”
A Hybrid Collaborative Filtering Model with Deep Structure for Recommender Systems
Dong, X., Yu, L., Wu, Z., Sun, Y., Yuan, L., & Zhang, F. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10747 · Cited by 282 · cited 1×
“Dong et al. [88] propose a stacked denoising autoencoder that reconstructs item/user ratings and textual information simultaneously, allowing for the joint modeling of collaborative and textual knowledge.”
Self-citationWebGPT: Browser-assisted question-answering with human feedback
Nakano, R., Hilton, J., Balaji, S., Wu, J., Ouyang, L., Kim, C., Hesse, C., Jain, S., Kosaraju, V., Saunders, W., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.09332 · Cited by 272
LLMRec: Large Language Models with Graph Augmentation for Recommendation
Wei, W., Ren, X., Tang, J., Wang, Q., Su, L., Cheng, S., Wang, J., Yin, D., & Huang, C. (2024) · Proceedings of the 17th ACM International Conference on Web Search and Data Mining · doi:10.1145/3616855.3635853 · Cited by 268 · cited 1×
“LLMRec [81] adopts LLM-based graph augmentation strategies to enrich the information of items and further designs denoise methods to ensure the augmentation.”
Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisited
Yuan, Z., Yuan, F., Song, Y., Li, Y., Fu, J., Yang, F., Pan, Y., & Ni, Y. (2023) · arXiv · doi:10.48550/arxiv.2303.13835 · Cited by 267
Turpin, M., Michael, J., Perez, E., & Bowman, S. R. (2023) · arXiv · doi:10.48550/arxiv.2305.04388 · Cited by 262
PALR: Personalization Aware LLMs for RecommendationPreprint
Yang, F., Chen, Z., Jiang, Z., Cho, E., Huang, X., & Lu, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.07622 · Cited by 260
Self-citationLei, W., He, X., Miao, Y., Wu, Q., Hong, R., Kan, M.-Y., & Chua, T.-S. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371769 · Cited by 253 · cited 1×
“The attribute-based QA approach [185], [198], [199], [200] utilizes a pipeline”
A Survey on In-context Learning
Dong, Q., Li, L., Dai, D., Zheng, C., Ma, J., Li, R., Xia, H., Xu, J., Wu, Z., Liu, T., et al. (2023) · arXiv · doi:10.48550/arxiv.2301.00234 · Cited by 248
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Feng, Z., Guo, D., Tang, D., Duan, N., Feng, X., Gong, M., Shou, L., Qin, B., Liu, T., Jiang, D., et al. (2020) · arXiv · doi:10.48550/arxiv.2002.08155 · Cited by 243
How Can Recommender Systems Benefit from Large Language Models: A Survey
Lin, J., Dai, X., Xi, Y., Liu, W., Chen, B., Zhang, H., Liu, Y., Wu, C., Li, X., Zhu, C., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3678004 · Cited by 242 · cited 1×
“Regarding the adaptation of LLM for recommender systems in terms of ‘Where’ and ‘How’, Li et al [6] concentrate on the overall pipeline in industrial recommender phases.”
Self-citationTowards Deep Conversational Recommendations
Li, R., Kahou, S., Schulz, H., Michalski, V., Charlin, L., & Pal, C. (2018) · arXiv · doi:10.48550/arxiv.1812.07617 · Cited by 242 · cited 1×
“Compared to attribute-based QA methods, generative methods [201], [202], [203], [204] appear to be simpler and more scalable.”
Personalized News Recommendation: Methods and Challenges
Wu, C., Wu, F., Huang, Y., & Xie, X. (2023) · ACM Transactions on Information Systems · doi:10.1145/3530257 · Cited by 240 · cited 1×
“While autoencoders are effective in learning low-dimensionalrepresentationsfromtextdata,theymaystruggletocapturesemanticinformation effectively[90].”
Self-citationRethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models
Wang, X., Tang, X., Zhao, X., Wang, J., & Wen, J.-R. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.621 · Cited by 229
Self-citationInteractive Path Reasoning on Graph for Conversational Recommendation
Lei, W., Zhang, G., He, X., Miao, Y., Wang, X., Chen, L., & Chua, T.-S. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403258 · Cited by 228 · cited 1×
“The attribute-based QA approach [185], [198], [199], [200] utilizes a pipeline”
Self-citationJointly Learning Explainable Rules for Recommendation with Knowledge Graph
Ma, W., Zhang, M., Cao, Y., Jin, W., Wang, C., Liu, Y., Ma, S., & Ren, X. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313607 · Cited by 216 · cited 1×
“Path-based approaches, such as Hete-MF [44], SemRec [45], RuleRec [46], EIUM [47], exploit the semantic connectivity information present in the knowledge graph to regularize the user and item representations.”
Structure-Augmented Text Representation Learning for Efficient Knowledge Graph Completion
Wang, B., Shen, T., Long, G., Zhou, T., Wang, Y., & Chang, Y. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450043 · Cited by 213
Atlas: Few-shot Learning with Retrieval Augmented Language Models
Izacard, G., Lewis, P., Lomeli, M., Hosseini, L., Petroni, F., Schick, T., Dwivedi-Yu, J., Joulin, A., Riedel, S., & Grave, E. (2022) · arXiv · doi:10.48550/arxiv.2208.03299 · Cited by 213
Memory-assisted prompt editing to improve GPT-3 after deployment
Madaan, A., Tandon, N., Clark, P., & Yang, Y.-M. (2022) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2201.06009 · Cited by 213
Diverse Demonstrations Improve In-context Compositional GeneralizationPreprint
Levy, I., Bogin, B., & Berant, J. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2212.06800 · Cited by 211
Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisited
Yuan, Z., Yuan, F., Song, Y., Li, Y., Fu, J., Yang, F., Pan, Y., & Ni, Y. (2023) · Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3539618.3591932 · Cited by 200 · cited 1×
“Additionally, some recent works [114–117] have explored using only textual features as inputs to recommendation models, leveraging pre-trained language models to alleviate cold-start problems and enable cross-domain recommendations.”
Enhancing Knowledge Graph Construction Using Large Language ModelsPreprint
Trajanoska, M., Stojanov, R., & Trajanov, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.04676 · Cited by 199
Explainable Recommendation: A Survey and New Perspectives
Zhang, Y., & Chen, X. (2020) · doi:10.1561/9781680836592 · Cited by 199
Self-citationVisual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models
Wu, C., Yin, S., Qi, W., Wang, X., Tang, Z., & Duan, N. (2023) · arXiv · doi:10.48550/arxiv.2303.04671 · Cited by 197
Self-citationDAN: Deep Attention Neural Network for News Recommendation
Zhu, Q., Zhou, X., Song, Z., Tan, J., & Guo, L. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015973 · Cited by 192 · cited 1×
“DAN [101] proposes an attention-based LSTM to capture richer hidden sequence features.”
Learning to Generate Product Reviews from Attributes
Dong, L., Huang, S., Wei, F., Lapata, M., Zhou, M., & Xu, K. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1059 · Cited by 190 · cited 1×
“Early work [122], [123], [124] mainly relied on recurrent”
Uncovering ChatGPT’s Capabilities in Recommender Systems
Dai, S., Shao, N., Zhao, H., Yu, W., Si, Z., Xu, C., Sun, Z., Zhang, X., & Xu, J. (2023) · Proceedings of the 17th ACM Conference on Recommender Systems · doi:10.1145/3604915.3610646 · Cited by 187 · cited 1×
“[144] text-davinci-002 text-davinci-003 gpt-3.”
A Neural Network Approach to Context-Sensitive Generation of Conversational ResponsesPreprint
Sordoni, A., Galley, M., Auli, M., Brockett, C., Ji, Y., Mitchell, M., Nie, J., Gao, J., & Dolan, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06714 · Cited by 186
Neural Responding Machine for Short-Text Conversation
Shang, L., Lu, Z., & Li, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.02364 · Cited by 186
Tool Learning with Foundation Models
Qin, Y., Hu, S., Lin, Y., Chen, W., Ding, N., Cui, G., Zeng, Z., Huang, Y., Xiao, C., Han, C., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.08354 · Cited by 184
Self-citation(2022) · doi:10.52202/068431-1126 · Cited by 182
Multi-Task Learning for Knowledge Graph Completion with Pre-trained Language Models
Kim, B., Hong, T., Ko, Y., & Seo, J. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.153 · Cited by 181 · cited 1×
“MTL-KGC [51] encoders the text sequences to predict the”
Learning Vector-Quantized Item Representation for Transferable Sequential Recommenders
Hou, Y., He, Z., McAuley, J., & Zhao, W. X. (2023) · Proceedings of the ACM Web Conference 2023 · doi:10.1145/3543507.3583434 · Cited by 172
Personalized Prompt Learning for Explainable Recommendation
Li, L., Zhang, Y., & Chen, L. (2023) · ACM Transactions on Information Systems · doi:10.1145/3580488 · Cited by 172 · cited 1×
“natural, and adaptable to various user preferences [124], [127], [134], mitigating the limitations of conventional, formulaic explanations.”
Liu, B., Zhu, C., Li, G., Zhang, W., Lai, J., Tang, R., He, X., Li, Z., & Yu, Y. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403314 · Cited by 171
IntentGC: A Scalable Graph Convolution Framework Fusing Heterogeneous Information for Recommendation
Zhao, J., Zhou, Z., Guan, Z., Zhao, W., Ning, W., Qiu, G., & He, X. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330686 · Cited by 170
Empowering News Recommendation with Pre-trained Language Models
Wu, C., Wu, F., Qi, T., & Huang, Y. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3463069 · Cited by 169 · cited 1×
“Similarly, other works [86], [87], [88], [89], [90] have utilized pre-trained BERT to initialize”
Self-citationMulti-Rate Deep Learning for Temporal Recommendation
Song, Y., Elkahky, A. M., & He, X. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2914726 · Cited by 167 · cited 1×
“Insomecases,approacheslikedoc2vec[91]areusedtoconstructcontent embeddings[92,93]andlearnhiddenrepresentations.”
Commonsense Knowledge Base Completion
Li, X., Taheri, A., Tu, L., & Gimpel, K. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1137 · Cited by 166 · cited 1×
“The multi-modal generation has become an essential aspect of AIGC, which learns the multimodal connection and interaction, typically including vision language generation [259], text audio generation [260], text graph generation [261], text Code Generation [262].”
Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning
Wang, X., Zhou, K., Wen, J.-R., & Zhao, W. X. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539382 · Cited by 164
Self-citationA Reinforcement Learning Framework for Explainable Recommendation
Wang, X., Chen, Y., Yang, J., Wu, L., Wu, Z., & Xie, X. (2018) · 2018 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2018.00074 · Cited by 163 · cited 2×
“Thus, they are at the forefront of research [106], [118], [119], [120], [121].”
Self-citationCan language models learn from explanations in context?
Lampinen, A. K., Dasgupta, I., Chan, S. C. Y., Matthewson, K., Tessler, M. H., Creswell, A., McClelland, J. L., Wang, J. X., & Hill, F. (2022) · arXiv · doi:10.48550/arxiv.2204.02329 · Cited by 163
Augmented Language Models: a Survey
Mialon, G., Dessì, R., Lomeli, M., Nalmpantis, C., Pasunuru, R., Raileanu, R., Rozière, B., Schick, T., Dwivedi-Yu, J., Celikyilmaz, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.07842 · Cited by 160 · cited 1×
“LLMs, such as GPT, are well-suited for tool learning applications [217].”
PAL: Program-aided Language Models
Gao, L., Madaan, A., Zhou, S., Alon, U., Liu, P., Yang, Y., Callan, J., & Neubig, G. (2022) · arXiv · doi:10.48550/arxiv.2211.10435 · Cited by 155
Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers
Dai, D., Sun, Y., Dong, L., Hao, Y., Ma, S., Sui, Z., & Wei, F. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.247 · Cited by 154
Towards Open-World Recommendation with Knowledge Augmentation from Large Language Models
Xi, Y., Liu, W., Lin, J., Cai, X., Zhu, H., Zhu, J., Chen, B., Tang, R., Zhang, W., & Yu, Y. (2024) · 18th ACM Conference on Recommender Systems · doi:10.1145/3640457.3688104 · Cited by 151 · cited 1×
“Existingwork[80]prompts largelanguagemodelstogeneratefactualknowledgeaboutmoviestoenhancetheperfor-manceofCTRpredictionmodels.”
Generate Neural Template Explanations for Recommendation
Li, L., Zhang, Y., & Chen, L. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3411992 · Cited by 149 · cited 3×
“In addition, these explanation methods are tightly coupled with specific recommendation models (e.g., NETE [141]), or directly design a new recommendation model (e.g., NRT [139], 123 PETER [144]), and they are often powerless when faced with existing advanced recommendation models, which limits…”
E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT
Poerner, N., Waltinger, U., & Schütze, H. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.71 · Cited by 146
A Network-based End-to-End Trainable Task-oriented Dialogue SystemPreprint
Wen, T.-H., Vandyke, D., Mrkšić, N., Gašić, M., Rojas-Barahona, L. M., Su, P.-H., Ultes, S., & Young, S. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.04562 · Cited by 146
Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach
Zhang, J., Xie, R., Hou, Y., Zhao, W. X., Lin, L., & Wen, J.-R. (2023) · arXiv · doi:10.48550/arxiv.2305.07001 · Cited by 146
Packed Levitated Marker for Entity and Relation Extraction
Ye, D., Lin, Y., Li, P., & Sun, M. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.337 · Cited by 144 · cited 1×
“…[84], a benchmark for evaluating word knowledge of LLMs, even the top-ranked GPT4 just achieves 0.012 in Precision and 0.013 in Recall on the task Named Entity Recognition , which falls far short of the performance (0.712 in Precision and 0.706 in Recall) of the task-specific models PL-Marker [85].”
InfluentialShow Your Work: Scratchpads for Intermediate Computation with Language Models
Nye, M., Andreassen, A. J., Gur-Ari, G., Michalewski, H., Austin, J., Bieber, D., Dohan, D., Lewkowycz, A., Bosma, M., Luan, D., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.00114 · Cited by 144
Can language models learn from explanations in context?
Lampinen, A., Dasgupta, I., Chan, S., Mathewson, K., Tessler, M., Creswell, A., McClelland, J., Wang, J., & Hill, F. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.38 · Cited by 142
Unified Conversational Recommendation Policy Learning via Graph-based Reinforcement Learning
Deng, Y., Li, Y., Sun, F., Ding, B., & Lam, W. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3462913 · Cited by 136 · cited 1×
“The attribute-based QA approach [185], [198], [199], [200] utilizes a pipeline”
Language Models are General-Purpose InterfacesPreprint
Hao, Y., Song, H., Li, D., Huang, S., Chi, Z., Wang, W., Ma, S., & Wei, F. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.06336 · Cited by 136
Explainable Recommendation through Attentive Multi-View Learning
Gao, J., Wang, X., Wang, Y., & Xie, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013622 · Cited by 127 · cited 1×
“dation model, users are also interested in the comprehensible justifications for these recommendations [106], [107].”
Self-citationPersonalized Transformer for Explainable Recommendation
Li, L., Zhang, Y., & Chen, L. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.383 · Cited by 124 · cited 3×
“Li et al. [144] use the position vectors corresponding to the user (item) IDs to predict interpreted tokens.”
Symbolic Knowledge Distillation: from General Language Models to Commonsense ModelsPreprint
West, P., Bhagavatula, C., Hessel, J., Hwang, J. D., Jiang, L., Bras, R. J. L., Lu, X., Welleck, S., & Choi, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07178 · Cited by 121
Hidden Backdoors in Human-Centric Language Models
Li, S., Liu, H., Dong, T., Zhao, B. Z. H., Xue, M., Zhu, H., & Lu, J. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3484576 · Cited by 119 · cited 1×
“Secondly, the extensive data utilized by LLMs may encompass human biases and erroneouscontent[158].”
Explainable Interaction-driven User Modeling over Knowledge Graph for Sequential Recommendation
Huang, X., Fang, Q., Qian, S., Sang, J., Yan, L., & Xu, C. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350893 · Cited by 113 · cited 1×
“Path-based approaches, such as Hete-MF [44], SemRec [45], RuleRec [46], EIUM [47], exploit the semantic connectivity information present in the knowledge graph to regularize the user and item representations.”
Self-citationA form-based dialogue manager for spoken language applications
Goddeau, D., Meng, H., Polifroni, J., Seneff, S., & Busayapongchai, S. (2002) · Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96 · doi:10.1109/icslp.1996.607458 · Cited by 113
U-BERT: Pre-training User Representations for Improved Recommendation
Qiu, Z., Wu, X., Gao, J., & Fan, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16557 · Cited by 112 · cited 1×
“For example, U-BERT [102] employs BERT as a content interpreter and introduces masked opinion token prediction and opinion rating prediction as pre-training tasks to better align BERT with recommendation objectives.”
DeepLight: Deep Lightweight Feature Interactions for Accelerating CTR Predictions in Ad Serving
Deng, W., Pan, J., Zhou, T., Kong, D., Flores, A., & Lin, G. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441727 · Cited by 111 · cited 1×
“Embedding size search, such as [157], [158], [159], [160] seeks for appropriate embedding size for each feature to avoid resources overconsumption.”
Fine-tune Bert for DocRED with Two-step Process
Wang, H., Focke, C., Sylvester, R., Mishra, N., & Wang, W. (2019) · arXiv · doi:10.48550/arxiv.1909.11898 · Cited by 111 · cited 1×
“can be applied in the process of constructing knowledge graphs, including entity discovery [56], [57], coreference resolution [58], [59] and relation extraction [60], [61].”
LaMP: When Large Language Models Meet Personalization
Salemi, A., Mysore, S., Bendersky, M., & Zamani, H. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.399 · Cited by 109
LaMP: When Large Language Models Meet Personalization
Salemi, A., Mysore, S., Bendersky, M., & Zamani, H. (2023) · arXiv · doi:10.48550/arxiv.2304.11406 · Cited by 109 · cited 2×
“In the existing related work, LaMP [4] introduces a novel benchmark for training and evaluating language models in producing personalized outputs for information retrieval systems.”
TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs
Liang, Y., Wu, C., Song, T., Wu, W., Xia, Y., Liu, Y., Ou, Y., Lu, S., Ji, L., Mao, S., et al. (2024) · Intelligent Computing · doi:10.34133/icomputing.0063 · Cited by 108
Self-citationAutoField: Automating Feature Selection in Deep Recommender Systems
Wang, Y., Zhao, X., Xu, T., & Wu, X. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512071 · Cited by 105 · cited 1×
“Searching for features consisting of raw feature search [180, 181] and synthetic feature search [182, 183], which selects a subset from the set of original or cross features to maintain informative features to reduce both computation and space cost.”
LLM4Vis: Explainable Visualization Recommendation using ChatGPT
Wang, L., Zhang, S., Wang, Y., Lim, E., & Wang, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-industry.64 · Cited by 101
AKUPM: Attention-Enhanced Knowledge-Aware User Preference Model for Recommendation
Tang, X., Wang, T., Yang, H., & Song, H. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330705 · Cited by 98 · cited 1×
“Unified methods, such as RippleNet [48], KGCN [49], KGAT [50], AKUPM [51], IntentGC [52] refine the representations of entities in the knowledge graph by leveraging embedding propagation techniques.”
Unifying Large Language Models and Knowledge Graphs: A RoadmapPreprint
Pan, S., Luo, L., Wang, Y., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.08302 · Cited by 97
UNBERT: User-News Matching BERT for News Recommendation
Zhang, Q., Li, J., Jia, Q., Wang, C., Zhu, J., Wang, Z., & He, X. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/462 · Cited by 96
Pre-trained Language Model for Web-scale Retrieval in Baidu Search
Liu, Y., Lu, W., Cheng, S., Shi, D., Wang, S., Cheng, Z., & Yin, D. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467149 · Cited by 95 · cited 1×
“The pre-trained model, ERNIE, is also utilized to enhance the representation ability of queries and documents [108, 109].”
BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage
Shuster, K., Xu, J., Komeili, M., Ju, D., Smith, E. M., Roller, S., Ung, M., Chen, M., Arora, K., Lane, J., et al. (2022) · arXiv · doi:10.48550/arxiv.2208.03188 · Cited by 95
Language Models as Knowledge Bases?
Petroni, F., Rocktäschel, T., Lewis, P., Bakhtin, A., Wu, Y., Miller, A., & Riedel, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.01066 · Cited by 94
Towards Knowledge-Based Personalized Product Description Generation in E-commerce
Chen, Q., Lin, J., Zhang, Y., Yang, H., Zhou, J., & Tang, J. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330725 · Cited by 92 · cited 1×
“Furthermore,theincorporationofpre-trainedlanguagemod-elshasplayedasignificantroleinimprovingthegenerationprocessformultiplecontent items[263–266].”
PiVe: Prompting with Iterative Verification Improving Graph-based Generative Capability of LLMs
Han, J., Collier, N., Buntine, W., & Shareghi, E. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.400 · Cited by 92
Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems
Ginart, A. A., Naumov, M., Mudigere, D., Yang, J., & Zou, J. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9517710 · Cited by 91
Re3: Generating Longer Stories With Recursive Reprompting and Revision
Yang, K., Tian, Y., Peng, N., & Klein, D. (2022) · arXiv · doi:10.48550/arxiv.2210.06774 · Cited by 91 · cited 1×
“Re3[218] LLM gpt3-instruct-175B gpt3-instruct-13B Long Stories Generation”
Re3: Generating Longer Stories With Recursive Reprompting and Revision
Yang, K., Tian, Y., Peng, N., & Klein, D. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.296 · Cited by 90
Learnable Embedding Sizes for Recommender SystemsPreprint
Liu, S., Gao, C., Chen, Y., Jin, D., & Li, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07577 · Cited by 90
Research works printed but not linked: 17
- Bengio, Y., Ducharme, R., Vincent, P.: A neural probabilistic language model. Adv. Neural. Inf. Process. Syst. 13 (2000)
- Kenton, J.D.M.-W.C., Toutanova, L.K.: Bert: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of NAACL-HLT, pp. 4171–4186 (2019)
- Yu, X., Ren, X., Gu, Q., Sun, Y., Han, J.: Collaborative filtering with entity similarity regularization in heterogeneous information networks. IJCAI HINA 27 (2013)
- Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. Adv. Neural. Inf. Process. Syst. 26 (2013)
- Le, Q.V., Mikolov, T.: Distributed representations of sentences and documents. In: ICML. JMLR Workshop and Conference Proceedings, vol. 32, pp. 1188–1196. JMLR.org (2014)
- Kumar, V., Khattar, D., Gupta, S., Gupta, M., Varma, V.: Deep neural architecture for news recommendation. In: CLEF (Working Notes). CEUR Workshop Proceedings, vol. 1866. CEUR-WS.org (2017)
- Liu, Q., Zhu, J., Dai, Q., Wu, X.: Boosting deep ctr prediction with a plug-and-play pre-trainer for news recommendation. In: Proceedings of the 29th International Conference on Computational Linguistics, pp. 2823–2833 (2022)
- Muhamed, A., Keivanloo, I., Perera, S., Mracek, J., Xu, Y., Cui, Q., Rajagopalan, S., Zeng, B., Chilimbi, T.: Ctr-bert: cost-effective knowledge distillation for billion-parameter teacher models. In: NeurIPS Efficient Natural Language and Speech Processing Workshop (2021)
- Bills, S., Cammarata, N., Mossing, D., Tillman, H., Gao, L., Goh, G., Sutskever, I., Leike, J., Wu, J., Saunders, W.: Language models can explain neurons in language models (2023)
- Xie, S.M., Raghunathan, A., Liang, P., Ma, T.: An explanation of in-context learning as implicit bayesian inference. In: International Conference on Learning Representations
- Qiu, X., Huang, X.: Convolutional neural tensor network architecture for community-based question answering. In: Twenty-Fourth International Joint Conference on Artificial Intelligence (2015)
- Zhou, H., Huang, M., Zhu, X.: Context-aware natural language generation for spoken dialogue systems. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 2032–2041 (2016)
- Li, J., Li, D., Xiong, C., Hoi, S.: Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. In: International Conference on Machine Learning, pp. 12888–12900 (2022). PMLR
- Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. Adv. Neural. Inf. Process. Syst. 27 (2014)
- Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al.: Learning transferable visual models from natural language supervision. In: International Conference on Machine Learning, pp. 8748–8763 (2021). PMLR
- Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., Chen, M., Sutskever, I.: Zero-shot text-to-image generation. In: International Conference on Machine Learning, pp. 8821–8831 (2021). PMLR
- Hu, E.J., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., Chen, W., et al.: Lora: low-rank adaptation of large language models. In: International Conference on Learning Representations (2021)
Cited by
A Survey on Large Language Models for Recommendation
Wu, L., Zheng, Z., Qiu, Z., Wang, H., Gu, H., Shen, T., Qin, C., Zhu, C., Zhu, H., Liu, Q., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.19860 · Cited by 515
Self-citationA survey on large language models for recommendation
Wu, L., Zheng, Z., Qiu, Z., Wang, H., Gu, H., Shen, T., Qin, C., Zhu, C., Zhu, H., Liu, Q., et al. (2024) · World Wide Web · doi:10.1007/s11280-024-01291-2 · Cited by 515
Self-citationHow Can Recommender Systems Benefit from Large Language Models: A Survey
Lin, J., Dai, X., Xi, Y., Liu, W., Chen, B., Zhang, H., Liu, Y., Wu, C., Li, X., Zhu, C., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3678004 · Cited by 242
Self-citationIndustrial applications of large language models
Raza, M., Jahangir, Z., Riaz, M. B., Saeed, M. J., & Sattar, M. A. (2025) · Scientific Reports · doi:10.1038/s41598-025-98483-1 · Cited by 163
“Jin et al., 65 discuss the applications of LLMs in human computer interaction, personalization systems and recommendation system.”
A survey of personalized large language models: progress and future directions
Liu, J., Qiu, Z., Li, Z., Dai, Q., Yu, W., Zhu, J., Hu, M., Yang, M., Chua, T.-S., & King, I. (2025) · arXiv · doi:10.48550/arxiv.2502.11528 · Cited by 146
Metadata
- Authors
- Chen, J., Liu, Z., Huang, X., Wu, C., Liu, Q., Jiang, G., Pu, Y., Lei, Y., Chen, X., Wang, X., Zheng, K., Lian, D., & Chen, E.
- Affiliations
- Beijing Academy of Artificial Intelligence (CN)
- University of Science and Technology of China (CN)
- University of Electronic Science and Technology of China (CN)
- Corresponding author
- Liu, Zheng
- Huang, Xu
- Wu, Chenwang
- Liu, Qi
- Jiang, Gangwei
- Pu, Yuanhao
- Lei, Yuxuan
- Chen, Xiaolong
- Wang, Xingmei
- Zheng, Kai
- Lian, Defu
- Chen, Enhong
- Venue
- World Wide Web
- Published
- 2024-06-28
- Volume
- 27
- Issue
- 4
- ISSN
- 1386-145X (ISSN-L)
- 1573-1413
- OpenAlex
- W4400118952
- Cited by
- 367
- References
- 236
- Citations by year
- 2026: 126 · 2025: 194 · 2024: 43
- FWCI
- 135.88
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- World Wide Web (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Hong Kong University of Science and Technology
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- large language models, personalization, personalized services, human-AI interaction, tool calling, function calling, recommender systems, search engines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.





