Training Millions of Personalized Dialogue Agents
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Current dialogue systems are not very engaging for users, especially when trained end-toend without relying on proactive reengaging scripted strategies.Zhang et al. (2018) showed that the engagement level of end-to-end dialogue models increases when conditioning them on text personas providing some personalized back-story to the model.However, the dataset used in (Zhang et al., 2018) is synthetic and of limited size as it contains around 1k different personas.In this paper we introduce a new dataset providing 5 million personas and 700 million persona-based dialogues.Our experiments show that, at this scale, training using personas still improves the performance of end-to-end systems.In addition, we show that other tasks benefit from the wide coverage of our dataset by fine-tuning our model on the data from (Zhang et al., 2018) and achieving state-of-the-art results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015) · arXiv · doi:10.48550/arxiv.1503.08895 · Cited by 1,345
Personalizing Dialogue Agents: I have a dog, do you have pets too?
Zhang, S., Dinan, E., Urbanek, J., Szlam, A., Kiela, D., & Weston, J. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1205 · Cited by 1,177 · cited 13×
“P ERSONA - CHAT (Zhang et al., 2018) recently introduced a dataset of conversations re-volving around human habits and preferences.”
BackgroundMethodResultInfluentialA Persona-Based Neural Conversation Model
Li, J., Galley, M., Brockett, C., Spithourakis, G., Gao, J., & Dolan, B. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1094 · Cited by 898
Personalizing Dialogue Agents: I have a dog, do you have pets too?
Zhang, S., Dinan, E., Urbanek, J., Szlam, A., Kiela, D., & Weston, J. (2018) · arXiv · doi:10.48550/arxiv.1801.07243 · Cited by 165
Cited by
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y., Chen, D., Dai, W., et al. (2022) · arXiv · doi:10.48550/arxiv.2202.03629 · Cited by 4,981
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
“The PersonaChat datasets [31, 228] have accelerated research into persona consistency [68, 91, 126, 208, 219, 224, 232].”
BackgroundRecipes for Building an Open-Domain Chatbot
Roller, S., Dinan, E., Goyal, N., Ju, D., Williamson, M., Liu, Y., Xu, J., Ott, M., Smith, E. M., Boureau, Y.-L., et al. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.24 · Cited by 784
Recipes for building an open-domain chatbot
Roller, S., Dinan, E., Goyal, N., Ju, D., Williamson, M., Liu, Y., Xu, J., Ott, M., Shuster, K., Smith, E. M., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.13637 · Cited by 784
“pushshift.io Reddit We use a variant of Reddit discussions, which has also been used in several existing studies, see e.g. Yang et al. (2018); Mazaré et al. (2018); Keskar et al. (2019); Shuster et al. (2019).”
MethodTowards Empathetic Open-domain Conversation Models: A New Benchmark and Dataset
Rashkin, H., Smith, E. M., Li, M., & Boureau, Y.-L. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1534 · Cited by 771
Wizard of Wikipedia: Knowledge-Powered Conversational agents
Dinan, E., Roller, S., Shuster, K., Fan, A., Auli, M., & Weston, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01241 · Cited by 572
Dialogue Natural Language Inference
Welleck, S., Weston, J., Szlam, A., & Cho, K. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1363 · Cited by 249
Beyond Goldfish Memory: Long-Term Open-Domain Conversation
Xu, J., Szlam, A., & Weston, J. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.356 · Cited by 188
Tool Learning with Foundation Models
Qin, Y., Hu, S., Lin, Y., Chen, W., Ding, N., Cui, G., Zeng, Z., Huang, Y., Xiao, C., Han, C., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.08354 · Cited by 184
(2024) · doi:10.1145/3704435 · Cited by 184
Personalizing Dialogue Agents via Meta-Learning
Madotto, A., Lin, Z., Wu, C.-S., & Fung, P. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1542 · Cited by 183
From Matching to Generation: A Survey on Generative Information Retrieval
Li, X., Jin, J., Zhou, Y., Zhang, Y., Zhang, P., Zhu, Y., & Dou, Z. (2025) · ACM Transactions on Information Systems · doi:10.1145/3722552 · Cited by 172
“It is calculated as:”
Learning from Dialogue after Deployment: Feed Yourself, Chatbot!
Hancock, B., Bordes, A., Mazare, P.-E., & Weston, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1358 · Cited by 161
Self-citationCorefQA: Coreference Resolution as Query-based Span Prediction
Wu, W., Wang, F., Yuan, A., Wu, F., & Li, J. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.622 · Cited by 152
Beyond Goldfish Memory: Long-Term Open-Domain Conversation
Xu, J., Szlam, A., & Weston, J. (2021) · arXiv · doi:10.48550/arxiv.2107.07567 · Cited by 148
“In Mazaré et al. (2018) such personas were extracted from Reddit and used to train agents.”
MethodLaMP: When Large Language Models Meet Personalization
Salemi, A., Mysore, S., Bendersky, M., & Zamani, H. (2023) · arXiv · doi:10.48550/arxiv.2304.11406 · Cited by 109
“…work has constructed dialogue data for users by promoting crowd-workers to author dialogues based on specific personas (Zhang et al., 2018), and through extracting user attributes and utterances from Red-dit (Mazaré et al., 2018; Wu et al., 2021) and Weibo (Zhong et al., 2022; Qian et al., 2021).”
BackgroundInfluentialLaMP: When Large Language Models Meet Personalization
Salemi, A., Mysore, S., Bendersky, M., & Zamani, H. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.399 · Cited by 109
Importance of Search and Evaluation Strategies in Neural Dialogue Modeling
Kulikov, I., Miller, A., Cho, K., & Weston, J. (2019) · Proceedings of the 12th International Conference on Natural Language Generation · doi:10.18653/v1/w19-8609 · Cited by 83
“A number of variants of sequence-to-sequence models (Sutskever et al., 2014; Cho et al., 2014; Kalchbrenner and Blunsom, 2013) have been proposed for dialogue modeling in recent years, including hierarchical models (Serban et al., 2016) and transformers (Mazaré et al., 2018; Yang et al., 2018).”
BackgroundLong Time No See! Open-Domain Conversation with Long-Term Persona Memory
Xu, X., Gou, Z., Wu, W., Niu, Z.-Y., Wu, H., Wang, H., & Wang, S. (2022) · arXiv · doi:10.48550/arxiv.2203.05797 · Cited by 65
Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models
Wang, Q., Fu, Y., Cao, Y., Wang, S., Tian, Z., & Ding, L. (2023) · arXiv · doi:10.48550/arxiv.2308.15022 · Cited by 55
“Another way is to employ a memory module to preserve important conversation information, in the form of dialogue histories (Guu et al., 2020; Lewis et al., 2020) or summaries (Mazaré et al., 2018; Xu et al., 2022b), to assist the LLMs.”
Optimization Methods for Personalizing Large Language Models through Retrieval Augmentation
Salemi, A., Kallumadi, S., & Zamani, H. (2024) · Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3626772.3657783 · Cited by 52
Recursively summarizing enables long-term dialogue memory in large language models
Wang, Q., Fu, Y., Cao, Y., Wang, S., Tian, Z., & Ding, L. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130193 · Cited by 55
Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions
Roller, S., Boureau, Y.-L., Weston, J., Bordes, A., Dinan, E., Fan, A., Gunning, D., Ju, D., Li, M., Poff, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.12442 · Cited by 38
“, 2020), we believe it is better for a bot to be able to adapt a multitude of personalities (Zhang et al., 2018; Mazaré et al., 2018).”
BackgroundMethodInfluentialSelf-citationLarge scale multi-actor generative dialog modeling,
Boyd, A., Puri, R., Shoeybi, M., Patwary, M., & Catanzaro, B. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.8 · Cited by 22
Am I Me or You? State-of-the-Art Dialogue Models Cannot Maintain an Identity
Shuster, K., Urbanek, J., Szlam, A., & Weston, J. (2022) · Findings of the Association for Computational Linguistics: NAACL 2022 · doi:10.18653/v1/2022.findings-naacl.182 · Cited by 20
Abu-Jeyyab, M., Alrosan, S., & Alkhawaldeh, I. (2023) · High Yield Medical Reviews · doi:10.59707/hymrfbya5348 · Cited by 17
Large Language Models Empowered Personalized Web Agents
Cai, H., Li, Y., Wang, W., Zhu, F., Shen, X., Li, W., & Chua, T.-S. (2025) · Proceedings of the ACM on Web Conference 2025 · doi:10.1145/3696410.3714842 · Cited by 15
“In this section, we formulate the task of LLM-empowered Web agents in Section 3.1, detail the construction of PersonalWAB in Section 3.2, and present the evaluation paradigms in Section 3.3.”
InfluentialTowards User-Centric Text-to-Text Generation: A Survey
Yang, D., & Flek, L. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-83527-9_1 · Cited by 10
Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMs
Zhao, S., Hong, M., Liu, Y., Hazarika, D., & Lin, K. (2025) · arXiv · doi:10.48550/arxiv.2502.09597 · Cited by 3
Faithful Persona-based Conversational Dataset Generation with Large Language Models
Jandaghi, P., Sheng, X., Bai, X., Pujara, J., & Sidahmed, H. (2023) · arXiv · doi:10.48550/arxiv.2312.10007 · Cited by 1
“One of the earliest works in this area is Persona-Chat, by (Zhang et al., 2018), which proposed the Persona-Chat dataset and evaluation metrics that have become a benchmark for persona-based conversation generation (Mazaré et al., 2018).”
BackgroundAutoPal: Autonomous Adaptation to Users for Personal AI Companionship
Cheng, Y., Liu, W., Xu, K., Hou, W., Ouyang, Y., Leong, C. T., Li, W., Wu, X., & Zheng, Y. (2024) · arXiv · doi:10.48550/arxiv.2406.13960 · Cited by 2
Metadata
- Authors
- Mazaré, P.-E., Humeau, S., Raison, M., & Bordes, A.
- Venue
- Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
- Published
- 2018
- Pages
- 2775-2779
- OpenAlex
- W2890394457
- Cited by
- 226
- References
- 4
- FWCI
- 11.76
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.