Long Time No See! Open-Domain Conversation with Long-Term Persona Memory
Open accessAbstract
Most of the open-domain dialogue models tend to perform poorly in the setting of long-term human-bot conversations. The possible reason is that they lack the capability of understanding and memorizing long-term dialogue history information. To address this issue, we present a novel task of Long-term Memory Conversation (LeMon) and then build a new dialogue dataset DuLeMon and a dialogue generation framework with Long-Term Memory (LTM) mechanism (called PLATO-LTM). This LTM mechanism enables our system to accurately extract and continuously update long-term persona memory without requiring multiple-session dialogue datasets for model training. To our knowledge, this is the first attempt to conduct real-time dynamic management of persona information of both parties, including the user and the bot. Results on DuLeMon indicate that PLATO-LTM can significantly outperform baselines in terms of long-term dialogue consistency, leading to better dialogue engagingness.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
CAIM's memory structure is divided into STM and LTM, following models of human memory.
“In particular, CAIM’s memory structure is divided into STM and LTM, following models of human memory [2, 3, 49, 60].”
From CAIM: Development and Evaluation of a Cognitive AI Memory Framework for Long-Term Interaction with Intelligent Agents (2026) · cites this paper as [60]
Sections 4 and 4.2 describe a dialogue system with a long-term memory (LTM) module. They do not describe CAIM, an STM/LTM division, or a design based on models of human memory; the paper’s LTM instead stores user and chatbot persona information. No page numbers are available in our copy. (LLM, conf=0.82)
Experimental — accuracy not yet measuredCurrent LLMs are not designed to retain information persistently across interactions due to their limited context window.
“Current LLMs are not designed to retain information persistently across interactions due to their limited context window [60].”
From CAIM: Development and Evaluation of a Cognitive AI Memory Framework for Long-Term Interaction with Intelligent Agents (2026) · cites this paper as [60]
The Introduction says large-scale generative dialogue models perform poorly in long-term conversations, and the Conclusion describes adding long-term memory to retain persona information. Appendix B specifies a maximum context length, but the paper does not say that this limit is why current models fail to retain information across interactions, or that LLMs generally are not designed to do so. (LLM, conf=0.84)
Experimental — accuracy not yet measuredThe memory is often divided into STM (Working Memory) and LTM.
“The memory is often divided into several types of memories. Typical types are a STM, called Working Memory in cognitive science [3], which reflects the current circumstances, and a LTM that stores relevant knowledge for extended periods [2, 60].”
From CAIM: Development and Evaluation of a Cognitive AI Memory Framework for Long-Term Interaction with Intelligent Agents (2026) · cites this paper as [60]
Section 4.2, “Long-Term Memory” (page not provided), says the LTM module stores historical persona information about the user and chatbot. That supports the LTM portion of the claim, but the paper does not describe a general division of memory into STM and LTM or identify STM as working memory. (LLM, conf=0.84)
Experimental — accuracy not yet measuredLLMs have a limited context window that restricts the amount of information they can process and thus their ability to understand the ever-changing environment and maintain effective long-term interactions.
“Despite their capabilities, LLMs still have shortcomings, such as a limited context window, which restricts the amount of information that can be processed and thus the ability to understand the ever-changing environment [58, 60] and maintain effective long-term interactions [45, 50].”
From CAIM: Development and Evaluation of a Cognitive AI Memory Framework for Long-Term Interaction with Intelligent Agents (2026) · cites this paper as [60]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 25
- Daniel Adiwardana, Minh-Thang Luong, David R. So, Jamie Hall, Noah Fiedel, Romal Thoppilan, Zi Yang, Apoorv Kulshreshtha, Gaurav Nemade, Yifeng Lu, and Quoc V. Le. 2020. Towards a human-like open- domain chatbot. CoRR, abs/2001.09977. · arXiv
- Jeesoo Bang, Hyungjong Noh, Yonghee Kim, and Gary Geunbae Lee. 2015. Example-based chat- oriented dialogue system with personalized long- term memory. In 2015 International Conference on Big Data and Smart Computing (BIGCOMP), pages 238-243. · DOI
- Siqi Bao, Huang He, Fan Wang, Hua Wu, Haifeng Wang, Wenquan Wu, Zhen Guo, Zhibin Liu, and Xinchao Xu. 2020. PLATO-2: towards building an open-domain chatbot via curriculum learning. CoRR, abs/2006.16779. · arXiv
- Joana Campos, James Kennedy, and Jill F. Lehman. 2018. Challenges in exploiting conversational mem- ory in human-agent interaction. In Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems, AAMAS '18, page 1649-1657, Richland, SC. International Foundation for Autonomous Agents and Multiagent Systems.
- Emily Dinan, Varvara Logacheva, Valentin Malykh, Alexander H. Miller, Kurt Shuster, Jack Urbanek, Douwe Kiela, Arthur Szlam, Iulian Serban, Ryan Lowe, Shrimai Prabhumoye, Alan W. Black, Alexan- der I. Rudnicky, Jason Williams, Joelle Pineau, Mikhail S. Burtsev, and Jason Weston. 2019. The sec- ond conversational intelligence challenge (convai2). CoRR, abs/1902.00098. · arXiv
- Miguel Elvir, Avelino J. Gonzalez, Christopher Walls, and Bryan Wilder. 2017. Remembering a conver- sation -a conversational memory architecture for embodied conversational agents. Journal of Intelli- gent Systems, 26(1):1-21. · DOI
- Minlie Huang, Xiaoyan Zhu, and Jianfeng Gao. 2020. Challenges in building intelligent open-domain dia- log systems. ACM Trans. Inf. Syst., 38(3). · DOI · Paper page
- Yonghee Kim, Jeesoo Bang, Junhwi Choi, Seonghan Ryu, Sangjun Koo, and Gary Geunbae Lee. 2014. Acquisition and use of long-term memory for per- sonalized dialog systems. In Multimodal Analyses enabling Artificial Agents in Human-Machine Inter- action -Second International Workshop, MA3HMI 2014, Held in Conjunction with INTERSPEECH 2014, Singapore, Singapore, September 14, 2014, Revised Selected Papers, volume 8757 of Lecture Notes in Computer Science, pages 78-87. Springer. · DOI
- Yoon Kim. 2014. Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Lan- guage Processing, EMNLP 2014, October 25-29, 2014, Doha, Qatar, A meeting of SIGDAT, a Spe- cial Interest Group of the ACL, pages 1746-1751. · DOI · Paper page
- ACL.
- Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In 3rd Inter- national Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings.
- Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, and William B. Dolan. 2016a. A persona-based neural conversation model. In Proceedings of the 54th Annual Meeting of the As- sociation for Computational Linguistics, ACL 2016, August 7-12, 2016, Berlin, Germany, Volume 1: Long Papers. The Association for Computer Linguistics. · DOI · Paper page
- Mei Yii Lim. 2012. Memory Models for Intelligent Social Companions, pages 241-262. Springer Berlin Heidelberg, Berlin, Heidelberg. · DOI
- Zhaojiang Lin, Zihan Liu, Genta Indra Winata, Samuel Cahyawijaya, Andrea Madotto, Yejin Bang, Etsuko Ishii, and Pascale Fung. 2020. Xpersona: Eval- uating multilingual personalized chatbot. CoRR, abs/2003.07568. · arXiv
- Pierre-Emmanuel Mazaré, Samuel Humeau, Martin Rai- son, and Antoine Bordes. 2018. Training millions of personalized dialogue agents. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2775-2779, Brussels, Belgium. Association for Computational Linguistics. · DOI
- Kishore Papineni, Salim Roukos, Todd Ward, and Wei- Jing Zhu. 2002. Bleu: a method for automatic evalu- ation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Compu- tational Linguistics, July 6-12, 2002, Philadelphia, PA, USA, pages 311-318. · DOI · Paper page
- ACL.
- Qiao Qian, Minlie Huang, Haizhou Zhao, Jingfang Xu, and Xiaoyan Zhu. 2018. Assigning personal- ity/profile to a chatting machine for coherent con- versation generation. In Proceedings of the Twenty- Seventh International Joint Conference on Artificial Intelligence, IJCAI-18, pages 4279-4285. Interna- tional Joint Conferences on Artificial Intelligence Organization. · DOI
- Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Eric Michael Smith, Y-Lan Boureau, and Jason We- ston. 2021. Recipes for building an open-domain chatbot. In Proceedings of the 16th Conference of the European Chapter of the Association for Com- putational Linguistics: Main Volume, EACL 2021, Online, April 19 -23, 2021, pages 300-325. Associa- tion for Computational Linguistics.
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Pro- cessing Systems, volume 30.
- Saizheng Zhang, Emily Dinan, Jack Urbanek, Arthur Szlam, Douwe Kiela, and Jason Weston. 2018. Per- sonalizing dialogue agents: I have a dog, do you have pets too? In Proceedings of the 56th Annual Meeting of the Association for Computational Lin- guistics (Volume 1: Long Papers), pages 2204-2213, Melbourne, Australia. Association for Computational Linguistics. · DOI · Paper page
- Weinan Zhang, Ting Liu, Yifa Wang, and Qingfu Zhu. 2017. Neural personalized response generation as domain adaptation. CoRR, abs/1701.02073. · arXiv
- Tiancheng Zhao, Ran Zhao, and Maxine Eskénazi. 2017. Learning discourse-level diversity for neural dialog models using conditional variational autoencoders. In Proceedings of the 55th Annual Meeting of the As- sociation for Computational Linguistics, ACL 2017, Vancouver, Canada, July 30 -August 4, Volume 1: Long Papers, pages 654-664. Association for Com- putational Linguistics. · DOI · Paper page
- Yinhe Zheng, Guanyi Chen, Minlie Huang, Song Liu, and Xuan Zhu. 2019. Personalized dialogue genera- tion with diversified traits. CoRR, abs/1901.09672. · arXiv
- Peixiang Zhong, Chen Zhang, Hao Wang, Yong Liu, and Chunyan Miao. 2020. Towards persona-based empa- thetic conversational models. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6556-6566, Online. Association for Computational Linguistics. · DOI
Cited by
Sorted by citations
Retrieval-Augmented Generation for Large Language Models: A Survey
Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, M., & Wang, H. (2023) · arXiv · doi:10.48550/arxiv.2312.10997 · Cited by 876 · see citing works
Self-citationMemolet: Reifying the Reuse of User-AI Conversational Memories
Yen, R., & Zhao, J. (2024) · Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3654777.3676388 · Cited by 22 · see citing works
MemoryBank: Enhancing Large Language Models with Long-Term Memory
Zhong, W., Guo, L., Gao, Q., Ye, H., & Wang, Y. (2023) · arXiv · doi:10.48550/arxiv.2305.10250 · Cited by 253 · see citing works
Evaluating the Long-Term Memory of Large Language Models
Jia, Z., Liu, Q., Li, H., Chen, Y., & Liu, J. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.1014 · Cited by 5 · see citing works
“Recent approaches (Xu et al., 2022b; Chen et al., 2024) store memory in text form without changing model parameters, preventing models from truly remembering dialogue history.”
LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory
Wu, D., Wang, H., Yu, W., Zhang, Y., Chang, K.-W., & Yu, D. (2024) · arXiv · doi:10.48550/arxiv.2410.10813 · Cited by 3 · see citing works
“Early works focused on language modeling evaluation on generating personalized responses from human-human (Xu et al., 2022a) or human-AI (Xu et al., 2022b) chat histories.”
Self-citationMemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents
Tan, H., Zhang, Z., Ma, C., Chen, X., Dai, Q., & Dong, Z. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.989 · Cited by 7 · see citing works
Westhäußer, R., Minker, W., & Zepf, S. (2026) · Proceedings of the 31st International Conference on Intelligent User Interfaces · doi:10.1145/3742413.3789222 · Cited by 1 · see citing works
From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents
Uddin, M. N., Shubham, K., Blanco, E., Baral, C., & Wang, G. (2026) · arXiv · doi:10.48550/arxiv.2604.20006
“Early benchmarks such as DuLeMon (Xu et al., 2022b) evaluate persona-consistent dialogue generation.”
A Multi-Task Role-Playing Agent Capable of Imitating Character Linguistic Styles
Chen, S., Si, Q., Yang, C., Liang, Y., Lin, Z., Liu, H., & Wang, W. (2024) · arXiv · doi:10.48550/arxiv.2411.02457
“Persona-based dialogue datasets (Zhang et al., 2018; Di-nan et al., 2019; Xu et al., 2022) are constructed through interactions between two human speakers, each providing approximately five sentences to describe their persona traits, which are then reflected in the subsequent dialogue.”
Background
- Authors
- Xu, X., Gou, Z., Wu, W., Niu, Z.-Y., Wu, H., Wang, H., & Wang, S.
- Affiliations
- Beijing University of Posts and Telecommunications (CN)
- Baidu (China) (CN)
- Columbia University (US)
- ORCID
- Wang, Shihang
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Pages
- 2639-2650
- arXiv
- 2203.05797
- OpenAlex
- W4226484906
- Cited by
- 65
- References
- 0
- Citations by year
- 2026: 13 · 2025: 12 · 2024: 12 · 2023: 22 · 2022: 6
- FWCI
- 7.19
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Findings of the Association for Computational Linguistics: ACL (Findings of ACL) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › AI in Service Interactions
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- open-domain dialogue, long-term memory, dialogue generation, dialogue dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
