Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversations
Open accessAbstract
In the field of natural language processing, open-domain chatbots have emerged as an important research topic.However, a major limitation of existing open-domain chatbot research is its singular focus on short single-session dialogue, neglecting the potential need for understanding contextual information in multiple consecutive sessions that precede an ongoing dialogue.Among the elements that compose the context in multi-session conversation settings, the time intervals between sessions and the relationships between speakers would be particularly important.Despite their importance, current research efforts have not sufficiently addressed these dialogical components.In this paper, we introduce a new 1M multisession dialogue dataset, called CONVERSA-TION CHRONICLES, for implementing a longterm conversation setup in which time intervals and fine-grained speaker relationships are incorporated.Following recent works, we exploit a large language model to produce the data.The extensive human evaluation shows that dialogue episodes in CONVERSATION CHRONI-CLES reflect those properties while maintaining coherent and consistent interactions across all the sessions.We also propose a dialogue model, called REBOT, which consists of chronological summarization and dialogue generation modules using only around 630M parameters.When trained on CONVERSATION CHRONI-CLES, REBOT demonstrates long-term context understanding with a high human engagement score. 1
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · see citing works
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522 · see citing works
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · see citing works
(2004) · Cited by 9,718 · see citing works
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821 · see citing works
Transformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.6 · Cited by 8,741 · see citing works
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208 · see citing works
A large annotated corpus for learning natural language inference
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1075 · Cited by 3,377 · see citing works
Liu, C., Lowe, R., Serban, I. V., Noseworthy, M., Charlin, L., & Pineau, J. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1230 · Cited by 1,262 · see citing works
ChatGPT outperforms crowd workers for text-annotation tasks
Gilardi, F., Alizadeh, M., & Kubli, M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2305016120 · Cited by 1,197 · see citing works
Personalizing Dialogue Agents: I have a dog, do you have pets too?
Zhang, S., Dinan, E., Urbanek, J., Szlam, A., Kiela, D., & Weston, J. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1205 · Cited by 1,177 · see citing works
Towards Empathetic Open-domain Conversation Models: A New Benchmark and Dataset
Rashkin, H., Smith, E. M., Li, M., & Boureau, Y.-L. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1534 · Cited by 883 · see citing works
Baumgartner, J., Zannettou, S., Keegan, B., Squire, M., & Blackburn, J. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7347 · Cited by 881 · see citing works
Recipes for Building an Open-Domain Chatbot
Roller, S., Dinan, E., Goyal, N., Ju, D., Williamson, M., Liu, Y., Xu, J., Ott, M., Smith, E. M., Boureau, Y.-L., et al. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.24 · Cited by 784 · see citing works
DailyDialog: A Manually Labelled Multi-turn Dialogue DatasetPreprint
Li, Y., Su, H., Shen, X., Li, W., Cao, Z., & Niu, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.03957 · Cited by 757 · see citing works
Wizard of Wikipedia: Knowledge-Powered Conversational agentsPreprint
Dinan, E., Roller, S., Shuster, K., Fan, A., Auli, M., & Weston, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01241 · Cited by 610 · see citing works
Data-Driven Response Generation in Social Media
Ritter, A., Cherry, C. A., & Dolan, W. B. (2011) · Cited by 566 · see citing works
ParlAI: A Dialog Research Software Platform
Miller, A., Feng, W., Batra, D., Bordes, A., Fisch, A., Lu, J., Parikh, D., & Weston, J. (2017) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/d17-2014 · Cited by 326 · see citing works
Baize: An Open-Source Chat Model with Parameter-Efficient Tuning on Self-Chat Data
Xu, C., Guo, D., Duan, N., & McAuley, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.385 · Cited by 191 · see citing works
Beyond Goldfish Memory: Long-Term Open-Domain Conversation
Xu, J., Szlam, A., & Weston, J. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.356 · Cited by 188 · see citing works
Can You Put it All Together: Evaluating Conversational Agents’ Ability to Blend Skills
Smith, E. M., Williamson, M., Shuster, K., Weston, J., & Boureau, Y.-L. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.183 · Cited by 179 · see citing works
A Holistic Approach to Undesired Content Detection in the Real World
Markov, T., Zhang, C., Agarwal, S., Nekoul, F. E., Lee, T. T. H., Adler, S., Jiang, A., & Weng, L. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i12.26752 · Cited by 153 · see citing works
Beyond Goldfish Memory: Long-Term Open-Domain Conversation
Xu, J., Szlam, A., & Weston, J. (2021) · arXiv · doi:10.48550/arxiv.2107.07567 · Cited by 148 · see citing works
BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage
Shuster, K., Xu, J., Komeili, M., Ju, D., Smith, E. M., Roller, S., Ung, M., Chen, M., Arora, K., Lane, J., et al. (2022) · arXiv · doi:10.48550/arxiv.2208.03188 · Cited by 95 · see citing works
Long Time No See! Open-Domain Conversation with Long-Term Persona Memory
Xu, X., Gou, Z., Wu, W., Niu, Z.-Y., Wu, H., Wang, H., & Wang, S. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.207 · Cited by 80 · see citing works
ProsocialDialog: A prosocial backbone for conversational agents
Kim, H., Yu, Y., Jiang, L., Lu, X., Khashabi, D., Kim, G., Choi, Y., & Sap, M. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.267 · Cited by 80 · see citing works
Self-citationSODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization
Kim, H., Hessel, J., Jiang, L., West, P., Lu, X., Yu, Y., Zhou, P., Bras, R., Alikhani, M., Kim, G., et al. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.799 · Cited by 63 · see citing works
Self-citationKeep Me Updated! Memory Management in Long-term Conversations
Bae, S., Kwak, D., Kang, S., Lee, M. Y., Kim, S., Jeong, Y., Kim, H., Lee, S.-W., Park, W., & Sung, N. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.276 · Cited by 29 · see citing works
Self-citationGetting To Know You: User Attribute Extraction from DialoguesPreprint
Wu, C.-S., Madotto, A., Lin, Z., Xu, P., & Fung, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.04621 · Cited by 23 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Kishore Papineni, Salim Roukos, Todd Ward, and Wei- Jing Zhu. 2002. Bleu: a method for automatic evalu- ation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computa- tional Linguistics, pages 311-318.
Cited by
Sorted by citations
Evaluating Very Long-Term Conversational Memory of LLM Agents
Maharana, A., Lee, D.-H., Tulyakov, S., Bansal, M., Barbieri, F., & Fang, Y. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.747 · Cited by 96 · see citing works
Evaluating LLM-based Agents for Multi-turn Conversations: A Survey
Guan, S., Wang, J., 渡辺, 将., Zhu, B., Lou, J., & Xiong, H. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3793671 · Cited by 28 · see citing works
Towards lifelong dialogue agents via timeline-based memory management
Ong, K. T.-I., Kim, N., Gwak, M., Chae, H., Kwon, T., Jo, Y., Hwang, S.-W., Lee, D., & Yeo, J. (2025) · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2025.naacl-long.435 · Cited by 18 · see citing works
Evaluating Very Long-Term Conversational Memory of LLM Agents
Maharana, A., Lee, D.-H., Tulyakov, S., Bansal, M., Barbieri, F., & Fang, Y. (2024) · arXiv · doi:10.48550/arxiv.2402.17753 · Cited by 3 · see citing works
DialRet: Enhancing Dialogue Retention for Multi-session Conversations
Na, Y., Kim, D., & Chae, D. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8186-0_7 · Cited by 2 · see citing works
Kim, N., Lee, J., Park, S. H., On, Y., Lee, J., Keum, M., Oh, S.-H., Song, Y., Lee, J., Won, G. H., et al. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1473614 · Cited by 2 · see citing works
Remind: Recall Enhanced Memory Integration for Natural Language Dialogue Systems
Huang, B.-S., Kuo, T. T., Wang, L.-J., & Lin, C. (2025) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai64502.2025.00125 · Cited by 2 · see citing works
Generating, retrieving persona and generating responses for long-term open-domain dialogue
Cha, D., Lee, D., & Kim, J. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.2979 · Cited by 2 · see citing works
HingeMem: Boundary Guided Long-Term Memory with Query Adaptive Retrieval for Scalable Dialogues
Zhong, Y., Gao, Y., & Wang, H. (2026) · Proceedings of the ACM Web Conference 2026 · doi:10.1145/3774904.3792089 · Cited by 1 · see citing works
MemRefine: LLM-Guided Compression for Long-Term Agent Memory
Kim, M., Baek, J., Jeong, S., & Hwang, S. J. (2026) · arXiv · doi:10.48550/arxiv.2606.13177
Ge, Y., Romeo, S., Cai, J., Shu, R., Sunkara, M., Benajiba, Y., & Zhang, Y. (2025) · arXiv · doi:10.48550/arxiv.2502.01630 · Cited by 3 · see citing works
Mao, W., Tan, H., Liu, S., Liu, H., Xu, Y., Ji, H., & Wang, X. (2026) · arXiv · doi:10.48550/arxiv.2601.06490
RECALLbot: Designing Agentic Memory and Reciprocal Disclosure for Human–Chatbot Relationships
Jiang, Z., Zheng, C., Chen, H., & Chen, L. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790714
Chen, C., Molina, M. D., Liao, M., & Snyder, E. C. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791635 · Cited by 2 · see citing works
Lee, S., & Cho, S. (2026) · Journal of Korean Institute of Industrial Engineers · doi:10.7232/jkiie.2026.52.2.116
Meta-Memory for Large Language Models
Liang, B., Ke, C., Zhao, R., Zhu, Q., Gui, L., Yu, Y., Wang, H., Xu, R., & Wong, K. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3692286
NeurPIU: Neurobiologically Inspired Personalized Intent Understanding in Large Language Models
Liao, Z., Liao, J., & Zhao, X. H. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809593
Efficient Memory Alignment for Long-term Conversational Information Seeking
Xu, Q., Liu, X., Zhouhua, F., Li, Y., Liu, Z., Lee, V., & Wang, H. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809926
Ke, C., Liang, B., Liu, X., Yu, Y., Wang, H., & Xu, R. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809646
Rapid Episodic-Merging Memory for LLM Agents
YANG, H., & Gopalakrishnan, A. K. (2026) · International Conference on Mechatronics, Robotics, and Artificial Intelligence (MRAI) · doi:10.1109/mrai70020.2026.11621122
- Authors
- Jang, J., Boo, M., & Kim, H.
- Affiliations
- Ulsan National Institute of Science and Technology (KR)
- ORCID
- Kim, Hyounghun
- Venue
- Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Published
- 2023
- Pages
- 13584-13606
- OpenAlex
- W4389523826
- Cited by
- 13
- References
- 29
- Citations by year
- 2026: 9 · 2025: 4
- FWCI
- 2.30
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Ulsan National Institute of Science and Technology (2020-0-01336)
- Ministry of Science and ICT, South Korea (2020-0-01336)
- Institute for Information and Communications Technology Promotion (2020–0-01336)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › AI in Service Interactions
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- open-domain chatbots, temporal dynamics, dialogue dataset, dialogue summarization, dialogue generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review