The DOI matches its DataCite record; 1 of the 12 references it cites were found in a registry or an index, and 11 are not checked yet.
Compress to Impress: Unleashing the Potential of Compressive Memory in Real-World Long-Term Conversations
Open accessAbstract
Existing retrieval-based methods have made significant strides in maintaining long-term conversations. However, these approaches face challenges in memory database management and accurate memory retrieval, hindering their efficacy in dynamic, real-world interactions. This study introduces a novel framework, COmpressive Memory-Enhanced Dialogue sYstems (COMEDY), which eschews traditional retrieval modules and memory databases. Instead, COMEDY adopts a "One-for-All" approach, utilizing a single language model to manage memory generation, compression, and response generation. Central to this framework is the concept of compressive memory, which intergrates session-specific summaries, user-bot dynamics, and past events into a concise memory format. To support COMEDY, we curated a large-scale Chinese instruction-tuning dataset, Dolphin, derived from real user-chatbot interactions. Comparative evaluations demonstrate COMEDY's superiority over traditional retrieval-based methods in producing more nuanced and human-like conversational experiences. Our codes are available at https://github.com/nuochenpku/COMEDY.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Recent approaches store memory in text form without changing model parameters, preventing models from truly remembering dialogue history.
“Recent approaches (Xu et al., 2022b; Chen et al., 2024) store memory in text form without changing model parameters, preventing models from truly remembering dialogue history.”
From Evaluating the Long-Term Memory of Large Language Models (2025) · cites this paper as Chen et al., 2024
The Introduction (page unavailable) describes recent retrieval-based approaches that summarize past conversations, store the summaries in a memory database, and retrieve them for response generation. It also identifies retrieval failures, but does not say that these approaches leave model parameters unchanged or prevent models from truly remembering dialogue history. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 22
- Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, T. J. Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeff Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. ArXiv.
- Yu Cao, Liang Ding, Zhiliang Tian, and Meng Fang. 2021. Towards efficiently diversifying dialogue gen- eration via embedding augmentation. In ICASSP.
- Nuo Chen, Hongguang Li, Baoyuan Wang, and Jia Li. 2023b. From good to great: Improving math reason- ing with tool-augmented interleaf prompting. arXiv preprint arXiv:2401.05384. · arXiv
- Eunbi Choi, Kyoung-Woon On, Gunsoo Han, Sung- woong Kim, Daniel Wontae Nam, Daejin Jo, Se- ung Eun Rho, Taehwan Kwon, and Minjoon Seo. 2023. Effortless integration of memory management into open-domain conversation systems. ArXiv.
- Tianyu Gao, Xingcheng Yao, and Danqi Chen. 2021. Simcse: Simple contrastive learning of sentence em- beddings. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 6894-6910.
- Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Mingwei Chang. 2020. Retrieval augmented language model pre-training. In ICLR. · DOI
- Patrick Lewis, Ethan Perez, Aleksandara Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Hein- rich Kuttler, Mike Lewis, Wen tau Yih, Tim Rock- täschel, Sebastian Riedel, and Douwe Kiela. 2020. Retrieval-augmented generation for knowledge- intensive nlp tasks. In NeurIPS.
- Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2016. A diversity-promoting ob- jective function for neural conversation models. In NAACL HLT 2016, The 2016 Conference of the North American Chapter of the Association for Computa- tional Linguistics: Human Language Technologies, San Diego California, USA, June 12-17, 2016, pages 110-119. The Association for Computational Lin- guistics.
- Chin-Yew Lin. 2004. ROUGE: A package for auto- matic evaluation of summaries. In Text Summariza- tion Branches Out, pages 74-81, Barcelona, Spain. Association for Computational Linguistics.
- Qingyu Lu, Baopu Qiu, Liang Ding, Liping Xie, and Dacheng Tao. 2023. Error analysis prompting en- ables human-like translation evaluation in large lan- guage models: A case study on chatgpt. arXiv preprint.
- Kishore Papineni, Salim Roukos, Todd Ward, and Wei- Jing Zhu. 2002. Bleu: a method for automatic evalu- ation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Compu- tational Linguistics, July 6-12, 2002, Philadelphia, PA, USA, pages 311-318. ACL.
- Keqin Peng, Liang Ding, Qihuang Zhong, Li Shen, Xuebo Liu, Min Zhang, Yuanxin Ouyang, and Dacheng Tao. 2023. Towards making the most of chatgpt for machine translation. arxiv preprint.
- Rafael Rafailov, Archit Sharma, Eric Mitchell, Stefano Ermon, Christopher D Manning, and Chelsea Finn. 2023. Direct preference optimization: Your language model is secretly a reward model. arXiv preprint arXiv:2305.18290. · arXiv
- Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 3982-3992.
- Hugo Touvron, Louis Martin, Kevin Stone, Peter Al- bert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023b. Llama 2: Open founda- tion and fine-tuned chat models. arXiv preprint arXiv:2307.09288. · arXiv
- Qingyue Wang, Liang Ding, Yanan Cao, Zhiliang Tian, Shi Wang, Dacheng Tao, and Li Guo. 2023b. Re- cursively summarizing enables long-term dialogue memory in large language models. arXiv preprint arXiv:2308.15022. · arXiv
- Haoran Wu, Wenxuan Wang, Yuxuan Wan, Wenxiang Jiao, and Michael Lyu. 2023. Chatgpt or grammarly? evaluating chatgpt on grammatical error correction benchmark. arXiv preprint.
- Qingyang Wu, Zhenzhong Lan, Kun Qian, Jing Gu, Al- borz Geramifard, and Zhou Yu. 2022. Memformer: A memory-augmented transformer for sequence mod- eling. In Findings of the Association for Computa- tional Linguistics: AACL-IJCNLP 2022, pages 308- 318, Online only. Association for Computational Lin- guistics.
- Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yifan Xu, Wendi Zheng, Xiao Xia, Weng Lam Tam, Zixuan Ma, Yufei Xue, Jidong Zhai, Wenguang Chen, P. Zhang, Yuxiao Dong, and Jie Tang. 2022. Glm-130b: An open bilingual pre-trained model. ArXiv.
- Tong Zhang, Yong Liu, Boyang Li, Zhiwei Zeng, Peng- wei Wang, Yuan You, Chunyan Miao, and Lizhen Cui. 2022. History-aware hierarchical transformer for multi-session open-domain dialogue system. In Findings of EMNLP. · DOI
- Qihuang Zhong, Liang Ding, Juhua Liu, Bo Du, and Dacheng Tao. 2023a. Can chatgpt understand too? a comparative study on chatgpt and fine-tuned bert. arXiv preprint.
- Wanjun Zhong, Lianghong Guo, Qiqi Gao, and Yan- lin Wang. 2023b. Memorybank: Enhancing large language models with long-term memory. arXiv preprint arXiv:2305.10250. · arXiv
Cited by
Sorted by citations
Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language ModelsPreprint
Li, Y. X., Shen, X., Miao, Y., Yao, X., Ding, X., Krishnan, R., & Padman, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.04717 · Cited by 132
Hu, M., Chen, T., Chen, Q., Mu, Y., Shao, W., & Luo, P. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1575 · Cited by 114
The Oscars of AI Theater: A Survey on Role-Playing with Language ModelsPreprint
Chen, N., Wang, Y. S., Deng, Y., & Li, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.11484 · Cited by 92
Self-citationRecursively summarizing enables long-term dialogue memory in large language models
Wang, Q., Fu, Y., Cao, Y., Wang, S., Tian, Z., & Ding, L. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130193 · Cited by 55
Enhancing Persona Consistency for LLMs' Role-Playing using Persona-Aware Contrastive LearningPreprint
Ji, K., Lian, Y., Li, L., Gao, J., Li, W., & Dai, B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.17662 · Cited by 22
Towards lifelong dialogue agents via timeline-based memory management
Ong, K. T.-I., Kim, N., Gwak, M., Chae, H., Kwon, T., Jo, Y., Hwang, S.-W., Lee, D., & Yeo, J. (2025) · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2025.naacl-long.435 · Cited by 18
Enhancing Persona Consistency for LLMs’ Role-Playing using Persona-Aware Contrastive Learning
Ji, K., Lian, Y., Li, L., Gao, J., Li, W., & Dai, B. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.1344 · Cited by 14
Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMsPreprint
Zhao, W., Hu, Y., Deng, Y., Guo, J., Sui, X., Han, X., Zhang, A., Zhao, Y., Qin, B., Chua, T.-S., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.20968 · Cited by 13
MOOM: Maintenance, Organization and Optimization of Memory in Ultra-Long Role-Playing DialoguesPreprint
Chen, W., Tang, J., Hou, Z., Han, S., Zhan, M., Huang, Z., Liu, D., Guo, J., Zhao, Z., & Su, F. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.11860 · Cited by 11
ChatMDG: A discourse parsing graph fusion based approach for multi-party dialogue generation
Li, J., Song, S., Li, Y., Zhang, H., & Hu, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102469 · Cited by 10
Self-citationRole-Playing Evaluation for Large Language Models
Boudouri, Y. E., Nuninger, W., Álvarez, J., & Peter, Y. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-032-05070-0_11 · Cited by 9
SHARE: Shared Memory-Aware Open-Domain Long-Term Dialogue Dataset Constructed from Movie Script
Kim, E., Park, C., & Chang, B. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.704 · Cited by 7
Teaching LLMs to See and Guide: Context-Aware Real-Time Assistance in Augmented RealityPreprint
Qorbani, M., Paynabar, K., & Moghaddam, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.00730 · Cited by 6
Evaluating the Long-Term Memory of Large Language Models
Jia, Z., Liu, Q., Li, H., Chen, Y., & Liu, J. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.1014 · Cited by 5
Self-citationMemRouter: Memory-as-Embedding Routing for Long-Term Conversational AgentsPreprint
Hu, T., Lin, W., Zhang, W., Ma, J., & Wang, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.00356 · Cited by 4
From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs
Wu, Y., Liang, S., Zhang, C., Wang, Y., Zhang, Y., Guo, H., Tang, R., & Liu, Y. (2025) · arXiv · doi:10.48550/arxiv.2504.15965 · Cited by 3
“…MemoChat [51], MemoryBank [17], RMM [52], LD-Agent [53], A-MEM [54], Generative Agents [55], EMG-RAG [56], KGT [46], LLM-Rsum [57], COMEDY [58] Retrieval RET-LLM [44], ChatDB [59], Human-like Memory [60], HippoRAG [13], HippoRAG 2 [61], EgoRAG [62], MemInsight [50] Usage MemoCRS [63],…”
Kim, S., Lee, Y., Kim, S., Kim, H., & Cho, S. (2025) · Findings of the Association for Computational Linguistics: EMNLP 2025 · doi:10.18653/v1/2025.findings-emnlp.1204 · Cited by 2
On Memory Construction and Retrieval for Personalized Conversational Agents
Pan, Z., Wu, Q., Jiang, H., Luo, X., Cheng, H., Li, D., Yang, Y., Lin, C.-Y., Zhao, H. V., Qiu, L., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.05589 · Cited by 2
Generating, retrieving persona and generating responses for long-term open-domain dialogue
Cha, D., Lee, D., & Kim, J. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.2979 · Cited by 2
Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics
Du, Y., Huang, W., Zheng, D., Wang, Z., Montella, S., Lapata, M., Wong, K.-F., & Pan, J. Z. (2025) · arXiv · doi:10.48550/arxiv.2505.00675 · Cited by 1
Cognitive Memory in Large Language Models
Shan, L., Luo, S., Zhu, Z., Yuan, Y., & Wu, Y. (2025) · arXiv · doi:10.48550/arxiv.2504.02441 · Cited by 1
Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMs
Zhao, W., Hu, Y., Deng, Y., Guo, J., Sui, X., Han, X., Zhang, A., Zhao, Y., Qin, B., Chua, T., et al. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.544 · Cited by 1
When AI Remembers: Investigating the Dual Role of Long‐Term Memory in Chatbots
Parvizian, M., Whittaker, L., Daronkola, H. K., Pallant, J. L., & Johnson, L. W. (2026) · Psychology and Marketing · doi:10.1002/mar.70267 · Cited by 1
The AI Hippocampus: How Far are We From Human Memory?
Jia, Z., Li, J., Kang, Y., Wang, Y., Wu, T., Wang, Q., Wang, X., Zhang, S., Shen, J., Li, Q., et al. (2026) · arXiv · doi:10.48550/arxiv.2601.09113
Self-citationMemRefine: LLM-Guided Compression for Long-Term Agent Memory
Kim, M., Baek, J., Jeong, S., & Hwang, S. J. (2026) · arXiv · doi:10.48550/arxiv.2606.13177
“Session-level summarization (Wang et al., 2025; Chen et al., 2025) compresses raw conversation history before it enters memory rather than the resulting store, prompt or retrieved-context compression (Jiang et al., 2023; Xu et al., 2024; Jiang et al., 2024) operates at inference time on the…”
Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory
Yuen, S., Medina, F. G., Su, T., Du, Y., & Sobey, A. J. (2025) · arXiv · doi:10.48550/arxiv.2508.08997
All-Mem: Agentic Lifelong Memory via Dynamic Topology Evolution
Lv, C., Chang, H., Tao, S., Chen, M., Fan, Z., Zhang, Z., Guo, Y., & Zhou, S. (2026) · arXiv · doi:10.48550/arxiv.2603.19595 · Cited by 11
SOMA: Efficient Multi-turn LLM Serving via Small Language ModelPreprint
Cheng, X., Wu, Q., Zhou, Z., Zhou, X., Derr, T., & Dong, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.11317
Enhancing Software Engineering Through Closed-Loop Memory OptimizationPreprint
Guo, X., Wang, Z. Z., Wang, Q., Wang, Q., Neubig, G., & Ji, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.05646
MENTOR: Mitigating Identity Drift in Dynamic Role-Playing via Dual-Chain Structured Memory
Zhuoning, Z., Gao, X., & Shi, H. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1046
Metadata
- Authors
- Chen, N., Li, H., Huang, J., Wang, B., & Li, J.
- Affiliations
- The Hong Kong University of Science and Technology (Guangzhou) (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2402.11975
- OpenAlex
- W4391987972
- Cited by
- 3
- References
- 0
- Citations by year
- 2025: 2 · 2024: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- dialogue systems, memory compression, memory formation, response generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
