The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Beyond Goldfish Memory: Long-Term Open-Domain Conversation
Open accessAbstract
Despite recent improvements in open-domain dialogue models, state-of-the-art models are trained and evaluated on short conversations with little context.In contrast, the long-term conversation setting has hardly been studied.In this work we collect and release a humanhuman dataset consisting of multiple chat sessions whereby the speaking partners learn about each other's interests and discuss the things they have learnt from past sessions.We show how existing models trained on existing datasets perform poorly in this long-term conversation setting in both automatic and human evaluations, and we study long-context models that can perform much better.In particular, we find retrieval-augmented methods and methods with an ability to summarize and recall previous conversations outperform the standard encoder-decoder architectures currently considered state-of-the-art.* We use this term colloquially, see Agranoff et al. (1965) for evidence of goldfish long-term memory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jegou, H. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2921572 · Cited by 4,228
Running experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.550 · Cited by 3,575
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101
Longformer: The Long-Document Transformer
Beltagy, I., Peters, M. E., & Cohan, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05150 · Cited by 2,281
Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering
Izacard, G., & Grave, E. (2020) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2007.01282 · Cited by 2,242
Reading Wikipedia to answer open-domain questions
Chen, D., Fisch, A., Weston, J., & Bordes, A. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1171 · Cited by 1,546
Self-citationReformer: The Efficient Transformer
Kitaev, N., Kaiser, Ł., & Levskaya, A. (2020) · arXiv · doi:10.48550/arxiv.2001.04451 · Cited by 1,435
Cited by
Sorted by citations
Items 201–216 of 216
SWin: A Sliding Window Summarization Approach for Coherent LLM-driven Dialogue Systems
Savant, S., Zhao, Y., Yan, J., & Rengarajan, N. K. K. (2026) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai68641.2026.11536307
Verification-Gated Persona State Transitions for Memory-Augmented Language Agents
Li, F., Li, J. M., Ma, S., & Liu, Y. (2026) · Symmetry · doi:10.3390/sym18061037 · Cited by 1
Efficient Memory Alignment for Long-term Conversational Information Seeking
Xu, Q., Liu, X., Zhouhua, F., Li, Y., Liu, Z., Lee, V., & Wang, H. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809926
Ke, C., Liang, B., Liu, X., Yu, Y., Wang, H., & Xu, R. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809646 · Cited by 1
Ding, C., & Zhu, W. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3520-9_15
Rapid Episodic-Merging Memory for LLM Agents
YANG, H., & Gopalakrishnan, A. K. (2026) · International Conference on Mechatronics, Robotics, and Artificial Intelligence (MRAI) · doi:10.1109/mrai70020.2026.11621122
PersonaEcho: A Personalized Voice Companion
Chen, X., & Liu, Y. (2026) · International Conference on Artificial Intelligence, Big Data and Algorithms (CAIBDA) · doi:10.1109/caibda70336.2026.11621105
Visual Memory-Augmented Architecture for Persistent Multimodal Conversational Agents
Gandikota, L. R., Gudipati, V. R. S., Aluvala, S. K., PONUGOTI, S., & Konda, S. T. R. (2026) · International Conference on Revolutionary Artificial Intelligence and Future Applications (Rev-AI) · doi:10.1109/rev-ai70456.2026.11622132
Li, C., Tang, H., Qi, X., Yang, B., & Liu, D. (2026) · IEEE Access · doi:10.1109/access.2026.3732026
Zaitsev, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39150-6_14
Talk to Me Kindly: Designing AI Companions to Foster Positive Self-Talk in Young Adults
Gedeus, A.-K., Wagener, N., Li, Y., Bai, Y., Felver, J. C., Difede, J., Yoon, S., & Taylor, A. M. (2026) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3829807.3829873
Gupta, U., Gupta, D., Shukla, S., & Uditanshu (2026) · International Conference on Intelligent Computing and Sustainable Innovations in Technology (IC-SIT) · doi:10.1109/ic-sit69723.2026.11735767
Seamless: Self-Maintaining Knowledge Graph Memory for Retrieval-Augmented Language Models
Smirnov, N. (2026) · IEEE Access · doi:10.1109/access.2026.3747787
When Do Memories Break? Chain-of-Stage Diagnosis for LLM Memory Systems
Wang, C., Fu, Y., Zheng, Z., Qin, S., Cao, Z., & Liu, Z. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1042
Ding, K., Xu, X., Feng, C., & Wu, Y. (2026) · doi:10.1109/eecct71142.2026.11746548
Nannapaneni, S. K., & Nannapaneni, J. (2026) · doi:10.1109/icact70625.2026.11748725
Metadata
- Authors
- Xu, J., Szlam, A., & Weston, J.
- Affiliations
- Meta (United States) (US)
- ORCID
- Xu, Jing
- Venue
- Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2022
- Pages
- 5180-5197
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W3186804217
- Cited by
- 188
- References
- 42
- Citations by year
- 2026: 33 · 2025: 30 · 2024: 32 · 2023: 51 · 2022: 36
- FWCI
- 19.38
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, public-domain)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- open-domain dialogue, long-context models, retrieval-augmented generation, dialogue summarization, chatbot evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
